curl: (52) Empty reply from server

$ curl http://localhost:8080/v1/completions -H "Content-Type: application/json" -d '{
     "model": "gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin",
     "prompt": "A long time ago in a galaxy far, far away",
     "temperature": 0.7
   }'
curl: (52) Empty reply from server

running this command crashes the docker container.

i believe this model isn't supported, but ideally the server wouldnj't crash.

Please show us more detail. for example, the container's log

localai-api-1  | 1:02PM DBG [llama] Attempting to load
localai-api-1  | 1:02PM DBG Loading model llama from gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | 1:02PM DBG Loading model in memory from file: /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | llama.cpp: loading model from /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | error loading model: llama.cpp: tensor '���x�7�h' should not be<PHONE_NUMBER>-dimensional
localai-api-1  | llama_init_from_file: failed to load model
localai-api-1  | 1:03PM DBG [llama] Fails: failed loading model
localai-api-1  | 1:03PM DBG [gpt4all-llama] Attempting to load
localai-api-1  | 1:03PM DBG Loading model gpt4all-llama from gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | 1:03PM DBG Loading model in memory from file: /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | llama.cpp: loading model from /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | error loading model: unknown (magic, version) combination: 67676a74, 00000002; is this really a GGML file?
localai-api-1  | gptjllama_init_from_file: failed to load model
localai-api-1  | LLAMA ERROR: failed to load model from /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | gpt2_model_load: loading model from '/models/gml-gpt4all-j.bin'
localai-api-1  | stablelm_model_load: loading model from '/models/gml-gpt4all-j.bin' - please wait ...
localai-api-1  | dollyv2_model_load: loading model from '/models/gml-gpt4all-j.bin' - please wait ...
localai-api-1  | redpajama_model_load: loading model from '/models/gml-gpt4all-j.bin' - please wait ...
localai-api-1  | replit_model_load: loading model from '/models/gml-gpt4all-j.bin' - please wait ...
localai-api-1  | gpt_neox_model_load: loading model from '/models/gml-gpt4all-j.bin' - please wait ...
localai-api-1  | bert_load_from_file: loading model from '/models/gml-gpt4all-j.bin' - please wait ...
localai-api-1  | starcoder_model_load: loading model from '/models/gml-gpt4all-j.bin'
localai-api-1  | 1:03PM DBG [gpt4all-llama] Fails: failed loading model
localai-api-1  | 1:03PM DBG [gpt4all-mpt] Attempting to load
localai-api-1  | 1:03PM DBG Loading model gpt4all-mpt from gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | 1:03PM DBG Loading model in memory from file: /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | mpt_model_load: loading model from '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin' - please wait ...
localai-api-1  | mpt_model_load: invalid model file '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin' (bad magic)
localai-api-1  | GPT-J ERROR: failed to load model from /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin1:03PM DBG [gpt4all-mpt] Fails: failed loading model
localai-api-1  | 1:03PM DBG [gpt4all-j] Attempting to load
localai-api-1  | 1:03PM DBG Loading model gpt4all-j from gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | 1:03PM DBG Loading model in memory from file: /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | gptj_model_load: loading model from '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin' - please wait ...
localai-api-1  | gptj_model_load: invalid model file '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin' (bad magic)
localai-api-1  | GPT-J ERROR: failed to load model from /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin1:03PM DBG [gpt4all-j] Fails: failed loading model
localai-api-1  | 1:03PM DBG [gpt2] Attempting to load
localai-api-1  | 1:03PM DBG Loading model gpt2 from gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | 1:03PM DBG Loading model in memory from file: /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | gpt2_model_load: invalid model file '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin' (bad magic)
localai-api-1  | gpt2_bootstrap: failed to load model from '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin'
localai-api-1  | 1:03PM DBG [gpt2] Fails: failed loading model
localai-api-1  | 1:03PM DBG [stablelm] Attempting to load
localai-api-1  | 1:03PM DBG Loading model stablelm from gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | 1:03PM DBG Loading model in memory from file: /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | stablelm_model_load: invalid model file '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin' (bad magic)
localai-api-1  | stablelm_bootstrap: failed to load model from '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin'
localai-api-1  | 1:03PM DBG [stablelm] Fails: failed loading model
localai-api-1  | 1:03PM DBG [dolly] Attempting to load
localai-api-1  | 1:03PM DBG Loading model dolly from gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | 1:03PM DBG Loading model in memory from file: /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | dollyv2_model_load: invalid model file '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin' (bad magic)
localai-api-1  | dolly_bootstrap: failed to load model from '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin'
localai-api-1  | 1:03PM DBG [dolly] Fails: failed loading model
localai-api-1  | 1:03PM DBG [redpajama] Attempting to load
localai-api-1  | 1:03PM DBG Loading model redpajama from gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | 1:03PM DBG Loading model in memory from file: /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | redpajama_model_load: invalid model file '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin' (bad magic)
localai-api-1  | redpajama_bootstrap: failed to load model from '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin'
localai-api-1  | 1:03PM DBG [redpajama] Fails: failed loading model
localai-api-1  | 1:03PM DBG [replit] Attempting to load
localai-api-1  | 1:03PM DBG Loading model replit from gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | 1:03PM DBG Loading model in memory from file: /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | replit_model_load: invalid model file '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin' (bad magic)
localai-api-1  | replit_bootstrap: failed to load model from '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin'
localai-api-1  | 1:03PM DBG [replit] Fails: failed loading model
localai-api-1  | 1:03PM DBG [gptneox] Attempting to load
localai-api-1  | 1:03PM DBG Loading model gptneox from gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | 1:03PM DBG Loading model in memory from file: /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | gpt_neox_model_load: invalid model file '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin' (bad magic)
localai-api-1  | gpt_neox_bootstrap: failed to load model from '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin'
localai-api-1  | 1:03PM DBG [gptneox] Fails: failed loading model
localai-api-1  | 1:03PM DBG [bert-embeddings] Attempting to load
localai-api-1  | 1:03PM DBG Loading model bert-embeddings from gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | 1:03PM DBG Loading model in memory from file: /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | bert_load_from_file: invalid model file '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin' (bad magic)
localai-api-1  | bert_bootstrap: failed to load model from '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin'
localai-api-1  | 1:03PM DBG [bert-embeddings] Fails: failed loading model
localai-api-1  | 1:03PM DBG [starcoder] Attempting to load
localai-api-1  | 1:03PM DBG Loading model starcoder from gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | 1:03PM DBG Loading model in memory from file: /models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin
localai-api-1  | starcoder_model_load: invalid model file '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin' (bad magic)
localai-api-1  | starcoder_bootstrap: failed to load model from '/models/gpt4-x-alpaca-13b-ggml-q4_0-cuda.bin'
localai-api-1  | 1:03PM DBG [starcoder] Fails: failed loading model
localai-api-1  | [<IP_ADDRESS>]:42438  500  -  POST     /v1/completions

all subsequent requests hang even when changing to a known good model.

Thanks for your feedback, maybe you can check it later, it is a loop to load the models. And if you want to have a quick start, I suggest you use models here: https://github.com/go-skynet/model-gallery and we will investigate this issue.

the same issue too, My models are these: ggml-gpt4all-j.bin,vicuna-13b-v1.1 , the api container run up sucecess ,but api seems not work :
curl http://localhost:8080/v1/models
curl: (52) Empty reply from server

i got this same result following exactly the steps in the tutorial in the readme

facing same issue with starcoder.cpp

I got the same issue when using ggml-gpt4all-j model, and I solve it later by increase the memory limit of docker. I think it might be a OOM error when loading models with low container memory limit.

I just tried the example (wget https://gpt4all.io/models/ggml-gpt4all-j.bin -O models/ggml-gpt4all-j) and I could not even call /v1/models, it would just say Empty reply from server.

After manually building it, everything seems to work just fine...

In case this helps anyone else, I received this response to the get models curl in the quick start, but about 10 minutes later my model appeared when I asked it again, so perhaps they take some time to load into RAM or something.

I tried using starcoder.cpp model and got the same error, below are the docker logs.
llama.cpp: loading model from /models/starcoder-ggml-q4_1.bin
error loading model: llama.cpp: tensor '' should not be 999572548-dimensional
llama_init_from_file: failed to load model
llama.cpp: loading model from /models/starcoder-ggml-q4_1.bin
error loading model: missing tok_embeddings.weight
gptjllama_init_from_file: failed to load model
LLAMA ERROR: failed to load model from /models/starcoder-ggml-q4_1.bin
mpt_model_load: invalid model file '/models/starcoder-ggml-q4_1.bin' (bad magic)
GPT-J ERROR: failed to load model from /models/starcoder-ggml-q4_1.bingptj_model_load: invalid model file '/models/starcoder-ggml-q4_1.bin' (bad vocab size 13 != 49152)
mpt_model_load: loading model from '/models/starcoder-ggml-q4_1.bin' - please wait ...
gptj_model_load: loading model from '/models/starcoder-ggml-q4_1.bin' - please wait ...
gptj_model_load: n_vocab = 49152
gptj_model_load: n_ctx  = 8192
gptj_model_load: n_embd = 6144
gptj_model_load: n_head = 48
gptj_model_load: n_layer = 40
gptj_model_load: n_rot  = 1003
gptj_model_load: f16   = 49152
GPT-J ERROR: failed to load model from /models/starcoder-ggml-q4_1.binStarting LocalAI using 4 threads, with models path: /models

 ┌───────────────────────────────────────────────────┐
 │          Fiber v2.46.0          │
 │        http://<IP_ADDRESS>:8080/        │
 │    (bound on host <IP_ADDRESS> and port 8080)    │
 │                          │
 │ Handlers ............ 23 Processes ........... 1 │
 │ Prefork ....... Disabled PID ................. 1 │
 └───────────────────────────────────────────────────┘

llama.cpp: loading model from /models/starcoder-ggml-q4_1.bin
error loading model: llama.cpp: tensor '' should not be 999572548-dimensional
llama_init_from_file: failed to load model
llama.cpp: loading model from /models/starcoder-ggml-q4_1.bin
error loading model: missing tok_embeddings.weight
gptjllama_init_from_file: failed to load model
LLAMA ERROR: failed to load model from /models/starcoder-ggml-q4_1.bin
mpt_model_load: loading model from '/models/starcoder-ggml-q4_1.bin' - please wait ...
mpt_model_load: invalid model file '/models/starcoder-ggml-q4_1.bin' (bad magic)
GPT-J ERROR: failed to load model from /models/starcoder-ggml-q4_1.bingptj_model_load: invalid model file '/models/starcoder-ggml-q4_1.bin' (bad vocab size 13 != 49152)
gptj_model_load: loading model from '/models/starcoder-ggml-q4_1.bin' - please wait ...
gptj_model_load: n_vocab = 49152
gptj_model_load: n_ctx  = 8192
gptj_model_load: n_embd = 6144
gptj_model_load: n_head = 48
gptj_model_load: n_layer = 40
gptj_model_load: n_rot  = 1003
gptj_model_load: f16   = 49152
GPT-J ERROR: failed to load model from /models/starcoder-ggml-q4_1.bin

I think the cause is https://github.com/go-skynet/go-ggml-transformers.cpp/blob/master/mpt.cpp#L196.
I wonder if checking for the magic is really necessary.

Also had this curl: (52) Empty reply from server error.
Turns out it was caused by OOM. Increasing the servers memory fixed the issue.
But this should be reflected somehow. Some error message or something not just crashing and figuring this out blindly.

In case this helps anyone else, I received this response to the get models curl in the quick start, but about 10 minutes later my model appeared when I asked it again, so perhaps they take some time to load into RAM or something.

Yes, this for me. Waited for about 5 mins and it started working, so as mentioned just takes a little time start up and load models etc.

In case this helps anyone else, I received this response to the get models curl in the quick start, but about 10 minutes later my model appeared when I asked it again, so perhaps they take some time to load into RAM or something.

Same to me, but mine takes longer to respond, around 20 mins. I'm using M1 MacBook.


External link for using CVAT

Platform: GKE
I have created a CVAT workspace and in order to annotate my data , I have to go through the main one panel UI, which requires token authentication.
The jobs uploaded on CVAT need to be labelled by third-party sources, so I cannot share one panel authentication token with them.
How can I get an external link to directly connect to CVAT . Instead of going through the one panel UI. the external link will allow the labellers to be authenticated using CVAT's authentication system.
(The question can also be expressed as what address will a NGINX server be hosted at if I use the NGINX template?)
P.s I am new with Kubernetes and so this question might be trivial.

@Armughan-Derq I am working on a few scripts you can use to add users with Workspace specific access - I should have these tested and working by tomorrow.

@Armughan-Derq here are the steps to add readonly users.
Once you add them, you can just give them the URL to the CVAT Workspace. They will be prompted with the Onepanel login screen, once they log in, their users will be automatically created in CVAT. You can then assign them the correct role by clicking Admin > Users and their username in CVAT.
Create readonly role
You only need to create these once.

Save the following as role.yaml:

apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
  name: onepanel-cluster-readonly
rules:
- apiGroups: ['']
  resources: [namespaces]
  verbs: [get, list]
- apiGroups: [onepanel.io]
  resources: [workspaces, workflows]
  verbs: [get, list]

Create the role:

kubectl apply -f role.yaml

Save the following as role-binding.yaml:

kind: ClusterRoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: onepanel-cluster-readonly
roleRef:
  apiGroup: rbac.authorization.k8s.io
  kind: ClusterRole
  name: onepanel-cluster-readonly
subjects:
- kind: ServiceAccount
  name: admin
  namespace: onepanel

Create the role binding:

kubectl apply -f role-binding.yaml

Adding a user
You can add multiple users as follows.
NOTE: In the commands below, replace <username> with the username you're adding
Create a service account:
kubectl create serviceaccount <username> -n onepanel

Bind the user to a role:
kubectl patch clusterrolebinding onepanel-cluster-readonly --type='json' -p='[{"op": "add", "path": "/subjects/-", "value": {"kind": "ServiceAccount", "name": "<username>","namespace": "onepanel" } }]'

Get the auth token for the user:
opctl auth token -u <username>

Deleting a user
kubectl delete serviceaccount <username> -n onepanel

Closing this issue - let us know if you still have any questions.

@rushtehrani Can I use the same script for Azure?


[WIP] Add service account permissions to Kafka quickstart

[x] The commits are squashed in a cohesive manner and have meaningful messages.
[x] N/A - For commits that came from upstream, [UPSTREAM] has been prepended to the commit message
[x] JIRA link(s): https://issues.redhat.com/browse/RHODS-2107
[ ] The Jira story is acked
[ ] An entry has been added to the latest build document in Build Announcements Folder.
[ ] Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious)

@laubai I tried to a succinct summation of the documented process in managed kafka so we don't blow out the size of this quickstart and duplicate everything from theirs.  Let me know what you think.

This looks pretty good, but a few suggestions for improvement:

It's implied by the title, but it might be best to really hammer home that the point of this step is to get information that they will need for later. Just before that top level heading, it would be good to say something like, "Your application needs certain information about your Kafka instance in order to connect to it. Follow these steps to save the information that your application needs."
"In the Connection page" and "In the Kafka Instances page" can both be "On" rather than "In" the page
Let's make the last sentence of our copying steps consistent in their format, so change "This is the bootstrap server endpoint that your application requires to connect to the Kafka instance" to "Your application requires this endpoint to connect to the Kafka instance."

Otherwise, looks good. :)

This looks pretty good, but a few suggestions for improvement:
...

Made those changes @laubai

/retest


sublimepicker lib blocks android UI test automation.

Apps using sublimpicker fails while writing UI tests.
Gradle results pasted below for reference.
Reason: android dependencies aren't upto date with releases.
Solution: can be fixed easily by updating Android dependencies.

FAILURE: Build failed with an exception.

What went wrong:
Execution failed for task ':app:preDebugAndroidTestBuild'.
Conflict with dependency 'com.android.support:recyclerview-v7' in project ':app'. Resolved versions for app (27.1.1) and test app (23.1.1) differ. See https://d.android.com/r/tools/test-apk-dependency-conflicts.html for details.

@faisalmohd83 Hi Faisal, I've updated the dependencies in a recent commit. Can you please check if v2.1.2 resolves this issue?

@vikramkakkar It works now with AndroidX migration.
Appreciate if the libs are updated with latest from Google.
Thanks for updates.


Feature vite

:tada: This PR is included in version 1.2.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Add coverpkg for coverage

Remove unused utils

Pull Request Test Coverage Report for Build 3420

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 89.702%

Totals

Change from base Build 3419:
0.0%

Covered Lines:
9388

Relevant Lines:
10112

💛  - Coveralls


Big custom icons are not centered in toast

Custom JSX icons are currently size constrained by 20x20 and that causes issues with aligning.
Example:

Code:
toast("example", {
  icon: <div style={{
    "height": "30px",
    "width": "30px",
    "border-radius": "50%",
    "background-color": "red",
  }}/>,
});

Thanks for pointing out this issue. Yeah seems like icon sizing could be made more dynamic. I'll push an update to fix this issue tonight 😄

Okay so I have the fix applied and it is published on an alpha branch. You can test it out here.
https://stackblitz.com/edit/vitejs-vite-y39ydn?file=src/App.tsx
Let me know if this works for you too and I will publish it to the main prod version

Thanks for the fast work 🙏. Tested it both in stackblitz and locally. Works without issues.


Add tests for using file system based charts

Right now we are defaulting to compiled-in charts. Many users will be referencing charts in the file system - although we have this functionality it is not currently part of any test and it may in fact be broken atm.

I verified that the functionality is working as expected at least, but we still need tests since this feature is not exercised much.
Downgrading to P1 for now.


Directly collect Semantic Scholar papers into SQL database

Hi @breuleux this is a PR to collect Semantic Scholar papers into SQL database.
I also check if MAG ID for new paper already exists in database. Tested with following commands:
# Import some papers from an author
paperoni import -j ~/Téléchargements/mila-papers.json -c tests/example.db -v -a "Junyoung Chung"

# After found a MAG ID for a paper in database, get related authors IDs in Semantic Scholar:
https://api.semanticscholar.org/graph/v1/paper/MAG:2950067852?fields=authors,title

# Then collect papers from Semantic Scholar for a chosen author:
paperoni collect-semantic-scholar -a 8270717 -c tests/example.db

# Papers collected with existing MAG ID In database should not be duplicated in `paper` table.

NB: In paper_link table, column link_type now contains MAG (uppercase) instead of previous mag (lowercase) for all MAG IDs (including ones imported from JSON), to match Semantic Scholar nomenclature. You may need to rebuild the database to apply this change.
What do you think?

HI @breuleux , PR updated!


fix: busy states during governance transactions

Co-authored-by: Tuditi<EMAIL_ADDRESS>Summary

Please summarize your changes, describing what they are and why they were made.

...
Changelog
- Please write a list of changes

Relevant Issues
Please list any related issues (e.g. bug, task).
Fixes #5726
Testing
Platforms

Please select any platforms where your changes have been tested.

Desktop

[ ] MacOS
[ ] Linux
[ ] Windows

Mobile

[ ] iOS
[ ] Android

Instructions

Please describe the specific instructions, configurations, and/or test cases necessary to test and verify that your changes work as intended.

...
Checklist

Please tick all of the following boxes that are relevant to your changes.

[ ] I have followed the contribution guidelines for this project
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have added or modified tests that prove my changes work as intended
[ ] I have verified that new and existing unit tests pass locally with my changes
[ ] I have verified that my latest changes pass CI workflows for testing and linting
[ ] I have made corresponding changes to the documentation

Some feedback from testing:

(Slightly unrelated but) I got a no unspent voting output found when trying to revote for proposals (after reducing voting power from 1000 to 500 SMR):No unspent voting output found

Until I logged out and back in, my voting power went to 0 SMR even though it was reflected in my available balance (500 SMR). When I logged back in it displayed the correct voting power of 500 SMR.
Since I didn't revote, my expectation was that voting on a proposal would only vote for that single one, but it seems that all my previous votes were remembered. This is convenient for the user since they aren't required to manually re-vote for everything, but it's not the expectation.
UX-wise, it would feel better if we also disabled the "Cancel" button in the ProposalDetailsView since we do it for the popups.

UX-wise, it would feel better if we also disabled the "Cancel" button in the ProposalDetailsView since we do it for the popups.

There is a task to remove this redundant button and replace it with the unvote button so this PR is fine for now


Version & Track Datasets in Production

[Enter feedback here]
Hi, Thank you for explaining this. But can you also explain how can we replicate this versioning behavior of the datasets in production?
From this code, it seems one has to keep adding new locations for the datasets to create a new version. But how does it works in production while orchestrating using Azure DevOps or Github Actions?
from azureml.core import Dataset
get the default datastore of the workspace
datastore = workspace.get_default_datastore()
create & register weather_ds version 1 pointing to all files in the folder of week 27
datastore_path1 = [(datastore, 'Weather/week 27')]
dataset1 = Dataset.File.from_files(path=datastore_path1)
dataset1.register(workspace = workspace,
name = 'weather_ds',
description = 'weather data in week 27',
create_new_version = True)
create & register weather_ds version 2 pointing to all files in the folder of week 27 and 28
datastore_path2 = [(datastore, 'Weather/week 27'), (datastore, 'Weather/week 28')]
dataset2 = Dataset.File.from_files(path = datastore_path2)
dataset2.register(workspace = workspace,
name = 'weather_ds',
description = 'weather data in week 27, 28',
create_new_version = True)
How does the dataset version gets affected if a new parquet file is created in the same dataset location? For eg.
create & register sample_ds version 1 pointing to all the parquet files in the folder sample_ds
datastore_path = [(datastore, 'sample_ds/*.parquet')]
# Assume currently there are 10 parquet files in this location today and 2 new files will get added tomorrow plus 2 older files will be deleted
dataset = Dataset.File.from_files(path = datastore_path2)
dataset.register(workspace = workspace,
name = 'sample_ds',
description = 'Sample Dataset',
create_new_version = True)
# Assume the current version of sample_ds is 2 and it shall update to 3 tomorrow after 2 new files gets added and 2 older files gets deleted And if nothing gets changed in the folder then the existing version shall remain the same
In my code, I am using the dataset.register class to register dataset for the first time but within the pipeline it also runs everytime to find out if the dataset exists with the same name if yes then it skips the registration part and proceeds with the pipeline. How does the logic be written to find out if a new version needs to be created or not for a specific dataset in production?
Now, based on a file addition or deletion from the blob location the dataset version shall also be updated. Please share some sample code or logic to maintain this behavior.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 70fbb1c8-1435-e762-8824-78cf96faed84
Version Independent ID: 062879b5-72cf-2353-63f2-d862fe1b40ba
Content: Microsoft Docs contributor guide overview - Contributor Guide
Content Source: Contribute/index.md
Product: non-product-specific
GitHub Login: @Jim-Parker
Microsoft Alias: jimpark

@pankaj1311 - Thanks for reaching out. You've reached our Docs contributor guide repo, rather than the writers of the article you're referencing. I can help you try to find the right people to answer this question, but I need to know which page in our documentation you were reading. Can you please provide a link to the page?

@pankaj1311 - You have reached the Issues queue for the Docs contributor guide, not a product.
Issues submitted here are reviewed by the repo managers of the Docs contributor guide, not product teams. Your issue should pertain to the documentation in this contributor guide only. Requests for updates to products or product documentation will be closed.
If you have feedback about a product or product documentation, use one of these outlets instead:

For Docs content: The feedback area at the bottom of an article. If there is none, post to our Feedback Portal.

For Learn content: The feedback link at the bottom of each unit. If there is none, use the Report feedback tool at the very bottom of this article.


false section prefs still being applied

Hey Jeremy,
Thank you for your project! I like that this is a unique way to setup a user.js file.
I patterned my project off of your layout and ran into an issue. Even though I mark certain sections as false, some prefs still apply. Can you test on a new profile?
For instance, even though AdvancedPrivacy is set to false, other prefs in that section are also active, like extensions.formautofill.addresses.enabled. And yet "browser.contentblocking.category", "strict" remain on Standard when I start Firefox.
Another example: var betterScrolling = false; but all the prefs in that section are applied.
Third example: I have XOriginTrimmingPolicy set to 1 under Tracking Protection. But an optional section, AdvancedPrivacy, also has this pref and is set to 2, even though the control variable is marked as false. When I start Firefox, this pref is 2 but should be left at 1.
I suspected the format might not handle duplicates well. I removed XOriginTrimmingPolicy from the true section and left it in the false control variable, reset the preference in about:config, but the preference still applies. In other words, if I remove the first instance and only have it once in the file, it still sets it to 2, even though I have that section set to false.
Am I missing a step to prevent Firefox from reading the false control variables?

Hi yokoffing,
I did some digging, and realized the function format isn't actually compatible. Apparantly, it only reads in individual lines, and isn't designed to follow code logic and perform scripting functions.
I stripped it down and just have them clumped into sections now, which is more boring and way less useful. I hope Mozilla updates this logic to allow for a variable/function system like I designed to allow more of a "button" feel that could toggle entire sections, as opposed to needing to update every single individual line.
Thanks for the issue, and I realized that it was working for me originally on my linux browser because of my pref.js file, not the user.js file.
I appreciate the feedback and thanks for the time for submitting the issue here.
Jeremy

the function format isn't actually compatible. Apparantly, it only reads in individual lines, and isn't designed to follow code logic and perform scripting functions.

What I found led me to the same conclusion, but I didn't know if it was accurate.

I realized that it was working for me originally on my linux browser because of my pref.js file, not the user.js file.

Are you saying you altered the pref.js file? Did it work there?


fix: Ensure tools handle parameters passed post-creation correctly

Fixed an issue where multiple RagTool based tools failed to function if parameters were provided after tool creation.
Updated tools to correctly process source file/URL passed by the agent post-creation as per documentation.

Closes #<47>

<3 Love it! :D


fix(insert-menu): ui polish

It looks good. We have an issue where it sometimes end up here, but it doesn't look like that is introduced by this PR.

It looks good. We have an issue where it sometimes end up here, but it doesn't look like that is introduced by this PR.

Never mind, I've fixed it now in https://github.com/sanity-io/sanity/pull/6853


Why spacegray-dark-syntax for VS Code looks better?

I just love this theme, I cannot code without it. Thanks.
Recently I tried the same theme on vs code and it looks even cleaner and better. Can you please take a look there? https://marketplace.visualstudio.com/items?itemName=ionutvmi.spacegray-vscode
I am willing to contribute and improve upon the theme if you want me to. Are we doing something wrong this syntax theme?

Of course u can, just make PR and welcome on board.


docs(various): Documentation changes suggestions including fixes

This PR includes several small fixes and suggests minor changes for clarity based on a couple of users experiences following them both in Mac and Linux boxes.

added a fix for all typos/replacements listed above by @sgoings

Aside from the already-existing comments and the fact that this PR needs a rebase, this patch looks good to me. Marking as such.

moving this out of the 2.2 milestone

@fagiani could you update this PR with the suggestions above and squash the commits?

ping

I went ahead and rebased this PR and adjusted the note format to the admonition format.
https://github.com/deis/workflow/pull/548

@ultimateboy do you think we can close this PR since its included in yours?

@jchauncey sure. I was just keeping it open until the other one was merged.

Now that #548 has been merged, closing.


Compatible with mysql?

Is there any way that this could be compatible with mysql?

Normally it should be out of the box. I haven't really attempted running using a external database. Just make sure that modmail (or any container) can access your database, or just run your database in Docker alongside it.


⚠ Processors has degraded performance

In cccfb93, Processors ($STATUS_URL) experienced degraded performance:

HTTP code: 200
Response time: 47 ms

Resolved: Processors performance has improved in d013703.


There should be clear documentation of how geocoded addresses are stored

With documented geocoded workflows, there is now an expectation that the gaiaDB is extended to include geocoded addresses.
While the gaiaCore tools are one possible way for populating the gaiaDB with geocoded address data, gaiaDB should be geocoder-agnostic.
We need to specify a target for geocoded addresses. If user A uses gaiaCore geocoder, and user B uses something else, they should both be storing data in the correct location and with similar (overlapping where necessary) schema.

Maybe a section in geocoding workflow called "Targets" that explains how downstream processes will look for geocoded location information.

This could be expanded upon to include "how to store non-address level information": https://github.com/OHDSI/GIS/issues/321

Incompatible with more recent thinking about how to use geocoded addresses in Gaia


Is it possible to remove auto /m character in datetime mask

Is there an option or property that allows you to remove, or disable, or replace the m character that is automatically inserted in the "datetime" mask?
OS: All
Browser: All
Inputmask version: 5.0.5

Code sample to reproduce the problem:
 $ ("#dateInput") .inputmask ("datetime", {
     inputFormat: "dd/mm/yyyy",
     jitMasking: true
 });

Screenshot:

EDIT:
I used the onBeforeWrite event to remove the automatic m, but I don't know if this is correct. Is there a better way to do this?
 onBeforeWrite: function (_event, characters) {
     if (characters[3] === "m") {
         characters[3] = ""
     }
 }

Hello,
You can try using a placeholder with a space.

Inputmask("datetime", {   inputFormat: "dd/mm/yyyy",   placeholder: " ",   /* jitMasking: true */ }).mask('input#date');
https://jsfiddle.net/adlersd/wk4goj56/

This works in parts. With this the placeholder is no longer the m character and becomes a blank space. I wanted to remove the placeholder completely.
I tried placeholder: "" but was unsuccessful.

To achieve this new specification you need to enable jitMasking
Inputmask("datetime", {
  inputFormat: "dd/mm/yyyy",
  placeholder: " ",
  jitMasking: true
}).mask('input#date');

To achieve this new specification you need to enable jitMasking
Inputmask("datetime", {
  inputFormat: "dd/mm/yyyy",
  placeholder: " ",
  jitMasking: true
}).mask('input#date');

I'm doing just that, but after typing the second number, it automatically inserts a blank space and a forward slash. I wish you hadn't added that blank space, just the bar.

Duplicate of #2438.
This is fixed int version 5.0.6-beta......

Thanks. Thanks. I'm still using version 5.0.5 (last stable).


homedir parameter not found

Module version: 5.0.0
Puppet version: 4.8.2
OS and version: RHEL 7.2

Bug description
Error: Could not retrieve catalog from remote server: Error 500 on SERVER: Server Error: no parameter named 'homedir' at /etc/puppetlabs/code/environments/elasticsearch/modules/elasticsearch/manifests/service/systemd.pp:165 on Elasticsearch_service_file[/lib/systemd/system/elasticsearch-staging.service] at /etc/puppetlabs/code/environments/elasticsearch/modules/elasticsearch/manifests/service/systemd.pp:165 on node lx-s014.intern.klaverblad.nl
##Description
I was using version 0.16.0 of the module. When I saw the update supporting x-pack, I tried using version 5.0.0. The first puppet run with version 5.0.0 however breaks with the error above.
I commented the homedir parameter at the mentioned line and then the puppet run completes succesfully. However the WorkingDir in the sysconfig file is blank instead of the actual location.
##Manifest
The profile I use to use this class:
class { '::elasticsearch':
java_install             => false,
manage_repo        => false,
version                  => '5.2.0',
autoupgrade         => false,
datadir                  => '/var/lib/elasticsearch',
restart_on_change => true,
}
elasticsearch::instance { 'staging':
}

This is almost certainly due to failing to restart either a puppetmaster or puppet agent somewhere; this problem happens all the time when native types and providers change. Please restart any puppet masters/agents and retry.

Thanks, restarted the puppetserver and that fixed it.

In my opinion it should be changed to no longer require restarting the puppetmaster.
Is this an one-time effort or will it be required in future module upgrades?
In my case restarting the puppetmaster requires cooperation of multiple teams and most likely planning and effort on their side which is difficult to place for the "I would like to try a new puppet module" use-case.

@gna582 unfortunately this is a limitation of Puppet itself - if native types and providers have any of their parameters changed, Puppet usually needs the master restarted. Since this module has lots of native types for resources that talk to Elasticsearch's REST API, updates usually (though not always) need to see the puppetmaster restarted.
Sorry about the inconvenience - if there was a reasonable way to avoid requiring restarts for module changes, I'd certainly try and do it.


Re-thinking the usage of a package facade

As outlined in #253, a package facade could be used as the makeSchema function's outputs.typegen parameter by default, unless overrided explicitly. By using a facade, multiple workarounds could be resolved at package level, available out of the box for everyone.
Experimentation with the @prisma/photon package could be taken as an example for implementing a similar approach with nexus and nexus-prisma.
As an additional benefit, this change may eliminate the need for a prettierConfig option, as files in node_modules don't have to match the style of source code checked into SCM.

@kripod we've gone through this over the past few months. We got half way there then removed the feature. Therefore I can safely say this feature will not be getting addressed at the nexus library level.
It will be up to higher order tooling to address this issue. The good news is we're already on it. Stay tuned.


Can i attach ImGUI to GLFW window?

I wanna know is there is a way to attach ImGUI window to existing GLFW.Net window?

I'm hoping to achieve the same thing, has anyone managed this?

@stephen-wood83 I have been able to get it done using OpenTK.NET. Its a great GLFW / OpenGL library and I highly recommend it. There is even an ImGui Controller example made for OpenTK / OpenGL here.
Good luck!


Move from autocorr to crosscorr

Major changes to analyze-data, as the class Hydrophone has been dropped
I'm a bit uncertain about the correctness of some arrays:
-at line 182 and 189 I make an array to hold some specific values that are later changed in a function. Will the original values be changed?
Note: some of the code from my debugging session during the work-week has been included. This must be dealt with in another pr/issue

Just starting thinking how we would detect which hydrophone measures the signal first. Using the crosscorrelation, we would only get the TDOA in absolute value.

And I realize that the switch from autocorr to crosscorr has large effects on other parts of the code. Do NOT approve the PR. Repeat: Do NOT approve the pr until this is sorted out

To get the crosscorr right, we have to detect the polarity of the index.
If H1 and H2 are signals, and x denotes the cross-correlation between them:
Assuming that H1 arrives before H2 with n timesteps
=>
arg max( H1 x H2 ) = n
arg max( H2 x H1 ) = - n
Please notify if I've swapped the sign here ^^
To get the correct index n, we must therefore do a linear shift of the estimated index-number n_hat

Currently (after way too many hours of refactoring), I would consider the code reasonable. Would therefore encourage a pr (if the code looks good otherwise)

Think I eliminated a possible bug, where the matrices A and B were set to the same value and thus resulted in the same position-estimate every time. See changes to calculate_tdoa_matrices in trilateration.cpp


Map & Layer Database Layout

This Pull request adresses #257
Things I need to:

[ ] Write tests
[ ] Benchmark transformations from Cartesian coordinates to Long-Lat
[ ] Complete the examples

Basics

[ ] Details of what you changed are in commit messages
(first line should have module: short statement syntax)
[ ] References to issues, e.g. close #X, are in the commit messages.
[ ] The buildserver is happy.
[ ] The PR is rebased with current master.

Checklist

[ ] I added unit tests for my code
[ ] I fully described what my PR does in the documentation
(not in the PR description)
[ ] I fixed all affected documentation
[ ] I fixed all affected decisions
[ ] I added code comments, logging, and assertions as appropriate
[ ] I mentioned every code or binary not directly written or done by me in reuse syntax

Review

[ ] Documentation is conforming to our Documentation Guidelines
[ ] Examples are well chosen and understandable
[ ] Code is conforming to our Coding Guidelines
[ ] Code is consistent to our Design Decisions

Is this pull request ready yet?
I'm supposed to implement the base layer use case this week. It would make my life much easier if I could base my work on this PR.

Is this pull request ready yet?

As it is draft, probably not.

I'm supposed to implement the base layer use case this week. It would make my life much easier if I could base my work on this PR.

You can push here or create a new PR on top of this one.


[Improvement]: Support for regular expressions to match database name for Hive Metastore

Search before asking

[X] I have searched in the issues and found no similar issues.

What would you like to be improved?
The existing HMS has a large number of hive tables, and all the databases and tables have to be loaded each time.
Support for regular matching of database
How should we improve?
Add an input when creating a catalog to support regular expressions to match database names
Are you willing to submit PR?

[x] Yes I am willing to submit a PR!

Subtasks
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

@zhoujinsong Sorry for not being clear.
We are going to have iceberg format in our existing cluster, but there are a lot of hive DBs and tables in the existing cluster that I don't need to care about and I don't want to show them in AMS, so I want to exclude them.
Regarding the two points you mentioned both are optimizations that come with this improvement.

Also, when creating a Catalog format can only choose hive or iceberg, but in fact, both may exist in HMS.

@zhoujinsong Sorry for not being clear.
We are going to have iceberg format in our existing cluster, but there are a lot of hive DBs and tables in the existing cluster that I don't need to care about and I don't want to show them in AMS, so I want to exclude them.
Regarding the two points you mentioned both are optimizations that come with this improvement.

Thanks for introducing the detail of your use case.
And welcome to provide a PR to achieve this improvement more quickly.

Also, when creating a Catalog format can only choose hive or iceberg, but in fact, both may exist in HMS.

Yes, we are planning to support multiple formats in a catalog.
Are you interested in joining our development WeChat group, we can discuss some future features here.

@huiyuanz Can you help me with the frontend work?

@huiyuanz Can you help me with the frontend work?

AFAIK, filtering databases and tables on the backend is enough for this feature?

@zhoujinsong
I'm going to add a regular expression input to the catalog creation page to filter the databases.
I've done it on the back end [1], not so good on the front end and have a few questions.
[1] : https://github.com/zhongqishang/arctic/tree/ARCTIC-712

@zhoujinsong I'm going to add a regular expression input to the catalog creation page to filter the databases. I've done it on the back end [1], not so good on the front end and have a few questions.
[1] : https://github.com/zhongqishang/arctic/tree/ARCTIC-712

How do you think put the configuration into catalog properties?
In my option, filter expression is not required for creating every catalog.

By the way, do you want to filter the database on the engine side (flink/spark/trino) too?

How do you think put the configuration into catalog properties?

This should be a good choice.

In my option, filter expression is not required for creating every catalog.

In my scenario, filtering the database will only happen if an existing HMS is loaded into the AMS, other scenarios it should not be necessary.

By the way, do you want to filter the database on the engine side (flink/spark/trino) too?

The catalog registered on the engine side uses the AMS, so filtering should depend on whether the databases exist in the AMS or not, What do you think?


Port to something newer than 1.12.2

While it's nice this exists on Forge at all, and can be enjoyed with all the various Forge-only mods that were around back then and will never leave for Fabric, there's no getting around the fact that 1.12.2 is about six years old at this point. That's about as much time between us and 1.12 as there was between 1.12 and Beta 1.7.3. At this point, it's only useful for anarchy servers and those most stubborn (or abandoned) mods.
The fabric version can support 1.19, 1.18, and 1.17. Why can't the Forge version?

This was a one-off project for a friend who specifically set up a 1.12.2 server. I'm not looking to do more beyond this.

Fair enough.


add flake8

closes #2

I think now that we're adding in black that this is no longer needed? In addition we need to work out dependency management programmatically, as we currently handle dev dependencies manually and the split is arbitrary.

@markrawls - updated


chacha: drop internal HChaCha20.

I dunno how you'll feel about this one, as you said you (understandably) didn't want to meddle with the original package too much.
This removes Andreas' (vendored) implementation of HChaCha20, since x/crypto provides a suitable one.
It doesn't cause any difference at all... because Adiantum doesn't use this at all (see this coverage report). It uses HChaChaN (with configurable rounds) in other places instead.
I guess merging chacha into xchacha would drop even more code.
Not sure what would make it easier to maintain, though.
So feel free to close. The point is not to give you any more headaches, is to figure out if there's anything to make this less of a burden.
PS: thanks for the tag!

hmm. I've reconsidered -- let's custom tailor internal/xchacha to the needs of Adiantum. It feels silly to retain dead code. As long as we remove it thoughtfully, I don't think there's any real reason for concern.

OK, I get something for you to review.
Thanks!

This should already give you an idea of the amount of code that can be removed.
But ISTM the xchacha.go file can be merged with chacha.go.

nice. Yes, I agree, we can merge xchacha.go and chacha.go. Also, the package should be named xchacha, not chacha.

OK. I chose the name just so the diffs were easier to follow (helps me have more confidence in what I'm doing), but I'll do a final rename before opening up for review.
I may also try to factor the generic ChaCha round-pair, as we cary two implementations of it.

I think this is ready for review. I'd probably squash this one and tweak the commit message, as I don't think the intermediate commits add much value.
Only the chacha_test.go diff doesn't carry over.

rad

Would it make sense to tag this? I'm not planning any more contributions.
(I have an hacked up version of s390x assembly - based on x/crypto - but I don't think it's very mergeable; almost no one will use it, why maintain it?)

tagged! thanks for your help. :) I agree, not much need for s390x


Scheduler is running in Central Time

I made a schedule for 2:33 PM EST but it ran at 3:33 PM EST.

it ran at the correct time.  but when I went back to the scheduler the 9:49 AM time I had put in had transformed to 13:49 PM (UTC).

Fixed!


📝 Updated Documentation

Codecov Report

Merging #58 (079722b) into main (b36014b) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #58   +/-   ##
=======================================
  Coverage   98.89%   98.89%
=======================================
  Files          20       20
  Lines         904      904
=======================================
  Hits          894      894
  Misses         10       10

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Java Data Loader (jdl) fails in cTAKES-6.0.0-SNAPSHOT

Hi all,
I am running into the following issue when I attempt to load tables into MSSQL Server using Java Data Loader (jdl) utility in cTAKES-6.0.0-SNAPSHOT. The jdl utility worked fine in cTAKES-5.1.0. The jdl is part of ctakes-ytex package.
It looks like the loader if failing to read the contents of the .txt file:
[java] 12 Sep 2024 09:16:31  INFO CsvLoader - insert into null () values ()
jdbc.sqlcmd is working fine.
ERROR Trace:
uima.create:

jdbc.sqlcmd:
     [echo] db.schema dbo
     [echo] umls.schema UMLS
     [echo] umls.catalog YTEX_TEST
     [echo] execute ./mssql/uima/create_reference.sql
     [copy] Copying 1 file to C:\Users\USERID\AppData\Local\Temp\4
     [echo] executing C:\Users\USERID\AppData\Local\Temp\4\ytex424002541.sql
      [sql] Executing resource: C:\Users\USERID\AppData\Local\Temp\4\ytex424002541.sql
      [sql] 9 of 9 SQL statements executed successfully
   [delete] Deleting: C:\Users\USERID\AppData\Local\Temp\4\ytex424002541.sql
   [delete] Deleting: C:\Users\USERID\AppData\Local\Temp\4\ytex1717560066use.sql

...

uima.create.trigger:

init:
     [echo] java.io.tmpdir C:\Users\USERID\AppData\Local\Temp\4\
     [echo] basedir E:\cTAKES\cTAKES-source\ctakes-ytex\scripts\data
     [echo] umls.data E:\cTAKES\cTAKES-source\ctakes-ytex\scripts\data/umls

init.conn:
     [copy] Copying 1 file to C:\Users\USERID\AppData\Local\Temp\4
uima.ref.load:

jdl:
     [echo] jdl.format ref_uima_type.xml
     [echo] jdl.data ref_uima_type.txt
     [echo] db.schema dbo
     [echo] umls.schema UMLS
     [echo] umls.prefix YTEX_TEST.UMLS.
     [copy] Copying 1 file to C:\Users\USERID\AppData\Local\Temp\4
     [java] 12 Sep 2024 09:16:31  INFO CsvLoader - delimiter 44 encapsulator 65534
     [java] 12 Sep 2024 09:16:31  INFO CsvLoader - insert into null () values ()
     [java] Exception in thread "main" java.lang.NullPointerException: Cannot invoke "java.lang.Number.intValue()" because "ncommit" is null
     [java] 	at org.apache.ctakes.jdl.data.loader.CsvLoader.dataInsert(CsvLoader.java:225)
     [java] 	at org.apache.ctakes.jdl.AppJdl.execute(AppJdl.java:87)
     [java] 	at org.apache.ctakes.jdl.AppMain.main(AppMain.java:84)

BUILD FAILED
E:\cTAKES\cTAKES-source\ctakes-ytex\scripts\data\build.xml:573: The following error occurred while executing this line:
E:\cTAKES\cTAKES-source\ctakes-ytex\scripts\data\build.xml:589: The following error occurred while executing this line:
E:\cTAKES\cTAKES-source\ctakes-ytex\scripts\data\build.xml:535: Java returned: 1

I am encountering this error when I run the following command:
E:\cTAKES\cTAKES-source\ctakes-ytex\scripts\data>ant -Dconfig.local=..\..\target\classes uima.all > uima_all.out 2>&1
I am using the following versions of JAVA and ant:
E:\cTAKES\cTAKES-source\ctakes-ytex\scripts\data>java --version
openjdk 17.0.10 2024-01-16
OpenJDK Runtime Environment Temurin-17.0.10+7 (build 17.0.10+7)
OpenJDK 64-Bit Server VM Temurin-17.0.10+7 (build 17.0.10+7, mixed mode, sharing)

E:\cTAKES\cTAKES-source\ctakes-ytex\scripts\data>ant -version
Apache Ant(TM) version 1.10.14 compiled on August 16 2023

I am using the following version of Microsoft JDBC Driver (https://learn.microsoft.com/en-us/sql/connect/jdbc/release-notes-for-the-jdbc-driver?view=sql-server-ver16#previous-releases). Here's the content of pom.xml file in ctakes-ytex package:
        <dependency>
            <groupId>com.microsoft.sqlserver</groupId>
            <artifactId>mssql-jdbc</artifactId>
            <version>12.6.2.jre8</version>
        </dependency>

Thanks for any help you can provide!

Hi silwalr,
I will try to look into this if I can, but this is fairly far outside my range of experience.  Out of curiosity, what are you using this for?  There are plans to remove large parts of ytex and migrate others.  ytex was dumped into ctakes about 12 years ago and the authors are (to my knowlege) no longer active.  While we try to keep up with problems, the code base is so old that doing so is difficult and takes a significant amount of time.

Hi @seanfinan,
We are working on upgrading our system that runs cTAKES-4.0 to the most recent version of cTAKES at UVA health System. We use the jdl utilities to create/drop UMLS, SNOMEDCT, uima etc tables in MSSQL server. Our cTAKES-4.0 uses Semantic Similarity and Word Sense Disambiguation components of YTEX. Are there plans to drop any of these components in the future? Thanks!

It looks like the problem might just be a drop of feature in one of the updated 3rd party libraries.
It may be a bit of a cheap escape, but I am tempted to release as-is with a "known issue" disclaimer and advise people to use one of the many import guis and scripts that can be found on the web.  There are a lot of "new and shiny" tools out there that make the ytex utility look as old as it is.  What are your thoughts?
As for the semantic similarity and wsd components, I think that you are not alone in wanting those to be kept/migrated, and that is indeed part of the plan for the future.

Releasing it as-is with a "known-issue" sounds like a reasonable thing to do, considering that there are other tools out there that can easily do this job.
Good to know that semantic similarity and wsd components will be retained in the future by popular demand!
Thanks for your timely response.

Excellent, Thanks!


Large media file storage

I'm really excited to find a library that solves "cross-browser storage for all use cases". My use case is that I want to store media files for offline playback. Can I use Store.js for that now? If not, is that a use case that a future release could solve?

I'm confident that we can find a way to store files locally at least in modern browsers!
This will likely depend on #181. Once that's in place it's just a matter of using an audio/video API that supports playback from Files/ArrayBuffers - this wouldn't make sense to put in store.js, but some quick googling pulls up results lots of results like http://stackoverflow.com/questions/32172466/loading-mp3-as-arraybuffer-using-local-file-for-web-audio, and I bet there are lots of libraries for this.
So yes, totally doable! What are you currently using for playback of media files?

Here's another relevant example: https://hacks.mozilla.org/2012/02/storing-images-and-files-in-indexeddb/


Update to fabric networking API v1

and move the rerolling code to a separate reroll(PlayerEntity player) method (so that I can more easily write a compatibility mixin).
P.S. The unified GitHub diff looks god awful, better read the right side of the split view.
P.P.S. Shall I PR an updated gradle build as well?
Auto Config is now part of Cloth and moved host, there's loom 0.6, slightly newer dependencies/mappings and jcenter has reached EOL

Awesome, thank you for the PR!


added public build

Description
Added public build scripts for CPU integration and smoke tests running on Azure Pipelines
Motivation and Context
Allows automatic builds to be run for public PRs

@bethz FYI
We're closing as this is contained in your work


Update Hosted Image versions

@mallibone : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@mallibone Thanks for your contribution!

#sign-off


Update Posts “heard-it-on-the-radio”

Automatically generated by Netlify CMS

👷 Deploy Preview for enchanting-chaja-c384e5 processing.

Name
Link

🔨 Latest commit
54525f81e53acf7c43d6f58a6780e28f45f1c471

🔍 Latest deploy log
https://app.netlify.com/sites/enchanting-chaja-c384e5/deploys/66d38d4bd0a9f100082c821d


the server responded with status 400

Issue Description

fastlane (2.198.1)
fastlane-plugin-firebase_app_distribution (0.3.1)

I'm getting this issue and didn't succeed in the step where CircleCi and Fastlane upload APK to Firebase distribution, I've read every issue and StackOverflow threads but I didn't get anywhere. the token is working locally on my machine and the Fastlane log on CircleCi shows that's authenticated successfully, but didn't proceed to upload the apk.
I've attached the error on CircleCi and distribution lane as follow:
[21:53:06]: ---------------------------------------
[21:53:06]: --- Step: firebase_app_distribution ---
[21:53:06]: ---------------------------------------
[21:53:06]: Authenticating with FIREBASE_TOKEN environment variable
[21:53:06]: 🔐 Authenticated successfully.
[21:53:06]: ⌛ Uploading the APK.
+-------------------------------------+-----------------------------------------------------------------------------------+
|                                                      Lane Context                                                       |
+-------------------------------------+-----------------------------------------------------------------------------------+
| DEFAULT_PLATFORM                    | android                                                                           |
| PLATFORM_NAME                       | android                                                                           |
| LANE_NAME                           | android CI_Distribute                                                             |
| GRADLE_ALL_APK_OUTPUT_PATHS         | ["/home/circleci/project/app/build/outputs/apk/release/app-release-unsigned.apk"] |
| GRADLE_ALL_AAB_OUTPUT_PATHS         | []                                                                                |
| GRADLE_ALL_OUTPUT_JSON_OUTPUT_PATHS | ["/home/circleci/project/app/build/outputs/apk/release/output-metadata.json"]     |
| GRADLE_ALL_MAPPING_TXT_OUTPUT_PATHS | []                                                                                |
| GRADLE_APK_OUTPUT_PATH              | /home/circleci/project/app/build/outputs/apk/release/app-release-unsigned.apk     |
| GRADLE_OUTPUT_JSON_OUTPUT_PATH      | /home/circleci/project/app/build/outputs/apk/release/output-metadata.json         |
+-------------------------------------+-----------------------------------------------------------------------------------+
[21:53:06]: the server responded with status 400

+------+-----------------------------------+-------------+
|                    fastlane summary                    |
+------+-----------------------------------+-------------+
| Step | Action                            | Time (in s) |
+------+-----------------------------------+-------------+
| 1    | default_platform                  | 0           |
| 2    | setup_circle_ci                   | 0           |
| 3    | Switch to android distribute lane | 0           |
| 4    | clean assembleRelease             | 73          |
| 💥   | firebase_app_distribution         | 0           |
+------+-----------------------------------+-------------+

[21:53:06]: fastlane finished with errors

Looking for related GitHub issues on fastlane/fastlane

Fastfile:
default_platform(:android)

platform :android do

  before_all do
    setup_circle_ci
  end

  desc "Runs all the tests"
  lane :test do
    gradle(task: "test")
  end

  desc "Submit a new Beta Build to Crashlytics Beta"
  lane :beta do
    gradle(task: "clean assembleRelease")
    crashlytics
  end

  desc "Deploy a new version to the Google Play"
  lane :deploy do
    gradle(task: "clean assembleRelease")
    upload_to_play_store
  end

#Main Distribute lane
 lane :distribute do |options|
     gradle(task: "clean assembleRelease")
     firebase_app_distribution(
        app: "#{options[:firebaseAppId]}",
        firebase_cli_token: "#{options[:firebaseCliToken]}",
        groups_file: "FirebaseAppDistributionConfig/groups.txt",
        release_notes_file: "FirebaseAppDistributionConfig/release_notes.txt",
     )
 end

#Ci lane
 lane :CI_Distribute do |options|
     distribute(
        firebaseAppId: "#{options[:FIREBASE_APP_ID]}",
        firebaseCliToken: "#{options[:FIREBASE_TOKEN]}",
     )
 end

#Fastlane lane
 lane :Fast_distribute do
     distribute(
        firebaseAppId: ENV["FIREBASE_APP_ID"],
        firebaseCliToken: ENV["FIREBASE_TOKEN"],
     )
 end

end

I'm having the same problem. If I upload the apk manually it works fine. I checked if groups where correct and they are, I don't have release notes and kind of out if ideas what to try.

@taltrui Well, let me explain what I've found;
firstly there's a debug flag you could enable it with Firebase App distribution, and then when it fails, it will log error cause, so What I've got plus the 400 status, is an error message telling me that there's an invalid argument.
The fix was to use Fast_distribute directly instead of CI_Distribute with arguments. But you've to make sure that you've saved token and app id in CircleCi with the same names as Fastlane .env variables.

@MohamedISoliman how did you set the debug flag on Firebase App Distribution? I am getting the same error

@aaronksaunders this is a sample code of mine
 firebase_app_distribution(
        app: "#{options[:firebaseAppId]}",
        firebase_cli_token: "#{options[:firebaseCliToken]}",
        release_notes: "Text of release notes",
        groups_file: "FirebaseAppDistributionConfig/groups.txt",
        release_notes_file: "FirebaseAppDistributionConfig/release_notes.txt",
        debug: true
     )

thanks, will give it a try
--
Aaron K. Saunders
CEO Clearly Innovative Inc - Luma Lab - In3
@.***
www.clearlyinnovative.com
www.In3DC.com
This email message and any attachment(s) are for the sole use of the
intended recipient(s) and may contain proprietary and/or confidential
information which may be privileged or otherwise protected from disclosure.
Any unauthorized review, use, disclosure or distribution is prohibited. If
you are not the intended recipient(s), please contact the sender by reply
email and destroy the original message and any copies of the message as
well as any attachment(s) to the original message.
On Sat, Dec 4, 2021 at 10:57 AM Mohamed Ibrahim @.***>
wrote:

@aaronksaunders https://github.com/aaronksaunders this is a sample code
of mine
firebase_app_distribution(
app: "#{options[:firebaseAppId]}",
firebase_cli_token: "#{options[:firebaseCliToken]}",
release_notes: "Text of release notes",
groups_file: "FirebaseAppDistributionConfig/groups.txt",
release_notes_file: "FirebaseAppDistributionConfig/release_notes.txt",
debug: true
)
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/fastlane/fastlane-plugin-firebase_app_distribution/issues/253#issuecomment-986049391,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAEAFGJFWOPBYPFGHEQQE4LUPI25RANCNFSM5IXDMFNA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.


[home-assistant] Home assistant/db dependencies

Special notes for your reviewer:
Adds dependent chart options for mariadb and postgres. both disabled by default.
Checklist
[Place an '[x]' (no spaces) in all applicable fields. Please remove unrelated fields.]

[X] Chart Version bumped
[X] Variables are documented in the README.md
[X] Title of the PR starts with chart name (e.g. [radarr])

Closes #318


Index selection algorithms should always return a minimal set of indexes with lowest costs.

At least the DropHeuristic has to be adapted.

I am not sure what I wanted back then.


Experiment with GHA build - is it faster to create a .tar.gz?

The upload-action and download-action steps in the GHA build seem to be taking a lot of time uploading and downloading about one and a half thousand files. We should experiment with whether building a .tar.gz out of the tarball directory, before running upload-artifact, would produce faster builds.

It is indeed faster. Compare the "Download build artifacts" step of https://github.com/sillsdev/LfMerge/runs/6603162334?check_suite_focus=true to the same step of https://github.com/sillsdev/LfMerge/runs/6603330095?check_suite_focus=true. The first run, which did not compress artifacts before uploading them, took 71 seconds to download artifacts. The second run, which was downloading compressed .tar.gz files, took only 2 seconds. The uploads were faster, too. So the time spent compressing the artifacts is more than repaid by the much lower time spent in the upload/download process.


3D object alignment with source photo

I'm having some trouble getting the OBJ mesh objects to align with the original photo. It seems like horizontal axis is swapped (although it depends what software you view it in. Any way to control axis orientation (or do you know what the default is for the libraries you're using?)
Related issue is how you created the 3D animated object you use in your demo video. I know this isn't strictly a coding issue, but I'm curious how you handle a sequence of OBJ files to turn them into an animation.

Hi,

If you means the OBJ opened with meshlab is flipped with original 2d image, this is because their aixs relations are y = h - 1 - y. If you want a visual aligned one, you can add save_vertices[:,1] = h - 1 - save_vertices[:,1]  before write obj.
In my demo video, the image are plotted by Matlab. I've answer in #10, the vertices are definitely aligned to the image. And the 3D object are plotted by

imshow(image);
hold on;
patch('Vertices', double(mesh.vertices),  'FaceVertexCData', mesh.colors, 'Faces', mesh.triangles, 'FaceColor', 'interp', 'EdgeColor', 'none', 'EdgeLighting', 'none', 'LineWidth', 1);
camlight('left');

Thanks for your reporting,  if there's other people also care about that, I will modify this.


Documentation is unclear about when "unresponsive" event fires

I experimented with the unresponsive event today. However, I can't seem to successfully trigger it. I tried to simulate application hanging using an infinite loop but without success.
Can you clarify why the event is not being triggered? Then I could add more information to the documentation.
// I tried executing this code after hitting Enter in our app
while (true) {}

browserWindow.on('unresponsive', function () {
  require('dialog').showMessageBox({
    type: 'info',
    message: 'Reload window?',
    buttons: ['Cancel', 'Reload']
  });
});

We basically emit the event when Chromium tells us the window is unresponsive, there is no documentation on when it would be emitted:
https://code.google.com/p/chromium/codesearch#chromium/src/content/public/browser/web_contents_delegate.h&sq=package:chromium&type=cs&l=316


refactor: simplify pull request creation

This pull request is part of a stack:

refactor: simplify pull request creation (#499) 👈
fix: don't recreate merged PR (#500)


Set the application icon, settings window title and systray tooltip

This does minor changes to the UI to better visually identity the application on the desktop.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

LGTM!


Extrahepatic Bile Duct Epithelial Cell

Note - please check that the term does not already exist (check OLS: https://www.ebi.ac.uk/ols/ontologies/cl)
Preferred term label:
Extrahepatic cholangiocyte
Synonyms
Extrahepatic Bile Duct Epithelial Cell
Definition (free text, please give PubMed ID in format PMID:XXXXXX)
An epithelial cell of the extrahepatic portion of the bile duct. Cholangiocytes are the epithelial cells of the bile duct. They are cuboidal epithelium in the small interlobular bile ducts, but become columnar and mucus secreting in larger bile ducts approaching the porta hepatis and the extrahepatic ducts. (PMID:16550043)
Parent cell type term (check the hierarchy here https://www.ebi.ac.uk/ols/ontologies/cl):
Cholangiocyte (CL:1000488)
What is the anatomical structure that the cell is a part of? Please check Uberon: https://www.ebi.ac.uk/ols/ontologies/uberon
extrahepatic bile duct epithelium (UBERON:0004822)
Your nano-attribution (ORCID)
0000-0002-0449-2730
Any additional notes or concerns
Also consider investigating the relationship between "intrahepatic bile duct epithelial cell" (CL:0002538) and Cholangiocyte (CL:1000488) for which bile duct epithelial cell is a synonym. Perhaps subclassify Cholangiocyte (CL:1000488) with “extrahepatic cholangiocyte” and “intrahepatic cholangiocyte” (which is reasonable since there are morphological and functional differences) and rename  intrahepatic bile duct epithelial cell (CL:0002538) to “intrahepatic cholangiocyte” including “intrahepatic bile duct epithelial cell” as a synonym.

Hi @rich-brennan , I'm actually working on this at the moment :) I've got a related ticket here, almost ready for review: https://github.com/obophenotype/cell-ontology/issues/697

Hi Maria,
This ticket (#697https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_obophenotype_cell-2Dontology_issues_697&d=DwMCaQ&c=Dbf9zoswcQ-CRvvI7VX5j3HvibIuT3ZiarcKl5qtMPo&r=R371wBvy7Uz1CadKCOlU0dujKN0lJldd3-jwK0A1nfk&m=82kudcpCBXrB179lK4cxOdwCJVSXFvCNgGurHPYC8dE&s=J6ggUaYxkRyu4ws2k1vY6vlif2pZSnoto_0J16-1EI4&e=) covers the same topic and seems to have the same recommended resolution. Thanks for picking up on this.
BTW (I’m newby on GitHub) when I submitted the issue a group of 3 other people somehow were assigned to the request – did that happen automatically or did I do something inadvertently to link random, unsuspecting people to the issue? The same thing didn’t happen to my UBERON submissions.
Best,
Richard
Richard Brennan, PhD DABT
Scientific Advisor, Preclinical Safety
richard.brennan<EMAIL_ADDRESS>Office:  +1<PHONE_NUMBER>
Mobile: +1<PHONE_NUMBER>
153 2nd Avenue, Waltham, MA 02451, USA
<EMAIL_ADDRESS>Please consider the environment before printing this email!
From: Maria Keays<EMAIL_ADDRESS>Sent: Wednesday, September 30, 2020 5:11 AM
To: obophenotype/cell-ontology<EMAIL_ADDRESS>Cc: Brennan, Richard /US<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: [EXTERNAL] Re: [obophenotype/cell-ontology] Extrahepatic Bile Duct Epithelial Cell (#755)
EXTERNAL : Real sender is<EMAIL_ADDRESS>Hi @rich-brennanhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_rich-2Dbrennan&d=DwMCaQ&c=Dbf9zoswcQ-CRvvI7VX5j3HvibIuT3ZiarcKl5qtMPo&r=R371wBvy7Uz1CadKCOlU0dujKN0lJldd3-jwK0A1nfk&m=82kudcpCBXrB179lK4cxOdwCJVSXFvCNgGurHPYC8dE&s=qF6q1fFRPGL-mDqK9F6eGK-n-r2BUm8WmKSvLxGOjVs&e= , I'm actually working on this at the moment :) I've got a related ticket here, almost ready for review: #697https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_obophenotype_cell-2Dontology_issues_697&d=DwMCaQ&c=Dbf9zoswcQ-CRvvI7VX5j3HvibIuT3ZiarcKl5qtMPo&r=R371wBvy7Uz1CadKCOlU0dujKN0lJldd3-jwK0A1nfk&m=82kudcpCBXrB179lK4cxOdwCJVSXFvCNgGurHPYC8dE&s=J6ggUaYxkRyu4ws2k1vY6vlif2pZSnoto_0J16-1EI4&e=
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_obophenotype_cell-2Dontology_issues_755-23issuecomment-2D701266196&d=DwMCaQ&c=Dbf9zoswcQ-CRvvI7VX5j3HvibIuT3ZiarcKl5qtMPo&r=R371wBvy7Uz1CadKCOlU0dujKN0lJldd3-jwK0A1nfk&m=82kudcpCBXrB179lK4cxOdwCJVSXFvCNgGurHPYC8dE&s=M5y42D85LD3wfrY-n3dnC_OCw-tjkCr2Gua6fK8rzPc&e=, or unsubscribehttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_ARESG64UQ5X2SEI64EYSLO3SILY2HANCNFSM4R6G52NQ&d=DwMCaQ&c=Dbf9zoswcQ-CRvvI7VX5j3HvibIuT3ZiarcKl5qtMPo&r=R371wBvy7Uz1CadKCOlU0dujKN0lJldd3-jwK0A1nfk&m=82kudcpCBXrB179lK4cxOdwCJVSXFvCNgGurHPYC8dE&s=6WIvQx0lt_DnaN3ytXzsyLVHKxR2xOgwTynBFhupl84&e=.

BTW (I’m newby on GitHub) when I submitted the issue a group of 3 other people somehow were assigned to the request – did that happen automatically or did I do something inadvertently to link random, unsuspecting people to the issue? The same thing didn’t happen to my UBERON submissions.

It happened automatically, we created templates in this repo, so certain people are automatically assigned to certain types of tickets.
We have templates in Uberon too, but don't have the automatic assignments set up.
@rich-brennan when you reply to a github ticket via email, it posts your email signature on this public page. I am going to delete it above.

@rich-brennan great, I think I will close this one as #697 seems to cover it. Can update you when the terms are released.


postgresql support?

would be nice to have options for the used DB.

I guess that this feature would be a solution for you: https://github.com/electerious/Lychee/issues/83


refactor: update to the latest Angular next versions and account for schematics breaking changes

These changes update us to the latest next versions of the Angular packages and the latest canary of MDC.
Furthermore, the latest version of the CLI removed some deprecated APIs that we were depending on. These changes update all the code so that it used the correct API (according to the CLI team). High-level overview of the changes and why they were necessary:

Previously we parsed the angular.json ourselves using JSON.parse in order to support very old versions of the CLI, however this is no longer feasible, because the CLI has set up classes around the parsed data which are non-trivial to construct. According to the CLI, we don't have to worry about older version anymore, because the schematics infrastructure will ensure that we're running against the correct version.
The interface of the new API is different from the one we were using before so I had to rewrite some code.
Some of these new APIs are asynchronous so I've had to move some code around to accommodate it.
Previously we would JSON.parse and JSON.stringify the angular.json file whenever we needed to mutate it (e.g. when adding a theme), but this isn't possible anymore due to the aforementioned classes around the config file. I've reworked our schematics to use a utility from the CLI to write to the file.
A lot of our tests depended on parsing the angular.json, changing a property and writing it back as JSON. This isn't possible, because the abstraction around the config can't be stringified so I've worked around it by writing out the angular.json file from scratch in the test. While this is more code, it should be easier to maintain in the long term.

@jelbourn this one is finally ready for review.


[cmake] Add "tracelog" build option to define BONEFISH_DEBUG.

@davidchappelle, please have a look if this is done the right way.

I changed the commit after discovering that there's a second BONEFISH_TRACE() implementation that's not in logging.hpp, and that's the one that's used. The --debug option is already documented in the README.txt, which is good, I just stumbled by looking at the code directly. So, to avoid confusing people like me, let's get rid of logging.hpp entirely.

Thanks @jpetso. Must have accidentally committed logging at some point and then changed to use trace. Removing the logging directory was the right fix.


linux-hardkernel_4.9.bb: Update to 4.9.312 and fix with gcc12

Signed-off-by: Khem Raj<EMAIL_ADDRESS>

thanks


Edit filenames addon

Got browse - would be nice if could edit filenames.
The way I see this working is:

Put a pencil icon next to the folder/file icon
Click it and filename loads in a textbox with save icon button on the right
Clicking the save icon button renames the file to what is in the textbox

of course optimisation is, if not different don't waste time writing to disk

If this can be done in the browser via html, then should be doable from other places, aka its an api thing. /orginal-filename.txt?rename=new-filename.txt - I don't know something simple...
so there are two parts

a new default template for browse if browse & rename are enabled at the same time
own middleware looking out for renaming directions

need to make the call on rename = moving... not sure about that. I am going to just do simple rename and edit out os_directory_separator (whatever the go_lang of this is).

so this stuff below has ZERO to do with caddy, it is simply why I came to Caddy and why I want a http in road to renaming files ;)
grand plan is to make a useful media manager for Kodi (or any multi platform player that has a http/websockets api) - been using it and Kore (remote on android) and frankly, some really annoying ux things that shouldn't exist (weird sorting, cut off file names, doesn't allow fixing matches of scrapers to filenames). Kodi has a functional API to control & play content remotely - awesome!, media library/navigating lots of files is weird - less awesome...
Writing the media manager in Ember.js using local storage and firebase (multi-device sync) - so need static file serving. Simplest way to get content over the network to kodi is via http, hence Caddy browse. Webapp being Ember needs some static hosting love as well. Caddy runs on android (bit awkward, however it works... must be possible to wrap in a minimal app like aria2 currently is)
ultimate plan = have screens, have files, have people, have devices = everything talk to everything and let people keep track of separate things or same things... purposefully vague, cryptic and open ended.

Let me share my thoughts on this and maybe that will help materialize a vision for your plans a bit more.
I like the idea of a file manager add-on for Caddy, but renaming files shouldn't be part of the browse middleware. Implicit in the idea of any kind of mutations through a Caddy plugin is authentication.
Caddy is a great platform on which to deploy your web app - so I think you're on the right track, but it should be separate from browse.

indeed @mholt - I intend to make this rename addon standalone. All I need is some simple api to rename files. This is something I could take on and complete in a reasonable amount of time. A full blown file manager is way out of scope for me :) (i see the upload addon is coming along, so nearly have all the bits that would make a file manager)
With relation to browse my only interaction with that addon is through the existing interface of specifying a template file (I've already tweaked the existing template as it would wrap lines and wasn't using a monospaced font) in the in the caddyfile. This is where i would expose an example UI or implementation of the rename functionality. In other words rename doesn't have any UI and doesn't care about any other middlewares.
Regarding auth, yes a feature complete rename addon should consider auth as randoms renaming files willy nilly is to be avoided. For v1 though renaming files is the goal, v2 can figure out auth. Will look at existing auth strategies and see how that might be used for rename. Out of the box though specify rename in the caddyfile should be all that is needed to enable, if auth is required then add extra params or middleware.

for whatever reason I missed the "setup" part of creating middleware...
https://github.com/mholt/caddy/wiki/Writing-Middleware
Now that I've re-read the docs, I'll probably be able to get this up and running shortly :)
Was playing on hard mode for some reason...

Maybe auth should be a separate middleware (smaller, simpler middleware are good). See #246 and #109 for that.
A Caddy file manager seems like an appropriate add-on to have, though, at yours or anyone's leisure. :smile:

separate auth +1 (you get an auth, you get an auth, every middleware gets an auth)
nearly getting to the point where I really want this. however have a couple of other things I want to work first (nothing to do with caddy, involve the same files that eventually get served by caddy)
re-thought the rename functionality, it needs to be able to move files around the current filetree. example:

root /home/user/www/html
currently at http://domain/dir1/dir2/
want to rename file /dir1/dir2/file1.txt to /dir1/dir3/renamed_file1.txt = works

thus the result is /home/user/www/html/dir1/dir2/file1.txt becomes /home/user/www/html/dir1/dir3/renamed_file1.txt (dir3 is created if it doesn't exist)

so can only move/rename files around within current root :)
auto create parent directories as needed (assuming stdlib has this, otherwise that is a bit painful, still doable though)

full blown file manager addon would be ideal, however that is pretty full on, go with a php or other solution i reckon :P

No, no PHP. :-1: It can be written in Go. :wink:

haha - i mean they already exist, if a full on file manager is required, use an existing one :)

Could make it to one of the next versions of #249. For our notes, from WebDAV:
curl \
  -X MOVE \
  --header 'Destination: /to/new.file' \
  https://caddyserver.com/from/old.file

@SoreGums if you can, have a look at my plugin. I've implemented DELETE in wmark/caddy.upload@f77c34aa2a506b14d75bf65cb2acdc4ae08778ac

Caddy with plugin Upload are out. There are not many auth plugins available, yet, so you could ping all authors and standardize a flag (header?) and, if it's set, display that button in middleware browse. Should be very few lines of JS on top of that.

@SoreGums and @wmark - thanks for your comments! There is a lot of good stuff here, so I have linked to this issue from a thread in our community forum where we are aggregating ideas/requests for Caddy plugins.
If you want to continue discussing the plugin before development begins on it, feel free to start a new topic on the forum. :+1: Hope to see you participate with us there!

You can rename files using plugin Upload.


Add the ability to copy k8s object name

This PR makes it easier to copy any of the pod names , configmaps and so on by adding a button to the k8s object menu

Hello @aleksfront, thank you for your feedback, I have moved the copy functionality as suggested, can you review it again please?

@aleksfront , thanks, that was really helpful. The requested changes are done.
Regarding changing the tooltip suggestion, I decided to implement it similar to what Github is doing when you copy the branch name.

The icon will change to "done"
The tooltip will change to "Copied!"
Everything will be reverted to its original state based on "setTimeOut" instead of using "onMouseOut" event.

What do you think?

@aleksfront , thanks, that was really helpful. The requested changes are done.
Regarding what should happen when you click the copy button, I decided to implement it similar to what Github is doing when you copy the branch name or file path.

The icon will be changed to "done"
The tooltip will be changed to "Copied!"
Everything will be reverted to its original state based on setTimeOut instead of using onMouseOut event.

What do you think?

@mostafahussein Added a few tiny comments, please take a look. Otherwise, looks good!

@aleksfront  all done 🎉 ,  you can check it now

There's 2 linter errors over there. Please run yarn lint:fix.


Vertical & Horizontal line markers

Users are requesting vertical & horizontal lines for the purpose of annotating events or thresholds

Notice: this issue has been closed because it has been inactive for 257 days. Feel free to comment and request for this issue to be reopened.


Add missing filter operator for dotnet test

I've needed this operator and it' looks like it's working properly but it's not listed in the docs

@mairaw could you please review?

@AndreyTretyak Hi there. Sorry for the delay on this. We based this information on the docs provided by the vstest docs: https://github.com/Microsoft/vstest-docs/blob/master/docs/filter.md which doesn't have this listed.
@nigurr @singhsarab can one of you comment? Thanks!

LGTM.
/cc: @nohwnd


how tu use other model

#114
hello sir when i'm trying to use the model fasterrcnn_efficientnet_b4 instead of the default one i'm getting an error at the begining i found that it is not mentioned on the create_fasterrcnn_model.py so i add it but when i'm runing the command like this it shows error
!python train.py --model fasterrcnn_efficientnet_b4 --epochs 10 --data data_configs/custom_data.yaml
how can i solve it ?
------- error -----------
!python train.py --model models/fasterrcnn_efficientnet_b4.py --data data_configs/custom_data.yaml fix this 2024-05-27 08:03:01.976187: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-05-27 08:03:01.976243: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-05-27 08:03:02.076856: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2024-05-27 08:03:02.085446: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 AVX512F FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2024-05-27 08:03:03.152786: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
Not using distributed mode
wandb: (1) Create a W&B account
wandb: (2) Use an existing W&B account
wandb: (3) Don't visualize my results
wandb: Enter your choice: 3
wandb: You chose "Don't visualize my results"
wandb: Tracking run with wandb version 0.17.0
wandb: W&B syncing is set to offline in this directory.
wandb: Run wandb online or set WANDB_MODE=online to enable cloud syncing.
device cuda
Checking Labels and images...
100% 573/573 [00:00<00:00, 136989.07it/s]
Checking Labels and images...
100% 163/163 [00:00<00:00, 203473.68it/s]
Creating data loaders
/usr/local/lib/python3.10/dist-packages/torch/utils/data/dataloader.py:558: UserWarning: This DataLoader will create 4 worker processes in total. Our suggested max number of worker in current system is 2, which is smaller than what this DataLoader is going to create. Please be aware that excessive worker creation might get DataLoader running slow or even freeze, lower the worker number to avoid potential slowness/freeze if necessary.
warnings.warn(_create_warning_msg(
Number of training samples: 573
Number of validation samples: 163
Building model from scratch...
Traceback (most recent call last):
File "/content/fastercnn-pytorch-training-pipeline/train.py", line 571, in
main(args)
File "/content/fastercnn-pytorch-training-pipeline/train.py", line 305, in main
build_model = create_model[args['model']]
KeyError: 'models/fasterrcnn_efficientnet_b4.py'
Traceback (most recent call last):
File "/content/fastercnn-pytorch-training-pipeline/train.py", line 571, in
main(args)
File "/content/fastercnn-pytorch-training-pipeline/train.py", line 305, in main
build_model = create_model[args['model']]
KeyError: 'models/fasterrcnn_efficientnet_b4.py'
wandb: You can sync this run to the cloud by running:
wandb: wandb sync /content/fastercnn-pytorch-training-pipeline/wandb/offline-run-20240527_080317-2gkbw1tf
wandb: Find logs at: ./wandb/offline-run-20240527_080317-2gkbw1tf/logs

Will check it and reply here.

Hello. After adding the function, please update the create_model dictionary in the create_fasterrcnn_model.py file. Add the following key-value pair.
'fasterrcnn_efficientnet_b4': return_fasterrcnn_efficientnet_b4
I hope that you have written the return_fasterrcnn_efficientnet_b4 function already.

@sovit-123 i already did thank you so much sir i just wanna know how can i print the validation metrics like obj_loss and so on ?

Hi. Validation loss is not included as of now as the loss is directly returned by the model. And the Torchvision detection models do  no include the calculation of validation losses. Only validation mAP is possible.


cleanup

"SQL Stored   " deleted

@lianghong42 : Thanks for your contribution! The author, @minewiskan, has been notified to review your proposed change.

#sign-off
@lianghong42  Thanks for catching this!


fix: Refactoring And Features

Description:

Refactored the code
Implemented the new features
Ref: TaskList

Can you structure the java file into packages like move all the service into service package and keep the class containing main outside

Fixed it.


Can a network that uses depthwise separable convolution be converted into an INN and trained using the code？

I encountered this error while trying to convert a structure like MobilenetV3 to INN and train it.
"RuntimeError: Given groups=64, weight of size [64, 64, 3, 3], expected input [64, 64, 160, 160] to have 4096 channels, but got 64 channels installed".
May I ask if your current code supports depthwise separable convolution?Or, in principle, does INN support depthwise separable convolutions?
Thank you very much if you could answer my question

Unfortunately, the current implementation does not support such convolutions. However it looks like it's easy to add.
We will add this soon in the next update. Thank you for your comment.


Add mention of basic scope handling to migration guide

Problem Statement
With the introduction of the dedicated "basic" scope in Keycloak, existing realm configurations with custom clients might now produce access tokens that don't contain the sub claim anymore. This is because the new basic scope that emits those claims might be removed by an explicit defaultClientScopes configuration.
The Keycloak 25 migration documentation documents that the basic scope is automatically added to existing clients during realm migration, however some client configurations with a defaultClientScopes configuration might lack the basic scope configuration. In that case keycloak-config-cli will remove the basic scope again.
Proposed Solution
Add a short note to the migration guide about the need to add the basic scope explicitly when a client configuration uses defaultClientScopes.
A workaround is to configure the basic scope explicitly via defaultClientScopes
    defaultClientScopes:
      - "basic"

Environment

Keycloak Version: 25.0.1
keycloak-config-cli Version: 6.0.3-SNAPSHOT (cf28b9df)
Java Version: 21

Additional information
I think this is actually a regression in Keycloak, but some folks might blame keycloak-config-cli here.
Example of a previously working client definition, which will produce access tokens with the sub claim:
  - clientId: app-greetme
    protocol: openid-connect
    name: Acme Greet Me
    description: "App Greet Me Description"
    enabled: true
    publicClient: true
    standardFlowEnabled: true
    directAccessGrantsEnabled: false
    # Show client in account-console
    alwaysDisplayInConsole: true
    serviceAccountsEnabled: false
    #    attributes: { }
    fullScopeAllowed: false
    rootUrl: "$(env:APPS_FRONTEND_URL_GREETME:https://localhost:9443/apps/greet-me)"
    baseUrl: "/?realm=acme-internal&scope=openid"
    adminUrl: ""
    redirectUris:
      - "/*"
    webOrigins:
      - "+"
    defaultClientScopes:
      - "email"
    optionalClientScopes:
      - "phone"
      - "name"
      - "acme.api"
      - "address"
    attributes:
      "pkce.code.challenge.method": "S256"
      "post.logout.redirect.uris": "+"

Working client configuration:
  - clientId: app-greetme
    protocol: openid-connect
    name: Acme Greet Me
    description: "App Greet Me Description"
    enabled: true
    publicClient: true
    standardFlowEnabled: true
    directAccessGrantsEnabled: false
    # Show client in account-console
    alwaysDisplayInConsole: true
    serviceAccountsEnabled: false
    #    attributes: { }
    fullScopeAllowed: false
    rootUrl: "$(env:APPS_FRONTEND_URL_GREETME:https://localhost:9443/apps/greet-me)"
    baseUrl: "/?realm=acme-internal&scope=openid"
    adminUrl: ""
    redirectUris:
      - "/*"
    webOrigins:
      - "+"
    defaultClientScopes:
      - "default"
      - "email"
    optionalClientScopes:
      - "phone"
      - "name"
      - "acme.api"
      - "address"
    attributes:
      "pkce.code.challenge.method": "S256"
      "post.logout.redirect.uris": "+"

Acceptance Criteria
No response

CC @francis-pouatcha @jonasvoelcker

Hi @thomasdarimont,
I guess it is also necessary to define the basic-scope:
    "clientScopes": [
        {
            "name": "basic",
            "description": "OpenID Connect scope for add all basic claims to the token",
            "protocol": "openid-connect",
            "attributes": {
                "include.in.token.scope": "false",
                "display.on.consent.screen": "false"
            },
            "protocolMappers": [
                {
                    "name": "sub",
                    "protocol": "openid-connect",
                    "protocolMapper": "oidc-sub-mapper",
                    "consentRequired": false,
                    "config": {
                        "access.token.claim": "true",
                        "introspection.token.claim": "true"
                    }
                },
                {
                    "name": "auth_time",
                    "protocol": "openid-connect",
                    "protocolMapper": "oidc-usersessionmodel-note-mapper",
                    "consentRequired": false,
                    "config": {
                        "user.session.note": "AUTH_TIME",
                        "id.token.claim": "true",
                        "introspection.token.claim": "true",
                        "access.token.claim": "true",
                        "claim.name": "auth_time",
                        "jsonType.label": "long"
                    }
                }
            ]
        },
        ...
    ]


Submission email - update action in email body

I have updated the action in the email's body.
The subject however seems invalid for a delete scenario.
@melisabok @zbialecki any suggestions on language for the email subject?

Please, update the process function through the invitation editor and NOT the builder.

Please, update the process function through the invitation editor and NOT the builder.

Yep, the live site has been updated just now.


Remove Reconciler entry

The traffic I got from this entry made me realize that I won't properly maintain the project - so I'm taking this entry out again, deactivate the project's issue section and put a disclaimer in my readme.

@jtheisen Sorry to hear, but thanks for sending the PR to remove.


Update Copilot icon

Purpose of this pull request
This pull request:

Updates the Copilot icon
Applies /get-started edits that I came across in reviewing the AI and Copilot docs

Select the type of change

[x] Minor Changes - Typos, formatting, slight revisions
[x] Update Content - Revisions, updating sections
[ ] New Content - New features, sections, pages, tutorials
[ ] Site and Tools - .clabot, version updates, maintenance, dependencies, new packages for the site (Docusaurus, Gatsby, React, etc.)

@kimsauce, the old icon still appears in the upper left of many screenshots in the Copilot article. You'll want to update those.

Oh, good call! I completely missed that. I'll fix and resubmit.

Thanks again for catching those images, @jpipkin1 ! I've fixed them all except for the video and gif. Since the product is so in flux, those will likely be updated anyway.


can't edit a path on a newly added item, have to modify it in some way first, search fixes it, similar to the rename issue

fixed


slack-19.0: support consul topo stale reads

Description
This PR allows Vitess components to use stale reads from consul. This is enabled with the flag --topo_allow_stale_reads, which is default false and should be considered experimental
*api.QueryOptions:

// AllowStale allows any Consul server (non-leader) to service
// a read. This allows for lower latency and higher throughput
AllowStale bool

This flag allow us to distribute topo .Get(...) and .List(...) load to consul replicas. Also it limits the impact of elections
It may be safe in use cases like txthrottler if stale reads have no impact to any other vttablet operations. It may be safe to use in vtorc also
Related Issue(s)

Checklist

[x] "Backport to:" labels have been added if this change should be back-ported
[x] Tests were added or are not required
[x] Did the new or modified tests pass consistently locally and on the CI
[x] Documentation was added or is not required

Deployment Notes

LGTM but some CI failed. I triggered a re-run to see if that helps

@ejortegau the query serving downgrade tests on v19 are known-broken and currently not required CI. For context, we've confirmed we shouldn't be impacted by the handful of failures in those CIs but we still need to modify the pipeline to understand this


Spark operator pod going to crashloopbackoff

Describe the bug
The image version we are trying to fetch is not available.
To Reproduce
Execute omnia.yml with k8s_start_services role.

Issue resolved by PR #955