feat: ArrayDisplayModel (for later model/view refactor)

this is the model-only partly from #33, cleaned up for easier review.  This isn't yet connected to a view, but can be reviewed for soundness of the model itself, interactive validation (i.e. instantiate the object and see if you can break it with invalid inputs), and signal emission (they should be appropriate for later view connection).
see the display_model.py example for a starting point
cc @gselzer if you want to play with it and provide feedback (including requests for more docstrings & comments for any parts that seem confusing or magical), or try to connect it to a view

am wondering about your plans for modeling the other data involved, namely the array data itself

just pushed some of my recent playground changes (in viewer_v2.py) where you can see how I was envisioning this.  Basically, the array display model is intentionally expressed independent of the data itself.  But of course you will need to pair it with a DataWrapper in order to get much use.   I'm currently playing with that in the Viewer object itself, but if there's sufficient logic just between that pair of objects, it could be extracted to an intermediate object.

whether this model could handle multiple datasets. I think that, written right now, it could, but is that a "feature" we should preserve later, or just an aspect of the current state it maintains?

yes that is definitely a goal here (and is part of why i exclude the dataset from the display model).  I don't think it's a big can of worms really... it just requires a more explicit model of a "world object" (i.e. a thing that has a data-to-world transform) that tells us how to place the object in the scene graph.  Essentially, right now you can think of it as everything having an (implicit) data-to-world transform of "identity".
basically, i think everything's still on a good path here for these things

I'd love to try hooking this up to a widget and see how far I/we can get.

see x.py for now in this PR

m.current_index["5"] = slice(1, "fooo")

the only issue there is the "fooo" in the slice right?  I can update the Slice type validator

just pushed some of my recent playground changes (in viewer_v2.py) where you can see how I was envisioning this. Basically, the array display model is intentionally expressed independent of the data itself. But of course you will need to pair it with a DataWrapper in order to get much use. I'm currently playing with that in the Viewer object itself, but if there's sufficient logic just between that pair of objects, it could be extracted to an intermediate object.

Oh, great!
Since you're already working on the "view" part...how much are you planning to separate the "view" part (Qt/Jupyter, vispy/pygfx) from the "controller" part (signal connections, maybe some top-level user API)? Might be helpful in resolving #48

yes that is definitely a goal here (and is part of why i exclude the dataset from the display model). I don't think it's a big can of worms really... it just requires a more explicit model of a "world object" (i.e. a thing that has a data-to-world transform) that tells us how to place the object in the scene graph. Essentially, right now you can think of it as everything having an (implicit) data-to-world transform of "identity".
basically, i think everything's still on a good path here for these things

Glad to hear it! Since we're talking about transforms, do you think it's worth allowing current_index values be numbers (i.e. int or float)?

see x.py for now in this PR. Note, at this point it's just in "hook all the things up mode" ... not clean and not refactored to be clear

❤

the only issue there is the "fooo" in the slice right? I can update the Slice type validator

Yeah, think so!

how much are you planning to separate the "view" part (Qt/Jupyter, vispy/pygfx) from the "controller" part (signal connections, maybe some top-level user API)? Might be helpful in resolving

was definitely also in scope for this :) i just split some stuff up and now there's an mvc.py pattern.  Still a mess, but you can run it.  Gives a decent example of how we can split all front-end concerns

was definitely also in scope for this :) i just split some stuff up and now there's an mvc.py pattern. Still a mess, but you can run it. Gives a decent example of how we can split all front-end concerns

Gorgeous 😍 this was exactly what I was envisioning, and I was hacking out something like this before I saw your WIP commit yesterday.

something I'm still thinking about a lot (as you were above) is the relationship between the data wrapper and the display model.
I do definitely want it to be possible to have the same display model associated with two different data wrappers (this is essentially like "synced windows" in Fiji, where you link the current index and luts of two different images).  And I also want it to be possible to associate two different display models with the same data wrapper (this would make orthoviewers trivial).  So I don't think I want to simply add a data field to the ArrayDisplayModel.  But i do find it a little clunky to pass around both the "model" and the "data" (since they are rather linked with each other).  So perhaps an intermediate object:
class DisplayedData:
    data: DataWrapper | None
    view_model: ArrayDisplayModel

Since we're talking about transforms, do you think it's worth allowing current_index values be numbers (i.e. int or float)?

this concept is important if we want to select a display in world space (instead of data space), but that sort of thing was such a hairy ball of wax in napari, that I want to leave all that kind of multi-world-object negotiation for another PR

That object would have logic like the _canonicalize_axis_key method. That method is essentially there because we do want someone to be able to express axis keys in the display in as flexible of a way as possible (including negative indexing, named axes, etc... visible_axes = (-2, 1) or visible_axes = {'y', 'x'}). But at the end of the day, those keys must be resolved to a specific axis index, and for that we need the data. So that's a good place for it i think

It's possible that I just haven't dug as deep in as you have yet, but why can that not be resolved in the view, or in the controller? I do like the idea of thinking about the "Viewer" having three things, which it is responsible for interconnecting:

data: the information being displayed
model: how to display data (this definition, which is basically copied from _array_display_model, could use a little wordsmithing to sufficiently distinguish from the view)
view: the mechanism of display

I've also been hacking more on #49 in the meantime, now off of your prototype. Do you think that it makes sense to build up StatsModel and StatsView objects in tandem with the objects you're building here?

Do you think that it makes sense to build up StatsModel and StatsView objects in tandem with the objects you're building here?

I do actually think that model view could work there.  That's a better way to phrase the vague things I was saying about some "stats service" (i.e. model), the thing that can calculate min max mean histogram, etc... once, and be shared by various things, like the auto-scaler, the histogram, etc...

Yup, and I also like the idea of a view protocol because it could make it easier to define multiple histogram widgets as I describe in #49 - a simple, small one that could replace dimension sliders, and a more complicated widget like you had in napari/napari#675 that could be brought up with double click...

proof of principle working with Jupyter :)
https://github.com/user-attachments/assets/041de589-ae2e-400b-bb92-c34776286224

to prevent confusion, I'm going to close this PR.  As I told @gselzer, this branch is now present upstream at https://github.com/pyapp-kit/ndv/tree/v2-mvc ... and to facilitate multiple people (me and gabe) working on different aspects of it at the same time, all PRs working on the model view refactor will be made to that v2-mvc branch instead of to main.  Then, we will eventually merge that branch into main in one PR


Add CLI documentation

The prosed changes appertain to #118.
The contribution:

[x] updates all affected documentation
[x] provides commits messages which comply with the CONTRIBUTING.md > Committing the changes rules
[x] updates the completion scripts if requires
[x] complies with all requirements from README.md > Hands-on development notes

@alexbeatnik, please review.

@extsoft Great job!


Pdf extraction adds metadata [Document: <filename.ext>, Page: ] in extracted text

Adds [Document: <filename.ext>, Page: ] in extracted text before each page.
Just something I found useful, was difficult to track where my results were coming from before using it. Feel free to reject or propose changes.

Thanks for the PR - That's awesome and taking on one of the biggest points of criticism in using SemanticFinder as a web app (tool in the foreground, data in the background) in comparison to the e.g. the Chrome plugin (data in the foreground, tool in the background).
From a usability point of view, orientation is fundamental since users probably want to come back to the original document and read the paragraph in context.
I was thinking back and forth whether the text input is the right place to put the meta data, as it's something, well "meta". The only problem I see is that it might interfere with the embedding quality and mess a little bit with the order. However, the larger the chunks, the lesser this effect.
Seeing the page numbers right in the text is maybe also good for quickly checking whether the parser got everything right or not.
Eventually I'd say users always have the option to copy & paste text directly from a PDF viewer of their choice without the numbers if they create problems. So I guess, adding this convenience function is a good idea, hence merging. Thanks a lot for your contribution :)

Fixed a minor bug for remote pdf page numbers.


Uncaught error: ("InferModules__Driver.Infer_error("exited with code 65")")

when I try infer -- xcodebuild clean build -scheme appName -workspace appName.xcworkspace -configuration Debug -sdk iphoneos, I get error like "Nothing to compile. Try running xcodebuild clean build scheme appName -workspace appName.xcworkspace -configuration Debug -sdk iphoneos clean first."
Then I try infer --keep-going --no-xcpretty -- xcodebuild clean build -scheme appName -workspace appName.xcworkspace -configuration Debug -sdk iphoneos,The error above is gone, but I get a new error

like
BUILD FAILED
Error backtrace:
Raised at file "integration/Driver.ml", line 297, characters 16-78
Called from file "integration/Driver.ml", line 176, characters 2-16
Called from file "backend/infer.ml", line 23, characters 2-36
Called from file "backend/infer.ml", line 106, characters 6-52
Uncaught error: ("InferModules__Driver.Infer_error("exited with code 65")")

However, the build command  xcodebuild clean build -scheme appName -workspace appName.xcworkspace -configuration Debug -sdk iphoneos can run sucessfully.
Is there something I can do to solve this problem?

Try running  xcodebuild clean -scheme appName -workspace appName.xcworkspace -configuration Debug -sdk iphoneos first,
then
infer --keep-going --no-xcpretty -- xcodebuild build -scheme appName -workspace appName.xcworkspace -configuration Debug -sdk iphoneos

I'm getting a very similar error when running infer run -- ./gradlew assembleDebug
Error backtrace:
Raised at file "integration/Driver.ml", line 297, characters 16-78
Called from file "integration/Driver.ml", line 176, characters 2-16
Called from file "backend/infer.ml", line 23, characters 2-36
Called from file "backend/infer.ml", line 106, characters 6-52
Uncaught error: ("InferModules__Driver.Infer_error(\"exited with code 1\")")

I got the same problem, and the @dulmarod methods did not work for me.
First run:
xcodebuild clean -workspace Aweme.xcworkspace -configuration AwemeInhouseDebug -scheme Aweme
Then:
infer --keep-going --no-xcpretty -- xcodebuild -workspace Name.xcworkspace -configuration Debug -scheme Name
And I got the following errors:

`** BUILD FAILED **
The following build commands failed:
Ld /Users/limaoqi/Library/Developer/Xcode/DerivedData/Aweme-bkezrnqnlfrskocmuntegwvejtzf/Build/Intermediates.noindex/Aweme.build/AwemeInhouseDebug-iphoneos/AwemeVideoNotification.build/Objects-normal/arm64/AwemeVideoNotification normal arm64
(1 failure)
Error backtrace:
Raised at file "integration/Driver.ml", line 297, characters 16-78
Called from file "integration/Driver.ml", line 176, characters 2-16
Called from file "backend/infer.ml", line 23, characters 2-36
Called from file "backend/infer.ml", line 106, characters 6-52
Uncaught error: ("InferModules__Driver.Infer_error("exited with code 65")")`

How can I solve this problem?

With that information is difficult for me to figure out the problem. Could you send me the content of infer-out/logs? Also, you could try using the latest version of Infer, the problem may be fixed there, and if not, I will be able to understand the trace better (seems that the code has changed since the version you are using, so I cannot follow the trace).

@dulmarod My logs is:
logs.txt

@WishQi in your case, Infer is failing  when trying to process a linker command. A solution to this is to pass
LD=/bin/true infer [options] --  --
See more info in http://fbinfer.com/support.html.

@dulmarod The method did not work for me. And it seems to be more wrong
And I got these:

** BUILD FAILED **
The following build commands failed:
Ld /Users/limaoqi/Library/Developer/Xcode/DerivedData/Aweme-bkezrnqnlfrskocmuntegwvejtzf/Build/Intermediates.noindex/Aweme.build/AwemeDebug-iphoneos/AwemeNotificationService.build/Objects-normal/arm64/AwemeNotificationService normal arm64
Ld /Users/limaoqi/Library/Developer/Xcode/DerivedData/Aweme-bkezrnqnlfrskocmuntegwvejtzf/Build/Intermediates.noindex/Aweme.build/AwemeDebug-iphoneos/AwemeNotificationService.build/Objects-normal/armv7/AwemeNotificationService normal armv7
(2 failures)
Error backtrace:
Raised at file "integration/Driver.ml", line 297, characters 16-78
Called from file "integration/Driver.ml", line 176, characters 2-16
Called from file "backend/infer.ml", line 23, characters 2-36
Called from file "backend/infer.ml", line 106, characters 6-52
Uncaught error: ("InferModules__Driver.Infer_error("exited with code 65")")
And the logs is:
logs.txt

Maybe pass also CreateUniversalBinary =/usr/bin/true?

First I set this,
export LD=/bin/true infer
export CreateUniversalBinary=/usr/bin/true
Then
xcodebuild clean  -scheme appName -workspace appName.xcworkspace -configuration Debug -sdk iphonesimulator
Then
infer capture --keep-going --no-xcpretty -- xcodebuild build  -scheme appName -workspace appName.xcworkspace -configuration Debug -sdk iphonesimulator
It run succeed!

** BUILD SUCCEEDED **
However, I have another problem that it did not generate bug.txt like version before 0.13.0. The result directory shows

captured
lint_issues
logs
results.db
-lint_issues

So how should I see the bug lists?

@danyating For infer, there are two phases in the whole process. The first is capture, and the second is the analyze. You have only run the first phase capture, so you should run infer analyze after infer capture

@dulmarod I have another question: Can Infer ignore the pod specs in the capture phase?

@WishQi thanks! After I run infer analyze, I get bug.txt file. So it finally woks out!
And thanks @dulmarod  so much!

@danyating, @WishQi you don't need to run the capture separately, normally running infer capture --keep-going --no-xcpretty -- xcodebuild build -scheme appName -workspace appName.xcworkspace -configuration Debug -sdk iphonesimulator should do everything you need.

@dulmarod
It happends error:
Error backtrace:
Raised at file "integration/Driver.ml", line 297, characters 16-78
Called from file "integration/Driver.ml", line 176, characters 2-16
Called from file "backend/infer.ml", line 23, characters 2-36
Called from file "backend/infer.ml", line 106, characters 6-52
Uncaught error: ("InferModules__Driver.Infer_error(\"exited with code 65\")")

@veryitman I think that error just means the compilation failed, which can be many different things, so maybe it isn't the best to keep it all together in the the same issue. Could you please start a new issue and give more information about what you ran, the whole output, and ideally also the infer-out/logs file?

Thanks @dulmarod .


Add information on the metadata decorator.

Details on how to use the metadata() decorator would help out understand how to use it.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 6e71ca53-208a-3e18-7d22-294e4a3954af
Version Independent ID: 00f4455f-fa2a-be4d-6187-30ee37c95912
Content: Parameters in Bicep files - Azure Resource Manager
Content Source: articles/azure-resource-manager/bicep/parameters.md
Service: azure-resource-manager
Sub-service: bicep
GitHub Login: @mumian
Microsoft Alias: jgao

@evilpilaf - thanks for this feedback. I'll add an example of using metadata. In general, it is not used a lot but can be helpful if you have some custom properties you want to apply.

The update will get published later today. Thanks again for the suggestion.
#please-close


Improve ADCS integration documentation

Current MS ADCS Connector integration guide does not reflect other authentication and authorization options, especially CredSSP case that is useful for credential delegation when AD needs to be access on separate server.
Documentation about ADCS integration should be improved to include:

WinRM options
configuration of the user
authentication options
testing and troubleshooting

Close #130


Rename stopThrowing to preventThrowing

Q
A

Is bugfix?
❌

New feature?
❌

Breaks BC?
❌

Tests pass?
✔

Fixed issues
❌

 Queue

👍


Long Json passed in env variable breaks singularity call

Short Description of the issue

Running an Argo workflow with a pod step affinity set to InterLink Slurm node, will break with this error
XXX:~/.interlink$ kubectl -n argo-workflows logs XXX  -f -c init
FATAL:   While checking container encryption: could not open image /home/username/.interlink/ARGO_PROGRESS_PATCH_TICK_DURATION=1m0s,ARGO_PROGRESS_FILE_TICK_DURATION=3s,ARGO_POD_NAME=containerXXXname,ARGO_CONTAINER_NAME=init,ARGO_TEMPLATE=inputs:parameters:[name:input_data,ARGO_INCLUDE_SCRIPT_OUTPUT=false,ARGO_DEADLINE=0001-01-01T00:00:00Z,ARGO_PROGRESS_FILE=/var/run/argo/progress,ARGO_POD_UID=6c9f1e72-862c-4795-ae25-930919fd9438,GODEBUG=x509ignoreCN=0,ARGO_WORKFLOW_NAME=globalfitmock-lsdsharedfs-template-n7ch4,ARGO_WORKFLOW_UID=8b0c0b74-bf78-4916-babc-42ae4ffc6899,ARGO_NODE_ID=containerYYYYYname: failed to retrieve path for /home/username/.interlink/ARGO_PROGRESS_PATCH_TICK_DURATION=1m0s,ARGO_PROGRESS_FILE_TICK_DURATION=3s,ARGO_POD_NAME=containerXXXname,ARGO_CONTAINER_NAME=init,ARGO_TEMPLATE=inputs:parameters:[name:input_data,ARGO_INCLUDE_SCRIPT_OUTPUT=false,ARGO_DEADLINE=0001-01-01T00:00:00Z,ARGO_PROGRESS_FILE=/var/run/argo/progress,ARGO_POD_UID=6c9f1e72-862c-4795-ae25-930919fd9438,GODEBUG=x509ignoreCN=0,ARGO_WORKFLOW_NAME=globalfitmock-lsdsharedfs-template-n7ch4,ARGO_WORKFLOW_UID=8b0c0b74-bf78-4916-babc-42ae4ffc6899,ARGO_NODE_ID=containerYYYYYname: lstat /home/username/.interlink/ARGO_PROGRESS_PATCH_TICK_DURATION=1m0s,ARGO_PROGRESS_FILE_TICK_DURATION=3s,ARGO_POD_NAME=containerXXXname,ARGO_CONTAINER_NAME=init,ARGO_TEMPLATE=inputs:parameters:[name:input_data,ARGO_INCLUDE_SCRIPT_OUTPUT=false,ARGO_DEADLINE=0001-01-01T00:00:00Z,ARGO_PROGRESS_FILE=: file name too long

Environment

Operating System: Linux
Other related components versions: Interlink slurm plugin 0.3.2

Steps to reproduce

Run an Argo workflow and put a helloworld step in InterLink Slurm node thanks to taint and affinity:
        "affinity": {
          "nodeAffinity": {
            "preferredDuringSchedulingIgnoredDuringExecution": [
              {
                "weight": 1,
                "preference": {
                  "matchExpressions": [
                    {
                      "key": "kubernetes.io/hostname",
                      "operator": "In",
                      "values": [
                        "interlink-slurm"
                      ]
                    }
                  ]
                }
              }
            ]
          }

Logs, stacktrace, or other symptoms

Argo Workflow pod when editing it:
167   - command:
168     - argoexec
169     - init
170     - --loglevel
171     - info
172     - --log-format
173     - text
174     env:
175     - name: ARGO_POD_NAME
176       valueFrom:
177         fieldRef:
178           apiVersion: v1
179           fieldPath: metadata.name
180     - name: ARGO_POD_UID
181       valueFrom:
182         fieldRef:
183           apiVersion: v1
184           fieldPath: metadata.uid
185     - name: GODEBUG
186       value: x509ignoreCN=0
187     - name: ARGO_WORKFLOW_NAME
188       value: XXXXXXXXXXXXXx
189     - name: ARGO_WORKFLOW_UID
190       value: 8b0c0b74-bf78-4916-babc-42ae4ffc6899
191     - name: ARGO_CONTAINER_NAME
192       value: init
193     - name: ARGO_TEMPLATE
194       value: '{"name":"group-block","inputs":{"parameters":[{"name":"input_data","value":"stub1_output_preprocessed_signal.h5"},{"name":"pipeline_run_id","value":"XXXXXXXXXXXXXXXXX"},{"name":"block_label",    "value":"282"},{"name":"group_label","value":"stub1"},{"name":"block_static_configuration_reference","value":"dummy_config.json"},{"name":"workdir","value":"/work"},{"name":"bus_uri","value":"nats://my-nats.nats:4222"},{"name":"    n_steps_per_iteration","value":"1000"},{"name":"current_iteration","value":"0"}]},"outputs":{},"affinity":{"nodeAffinity":{"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":1,"preference":{"matchExpressions":[{"key":"    kubernetes.io/hostname","operator":"In","values":["interlink-slurm"]}]}}]}},"metadata":{},"container":{"name":"","image":"gitlab.esa.int:4567/lisa-sgs/globalfit/framework:0.4.0","command":["XXXXXXXXXXX"],"args":["--workdir=/work","    --pipeline-run-id=XXXXXXXXXXXXXXXX","--servers=nats://my-nats.nats:4222","start-block","--input-data=stub1_output_preprocessed_signal.h5","--input-group-configuration-path=/work/stub1_group_configuration.    json","--block-label=282","--group-label=stub1","--n-steps=1000","--current-iteration=0","--output-checkpoint=/work/XXXXXXXXXXXX"],"resources":{"limits":{"cpu":"500m","memory":"256Mi"},"requests":{"cpu":"500m","memory":"2    56Mi"}},"volumeMounts":[{"name":"working-volume","mountPath":"/work"}]},"tolerations":[{"key":"virtual-node.interlink/no-schedule","operator":"Exists"}]}'
195     - name: ARGO_NODE_ID
196       value: XXXXXXXXXXXXXXXXXXX
197     - name: ARGO_INCLUDE_SCRIPT_OUTPUT
198       value: "false"
199     - name: ARGO_DEADLINE
200       value: "0001-01-01T00:00:00Z"
201     - name: ARGO_PROGRESS_FILE
202       value: /var/run/argo/progress
203     - name: ARGO_PROGRESS_PATCH_TICK_DURATION
204       value: 1m0s
205     - name: ARGO_PROGRESS_FILE_TICK_DURATION
206       value: 3s
207     image: quay.io/argoproj/argoexec:v3.5.4
208     imagePullPolicy: Always
209     name: init
210     resources:
211       limits:
212         cpu: 100m
213         memory: 128Mi
214       requests:
215         cpu: 50m
216         memory: 16Mi

The job.sh runs 3 singularity container, because Argo as for each pod an init, wait and main containers. Here is an extract of the init container:
singularity exec --containall --nv   --env ARGO_CONTAINER_NAME=init,ARGO_TEMPLATE={"name":"group-block","inputs":{"parameters":[{"name":"input_data","value":"stub2_output_preprocessed_signal.h5"},{"name":"pipeline_run_id","value":"XXXXXXXXXXXXX"},{"name":"block_label","value":"282"},{"name":"group_label","value":"stub2"},{"name":"block_static_configuration_reference","value":"dummy_config.json"},{"name":"workdir","value":"/work"},{"name":"bus_uri","value":"nats://my-nats.nats:4222"},{"name":"n_steps_per_iteration","value":"1000"},{"name":"current_iteration","value":"0"}]},"outputs":{},"affinity":{"nodeAffinity":{"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":1,"preference":{"matchExpressions":[{"key":"kubernetes.io/hostname","operator":"In","values":["interlink-slurm"]}]}}]}},"metadata":{},"container":{"name":"","image":"XXXXXXXXXXXXX","command":["lgfk-cli"],"args":["--workdir=/work","--pipeline-run-id=XXXXXXXXXX","--servers=nats://my-nats.nats:4222","start-block","--input-data=XXXXXXXXXXX","--input-group-configuration-path=/work/stub2_group_configuration.json","--block-label=282","--group-label=stub2","--n-steps=1000","--current-iteration=0","--output-checkpoint=/work/XXXXXXXXXXXXX.dump"],"resources":{"limits":{"cpu":"500m","memory":"256Mi"},"requests":{"cpu":"500m","memory":"256Mi"}},"volumeMounts":[{"name":"working-volume","mountPath":"/work"}]},"tolerations":[{"key":"virtual-node.interlink/no-schedule","operator":"Exists"}]},ARGO_INCLUDE_SCRIPT_OUTPUT=false,ARGO_PROGRESS_PATCH_TICK_DURATION=1m0s,ARGO_PROGRESS_FILE_TICK_DURATION=3s,ARGO_POD_UID=216626ae-df79-441d-a58a-9a1f657ecee6,GODEBUG=x509ignoreCN=0,ARGO_WORKFLOW_NAME=XXXXXXXXXXXXXX,ARGO_DEADLINE=0001-01-01T00:00:00Z,ARGO_PROGRESS_FILE=/var/run/argo/progress,ARGO_POD_NAME=XXXXXXXXXXXXXn7ch4-group-block-4006580661,ARGO_WORKFLOW_UID=8b0c0b74-bf78-4916-babc-42ae4ffc6899,ARGO_NODE_ID=XXXXXXXXXXXXn7ch4-4006580661  --bind /home/XXXX/.interlink/argo-workflows-216626ae-df79-441d-a58a-9a1f657ecee6/emptyDirs/var-run-argo:/var/run/argo:rw  --bind /home/XXXXXX/.interlink/argo-workflows-216626ae-df79-441d-a58a-9a1f657ecee6/command_init.sh:/tmp/command_init.sh --bind /home/XXXX/.interlink/argo-workflows-216626ae-df79-441d-a58a-9a1f657ecee6/args_init.sh:/tmp/args_init.sh quay.io/argoproj/argoexec:v3.5.4 /bin/sh /tmp/command_init.sh &> /home/XXXXXXXXX/.interlink/argo-workflows-216626ae-df79-441d-a58a-9a1f657ecee6/init.out; echo $? > /home/XXXX/.interlink/argo-workflows-216626ae-df79-441d-a58a-9a1f657ecee6/init.status

Analyze
Multiple issues here:

the command line is too long: it is over the 4096 limit of a Linux command, resulting in file name too long
the environment ARGO_TEMPLATE contains the Json of the Kubernetes pod to run by Argo. When Interlink Slurm Plugin runs singularity, double quotes are evaluated by the bash command and lost
the singularity env (https://docs.sylabs.io/guides/3.7/user-guide/environment_and_metadata.html#env-option) relies on "," to separate, and in ARGO_TEMPLATE there are multiple "," because it is a Json, resulting in a bad variable parsing
less important but the Argo runs the docker image like quay.io/... , but singularity will fail if this is not prefixed by docker:/docker.io/

Summary of proposed changes

Suggestion of a solution: rework the plugin to put all environment variable either as envfile (https://docs.sylabs.io/guides/3.7/user-guide/environment_and_metadata.html#env-file-option), or as env variable prefixed by SINGULARITYENV_ (https://docs.sylabs.io/guides/3.7/user-guide/environment_and_metadata.html#singularityenv-prefix)
But worked in my test, however, both requires some form of escaping, like simple quote at least. But if we have simple quote inside the env variable (we cannot be certain what the user want to pass), then it would fail. To be completely reliable, we should parse the quote and escape them for each env var.

Testing with SINGULARITYENV_prefix results in a warning:
INFO:    Environment variable SINGULARITYENV_ARGO_TEMPLATE is set, but APPTAINERENV_ARGO_TEMPLATE is preferred

Whether we have singularity or apptainer, we don't know, so I recommend using envfile instead.

@antoinetran  +1 for envfile, regarding escaping I propose to target it after the envfile fix is in place and working (opening a dedicated issue now).
Do you have a patch that you want to merge already for the envfile ?

@antoinetran +1 for envfile, regarding escaping I propose to target it after the envfile fix is in place and working (opening a dedicated issue now).
Do you have a patch that you want to merge already for the envfile ?

No patch yet, I start working on it now. It is my first time programming in GO, so it will take some time :) especially if I want to incorporate Unit Tests with weird case of simple quote double quote inside env.

Right, for the moment we could rely on introducing a case into the e2e integration suite. I'll open an issue there.
Executive message, you can concentrate of making changes, tests are going to be handled together with interlink core (at least the functional ones)


Import third-party events

In this PR we introduce new API for posting events into a Bounded Context manually.
Mitivation
In real-life projects, often there are upstream third-party systems to integrate with. Such systems may emit events. However, constructing an instance of io.spine.core.Event and posting it into the corrent EventBus may be cumbersome, as well as error-prone, since the Event type is the internal API of the framework.
API
ThirdPartyContext is an adapter for external systems. ThirdPartyContext represents an external system as if it was just another Bounded Context. The adapter posts submitted by the user events to other Bounded Contexts via the common transport.
Typical usage looks as follows:
ThirdPartyContext gitHub = ThirdPartyContext.multitenant("GitHub");
ActorContext actor = ActorContext
        .newBuilder()
        .setUserId(/* ... */)
        .setTimestamp(/* ... */)
        .setTenantId(/* ... */) // A tenant ID is required for a multitenant Context.
        .vBuild();
EventMessage event = IssueClosed
        .newBuilder()
        // ...
        .vBuild();
gitHub.emittedEvent(actor, event);

Further Improvements
The next step for this feature is to allow events going through the IntegrationBus be posted into the domestic EventBus so that they are stored in the domestic EventStore for catch up and audit.
Other Changes
This PR also re-enabled the 3 disabled tests in the server module. 2 of them used to fail due to unimplemented functionality and the third one is just too slow. All the tests now pass. The slow one is marked as SlowTest so that it can be skipped locally by running fastTest Gradle task instead of test.

@alexander-yevsyukov, PTAL.
@dmitrykuzmin, PTAL.

by definition, this event would not be domestic.

What if we migrate existing code to a new solution, which is DDD-based? Then, we'd have a new Context and a legacy system which generates events for us. They are domestic in the sense it's the same context.

We need to avoid boradcast() and toAggregate() details being exposed to the party which integrates with us.

@alexander-yevsyukov, @dmitrykuzmin, PTAL again.

@alexander-yevsyukov, PTAL again.

@alexander-yevsyukov, PTAL again.


🐛 Bug Report: Incorrect ProjectID Instructions

👟 Reproduction steps

Navigate to the Appwrite dashboard.
Create a new project.
Enter a project ID containing alpha numeric characters, non-leading hyphens, periods, and underscores (example project_1).
Observe the error or unexpected behavior.

👍 Expected behavior
From the code in
appwrite\src\Appwrite\Utopia\Database\Validator\ProjectId.php

It can be seen that the regex doesn't accept underscores as well as leading hyphens and periods in projectID.
The error message provided, also has a slight correction, that it only accepts non-leading hyphens.
Thus, the expected behavior, would be, the following:

👎 Actual Behavior
It currently shows wrong statement, that it accepts underscores as well as periods

This causes confusion among people, not sure what they did wrong, as they were correctly following the instructions
🎲 Appwrite version
Appwrite Cloud
💻 Operating system
Linux
🧱 Your Environment
No response
👀 Have you spent some time to check if this issue has been raised before?

[X] I checked and didn't find similar issue

🏢 Have you read the Code of Conduct?

[X] I have read the Code of Conduct

Please assign this issue to me

Duplicate of https://github.com/appwrite/appwrite/issues/6279


dropping Python 2

Since Python 2 will not be maintained past 2020, we will also drop Python 2 support soon. I already enlisted PySCIPOpt here: https://python3statement.org/

done with release 3.0


chore: Be consistent with embedding model

Ensure consistent usage of either sentence-transformers/all-MiniLM-L12-v2 or sentence-transformers/all-MiniLM-L6-v2.

@anujsinha3 explored this. Use sentence-transformers/all-MiniLM-L12-v2.

Verified this is fixed in both places
https://uw-ssec-tutorials.readthedocs.io/en/latest/SciPy2024/module2/retrieval-augmented-text-generation.html#embedding-models
https://uw-ssec-tutorials.readthedocs.io/en/latest/SciPy2024/appendix/qdrant-vector-database-creation.html#qdrant-creation
Should be okay to close this issue @anantmittal?

Yes. This is done.


Instantiable tokens pallet

Resolves https://github.com/open-web3-stack/open-runtime-module-library/issues/391

Still a draft? should we make a PR to upstream?

There a some issues to fix in imbalances, working on it


Return in dot notation when using AS_PATH_LIST

When using AS_PATH_LIST is there any road map to return the response in dot notation
eg: below code returns the path
$['store']['book'][0]['author'] instead is it possible to return it as $.store.book.0.author
Configuration conf = Configuration.builder()
   .options(Option.AS_PATH_LIST).build();

List<String> pathList = using(conf).parse(json).read("$..author");

assertThat(pathList).containsExactly(
    "$['store']['book'][0]['author']",
    "$['store']['book'][1]['author']",
    "$['store']['book'][2]['author']",
    "$['store']['book'][3]['author']");

I am looking for the same, are there any updates on this?

The problem with the dot notation is, that it's not valid if a key in the JSON contains spaces or dots. Only by using the square bracket you (nearly) always get a valid path.


Additional Application Details getting cleared off after AXIS Sync - Personal Requests

Describe the bug in current situation
Not a deal breaker for 24th Go live . Issue is like Additional Applicant details like DOB , Correction Number, Employee Number is getting cleared off,  even though data exists on AXIS side as well as on FLOW side. At the same time, some other information is not getting cleared. Need to bring consistent logic on which data gets cleared and what need to be overwritten.
Link bug to the User Story
Impact of this bug
Describe the impact, i.e. what the impact is, and number of users impacted.
Lose data. High.
Chance of Occurring (high/medium/low/very low)
Medium. Impacts all requests with this information.
Pre Conditions: which Env, any pre-requesites or assumptions to execute steps?
Steps to Reproduce
Steps to reproduce the behavior:

Go to Public facing app, submit a Personal FOI request with Application DOB, Correction Number, Employee Number, Child details
Go to FLOW app, do an advanced search for above submitted FOI request
Do AXIS with a request having Application DOB and other info on the FLOW 's unopened request
We can see DOB, and other information getting cleared off while Sync'ing even though data exists.

Actual/ observed behaviour/ results
Expected behaviour
A clear and concise description of what you expected to happen. Use the gherking language.

GIVEN a row requests from the FOI request form includes DOB, Correction Number, Employee Number, child details etc.
WHEN a request is synced from AXIS
The information (DOB, Correction Number, Employee Number, child details etc.)  should not be erased from the request in Flow (ie.,Fields that are not in AXIS/ that are not pulling from AXIS but exist in FOI request form should persist.)

Screenshots/ Visual Reference/ Source
If applicable, add screenshots to help explain your problem. You an use screengrab.

@sumathi-thirumani-aot, try to replicate as discussed.

Decision at standup Jul 12 to create new bug ticket to address issue of Identity Verified field

Per conversation with @aparna-aot yesterday - issue seems fixed but still an issue with DOB. Need to wait for #2448 and QA together

Hey @m-prodan #2448 is already pushed to test. Can you do a QA and let me know if the issue still exists? I couldn't reproduce the issue and if you could show it on a call that would be great. Thanks!

@aparna-aot - it is working as expected now, thanks!


Application with multiple threads each importing image module gets hung

Hi,
We have built torch on ppc64le. And while testing it, we found a problem wherein threads get hung if we have a thread pool containing higher number of threads say 16 (at times, even with 8) and if all of them are importing 'image'.
Here is our test case -
local Threads = require 'threads'
nthreads = 16
Threads.serialization('threads.sharedserialize')
thrds = Threads(nthreads,
         function()  require 'image' end
      );
thrds:synchronize()
print "Done"

Some of my observations -

This test works just fine on x86_86 with the latest torch distro repo
For ppc, we have a bit older code on top of which ppc specific changes are present. With this setup, this test gets hung.
I also tried updating torch submodules like threads, images on my ppc setup but no luck
Instead of 'image', if I make threads import other modules like torch or sundown from torch, then those cases work. This could be just a fluke, but I'm not really sure.
Debugging using gdb shows that some threads are sitting in __pthread_cond_wait and some in __lll_lock_wait, creating a deadlock.

Is importing 'image' a resource intensive operation? Has anyone seen such problem earlier on any other platform?
Any help would be greatly appreciated.

This issue may not be directly due to image module. But if I get an idea about what this module is doing intensively which is leading to this hang problem, I may be able to nail down the problem further. Forgot to mention one point - the glibc version on my ppc setup is 2.23-0ubuntu3 and on x86_64 is 2.19-0ubuntu6.

We got this issue fixed by building torch using the latest Advanced Toolchain to 10.0 which has gcc 6.2.1 and glibc 2.24.

I confirmed that this issue is fixed, also in my environment.
local threads = require 'threads'
local nthread = 32

local pool = threads.Threads(
   nthread,
   threads.safe(
   function(threadid)
      require 'image'
   end)
)
pool:synchronize()
pool:terminate()

threads.safe avoids the deadlock problem that is caused by fork() at require() phase.

Thanks @nagadomi for this information. I tried updating threads packages and the mentioned test case worked with even 64 threads! Thank you for informing this.


Feat Added-Raichu

@kirtisingh3008 Raichu also exists in the website. And even if you are adding a common pokemon, kindly add description to the PR to help the maintainer.


[8.x] Expand Full-Text Search capabilities

Following on from @driesvints' excellent work in https://github.com/laravel/framework/pull/40129, this adds selectFullText() and addSelectFullText() methods.
Whilst whereFullText() is useful in itself, an arguably more practical use-case for fulltext search queries involves being able to select the relevance score in the query, filter to only results with > 0 relevance score using a having clause, and ordering the results by relevance).
This is a scenario used in the fulltext search lesson of @reinink's Eloquent Performance Patterns video course, except there the MATCH()..AGAINST() is used in with select and where clauses, which isn't actually necessary .. see 'Ordering By Result Relevance' section here https://www.cloudsavvyit.com/10172/how-to-use-full-text-searches-in-mysql/
Example (assuming a fulltext index exists on 'bio,resume' (both string) fields):
$users = \App\Models\User::addSelectFullText(['bio', 'resume'], 'my previous work', 'relevance', ['mode' => 'boolean'])
->having('relevance', '>', 0);
->orderBy('relevance', 'desc')
->get();

TODO:

Postgres version (I'm out of my depth there) .. hoping @tpetry can help
Add more tests, specific to selectFullText() and addSelectFullText()

This is a scenario used in the fulltext search lesson of @reinink's Eloquent Performance Patterns video course, except there the MATCH()..AGAINST() is used in with select and where clauses, which isn't actually necessary .. see 'Ordering By Result Relevance' section here https://www.cloudsavvyit.com/10172/how-to-use-full-text-searches-in-mysql/

If you don't usw the MATCH(...) AGAINST(...) clause in the WHERE part then any database is calculating the score for any row. It's calculating a score, but not using an index to filter all the rows. Your HAVING clause is then filtering every row by the fulltext expression, without an index. Your implementation does work, but will not use an index. I am strictly suggesting not using that solution.
I will look at the PR and it's effect on PostgreSQL later. But I don't share the actual implementation idea. It's making a simple "order by ranking" logic very complicated as I have to add a select part (which I don't need) and then sort by that column.
I, personally, would prefer an orderByFullText($columns, $value, $direction = 'desc', array $options = []) method and your addSelectFullText implementation in case the application requires the score. @driesvints What's your opinion?

@tpetry my knowledge about full text search doesn't extends that far. I suggest you both work on this PR as you see fit and mark it as ready when you think it's valid for review.

If you don't usw the MATCH(...) AGAINST(...) clause in the WHERE part then any database is calculating the score for any row.

Great point @tpetry .. and not a consideration I'd realised. How would you see the orderByFullText() operating - would it add the where condition AND the order by clause?

@tpetry I guess my main goal in all this is a way of getting the results ordered by relevance. Having the score value available from the select clause is very much secondary (although I could see some uses for it, e.g. displaying a %-age relevance score on a results page).
I'm sure I read somewhere that if there's no other ordering specified on the query and a fulltext MATCH is used, MySQL will order the result by descending relevance by default, but I can't seem to replicate that in manual query tests on my local db. I'm not sure if it's actually true, or just a rumour from something I Googled.

@tpetry Looking at the MySQL docs:
When MATCH() is used in a WHERE clause, as in the example shown earlier, the rows returned are automatically sorted with the highest relevance first as long as the following conditions are met:

There must be no explicit ORDER BY clause.

The search must be performed using a full-text index scan rather than a table scan.

If the query joins tables, the full-text index scan must be the leftmost non-constant table in the join.

So that confirms that needing the relevance score to actually be available as a result table column is really the only reason for a select-based MATCH..AGAINST.
I'm interested as to what you'd think an orderByFullText() would do that whereFullText() doesn't already, in light of the above..

We've fixed the build on 8.x so please rebase, thanks!

I think this branch is already based on the latest 8.x commit.. ?

If you don't usw the MATCH(...) AGAINST(...) clause in the WHERE part then any database is calculating the score for any row.

Great point @tpetry .. and not a consideration I'd realised. How would you see the orderByFullText() operating - would it add the where condition AND the order by clause?

Just the ORDER BY.

@tpetry I guess my main goal in all this is a way of getting the results ordered by relevance. Having the score value available from the select clause is very much secondary (although I could see some uses for it, e.g. displaying a %-age relevance score on a results page).

The score is an implementation detail, it's not really a percentage value. A perfect document can be a 1.0 or a 0.12. There is no meaning in the value. It depends on many factors: dbms engine, language, text corpus, search term.

When MATCH() is used in a WHERE clause, as in the example shown earlier, the rows returned are automatically sorted with the highest relevance first as long as the following conditions are met:
There must be no explicit ORDER BY clause.
The search must be performed using a full-text index scan rather than a table scan.
If the query joins tables, the full-text index scan must be the leftmost non-constant table in the join.

I'm interested as to what you'd think an orderByFullText() would do that whereFullText() doesn't already, in light of the above..
As stated in the documentation, automatic ordering will not happen in some cases for joins. But reducing your question to it's basic statement would make this PR obsolete as MySQL is doing sorting completely automatic? Additionally, manual sorting together with rank-based sorting may be used.

@tpetry Thanks, and you're right, now I've realised the ordering happens automatically in MySQL, and the score value isn't really useful, this whole PR is probably redundant. I'll close!
Sorry for the time-waste @driesvints :(

@jonnott don't worry about it 👍

It's useful for PostgreSQL as it does not do any automatic sorting, I will work on a PR the next week.


Revert #645

It broke transaction handling in jormungandr because it uses apply_block to test whether transactions can be applied, but apply_block wants to update the chain_length / block date.

But it is fine since the new created state is throw away.
The transaction validation is done as follow:

take what is believed to be the tip of the blockchain;
apply the transaction;
throw the newly created state


Theme support

I cannot seem to be able to overwrite the theme.
echo $this->Recaptcha->display(array('recaptchaOptions' => array('theme' => 'white')));

This is in the 2.0 branch.
Thanks,
Dave

Duplicate of #16


ch32v003programmer, s3 version?

Hi, I need a little bit of help.
I'm trying to immigrate the s2 programmer to s3 since my main project runs on s3. However, I got the following errors:

missing lib: tusb_hid_gamepad.h
undefined registers: mainly because those are for the s2, not s3.
main issue : undefined reference to `tud_hid_descriptor_report_cb'

ESP-IDF) 5.2.2
and I also want to know which IDF version it was running on.
thx

I believe I was on IDF 5.1 - give that a shot and see how it goes.

Thanks, before you reply. I tried 5.0. S2 compiled successfully. But on S3, #include "soc/dedic_gpio_reg.h" is missing. It seems to work only for S2.
Which library should I use on S3? Is this library responsible for the current control of gpios?

Thx, it's working.
I disable the
0x0c: Output clock on P2.
0x03: // Power-up
#################################################
then I tried without Arduino. only ch32v003fun
[env:genericCH32V003F4U6]
platform = ch32v
board = genericCH32V003F4U6
;framework = arduino
upload_protocol = minichlink
it returns the error
Found ESP32S2 Programmer
Error: File I/O Fault.
*** [upload] Error<PHONE_NUMBER>
is this a programmer's problem?

Today I started to look into this and I got it to compile S2 binary in the latest IDF 5.3 by:
git rm components/tinyusb/ -r
idf.py add-dependency espressif/esp_tinyusb
idf.py update-dependencies

And commenting out #include "tusb_hid_gamepad.h" in couple of files.
Building for S3 needs some more work.


iframe focus

I'm adding arrow key navigation to my iframe html, but the code only works after i click somewhere inside the iframe first. Is there some way to force focus on the iframe on load or on complete?
(btw, i have iframe and inline both set to true, just in case that'swrong)

so far, i'm solving it like most other ppl - adding a button at the top:
x
and adding that id to the called url:

I tried adding a div id to the url, but that didn't work for some reason, so i'll stick with a 1px button w. an id.

My apologies for the late reply. I wasn't sure how to address this, so I'm glad you are finding a way. That sounds like a very good option. I figured you could use the onComplete callback to select the iframe contentWindow and focus, but I believe that has to wait until the iframe's onload event fires, which is not something I would want to wait on if I could avoid it.


timeout in the nmap tests

it seems the timeout for nmap scan report was hard code to 660
/tests/nmap.py
lan.expect('Nmap scan report', timeout=660)
When we ran the test, this timeout was not enough, so increased it to about 800 then the test can pass
Is there any particular reason to choose 660 as timeout? would it better to make it configurable?
Thanks

If you like, you can submit a code change with the timeout increased to 800 or whatever.
It's really hard to predict how long nmap will take because it depends on a variety of factors.  It can change drastically if you change the number of ports scanned or the methods nmap uses.


New Display tab with Tab Index and Custom CSS Class

Renamed Display tab to Settings
Added new common Display tab with new Tab Index option
Added new Tab Index option
Refactored API tab templates to use single common template

Hold off on this while I move things back into the original Display tab.

This is good 2 go now


Add extensions overloads for quartz job factory

In addition to https://github.com/MassTransit/MassTransit/issues/2065
SchedulerBusObserver has required overload to pass (in my case MicrosoftDependencyInjectionScopedJobFactory), but no extension method overloads exists

Rebased/merged.


system-probe: Made clang and llc optional for image build

What does this PR do?
Make clang-bpf and llc-bpf optional in the process of building a dedicate agent image

Motivation

Additional Notes

Possible Drawbacks / Trade-offs

Describe how to test/QA your changes

Reviewer's Checklist

[ ] If known, an appropriate milestone has been selected; otherwise the Triage milestone is set.
[ ] Use the major_change label if your change either has a major impact on the code base, is impacting multiple teams or is changing important well-established internals of the Agent. This label will be use during QA to make sure each team pay extra attention to the changed behavior. For any customer facing change use a releasenote.
[ ] A release note has been added or the changelog/no-changelog label has been applied.
[ ] Changed code has automated tests for its functionality.
[ ] Adequate QA/testing plan information is provided if the qa/skip-qa label is not applied.
[ ] At least one team/.. label has been applied, indicating the team(s) that should QA this change.
[ ] If applicable, docs team has been notified or an issue has been opened on the documentation repo.
[ ] If applicable, the need-change/operator and need-change/helm labels have been applied.
[ ] If applicable, the k8s/<min-version> label, indicating the lowest Kubernetes version compatible with this feature.
[ ] If applicable, the config template has been updated.

Why do you need this? These are required for runtime compilation.

we are using a another agent image as base image, so they already appear there
if they are not presented locally, then we just don't override them

What is the benefit of this change? Aren't those files going to be present in most circumstances? Can you describe your use case in a little more detail?

When we are building a special image locally, we dont have those files, and the build fails


[Sub Issue] Move evaluations to backend

Problem Statement:
The request is to transition the existing frontend-based evaluation workflow to be fully backend-driven. This change aims to enhance efficiency and scalability.
Description of the Current Evaluation Workflow:
The current workflow, which needs to be implemented in the backend, involves the following steps:

Inputs Required:

A list of variant IDs (List[variantid]).
A test set ID (testset_id).
A list of evaluators (list[evaluators]).

Workflow Logic:

Retrieve the test set based on the testset_id.
For each variant in the list of variant IDs:

For each data point in the test set, call the variant with the test set and save the results.

For each metric in the list of evaluators:

Apply the metric on the variant output and the ground truth (when available), and save the results.

Implementation Tasks:

[x] Refactor backend codebase to support new evaluations schemas
[x] Develop a Script: Create a script capable of running the evaluation workflow as described. @aakrem
[x] Celery Task Creation: Develop a Celery task to handle the execution of the evaluation workflow. @aakrem
[x] API Endpoints: Establish API endpoints to initiate evaluation jobs and provide updates on job status. @aakrem
[x] Fix the docker internal issue @aybruhm
[x] Handle the response flow to the frontend @aybruhm
[x] Check if we can improve the async methods instead of using the event loop @aybruhm
[x] Aggregated results @aakrem @aybruhm
[x] Move evaluators from db back to code @aakrem
[x] Add an endpoint where we can fetch evaluators @aakrem
[x] Crud operations to manage evaluators configs @aakrem
[x] Human evaluations @aakrem
[ ] Prepare a migration strategy to the new schemas as
[ ] Evaluation duration ?
[x] Rate limiting RPM @aybruhm
[x] Rate limiting TPM @aybruhm
[ ] comparison
[x] Evaluators with "direct-use"
[ ] Migrate to Beanie https://github.com/Agenta-AI/agenta/issues/1139
[ ] Evaluations in chat

Testing all the evaluations one by one

[x] auto_exact_match @aakrem
[x] auto_similarity_match @aakrem
[x] auto_regex_test @aybruhm
[x] auto_webhook_test @aybruhm
[x] auto_ai_critique @aakrem
[x] custom_code_run @aybruhm
[x] human_a_b_testing @aakrem
[x] single_model_test @aakrem

Integration Tests to run evaluations using these evaluators

[x] evaluators configs crud @aybruhm
[x] evaluations crud (create, status, results) @aybruhm
[x] auto_exact_match @aybruhm
[x] auto_similarity_match @aybruhm
[x] auto_regex_test @aybruhm
[x] auto_webhook_test @aybruhm
[x] auto_ai_critique @aybruhm

Cleanup:

[ ] CustomEvaluationDB @aybruhm
[ ] Evaluations settings @aybruhm
[ ] EvaluationType @aybruhm
[ ] EvaluationTypeSettings @aybruhm
[ ] AICritiqueCreate

Test Edge cases mechanisms:

[ ] Check Error handling

To fix in separate issues:

In auto_ai_critique read inputs from db instead of getting them from frontend dependent on : https://github.com/Agenta-AI/agenta/issues/1102
[ ] retry >> To do in separate issue
[ ] logs >> To do in separate issue

Sub issue of #989

Step 1

Migration to Bennie still has cloud to be done @aybruhm
We need to cleanup the code @aybruhm
We have a bug from the backend that Akrem has been notified about @MohammedMaaz
We need cypress tests for the evaluation @MohammedMaaz @bekossy [invest 30 minutes exploring cypress studio)

Step2:

Run the test in the Bennie branch after finishing it
Deploy Bennie branch to staging and QA(@devgenix @bekossy)
Debugging

Step3:

We need to migrate the database (@aybruhm)

Issues:

Deleted Evaluators are not Deleted. (fixed)
There is an issue with large test sets (@aakrem)


UTMFW not interceting SSLPROXY requests

I have installed and configured UTMFW , in the victim machine I have redirected traffic to UTMFW, in the packet filter logs, it does not resolve DNS of the victim machine, instead blocks its request for DNS. I cannot see any connection to SSLProxy as well,
When I turn off packetfilter DNS is resolved and still no connection to sslproxy, someone please tell me the hierarchy to use the UTMFW services for SSLPROXY

The usual use case for UTMFW is:
local network <--> UTMFW <--> Internet or external network

If you have successfully installed UTMFW, a computer on the local network should be able to get an IP address from UTMFW and connect to, say, a web server on the Internet, over http or https; in the latter case SSLproxy is used to decrypt and divert traffic to the web filter running on UTMFW. Make sure you have installed the ca.crt of SSLproxy on your web browser (or other clients like MUAs). The packet filter rules and DNS configuration should work without any problems in this case.
I suspect that there is an issue with your network setup. For example,

Is the external interface of UTMFW configured correctly? If it obtains its IP address and configuration over DHCP, is it correct? The $ext_if macro in the pf ruleset depends on the external IP address of UTMFW, so the DHCP server on the external network should be running when UTMFW is starting, or else the pf rules will not work as expected.
The DNS configuration should match with the external and internal interface configuration. Is the IP address of the internal interface the same as the "Listen on" address of DNS? Is the gateway address of the external interface is the same as the "Forwarders" address of DNS?
Also, if you change any interface configuration on the System>Config>Network page, you should run "Automatic config" on System>Config>Init page, and restart the system. This is necessary as many UTM services depend on those network settings.

This is all I can say unless you share more information on what you are trying to do, as I have asked before. For example, I don't understand the phrase "the hierarchy to use the UTMFW services for SSLPROXY". (Currently, there are 4x UTM services using SSLproxy: Web Filter + HTTP proxy, POP3 proxy, SMTP proxy, and IPS. One can say that anti-virus and anti-spam software use it too, because those 4x UTM services make use of anti-virus and anti-spam.)


EPOCH_RUNTIME format not available through service

Describe the bug
I tried to run test_epoch_inference.py with the service installed and direct msr-safe access removed, and I expected the test to pass instead the test hangs indefinitely, and the test log shows EPOCH_RUNTIME is not available.
GEOPM version
1.1.0+dev1674g69e2becc
https://github.com/bgeltz/geopm/tree/issue-2015
Expected behavior
The test runs to completion with a return code of 0.
Actual behavior
In the first terminal window:
[nomsr@mcfly9 test](issue-2015)$ python3 ./test_epoch_inference.py
srun: Loaded msrsave restore plugin.
srun: Loaded msrsave restore plugin.
srun: Loaded msrsave restore plugin.
srun: Loaded msrsave restore plugin.

In the second terminal window:
[nomsr@mcfly test](issue-2015)$ cat test_epoch_inference.log
2021-12-06 15:21:57.085121

OMP_PROC_BIND=true GEOPM_CTL=process GEOPM_PROFILE=test_epoch_inference GEOPM_AGENT=monitor GEOPM_POLICY=test_epoch_inference-agent-config.json GEOPM_REPORT=test_epoch_inference_no_epoch.report GEOPM_TRACE=test_epoch_inference_trace_no_epoch GEOPM_TRACE_SIGNALS=EPOCH_RUNTIME,EPOCH_RUNTIME_IGNORE,EPOCH_RUNTIME_NETWORK KMP_AFFINITY=disabled MV2_ENABLE_AFFINITY=0 KMP_WARNINGS=FALSE srun -N 1 -n 2 --cpu-bind v,mask_cpu:0x100000000000,0xffffffffffe --export=LD_PRELOAD=libgeopm.so,ALL -I30 -t 100 -J test_epoch_inference -- /home/nomsr/geopm/integration/test/.libs/test_epoch_inference --verbose

srun: Loaded msrsave restore plugin.
cpu-bind=MASK - mcfly9, task  1  1 [46373]: mask 0xffffffffffe set
cpu-bind=MASK - mcfly9, task  0  0 [46372]: mask 0x100000000000 set
Error: <geopm> Invalid argument: PlatformIOImp::format_function(): unknown how to format "EPOCH_RUNTIME": at src/PlatformIO.cpp:576
terminate called after throwing an instance of 'geopm::Exception'
  what():  <geopm> Runtime error: All2allModelRegion::All2allModelRegion(): at src/All2allModelRegion.cpp:74
srun: error: mcfly9: task 1: Aborted (core dumped)

Additional context
When this bug occurs, stale shmem keys are left in /dev/shm and must be manually removed prior to the next run.  This seems to be an additional bug in this context.

EPOCH_RUNTIME is not a signal that exists any longer.
Since this is broken in dev and is not specifically related to test failing when msr-safe permissions are removed, this is tech-debt. This should be revisited when the tests that used to rely on the EPOCH signals (e.g. EPOCH_RUNTIME) are rewritten to use the profile trace instead.
All of the old signals re:bloat can be derived from the profile trace.

This is exposing another real bug that the Tracer does not vet the signals passed in to ensure they are valid before attempting to query for the format.  This causes the Controller to fall over during the init handshake.


Unable to set the default ViewEncapsulation with AOT compiled build

When doing a JIT build using the CLI, I can set the compiler options within platformBrowserDynamic().bootstrapModule. Compiler options allow me to set the default ViewEncapsulation for the whole application.
OS?

Mac OSX (Sierra)

Versions.

angular-cli: 1.0.0-beta.17

Repro steps.

Create a default app ng new app
Inside main.ts add compiler options like so  platformBrowserDynamic().bootstrapModule(AppModule, { defaultEncapsulation: ViewEncapsulation.None });
ng serve
Encapsulation is none
ng serve --aot
Encapsulation is back to Emulated

The log given by the failure.

No Error logs

Mention any other details that might be useful.
I'm not actually sure how to do this with just ngc by itself, so maybe that could point me in the right direction.

created a feature request for this at the compiler level here: angular/angular#12251

Closing as it doesn't seem to be a CLI issue.


update: removed slack notification from templates

closes onepanelio/core#276

These should be commented out but still kept in the YAML with the following comment:
# DAG Workflow to be executed once a Workspace action completes (optional)

These should be commented out but still kept in the YAML with the following comment:
# DAG Workflow to be executed once a Workspace action completes (optional)

Roger that, will adjust.

These should be commented out but still kept in the YAML with the following comment:
# DAG Workflow to be executed once a Workspace action completes (optional)

@rushtehrani How's it look now?


docs: Adding InVision to Users

Checklist:

[ ] Either (a) I've created an enhancement proposal and discussed it with the community, (b) this is a bug fix, or (c) this is a chore.
[ ] The title of the PR is (a) conventional, (b) states what changed, and (c) suffixes the related issues number. E.g. "fix(controller): Updates such and such. Fixes #1234".
[x] I've signed the CLA.
[ ] I have written unit and/or e2e tests for my change. PRs without these are unlikely to be merged.
[ ] My builds are green. Try syncing with master if they are not.
[ ] My organization is added to USERS.md.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Thank you @candonov . You're Github profile doesn't show you working for InVision - so we don't have a way to verify your relationship with them. Any suggestions?

@alexec, thank you for pointing that out. I fixed it, I should show up now.

Thank you!


Error: Cant run the project

This is the error i got.
/usr/local/Cellar/vite/4.1.4/libexec/lib/node_modules/vite/bin/vite.js:2
import { performance } from 'node:perf_hooks'
^^^^^^
SyntaxError: Unexpected token import
at new Script (vm.js:51:7)
at createScript (vm.js:138:10)
at Object.runInThisContext (vm.js:199:10)
at Module._compile (module.js:626:28)
at Object.Module._extensions..js (module.js:673:10)
at Module.load (module.js:575:32)
at tryModuleLoad (module.js:515:12)
at Function.Module._load (module.js:507:3)
at Function.Module.runMain (module.js:703:10)
at startup (bootstrap_node.js:193:16)

Hi jerviechronix, in the main folder execute the following command: npm i --save-dev @types/node (on Terminal).
The command npm i --save-dev @types/node is used to install TypeScript type definitions for the Node.js runtime environment as a development dependency in a Node.js project. This should solve the issue.
In any other case, update your node version and try a fresh install. (npm update).
If this solved your problem, below the comment, please click Mark as answer 👍

I g et a different error message when trying to npm install.

I get a different error message when trying to npm install.

At the main folder execute the following command in Terminal: npm i --legacy-peer-deps.

Wow! It works. Thank you!!!

My pleasent jerviechronix, thus command install (or update) all the dependencies in package.json file.
Please mark my comment as an answer 👍

Glad to help! If you're looking for a free hosting service, I would suggest checking out vercel (frontend-as-a-service product). When it comes to backend render is a great option.
Anytime you're all set, close your issue #10

Sorry to ask you basics, but kindly provide 3 to 4 steps how I can host this with these 2 options. I have uploaded this to Github already

At this case, the website is frontend-only, so you don't have to use render.com. To deploy this website on vercel, follow this video.

obsolutely @ladunjexa  i have never seen a faster reply than this, it is really privilege to use your code and project !!!

Hi @ladunjexa , tried it on vercel, i get the following error during deployment
[07:24:02.510] Running build in Cleveland, USA (East) – cle1
[07:24:02.566] Cloning github.com/manjubluemoon/Threejs-3D-Portfolio (Branch: main, Commit: 4503894)
[07:24:02.819] Previous build cache not available
[07:24:06.900] Cloning completed: 4.334s
[07:24:07.790] Running "vercel build"
[07:24:08.268] Vercel CLI 30.2.1
[07:24:08.813] Installing dependencies...
[07:24:10.365] npm notice
[07:24:10.366] npm notice New minor version of npm available! 9.5.0 -> 9.7.1
[07:24:10.366] npm notice Changelog: https://github.com/npm/cli/releases/tag/v9.7.1
[07:24:10.366] npm notice Run npm install -g<EMAIL_ADDRESS>to update!
[07:24:10.366] npm notice
[07:24:10.367] npm ERR! code ERESOLVE
[07:24:10.370] npm ERR! ERESOLVE could not resolve
[07:24:10.370] npm ERR!
[07:24:10.370] npm ERR! While resolving<EMAIL_ADDRESS>[07:24:10.370] npm ERR! Found<EMAIL_ADDRESS>[07:24:10.370] npm ERR! node_modules/react
[07:24:10.370] npm ERR<EMAIL_ADDRESS>from the root project
[07:24:10.370] npm ERR!   peer<EMAIL_ADDRESS>|| ^17.0.0 || ^18.0.0" from<EMAIL_ADDRESS>[07:24:10.370] npm ERR!   node_modules/@react-spring/animated
[07:24:10.370] npm ERR<EMAIL_ADDRESS>from<EMAIL_ADDRESS>[07:24:10.370] npm ERR!     node_modules/@react-spring/core
[07:24:10.370] npm ERR<EMAIL_ADDRESS>from<EMAIL_ADDRESS>[07:24:10.370] npm ERR!       node_modules/@react-spring/three
[07:24:10.371] npm ERR<EMAIL_ADDRESS>from<EMAIL_ADDRESS>[07:24:10.371] npm ERR!         node_modules/@react-three/drei
[07:24:10.371] npm ERR<EMAIL_ADDRESS>from<EMAIL_ADDRESS>[07:24:10.371] npm ERR!     node_modules/@react-spring/three
[07:24:10.371] npm ERR<EMAIL_ADDRESS>from<EMAIL_ADDRESS>[07:24:10.371] npm ERR!       node_modules/@react-three/drei
[07:24:10.371] npm ERR<EMAIL_ADDRESS>from the root project
[07:24:10.371] npm ERR!   17 more (@react-spring/core, @react-spring/shared, ...)
[07:24:10.371] npm ERR!
[07:24:10.371] npm ERR! Could not resolve dependency:
[07:24:10.371] npm ERR! peer<EMAIL_ADDRESS>|| ^16.0.0-beta || ^16.0.0" from<EMAIL_ADDRESS>[07:24:10.371] npm ERR! node_modules/react-tilt
[07:24:10.371] npm ERR<EMAIL_ADDRESS>from the root project
[07:24:10.371] npm ERR!
[07:24:10.371] npm ERR! Conflicting peer dependency<EMAIL_ADDRESS>[07:24:10.371] npm ERR! node_modules/react
[07:24:10.371] npm ERR!   peer<EMAIL_ADDRESS>|| ^16.0.0-beta || ^16.0.0" from<EMAIL_ADDRESS>[07:24:10.372] npm ERR!   node_modules/react-tilt
[07:24:10.372] npm ERR<EMAIL_ADDRESS>from the root project
[07:24:10.372] npm ERR!
[07:24:10.372] npm ERR! Fix the upstream dependency conflict, or retry
[07:24:10.372] npm ERR! this command with --force or --legacy-peer-deps
[07:24:10.372] npm ERR! to accept an incorrect (and potentially broken) dependency resolution.
[07:24:10.372] npm ERR!
[07:24:10.372] npm ERR!
[07:24:10.372] npm ERR! For a full report see:
[07:24:10.372] npm ERR! /vercel/.npm/_logs/2023-06-18T01_54_09_103Z-eresolve-report.txt
[07:24:10.373]
[07:24:10.373] npm ERR! A complete log of this run can be found in:
[07:24:10.373] npm ERR!     /vercel/.npm/_logs/2023-06-18T01_54_09_103Z-debug-0.log
[07:24:10.387] Error: Command "npm install" exited with 1
[07:24:10.780] BUILD_UTILS_SPAWN_1: Command "npm install" exited with 1

@manjubluemoon Open a new issue.

Done, created new - https://github.com/ladunjexa/Threejs-3D-Portfolio/issues/11


Reading/writing fails for large data.frames

I'm trying to use feather to transfer large data.frames between R and Python.
However, reading data fails after some size.  Below is a brief reproducible example:
seqs <- paste0(rep("A", 77), collapse="")
N <- 40000000 # 40 million
df <- data.frame(sequences = seqs, var1 = runif(N), var2 = sample(N), stringsAsFactors = F)
write_feather(df, path = "/tmp/test.feather")
z <- read_feather("/tmp/test.feather")

I am using the latest CRAN version.

Could you characterize the failure in some way?
Also, have you tried with the arrow package? It has a more robust and performant implementation of read/write_feather

Here's the error I get using read_feather.
Error in coldataFeather(x, i) :
  embedded nul in string: '\0\0`\x9a2\x82\xe3?\0\0\0p&Q\xe4?\0\0\xc0ѵ\x8c\xe2?\0\0\x80\xed\xf7A\xe2?\0\0\x80ALS\xdd?\0\0\0\xfa=\x9e\xc3?\0\0\xe0U\017\xe0\xe0?\0\0\0\xc3Ń\xcf?\0\0\xa0\x85M \xe4?\0\0\05\xe7'

Thanks for pointing towards the arrow package.  It seems faster, but it also gives an error:
library(arrow)

seqs <- paste0(rep("A", 77), collapse="")
N <- 40000000 # 40 million
df <- data.frame(sequences = seqs, var1 = runif(N), var2 = sample(N), stringsAsFactors = F)
arrow::write_feather(df, stream = "/tmp/test.feather")
z <- arrow::read_feather("/tmp/test.feather")

Error in Table__to_dataframe(x, use_threads = option_use_threads()) :
  Invalid: Invalid offset buffer

Should I open an issue on the arrow package?

Well, failing faster is an improvement I guess ;)
It sounds like you may be hitting https://issues.apache.org/jira/browse/ARROW-3317. Until that's resolved, if you can chunk your data frame into multiple parquet files, you can read them with pyarrow as a single unit with the ParquetDataset class: https://arrow.apache.org/docs/python/parquet.html#reading-from-partitioned-datasets
Similar functionality is coming soon to the arrow R package.

This should be fixed in the arrow::write_feather/read_feather functions


Drag to resize the node in Godot Editor become extremely uncontrollable in 3.2.4 RC5

Godot version:

3.2.4 RC5
OS/device including version:

Mac OS
Issue description:

In 2D scene editor, when drag an anchor to resize a node, it uncontrollable, it scales very fast.
I had not see this issue before rc5.
Steps to reproduce:
Minimal reproduction project:

Duplicate of #46979.


use anza-xyz/ntapi instead of the labs one

Problem
we should use anza-xyz/ntapi as the vendor. just forked it and the commit, https://github.com/anza-xyz/ntapi/commits/97ede981a1777883ff86d142b75024b023f04fad, is reachable
Summary of Changes
use it

found https://github.com/solana-labs/solana/pull/32488 and https://github.com/solana-labs/solana/pull/32491.
also ntapi has released new version 0.4.0 and 0.4.1. both of them include the commit that we need https://github.com/MSxDOS/ntapi/commit/24fc1e47677fc9f6e38e5f154e6011dc9b270da6
do we still need to patch this one 🤔

do we still need to patch this one 🤔

as you guessed, this entirely should rather be removed. it's no longer used as indicated here:


docs: fix simple typo, cerialized -> serialized

There is a small typo in CoreBitcoin/BTCPaymentMethodRequest.h, CoreBitcoin/BTCPaymentRequest.h.
Should read serialized rather than cerialized.
Semi-automated pull request generated by
https://github.com/timgates42/meticulous/blob/master/docs/NOTE.md

Thanks!

Thanks!


V2 - Profile Improvement

Profile is the heuristic and the core of the algorithm. A good heuristic leads to better solutions. However, it is challenging to find a great heuristic by hand. Ideally, I should train the AI to learn it by itself. This is exactly what pazulove tries to achieve.
In V2, profile should work better with each other and also it should be used to analyse the board even before find the solution. This way, the search can stop early if we want to since a good solution may be found already.
Also, more profiles will be added. It is challenging to balance between different profiles. For example, 2U and combo. 2U needs to connect in 4 but combo aims to connect in 3 only. Unless, it is necessary to do 2U, combo should take over. Sometimes, it is fine to do less combo but does more attack. Profile should focus on surviving in game.

The problem is the balance between different profiles. 2U can reduce max combo but this should be allowed. goal is now added to check if the goal if found, for example, 1U and 5 colours while doing max combo. The scan is definitely needed here, and it needs to evaluate based on the board. Think more like a player, and this will make it far more flexible in the future.


Windows Phone - Crashing

Latest version of Quarrel Insider as of now. Latest OS update available for my Lumia 950 XL (1709 ,10.0.15254.590). I can login to the app and see channels and friends, but when I try to do anything, the app crashes. By anything I mean open a text channel in any server or going to the settings. Everything seems to crash the app immediately.

there is a known crash on mobile with embed/attachments, could you try going to a text channel that you are sure has no embeds/attachments in.

Hello. I just tested a channel with just text and it crashes before it even seems to load anything. I made a new empty channel on my server and it opened normally. I sent a message there (just text) and it crashed. I can see on PC that the message was sent. When I try to go back to this channel on my phone, I can't see the text I sent there since it crashes again before it loads. Text I sent was just 'Test'. I've noticed the embed crash on the regular Quarrel version on my phone, but this seems to happen with just loading a channel with simple text. And like I mentioned, I can't even open settings to see if there's something that would help with this issue.

so it loads the empty channel but crashes when there is a message, I will see if I can find out the problem.

Have you managed to track down this issue? Would having Quarrel and Quarrel Insider installed (but not running) at the same time cause this or any other issues?

This should have been fixed in #97. You should be able to have both installed at the same time.

I still have this problem on mobile, is a new build not pushed there yet?


[DO NOT MERGE] Test coverage with Isparta

This PR aims to add test coverage with Isparta:

uses mocha without karma
jsdomify to provide a fake DOM (needed by React TestUtils)
instruments the code with isparta/istanbul

Hey @gcedo, take a look through this branch of chai's type-detect, which I'm working on. It sets up a istanbul config, using Karma for browser testing (as well as node based testing, but thats irrelevant for us). The main bits you need are the test:browser npm script, which just runs Karma and the karma.conf.js reporters section, which features the coverage reporter. This is probably the easiest way to set up istanbul with Karma - no extra test config, no extra config files.

:+1: I'll have a look :blush:

FYI that type-detect config uses browserify to concat tests, but still outputs a single HTML file with an accurate report:


My way of helping the community

@jeheran is the naming good for you?
or is Datacrunch.ipynb too generic for you?

Sir, I have renamed the .ipynb file. Please check if any changes are to be made.


select specific fields

Is there a way to select only specific fields in a collection when retrieving a list? For example when listing the users collection I would like to retrieve only the email field.
Thanks.

At the moment it is not possible without creating a separate View collection with a subset of the felds you want to return.
It is in the roadmap and will be added in the near future.


[BUG] Captive Portal is not creating IPFW Firwall rules for >1 zones

I configured two zones and only the rules for http and https for one zone has been created.

Version: 17.1 with 17.1.1 kernel

@fabianfrz I tested two zones on my machine, which seem to generate the correct rules. Are you using more interfaces per zone? Can you share some additional information about your setup (configured networks, ipfw forward rules, etc)?

I used two zones, one on em5 and one on em6, and first it generated the rules only for em5 while both were enabled but after disabling the captive portal on em5, it generated the rule for em6.
It is one captive portal zone per interface.

can you dump an ipfw show? My end doesn't produce the same issue.

no I cannot because the firewall is not under my control anymore, however I know that the fwd part was only included for one interface

Ok, let's keep this issue open, I can't reproduce it, but maybe someone else can eventually.

Maybe this information helps: both have http and https redirects enabled (transparent proxy)

unfortunately not, below my output with two interfaces (em2, em2_vlan4)
ipfw show | grep fwd
05000    0       0 fwd <IP_ADDRESS>,8000 tcp from any to any dst-port 443 in via em0
05000    0       0 fwd <IP_ADDRESS>,9000 tcp from any to any dst-port 80 in via em0
05001    0       0 fwd <IP_ADDRESS>,8001 tcp from any to any dst-port 443 in via em2_vlan4
05001    0       0 fwd <IP_ADDRESS>,9001 tcp from any to any dst-port 80 in via em2_vlan4
65532    0       0 fwd <IP_ADDRESS>,3128 tcp from any to any dst-port 80 via em0
65532    2     104 fwd <IP_ADDRESS>,3129 tcp from any to any dst-port 443 via em0
65532    0       0 fwd <IP_ADDRESS>,3128 tcp from any to any dst-port 80 via em2_vlan4
65532    0       0 fwd <IP_ADDRESS>,3129 tcp from any to any dst-port 443 via em2_vlan4

I created a fresh VM on virtual Box with 17.1.1 and I cannot reproduce the issue by myself.

@fabianfrz ok, I'll close this now, if it ever pops-up and you know how to reproduce, feel free to reopen.
Thanks for testing!


Prefix each credential with their provider name when exporting.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

This should be merged with https://github.com/newrelic/demo-deployer/pull/17


USHIFT-2139: bump sonobuoy version to 0.57.1

Which issue(s) this PR addresses:

Closes #

/test metal-periodic-test
/test metal-periodic-test-arm

The failure is on the "known" problem unrelated to the change.
/override ci/prow/metal-periodic-test-arm

The CNCF test passed and the failure is not related to the current change.
/override ci/prow/metal-periodic-test

/unhold


Fire command events for own commands

I need to hook into these commands, but can't as no events are fired.

What's the use case please?

Running key:generate in Cachet at the start of app:install.

This is something I want to make part of this package itself.

https://github.com/GrahamCampbell/Laravel-Core/issues/12

The reset command will also have to regenerate it.

I've just not had time to do it yet.

So you do want it part of the package? I can make a PR.

:+1:


Can't download games

When I click "Download title" these lines are shown and nothing goes further.
(https://user-images.githubusercontent.com/76644705/146925029-f44b4b71-188e-44ce-b5df-445a497b8c77.png)

There is no reliable title id. The tool can not download the tmd file. If you have a correct id, you can add it to the titledb.
https://ccs.cdn.c.shop.nintendowifi.net/ccs/download/0005000010195D00/tmd


what debugger do you guys use for CL, RPG, etc.

@obito74 When developing in VS Code I use Code for IBM i, which integrates the IBM i debugger extension - for more information about the requirements, see here: https://halcyon-tech.github.io/docs/#/pages/developing/debug/debug
Occasionally I also use the STRDBG command, especially when debugging a batch job.


Add OCI source label to images

Changes
When building images with ko, add the OCI source label:
org.opencontainers.image.source=https://$(params.package)
This is generally useful, and in the case of ghcr.io it lets GitHub automatically associated the container image with its source repository.
Submitter Checklist
As the author of this PR, please check off the items in this checklist:

[x] Has Docs if any changes are user facing, including updates to minimum requirements e.g. Kubernetes version bumps
[x] Has Tests included if any functionality added or changed
[x] pre-commit Passed
[x] Follows the commit message standard
[x] Meets the Tekton contributor standards (including functionality, content, code)
[x] Has a kind label. You can add one by adding a comment on this PR that contains /kind <type>. Valid types are bug, cleanup, design, documentation, feature, flake, misc, question, tep
[x] Release notes block below has been updated with any user facing changes (API changes, bug fixes, changes requiring upgrade notices or deprecation warnings). See some examples of good release notes.
[x] Release notes contains the string "action required" if the change requires additional action from users switching to the new release

Release Notes
NONE

/kind misc

/lgtm


white page-flash between page animations

I am having a white flash (like in normal page switch) between the page animations. My site has black background.
Anybody has any idea?

I am attaching my links to see better.
Thank you.
http://nagygyulapainting.besaba.com/index.html
http://nagygyulapainting.besaba.com/galleries.html


Sockperf: add sockperf network tests

Supports most linux and BSD
required changes to gcc tool to handle g++ install on some platforms
required change to Make tool to handle make/gmake naming on BSD

one lingering bug in the mariner run, debugging...

one lingering bug in the mariner run, debugging...

should be resolved now. Testing full run of 10 images.

@squirrelsc  @LiliDeng should be good to review/merge now

introduced a bug, fixing, don't merge

Fixed bug, running longer test with sockperf ntttcp and lagscope suites to check for regressions after the cleanup fixes.


DuckDB parsing errors if a column name has quotes

Not super important but affects the split-descriptive-statistics and the split-duckdb-index  jobs
e.g. this dataset has a pretty long column name that has quotes and it raises this error
│ INFO: 2023-10-16 12:27:43,231 - root - Compute descriptive statistics for dataset='lunaluan/chatbox3_history', config='default', split='train'                                                                                │
│ INFO: 2023-10-16 12:27:43,233 - root - Downloading remote parquet files to a local directory /storage/stats-cache/81004481536938-split-descriptive-statistics-lunaluan-chatbox3_hi-0d92723b.                                                   │
│ Downloading 0000.parquet:   0%|          | 0.00/6.75k [00:00<?, ?B/s]Downloading 0000.parquet: 100%|██████████| 6.75k/6.75k [00:00<00:00, 5.67MB/s]                                                                                │
│ INFO: 2023-10-16 12:27:43,912 - root - Loading data into in-memory table.                                                                                │
│ ERROR: 2023-10-16 12:27:44,068 - root - Parser Error: syntax error at or near "detail"                                                                                │
│ LINE 2: ... over his Professor's face. Mention "in detail description" how the professor ...                                                                                │
│                                                   ^                                                                                │
│ Traceback (most recent call last):                                                                                │
│   File "/src/services/worker/src/worker/job_manager.py", line 168, in process                                                                                │
│     job_result = self.job_runner.compute()                                                                                │
│   File "/src/services/worker/src/worker/job_runners/split/descriptive_statistics.py", line 591, in compute                                                                                │
│     compute_descriptive_statistics_response(                                                                                │
│   File "/src/services/worker/src/worker/job_runners/split/descriptive_statistics.py", line 485, in compute_descriptive_statistics_response                                                                                │
│     con.sql(                                                                                │
│ duckdb.ParserException: Parser Error: syntax error at or near "detail"                                                                                │
│ LINE 2: ... over his Professor's face. Mention "in detail description" how the professor ...                                                                                │
│                                                   ^                                                                                │

Thanks for pointing out, @lhoestq.
On the one hand, should we support column names with quotes?
On the other hand, this specific dataset just contains a CSV without header row: the column name is indeed text content.

I agree at least we could catch this error, as we already do in filter/search, and raise a specific error.

No need to spend time on this imo, I mostly created this issue to save time next time we see a similar issue. But yea a nice error message would be better


Problem: overriding postgres symbols

As discovered during a debugging session on #537, there's a chance for a subtle problem when a Postgres symbol is overridden by an extension. Specifically, if a symbol is defined in the extension and postgres, the linker may pick postgres's version of the symbol over the one in the extension
On macOS/clang it seems to compile and link correctly (as we'd expect it) but on Linux/gcc it didn't.
Proposed solution: run an intersection of nm -g --defined-only (or nm -g -U on macOS, it seems)
on both the compiled extension and postgres.
If there's any intersection, error out.

Bounty size: $100
Read more about bounties

Hey, @yrashk ! Could you assign it to me? Seems straight-forwad enough.

Here you go!


I18N

First of all, thank you for this very useful project!
I was wondering: How would I go about changing I18N to another language?

Hey @potofcoffee, in order to customize the texts of Dataset you can create a new Dataset component that extends the original one and provide the translated texts in its data property.
For example:
myDataset.js
import { Dataset } from 'from 'vue-dataset'

export default {
  extends: Dataset,
  data() {
    return {
      // Provide the translated texts here
      datasetI18n: {
        show: 'Show',
        entries: 'entries',
        previous: 'Previous',
        next: 'Next',
        showing: 'Showing',
        showingTo: 'to',
        showingOf: 'of',
        showingEntries: 'entries'
      }
    }
  }
}

Then you can use it like this:
 import  MyDataset from './myDataset.js'

How could I achieve this with Vue3?


Add CHIP support for the Power Configuration and Battery cluster to one of the demo projects

Problem
CHIP defines means for reading information about a device's battery and/or power source but does not currently use this functionality in any of the demo applications.
Proposed Solution
Add CHIP support for the Power Configuration and Battery cluster to one of the demo projects

We already have power source cluster. Is anyone working on Power source configuration cluster right now?
Is there something else related to battery?

@woody-apple @franck-apple anyone working on this?

@fessehaeve Nope, unfortunately not! :(

@woody-apple apparently I did the power source configuration cluster but forgot about this open issue. There is also a power source cluster in the example apps (all-cluster-apps and lock-app). The only thing missing is hooking up the power source to an actual implementation, eg for battery measurement.

It looks we just need to enable those cluster in one of example app zap and implement the relevant callback if needed. Maybe thermostat is a good candidate.
@fessehaeve  please let me know if you need any help on this.

The clusters are enabled in all-clusters-app and lock-app. I was proposing having actual implementation with hardware integration. Not sure if that is really necessary. We could close the issue if everyone is satisfied.

This looks complete, yes. Thanks!


Would an article on keeping work area clean during COVID-19 outbreak be a good idea

It is certainly relevant. I don't know how much to include but keeping keygoard, cell phone, mouse, telephone handset, headset clean, eye glassies, etc. what the best cleaners are. How often? What the current guidance is on time CV-19 can live on surfaces, etc

Need  to move to topic review since team members agreed to this verbally on Mar 12 call.

@markcmiller86 did this turn into PR #492 ?  I think we can close this as done.

Pe #492 is for a curated content of this article


Welcome

Re-arrange the welcome to the server to use a pigepeek rather than just saying pigepeek

config.json add
"csv_headers": ["user_id", "emoji_count", "warning_count"]


Setting SOCIALACCOUNT_PROVIDERS for Django has no effect

I expect that setting SOCIALACCOUNT_PROVIDERS = {} will disable the ability to log in with OAuth providers. But I still see them in Pistorius.

As mentioned at https://github.com/maxking/docker-mailman/tree/main/web#social-auth create /opt/mailman-web-data/settings_local.py for the mailman-web container. Inside write
MAILMAN_WEB_SOCIAL_AUTH = []

to disable social authentication.


Review code and publish

@pooran-c i did it

@saeedniko : this is fine, could you just the comments and the javadocs, then we can merge to main.


TLS/SSL certificate issue when using deploy guide link

https://github.com/GitbookIO/nuts/blame/master/README.md#L36
link: https://nuts.gitbook.com/deploy.html

Cert is wildcard for *.gitbook.io (vs .com)

nuts.gitbook.io does not have a DNS entry

Non-TLS link does work: http://nuts.gitbook.com/deploy.html

@rib3 Caused by a DNS misconfiguration, should be fixed now. Might take some time for DNS settings to propagate.
Thanks for pointing this out !


Case-insensitive header search

In some case, the copied text will have the header lowercased, leading to header not found error. The search phrase should be case insensitive

Fixed by d26050a