Aggregating the output artifacts of parallel steps

Is this a BUG REPORT or FEATURE REQUEST?: FEATURE REQUEST
What happened:
Separating this issue from #861 to handle aggregation of output artifacts. Similar to output parameters which have been expanded using loops, we need some mechanism to aggregate artifacts from parallel steps. With parameters, the solution was to introduce a new variable, steps.XXXX.outputs.parameters as a json list. For artifacts we need something similar. The trick is how we would place aggregate artifacts into a subsequent pod.

When aggregating and importing the artifacts generated by steps in a loop, I think the most useful option may be to allow subsequent steps to reference a composite artifact that is a merge of the contents of all the output artifacts into a single composite artifact.
Each instance of the loop could use the iteration index or other parameter passed in to appropriately name the output file/directory so that the merge does not overwrite content. This gives the user control over how to name/structure the layout of the output artifact.
Example:
If the output artifact directory in each step is output-artifact-dir, each step would generate a file or artifact name something like output-artifact-dir/-artifact.
The composite artifact could be referenced normally as
steps.my-loop-step.outputs.artifacts.name1
Where name1 is the name of the artifact generated by the output steps. This would create a composite artifact my merging all output artifacts with the name ‘name1’. Note that, one could create multiple output artifacts in a loop step using different names.
What do you think?

Even with an off-the-shelf image, I think the user could override the command parameter to customize the name of the output file/directory.
If desired, we could support a second form for accessing the composite output artifact. E.g. if the input artifact is specified as, for example, steps.my-loop-step.output.artifacts.* the unpacked input artifacts could be placed at input-artifact-dir/{0,1,2,3,...}/. That is, each input artifact is unpacked into a subdirectory corresponding to an index number.
One draw back with this approach is that it only works well with loops. I think the first approach is more general.

This seems to be a fairly stale issue, but it would be extremely handy for easily parallelizable tasks such as scraping multiple sources and generating large datasets that need to be merged in the end and analysed as a whole.
Just spent the past couple of hours trying to achieve this :smile:

Since this bug was filed, we now support artifacts with archive: none: {}, and now there is a pattern developed where parallel steps can output to a common s3 "directory". The following step (which needs the aggregated outputs), will download the s3 "directory" as an artifact.

@jessesuen can you point me to that pattern where multiple steps can output to a common s3 directory?

Need to write a proper example, but the idea is that you would disable .tgz archiving on a file like so:
https://github.com/argoproj/argo/blob/master/examples/artifact-disable-archive.yaml#L38
And then the subsequent step would recursively download the s3 key as a "directory." The enhancement that was made in v2.2, is that if the S3 location appears to be a "directory" instead of a file, it performs a recursive download of all of the contents of that "directory." Directory is in quotes because S3 is really just a key/value store.

So, does your container job need to be aware of its "index" or is the template using it to save the artifacts with unique names (using the item index i.e.)?

@jessesuen, did you ever get a chance to add an example which uses archive: none: {} to pass outputs to common s3 directory for parallel task?

@jessesuen extremely interesting as well to perform experiments

This seems potentially broken for GCS per https://github.com/argoproj/argo/issues/1351

@jessesuen: Is there a particular concern in trying to support tasks.X.outputs.artifacts.selector when using loops, and simply extracting all matches? It's up to the workflow designer to ensure the overlay is correct.
@edlee2121 @fj-sanchez I'm suggesting we skip any complexity around indexes and just use unique names.
For example, this is working just fine in a loop to get the artifact onto storage:
    outputs:
      artifacts:
      - name: split
        path: "/tmp/split-{{inputs.parameters.offset}}"

All I'd need to pull out of storage is to just loop through the list, much as parameter aggregation does, and unpack the archives into the target folder.
Unfortunately, due to the GCS folders bug, I can't use the folder clone technique to just download all of the {{workspace.name}} key. And parameter aggregation is a little funky, because I can't trivially aggregate the {{pod.name}} variables (I have to write them to a file, and use valueFrom).

Does anybody have a working example of how to do this?
If not, I'll work something out myself.

Does anybody have a working example of how to do this?
If not, I'll work something out myself.
Edit 1: One thing I tried was using {inputs,outputs}.artifacts.s3 to access the same S3 bucket and key from different pods, however I would need them to use a key which is specific to the current workspace.name, and currently it doesn't seem that {{workspace.name}} is interpolated within inputs.artifacts.s3.key.
Edit 2: I got something to work! Here is my attempt: sebinsua/k8s-argo-parallel-aggregate-workflow

I have used that approach initially as well, it works as long as all steps are running on the same Node or the volume runs in ReadWriteMany mode.. Minikube provides volumes in mode "ReadWriteMany" but EKS (AWS Kubernetes) EBS volumes do not support to be mounted to several nodes at once.

@sebinsua This example rocks, thanks for sharing!
I was able to get this running with ReadWriteMany volumes using nfs-server-provisioner on multiple cloud providers backed with volumes that are usually constrained to ReadWriteOnce. @TekTimmy if you are still blocked on this, I provided a link to the helm chart below.
https://github.com/helm/charts/tree/master/stable/nfs-server-provisioner

Document the pattern. #2549

I'm having a little trouble figuring out the state of this. Looks like there's a solution that works on a volume mount but not on an artifact store?

Wow, I found a solution that works OK for me. Trick was to use parameter as part of the artifact key. I might post an example tomorrow.

Phew, I found a solution that works OK for me. Trick was to use parameter as part of the artifact key. I might post an example tomorrow.

Yes please - would you like to update the example too?

Here's an example of how I'm doing it. I could contribute as an example but it's more of a hack than a pattern at this point I think! I'll see if I can make it a little less hacky and submit as an example with caveat. https://gist.github.com/foobarbecue/bb6c5a1a5c67ad17b9c6cbb7fd32f5ee

Here's an example of how I'm doing it. I could contribute as an example but it's more of a hack than a pattern at this point I think! I'll see if I can make it a little less hacky and submit as an example with caveat. https://gist.github.com/foobarbecue/bb6c5a1a5c67ad17b9c6cbb7fd32f5ee

@foobarbecue Your solution seems to achieve it. But it seems incredibly hacky. Maintaining that would be a nightmare.
We have a use case where actually need to loop over artifacts. And I was thinking along the same lines. But I think it should be implemented at argo feature level, like with a withArtifacts parameter.
I was thinking of contributing to the project. But being mainly a python developer and never having used golang. The code is going over my head. @alexec Any pointers on that? Maybe an architecture document?

I am in the same boat, mostly python and javascript and haven't used go.
I think the critical missing feature here is the ability to specify output artifact keys in the workflow without having to do backflips (changing the configmap and using the "hard-wired" artifact spec style). Those would eliminate the hackyness from my example. I was hoping there was a way to use the default artifact store and specify keys, but there doesn't seem to be.

Hmm. Should not have been closed.

I've created an example of a map-reduce job in Argo Workflows that aggregates outputs. Please take a look
https://github.com/argoproj/argo/pull/4175

If desired, we could support a second form for accessing the composite output artifact. E.g. if the input artifact is specified as, for example, steps.my-loop-step.output.artifacts.* the unpacked input artifacts could be placed at input-artifact-dir/{0,1,2,3,...}/. That is, each input artifact is unpacked into a subdirectory corresponding to an index number.

I like this form, but I think there needs to be a way to access artifacts per-output. For example tasks.my-loop.output.artifacts.something. Then the artifacts are downloaded into input-artifact-dir/{0,1,2,3,...}/ sudirectories as you've proposed.

I've created an example of a map-reduce job in Argo Workflows that aggregates outputs. Please take a look
#4175

Interesting example.
The problem I see is that it requires explicit manipulation of the artifact location, which makes the workflows less reusable.

The map-reduce example gave me an idea how Argo could solve the artifact aggregation with minimal effort.
But then I understood that this is a bad idea and won't support DAGs or artifacts with custom URIs.
<bad_idea>
Suppose there is a normal task. It outputs all its artifacts to <run-id>/<task-id>/<output-name>.
Now we make this task a loop by adding withItems, withParam or withSequence.
What if the resulting sub-nodes would output their artifacts to <run-id>/<task-id>/<output-name>/<loop-idx>?
In this case the loop node's output artifact URI is still <run-id>/<task-id>/<output-name> and when downloaded by downstream component it will automatically contain artifacts from all lop iterations.
</bad_idea>

Perhaps we could implement artifact aggregation the same way as for parameters - the loop node should collect per-output artifact lists and the init executor should be able to download multiple artifacts under a single path.
name: aggregate
inputs:
  artifacts:
  - name: in-art-1
    path: /tmp/inputs/in-art-1/  #Artifacts end up in /tmp/inputs/in-art-1/{1,2,3,4}
    uris:
    - s3: ...
    - s3: ...

name: dag-aggregate-task
template: aggregate
arguments:
- name: in-art-1
   from: {{tasks.loop-task.outputs.artifacts.out1}}

It's simply that map reduce patterns need some enthusiastic support.
I found the easiest way to explore the space was to actually mock out the yaml flows as objects. In one experiment, I just used javascript with a dag library.
Looking forward to seeing what the community comes up with (my experiment was nuked by the client); I'm just saying: yes, map reduce needs to happen, but you can experiment with it in just thinking about an in memory dag.

I think this could be fixed by using key-only artifacts. See #4341

@jessesuen Can we get on slack/zoom to talk to about this?


Db variable not found

Not sure what happened. Here is the error:
shexplore-server/models/account.js:10
var User = db.Model.extend({ tableName: 'users' }, {
           ^

ReferenceError: db is not defined
    at Object.<anonymous> (shexplore-server/models/account.js:10:12)
    at Module._compile (module.js:413:34)
    at Object.Module._extensions..js (module.js:422:10)
    at Module.load (module.js:357:32)
    at Function.Module._load (module.js:314:12)
    at Module.require (module.js:367:17)
    at require (internal/module.js:16:19)
    at Object.<anonymous> (shexplore-server/routes/users.js:6:20)
    at Module._compile (module.js:413:34)
    at Object.Module._extensions..js (module.js:422:10)

@pfgithub, do you know what is going on here?

The DB wasn't initialized right. For a temporary fix, remove anything
requiring those files
On Fri, Apr 22, 2016 at 8:08 PM Hum4n01d<EMAIL_ADDRESS>wrote:

Assigned #1 https://github.com/shexplore/shexplore-server/issues/1 to
@pfgithub https://github.com/pfgithub.
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/shexplore/shexplore-server/issues/1#event-638447094

--

Which files was DB used in?
Sincerely,
Lakshay Maharana
Miller Leadership 2015-2016
On Fri, Apr 22, 2016 at 9:39 PM, pfgithub<EMAIL_ADDRESS>wrote:

The DB wasn't initialized right. For a temporary fix, remove anything
requiring those files
On Fri, Apr 22, 2016 at 8:08 PM Hum4n01d<EMAIL_ADDRESS>wrote:

Assigned #1 https://github.com/shexplore/shexplore-server/issues/1 to
@pfgithub https://github.com/pfgithub.
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/shexplore/shexplore-server/issues/1#event-638447094

--

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub
<https://github.com/shexplore/shexplore-server/issues/1#issuecomment-213663091>

@FlyKnight, the file is shexplore-server/models/account.js

That file isn't there right now.
Sincerely,
Lakshay Maharana
Miller Leadership 2015-2016
On Sat, Apr 23, 2016 at 9:26 AM, Hum4n01d<EMAIL_ADDRESS>wrote:

@FlyKnight https://github.com/FlyKnight, the file is
shexplore-server/models/account.js
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/shexplore/shexplore-server/issues/1#issuecomment-213775146

Are you sure? Try git pulling. It's on the repo.

On Apr 23, 2016, at 10:41 AM, FlyKnight<EMAIL_ADDRESS>wrote:
That file isn't there right now.
Sincerely,
Lakshay Maharana
Miller Leadership 2015-2016
On Sat, Apr 23, 2016 at 9:26 AM, Hum4n01d<EMAIL_ADDRESS>wrote:

@FlyKnight https://github.com/FlyKnight, the file is
shexplore-server/models/account.js
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/shexplore/shexplore-server/issues/1#issuecomment-213775146

—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub

Solved


Add support for folders/git ls-files channel

Similar to Files can we have Folders or Directories channel?
My use case is to create a binding in the fish shell so I can run tv.
Here is how my ~/.config/fish/config.fish looks like.
# Ensure tv is installed and configured
if command -q tv
    # Ctrl+Alt+f to select and paste file path
    bind \e\cf 'set -l selected_file (tv)
    if test -n "$selected_file"
        commandline -i "$selected_file"
    end
    commandline -f repaint'

    # Ctrl+Alt+d to select and paste directory path
    bind \e\cd 'set -l selected_dir (find . -type d | tv)
    if test -n "$selected_dir"
        commandline -i "$selected_dir"
    end
    commandline -f repaint'
end

Now in the terminal I can type vim  and press ctrl+alt+f. This will open television, I can fuzzy search and when select it will paste the pat in the terminal so it will look like vim path/I/selceted/from/tv.txt. I would like to do the same for directory. Right now the above code works but you can see that I'm using find . -type d instead. If tv has folders channel than I can directly type tv dir which will most likely be very fast.
It will also be good to support git ls-files that works with both files and directory. If I'm in a git repo, it may have lot of ignored files such as node_modules or unnecessary build folders and files which I don't care. tv git-ls-files and tv-git-ls-dir?

@prabirshrestha Sure thing for directories.
For git ls-files and dirs, using a custom channel and being able to invoke that custom channel from the command line (not yet implemented but probably straightforward enough) could be a quick alternative if you need to iterate quickly on this.

Can cables be used without the toml file? the reason for this I want to do it all in vim script without asking the consumers to update the toml files.
tv cable --source-command="git ls-files" --preview-command="bath -n --color=always {0}"

You could do something like
git ls-files | tv --preview 'bat -n --color=always {}'

which should give you what you want:

I believe this was fixed by custom channels and https://github.com/alexpasmantier/television/pull/130.
Closing for now


Test creation shouldn't include system.runas unless specified

Summary
Asked E4D to create a test for:
 @AuraEnabled(cacheable=true)
  public static Decimal getAveragePrice() {
      List<AggregateResult> price = [SELECT AVG(MSRP__c) avgPrice FROM Product__c];
      return (Decimal)price[0].get('avgPrice');
  }

And it came up with:
static void testAveragePrice() {
        System.runAs(new User(Id = UserInfo.getUserId())) {
            Test.startTest();
            Decimal avgPrice = ProductController.getAveragePrice();
            Test.stopTest();
            List<Product__c> productList = [SELECT MSRP__c FROM Product__c];
            Decimal expectedAveragePrice = productList[0].MSRP__c;
            for (Integer i = 1; i < productList.size(); i++) {
                expectedAveragePrice += productList[i].MSRP__c;
            }
            expectedAveragePrice = expectedAveragePrice / productList.size();
            System.assertEquals(expectedAveragePrice, avgPrice, 'The average price should be calculated correctly');
        }
    }

Steps to Reproduce

Create the method specified
Ask E4D to generate test

Actual Result
The one shared
Expected result
It should not include system.runAs unless specified
Additional information
Salesforce Extension Version in Code builder: 61.1.2
Salesforce Einstein For Developers Version in Code builder: 0.50.0
code-server: v4.18.0
Code: 1.83.1

Hi @albarivas - Thank you for this feedback. We will pass it on to the AI Research team.


Added info about missing menu option

you need 4.7.1. or up. as found in the blog post.
When creating a new PR, please do the following and delete this template text:

Reference the issue number if there is one:
Fixes #Issue_Number

The "Fixes #nnn" syntax in the PR description causes
GitHub to automatically close the issue when this PR is merged.

Thanks @jphellemons.


How to Upgrade Data from NAV 2018 to Business Central Online

I had migrated the code to AL extension and now i need to upgrade the data from Nav 2018 to Business Central as i didn't found any fruitfull information about this please help.

Please see the Business Central documentation found here: https://docs.microsoft.com/en-us/dynamics365/business-central/index. Thanks!

Thanks for your reply,
But  already gone through the above Link but how i can upgrade my data from NAV 2018 to Business Central Online as my database is in Tera bytes please suggest.

Please see the Business Central documentation found here: https://docs.microsoft.com/en-us/dynamics365/business-central/index. Thanks!

Thanks for your reply,
But already gone through the above Link but how i can upgrade my data from NAV 2018 to Business Central Online as my database is in Tera bytes please suggest.


Remove note

[Enter feedback here]
Currently, mobile users can't share app content to the meeting stage. They can see content shared from desktop, though.
This note should be removed now

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 09c05a14-d442-bcd1-f233-1beeddfd4bb1
Version Independent ID: eb958ded-39dc-c0ab-a7c8-2d5bf334ab16
Content: Designing your meeting extension - Teams
Content Source: msteams-platform/apps-in-teams-meetings/design/designing-apps-in-meetings.md
Service: msteams
GitHub Login: @heath-hamilton
Microsoft Alias: lajanuar

Hi @surbhigupta12 - Could you please help here to update the doc accordingly?


Feature request: restart processes when SIGHUP is received

At the moment, SIGTERM, SIGINT and SIGHUP triggers a shutdown of Foreman.
I think it would be useful to be able to change the semantics for SIGHUP a bit, so that it instead will trigger a restart of all processes monitored by Foreman. That way, you can conveniently make it so that one of the watched processes sends a SIGHUP to itself which will make the entire set of processes restart, which can be very, very convenient sometmies.
@ddollar - would you accept a PR that implements this? I realize it's a semantical change, so if you want this to be opt-in rather than the default, that's an option as well.

@perlun are you still looking for this feature?

@andrewmcodes No longer using Foreman, so in practice, not really. But feel free to investigate it anyway if you like.

I’m just trying to help out the maintainer. Would you mind closing if this is no longer an issue for you?

@andrewmcodes It's not an "issue" in the sense that it causes problems for me, but it's still a useful feature I think we could keep on the backlog. Even though I have no use for it myself at the moment, this does not mean that the same holds true for everyone everywhere.
Nevertheless, it's up to you and the maintainer to determine what kind of issues you want to leave open on the GitHub project page.

I’m just trying to help out the maintainer. Would you mind closing if this is no longer an issue for you?

I think it's will be a great feature.
Currently I'm using Foreman to development and running four processes and from time to time I want to restart one of daemons.


optionsExt: Extended version of 'options' with additional information in 'help'-flag

@michelk: Thank you! 🙂


Missing property in new release

Hi,
When using the library at the previous release (0.10), there was the property Trigger Polarity that I cannot find anymore on this release (0.11). Any ideas why this may be? I have followed the instructions at https://github.com/TheImagingSource/tiscamera/wiki/UVC-Extension-Units but gotten
<pre>[libwebcam] Unknown V4L2 control ID encountered: 0x0199E201 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E201, name = 'Exposure Time (us)' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E202 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E202, name = 'Auto Shutter' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E203 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E203, name = 'Auto Exposure Reference' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E205 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E205, name = 'Gain Auto' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E208 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E208, name = 'Trigger Mode' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E209 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E209, name = 'Software Trigger' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E210 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E210, name = 'Trigger Delay' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E211 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E211, name = 'Strobe Enable' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E212 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E212, name = 'Strobe Polarity' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E213 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E213, name = 'Strobe Exposure' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E214 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E214, name = 'Strobe Duration' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E215 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E215, name = 'Strobe Delay' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E216 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E216, name = 'GPOUT' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E217 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E217, name = 'GPIN' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E218 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E218, name = 'ROI Offset X' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E219 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E219, name = 'ROI Offset Y' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E220 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E220, name = 'ROI Auto Center' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E234 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E234, name = 'Trigger Polarity' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E236 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E236, name = 'Trigger Expposure Mode' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E237 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E237, name = 'Trigger Burst Count' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E238 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E238, name = 'Trigger Debounce Time (us)' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E239 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E239, name = 'Trigger Mask Time (us)' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E240 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E240, name = 'Trigger Noise Suppression Time' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E241 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E241, name = 'Auto Functions ROI Control' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E242 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E242, name = 'Auto Functions ROI Left' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E243 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E243, name = 'Auto Functions ROI Top' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E244 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E244, name = 'Auto Functions ROI Width' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E245 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E245, name = 'Auto Functions ROI Height' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E251 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E251, name = 'Flip Horizontal' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E252 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E252, name = 'Flip Vertical' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E254 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E254, name = 'Exposure Auto Upper Limit Auto' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E256 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E256, name = 'Exposure Auto Upper Limit (us)' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E257 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E257, name = 'Override Scanning Mode' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E258 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E258, name = 'Auto Functions ROI Preset' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E201 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E201, name = 'Exposure Time (us)' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E202 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E202, name = 'Auto Shutter' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E203 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E203, name = 'Auto Exposure Reference' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E205 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E205, name = 'Gain Auto' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E208 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E208, name = 'Trigger Mode' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E209 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E209, name = 'Software Trigger' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E210 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E210, name = 'Trigger Delay' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E211 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E211, name = 'Strobe Enable' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E212 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E212, name = 'Strobe Polarity' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E213 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E213, name = 'Strobe Exposure' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E214 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E214, name = 'Strobe Duration' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E215 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E215, name = 'Strobe Delay' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E216 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E216, name = 'GPOUT' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E217 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E217, name = 'GPIN' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E218 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E218, name = 'ROI Offset X' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E219 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E219, name = 'ROI Offset Y' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E220 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E220, name = 'ROI Auto Center' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E234 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E234, name = 'Trigger Polarity' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E236 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E236, name = 'Trigger Expposure Mode' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E237 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E237, name = 'Trigger Burst Count' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E238 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E238, name = 'Trigger Debounce Time (us)' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E239 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E239, name = 'Trigger Mask Time (us)' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E240 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E240, name = 'Trigger Noise Suppression Time' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E241 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E241, name = 'Auto Functions ROI Control' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E242 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E242, name = 'Auto Functions ROI Left' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E243 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E243, name = 'Auto Functions ROI Top' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E244 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E244, name = 'Auto Functions ROI Width' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E245 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E245, name = 'Auto Functions ROI Height' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E251 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E251, name = 'Flip Horizontal' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E252 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E252, name = 'Flip Vertical' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E253 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E253, name = 'Highlight Reduction' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E254 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E254, name = 'Exposure Auto Upper Limit Auto' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E255 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E255, name = 'Exposure Auto Lower Limit (us)' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E256 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E256, name = 'Exposure Auto Upper Limit (us)' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E257 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E257, name = 'Override Scanning Mode' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E258 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E258, name = 'Auto Functions ROI Preset' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E259 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E259, name = 'Gain Auto Lower Limit' [libwebcam] Unknown V4L2 control ID encountered: 0x0199E260 [libwebcam] Invalid or unsupported V4L2 control encountered: ctrl_id = 0x0199E260, name = 'Gain Auto Upper Limit' Importing dynamic controls from file usb3.xml. usb3.xml: error: video1: unable to map 'Exposure Time (us)' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Auto Shutter' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Auto Exposure Reference' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Gain (dB/100)' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Gain Auto' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Whitebalance One Push' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Whitebalance Preset' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Trigger Mode' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Trigger Polarity' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Trigger Global Reset Release' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Software Trigger' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Trigger Delay' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Strobe Enable' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Strobe Polarity' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Strobe Exposure' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Strobe Duration' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Strobe Delay' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'GPOUT' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'GPIN' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'ROI Offset X' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'ROI Offset Y' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'ROI Auto Center' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Auto Focus One Push' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Auto Focus ROI Enable' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Auto Focus ROI Left' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Auto Focus ROI Top' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'ATR Enable' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'ATR Gain' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'ATR Enable Wide D' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'ATR Contrast' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'ATR Contrast Auto' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'ATR Chroma' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Image Stabilization' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Noise Reduction' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Face Detection' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Flip Horizontal' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Flip Vertical' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Highlight Reduction' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Trigger Polarity' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Trigger Operation' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Trigger Exposure Mode' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Trigger Burst Count' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Trigger Debounce Time (us)' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Trigger Mask Time (us)' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Trigger Noise Suppression Time' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Auto Functions ROI Preset' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Auto Functions ROI Control' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Auto Functions ROI Left' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Auto Functions ROI Top' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Auto Functions ROI Width' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Auto Functions ROI Height' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Whitebalance Mode' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'White Balance Temperature' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Whitebalance Temperature Preset' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'White Balance Green Component' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'White Balance Auto Preset' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Exposure Auto Lower Limit' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Exposure Auto Upper Limit' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Exposure Auto Upper Limit Auto' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists) usb3.xml: error: video1: unable to map 'Gain Auto Lower Limit' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Gain Auto Upper Limit' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 2: No such file or directory) usb3.xml: error: video1: unable to map 'Override Scanning Mode' control. ioctl(UVCIOC_CTRL_MAP) failed with return value -1 (error 17: File exists)</pre>

Hello
Sorry for the delay. We confirm the missing property and figure out, why it is missing currently.
I suppose, there will be an update in the near future.
Stefan

Hello
The bug is fixed.
Please "git pull" and rebuild, install. Result after reconnecting the camera is;
$ tcam-ctrl -p 45610198 | grep Polarity
Strobe Polarity                         (bool) default=false value=false category=Special
Trigger Polarity                        (enum)  default=Rising Edge category=Special

Stefan

Hi. I have just pulled, rebuilt and tested, and the bug is fixed. Thanks for the help!
You can close this issue on my end!


[Bug] Button in status not working

Describe the Bug

Buttons like this don't work
To Reproduce
https://user-images.githubusercontent.com/95376647/185363149-fef2e397-ab6a-453d-8c8c-1d56e0f655fb.mp4
Expected Behavior
Supposed to open a web page
Screenshots
https://user-images.githubusercontent.com/95376647/185362904-bd585328-02ea-4018-9e1e-2b76c83cad07.png
https://user-images.githubusercontent.com/95376647/185363149-fef2e397-ab6a-453d-8c8c-1d56e0f655fb.mp4
Discord Version
Stable
Additional Context

On the base discord it works perfectly
I don't know why it doesn't work on better discord


Multi Linestring with 'EMPTY' in the point throwing error

Hi,
Lovely lirary but we are having an issue with MULTILINESTRINGs where it includes "EMPTY" in it similar to:
SRID=4326;MULTILINESTRING((17.3184738535347 60.7864700694704,17.3180661577644 60.7874544933595),EMPTY,EMPTY)

It would then throw this error:
** (DBConnection.ConnectionError) client #PID<0.2818.0> stopped: ** (FunctionClauseError) no function clause matching in anonymous fn/2 in Geo.WKB.Decoder.do_decode/4
    (geo 3.4.2) lib/geo/wkb/decoder.ex:121: anonymous fn(1, <<1, 2, 0, 0, 0, 0, 0, 0, 0>>) in Geo.WKB.Decoder.do_decode/4

The line in the log are kinda incorrect. The lines that matter are these: https://github.com/bryanjos/geo/blob/master/lib/geo/wkb/decoder.ex#L108-L111

Hi, thanks for bringing this up. I didn't know EMPTY was a thing. I can look into it but I will also take any PRs to resolve this.

@bryanjos still receiving this, is this being looked into? Should I take a look at it?

@jnylen If you'd like to submit a PR, that'd be awesome. I'm not sure what the expected behavior here would be—do we stick nil values in the multilinestring's coordinates, or just remove the empty values?


Allocation Id

Description
Adds Allocation Id

API change check
API changes are not detected in this pull request.


Operator Does Not Remove Finalizer

Bug Description
The finalizer of an IstioOperator is not removed even though all child resources have been deleted:
$ kubectl get iop/istiocontrolplane-1-11-1 -n istio-system -o yaml
apiVersion: install.istio.io/v1alpha1
kind: IstioOperator
metadata:
  annotations:
    meta.helm.sh/release-name: istio-system-istio-1-11-1
    meta.helm.sh/release-namespace: istio-system
  creationTimestamp: "2021-09-09T18:06:59Z"
  deletionGracePeriodSeconds: 0
  deletionTimestamp: "2021-09-09T18:13:39Z"
  finalizers:
  - istio-finalizer.install.istio.io
  generation: 2
  labels:
    app.kubernetes.io/managed-by: Helm
  name: istiocontrolplane-1-11-1
  namespace: istio-system
...
status:
  componentStatus:
    Base:
      status: HEALTHY
    IngressGateways:
      status: HEALTHY
    Pilot:
      status: HEALTHY
  status: HEALTHY

Note: The status indicated "HEALTHY" when it should be "RECONCILING".
$ kubectl logs deploy/istio-operator-1-11-1 -n istio-operator -f
...
2021-09-09T18:15:07.212137Z	info	installer	Reconciling IstioOperator
2021-09-09T18:15:07.213569Z	info	installer	Deleting IstioOperator istiocontrolplane-1-11-1

No ns-scoped resources exist:
$ kubectl get all -n istio-system
No resources found in istio-system namespace.

The operator failed to clean-up cluster-scoped resources:
$ kubectl get validatingwebhookconfigurations | grep istio
istio-validator-1-11-1-istio-system   2          24m

$ kubectl get clusterroles | grep istio
istio-operator-1-11-1                                                  2021-09-09T18:06:31Z
istio-reader-clusterrole-1-11-1-istio-system                           2021-09-09T18:07:04Z
istio-reader-istio-system                                              2021-09-09T18:07:03Z
istiod-clusterrole-1-11-1-istio-system                                 2021-09-09T18:07:04Z
istiod-istio-system                                                    2021-09-09T18:07:03Z

Nothing changes even after I manually delete the cluster-scoped resources.
Version
$ istioctl version
no running Istio pods in "istio-system"
1.11.1

Additional Information
$ kubectl version
Client Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.1", GitCommit:"5e58841cce77d4bc13713ad2b91fa0d961e69192", GitTreeState:"clean", BuildDate:"2021-05-12T14:18:45Z", GoVersion:"go1.16.4", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.1", GitCommit:"5e58841cce77d4bc13713ad2b91fa0d961e69192", GitTreeState:"clean", BuildDate:"2021-06-22T04:47:11Z", GoVersion:"go1.16.4", Compiler:"gc", Platform:"linux/amd64"}

xref: https://github.com/istio/istio/issues/35114

xref: https://github.com/istio/istio/issues/32914

xref https://github.com/istio/istio/issues/34994 re the operator not removing validatingwebhookconfigurations either.

Note that this issue is a problem for rolling back a canary upgrade. When rolling back, the revisioned IstioOperator continues to exist with a "Healthy" status. The deletionTimestamp is applied to the revisioned IstioOperator and the operator logs show:
$ kubectl logs deploy/istio-operator-1-11-2 -n istio-operator -f
...
2021-09-09T18:15:07.212137Z	info	installer	Reconciling IstioOperator
2021-09-09T18:15:07.213569Z	info	installer	Deleting IstioOperator istiocontrolplane-1-11-2

All the revisioned child resources continue to exist.


Windows executable

Has anyone had a stab at building a Windows executable? I'm working on a project where I have to use Windows and I wanted to use StarSpace...

Check if #146 works for you.

Thanks for importing this to Windows @davidalbertonogueira !


Bytecode Becomes Contract Address In Exploit Output

Description
Okay, really weird bug here. Runnnig mythril over the address 0xD99b6e04d6911f032d2e9139Bd3309D2641Dc706 causes the final exploit found to be an address not of its own (i.e., "0xD99b..."). Instead, it is part of the bytecode with a 0x thrown in front of it.
...
==== Exception State ====
SWC ID: 110
Severity: Low
Contract: 0x6012c8cf97bead5deae237070f9587f8e7a266d
Function name: giveBirth(uint256)
PC address: 6528
Estimated Gas Usage: 1932 - 2687
A reachable exception has been detected.
It is possible to trigger an exception (opcode 0xfe). Exceptions can be caused by type errors, division by zero, out-of-bounds array access, or assert violations. Note that explicit `assert()` should only be used to check invariants. Use `require()` for regular input checking.
--------------------
Initial State:

Account: [ATTACKER], balance: 0x0, nonce:0, storage:{}
Account: [SOMEGUY], balance: 0x0, nonce:0, storage:{}

Transaction Sequence:

Caller: [SOMEGUY], function: unknown, txdata: 0x3030303000303030303030303030303030303030303030303030303030903030, value: 0x0

How to Reproduce
myth -v4 analyze -1 --execution-timeout 3600 -a 0xD99b6e04d6911f032d2e9139Bd3309D2641Dc706
Expected behavior
All exploits should have the address of the contract, not a subsection of the bytecode.
Other examples
The contract 0x1c764a70797DeB7100037581e679684Cc5C9CA42 produces the same problem. However, in this contract the output that is incorrectly put at the end as an exploit from a bug that grabs the bytecode IS a contract (e.g., 0x8d12a197cb00d4747a1fe03395095ce2a5cc6819), which can be easily confusing to people looking at output. I am fairly certain it is not a dependency of this contract, because it would be too coincidental that the bytecode also matched a contract address of a dependency.

Actually that's because a call happens to that contract which is then executed, so the exception is in that contract.

Oh, how odd. I guess there is really nothing you could do except to check if the contract was a valid contract, but that is not really ideal either since a contract could be self destructed and then it would be harder to tell (e.g., getCode would not work). Thanks for the update, I'll ignore this output then.

I am not closing this as I am not sure if you wanted to do anything with it, though it clearly is the offending contracts fault, not mythrils :1st_place_medal: .

Mythril loads any new contract to which a call is executed and then executes a call, So I don't think this is a bug. As exception gets triggered when a call to 0x6012... is being executed.

@norhh Call me slow, but I was running into another contract that had the same properties of this one and I am still doubtful as to whether this is a bug or not (and maybe this is because I wasn't super clear originally). The contract 0x6012c8cf97bead5deae237070f9587f8e7a266d does not actually exist, so even though mythril is loading the contract that is called (which does not exist), how is mythril claiming this contract has an exploit? If anything, it should be the 0xD99b6e04d6911f032d2e9139Bd3309D2641Dc706 that should have an exploit.

@Danc2050 , It was some python error. The contract should be 0x06012c8cf97bead5deae237070f9587f8e7a266d . Python skips a leading zero while printing hex, so while searching just add a bunch of leading zeros if the length is != 40, I should correct this in mythril.

Great! Thank you for your help.


Invalid data download link

Hi, thank you so much for sharing the code!
The links for downloading miniImagenet and Omniglot are invalid (not the official ones).
Espicially for the miniImage one, how am I supposed to get the data as well as the txt files?
Thanks!

Hi,
Thanks for letting me know! It should be fixed now.


Replace WebServer with a ServiceWorker

This will allow us to modify POST data on XHR requests among other things (once ForeignFetch is implemented in Chrome).

I can not get 2 step verification nor do any of my back up codes work.

Sxs madina  ksa

another way to fix this would be to not wait for foreignFetch, and intercept requests reusing the current infrastructure, but capturing the requests onfetch for the controlling service worker.
that said, this isnt possible because at least in chrome service workers cant intercept synchronous XHR requests
https://bugs.chromium.org/p/chromium/issues/detail?id=602051

unfortunately, foreignFetch wont be implemented as specd.. this means the service worker approach wont work for tamper chrome.
it also doesn't seem like extensions will be given access to sockets, which means TamperChrome's server might not work at all.

https://github.com/w3c/ServiceWorker/issues/1188

Firefox seems to support this:
https://developer.mozilla.org/en-US/docs/Mozilla/Add-ons/WebExtensions/API/webRequest/onBeforeRequest

since foreignFetch is dead, and there doesn't seem to be any chance of it coming back, closing this


Add examples for HIP-583: Transfer to evm address

Problem
The SDK does not have examples for this feature.
Solution
Add examples when the HIP is live on previewnet.
Link to example definitions: https://github.com/hashgraph/hedera-sdk-reference/pull/65
Alternatives
No response

https://github.com/hashgraph/hedera-sdk-java/blob/4152aebaf5c62c2302bceff9b433ad29026b2a59/examples/src/main/java/com/hedera/hashgraph/sdk/examples/TransferUsingEvmAddressExample.java#L42 <- @0xivanov that's the resolution to the issue, right? we can close that one?


Bug: Contributors fetched incorrectly

The contributors' section on the developers page does not contain all the contributors. Cause we are not fetching the contributors of the current repo instead we're fetching contributors of https://github.com/varun-singhh/vovoca. So this has to be refactored and we'll have to fetch the contributors from the backend repo as well. After that take the unique contributors from both the repos cause the same contributor might have contributed to both the repos.  We can then show all the contributors.

assigned


No range limits for numeric configuration options, and several descriptions are lacking in information.

Numeric configuration settings do not specify their limits. For example, FileInfoCacheEntriesMax. It says that it is Uint32. But it is limited to a number in the range 1-65536.
DirectoryCacheEntriesMax is also Uint32. Its range is 1-4096.
Unit of measure is not indicated for all timeouts. Milliseconds? Seconds?
Descriptions:
-EnableBandwidthThrottling
Indicates that bandwidth throttling is enabled.
This isn't descriptive of how it works, or what exactly it really does, or possible effects on performance.
Compare that to -EnableCompressibilitySampling, which has two paragraphs of information on what it does.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 38ca7804-a599-a6be-70fc-03b1d0fef0e5
Version Independent ID: 416ad935-3de6-52ba-aba2-c7c821af24ad
Content: Set-SmbClientConfiguration (SmbShare)
Content Source: docset/winserver2022-ps/smbshare/Set-SmbClientConfiguration.md
Product: w10
GitHub Login: @JasonGerend
Microsoft Alias: jgerend

To make it easier for you to submit feedback on articles on learn.microsoft.com, we're transitioning our feedback system from GitHub Issues to a new experience.
As part of the transition, this GitHub Issue will be moved to a private repository. We're moving Issues to another repository so we can continue working on Issues that were open at the time of the transition. When this Issue is moved, you'll no longer be able to access it.
If you want to provide additional information before this Issue is moved, please update this Issue before December 15th, 2023.
With the new experience, you no longer need to sign in to GitHub to enter and submit your feedback. Instead, you can choose directly on each article's page whether the article was helpful. Then you can then choose one or more reasons for your feedback and optionally provide additional context before you select Submit.
Here's what the new experience looks like.
Note: The new experience is being rolled out across learn.microsoft.com in phases. If you don't see the new experience on an article, please check back later.
First, select whether the article was helpful:

Then, choose at least one reason for your feedback and optionally provide additional details about your feedback:

Article was helpful
Article was unhelpful

Finally, select Submit and you're done!


Fixed dynamic enablement

Fixed a bug in Dynamic Enablement where use of Dynamic Options would re-set the enabled state.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 2 (0.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.0009%) to 42.111%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

extensions/resource-deployment/src/ui/radioGroupLoadingComponentBuilder.ts
0
2
0.0%

Totals

Change from base Build<PHONE_NUMBER>:
-0.0009%

Covered Lines:
28148

Relevant Lines:
62361

💛  - Coveralls


Move tsconfig.json

In the editor I use the TypeScript language server doesn't detect the tsconfig.json file when it's in the typescript folder, meaning I have to manually open the main.d.ts file. Moving it to the root folder fixes that.

Thanks!


set service restart flag to false when dragging into category

using a restart attribute on the service to tell the api if the service update should initiate an application restart

:+1:


Bump version to 2.2.0-SNAPSHOT

Bump version to 2.2.0-SNAPSHOT

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Critically review DLL interaction

Currently there is a bug on windows debug mode each time you close the application:
__acrt_first_block == header

This is most likely related to DLL's in some way, although beyond my experience for now.
I reworked the dll interface once already:
The DLL hanlde is saved and properly deleted at the end.
However the allocation behavior is a bit all over place. I guess through the factory function thats produced inside the RegisterInteface, all components and nodes are actually allocated in the DLL.
And currently there are not delete functions from the DLL. I would really like to keep public plugin the interface as simple as possible. But node or component specific deleter could probably be added in teh back ground just like the factory functions...

Switched to dynamic linking which fixes this.


Add templates for github issues and PRs

People sometimes mistakenly open issues against this repo for requested changes to bitcoin.org, eg:

https://github.com/bitcoin-core/bitcoincore.org/issues/660
https://github.com/bitcoin-core/bitcoincore.org/issues/652

Add templates for github issues and PRs to direct people to the right place.

ACK d52a94c3fcca6c417a177501348b1d4f33e935e9


About run-time

Hello，how can I test the runtime of a frame？check the topic frequency or need clock？ how should I solve it? Thanks

hello @liuqijun1
It depends what are you exactly curious about.
If you run the demo and you just need check the frequency, simply type:  rostopic hz /urban_road_filter/curb (the average rate should be around 20 Hz).
Does this solution works for you?

I'll check. Thank you!


3 SFRs dependent on selection

Is it possible for a sel-based SFR to depend on arbitrarily many SFRs or is the limit three (using the "on-sel", "and", and "also" attributes?
FTP_ITC.1/H323 in the SBC Module depends on selections made in four different SFRs but it's unclear whether the current transforms supports this or if there is a hard cap at three.

As many as you want: https://github.com/commoncriteria/pp-template/wiki/Just-Depends

confirmed


how can I customize css style?

Hi @ok713, you can refer to #20:

You can use a React Element as a message, so to add a text-transform you could do something like this:
this.msg.success(
TEXT WILL BE CAPITALIZED
)

Hope this helps!

You can also use css only.
Here is my code

  <AlertContainer ref={a => { this.msg = a; }} {...this.options} />

.alerts-container {
  > div[class^='css-'] > span > div[class^='css-'] {
    // entire alert styles here.

    div {

      // alert icon
      &:first-child {
      }

      // alert message div
      &:nth-child(2) {
      }

      // alert close div
      &:last-child {
      }
    }
  }
}

@ok713 did you solved your issue?

It will be really handy if single alert container could have class depending on type to ease styling

@davidhu2000 What kind of CSS syntax is this? VSCode is not accepting it

@neilyoung might be scss

@davidhu2000 Thanks for enlighten me :)

with v3 you can now create custom alert templates, hope it helps!


Can't Password Protect My Stratux

Stratux version:1.3b2

Stratux config:
SDR

[ ] single
[x ] dual

GPS

[ x] yes
[ ] no
type:

AHRS

[ x] yes
[ ] no

power source:
usb cable:

EFB app and version: (e.g., WingX Pro7 8.6.2)iFly GPS Beta
EFB platform: (e.g., iOS 9.2)IOS 10.3.2 and Windows 10
EFB hardware: (e.g., iPad Mini 2)iPad Mini 4 and Surface Pro 4

Description of your issue:Can't password protect my Stratux using Putty.

If possible, enable "Replay Logs", reproduce the problem, and provide a copy of the logs in http://<IP_ADDRESS>/logs/stratux/ and http://<IP_ADDRESS>/logs/stratux.log.

If you are talking about the new method of simply typing open or secure...
That is not valid yet. I am waiting for the PR #611
https://github.com/cyoung/stratux/pull/611

Is there a way currently to password protect my Stratux??  Thanks.

I was able to do it once before using an earlier version of the Stratux software, but I can't get it to work now.

It was taken out. Somehow it broke. I got it to work again... when the PR is incorporated then you can update and it will be available

OK, thanks.

By the way, the AHRS is working great with iFly GPS beta.

@peepsnet - Will get to your PR soon. I seem to remember some issue with getting WPA2 to work? Was that an EDIMAX issue only?

Well. On my pi3 all is good. Remember I also have the edimax dongle so I can connect to my home wifi. It has always been random as to if wlwlan0 was the edimax or onboard. But I have had no issues on my pi 3

I am using a Pi3 with built-in WIFI.  When I used the Putty app to get into the Stratux program, I was able to change the SSID, but the command for adding a password would not work.  As a matter of fact, I think it was gone.

Tim.
Some time ago I removed the functionality for encrypting the Stratux wifi. There was an issue I could not overcome. I gave it another try recently and seemed to be successful.
The way this works is I submit the new code to @cyoung and he looks over it and decides if it is "worthy" of being added to the Stratux project. These are called pull requests.
Since cyoung(Chris) is the guy who started.this whole Stratux thing its only fair he gets a say.
Sit tight and wait for word. If you are getting email notifications from github about this and the pull request #611 you will see a message which says "merged". Merged means my code was... merged with the "master" code.

Thanks.  I wasn't sure if he was asking me a question or not.

The reason I want a password is I don't like leaving file sharing open on my Windows 10 computer.  I want to make my Stratux a password protected private network so I can close down file sharing.  This only became an issue since iFly GPS introduced their Windows 10 beta version.

Problem resolved.  Thanks Chris.


Adds support for direct object imports to be passed to Geographies

One problem I was having was the latency of making a request for my topojson file causing slow render times for my map. To solve this, I added the option of passing an topojson object directly to the Geographies component.
Example:
import mapData from './world-50m-with-data.json'

instantiate parent component, etc...

 <ComposableMap
            projectionConfig={{ scale: 215, rotation: [-10,0,0] }}
            projection='miller'
            width={1400}
            height={790}
            style={{
              width: '100%',
              height: '100%',
              zIndex: '100'
            }}
            aspectRatio='none'
          >
            <ZoomableGroup center={[10, 0]} zoom={1} disablePanning={true}>
              <Geographies geography={mapData}>

... rest of map

This renders much faster and could be useful for those who aren't using excessively large topojson files.

Also adds the option for a custom viewBox on the composableMap element

Thanks, could be useful to me. Would be nice to update the README to reflect these changes, too :)

@walidvb  I will update the README

This is cool. It is technically possible to avoid the load by using geographyPaths and doing the topojson conversion yourself using topojson-client, but this would simplify this step by using the internal conversion mechanism that is already used when loading the data from a url.
So with your solution we can now feed either a url or topojson directly to react-simple-maps. For those who need more control geographyPaths can still provide an interface to feed the array directly and bypass the topojson stuff. Did I understand that correctly?
The only downside is that we are renaming the prop from geographyUrl to geography. Ideally it would be good to merge all three (geographyUrl, geography, geographyPaths) into one prop (geography).

I agree. I can work on that if you would prefer to wait until three are merged into one path before closing this PR.

If the changes are alright, then I would like to make a motion to merge them.

Thanks for the great work @jamestthompson3, really appreciate it.  I am wondering whether some in code disclaimer would be a good thing to alert devs to the change... Will probably also have another look at the readme to make sure the changes are highlighted.


Node version that generates multiple API version and languages

Both 3.0 and 3.1 APIs bindings can be generated at the same time.
Add lint step, better sync output
Fetch API spec, upgrade, lint, generate
Add TSConfig
Added license statements to source files

This is the cleaned up PR for #1


Firechat with frameworks (Laravel)

I'm looking to integrate the firechat into Laravel and I was wondering if that will be possible and would really appreciate it if anyone can give me a walkthrough on how it can be achieved.

Good luck


choreremove headermember opcode from avm

wq

#8407  👈
master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @dbanks12 and the rest of your teammates on  Graphite


Enable UCP and UTF support

These are required for libpcre to be used by GLib.
Signed-off-by: Philip Withnall<EMAIL_ADDRESS>

Hey, we've just enabled a new workflow to contributing wraps, see https://github.com/mesonbuild/wrapdb/#how-to-contribute-new-wraps
Could you resubmit this against the monorepo?

Could you resubmit this against the monorepo?

⇒ https://github.com/mesonbuild/wrapdb/pull/106


AppCenter mobile app

Hi,
It will be great if you provide a mobile app edition for AppCenter, at least for the Analytics and Crashes so it will be easier to monitor on the move..
Thanks,
Jassim

Thanks @jrahma for requesting this. I have added this in our feature request backlog.


DragonFlyBSD: use __errno_location now provided by the libc crate

Dragonfly recently (in Dfly 5.8) added an __errno_location() function to make it easy to access the thread-local errno variable. This has been exposed in rust-libc as of 0.2.77. This PR uses that functionality instead of the locally compiled C language shim, which the PR removes. One issue is backwards compatibilty. It requires 0.2.77 libc and DragonFly 5.8. Not sure how to gracefully handle older DragonFly versions, although I'm also not sure doing so is worth it.

LGTM, but you'll have to rebase after #1294 merges.

OK I rebased and pushed my branch. The tests pass, but I want to make sure that my merge didn't disrupt anything it shouldn't have. In the diff, a few functions in  src/sys/wait.rs and  src/sys/quota.rs now are prefixed with the allow_unused_unsafe
annotation.

It looks like you merged master into your branch, rather than rebased your branch on top of master.  That's why the diff looks screwed up.  If you rebase on top of master there won't be that problem.

I rebased on top of master and the diff looks sensible now. The tests fail for aarch64-unknown-linux-gnu and x86_64-unknown-linux-gnu. There may be other pending commits that have to be merged to resolve those.

The failure fo x86_64-unknown-linux-gnu is an old one.  I think it's a bug in glibc itself, not in Nix.  The failure for aarch64 is new; I haven't seen it before.  It also doesn't make much sense.  It could be a bug in QEMU.  We've had those before.


Mic-4404/update-housing-types

Mic-4404/update-housing-types
Updates housing types.

Category: Refactor
JIRA issue: MIC-4404
Research reference:

Changes and notes
-updates housing type options
-changes "standard" to "household"
-removes hyphen in Other noninstitutional
Verification and Testing
All tests pass. Ran sim and created sample data with make results.

@stevebachmeier It's part of this PR - https://github.com/ihmeuw/vivarium_census_prl_synth_pop/pull/312


feat(eqtl): add preprocessing dag

This PR includes:

new DAG of steps in order to process the whole preprocessing of eQTL Catalog
redefined eqtl_catalogue step to eqtl_catalogue_ingestion. This is the script that produces a study index and harmonises their raw summary statistics.

When running the step, I hit a bottleneck at the eqtl_catalogue_ingestion level and the job was cancelled.
I want to test it with the recent fixes introduced in https://github.com/opentargets/genetics_etl_python/pull/369, it might work now

Codecov Report

Merging #366 (5dbebce) into dev (42b366c) will increase coverage by 0.24%.
Report is 20 commits behind head on dev.
The diff coverage is 91.30%.

Additional details and impacted files

@@            Coverage Diff             @@
##              dev     #366      +/-   ##
==========================================
+ Coverage   85.67%   85.92%   +0.24%
==========================================
  Files          89       90       +1
  Lines        2101     2117      +16
==========================================
+ Hits         1800     1819      +19
+ Misses        301      298       -3

Files
Coverage Δ

src/airflow/dags/eqtl_catalogue_preprocess.py
100.00% <100.00%> (ø)

src/otg/dataset/l2g_feature_matrix.py
82.92% <ø> (+7.31%)
:arrow_up:

src/otg/eqtl_catalogue_ingestion.py
61.90% <100.00%> (ø)

src/otg/method/l2g/evaluator.py
38.70% <100.00%> (ø)

src/otg/method/l2g/model.py
58.33% <50.00%> (+0.50%)
:arrow_up:

I don't think the changes here are relevant any more.

The plan is to define credible sets from eQTL Catalogue fine mapping results directly, and not from fine mapping summary stats for PICS.
This PR had also a technical limitation in terms of how the inputs were handled in the DAG, so I never managed to do a full run.

Since we don't have any business logic here and we only touch the Airflow layer, let's just close this.