[QUAD] Nuke Payload: Fix farm renderering (Add Gizmos and plugins to the NUKE_PATH)

Changelog Description
Paragraphs contain detailed information on the changes made to the product or service, providing an in-depth description of the updates and enhancements. They can be used to explain the reasoning behind the changes, or to highlight the importance of the new features. Paragraphs can often include links to further information or support documentation.
Additional info
Paragraphs of text giving context of additional technical information or code examples.
Testing notes:

start with this step
follow this step

Does setting the necessary environment variables in Application settings fix this problem ?
I'm not sure if you are using OpenPype standalone or OpenPype as AYON Addon?

Does setting the necessary environment variables in Application settings fix this problem ?
I'm not sure if you are using OpenPype standalone or OpenPype as AYON Addon?

We are using OP not Ayon, this issue is present on all OP version up to the last version (3.18.11) not tested in AYON but the logic should be the same.
The deadline job are sent directly with OP not manually submitted.
When sending a job your deadline farm you need to have all your plugins and gizmos (that was loaded on the submitted scene) to be in the NUKE_PATH.
The goal isn't to hardcode the gizmo and plugins in the NUKE_PATH from within the Application settings but to retrieve the currently loaded paths (so all your plugins and gizmos, even no coming from OP will work on farm) used by nuke to add then for the job.

This goes against a lot of the designs of AYON - but even in OpenPype. The intent has always been that the farm worker should build up the environment that makes sense on that worker - and not blindly copy from the source machine who submitted the job. This would not work on e.g. mixed farms (linux + windows) or potentially other configs too.

The goal isn't to hardcode the gizmo and plugins in the NUKE_PATH from within the Application settings but to retrieve the currently loaded paths (so all your plugins and gizmos, even no coming from OP will work on farm) used by nuke to add then for the job.

If they are NOT coming from OpenPype or AYON - where do they come from? I assume they are still 'managed' by the studio admin and deployed in a manner (e.g. network location). Or are you referring to some sort of setup where the artist, live in the application, defines extra dependencies to load?
What I'm wondering is - OpenPype and AYON have been completely able to define external tools/plug-ins, across multiple platforms using application environments, but even better using Tools environments.
That does leave the question that @MustafaJafar asked. What would make these particular paths not suited to be managed by an admin?

I'm inclined to close this; however knowing about your use case may highlight an actual workflow issue that is somehow not solved by OpenPype x AYON so will leave it open to continue discussion.

Thanks @BigRoy for expanding on this topic.
So, Typically, tools that are used across the studio should be managed by admins via environment variables.
I think this PR helps if artists are allowed to install any custom tools on their machines (which may happen with small teams from what I've seen in different places).
However, this indeed goes against the OP/AYON. one reason could be that nothing really guarantees that these tools exist on the farm machines. unlike with using Tools, AYON will always set these up based on the OS of the farm machine.


Fixes a silent crash when ejecting

This only affects master, not any stable releases.
It should fix the main problem in #1806 although we still shouldn't close the issue until we fix the end-to-end tests and make eject crash on error.
I'd appreciate the review because I haven't really tested it. We can look at Travis logs to verify it worked.
I want to merge this sooner than other issues in #1806 so that less forkers who track master are affected.

We should probably delete the babelrc and eslintrc files, along with lines https://github.com/facebookincubator/create-react-app/blob/master/packages/react-scripts/package.json#L14-L15.

AppVeyor having a bad day?

No, 0c0c5c1f24c38feb57bea54795a11c0e0d0a2300 indirectly caused it because lerna bootstrap seems borked.
https://ci.appveyor.com/project/Facebook/create-react-app/build/1.0.283/job/35q8j95f8r9j6hc0#L379

d6e82c24d963f72acbc6f81deb795f0d686d8a3b fixes eject for me.

Are we still using eslintrc on https://github.com/facebookincubator/create-react-app/blob/master/packages/react-scripts/config/webpack.config.dev.js#L124 and https://github.com/facebookincubator/create-react-app/blob/master/packages/react-scripts/config/webpack.config.prod.js#L125?

Nice catch @n3tr, admittedly I only checked babelrc. We should just need to stub these values there.

Why is it failing? 😢 😢 😢

It's failing because extends is a .eslintrc specific feature. 😅
See options available here: http://eslint.org/docs/developer-guide/nodejs-api#cliengine
You have to use some tricky hack, see https://github.com/eslint/eslint/issues/5179.
65c0b963dddc66dfeda3da4f3d09f00669e783f2 😄

Aaah ok.

No reason to not land this for forkers.


Add ontology ancestor mapping to cellxgene-schema

In order to have up-to-date information about ontology ancestors, we should think about adding the list of the ancestors as part of the validation mapping process, performed by cellxgene-schema.
If pinned ontologies are refreshed during a schema update, we will:

Upgrade cellxgene-schema to support the new ontologies
Re-curate the datasets that are affected by the ontology update
cellxgene-schema will also add the ancestors to the h5ad metadata (similarly to the labels added today)
The portal can store them in the database as additional metadata

I question:

cellxgene-schema will also add the ancestors to the h5ad metadata (similarly to the labels added today)

This adds more presentation metadata to the dataset which is not required by data consumers. We wouldn't want this field to appear in the cellxgene explorer LSB or data drawer for example.
We should definitely be using the cellxene-schema process for updating/parsing ontologies. Could an accessor be added to ontology.py to allow the portal to lookup the ancestor for the development stage and add to the database? This would be similar to the approach for calculating cell count or mean genes per cell.


rkt: can run some practical applications

We should be able to run applications such as:

[x] fleetd - #399
[x] etcd
[x] dockerd - #638
[x] flanneld - #389

What is the use case for running dockerd inside a rocket container? Is it to have containers inside containers, or to limit what dockerd could do on the host?

@alban One benefit is to reduce the number of components that need to be baked into the CoreOS distribution itself. Once we can deploy docker in a container, we can update it out-of-band with the OS release cycle.

@philips Since https://github.com/coreos/rocket/pull/626 is merged, running Dockerd inside Rocket works fine as long as the isolator "os/linux/capabilities-retain-set" contains CAP_NET_ADMIN. The test was reported on this issue. The dind aci was generated by docker2aci.
We don't have a solution to modify automatically the isolator in the aci. Flannel would also benefit from that, see this comment.

:+1:

This can be closed now that #399, #638 and #389 are closed.


Random Error Box appearing each time I launch an account

Each time I launch an account one of these error boxes appears and I am not sure what is causing it. If I attempt to close the error box it just opens a new one. It does not appear to be interfering with functionality at all, it is just annoying.

This could be a guess but when's the last time you emptied your %temp%   of gw2cache folders?

Part of the new Windowmanagement.
GetWindowDimensions(Process pro) will get called when your game is started and refers to the MainWindowhandle of the process.
This handle changes during the startup of the game.
Added an additional handle refresh before calling GetWindowDimensions.
Please report back if it is fixed once 2.0.0 is released.


update to ravenpy 0.7.5

Overview
This PR fixes #407
Changes:

Compatible with xclim 0.29
Update notebooks
Remove FLYINGPIGEON from Makefile
Do not fail the doc build on warnings
Fix some of the docs

Related Issue / Discussion
Additional Information
Links to other issues or sources.

@huard
Good news: Looks like the test has nothing to do with Raven or RavenPy. Bad news: Looks like the test has nothing to do with Raven or RavenPy.
@cjauvin and I are going to look into trying to reproduce this segfault (I haven't had luck on my machine natively; I'll be testing with a VM tomorrow). If we can get a core dump, we should be able to glean where the problem is. Christian has a suspicion that it might have something to do with the NetCDF4 C-library. I think it might have something to do with climpred and xclim.

Mauvaise nouvelle, je viens d'essayer dans un environnement frais et ça ne plante pas, sur ma machine Ubuntu.

Ah non je me reprends! Le test individuel (/test_wps_climpred_hindcast_verification.py) ne plante pas quand on l'appelle seul, mais il plante (segfault) quand on appelle la suite de tests au complet.
Je me sousviens d'avoir eu des problèmes de ce genre y a qq mois, c'est quasiment impossible à déboguer.

Je pense avoir déjà utilisé une approche de style bissection pour comprendre ce qui se passe. Il y a une combinaison de tests qui cause le problème, il faut trouver l'autre.

Looks like @cjauvin is onto something with his NetCDF4 theory - It's traceable to the HDF5 source library: https://gist.github.com/Zeitsperre/150dbed5b2772938e36bd00dea25ddef

It seems that the two tests that cause the segfault are test_wps_climatology_esp() and test_wps_climpre_hindcast_verification(). It could be that there are too many threads called HDF5 (asynchronous file reads suing dask + HDF5?) being created during test_wps_climatology_esp() that aren't being cleared from the memory heap fast enough before the next test runs. For perspective:

Possibly related issue with HDF5: https://forum.hdfgroup.org/t/heap-use-after-free-by-the-call-h5aread-when-running-with-multiple-threads-in-hdf5-thread-safe-version/6405

@huard Just to be clear, the climpred test is being skipped currently because of the segfault. Are we merging this PR with this test disabled?

I suggest we do that, but please open an issue to re-enable the test.

Le mieux serait d'essayer d'isoler et reproduire le problème dans la composante la plus low-level possible, pour ouvrir une issue dans la librairie concernée, quelle qu'elle soit.

Ou de trouver une combinaison de versions qui ne pose pas de problème.


Fnf psychic engine sometimes exit the app

Describe your bug here.
when i was in the chart menu i was recharting cheating song and adding scripts it happened it closed the app
Command Prompt/Terminal logs (if existing)
No response
Are you modding a build from source or with Lua?
Lua
What is your build target?
Windows
Did you edit anything in this build? If so, mention or summarize your changes.
It's not build

somebody help fix the problem pls i don't get any notifi soo chat me in discord Dark_bangi#6506

It might be caused by some sort of sprite integer overflow, try adding the events in an empty chart and saving the events with the save events button. Also, I can't seem to find you on discord.

BRUH  I WAS IN CHART MENU AND THE APP CLOSED WHAT HAPPEN TO YOU?!


Fix unit tests that rely on pseudo-random numbers

Test_ofPacketOutBuilder_Done relies on specific pseudo-random numbers to
be generated and will fail if another test also calls the pseudo-random
number generator. This patch creates a dedicated random number generator
for ofPacketOutBuilder and specifies a hardcoded seed for unit tests to
make test outputs predictable.
Signed-off-by: Quan Tian<EMAIL_ADDRESS>

/test-all


add verify overload

This allows an already-decoded JWT to be used without decoding twice. This is useful, for instance, when the kid is used to look up the public key.

Hi @joprice
Thanks for the PR. First of all, the only operations you're saving processing time in is the JSON parsing of the header/payload, and maybe the String.split() and Base64.decode() which are not as heavy as the signature verification that you're still doing on this new method so I don't think it's a win. Of course it always depends on the algorithm and size of your token, which we suggest you keep short.
Adding to that, the Algorithm and JWTVerifier classes are meant to be reusable, so you should be able to configure a single instance and use it widely (as long as your requirements doesn't change on runtime). If your concern is to access the kid or even the already verified DecodedJWT, why not just keep the value in a variable? Provide more context on how you're using the library so we can understand.
Cheers,

The use case is looking up the public key dynamically based on kid.

@joprice I think it's confusing to have another verify method that receives and returns DecodedJWT. I would keep the existing signature as it is, and let the one that you're suggesting return void instead and just throw if something goes wrong inside.
Something like this:
public DecodedJWT verify(String token) throws JWTVerificationException {
          DecodedJWT jwt = JWTDecoder.decode(token);
          verify(jwt);
          return jwt;
}

public void verify(DecodedJWT jwt) throws JWTVerificationException {
          //perform the actual verification
}

Please add the corresponding tests.
Cheers,

Before the above, I think you should look at this PR https://github.com/auth0/java-jwt/pull/149 as it adds support for KeyProviders, which seems to be what you need for the key look up. Will be available soon in the next release.

I don't see an example of looking up a key based on an id. The provider interface doesn't take any input.

@joprice will close this one since we rather improve on what @lbalmaceda mentioned for allowing using rotating keys.

We'll try to provide an example in the README and here too

Sounds good.


Handle ctrl+c to gracefully shutdown the server(s)

Fixes

#1520
#1367

Tried to use tokio's ctrl-c detection but ran into issues with it, so used the ctrlc crate we already depend on and got it working nicely with that.
Tested ctrl'c'ing with:
Serving

cargo run -p rerun --features web_viewer -- ../api_demo.rrd --web-viewer
python ./examples/python/api_demo/main.py --serve
cargo run -p re_web_viewer_server

Not serving, just to see if something else broke

python ./examples/python/tracking_hf_opencv/main.py
cargo run -p api_demo

Checklist

[x] I have read and agree to Contributor Guide and the Code of Conduct

I tested python3 -m rerun --web-viewer ../objectron.rrd, and that too seems to work

oof this has bigger ramifications.

works now. Tested all serve usecases again (added to the list)

that one is passing now as well! Changes got a lot bigger, but I do think it's better - admittedly still learning all these tokio things though; got quite far 😄

Found a problem after merge:
cargo r -p rerun -- ../nyud.rrd causes this:
[2023-03-21T08:15:56Z INFO  rerun::run] Loading "../nyud.rrd"…

thread 'main' panicked at 'Error setting Ctrl-C handler: MultipleHandlers', re_viewer/src/app.rs:131

   7: core::panicking::panic_fmt
             at core/src/panicking.rs:64:14
   8: core::result::unwrap_failed
             at core/src/result.rs:1791:5
   9: core::result::Result<T,E>::expect
             at core/src/result.rs:1070:23
      re_viewer::app::App::from_receiver
             at re_viewer/src/app.rs:126:13
  10: rerun::run::run_impl::{{closure}}::{{closure}}
             at rerun/src/run.rs:357:27
      core::ops::function::FnOnce::call_once{{vtable.shim}}
             at core/src/ops/function.rs:507:5
  11: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
             at alloc/src/boxed.rs:2000:9

Troubleshooting Rerun: https://www.rerun.io/docs/getting-started/troubleshooting
libc++abi: terminating with uncaught foreign exception

Rerun caught a signal: SIGABRT

Troubleshooting Rerun: https://www.rerun.io/docs/getting-started/troubleshooting

      rerun::crash_handler::install_signal_handler::signal_handler
             at rerun/src/crash_handler.rs:163:25
   3: _OSAtomicTestAndClearBarrier
   4: __pthread_atfork_prepare_handlers
   5: <unknown>
   6: <unknown>
   7: <unknown>
   8: <unknown>
   9: <unknown>
  10: <unknown>
  11: <unknown>
  12: <unknown>
  13: <unknown>

Rerun caught a signal: SIGABRT
Troubleshooting Rerun: https://www.rerun.io/docs/getting-started/troubleshooting

zsh: abort      cargo r -p rerun -- ../nyud.rrd

Reverting in https://github.com/rerun-io/rerun/pull/1632

I think the solution to the above problem would be to hand down shutdown_rx to crates/re_viewer/src/app.rs, and have that spawn a task to listen for the shutdown signal
…though I am not a big fan of how tokio is infecting every part of the codebase :/


Git-backed Settings Sync to allow sharing of settings with others

One of the advantages that I really liked when using the other Settings Sync extension is that you can put your settings in a public gist and share it with others. In the spirit of dotfiles, I find inspiration by looking at other folk's configurations. I'd argue that adding the ability to sync your settings in a "public" location (that only the user can control) would be a net-benefit for the editor and its community as a whole.
With the new syncing implementation that's built into VSCode, it seems like sharing your settings in a repository for others to look at is not possible. Can this please be added to VSCode's implementation; at least as an option? Is this already on the roadmap somewhere that I've been unable to find? If that's not something that will get added, I think I'm only going to be using this syncing functionality as a "backup" instead of my primary method of syncing.

/duplicate https://github.com/microsoft/vscode/issues/92357


[Feature Request] Support customize el-column type expand style

Existing Component
是
Component Name
el-table
Description
Now, the default style is a right arrow icon, but sometimes I need a button or other style, but now I can not customize it

Is there a update on this issue?
Is it possible to disable expand for a particular row?


6.x configure button colors not changed the color

Not sure if this is a bug or a 5.x -> 6.x migration issue on my part, but:
in:
func configure
in 5.x, the following would turn the icons and buttons purple:
// Colors
        cell.iconView.color = .systemPurple
        cell.button.allowedBackgroundColor = .systemPurple
        cell.button.allowTitleColor = .systemPurple

In 6x, the following turns the icons purple, but not the buttons:
// Colors
        cell.permissionDrawIconView.tintColor = .systemPurple
        cell.permissionButton.allowedBackgroundColor = .systemPurple
        cell.permissionButton.allowTitleColor = .systemPurple

Is that syntax incorrect or is it a bug w/ the color configuration?  Thank you in advance!

More info:
Button is initially blue in allowed state, but if you tap it it turns purple.
This is different than the 5.x behavior.
Hope this helps.
"initial view":

"after tap":

Thanks, true. I should add update interface after custom configuration.
I have added it already, so you can update to 6.0.9 and it will work.
Thanks for your reports!

I think 6.0.9 introduced a new bug:
the conformance to delegate is:

Which doesn't allow for a cell SPPermissionsTableViewCell to be returned...
vs:

Its true, no need return cell. You can change here simple, without return.
I updated readme too.

ok thx.
I'll work to figure this out but if you have any quick ideas let me know pls.
this:
// Colors
        cell.permissionDrawIconView.tintColor = .systemPurple
        cell.permissionButton.allowedBackgroundColor = .systemPurple
        cell.permissionButton.allowTitleColor = .systemPurple

results in black/blank (or transparent) buttons, and the icon tint which was working in 6.0.8, is not working now:

For me is good
Can you please create empty project and attach here?

I'm seeing that my func configure  was being called in 6.0.8, but isn't in 6.0.9...
Let me debug further on my side...

See, protocol changed. Maybe you left old version? Let me know if need any help.

I could use some help...  :/
6.0.8 configure:
func configure(_ cell: SPPermissionsTableViewCell, for permission: SPPermissions.Permission) -> SPPermissionsTableViewCell {

        cell.permissionButton.allowTitle = "Allow"
        cell.permissionButton.allowedTitle = "Allowed"

        // Colors
        cell.permissionDrawIconView.tintColor = .systemPurple
        cell.permissionButton.allowedBackgroundColor = .systemPurple
        cell.permissionButton.allowTitleColor = .systemPurple

        // If you want set custom image.
        //cell.set(UIImage(named: "IMAGE-NAME")!)
        switch permission.type {
        case .camera:
            cell.permissionTitleLabel.text = "Camera"
            cell.permissionDescriptionLabel.text = "for photos & selfies"
            break
        case .photoLibrary:
            cell.permissionTitleLabel.text = "Photo Library"
            cell.permissionDescriptionLabel.text = "to add photos"
            break
        case .notification:
            cell.permissionTitleLabel.text = "Notification"
            cell.permissionDescriptionLabel.text = "to get notifications from App"
            break
        case .microphone:
            break
        case .calendar:
            break
        case .contacts:
            break
        case .reminders:
            break
        case .speech:
            break
        case .locationWhenInUse, .locationAlways:
            cell.permissionTitleLabel.text = "Location"
            cell.permissionDescriptionLabel.text = "to find others near you"
            break
        case .motion:
            break
        case .mediaLibrary:
            cell.permissionTitleLabel.text = "Media Library"
            cell.permissionDescriptionLabel.text = "for playing songs"
            break
        default:
            break
        }

        return cell
    }

6.0.9 configure:
func configure(_ cell: SPPermissionsTableViewCell, for permission: SPPermissions.Permission) {

        cell.permissionButton.allowTitle = "Allow"
        cell.permissionButton.allowedTitle = "Allowed"

        // Colors
        cell.permissionDrawIconView.tintColor = .systemPurple
        cell.permissionButton.allowedBackgroundColor = .systemPurple
        cell.permissionButton.allowTitleColor = .systemPurple

        // If you want set custom image.
        //cell.set(UIImage(named: "IMAGE-NAME")!)
        switch permission.type {
        case .camera:
            cell.permissionTitleLabel.text = "Camera"
            cell.permissionDescriptionLabel.text = "for photos & selfies"
            break
        case .photoLibrary:
            cell.permissionTitleLabel.text = "Photo Library"
            cell.permissionDescriptionLabel.text = "to add photos"
            break
        case .notification:
            cell.permissionTitleLabel.text = "Notification"
            cell.permissionDescriptionLabel.text = "to get notifications from App"
            break
        case .microphone:
            break
        case .calendar:
            break
        case .contacts:
            break
        case .reminders:
            break
        case .speech:
            break
        case .locationWhenInUse, .locationAlways:
            cell.permissionTitleLabel.text = "Location"
            cell.permissionDescriptionLabel.text = "to find others near you"
            break
        case .motion:
            break
        case .mediaLibrary:
            cell.permissionTitleLabel.text = "Media Library"
            cell.permissionDescriptionLabel.text = "for playing songs"
            break
        default:
            break
        }

        return
    }

The 6.0.8 does what is expected.  The 6.0.9 doesn't seem to called (ie: no color changes or text changes).  Does anything look obvious?
Thank you in advance.

Can you add print something inside, it calling or not?
If it called, confirm 2 things:

installed 6.0.9
Set data source

yes: 6.0.9
Data source is set:
// Show dialog
                   DispatchQueue.main.async {
                       let controller = SPPermissions.dialog([.camera, .photoLibrary, .locationWhenInUse, .mediaLibrary, .notification])

                       // Ovveride texts in controller
                       controller.titleText = "PERMISSIONS"
                       controller.headerText = "App requests these"
                       controller.footerText = "App needs these permissions for full functionality, but allowing them is your choice! (Push notifications are optional)"

                       // Set `DataSource` or `Delegate` if need.
                       // By default using project texts and icons.
                       controller.dataSource = self
                       controller.delegate = self

                       // Always use this method for present
                       controller.present(on: self)
                   }

I will add a print and verify...  more to come.

on 6.0.10
    func configure(_ cell: SPPermissionsTableViewCell, for permission: SPPermissions.Permission) {

        print("sppermissionsdatasournce - in the func!")

Is never printed.  IE: the func configure is not called.

Can you create empty project with minimum code please and send here?

Thanks for your help, its fixed in 6.1.0. Hope it last my bug.

ok great - TY so much!  :)


Convert number of research slots

Vic2 to HoI4 does:
Great power - 4
Default - 3
Uncivilized (Vic3 Unrecognized) - 2
Unrecognized (Vic3 decentralized) - 0

Looking through hoi, not many powers start with 4 slots. For now, base on rank. Maybe include # of universities or something later on.
Looks roughly correct otherwise, though. Recognized powers get 3 slots, and all others get 2.


Version Issue

Hey @Domino987 do you know why the newest release shows version 0.0.2?

Ah yes, I missed one line in the release script.
I decided to release a next version which supports mui v5, but I missed a tag in the release script.
It is fixed but to show the correct version in the github page, we would need to release a new version of master.
The v5 branch is instabbalbe with npm i @material-table/core@next with its own versions.
But the next release will also tag it with -next.
Sorry for the confusion. Still working on the readme.

No worries at all! That's awesome actually. Nice work.

Hey @Domino987 version is broken again..

Hi can you describe it in mir detail? What is broken.

It looks like it's fixed now. I was still showing release 0.0.2 but not any longer.. it's now showing correct.


Error: YAML file error: MOTR_CONFIG section is missing

Hi guys, I am following the readme to install Hare. When I run sudo m0crate -S /tmp/m0crate-io.yaml, I got this error:

error: YAML file error: MOTR_CONFIG section is missing
error: Failed to parse Z��
Unable to parse workload:-22

I attached my /tmp/m0crate-io.yaml
m0crate-io.txt
Let me know if you guys know how to fix the yaml file. I believe there is no problem with m0crate itself.
Thanks

@knekrasov any idea about this ?

Hi @daniarherikurniawan,
Looks like there is some problem with m0crate file. I tried same at my end, it ran successfully without any error. Here is my output attached.
`
[root@ssc-vm-5571 ~]# hctl bootstrap --mkfs ~/cluster.yaml
2021-06-23 03:56:34: Generating cluster configuration... OK
2021-06-23 03:56:37: Stopping Consul on this node... OK
2021-06-23 03:56:53: Stopping Consul on other nodes... OK
2021-06-23 03:57:10: Starting Consul server on this node......... OK
2021-06-23 03:57:17: Importing configuration into the KV store... OK
2021-06-23 03:57:17: Starting Consul on other nodes.... OK
2021-06-23 03:57:22: Updating Consul configuraton from the KV store... OK
2021-06-23 03:57:24: Waiting for the RC Leader to get elected.... OK
2021-06-23 03:57:25: Starting Motr (phase1, mkfs)... OK
2021-06-23 03:58:25: Starting Motr (phase1, m0d)... OK
2021-06-23 03:58:42: Starting Motr (phase2, mkfs)... OK
2021-06-23 04:00:41: Starting Motr (phase2, m0d)... OK
2021-06-23 04:00:46: Starting S3 servers (phase3)... OK
2021-06-23 04:00:47: Checking health of services... OK
[root@ssc-vm-5571 ~]# /opt/seagate/cortx/hare/libexec/m0crate-io-conf >/tmp/m0crate-io.yaml
Usage: grep [OPTION]... PATTERN [FILE]...
Try 'grep --help' for more information.
Usage: grep [OPTION]... PATTERN [FILE]...
Try 'grep --help' for more information.
Usage: grep [OPTION]... PATTERN [FILE]...
Try 'grep --help' for more information.
Usage: grep [OPTION]... PATTERN [FILE]...
Try 'grep --help' for more information.
Usage: grep [OPTION]... PATTERN [FILE]...
Try 'grep --help' for more information.
Usage: grep [OPTION]... PATTERN [FILE]...
Try 'grep --help' for more information.
Usage: grep [OPTION]... PATTERN [FILE]...
Try 'grep --help' for more information.
Usage: grep [OPTION]... PATTERN [FILE]...
Try 'grep --help' for more information.
Usage: grep [OPTION]... PATTERN [FILE]...
Try 'grep --help' for more information.
[root@ssc-vm-5571 ~]# cat /tmp/m0crate-io.yaml
CrateConfig_Sections: [MOTR_CONFIG, WORKLOAD_SPEC]
MOTR_CONFIG:
MOTR_LOCAL_ADDR: <IP_ADDRESS>@tcp:12345:4:1
MOTR_HA_ADDR:    <IP_ADDRESS>@tcp:12345:1:1
PROF: <0x7000000000000001:0xc6>  # Profile fid
LAYOUT_ID: 9                      # Defines the UNIT_SIZE (9: 1MB)
IS_OOSTORE: 1                     # Is oostore-mode?
IS_READ_VERIFY: 0                 # Enable read-verify?
TM_RECV_QUEUE_MIN_LEN: 16  # Minimum length of the receive queue
MAX_RPC_MSG_SIZE: 65536    # Maximum rpc message size
PROCESS_FID: <0x7200000000000001:0x26>
IDX_SERVICE_ID: 1
LOG_LEVEL: 4  # err(0), warn(1), info(2), trace(3), debug(4)
WORKLOAD_SPEC:                # Workload specification section
WORKLOAD:                  # First Workload
WORKLOAD_TYPE: 1        # Index(0), IO(1)
WORKLOAD_SEED: tstamp   # SEED to the random number generator
OPCODE: 3               # Operation(s) to test: 2-WRITE, 3-WRITE+READ
IOSIZE: 10m      # Total Size of IO to perform per object
BLOCK_SIZE: 2m          # In N+K conf set to (N * UNIT_SIZE) for max perf
BLOCKS_PER_OP: 1        # Number of blocks per motr operation
MAX_NR_OPS: 1           # Max concurrent operations per thread
NR_OBJS: 10             # Number of objects to create by each thread
NR_THREADS: 4           # Number of threads to run in this workload
RAND_IO: 1              # Random (1) or sequential (0) IO?
MODE: 1                 # Synchronous=0, Asynchronous=1
THREAD_OPS: 0           # All threads write to the same object?
NR_ROUNDS: 1            # Number of times this workload is run
EXEC_TIME: unlimited    # Execution time (secs or "unlimited")
SOURCE_FILE: /tmp/128M  # Source data file
[root@ssc-vm-5571 ~]# dd if=/dev/urandom of=/tmp/128M bs=1M count=128
128+0 records in
128+0 records out
134217728 bytes (134 MB) copied, 1.10077 s, 122 MB/s
[root@ssc-vm-5571 ~]# sudo m0crate -S /tmp/m0crate-io.yaml
info: starting workload 0
info: workload type          io/2
info: random seed:           0
info: number of threads:     4
trace: oid 0004d0435f109d57:309b5744155a23c2
trace: oid 00d0e2ed2c7313b4:591604f610014680
trace: oid 00b8797d33bd637f:158366da12fee890
trace: oid 007977d418efcc40:2fd8f8441f6a73da
trace: oid 008e0f987af21622:32498c4e66aca7f7
trace: oid 000a871e693f5685:7c363a1427f6ee03
trace: oid 00a71e9175aad8f3:239d3d722438672f
trace: oid 003aca5929c36462:79280d1d3c2d29fb
trace: oid 00d401b92a9d52b3:51874dbd173f9a9c
trace: oid 001066673cc447f6:2740e11c6fa4e4a6
trace: oid 0081ab75327cc57b:02a3cd3621c8dfe5
trace: oid 006c91bb737ce00d:413353bf24fb2349
trace: oid 006ef62f07de0555:0ba7cb4135faa154
trace: oid 001d5bda018eccc9:5df18f575e797d4d
trace: oid 0039a5bc7bd9f19a:02b1e47d07c47a6b
trace: oid 009d55fc1578f224:43f1a46650747015
trace: oid 001644d70ef4ebcd:67b40ab12e7157b5
trace: oid 00b933c420ba0992:1e163c5b1726ab3f
trace: oid 0036cf0d7a22dee3:38ef8b243c3adf39
trace: oid 009fbef06cddcdc4:613602831ea360c8
trace: oid 00bbd319328f9173:549e021c5c0eb520
trace: oid 001e5e3c3d3a16ea:3a88326d65d92ef3
trace: oid<PHONE_NUMBER>8f4dc5:6d9da95e2b5803f9
trace: oid 00083fe963807ec0:7bcc740e5eb15e81
trace: oid 00756a8d2b38f292:0d22b637071e84c0
trace: oid 00f2fc245734bb23:1e452fff3e2e9e51
trace: oid 00579a065b9f800e:7a697d8b1f29cb31
trace: oid 007d4dd2126b2e16:3dcd2bfa3ef758f7
trace: oid 00fabf8a558e4084:1b060e173d3920eb
trace: oid 00c8576f10aff93c:23124fde79191dc6
trace: oid 003f4701203d95ce:247121bf4bdc5ff4
trace: oid 00be148e37b074ac:2a8dbe75094786ea
trace: oid 00e9673f2eab3baa:10660bab76337f1b
trace: oid 00dff6ce2ecb9af8:34621d6d2edc6363
trace: oid 006b1b060bd35a8f:4e062e95573790d4
trace: oid 003e88a53134f7e2:162ee9cb52e868d8
trace: oid 00c338673333d9a1:102189c36339482f
trace: oid 00e3d2dd00c387b5:5c5265f6198b8fd6
trace: oid 00011d830ff5ae3f:6567efca062319df
trace: oid 00a622ec1fd0ac74:0f6aa0c924bf3211
dbg: created worker thread 0
dbg: created worker thread 1
trace: [1624421207:419384803] t00: Creating objects...
dbg: created worker thread 2
trace: [1624421207:419406249] t01: Creating objects...
dbg: created worker thread 3
trace: [1624421207:419425148] t02: Creating objects...
trace: threads created
trace: [1624421207:419660041] t03: Creating objects...
trace: [1624421208:461481254] t00: Creation done.
trace: [1624421208:461504233] t00: Opening objects...
trace: [1624421208:469365947] t00: Open done.
trace: [1624421208:469382019] t00: Writing objects...
trace: [1624421220:760821639] t02: Creation done.
trace: [1624421220:760849686] t02: Opening objects...
trace: [1624421220:827574754] t01: Creation done.
trace: [1624421220:827597812] t01: Opening objects...
trace: [1624421220:831422947] t02: Open done.
trace: [1624421220:831437789] t02: Writing objects...
trace: [1624421220:871343485] t03: Creation done.
trace: [1624421220:871371394] t03: Opening objects...
trace: [1624421220:876349708] t01: Open done.
trace: [1624421220:876366195] t01: Writing objects...
trace: [1624421221:901601852] t03: Open done.
trace: [1624421221:901634301] t03: Writing objects...
trace: [1624421378:897804856] t00: Write done.
trace: [1624421378:897875064] t00: Reading objects...
trace: [1624421384:010890317] t00: Read done.
trace: [1624421384:010919249] t00: Deleting objects...
trace: [1624421397:033395574] t02: Write done.
trace: [1624421397:033437468] t02: Reading objects...
trace: [1624421404:118561330] t01: Write done.
trace: [1624421404:118608221] t01: Reading objects...
trace: [1624421405:307777950] t00: Deletion done.
dbg: worker thread done 0
trace: [1624421405:311140733] t03: Write done.
trace: [1624421405:311173653] t03: Reading objects...
trace: [1624421407:509010093] t02: Read done.
trace: [1624421407:509033103] t02: Deleting objects...
trace: [1624421410:542550115] t01: Read done.
trace: [1624421410:542592361] t01: Deleting objects...
trace: [1624421414:686992892] t03: Read done.
trace: [1624421414:687018142] t03: Deleting objects...
trace: [1624421436:579154842] t02: Deletion done.
trace: [1624421437:640893546] t01: Deletion done.
dbg: worker thread done 1
dbg: worker thread done 2
trace: [1624421440:558370397] t03: Deletion done.
dbg: worker thread done 3
info: I/O workload is finished.
info: Total: time=[233:477884976] objs=40 ops=400
info: C: [13:451571362] ([1:030954318] per op)
info: O: [1:030169309] ([0:028862164] per op)
info: D: [29:070082196] ([2:583275015] per op)
info: W: [183:403811818] ([3:562019063] per op), 409600 KiB, 2233 KiB/s
info: R: [10:475327035] ([0:156450639] per op), 409600 KiB, 39101 KiB/s
info: done workload 0
info: ---------------------------------------
[root@ssc-vm-5571 ~]# hctl shutdown
Stopping s3server@0x7200000000000001:0x23 at ssc-vm-5571.colo.seagate.com...
Stopping m0d@0x7200000000000001:0x9 (ios) at ssc-vm-5571.colo.seagate.com...
Stopped m0d@0x7200000000000001:0x9 (ios) at ssc-vm-5571.colo.seagate.com
Stopping m0d@0x7200000000000001:0x20 (confd) at ssc-vm-5571.colo.seagate.com...
Stopping hare-hax at ssc-vm-5571.colo.seagate.com...
Stopped hare-hax at ssc-vm-5571.colo.seagate.com
Making sure that RC leader can be re-elected next time
Stopping hare-consul-agent at ssc-vm-5571.colo.seagate.com...
Stopped hare-consul-agent at ssc-vm-5571.colo.seagate.com
Shutting down RC Leader at ssc-vm-5571.colo.seagate.com...
[root@ssc-vm-5571 ~]#
`

@daniarherikurniawan are you still facing this?

@vaibhavparatwar, @pavankrishnat  I guess this error is related to this prerequisite "3 | cortx-hare and cortx-s3server RPMs are installed | all machines".
However, now I am blocked by another issue (https://github.com/Seagate/cortx-hare/issues/1665) that prevents me from deploying hare RPMs. Please approve the PR that will address that problem.
I have a question, do we need to install cortx-s3server RPMs as well (in order to start hare)? There is no link about cortx-s3server tutorial on the Hare's README.md (https://github.com/Seagate/cortx-hare/blob/main/README.md).
If cortx-s3server is mandatory, then there must be another section in that readme about "Build Cortx-S3Server RPMs". Let me know if this section is needed, I can create a PR for it. Thx

@daniarherikurniawan I think ideal document for hare deployment on single node VM is this one - https://github.com/Seagate/cortx-hare/wiki/Hare-provisioning-for-single-node-deployment - Here all the pre-requisits are mentioned and links to all the required README's / QSGs are mentioned. s3server is mentioned in this document as pre-requisit, but I think to start hare cortx-s3server RPMs are optional .. @mssawant @suvratjoshi @knekrasov can confirm on this.

@vaibhavparatwar,  Thanks for the suggestion. I will try that link out.
In my case, I was following the main CORTX  quick start (https://github.com/Seagate/cortx/blob/main/QUICK_START.md) => 3. Build just the block storage layer (motr) from the source => ii. Run it across a cluster:  => then there is a link to Install HARE that points to hare's README.
I am hoping that we can make hare's README as clear as possible to avoid any confusion because this file is linked to the main CORTX quick-start guide, which will be visited by many people.

@daniarherikurniawan regarding s3server rpms - if we have non-zero s3 instances mentioned in CDF file, then we need s3server rpms as well.

@vaibhavparatwar  That totally makes sense! I believe we should add that information in the Hare Readme. For a newbie like me and all other future CORTX developers, we must know that the S3 is not required by hare unless it is mentioned in the CDF file.

Hi @daniarherikurniawan,
Looks like there is some problem with m0crate file. I tried same at my end, it ran successfully without any error. Here is my output attached.
root_20210623_095741.txt

@pavankrishnat , could you give me some hints on how to test the m0crate? to make sure that m0crate is performing as expected, is there any simple unit test? Thx!

Great news.. :)
I solved the problem by doing these:

Addressing the facter >= 3.14.8 requirements by changing that into just facter at hare.spec
Debug my m0crate-io.yaml, thanks to @pavankrishnat for the attached trace.
Restart the cortx modules completely by utilizing lsmod and then kill one by one in order.
Start the hare by running hctl bootstrap ... or hctl start.

Out of these 5, I am not sure which step really matters here.
I will run this test on 3 other servers and see if I can get a solid result. I close this issue, thx!
cc: @vaibhavparatwar


chore: Upgrade snapbox to 0.5.14

This makes the upgrade to 0.6 trivial once cargo-test-support upgrades

It seems the nightly toolchain is broken.

It seems the nightly toolchain is broken.

See: https://github.com/rust-lang/rust/issues/125484


Section <IP_ADDRESS> para 373, FCS_DTLSC_EXT.1.2

FCS_DTLSC_EXT.1.2 Test applicability description is hard to follow. “Note that tests 1-6 are only applicable to” is ambiguous and easy to misinterpret as references to para 367 to 372.
Recommend using precise references (e.g., Test 5-1 and Test 5-2 in this section). Recommend using clearly defined Cases to explain test applicability. Recommend using different numbering scheme (e.g., Test A instead of a. Test 1).
Suggested changes:
Case 1: DTLS v1.2 is implemented as part of FTP_ITC.1 and … perform X, Y, Z;
Case 2: DTLS v1.2 is implemented as part of FPT_ITT.1 and … perform Y, Z;
Case 3: DTLS v1.3 is implemented…;
…
Test A [conditional]…
Test B [conditional]…

Test formatting was corrected in the SD in PR #209.


Balder/extend flag eol

@aressem or @hmusum PR

Any of these that should be considered moved to permanent flags ?

Will consider when we see what is left after vespa 7 is gone.


Autofix Markdown files using Prettier on merge

Add seperate workflow for autofixing MD files using Prettier when PRs get merged into master. Use case: Edit docs from browser, but they don't align Prettier config. For more info checkout out the linked issue
Closes #3256
:heavy_check_mark: Checklist

[x] All your commits have a Signed-off-by line in the message. (more info)

Would be happy about feedback. Not 100% sure how to fully test this, as "CI / verify" will run yarn prettier:check & this would fail for an not prettified "ADOPTERS.md".


Config for security.yml

Hello,
I install the bundle but i don't know how i configure /app/config/security.yml
My file :
`security:
encoders:
    FOS\UserBundle\Model\UserInterface: bcrypt

role_hierarchy:
    ROLE_ADMIN:       ROLE_USER
    ROLE_SUPER_ADMIN: ROLE_ADMIN

providers:
    fos_userbundle:
            id: fos_user.user_provider.username

firewalls:

    dev:
        pattern: ^/(_(profiler|wdt|error)|css|images|js)/
        security: false

    main:
        pattern: ^/
        form_login:
            provider: fos_userbundle
    logout: true
    anonymous: true

access_control:
        - { path: ^/api, role: IS_AUTHENTICATED_ANONYMOUSLY }
        - { path: ^/login, role: IS_AUTHENTICATED_ANONYMOUSLY }
        - { path: ^/register, role: IS_AUTHENTICATED_ANONYMOUSLY }
        - { path: ^/resetting, role: IS_AUTHENTICATED_ANONYMOUSLY }
        - { path: ^/admin/, role: ROLE_ADMIN }`

Thanks for your help

I find the solution, in the README, there's an error
`# app/config/security.yml
dunglas_angular_csrf:
# Collection of patterns where to set the cookie
cookie:
set_on:
- { path: ^/$ }
- { route: ^app_, methods: [GET, HEAD] }
- { host: example.com }
# Collection of patterns to secure
secure:
- { path: ^/api, methods: [POST, PUT, PATCH, LINK] }
- { route: ^api_v2_ }
- { host: example.com, methods: [POST, PUT, PATCH, LINk] }`
It's in # app/config/config.yml

IIRC, you can put this config in any of those 2 files.


Meet with to Confirm IAO CFR Form Changes

Title of ticket: Meet with to Confirm IAO CFR Form Changes
Description
Summarize issue
Dependencies
Are there any dependencies?
DOD

[x] Meet
[x] Discuss changes
[x] Make Design Changes

@arielleandrews going to tag you here with a link to the updated designs so you can confirm if this meets the needs you have outlined in a demo a few weeks bachttps://jacklyn808742.invisionapp.com/console/share/RSBDPXJGKAW/922730565

@arielleandrews @KaraBeach @m-prodan @lmullane Here is the updated link with the two fields for IAO and Ministry users on both the Estimate and Actuals Sides
https://jacklyn808742.invisionapp.com/console/share/RSBDPXJGKAW/922730563
Let me know if there are any further changes

Thanks for the quick update, @JHarrietha-AOT. Looks good.
I'll write the story.

Closing the issue as design changes have been made and Dev Story can now be written up


HCE support

Does it has support for HCE
Example: I have an rfid card of a door i am looking to add that card to the app this helps me unlocking the door without carrying card does this plugin support that feature ,If so how can i achieve the same.
Many Thanks.

no update?


HAWQ-1025. Implement issues in HAWQ-1025.

cc @ictmalili @wcl14 @radarwave

LGTM except the three comments. Thanks 🎱

+1

Merged into master.


Wrong type for MessageBotMessageAttachment ts?

ts is declared as f32 on BotMessageAttachment. I beleave this is what fails deserialization on my machine when I call channels.history. My assumption is that I have a Swedish locale and number our decimalseparator is , not .. I'm not sure if f32 deserialization cares about locale but something fails when requesting channels and deserializing to f32.
I beleive the correct type for ts is String even if the format looks like a float.
        "defs_ts": {
            "pattern": "^\\d{10}\\.\\d{6}$",
            "title": "Timestamp in format<PHONE_NUMBER>.012345",
            "type": "string"
        },

Please advice how I can supply better details for debugging this issue.
https://docs.rs/slack_api/0.21.0/slack_api/struct.MessageBotMessageAttachment.html

Seems related to https://github.com/slack-rs/slack-rs-api/pull/56

this is fixed by the new Timestamp type https://github.com/slack-rs/slack-rs-api/releases/tag/v0.23.0


support background fill for freedraw shapes

requested by https://twitter.com/_cloudmu/status/1482026494155272198

Can I take this up?


Installing neovim-git gets stuck at "Generating helptags ..."

Hey, when trying to install neovim-git with pacaur the installation process always gets stuck at "Generating helptags ..." with CPU at 25% (which is one core running at 100% and it's cycling through the cores every few seconds).
The installation works fine when downloading the PKGBUILD manually and using makepkg.
It also seems to work fine with packer as AUR helper (see https://aur.archlinux.org/packages/neovim-git/ comments section).
Might be related to https://github.com/neovim/neovim/issues/2364.

Looks like a similar issue to #197.

Would the terminal output help you? It's pretty long though and I doubt it's helpful since it's just the compilation output which stops at "Generating helptags".

No, I can reproduce. This is the very same bug as #197, namely the piped 'yes' command conflicts with the check() routine. I am unsure how to fix this issue properly at this time.
Cheap and very dirty workaround: add the following to your pacaur config file:
makeopts+=("--nocheck")

Doesn't work for me either.

Confirmed, the yes piping produces the helptag hanging.
However, even when running makepk -sfi (which is what pacaur uses), the package fails to install:
:: Proceed with installation? [Y/n] ==> WARNING: Failed to install built package(s).

The PKGBUILD does look correct, but there's definitely something weird going on here. No way pacaur can install this package if -sfi fails. If you can reproduce too, you might want to report to the AUR package maintainer.

I get the same error with makepkg -sfi and makepkg -si, however if I use makepkg -s or makepkg -sf and install manually with pacman -U it installs just fine.

Yes, but there are a lot of reason pacaur uses -i instead of using pacman -U to install created packages. If it's not supported by makepkg -i, it's not supported by pacaur. This should be fixed in the PKGBUILD (if faulty), otherwise fixed upstream. Nothing I can do here.
The hanging issue is however real.

Hi, I'm the PKGBUILD maintainer for neovim-git. makepkg -i fails and the check() function doesn't make a difference, so I think it's an upstream issue..
Any idea what the underlying problem might be? I mean, why the installation fails? Is an extra Return pushed to the terminal, which then aborts the Proceed with installation? [Y/n] question?

Looks like the problem was introduced upstream with merge of neovim/neovim#2025. I'm going to report upstream when I know the exact commit and how to reproduce it on a non-Arch system.

Thanks. I'll try to find a way to fix the pacaur specific issue, but I'm clueless about my available options - any idea welcome!

Does removing the installation directory fixes the problem? See this for more info: https://github.com/neovim/neovim/issues/2364#issuecomment-91845325

@tarruda : doesn't seem so. Clean install with "makepkg -sfi", same issue.

makepkg -sfi works now (neovim/neovim#2598). With pacaur, the installation still gets stuck at "Generating helptags", though.

This should be fixed now (neovim/neovim#2801).

Thanks for the follow up!
On 6 Jun 2015 19:32, "Florian Walch"<EMAIL_ADDRESS>wrote:

This should be fixed now (neovim/neovim#2801
https://github.com/neovim/neovim/pull/2801).
—
Reply to this email directly or view it on GitHub
https://github.com/rmarquis/pacaur/issues/325#issuecomment-109569215.


socket.gaierror

Thank you for publishing this! I've "dockerized" this with the following Dockerfile
FROM python:latest

RUN git clone https://github.com/snicker/juicepassproxy

RUN pip install -r juicepassproxy/requirements.txt

CMD [ "python", "juicepassproxy/juicepassproxy.py", "-s <IP_ADDRESS>:8051", "-d <IP_ADDRESS>:8051", "-p 1883", "-H <IP_ADDRESS>"]

When I try to bring the container up, I see the following error output from python:
juicebox            | Traceback (most recent call last):
juicebox            |   File "//juicepassproxy/juicepassproxy.py", line 205, in <module>
juicebox            |     main()
juicebox            |   File "//juicepassproxy/juicepassproxy.py", line 196, in main
juicebox            |     handler = JuiceboxMessageHandler(mqtt_settings=mqttsettings,
juicebox            |               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
juicebox            |   File "//juicepassproxy/juicepassproxy.py", line 42, in __init__
juicebox            |     self._init_devices()
juicebox            |   File "//juicepassproxy/juicepassproxy.py", line 48, in _init_devices
juicebox            |     self._init_device_status(device_info)
juicebox            |   File "//juicepassproxy/juicepassproxy.py", line 61, in _init_device_status
juicebox            |     sensor = Sensor(settings)
juicebox            |              ^^^^^^^^^^^^^^^^
juicebox            |   File "/usr/local/lib/python3.12/site-packages/ha_mqtt_discoverable/__init__.py", line 652, in __init__
juicebox            |     self._connect_client()
juicebox            |   File "/usr/local/lib/python3.12/site-packages/ha_mqtt_discoverable/__init__.py", line 707, in _connect_client
juicebox            |     result = self.mqtt_client.connect(
juicebox            |              ^^^^^^^^^^^^^^^^^^^^^^^^^
juicebox            |   File "/usr/local/lib/python3.12/site-packages/paho/mqtt/client.py", line 914, in connect
juicebox            |     return self.reconnect()
juicebox            |            ^^^^^^^^^^^^^^^^
juicebox            |   File "/usr/local/lib/python3.12/site-packages/paho/mqtt/client.py", line 1044, in reconnect
juicebox            |     sock = self._create_socket_connection()
juicebox            |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
juicebox            |   File "/usr/local/lib/python3.12/site-packages/paho/mqtt/client.py", line 3685, in _create_socket_connection
juicebox            |     return socket.create_connection(addr, timeout=self._connect_timeout, source_address=source)
juicebox            |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
juicebox            |   File "/usr/local/lib/python3.12/socket.py", line 828, in create_connection
juicebox            |     for res in getaddrinfo(host, port, 0, SOCK_STREAM):
juicebox            |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
juicebox            |   File "/usr/local/lib/python3.12/socket.py", line 963, in getaddrinfo
juicebox            |     for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
juicebox            |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
juicebox            | socket.gaierror: [Errno -2] Name or service not known

Wondering if you have any thoughts on this.
Note that when I telnet into my Juicebox, I get the following for a list command:
list
! # Type  Info
# 0 FILE  webapp/index.html-<IP_ADDRESS> (1995, 0)
# 1 UDPC  juicenet-udp-prod4-usa.enelx.com:8051 (12684)

based on the stack track, the MQTT client library is failing to locate your MQTT server. This seems like an issue with how your network is configured in the docker environment or an incorrect IP for your MQTT server. On Nov 5, 2023, at 04:05, Juggler00 @.***> wrote:
Thank you for publishing this! I've "dockerized" this with the following Dockerfile
FROM python:latest
RUN git clone https://github.com/snicker/juicepassproxy
RUN pip install -r juicepassproxy/requirements.txt
CMD [ "python", "juicepassproxy/juicepassproxy.py", "-s <IP_ADDRESS>:8051", "-d <IP_ADDRESS>:8051", "-p 1883", "-H <IP_ADDRESS>"]
When I try to bring the container up, I see the following error output from python:
juicebox            | Traceback (most recent call last):
juicebox            |   File "//juicepassproxy/juicepassproxy.py", line 205, in
juicebox            |     main()
juicebox            |   File "//juicepassproxy/juicepassproxy.py", line 196, in main
juicebox            |     handler = JuiceboxMessageHandler(mqtt_settings=mqttsettings,
juicebox            |               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
juicebox            |   File "//juicepassproxy/juicepassproxy.py", line 42, in init
juicebox            |     self._init_devices()
juicebox            |   File "//juicepassproxy/juicepassproxy.py", line 48, in _init_devices
juicebox            |     self._init_device_status(device_info)
juicebox            |   File "//juicepassproxy/juicepassproxy.py", line 61, in _init_device_status
juicebox            |     sensor = Sensor(settings)
juicebox            |              ^^^^^^^^^^^^^^^^
juicebox            |   File "/usr/local/lib/python3.12/site-packages/ha_mqtt_discoverable/init.py", line 652, in init
juicebox            |     self._connect_client()
juicebox            |   File "/usr/local/lib/python3.12/site-packages/ha_mqtt_discoverable/init.py", line 707, in _connect_client
juicebox            |     result = self.mqtt_client.connect(
juicebox            |              ^^^^^^^^^^^^^^^^^^^^^^^^^
juicebox            |   File "/usr/local/lib/python3.12/site-packages/paho/mqtt/client.py", line 914, in connect
juicebox            |     return self.reconnect()
juicebox            |            ^^^^^^^^^^^^^^^^
juicebox            |   File "/usr/local/lib/python3.12/site-packages/paho/mqtt/client.py", line 1044, in reconnect
juicebox            |     sock = self._create_socket_connection()
juicebox            |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
juicebox            |   File "/usr/local/lib/python3.12/site-packages/paho/mqtt/client.py", line 3685, in _create_socket_connection
juicebox            |     return socket.create_connection(addr, timeout=self._connect_timeout, source_address=source)
juicebox            |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
juicebox            |   File "/usr/local/lib/python3.12/socket.py", line 828, in create_connection
juicebox            |     for res in getaddrinfo(host, port, 0, SOCK_STREAM):
juicebox            |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
juicebox            |   File "/usr/local/lib/python3.12/socket.py", line 963, in getaddrinfo
juicebox            |     for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
juicebox            |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
juicebox            | socket.gaierror: [Errno -2] Name or service not known
Wondering if you have any thoughts on this.
Note that when I telnet into my Juicebox, I get the following for a list command:
list
! # Type  Info
0 FILE  webapp/index.html-<IP_ADDRESS> (1995, 0)
1 UDPC  juicenet-udp-prod4-usa.enelx.com:8051 (12684)
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you are subscribed to this thread.Message ID: @.***>

hey @Juggler00  did you ever figure this out?


replace StopIteration with return

close https://github.com/clips/pattern/issues/243
Note this only addresses the code block in the issue.
There are other instances of StopIteration being raised in pattern that you, the maintainers might want to be addressed in this PR?

Coverage decreased (-0.002%) to 68.279% when pulling 01adbe37f6ed3130fe0c8eb020f1907a92acdcc3 on Krzana:fix/generators into 5b85d998c30ddc6772b56310713530224466083a on clips:master.


Move Schemas/Trusted Issuers from Settings to top Navigation

From UAT, user did not expect that Schemas (Create etc) would be under Settings, so they were a little lost.
Make Schemas accessible from the left hand side navigation. Could just be named "Schemas".  Eventually, this would be only visible based on the user's roles.

See: https://github.com/hyperledger-labs/business-partner-agent/pull/723

Implemented in #723

See: https://github.com/hyperledger-labs/business-partner-agent/pull/723


Ampersands in text to encodify

Hi - we noticed something. When we send a string to have it encodified with &private=, we found that if the string has ampersands, and our database url-encodes those, they are encoded as &. So if the string is sent as abc&%&123, our db is sending as abc&%&123 which steganographr is dutifully encoding.
Can you think of any strategy to avoid this, so that we get back what we intended? I am yet to try not url-encoding the private string but will if you think that might work. Appreciate your help.

I added something to the API code that might help (assuming that I understand the issue fully). If the decoded text to be sent back includes encoded ampersands, it'll convert those to the intended & character. Let me know if this helps! You can grab the updated script here, or you can text it live at https://neatnik.net/steganographr/api/.

thanks for the work on this @newbold 👍
Ok, so I tested in your site (made sure to clear the cache first), doing a GET in the browser with your test string, replacing a character in the string with &. I then copy the encoded string and pass it to decode, and what happens is, the returned decoded private string gets cut off at the ampersand.
In terms of process on our end:

user enters a private string with an ampersand
user clicks encode button, and the db url-encodes the string and passes it to the steganographr api, so it's passing the & in that step
steg dutifully encodes the & as is
user clicks decode button, and steg dutifully decodes showing the &

Yeah, my web server (Apache) will be tripped up by ampersands because it treats anything after an ampersand as a parameter in a query string (and not part of the string associated with the prior parameter). Even an encoded ampersand entity, like &, would be affected by that in Apache—but Apache is totally happy with the decimal encoding process that turns an ampersand into %26 (and that will slip right through in a query string and be treated as an actual ampersand character).
To clarify, when you're doing this on your end, are you running your own copy of the API script? If that's the case, can I ask what kind of web server you're running?

Hi - yeah, edited the above comment as it looks like I'm also passing %26, looking at the log; sorry for the misinformation. We are using our own copy of the API script, running on nginx.

Ok, did the same test on your site, replacing a letter with %26 and it works as expected.

OK, gotcha. I've never used nginx so but thanks to your linked script above I could see how it works. Looks like it's identical behavior to Apache -- an unencoded ampersand is treated as a query string parameter delimiter, but encoded ones (as %26) are passed through as strings. So at this point is everything OK with the setup on your end, or did you need any other adjustments made? Glad to help if you still need something!

Ok, I'll test again. I think something was cached on my side. Not sure if this is related, but please see the screenshot. I'm seeing errors again at the top, and also the sample URL in the Encoding section looks borked.

As for it working or not, ok, got it working in my db. Thanks!
Still not 100% sure, but, it appears my db is doing an additional url encode on the string that comes back from steganographr. I did a quick regex on it and that fixes it for display purposes.

It looks like REQUEST_SCHEME might be an Apache-specific thing, so I removed it. It was purely cosmetic (used to decide whether to show HTTP or HTTPS in the API landing page URLs), and I just went ahead and replaced the reference with HTTPS until I figure out a more universal way to detect a TLS connection. 😄 Updated script is here: https://github.com/neatnik/steganographr/blob/master/steganographr-api.php


except block should only run on an import error

Related #9

Thanks for the PR! Much appreciated! Please refer to the contributing guide. We are aligning internally on how to make contributing to Metaflow easy and transparent.

Thanks for making this PR. I would personally prefer that you at least fix some of our other occurrences for python2 vs python3 ImportError in some other parts of the code base as well; if you're anyway intending to fix this for us.
https://github.com/Netflix/metaflow/search?q=except%3A&unscoped_q=except%3A
I don't mean for you to fix all naked exceptions in our codebase, but there are at least a few more (like util.py) which have very similar logic.
@chrisaddy Let me know what you think.

@seeravikiran happy to help! I know it's a very small thing, don't want to make pointlessly small PRs, but I'm of the philosophy of clean up small things as you see them. I'll take a look at more exceptions


Quality components "dolbyvision" was override

Expected behaviour:

"dolbyvision" should not be override.
Actual behaviour:
Found different quality for Three-Body 2023 S01E19 2160p WEB-DL DoVi H265 10bit DDP5.1 Atmos-PTerWEB. Was 2160p webdl h265 dolbyvision dd+5.1, overriding with 2160p webdl h265 10bit dd+5.1.
Steps to reproduce:
As test below.
Config:
Case 1: #with 10bit
  test.monitor_series:
    mock:
      - {title: 'Three-Body 2023 S01E01 2160p WEB-DL DoVi H265 10bit DDP5.1 Atmos-PTerWEB'}
    parsing:
      series: guessit
    metainfo_series: yes
    exec: echo "{{quality}}"

Case 2: #without 10bit
  test.monitor_series:
    mock:
      - {title: 'Three-Body 2023 S01E01 2160p WEB-DL DoVi H265 DDP5.1 Atmos-PTerWEB'}
    parsing:
      series: guessit
    metainfo_series: yes
    exec: echo "{{quality}}"

Log:

(click to expand)
Case 1:
2023-02-01 21:03:23 VERBOSE  task_queue                    There are 1 tasks to execute. Shutdown will commence when they have completed.
2023-02-01 21:03:24 VERBOSE  details       test.monitor_series Produced 1 entries.
2023-02-01 21:03:24 VERBOSE  series        test.monitor_series Found different quality for `Three-Body 2023 S01E01 2160p WEB-DL DoVi H265 10bit DDP5.1 Atmos-PTerWEB`. Was `2160p webdl h265 dolbyvision dd+5.1`, overriding with `2160p webdl h265 10bit dd+5.1`.
2023-02-01 21:03:24 VERBOSE  details       test.monitor_series Summary - Accepted: 0 (Rejected: 0 Undecided: 1 Failed: 0)

Case 2:
2023-02-01 21:09:03 VERBOSE  task_queue                    There are 1 tasks to execute. Shutdown will commence when they have completed.
2023-02-01 21:09:03 VERBOSE  details       test.monitor_series Produced 1 entries.
2023-02-01 21:09:03 VERBOSE  series        test.monitor_series Found different quality for `Three-Body 2023 S01E01 2160p WEB-DL DoVi H265 DDP5.1 Atmos-PTerWEB`. Was `2160p webdl h265 dolbyvision dd+5.1`, overriding with `2160p webdl h265 dd+5.1`.
2023-02-01 21:09:03 VERBOSE  details       test.monitor_series Summary - Accepted: 0 (Rejected: 0 Undecided: 1 Failed: 0)

Additional information:

FlexGet version: 3.5.21
Python version:
Installation method: docker/wiserain
Using daemon (yes/no): yes
OS and version:
Link to crash log:

RELEASE.NAME........: Three-Body.2023.S01E01.2160p.WEB-DL.DoVi.H265.10bit.DDP5.1.Atmos-PTerWEB.mp4
RELEASE.DATE........: UTC 2023-01-17 09:08:31.617
RELEASE.SIZE........: 1.99 GiB
RELEASE.FORMAT......: MPEG-4
DURATION............: 00:43:41.760
OVERALL.BITRATE.....: 6 513 kb/s
RESOLUTION..........: 3840 x 1640
VIDEO.CODEC.........: HEVC Main 10@L5@Main Dolby Vision
FRAME.RATE..........: 25.000 FPS
Aspect.Ratio........: 2.350
Audio #0............: 6 channels E-AC-3  @ 448 kb/s
UPLOADER............: PTerWEB

I suppose that I misunderstand the "override" meaning.
Does it mean that dolbyvision is already marked in database, and rss output a new 10bit, that 10bit override dolbyvision in database.


figure out if compression threads can be removed

Closed by https://github.com/prefix-dev/rattler-build/pull/904


Option to cache firmware to computer for multiple updates?

I have a kit of lots of T2s that I use for hackathons. Any time we get a firmware update, I want to update all of them.
A significant piece of the time taken in this process is downloading the firmware image. It would be nice to not have to download it over and over to use the t2 update command. What if it cached locally?
Is this a problem other people have?

It is possible to update from local builds with t2 update --op PATH_TO_OPENWRT_IMAGE --fp PATH_TO_FIRMWARE_IMAGE. We don't have a great way of finding URLs to firmware images but they are accessible in the source code.


Limit max flow from a non-linear reservoir outlet

https://github.com/NOAA-OWP/ngen/blob/8283f3230772360b3393c8eae2544f4e901cd315/models/kernels/Nonlinear_Reservoir.hpp#L24
@jdmattern-noaa  Per Fred's comments, will need to add a max flow parameter to these outlets.

Closed by #57


ADDED : [Testing and Debugging in Machine Learning]

Hey @pooja1198 , Can you please add a description of the course?
Don't worry about the merge conflicts, I'll resolve those 😃
Hit me up, whenever you're done and I'll merge this PR or if you're unable to resolve the current conflicts and commit your changes, then please close this one and create a new PR instead, so that it's easier for you :) Goodluck ! ✨


bug with jwt

crypto-browserify/crypto-browserify#130 and auth0/node-jsonwebtoken#91

I believe this is fixed upstream


Compilation error after cloning

The build returns the errors:
Error		Assets file '<local path>\iot-edge-opc-publisher\src\obj\project.assets.json' not found. Run a NuGet package restore to generate this file.	OpcPublisher	C:\Program Files\dotnet\sdk\2.1.103\Sdks\Microsoft.NET.Sdk\build\Microsoft.PackageDependencyResolution.targets	327

and
Error		Assets file '<local path>\iot-edge-opc-publisher\src\obj\project.assets.json' not found. Run a NuGet package restore to generate this file.	OpcPublisher	C:\Program Files\dotnet\sdk\2.1.103\Sdks\Microsoft.NET.Sdk\build\Microsoft.PackageDependencyResolution.targets	167

In the sentence in readme.md
Open the OpcPublisher.sln project with Visual Studio 2017 and build the solution by hitting F7.
should be F6

It is the VS problem. If the local Package Manager Settings refers to local source in a folder and this folder doesn't exist the whole restore process fails even if the package source points out to nuget.org. The local source must be deselected in the setting to pass the restore.
Only typo is valid.