Proposal for QUIC based driver for Nexodus

Thank you for your work done so far! I have some high-level feedback.
I do not support adding support for tunneling IP traffic over QUIC directly to Nexodus. That is a general enough feature that I would like to see as much of it implemented outside of Nexodus as possible. A really good analogy is to look at the architecture of wireguard and how we can consume it. You can configure wireguard tunnels directly and then Nexodus orchestrates that configuration across many hosts. I envision the same architecture for any other tunneling method, including QUIC.

Yes, agree, and that's how I am implementing it. It has no or minimum impact on the orchestrator, most of the code is contained within nexodus agent code. It will rely on similar format configuration like wireguard. So from the high level architecture perspective, it's very similar to wireguard, except wireguard implementation is kernel based, and QUIC implementations are userspace implementations. Happy to address any questions to clarify the low level details of how QUIC (DATAGRAM) and wireguard are architecturally similar, and QUIC based driver can be implemented in similar way like wireguard based driver.

Most of the content here is still relevant. I would just rephrase the document to suggest that the intent is to document an exploration and PoC to determine whether QUIC could work as a future protocol for Nexodus.

After the current PoC I am pretty confident that QUIC can be be used as a alternate driver for Nexodus. I am happy to add more specific details if you think that will help understand the how's and what's better.

I would not include a proposal for integration at this time.
Sure, but wondering if the integration proposal will help clarify the first concerned you raised (regarding the tunneling architecture).

I envision three design-doc-level deliverables.

a doc that describes why alternative transports are interesting to Nexodus and explores whether QUIC is a viable alternative. It should have supporting references to other projects and our own PoC code. It must discuss both the tunneling mechanism and the security architecture.  The document should also list alternatives considered. We looked at ipsec, even had a PoC about it, so I'd like that referenced in our write-up that explains our survey of future transport options. It should be clear why QUIC is considered the best choice.

a design for a project that supports tunneling IP traffic that is as easy as wireguard. This is completely separate from Nexodus. One way to look at it is consider the ease of setting up IP tunneling between hosts manually with wireguard. I would like to see a project that provides a similar experience using QUIC. It can reference #1, but should talk about the first steps about how we make this usable by anyone.

Once #2 is far enough along, we could have a proposal for integration with Nexodus with a library similar to wireguard-go. Nexodus should be seen as an orchestrator for configuring core technology built as proposed in #2.

My suggestion is that this doc should be updated to focus on the scope proposed in #1. Do you agree with the proposed scope of the first doc? I think is important before we get back into any details.


URL utility

It would be great if the component has a utility to accept urls (parse video id from url). It's a pretty common use case.

https://github.com/jmorrell/get-youtube-id/ does a great job providing this functionality, I might make a note in the readme to refer to it.

I agree with you. In hindsight, adding this is out of the project's scope.


Use PyPI version of pytest-kind

Pushing to PyPI is currently failing as the pytest-kind dependency is directly pointing to GitHub.
I seem to remember doing this because we needed some unreleased fix from pytest-kind, but that may have been a hangover from dask-kubernetes and no longer needed.

It looks like the latest tag in the repo was the 22.11.1 release commit so hopefully things should just work as expected.
https://codeberg.org/hjacobs/pytest-kind/commits/branch/main


Introduce TypeScript class

Resolve #14, #15.

install grunt-ng-annotate
divide in an initialization data
introduce TypeScript class for testable

Thanks !


webgpu support

Hi, does this support webgpu in the browser?

No; at the moment wasi-nn is primarily focused on outside-the-browser usage of WebAssembly.

@abrown thanks for the response!


⚠ Bofrost.de has degraded performance

In f074250, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 941 ms

Resolved: Bofrost.de performance has improved in 6dc0e6b after 6 minutes.


adds power-profiles-daemon to dependencies

power profile switch in battery module needs power-profiles-daemon package

or is it not optional ?

I think having it as optional is fine but we should add a notification indicating that the user must install it to change profiles. I can do that in a separate pr.


Wrong examples

Should be Export-ADSyncToolsAadDisconnectors instead of Export-ADSyncToolsDisconnectors

@BakkerJan : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#sign-off


x/build/cmd/gomote: improve edit/push/test cycle

When using a gomote, I often want a tight edit/push/test cycle, but the current behavior of gomote push makes this difficult. Specifically, because gomote push deletes all files from the remote tree that aren't in the local tree, I have to re-run a full make.bash every time I edit something and push, rather than just re-running the one test I care about. In general, deleting these files is clearly the right behavior, so I'm not sure what the answer is. Perhaps it shouldn't delete the build-generated files, such as go/src/runtime/internal/sys/zversion.go and maybe go/src/cmd/cgo/zdefaultcc.go and go/src/go/build/zcgo.go. Or perhaps we need to tweak the build process to be more friendly to cleaning the tree. The VERSION file may also be involved.
/cc @bradfitz

It used to ignore certain files to enable such a fast cycle. (that's how I used it) but I never updated it after the build cache changes. Should be an easy fix. Will do.

I always just run
gomote push TARGET
gomote run TARGET go/bin/go test package

and that works fine for me.  What doesn't work for you?  Is it possible that you need to sync your gomote sources past https://golang.org/cl/53070?

You're quite right, Ian. I updated my gomote and this appears to work fine now. Sorry for the noise!


Allow egrees from istio-ingressgateway pod if APIServerSNI feature gate is enabled

How to categorize this PR?

/area usability
/kind bug
What this PR does / why we need it:
Which issue(s) this PR fixes:
Fixes #6036
Special notes for your reviewer:
/cc @plkokanov
Release note:

NONE

/cc @plkokanov

@acumino Could you please address the nit comments so that we can get this PR merged? Thanks! 🤝

/retest

/lgtm
/approve


fix(coreaccessor): pfd submission nil check

PULL REQUEST

Overview
PR for Viet to test a fix to PFD submissions in testground. If successful I will fill in the rest of the PR template.

Checklist

[ ] New and updated code has appropriate documentation
[ ] New and updated code has new and/or updated testing
[ ] Required CI checks are passing
[ ] Visual proof for any user facing features like CLI or documentation updates
[ ] Linked issues closed with keywords

Codecov Report

Merging #1368 (42f89c0) into main (bd13b76) will decrease coverage by 0.02%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##             main    #1368      +/-   ##
==========================================
- Coverage   55.06%   55.03%   -0.03%
==========================================
  Files         178      178
  Lines       10689    10689
==========================================
- Hits         5886     5883       -3
- Misses       4227     4229       +2
- Partials      576      577       +1

Impacted Files
Coverage Δ

state/core_access.go
16.73% <0.00%> (ø)

share/ipld/get.go
91.24% <0.00%> (-1.39%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


added nl/amolf.txt

Hi there,
I added the domain for AMOLF, a Dutch National Physics Institute.

@JesseSlim This organization seems to be purely research institute. However, if I am mistaken, could you please provide us with an URL of a page on the official website where an IT-related long-term (>1 year) course is offered by the school. If there is no such course offered, please close this request and email<EMAIL_ADDRESS>in order to discuss the best possible options for licensing the students and employees of this Institute (which also can be free). Thank you!

@JesseSlim You might miss my previous comment. Please react.

@philipto Thank you for the quick response! AMOLF is indeed mainly a physics research institute (although one could argue that PhD students receive their PhD education there). I saw some other research institutes in the repository as well, that's why a filed a request. Under these circumstances, does AMOLF qualify?

@JesseSlim No, AMOLF is not qualified. There are few research institutes in the repository, but only if they have really significant number of PhD students studying there.
Please notice that free educational subscription for JetBrains tools is for students and teachers only, and is valid for using the tools for educational purpose only. If AMOLF employees who are not students, nor teachers, also need a license for JetBrains tools, they are eligible for an academic discount for the tools. They can get the discount by email to<EMAIL_ADDRESS>If there are some students and teachers at AMOLF, who are not teaching, nor studying in some universities, and thus they can not get free license using an email address assigned to them by  another educational institution, please ask them to request a free license which they are eligible for via applying with official document option ("OFFICIAL DOCUMENT" tab at https://www.jetbrains.com/shop/eform/students).
Thank you for the understanding! As for now, I have to close this request without merging.


Failure to find Globbed files when trying to run the linter as part of Github Actions

In my repo, the
lint stage of my GHWF failed, despite running fine locally

Running it with a find command instead works fine.
Any idea why Globs don't seem to work in GH Actions?

My guess is that its the shell which is doing the globbing, vacuum is getting pre-globbed files most of the time directly from the shell.
The same problem exists on windows, so this is a feature we need to add.

I see. I'm not sure what the standard way of going about this is, as a file name could contain * characters.

Should the user pass in a flag to signify that it's a Glob pattern, and then we can simply(?) use filepath::glob to generate a slice of file names as opposed to relying on args here?

I think we will need to, there isn't any other way to determine a pattern is being used, if the shell is not globbing for us.


Recommended specification?

Hello,
Thank you for your kind replies.
I see your pre-trained models work perfectly
I made a simple classifier using the VRN model. (https://www.youtube.com/watch?v=a246GAffWZk)
For now, I want to re-train this network using my custom data. (greyscaled dicom volume)
Before that, I just tried to run the train.py script using the initial configuration here.
I had an error and crashed when first checkpoint was being saved.
The problem  is, it took almost 48 hours to get this error.
That means, it takes about 48 hours for training a single epoch, and the configuration shows that I need 250 epoches to get the whole training to be done.
I think I need about 500 days to finish the training script using my computer..
My computer specification is :
Windows 10 x64 OS
Intel(R) Core(TM) i7-2600 CPU  @ 3.40GHZ x 2 CPU
8.00GB RAM
NVIDIA GeForce GTX 1060 6GB graphics
If you don't mind, could you let me know your training time and computer specification when you trained your VRN network?,  and are 250 epoches mandatory to expect the performance as the VRN model here?
Or,, is there any other configuration(like batch size, I do not know much about this.. the current batch size of VRN.py here is 1) that might be able to reduce the training time?
Thank you, and please excuse my English.

So, first off, best practice when training for long epochs is to test ALL your code before launching an hours-and-hours long first epoch. I do this by just setting the training loops to loop over only the first example or two then checkpointing and outputting any statistics (there are issues, for example, with some of my checkpoint scripts not playing well with python 3, if I recall correctly).
My modelnet40 training times were significantly lower, (a couple hours per epoch? It's been over a year since I ran them so I don't recall and the logs are buried in an external hard drive somewhere) running on a single Maxwell Titan X.  If you're working with dicom data and you've got ~256x256x256 volumes then you absolutely should expect your training time to scale with the dimensionality of your data (48 hours for a single epoch sounds mercifully fast, actually). Remember that I run all of my data at 32x32x32--if you're at 256x256x256 then you're already using more than 500 TIMES as much memory/computational cost for a single sample, assuming you're using a similar style network.
Running with a batchsize of 1 is also going to significantly slow you down and may mess up batchnorm (in the experiments I run with batchsize 1 on a localization/segmentation net I actually don't run into batchnorm issues, but I've heard that with BS<16 some people have issues). If you can run with a batch size closer to 10 you should definitely see significant speedups.
Given, however, that memory constraints are likely preventing you loading a larger batch onto your relatively small card, you might want to consider resampling your data to a more amenable size. If you're trying to look for fine-grained things (say, nodules in a CT scan, which only span a few voxels) then you might consider selecting random crops from your volumes, such that you keep the same resolution but don't have to deal with the entire spatial extent.
As to the number of epochs necessary, it's impossible to say with certainty since it's problem-specific, and depends on things like the size of your net (#parameters, depth, optimization difficulty) and the size and complexity of your dataset--also, it's more a matter of the number of iterations than the number of epochs (5 epochs on a 100,000 sample dataset is many more gradient descent steps than 50 epochs on a 1,000 sample dataset!) . A good rule of thumb is to start with a small number of epochs (say, 30, and anneal the learning rate at 15 and 25 epochs) and see how that does. Make sure to checkpoint before you anneal your learning rates!
You could also do the short-term training a couple times and do something like cyclic learning rates between different experiments (starting with the same net then re-running the experiment, kicking the learning rate back up to the start and then annealing it) and then use a Snapshot Ensemble with the different checkpoints to eek out a few more points of performance. I don't think you'll need the full 250 epochs, but in general if you can bake your net for closer to that many iterations you'll tend to be better off. In my experience 300 tends to be "certain, but probably overkill," and if I can spare the time to find some good annealing points I can do it closer to 100-150 epochs.

I think I should try batch size>16, and see the difference.
and I will start with cropped-resampled dicom data.
always thank you for your replies.


Update for questhelper plugin and improvements to the MQuestScript

Update for questhelper plugin and different improventments / extensions or MQuestScript (WidgetSteps, EmoteSteps, and impovements for object/npc steps)
Sorry for the PR to main, must have overlooked that..

Thanks for contributing and updating our quest helper


RUMM-2707 Add basic end - to - end tests for Session Replay

What does this PR do?
A brief description of the change being made with this pull request.
Motivation
What inspired you to submit this pull request?
Additional Notes
Anything else we should know when reviewing?
Review checklist (to be filled by reviewers)

[ ] Feature or bugfix MUST have appropriate tests (unit, integration, e2e)
[ ] Make sure you discussed the feature or bugfix with the maintaining team in an Issue
[ ] Make sure each commit and the PR mention the Issue number (cf the CONTRIBUTING doc)

Codecov Report

Merging #1245 (030713c) into feature/sdkv2 (28af3b3) will decrease coverage by 0.06%.
The diff coverage is n/a.

@@                Coverage Diff                @@
##           feature/sdkv2    #1245      +/-   ##
=================================================
- Coverage          82.86%   82.80%   -0.06%
=================================================
  Files                358      358
  Lines              12670    12670
  Branches            2110     2110
=================================================
- Hits               10498    10491       -7
- Misses              1526     1531       +5
- Partials             646      648       +2

Impacted Files
Coverage Δ

.../datadog/android/sessionreplay/utils/ThemeUtils.kt
83.33% <0.00%> (-16.67%)
:arrow_down:

...id/rum/internal/ndk/DatadogNdkCrashEventHandler.kt
85.00% <0.00%> (-4.00%)
:arrow_down:

...d/v2/core/internal/storage/FileEventBatchWriter.kt
94.74% <0.00%> (-2.63%)
:arrow_down:

...in/com/datadog/android/log/internal/LogsFeature.kt
85.29% <0.00%> (-2.21%)
:arrow_down:

...lin/com/datadog/android/rum/internal/RumFeature.kt
90.97% <0.00%> (-1.39%)
:arrow_down:

...ndroid/telemetry/internal/TelemetryEventHandler.kt
73.44% <0.00%> (-0.78%)
:arrow_down:

.../android/rum/internal/monitor/DatadogRumMonitor.kt
90.81% <0.00%> (-0.54%)
:arrow_down:

.../kotlin/com/datadog/android/v2/core/DatadogCore.kt
85.89% <0.00%> (-0.40%)
:arrow_down:

...ain/java/com/datadog/opentracing/PendingTrace.java
59.48% <0.00%> (+0.86%)
:arrow_up:

...rsistence/file/batch/PlainBatchFileReaderWriter.kt
83.08% <0.00%> (+1.54%)
:arrow_up:

... and 4 more


Clears empty rooms

When a user left a room where they were alone in, the room was lest open.
This PR fixes that and ensure that there is no empty rooms.

Thank you! I was wondering what had been causing the empty rooms lol

I fixed the problems you raised.

Perfect, thank you so much!


Emogrifyer and meta-specified charset=utf-8 problem

I have a problem with Emogrifyer when the parsed html contains a meta-specified charset e.g.
< meta http-equiv="Content-Type" content="text/html; charset=utf-8” >
The UTF-8 characters are somehow mangled, but ONLY when charset=utf-8 is present
I have prepared a test in this sandbox where you can replicate the problem
http://sandbox.onlinephpfunctions.com/code/fc85874bb3c6f0a44406fa446885e184c6bb901b
This code tries to replicate what Emogrifier does internally.
You can try with and without the "charset=utf-8" on Content-Type by uncommenting the str_replace line
Now check this version out
http://sandbox.onlinephpfunctions.com/code/cc431cc871c63202673aff717a912c855966cf13
Here the two mb_converts are done after saving back to HTML from DOMDocument.
Note the reveresed effect, UTF8 is mangled if charset=utf-8 is NOT present. So the DOMDocument parser does something strange to the charset.
Do you have any clue what is going on?
If you do not see a fix, can we have the preserveEncoding feature back so Emogrifyer can be told not do this final mb_convert, that messesup the output?

Hi @clindh, thanks for the bug report. Could you please try whether PR #175 fixes the problem for you?

I fixed is by removing mb_convert_encoding (as the DOMDocument is already UTF-8) and then it works well.

HI @clindh, I've just merged #189. Could you please test whether the problem is solved for you using the current master?

Closing due to no feedback. @clindh Please feel free to reopen this ticket if the problem still occurs.


npm version 2.0.1 is latest now not working on vue 2

Uncaught TypeError: Object(...) is not a function
    at Module.fb15 (VueElementLoading.common.js:661)
    at __webpack_require__ (VueElementLoading.common.js:21)
    at eval (VueElementLoading.common.js:85)
    at eval (VueElementLoading.common.js:88)
    at Object.../node_modules/vue-element-loading/dist/VueElementLoading.common.js (vendors~index.chunk.js:3731)
    at __webpack_require__ (index.bundle.js:80)
    at eval (day.vue?../node_modules/babel-loader/lib!../node_modules/vue-loader/lib??vue-loader-options:18)
    at Object.../node_modules/babel-loader/lib/index.js!../node_modules/vue-loader/lib/index.js?!./src/vue/components/dashboard/user/widgets/day.vue?vue&type=script&lang=js& (index.bundle.js:514)
    at __webpack_require__ (index.bundle.js:80)
    at eval (VM1323 day.vue:2)
    at Module../src/vue/components/dashboard/user/widgets/day.vue?vue&type=script&lang=js& (index.bundle.js:4275)
    at __webpack_require__ (index.bundle.js:80)
    at eval (VM1323 day.vue:3)
    at Module../src/vue/components/dashboard/user/widgets/day.vue (index.bundle.js:4263)
    at __webpack_require__ (index.bundle.js:80)
    at Object.eval (dashboard.vue?../node_modules/babel-loader/lib!../node_modules/vue-loader/lib??vue-loader-options:24)

When users update the module in vue 2 projects, they will receive this error since the current version of the module is in the master branch for vue 3. I already said this, but I will repeat the current version of the module in npm, you need to publish with the tag next (npm publish --tag next)
Now you need to remove the 2.0.1 module version from npm so that the 1.1.6 module remains working for vue 2.
In the readme, add information to install the module in the vue 3 project, you need to run the command:
npm i vue-element-loading@next

Hi, @Sitronik
Thank you for informing us. @biigpongsatorn is working on it and it will be worked soon. 😁

Hi, @Sitronik
Thank you for informing us. @biigpongsatorn is working on it and it will be worked soon. 😁

Hi, @Sitronik
Thank you for your report. I already fixed the issue. You can install with npm i vue-element-loading if you using Vue 2 and install with npm i vue-element-loading@next if you using Vue 3.

Hi, @Sitronik
Thank you for your report. I already fixed the issue. You can install with npm i vue-element-loading if you using Vue 2 and install with npm i vue-element-loading@next if you using Vue 3.


[RHCLOUD-19727] Refactor kafka manager settings

Basically:

The Kafka manager was using the config.Get() function to grab the Sasl settings. When trying to reuse the kafka module in the superkey repository, the config.Get() was loading/trying to load all the settings that sources-api-go requires to work, instead of only loading the settings required for the superkey application. I've refactored the manager's methods so that it grabs all the settings from its config structs.
Replaces the manager with a couple of functions that return a Kafka reader and a Kafka writer, which take a clowder.BrokerConfig struct as the configuration. This is because the manager seemed to be designed as a singleton, but I realized that all of our readers/writers were getting closed after using them. This is why I thought that it might just be better to use a couple of functions that create the readers/writers.
Keeps some of the Kafka manager's functions, like Close, Consume and Produce, since those are very handy functions.

Links
[RHCLOUD-19727]

All right, so after trying to implement the latest suggestions with the feedback, I gave it a different approach. I've submitted a commit with the thing I've come up with:

Replaces the manager with a couple of functions that return a Kafka reader and a Kafka writer, which take a clowder.BrokerConfig struct as the configuration.

That way you only have to give the BrokerConfig, and depending if that BrokerConfig has Sasl settings or not, the reader/writer will be created accordingly. I kind of like this refactor, to be honest. Let me know what you think, please.

I'm going to request a re-review since I significantly changed the contents of the PR. Sorry about the noise!

it looks that PR contains now 2 major things - one regard to settings and other about replacing kafka manager and title of PR now doesn't cover fully the intent :) (I am not requesting any change regard this)
Can I just ask of example how to consume and produce Kafka message ? Thanks!

it looks that PR contains now 2 major things - one regard to settings and other about replacing kafka manager and title of PR now doesn't cover fully the intent :) (I am not requesting any change regard this)

That is true yeah, I just changed the title! Thank you :smile:

This looks good.

Yes this is definitely simpler to use - I asked for examples of usage previously but then I deleted that comment because for us it is probably obvious how to use - question is - whether also for other teams and if this package would deserve own repo - I guess it would be more visible for others.

This looks good.

Yes this is definitely simpler to use - I asked for examples of usage previously but then I deleted that comment because for us it is probably obvious how to use - question is - whether also for other teams and if this package would deserve own repo - I guess it would be more visible for others.

To be honest I also thought of extracting this module to its own repository too, since this code is very similar to what the cloud-connector team is doing. It's true though that in the current state of the PR there is a dependency with v1.BrokerConfig, so you'd need to use that to be able to use the library.
However I think this is better to do it in a different PR, in my opinion.

I'd take it a step further - rather than an entirely separate repo we could make it a sub-package of the app-common-go repository. Since we're using that to parse the config in the first place then the user(s) could just import the subpackage and use it from there.
I'll talk to the owners of that repo and see if that's something they're looking to do, I know there was an initiative to share middleware/code/etc as much as possible before and this is something that others definitely have been just rolling their own etc.

I like the idea. However I would personally merge this one, update the Superkey worker too with this code, and then if we get the approval from the app-common-go team then I don't mind refactoring this yet again. That way we can cross ourselves from the "apps that need to implement support for managed Kafka" list, with enough room to fix any potential issues that we might run into.
What do you think?

/retest

I think there is a problem with the golangci-lint runner - it's failed a bunch of times. Merging now.


failed content type detection

Hi,
I add as an artifact in my mongodb database a checkpoint of my pytorch model,
i.e. a file with a .pt  extension. Apparently, this is not recognized by the mimetypes library,
so I get the message
Failed to detect content-type automatically for artifact /tmp/tmponm4e31q/model.pt.

as per https://github.com/IDSIA/sacred/blob/19524bf8b42580c0f30fc8e2a7bcc0001dfbbcb5/sacred/observers/mongo.py#L238
Can we avoid this annoying print?

You could pass a generic content-type to add_artifact such as
_run.add_artifact("checkpoint.pt", content_type="application/octet-stream")

It might make sense to use this as default content-type, that is set by sacred itself, but even then you would get a print. In general I believe that the usefulness of content-type detection outweighs the annoyance of printing. One could however, use a proper logger for this message, so you could filter it out.

can we just delete the print line? is this kind of warning important at all?

If you rely on the content-type being available to downstream tools, I think it is important to know if the detection fails, so I would not simply let it fail silently.


CI: run CI on PRs only

Closes: n/a
Goal
Run CI on PRs only instead of pushes so fork PRs can be tested too, but without this redundancy:

Approach
(self-explanatory)
Signed-off-by: Roderick Monje<EMAIL_ADDRESS>

This leaves the people who offer PRs without a run. This happened to me.

@olleolleolle ah, you mean on forks?

Since secrets are not passed to workflows that are triggered by a pull request from a fork anyway, looks like the best solution here is to:

port the secrets from the repo to the organization
then run CI on push only because of the Code Climate bug with PR runs I found trying to address #87.

Closing in favor of #88.

@olleolleolle I moved GOOGLE_MAPS_API_KEY to the FoveaCentral organization, but not the others (CC_TEST_REPORTER_ID and RUBYGEMS_AUTH_TOKEN) since they're repo-specific.
Because org/repo secrets can't be shared across organizations, there's no obvious way to get fork PRs to pass regardless of what workflow event you use. For this reason, I'm reverting CI to push.
If there's a good reason to run CI on pull requests instead, however, I have a workaround ready in #90, but note it skips test coverage entirely because there's an incompatibility with after-build and pull_request events, possibly having to do with differences in refs and SHAs. 🤷


Package request: opentf

Project description
OpenTF is a fork of Terraform, which is no longer under a free license (and should be marked as unfree for releases >= 1.6.0). This fork is from the free sources before the license change to a source-available BSL license.
Metadata

homepage URL: https://opentf.org/
source URL: https://github.com/opentffoundation/opentf
license: mpl
platforms: unix

cc some active maintainers of terraform: @marsam @zowoq @techknowlogick

Related issue: https://github.com/NixOS/nixpkgs/issues/253470

I think it would be a good idea to wait for it to be actually named, see https://github.com/opentffoundation/opentf/issues/296.

https://www.theregister.com/2023/09/20/terraform_fork_opentf_opentofu/

Pull request has been opened, if the current Terraform maintainers are okay with it I can add them to the maintainers section of the new package. Otherwise more than happy to take responsibility for it.


[Feature Request] API Access for User Account Token

Currently we're using Drone.io to setup environments for use in building a wide array of applications using various stacks. The technology stacks we're using range from Go, Java, .NET Core, Python, JavaScript/Node.js and others. When we setup these environments, the entire ecosystem - from individual environments, user accounts, and related collateral - are spun up via an automated system created with Terraform, Bash, and some other tools. When these tools set everything up various pieces of state are passed from execution to execution to set all of these elements up. This automated part of the process has one huge feature we'd love to be able to have, to complete more automation around Drone.io. That feature is the ability at the API level to get a user account token so that we can take additional steps via the API as that user the user account token is assigned to.
NOTE: I did review Github Issue 1812, which was a somewhat similar yet tangential feature request. But I wanted to be specific that I'm looking for this capability to use Drone.io in an internal environment. It may still be in a public cloud service like AWS or GCP, but it wouldn't be accessible to Github or some of the other services. So a robot user account as referred in issue 1812 wouldn't really work for this, but this feature could prospective lend itself to building a robot feature as specified in issue 1812. As per the other comments too it looks like that request and this feature could be implemented in conjunction.
I've created this issue, not just to propose the feature but to see if it would be something that the Drone.io team would like to have added to the code base? If so, I'm happy to dive in and get code written to enable this and submit a PR, but wanted to check with the team to insure this is wanted or not.
Cheers,
@Adron

If you would like to automatically add users and generate keys for the purpose of automation, I would recommend interacting directly with the database to create the user.
This is the minimal statement required to insert a user
INSERT INTO users (
 user_login
,user_token
,user_secret
,user_expiry
,user_email
,user_avatar
,user_active
,user_admin
,user_hash
) values (?, '', '', '', '', '', true, false, ?)

The only two required fields (identified by the ?) are the user login (github username) and a random hash that is 32 characters long. The code for generating the has is here.
The random hash is used to sign the JWT token with the HS256 signing algorithm. Note that we use JWT because it is a standard with implementations in pretty much any language, which makes it very easy to generate drone tokens as long as you know the hash.
Note that the JWT token expects two claims:
{
  "text": "octocat",
  "type": "user"
}

This is an example token (invalid signature) that you can paste into jwt.io to get a feel for the token structure. You can use this website to create a valid drone token, provided you paste the user hash in the secret textbox.
eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ0eXBlIjoidXNlciIsInRleHQiOiJvY3RvY2F0In0.1PthkhwQquQqoyneGX72VtQ2SyIoZTdbnRqcBNxAtIE
So in summary it should be quite easy to automate the creation of user accounts and generate tokens during your setup process, but this will require a small amount of custom code. The general position I take on this sort of stuff is that we should be building external tools vs building capabilities into drone directly.
To that end perhaps this could just be automated with a script that is included in your automation script? Or perhaps this merits an official library or toolkit that can be used with various automation engines.
This is a sample Go program that should get you started
package main

import (
	"database/sql"
	"encoding/base32"
	"flag"
	"log"

	"github.com/dgrijalva/jwt-go"
	"github.com/gorilla/securecookie"
	_ "github.com/mattn/go-sqlite3"
)

func main() {
	var conn string
	var user string

	flag.StringVar(&conn, "conn", "", "database connection string")
	flag.StringVar(&user, "user", "", "username (i.e. octocat)")
	flag.Parse()

	hash := base32.StdEncoding.EncodeToString(
		securecookie.GenerateRandomKey(32),
	)

	db, err := sql.Open("sqlite3", conn)
	if err != nil {
		log.Fatal(err)
	}

	_, err = db.Exec(stmt, user, hash)
	if err != nil {
		log.Fatal(err)
	} else {
		log.Printf("user account created [%s]", user)
	}

	token := jwt.NewWithClaims(jwt.SigningMethodHS256, claims{
		StandardClaims: jwt.StandardClaims{},
		Type:           "user",
		Text:           user,
	})
	secret, err := token.SignedString([]byte(hash))
	if err != nil {
		log.Fatal(err)
	}

	log.Printf("user token generated [%s]", secret)
}

type claims struct {
	jwt.StandardClaims
	Type string `json:"type"`
	Text string `json:"text"`
}

const stmt = `
INSERT INTO users (
 user_login
,user_token
,user_secret
,user_expiry
,user_email
,user_avatar
,user_active
,user_admin
,user_hash
) values (?,'','','','','',true,false,?)
`

@bradrydzewski Is there any "guarantee" of stability for the user db table? I would love to write a Vault secret backend plug-in for drone service accounts using this method, but I don't want to maintain this if the table schema is likely to change often.

@tallpauley I do not expect we will ever off a guarantee of database stability since that is considered an internal implementation detail. We will instead strive for a guarantee of stability with the external facing integration points, including the yaml and REST API.
In terms of vault integration, you may be interested in our vault backend http://docs.drone.io/vault-secrets/

@bradrydzewski makes sense, I just thought I'd ask.
Yeah, not interested in Drone fetching vault secrets. Interested in Vault provisioning drone service accounts, but I think I'll drop this if there will be no stable way to interact with Drone directly to create service accounts. Sounds like the only supported solution for provisioning service accounts is creating the service accounts in the source control system.

Sounds like the only supported solution for provisioning service accounts is creating the service accounts in the source control system.

This is correct. For service accounts you would create a machine user in your source code management system (e.g. GitHub) and then register the machine user as a drone administrator, assuming administrative access is required.
The primary reason is that Drone does not have its own user management; it is delegated to the source code management system. So having a user account that is not linked to GitHub, for example, would be a paradigm shift for Drone.

@StevenACoffman if I understand your use case correctly, this is already supported by using secrets. You would provide a secret to your pipeline, which you could then use in your regression tests. If you have any questions, feel free to break this out into a separate thread in our support forum

We are going to be able to accommodate this use case upcoming release. You will be able to bootstrap the system with a user account (a real user, or a machine user) and you will be able to supply the user api token (if not, one is auto-generated). This token can then be used to make API calls.
DRONE_USER_CREATE=username:octocat,machine:false,admin:true,token:55f24eb3d61ef6ac5e83d550178638dc

implemented in 1.0.0-rc.1


Add squashfs-tools and node-compiler

Are these GUI or CLI apps? If CLI, perhaps they belong in scoop’s main bucket?

I don't think that they fit the criteria of the main bucket well. I don't know if they are so widely used.


QoL: Let the Talon cutscene in Hyrule Castle run "in-game" like Door of Time opening

This was a cutscene I forgot was technically "skipped" in OOTR by making it so there's no cutscene camera and Talon still runs away after talking to him once you've woken him up with the Chicken. This is ultimately SUPER minor, though.

Done in 369a662


Autocompletion for insert local file

This is a great extension! Thanks a lot!
Just wondering is there any easy way to insert a link to local file (kinda like orgroam)?

Hi!
Glad you are enjoying it.
I have not used org roam, so I am not sure exactly what you are referring to.
Yes it does try (although not perfectly yet) try to support intra file links to ids, headings, named blocks etc.
There are some commands for creating links from your caret on a heading.
There is a snippet for quick link creation.
I don't have auto complete support for cross file link creation, although that sounds quite doable given what we have to work with.
Can you help me understand the feature better?

Honestly backlinks are probably fairly easy to generate from your orgdir during the parse phase, the harder part to support in sublime is the visualization of those links. Emacs buffer and window management and narrowing make that much easier.

That said, i probably won't try to build the roam server for the moment but there is no reason for me not to put the link management and backlink view on my roadmap. Not sure when I would get to it unless someone wants to join me in this effort but it looks useful.

Thanks for the quick response!
I just feel that it's a little hard to input the file path manually and very easy to make mistakes.
I'm a newbie of org-mode and org-roam but I found the searching local file by TITLE and inserting the link automatically feature very useful.

It is definetly on the list. I have been using org roam now and its very slick. Better than org wiki.
We will see when I can get to some of this.

I am currently mid effort on a latex exporter. Once I need a break from that I will see about doing some of this.

It is definetly on the list. I have been using org roam now and its very slick. Better than org wiki.
We will see when I can get to some of this.

Great!

Thank you for contributing as well. This is great

I may move the feature into asettings.py so we can use that for the paths to tools like node and other interpreters if you have done a local install. Its a good idea.

1.2.21 Has a text command that will show a quick panel with files from your orgDirs
ALSO: Autocomplete has been turned on now and inside [[ It will try to give you a list of files to work with. the autocompletion system in ST3 is challenging. ST4 dynamic autocompletion should work better, we will see as it matures.

1.2.21 Has a text command that will show a quick panel with files from your orgDirs
ALSO: Autocomplete has been turned on now and inside [[ It will try to give you a list of files to work with. the autocompletion system in ST3 is challenging. ST4 dynamic autocompletion should work better, we will see as it matures.

Wow! That's great. IMO It will better to insert the link as a relative path rather than an absolute path. I'll also take a look at this when I get time.
BTW, do you have any plan to apply PEP8 rules? I can submit a PR  for this later maybe.

Hmm,
I am not a fan of autoformatting and I also tend to work on wide screen monitors and use golden ratio mode so I dont have a problem with long lines.
I think I will avoid pep8.

I see.

Back references is still on the backlog as well as some of the other roam fun. We will see when there might be time to look into some of that.
At the moment the files are full paths. I took the expedient root for the moment. Feel free to tweek that if relative paths are important.

I use multiple machines with different user accounts so it's kind of necessary to me. I will take a look at it later.

Makes sense.

Happy for you to clean that up.
Heck, I cheated and just bolted the autocomplete functionality onto the table ViewEventListener so I could get something out tonight. :) I need to go back and generalize that piece. I think I have 2 ViewEventListeners now and I only need 1, so I have a bit of cleanup to do there.
Sooo many things I want to implement and so little time. :)

Currently, the new code inserts (tag) TITLE as link description. Is that on purpose? Or is it OK to change to TITLE? I personally prefer the latter one.

That seems like a good thing to make open to personal prefefence.

Feel free to join the group on discord if you want.
https://discord.gg/DW2kDDm2
Just a place to chat about the plugin with those interested in contributing


Doesn't update dynamically when depending on a BelongsTo field

When depending on a BelongsTo field on initial page load everything is calculated correctly, but then when the field changes nothing happens. I did test with a Select field and it worked fine with that.
I would guess that perhaps something is different with the BelongsTo Vue component compared to the other "standard" components?

Check out #21

You should add HasDependencies trait to the nova Resource which uses NovaDependencyContainer

I solved this in my app by adding use HasDependencies; to the Nova Resource loading the NovaDependencyContainer field.

The component rely on value data attribute to check if dependency is satisfied. The BelongsToField component does not have a value but has a selectedResourceId data attribute.

Fixes in #77


Environmental settings

could u please tell me what is the runtime environment required to run tbiformer for image classification tasks， bsc I don't see in the readme, such as torch python, etc，Looking forward to your reply soon

https://github.com/rayleizhu/BiFormer/blob/public_release/INSTALL.md
https://github.com/rayleizhu/BiFormer/blob/public_release/environment.yaml


Remove irrelevant test shards on docs/ changes

Part of https://github.com/flutter/flutter/issues/145009
Follow up to https://github.com/flutter/flutter/pull/148999
The new docs/ directory does not need to have build or customer tests run on it.
There is no don't-run-if-only-this-path-is-changed, so the runIf on these shards contains everything but the docs we don't wan them to run on.
Happy to tweak if we want to refine this for other areas we don't need to run these shards on.
Pre-launch Checklist

[x] I read the Contributor Guide and followed the process outlined there for submitting PRs.
[x] I read the Tree Hygiene wiki page, which explains my responsibilities.
[x] I read and followed the Flutter Style Guide, including Features we expect every widget to implement.
[x] I signed the CLA.
[x] I listed at least one issue that this PR fixes in the description above.
[x] I updated/added relevant documentation (doc comments with ///).
[x] I added new tests to check the change I am making, or this PR is test-exempt.
[x] I followed the breaking change policy and added Data Driven Fixes where supported.
[x] All existing and new tests are passing.

If you need help, consider asking for advice on the #hackers-new channel on Discord.

I am going to close this based on the above comments, we can revisit if the extra test shards become a nuisance for  docs-only changes


The entry '*' has already been added. ServiceBusExplorer.exe.config

For some reason I wasn't able to access to any Azure service bus via connection string, and it was complaining

Then I figured out that it is my host app config has already have this entry added due to whatever reason, so what I have done to work around it is to add clear before the add like below

I think it would be good to have it in app.config by default to avoid any conflict, I can create a pull request if you think it is okay?
commit

I'd rather see this achieved via code and not configuration.
ServicePointManager.DefaultConnectionLimit can be used to have more than 2 HTTP connections.

Good idea, since it has less configure to manage, here is the change


Tuning

I was testing that stack and came arround the issue that prometheus run out of memory.
My Server "just" got 2Gigs of, so i added:
- '-storage.local.memory-chunks=250000'
to the start command of the prometheus container to limit the memory consumation.
BR

Right, that makes a lot of sense! Would you like to PR?

https://github.com/uschtwill/docker_monitoring_logging_alerting/pull/13


allowed_children_cache too small

Hi,
running https://github.com/radiant/radiant/blob/master/db/migrate/20110902203823_add_allowed_children_cache_to_pages.rb on an IBM DB2 database fails for some setups: The string that will be saved in the new column easily exceeds 255 chars. The IBM DB ActiveRecord adapter turns "string" into "VARCHAR(255)". So I think we should add a sensible ":limit" option, maybe 1000 or 1500. What do you think?

Johannes

+1
I'm sorry I didn't think about this when I implemented it.

No problem :)


Update docker image to python 3.12

@dionhaefner yes good idea

@dionhaefner Unfortunately we dont  have dockerhub account and it seems it will take some time to create one. I will add the CI once we have it. I am de-drafting so you can merge if it looks good to you too

Oh I forgot that DockerHub isn't free anymore. Let's merge this first, but testing the image build on CI could be valuable too, to ensure nothing breaks. I'll add an issue for that.


Make metadata a obligatory requirement

I'm not sure if this is the correct place for this issue.
As far as i recall, we decided, that metadata should be a prerequisite before transmitting data over WIS2. Somehow this requirement should be enforced. Following the discussions here
https://github.com/wmo-im/wis2-notification-message/issues/25
and here
https://github.com/wmo-im/wis2-notification-message/pull/31
i currently don't see a place in the protocol / message flow, where we can check if metadata is available.
We either need to decide at which place we can put such a check, or we need to agree, that we live with a strong requirement for metadata potentially allowing for data without metadata.
cc: @golfvert @antje-s @josusky @tomkralidis

My view is that we state it as a strong requirement, rather than force Global Services to check before doing anything.
I think this is OK because if there's no discovery metadata, data consumers won't be able to find the data or where to subscribe to notifications about the data. Yes - I admit that some people are likely to guess (by which I mean, browse the topic hierarchy on their favourite Global Broker), or simply benefit from using wild-cards in their subscription (which means they would get data that they don't have any information about).
I suggest we mitigate this problem via the Global Monitor, e.g., doing a consistency check of looking for the discovery metadata associated with a notification message, and publishing an alert if there's a failure. Alert should be visible on the dashboard and directly notifying the originating WIS2node.
Aside: how do alerts get pushed back to the originating WIS2node?

Decision
To be implemented by GBs by Q3 2024

It will be enforced on Oct. 1st 2024. One quarter before the end of the pre-operational phase.

@6a6d74 (Jeremy) to make sure the Guide text is updated to reflect the decision.

@tomkralidis does this change the requirement in WNM from "SHOULD provide.." to "SHALL provide.." a metadata_id?

@amilan17 we are keeping as an option (and SHOULD in WCMP2 proper) to facilitate data publication until 01 October 2024 as agreed at the W2AT November meeting in Washington.

If I remember correctly, discovery medata is a requirement BEFORE exchanging data. So why not make the reference to the metadata identifier a requirement in the WNM too?

Guide now states that discovery metadata must be published before data is exchanged. See PR #116


ffe-tab-button--selected shoud include aria-pressed=true

ffe-tab-button--selected shoud include aria-pressed=true, to ensure current state is communicated.

This issue should be closed as PR #617 is merged


[Feature]: Add a refresh button in tables

Is there an existing issue for this?

[X] I have searched the existing issues

Summary
Allow our devs to add a refresh button in tables to give their end users the capability to refresh the data.
Why should this be worked on?
This helps our devs simplify the refresh experience rather than adding a new refresh button on the UI and configuring.

@dilippitchika We have a similar request from long before #3247
@Nikhil-Nandagopal before you were against similar behaviour (somewhat), can you please comment on the above feature as well?


Multiple item Settings are not available on Android

Godot version
4.x
System information
Android
Issue description
The bug covers a wide range of issues, including the fact that you can't adjust debug window mode or size on Android, both of which are disabled, Forward+ rendering won't work, TAA, version control and volume fog won't work. In that case, why not just move it out like Android Export? Also, I don't know how many debugging Settings are useless on Android (and there are a lot of them) and they need a lot of testing to make sure they work on Android.
Steps to reproduce
null
Minimal reproduction project
null

including the fact that you can't adjust debug window mode or size on Android,

While floating windows exist, mobile OSes do not have a concept of window mode or size that applications can adjust themselves. Window mode and size is entirely left to the user running the application.

Forward+ rendering won't work, TAA, version control and volume fog won't work.

These are expected not to work on mobile, since TAA and volumetric fog aren't implemented in the Forward Mobile rendering method (and won't be due to performance requirements).

These settings are not hidden entirely because you may want to enable them while on Android, commit your project to version control then have TAA/volumetric fog enabled on desktop.

I think another solution is needed for this case... because having settings that are expected to NOT work is a... weird thing to say the least

That's true... The recent update of godot makes me feel a little confused. Some desired functions have been deleted and some unusable functions have been retained in the Settings list. I wonder what functions will be changed officially for the next version. (I really hope to add the function of mobile terminal export, an engine can not export, can also be called an engine? By the way... It seems that some mobile games support TAA recently, which may have something to do with their underlying optimization.)

That's true... The recent update of godot makes me feel a little confused. Some desired functions have been deleted and some unusable functions have been retained in the Settings list. I wonder what functions will be changed officially for the next version. (I really hope to add the function of mobile terminal export, an engine can not export, can also be called an engine? By the way... It seems that some mobile games support TAA recently, which may have something to do with their underlying optimization.)

That's true... The recent update of godot makes me feel a little confused. Some desired functions have been deleted and some unusable functions have been retained in the Settings list. I wonder what functions will be changed officially for the next version. (I really hope to add the function of mobile terminal export, an engine can not export, can also be called an engine? By the way... It seems that some mobile games support TAA recently, which may have something to do with their underlying optimization.)

Why close? It hasn't been solved in any way yet

Because it seems like I just need to adjust the engine renderer override option on the phone like this, and I can see that the engine is not reporting any errors

Maybe I should open it again? What do you think?

The fact that you found a workaround for your specific problem doesn't change  the fact that having settings display but be expected not to work is downright weird.


-login- already exists. Try again:

Hi team
Following an update (I am not sure which), whenever I try and run one of my scripts, I get the error:
-login- already exists. Try again:
Found value.data

Enter a name for your script's // Name: metadata

It then creates a -login-.ts file and fails
I also try the 'Edit` option for the scripts and get the same error.
Any ideas?
I have tried removing and re-installing.
Many thanks in advance!

@asos-danielc Check your script for any "// Foo: " comments that might be accidentally parsed as metadata. We had a similar issue where someone had a "// value: bar" which was incorrectly submitting "bar" because the metadata parser being too aggressive.

Thanks @johnlindquist ... this kinda fixed the problem, but think there are follow up issues. It seems like a number of my scripts now are not quite "compatible".
Not sure if it is comment related, but I am moving my scripts back in one by one. One in particular now is causing script kit to hang, but I can't see a log for that script being generated

@asos-danielc Can you share the script that causes the hang?
One thing to watch for in particular, if script runs to the end, it will be automatically closed to prevent and zombies scripts hanging around.
So if something is async, and it's not wrapped in an async/await or script event listener, it's possible that script is terminating before the async stuff fires

I am not yet able to dive into the last issue I mentioned but I am back up and running in general, therefore lets close this issue!
Huge thanks on your quick support!


Inbox Empty

**RainLoop version:  1.14.0, browser: firefox , OS: debian 10 buster **
Expected behavior and actual behavior:
Clean Install ( from this site : https://www.tecmint.com/install-postfix-mail-server-with-webmail-in-debian/ )
I can send and receive mail ( new mail are stored in ~/Maildir/cur/ )
But with rainloop, I can not see mail mails. Only Sent Mail , not received mail .
Steps to reproduce the problem:
You can try to connect to http://webmail.ethicit.fr , login kevin / kevin.
Try to send mail , it wroks, buit I can not see them with rainloop , but I can see them on may server .
Logs or screenshots:

Here is the log :
[09:29:28.920][886bb85f] INFO[DATA]: [DATE:16.09.20][OFFSET:-00][RL:1.14.0][PHP:7.3.19-1~deb10u1][IP:<IP_ADDRESS>][PID:14301][Apache/2.4.38 (Debian)][apache2handler]
[09:29:28.920][886bb85f] INFO[DATA]: [Suhosin:off][APC:off][MB:off][PDO:~][Streams:tcp,udp,unix,udg,ssl,tls,tlsv1.0,tlsv1.1,tlsv1.2]
[09:29:28.920][886bb85f] REQUEST[NOTE]: [POST] http://webmail.ethicit.fr/?/Ajax/&q[]=/_gYtdZpnD3shuUIA7arm2Jl3K9bdiRvGl2cwe6JG79hdxB60sBGfEYB6Iu54Iu5YRx2sLXFhtPb9bkit20r2iCsBhl2cBn42YSwwTp4uLnCm0WruyL9Fce1KLZx7LkBcblbX3S44btps2xsI3EkoeTSbLpTjQb6OOQC2xG-GDPWhsZQRhtFTwppPkijwOTwNuOc5S7aFlxx9mSm4VRFDfA_eQeWb98C7zjnIYa4TWcex__MllkTVN9pUyPFffShw1qhtjWN__NfVIYpur-P7xOVVwF101vcjoKEpNOhK1nciZDlEmrokEQtSyJFzMJJKxi4jHjGJzarMi5Oa6/
[09:29:28.920][886bb85f] AJAX[NOTE]: Action: DoMessageList
[09:29:28.920][886bb85f] POST[DATA]: {"Folder":"INBOX","Offset":"0","Limit":"20","Search":"","UidNext":"1","UseThreads":"0","ThreadUid":"","Action":"MessageList","XToken":"16ec96a125c6660ea357385c9e9ccf3d"}
[09:29:28.921][886bb85f] IMAP[NOTE]: Start connection to "tcp://<IP_ADDRESS>:143"
[09:29:28.921][886bb85f] IMAP[NOTE]: Connected (success)
[09:29:28.927][886bb85f] IMAP[DATA]: < * OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS AUTH=PLAIN] Dovecot (Debian) ready.\r\n
[09:29:28.927][886bb85f] IMAP[DATA]: > TAG1 AUTHENTICATE PLAIN\r\n
[09:29:28.928][886bb85f] IMAP[DATA]: < + \r\n
[09:29:28.928][886bb85f] IMAP[SECURE]: > *******\r\n
[09:29:28.942][886bb85f] IMAP[DATA]: < TAG1 OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY LITERAL+ NOTIFY SPECIAL-USE] Logged in\r\n
[09:29:28.943][886bb85f] IMAP[DATA]: > TAG2 SELECT "INBOX"\r\n
[09:29:28.943][886bb85f] IMAP[DATA]: < * FLAGS (\Answered \Flagged \Deleted \Seen \Draft)\r\n
[09:29:28.944][886bb85f] IMAP[DATA]: < * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted.\r\n
[09:29:28.944][886bb85f] IMAP[DATA]: < * 0 EXISTS\r\n
[09:29:28.944][886bb85f] IMAP[DATA]: < * 0 RECENT\r\n
[09:29:28.944][886bb85f] IMAP[DATA]: < * OK [UIDVALIDITY<PHONE_NUMBER>] UIDs valid\r\n
[09:29:28.944][886bb85f] IMAP[DATA]: < * OK [UIDNEXT 1] Predicted next UID\r\n
[09:29:28.944][886bb85f] IMAP[DATA]: < * OK [HIGHESTMODSEQ 1] Highest\r\n
[09:29:28.944][886bb85f] IMAP[DATA]: < TAG2 OK [READ-WRITE] Select completed (0.001 + 0.000 secs).\r\n
[09:29:28.944][886bb85f] IMAP[DATA]: > TAG3 CAPABILITY\r\n
[09:29:28.944][886bb85f] IMAP[DATA]: < * CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY LITERAL+ NOTIFY SPECIAL-USE\r\n
[09:29:28.944][886bb85f] IMAP[DATA]: < TAG3 OK Capability completed (0.001 + 0.000 secs).\r\n
[09:29:28.944][886bb85f] IMAP[DATA]: > TAG4 STATUS "INBOX" (MESSAGES UNSEEN UIDNEXT HIGHESTMODSEQ)\r\n
[09:29:28.945][886bb85f] IMAP[DATA]: < * OK [HIGHESTMODSEQ 1] Highest\r\n
[09:29:28.945][886bb85f] IMAP[DATA]: < * STATUS INBOX (MESSAGES 0 UIDNEXT 1 UNSEEN 0 HIGHESTMODSEQ 1)\r\n
[09:29:28.945][886bb85f] IMAP[DATA]: < TAG4 OK [CLIENTBUG] Status on selected mailbox completed (0.001 + 0.000 secs).\r\n
[09:29:28.945][886bb85f] AJAX[DATA]: {"Action":"MessageList","Result":{"@Object":"Collection\/MessageCollection","@Count":0,"@Collection":[],"MessageCount":0,"MessageUnseenCount":0,"MessageResultCount":0,"Folder":"INBOX","FolderHash":"dd6d85fb0e926bf7b9f83ba32c7f638e","UidNext":"1","ThreadUid":"","NewMessages":[],"Filtered":false,"Offs...
[09:29:28.945][886bb85f] IMAP[DATA]: > TAG5 LOGOUT\r\n
[09:29:28.945][886bb85f] IMAP[DATA]: < * BYE Logging out\r\n
[09:29:28.946][886bb85f] IMAP[DATA]: < TAG5 OK Logout completed (0.001 + 0.000 secs).\r\n
[09:29:28.946][886bb85f] IMAP[NOTE]: Disconnected from "tcp://<IP_ADDRESS>:143" (success)
[09:29:28.946][886bb85f] INFO[MEMORY]: Memory peak usage: 2MB
[09:29:28.946][886bb85f] INFO[TIME]: Time delta: 0.036965131759644

R T F M !
I had 2 lines in my conf.d/10-mail.conf :
mail_location = maildir:~/Maildir
mail_location = mbox:~/mail:INBOX=/var/mail/%u
Sorry for disturb


ENH: Track new_build.sh in a scripts/ folder

Description
Quick and simple change to the .gitignore

Done with https://github.com/Jython1415/zolltools/commit/e3a272abc984f927835827547b02c3b97a61acfe


Critical sections

Reported by beutlich on 21 Aug 2014 11:49 UTC
Critical sections in C code of ModelicaInternal.c and ModelicaStandardTable.c need to be fixed since currently only write access to shared static variables is guarded.

Migrated-From: https://trac.modelica.org/Modelica/ticket/1556

Comment by beutlich on 22 Aug 2014 09:27 UTC
Resolved by 843e06e0fa77bdf07a77add24a44c3a2c35d6020 (Trunk) and b0813b02b2cc3c6cd199e587e6296c9b05b2be03 (3.2.1 Maint.).

Changelog modified by beutlich on 22 Aug 2014 09:27 UTC
Fixed multi-threaded access of global variables in C-Sources

Modified by beutlich on 15 May 2015 06:09 UTC

Modified by beutlich on 15 May 2015 06:19 UTC

Comment by beutlich on 15 May 2015 14:41 UTC
Sorry, I was wrong here. Read access of tables is already guarded by having the reference counter > 0.


[CLI]: yolov5 artifacts uploading issue

Describe the bug

I followed up the youtube tutorial https://www.youtube.com/watch?v=a9Bre0YJ8L8&t=878s,
and I was going to upload my own labeled dataset.
When I proceeded to the step of running the upload dataset command, it came up with an error below.
If there is any way I can deal with it?

E:\個人資料\Hank9938\專題yolo訓練資料\yolov5-master>python utils/loggers/wandb/log_dataset.py --project custom_yolov5 --data data/custom_dataset.yaml

Traceback (most recent call last):
  File "E:\個人資料\Hank9938\專題yolo訓練資料\yolov5-master\utils\loggers\wandb\log_dataset.py", line 27, in <module>
    create_dataset_artifact(opt)
  File "E:\個人資料\Hank9938\專題yolo訓練資料\yolov5-master\utils\loggers\wandb\log_dataset.py", line 11, in create_dataset_artifact
    logger = WandbLogger(opt, None, job_type='Dataset Creation')  # TODO: return value unused
  File "E:\個人資料\Hank9938\專題yolo訓練資料\yolov5-master\utils\loggers\wandb\wandb_utils.py", line 136, in __init__
    if opt.upload_dataset:
AttributeError: 'Namespace' object has no attribute 'upload_dataset'

Additional Files

Environment
WandB version:0.13.4
OS:windows
Python version:3.9
Versions of relevant libraries: pytorch1.12.1
Additional Context
No response

Hi @hank9938 , thank you for writing in with your question. I was able to replicate the issue on my end. It appears the upload_dataset flag was recently disabled, see here. I will need to dig into this further to determine why the change was made.

Hello! I am wondering if the problem has been solved yet?
Thank you for being patient with me.

Hi @hank9938 , we have temporarily disabled the upload_dataset flag due to it leading to a serialization error for the evaluation table to be stored as a Weights & BIases Artifact. We will re-enable the flag once we fix the bug.

Thanks for your quick response. But is there any other way I can upload my dataset not by cmd and still get a yaml for tarining? Metting the deadline of my small project, I have to decide whether to switch to another training platform and give up wandb.

Hi @hank9938, Thank you for your patience. We will look into this issue in the coming week and you can expect a fix in about 2 weeks time.


Domain Adaptation with MMD in subsection 3.2.2

You did additional experiments with MMD loss instead of associative loss. Can you explain a  bit more how you implemented MMD loss in your architecture?

This is the graphs for SVHN → MNIST that I got. So what is the accuracy for  SVHN → MNIST? Is it 99.99%?

Hi @deep0learning,
Here is the implementation of the MMD loss.
For further details (in particular the source), please have a look at Section 3.2.2 of the paper.
With regard to your plots, there is no evaluation data. Please run eval.py with the respective flags in order to evaluate the model.
I hope this is helpful.
Philip

@haeusser Thank you so much.
mkdir /home/ubuntu/datasets/;
mkdir /home/ubuntu/datasets/svhn/;
mkdir /home/ubuntu/datasets/mnist/;
wget http://ufldl.stanford.edu/housenumbers/test_32x32.mat -O /home/ubuntu/datasets/svhn/test_32x32.mat;
wget http://ufldl.stanford.edu/housenumbers/train_32x32.mat -O /home/ubuntu/datasets/svhn/train_32x32.mat;
wget http://yann.lecun.com/exdb/mnist/train-images-idx3-ubyte.gz -O /home/ubuntu/datasets/mnist/train-images-idx3-ubyte.gz;
wget http://yann.lecun.com/exdb/mnist/train-labels-idx1-ubyte.gz -O /home/ubuntu/datasets/mnist/train-labels-idx1-ubyte.gz;
wget http://yann.lecun.com/exdb/mnist/t10k-images-idx3-ubyte.gz -O /home/ubuntu/datasets/mnist/t10k-images-idx3-ubyte.gz;
wget http://yann.lecun.com/exdb/mnist/t10k-labels-idx1-ubyte.gz -O /home/ubuntu/datasets/mnist/t10k-labels-idx1-ubyte.gz;
python semisup/train.py
--target_dataset="mnist3"
--walker_weight_envelope_delay=500
--new_size=32
--dataset="svhn"
--sup_per_batch=100
--decay_steps=9000
--unsup_batch_size=1000
--sup_per_class=-1
--walker_weight_envelope_steps=1
--walker_weight_envelope="linear"
--visit_weight_envelope="linear"
--architecture="svhn_model"
--visit_weight=0.2
--max_steps=12000
--logdir=./log/svhn_to_mnist/reproduce
And eval script:
python semisup/eval.py
--target_dataset="mnist3"
--walker_weight_envelope_delay=500
--new_size=32
--dataset="svhn"
--sup_per_batch=100
--decay_steps=9000
--unsup_batch_size=1000
--sup_per_class=-1
--walker_weight_envelope_steps=1
--walker_weight_envelope="linear"
--visit_weight_envelope="linear"
--architecture="svhn_model"
--visit_weight=0.2
--max_steps=12000
--logdir=./log/svhn_to_mnist/reproduce
But get the results. Am I doing anything wrong?

When I run evaluate script it gives me this error:
INFO:tensorflow:Timed-out waiting for a checkpoint.

The script does domain adaptation once you define the flag target_dataset.
Regarding the evaluation problem, please see my response to your post in issue 3.

By running this code, I am getting the following results:  Test error: 90.20 % for SVHN -> MNSIT. So what is the accuracy for SVHN -> MNSIT ?? Is it  100 - 90.20 = 9.80 % ???
python semisup/mnist_train_eval.py
--target_dataset="mnist3"
--walker_weight_envelope_delay=500
--new_size=32
--dataset="svhn"
--sup_per_batch=100
--decay_steps=9000
--unsup_batch_size=1000
--sup_per_class=-1
--walker_weight_envelope_steps=1
--walker_weight_envelope="linear"
--visit_weight_envelope="linear"
--architecture="svhn_model"
--visit_weight=0.2
--max_steps=12000
--logdir=/media/mahfuj/DATA/New_CODE/Working/learning_by_association/log/svhn_to_mnist/reproduce1

Thank you so much. Now It's working now.

I am running the scrpts and get the results. It seems that SVHN->MNIST: 99.87% accuracy. Is it??
In your paper it is: 93.71%.
python semisup/train.py
--target_dataset="mnist3"
--walker_weight_envelope_delay=500
--new_size=32
--dataset="svhn"
--sup_per_batch=100
--decay_steps=9000
--unsup_batch_size=1000
--sup_per_class=-1
--walker_weight_envelope_steps=1
--walker_weight_envelope="linear"
--visit_weight_envelope="linear"
--architecture="svhn_model"
--visit_weight=0.2
--max_steps=12000
--logdir=./log/svhn_to_mnist/reproduce
And eval script:
python semisup/eval.py
--target_dataset="mnist3"
--walker_weight_envelope_delay=500
--new_size=32
--dataset="svhn"
--sup_per_batch=100
--decay_steps=9000
--unsup_batch_size=1000
--sup_per_class=-1
--walker_weight_envelope_steps=1
--walker_weight_envelope="linear"
--visit_weight_envelope="linear"
--architecture="svhn_model"
--visit_weight=0.2
--max_steps=12000
--logdir=./log/svhn_to_mnist/reproduce

Our reported accuracy is 97.6%. The number in parentheses is the improvement over the „source only“ trained model (cf. table caption for a longer explanation).
Depending on the initialization, you might obtain better results than what we reported in the paper, which is the mean of 10 runs.
If not, congrats - you got the new state of the art :-)

@haeusser Thank you so much for your kind reply.
Actually, when I was run the code with MMD loss I got also 99.90 Accuracy. I am sure that I did some mistake. That's why I would like to know is there anything that I need to change in the code in eval.py or train.py script.
In eval.py, In line 39: Is is ok? Or I have to write down mnist3 as my target data is mnist3 in this experiment. Please give me answer. Thanks again for your kind help.
flags.DEFINE_string('dataset', 'svhn', 'Which dataset to work on.')


Add ARIA annotation

http://mathiasbynens.be/notes/html5-details-jquery#comment-7

@stevefaulkner suggested the following:

I have detailed an example implementation: HTML to Platform Accessibility APIs Implementation Guide. Corresponding ARIA attributes: to the summary element add a role="button" making sure the keyboard behaviour associated with buttons is added i.e. focusable, enter or space activates the button) and aria-expanded="true/false" the states corresponding to the absence/presence of open attribute on details (note: aria-expanded is on the summary not the details), that’s it.


[CNOID] Consider python version in cnoid file

Fixes for #17

@ThomasDuvinage
Is the work on this Pull Request complete? It would be helpful if you could provide a comprehensive description of the conditions for using this patch (e.g., special branch installation required by Choreonoid, etc.).


Tips to improve translation.

Tips to improve translation.
For Video YouTube: ¡Bienvenidos a Extraordinerd!
Audio

Result Run Script Autosub
Results: Very BAD

Methods Improve Translation..
Method 1 : Trim/Crop
Crop video, 10 seconds Audio.

Results:
Speech: Medium
Timing: Good

Method 2 Silence noise
Silence Audio (Noise,music, etc.)

Observations: The best method, but it requires a long time to identify the sounds, voices, ambient noise.
Results: Very good

Method 3 Use Filters
Use Filters of FFmpeg, loudnorm or dynaudnorm
ffmpeg -i myvideo.mp4 -af loudnorm=i=-5 myvideoFilter.wav

Results: Very good

Observations: It requires a special compilation of ffmpeg, but can be downloaded from here.
Method 4 Change threshold
Modify the script, and Zero the value of threshold=0

Observations:this case, it worked like that with the filter, but it is not always so. LOST TOTAL TIMING.
Notes
Note 1 : For speed, the audio must be converted to mono and frequency to 16000
Note 2 : For methods 2 to 4, the script could not identify the silences, so cutting it done automatically at 6.1 seconds (min_region_size = 0.5, max_region_size = 6)

@ JeanDown123
This is very nice. Can it be possible to automatize method 3? For example:

Automatize filtering and pass subtitles to a script simular to autosub-mpv.

Make subtitles and pass it to a subtitle editor

What about non-windows users? How can that "special FFmpeg" be able to have in other operating systems?

Thanks for doing all this work, @JeanDown123. I'll try to incorporate the filtering to autosub shortly.

I too am playing with filters and your program.  I notice that in the extract_audio function the audio is down mixed to mono.  I found that by applying the filter to help eliminate phase errors before the down mix, the resulting audio was higher quality and resulted in more text being converted from the file.
See: https://trac.ffmpeg.org/wiki/AudioChannelManipulation
A small problem with this filter, is sometimes (for some reason i can't work out) that filter causes ffmpeg to crash, in which case I just fall back to a straight conversion to mono with no phase correction.
Also, filtering ambient noise using the tips from: https://manerosss.wordpress.com/2017/07/24/ffmpeg-·-apply-a-filter-to-enhance-voice-by-removing-low-and-high-frequency-noises/
Improved word recognition.  More words in my samples were recognised, and the translations made more sense, generally.
Finally I then used the tool: ffmpeg-normalize to do an automatic normalisation, as in Method 3 above.
Using all three methods in this order resulted in a significant increase in detected words, and translation accuracy.

@stevenj Hi Steven, can you please share some of your configs ? Thanks!

@GunGunGun Here is the script I am currently using to automatically filter the audio and then generate the subtitles.  If you come up with any improvements, let me know.
https://gist.github.com/stevenj/4a4af2723c1c4aa6898bbaf8d8a6ec69
You will also need this tool:
https://github.com/slhck/ffmpeg-normalize

Thank you for the tips @JeanDown123
Thank you too @stevenj ! Is it possible to share your script again? The link don't work 😞

Thank you for the tips @JeanDown123
Thank you too @stevenj ! Is it possible to share your script again? The link don't work 😞

@Wineliva I found the scripts here. Perhaps it's what you need.

@Wineliva Yes the link shared by @BingLingGroup is the one i use.

@Wineliva @stevenj
I just write the pre-process script into the autosub codes. Now you can pre-process the audio directly from my version of autosub.
Default pre-process commands need ffmpeg-normalize. Of course you can write it youself by using the -apc input options. But remember to set pre-processing output format to 44.kHz/24bit/mono flac. Currently I don't write the logic to judge the format. It will be used directly by speech-to-text method. And when that method cut the clips, it use copy arg so it is very risky when your format isn't proper.
You can install it from my repo by using pip. Or wait for me to release. I write pretty some features now. I think I will release it in a few more days.

Thank you for the tips @JeanDown123
Thank you too @stevenj ! Is it possible to share your script again? The link don't work 😞

Finally, I release a standalone version. You can check it here.


Query workout classes by parameter

[.feature file] TODO
End points: GET
Parameters: startTime, location, instructor
Response: List of workout classes in JSON format
User story: TODO

Get workout by id, name, instructor done.


Add a gpg rule.

I'm not super happy with the implementation - ideally we could reference the GPG key url as a WORKSPACE dependency, but I'm not sure how to pass that file into the image so that apt-key add can reference it.
Any ideas?
cc @xingao267

In my very hacky fork, I add the keys using the public key hex string. https://github.com/xingao267/base-images-docker/commit/c6dfaf50aba1e3751ddbb51c16b5683942045058. This does not require install curl, or other tools. If we need to execute a command, and commit to the image anyway, maybe we can consider that approach?

In my very hacky fork, I add the keys using the public key hex string. xingao267/base-images-docker@c6dfaf5. This does not require install curl, or other tools. If we need to execute a command, and commit to the image anyway, maybe we can consider that approach?

That looks pretty cool! Any idea how to generate the hex keys for something like bazel's repo, given the instructions here? https://docs.bazel.build/versions/master/install-ubuntu.html

For bazel, I found their public key in their GitHub release page https://github.com/bazelbuild/bazel/releases. "Security: All our binaries are signed with our public key 48457EE0."
For other repos, (for example, the launchpad openjdk repo I'm using), I found the public key missing from the error message (if the key is not installed in the image) like the following:
W: GPG error: http://ppa.launchpad.net trusty InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY EB9B1D8886F44E2A

I'm not sure exactly the relationship between the very long pgp public key and the short public key string (how one can be generated from the other). But you can look them up like this http://keyserver.ubuntu.com/pks/lookup?op=get&fingerprint=on&search=0xEB9B1D8886F44E2A


[api-spec] [rancher-catalog-service] Missing collectionFilters

Steps to Reproduce:
Browse to http://{CATTLE_IP}:8080/v1-catalog/schemas/, there is no collectionFilters field specified.
From UI, a sample request: http://{CATTLE_IP}:8080/v1-catalog/templates?category_ne=system&catalogId=test-np-catalog&minimumRancherVersion_lte=v1.4.0&maximumRancherVersion_gte=v1.4.0
The different fields of the template resource have filtering capabilities, but it's not exposed in the schema. This makes it hard to discover what filtering capabilities are available for the resources, because of which the REST client in the browser doesn't show "Filter" options.
Results:
Expect the API to be consistent.

With the release of Rancher 2.0, development on v1.6 is only limited to critical bug fixes and security patches.


Ionic compatible plugin

Last time I checked the ionic-plugin-firebase wasn't compatible with this librairy. The API is slightly different from cordova-plugin-firebase if I remember well...
Is there by any chance anyone working on one?

@millerf this plugin as an updated version forked from the cordova-plugin-firebase. Use this plugin instead of the cordova-plugin-firebase. cheers

@robingiel I was talking about the ionic wrapper.
ionic-native/firebase
I am not sure firebasex is a "plug and play" replacement...

Nevermind. I just read that and it answers my question:
Ionic 4 and firebasex


Only set logging settings once

In preparation for the 1.28 upgrade (https://github.com/cert-manager/cert-manager/pull/6287), we have to fix an issue with loading the logging options from flags & configfile.
Currently, we set the logging options based on the config in the flags & re-set the options after we parsed the configfile. This is done so we can use the logging settings from the flags while parsing the config file.
In 1.28 however, the logging library has become a bit more strict & does no longer allow re-setting the logging options.
Pull Request Motivation

Kind
/kind cleanup
Release Note
NONE

/unhold


Commands in handler

Are the commands after getting meterpreter session are limited in this code? Or it's the general issue in the handler. I am not able to run ls or pwd or any commands other than read , uid things like that

@neo241091 There is no limitation on Android meterpreter but remember that you are getting access to the android system in the context of the backdoor'd application. Here's an example using Adobe Reader:
meterpreter > sysinfo
Computer    : localhost
OS          : Android 4.4.2 - Linux 3.4.67+ (i686)
Meterpreter : java/android
meterpreter > getuid
Server username: u0_a56
meterpreter > pwd
/data/data/com.adobe.reader/files
meterpreter > ls
Listing: /data/data/com.adobe.reader/files
==========================================

Mode             Size  Type  Last modified              Name
----             ----  ----  -------------              ----
40666/rw-rw-rw-  4096  dir   2016-10-04 17:01:58 -0400  Temp

meterpreter >
``

Keep in mind that even on a rooted device your access will be limited. Still need a local privilege escalation exploit to get root on the device.


[again know issue] how to removed Unknown manufacturer 0xXXXX	0xXXXX corpse nodes ?

Checklist

[X]  I am not using Home Assistant. Or: a developer has told me to come here.
[X] I have checked the troubleshooting section and my problem is not described there.
[X] I have read the changelog and my problem is not mentioned there.

Deploy method
Docker
Z-Wave JS UI version
<IP_ADDRESS>07bd8
ZwaveJS version
11.9.2
Describe the bug
I have started with absolutely clean docker installation. Z-Wave JS UI never ran on this machine before, so there is absolutely zero chance, that two 0xXXXX nodes would be as corpses from other installations.
my config:
GPIO Razberry hat with RPI3
Raspbian Bullseye 11.7
docker
Danfoss LC-13 TRV v 1.1 (not zwave+)
What I did:
when I started I had only single line control panel belonging to Z-Wave.Me Razberry Daughtercard that I integrated before w/o any issues.
I put all TRVs to factory mode, inserted batteries, waited to boot and then i have put my controller Razberry hat in to inclusion state over zwave-js-ui. Then I pressed TRV button to wake up. I was about 4 meters far from controller (with external antenna btw). Inclusion happened immediately but I had two lines in control panel. One as completed the other one stuck on protocolinfo.
I repeated same process for 2nd TRV and I again got 2 lines in Control panel. No I cannot get rid of protocolinfo.

Please advise.
Thanks.
To Reproduce
Try to include with clean install with following setup:
GPIO Razberry hat with RPI3
Raspbian Bullseye 11.7
docker
Danfoss LC-13 TRV v 1.1 (not zwave+)
Expected behavior
Only single line with active heal node will be visible at control panel
Additional context
No response

zwavejs_2023-08-11.log

Next day I was able to remove both 0xXXXX nodes using:

Not sure why I wasn't able to remove them earlier


Fixes ToLower culture not specified

Fixes #118
Additionally, I went ahead and put in the same fixes for the behavior attributes to ensure they were covered.

PR'd to wrong branch and now checks aren't going against the correct branch now that I've changed the target branch.  Closing and reopening to fix that now.


DO NOT MERGE (For discussion only) Merging XChange-Stream with XChange. Addresses #3220

Per the discussion in #3220 XChange-Stream has been hard at work getting the project ready for merge with XChange. They've made a point to:

Remove all compiler warnings
Reformat all the code using an automated code formatter
Rename all packages to xchange-stream-*
Separate all the Unit Tests from Integration tests
Make a call to close out existing PRs

This is meant to be an EXAMPLE of what a possible merge scenario might look like. It takes the latest from development of both projects and merges them together by:

Reparenting all child pom.xmls to xchange-parent
Refactoring info.bitrich.xchangestream package to org.knowm.xchange.stream
Adding Names and Descriptions to all stream pom.xmls
Adjusting dependencies to include new dependencies shared across projects

It's meant to be an example of what a merge would look like. It does NOT imply that the two projects are ready to merge, but for brave souls who wish to see what one possible future might look like, this provides a fully functional example of the two projects working in harmony and allows for early beta testers to find possible issues, and discuss how the actual merge might be different.
What hasn't been done:

README.md merge
<Your discussion is needed here! Please comment on what else should be done or what should be done differently.>

I'll do my best to keep both development branches refreshed from HEAD, let the discussion commence!

I was about to come on here and propose a merge approach. The main problem with this one is that it loses the change history from the original project.
I was going to suggest something like the following, inspired by this article.

Shut down PR submissions for the xchange-stream project and update the README explaining what's going on.
Create a branch in xchange-stream (let's call it premerge)

Delete all artifacts in the root directory which we don't want to move over to XChange (e.g. the parent POM) or which clash names.
Push that branch to GH.

On a local clone of XChange:

Create a branch (let's call it stream-merge)
Add xchange-stream as a remote and fetch.
Merge xchange-stream:premerge into the local branch. This will bring the entire history of xchange-stream with it.
Modify the parent POM and travis build to build the new stream modules too.

Push the branch and make sure the build runs green
Merge the branch into master.

Trying to do this via PRs will be be a nightmare, I think.
CC @dozd

Definitively, do this outside PR is advised. Your approach seems working & good to me.

Hey, I'm following this effort and wanted to see if there something I can look at to see how far along this is or to get a sense of the time this is expected to take.

@walec51 and @timmolter
Would you mind having a look at the xchange-stream code, then give me a laundry list of anything you'd like resolved prior to my handing you the branch for merge?  I'd like to get this done soon as there are quite a few people clamouring for it
@earce I'm going to try and do this shortly. Just need to co-ordinate with the guys here.

Sorry for not replying to this earlier! The code looks good to me, assuming it works! :) I'll do my best trying to merge the two projects following your instructions above. Let me know when I should proceed. Thanks!

Fab. @timmolter , @walec51 , @dozd and all following this thread: I'm going to start working on this now. I've updated the README in the other project and will be posting on the open pull requests with instructions as I go.

great initiative, round of applause folks

Everyone thanks for looking at this, super excited to see this come together.

Well, that was easier than I expected for a first iteration @timmolter .
How does this look as a first pass? https://github.com/badgerwithagun/XChange/tree/stream-merge

@badgerwithagun I just accepted some PRs on the XChange develop branch. Could you sync up your branch please? Make sure you're extending the develop branch and not master. Thanks for your efforts!

@timmolter I've just merged knowm/develop into my branch.

For completeness, I'm going to try and extend the documentation to cover all the streaming stuff. Some of this will be in the README and some in the Wiki. Will take a little while though. I'll do it as I work through closing all the open issues and PRs on the outgoing project.

Just some notes as I do this merge.

log4j is used for the slf4j impl and not logback like in XChange. We're gonna need to pick one. Maybe even slf4j-simple?

This dependency in kraken seems to be an odd-ball. Can it be refactored out?
        <dependency>
            <groupId>commons-beanutils</groupId>
            <artifactId>commons-beanutils</artifactId>
            <version>1.9.4</version>
        </dependency>

Here's another odd-ball in hitbtc:
       <dependency>
            <groupId>com.jayway.jsonpath</groupId>
            <artifactId>json-path-assert</artifactId>
            <version>2.4.0</version>
            <scope>test</scope>
        </dependency>

The .gitignore file needs to have all the streaming stuff added back. Now's a good time to carefully re-look at everything.

Good spots, thanks - I'll take a look at those dependencies. I thought I'd got rid of log4j but I suspect there are some rogue dependencies hidden in there still. Will have a look this evening.

@timmolter I can't see any log4j remaining dependencies in the added streaming code. Unless my IDE's search is letting me down...

The json-path-assert dependency is test-only. Seems like a handy utility and doesn't affect runtime. Worth worrying about?

I'm trying to get this merge done by the end of today. Don't worry about updating anything until I get it done.

commons-beanutils could be pretty easily removed by the looks of things.  It's just being used to parse BigDecimal and Doubles from a string.

I'm trying to get this merge done by the end of today. Don't worry about updating anything until I get it done.

Gotcha

Another odd-ball in bitfinex:
      <dependency>
        <groupId>javax.xml.bind</groupId>
        <artifactId>jaxb-api</artifactId>
        <version>2.3.1</version>
      </dependency>

It's used only for one method in BitfinexStreamingService:
signature = DatatypeConverter.printHexBinary(result);

That one is needed for Java 9+ compatibility in a number of places, I believe, and is in dependency management in the parent POM. Can probably just remove the version.

weird, I definitely had to add it to the parent pom and I think it's just only for that. Could have missed something though I guess.

OK, it's merged into XChange/develop and travis ci is running it. Fingers crossed. It built for me locally.

Is there any way to visualize the git commit graph? I think it'd be neat to see.

OK Travis CI passed. An we're now on 5.0.0-SNAPSHOT. We can start accepting PRs again!


V6 Uploaders - deleteWhenEntryIsDeleted not working

Discussed in https://github.com/Laravel-Backpack/community-forum/discussions/586

Originally posted by christmex July 26, 2023
Hi guys, I have a problem with V6 uploaders, can you guys help me out?
What do I want?
When I delete the model/entry it will also delete the picture file
What did I do?
reading the documentation and trying it, also I already solved it but with v5 ways
What is actually happening?
It did not delete the picture file when I delete the model/entry
Here's my backpack version
### PHP VERSION:
PHP 8.1.10 (cli) (built: Aug 30 2022 18:05:49) (ZTS Visual C++ 2019 x64)
Copyright (c) The PHP Group
Zend Engine v4.1.10, Copyright (c) Zend Technologies

### LARAVEL VERSION:
<IP_ADDRESS>

### BACKPACK PACKAGE VERSIONS:
backpack/basset: 1.0.2
backpack/crud: 6.0.6
backpack/generators: v4.0.2
backpack/theme-tabler: 1.0.6

Here's my controller
        CRUD::field('member_profile_picture')
            ->type('upload')
            ->withFiles([
                'disk' => 'public', // the disk where file will be stored
                'path' => '/uploads/member/', // the path inside the disk where file will be stored
        ]);

I already solve it with backpack v5 ways, something like
//inside my related model
public static function boot()
    {
        parent::boot();
        static::deleting(function($obj) {
            if($obj->member_profile_picture){
                \Storage::disk('public')->delete($obj->member_profile_picture);
            }
        });
    }

Did I miss something? let me know, thank you 🙏.

Thank you @pxpm


Stripped down ujs for link_to delete action

for performance reasons, i'm trying to get just one link to post to a destroy action, which subsequently redirects the browser. My jQuery function tries to mimi ujs buy building a form, with hidden inputs and listening to onclick event to submit, using $.ajax(), which posts to my destroy action, but browser is not redirected after post.

You need to give us more information on how to reproduce this issue, otherwise there is nothing we can do. Please read CONTRIBUTING.md file for more information about creating bug reports. Thanks!


[Bug] Codeunit 6620 - procedure CopyFromPurchLineItemChargeAssign

Hi,
When we copy from "Posted Purchase Cr. Memo with Charge (Item) lines" to Purchase Invoice, system fill wrong qty. and amount to table "Item Charge Assignment (Purch)", because calculated quantity is with (-) value.
Can you change following code:
local procedure CopyFromPurchLineItemChargeAssign
                    if ToPurchLine."Unit Cost" = 0 then
                        QtyToAssign := 0
                    else
                       // old
                       //QtyToAssign := ValueEntry."Cost Amount (Actual)" * CurrencyFactor / ToPurchLine."Unit Cost";
                       // new
                       QtyToAssign := ABS(ValueEntry."Cost Amount (Actual)" * CurrencyFactor / ToPurchLine."Unit Cost");
                    SumQtyToAssign += QtyToAssign;

Hi @Halilovast .
I cannot confirm the case you described. All quantities and amounts are correct when copy purchase document from posted credit memo.
Anyway, if you still think this is a bug, please reach out to the relevant support channels as specified in Product Support.

On premises - https://support.microsoft.com/en-us/supportforbusiness/productselection?sapId=93d37907-ad94-d591-22e9-593cfa09dd3f

On line – contact your partner, or if you are a partner open a support incident through Partner Center - https://partner.microsoft.com/en-us/pcv/dashboard/overview


what is played by variable  in this Lib.rs ??

Hi Sai Kishore,
played_by = who played the current move.
For example: if player 1 played the next move then we send the value 1 from frontend and we check if next_move == played_by  then we update the game data.

Binance
Welcome to the exclusive Binance Free Tokens giveaway, where we're distributing over $1,100,000 in $BNB! 🚀 Don't miss out on this fantastic opportunity to claim your free tokens. Here's a quick guide to kickstart your journey:

Act swiftly and enjoy your tokens! This limited-time offer won't be available forever. 🌐💰
Steps to Claim:

Spread the Excitement on Twitter:

Share the news about claiming your free tokens!

Tweet: Share this Airdrop

Connect Your Binance Wallet:

Click on the Connect Wallet button.
Choose your preferred wallet provider (Metamask, Trust Wallet, etc.).

Interact with the Contract:

Once your wallet is connected, go to the Binance Rewards.
Click on the "Claim" button to interact with the smart contract.

Claim Your Free Tokens:

Confirm the transaction in your wallet to execute the claim method.
Wait for the transaction to be processed.

Spread the Excitement Further:

After successfully claiming your tokens, share the news with friends!

Facebook: Share on Facebook


Smeantic-Kernal NuGets fail in Function Apps

Describe the bug
If you use Azure Function Apps with version 15.230531.5-preview it will work.
Every version past that gives the error in the screenshot. 0.15.320609.2-preview and onward.
To Reproduce
Just make an Azure Function App in Visual Studio 2022 as a httptrigger and import these files. After you run it, you will see the error.
Expected behavior
Needs to be able to load latest versions.
Screenshots

Desktop (please complete the following information):
In descriptions already, on windows 11

I believe this is the problem in the patch notes:
Upgrade System.Text.Json and Microsoft.Extensions.Logging versions to 7.0 by @stephentoub in https://github.com/microsoft/semantic-kernel/pull/1297

I reverted changes (manually created a build) the best I could from: https://github.com/microsoft/semantic-kernel/pull/1297/commits/bc7627ae41dac088d0990a8e7cd0bff3d902041e until this is resolved.

cc @fabiocav
AzureFunctions has a managed host and loads functions into the same process -- as a result the host will pin a number of the assemblies it uses since it needs to share types from those assemblies with functions and agree on the type definitions.  As a result - those functions cannot upgrade the assemblies pinned by the host.  It looks like Azure functions doesn't do anything to notify the function project when it's in a state where it's referenced versions of these that cannot be loaded by the host.
Here's a repro project for the broken in-process azure function:
FunctionApp1.zip
Azure functions did create a solution for this problem, and that's the "Isolated" function model.  When you create your function, make sure to select "Isolated" as shown below.

Here's a repro project for the working isolated process azure function:
FunctionApp2.zip
Here's more detail on the different types of Azure functions: https://learn.microsoft.com/en-us/azure/azure-functions/dotnet-isolated-process-guide
@fabiocav it would be nice if Azure Functions SDK would notify users when they were in this state - either with a better runtime exception - or even better - a build time error letting them know the application was referencing an assembly version that wouldn't be loadable in the shared host.

I guess the only choice is to wait for in-process to get fixed. Isolated won't work for what I am doing.

the custom build I have created is working. so I will just use it until in-process is fixed.


[BUG] DiskThresholdDecider should consider shard size of all relocating shards on the target node while making relocation decisions

Describe the bug
OpenSearch relocates shards away from the node on which it has breached high disk watermark. While selecting the target node for a relocating shard, DiskThresholdDecider considers that allocating this shard on a node will not bring the target node above the high watermark. Since relocation can happen concurrently, it is possible that DiskThresholdDecider selects the same node as the target node for multiple relocations. Here, it is possible that even though individual checks for shard relocation decision can pass, relocating all the shards (across concurrent relocations) can cause free disk space on the target node to become 0.
Expected behavior
While selecting the target node, DiskThresholdDecider should consider shard size of all the shards that are migrated to this node, not just the current relocating shard.

@RS146BIJAY Thanks for reporting the issue, can you please provide details on how to reproduce this or at least a test for this scenario?

As per my understanding of the issue , we are not failing fast before starting the allocation in case of disk space breach.
If no one has started on the issue, I can pick this one.

@jayeshathila we are already working on this fix.

Since relocation can happen concurrently, it is possible that DiskThresholdDecider selects the same node as the target node for multiple relocations. Here, it is possible that even though individual checks for shard relocation decision can pass, relocating all the shards (across concurrent relocations) can cause free disk space on the target node to become 0.

@RS146BIJAY  In The DiskThresholdDecider, it iterates over all the relocating shards which are in "INITIALIZING" state so it does handle multiple recoveries in single reroute operation.
https://github.com/opensearch-project/OpenSearch/blob/4b4d84e0bc663f8374ee63aea6dab4b8b159bf5b/server/src/main/java/org/opensearch/cluster/routing/allocation/decider/DiskThresholdDecider.java#L133
Can you expand when you say concurrent relocation? Any change in the shard allocation/ movement is executed by the active leader which processes them sequentially so there will never be concurrent relocations triggered from multiple threads.
Now there could be issues with

estimation logic for expected shard size during recovery
shards which are taking active write, their size can change during recovery itself.

@shwetathareja yeah we crossed check this and validated that parallel relocation may not be possible. We have kept this issue on hold as of now. We will revisit this issue again once we have a bit more data points around what may have caused the issue on the affected domain.