Illegal or unsupported padding mode RSA_PKCS1_WITH_TLS_PADDING

I opened issue https://github.com/intel/QAT_Engine/issues/331 but this may be an OpenSSL bug that affects engines in general.
OpenSSL 3.0 introduced what I understand is Bleichenbacher's attack mitigation in server code via special RSA_PKCS1_WITH_TLS_PADDING mode.
Looks like it is causing error when engine is used for RSA. I am using qat engine and I'm getting RSA_R_ILLEGAL_OR_UNSUPPORTED_PADDING_MODE error during handshake with AES256-SHA cipher.
Backtrace to error:
#0  pkey_rsa_ctrl (ctx=0x7f6c6566a6c0, type=4097, p1=7, p2=0x0) at crypto/rsa/rsa_pmeth.c:457
#1  0x00007f6c61d72720 in evp_pkey_ctx_ctrl_int (ctx=0x7f6c6566a6c0, keytype=-1, optype=-1, cmd=4097, p1=7, p2=0x0) at crypto/evp/pmeth_lib.c:1396
#2  0x00007f6c61d7285e in EVP_PKEY_CTX_ctrl (ctx=0x7f6c6566a6c0, keytype=-1, optype=-1, cmd=4097, p1=7, p2=0x0) at crypto/evp/pmeth_lib.c:1430
#3  0x00007f6c61e8e026 in RSA_pkey_ctx_ctrl (ctx=0x7f6c6566a6c0, optype=-1, cmd=4097, p1=7, p2=0x0) at crypto/rsa/rsa_lib.c:737
#4  0x00007f6c61e8ea02 in EVP_PKEY_CTX_set_rsa_padding (ctx=0x7f6c6566a6c0, pad_mode=7) at crypto/rsa/rsa_lib.c:963
#5  0x00007f6c69cf3f5f in tls_process_cke_rsa (s=0x7f6c65607000, pkt=0x7f6c65679930) at ssl/statem/statem_srvr.c:2909
#6  0x00007f6c69cf5429 in tls_process_client_key_exchange (s=0x7f6c65607000, pkt=0x7f6c65679930) at ssl/statem/statem_srvr.c:3305
#7  0x00007f6c69ceee97 in ossl_statem_server_process_message (s=0x7f6c65607000, pkt=0x7f6c65679930) at ssl/statem/statem_srvr.c:1199
#8  0x00007f6c69cd8b0b in read_state_machine (s=0x7f6c65607000) at ssl/statem/statem.c:647
#9  0x00007f6c69cd84f8 in state_machine (s=0x7f6c65607000, server=1) at ssl/statem/statem.c:442
#10 0x00007f6c69cd7f86 in ossl_statem_accept (s=0x7f6c65607000) at ssl/statem/statem.c:270
#11 0x00007f6c69c9a39b in ssl_do_handshake_intern (vargs=0x7f6c65628090) at ssl/ssl_lib.c:3933
#12 0x00007f6c61c18ef5 in async_start_func () at crypto/async/async.c:162

This is with OpenSSL 3.1.6 but I imagine this affects everything from 3.0 up.

This bug is specific to legacy keys only and does not happen with provider keys. I changed my application code to use EVP_RSA_gen() instead of now deprecated RSA_generate_key_ex() to generate server key and that fixed the issue.


[WIP] Kotlin style fixes

Starting on #698
TODO:

[x] Let ktlint auto-fix everything it can
[x] Fix all other ktlint issues
[x] Get ktlint as part of the build
[ ] Get rid of all hungarian notation
[ ] Fix modifiers where they are not necessary

Mwahaha

Neat! 🚀💯


Add coverage

Is your feature request related to a problem? Please describe.
Project does not show how much code is covered by testes
Describe the solution you'd like

Run coverage everytime tests run
Add a badge in the README file

I can tackle that one


Implement Chat: Clients able to send messages in a room

refinements are still left such as, username is not displayed, the basic framework is done.

unicode text is working.

rebased the changes the away.

rebased the changes the away.

another way we could stop large messages from displaying on the player is after a limit we could display only a certain part of the message, followed by "..." , rest of it could be read within the client or on the console

How are you going to determine what's big message? (i.e. difference between fullHD and laptop screen)

a full hd screen can have more characters , but displaying a part of the message would only serve as a kind of notification,  so displaying less characters on a bigger screen is not a big deal IMO.

Hey @abhsag24 , would be glad to help you on this!

@remimarenco would love to have help, as you can see i had already listed out the things that needed to be done further. What do you suggest?

@abhsag24 We should take some time to discuss about your vision on your branch, and see how we can work together on this.
Personally, I just want to be able to chat with my loved one while we are watching the movie. Annoying to have to use a third party system or to speak.
I found the letsgaze system pretty handy to handle the chat

I'm really looking forward to this functionality. I think having the conversation more closely tied with the on-screen action is essential for making it a more social experience.
Using Skype works and all, but I agree with @remimarenco that it's not always ideal to be on voice or to have to rely on another program to send text which requires keeping another window / screen active.

@perfectcolors  @remimarenco i think i've added the basic chat functionality in this PR already, you can go ahead and use it, but you'll have to chat from within the terminal and there are some concerns that i had stated earlier, i don't know much about the GUI and don't have the time right now add that functionality :(  , but it should be pretty usable :)

Merged into https://github.com/Syncplay/syncplay/tree/chat

awesome! so should i close this PR?

Closing this as PR has been accepted onto the chat branch.


Create macro for defining generators

It is inconvenient to write
A = ob(FreeCategory, :A)
B = ob(FreeCategory, :B)
f = hom(:f, A, B)
...

when working interactively or writing unit tests. Create a macro for defining generators and injecting them into the global namespace.
Analogous to the var function in SymPy.

The commit above adds an analogue of SymPy's symbols function for objects in a category.
A general macro providing syntactic sugar for defining generators could be implemented as a special case of the new presentation module (ad1d0243f617ad86351fde099205f374155c2e7d). Maybe I'll do that later.

With the presentation macro in place, this issue no longer seems very important. Closing for now.


Questions about Windows auth & Linux

"On the domain controller, add new web service SPNs to the machine account:
setspn -S HTTP/mywebservice.mydomain.com mymachine
setspn -S<EMAIL_ADDRESS>mymachine"
Why are the HTTP SPNs needed in addition to the default HOST SPNs?  Playing with this in a lab environment I'm seemingly able to get this working (hosted from linux, accessed with a windows domain machine, currently signed in user can access without a password prompt) while totally skipping the SPN/ktpass steps.  So what is the point of them?
[EDIT by guardrex to include followup question from #15923]
machine account password (in linux steps)
"Use ktpass to generate a keytab file:
ktpass -princ<EMAIL_ADDRESS>-pass myKeyTabFilePassword -mapuser MYDOMAIN\mymachine$ -pType KRB5_NT_PRINCIPAL -out c:\temp\mymachine.HTTP.keytab -crypto AES256-SHA1"
When I run this command I get prompted if I want to reset the password of the machine account:
"WARNING: Account ip-10-0-243-22$ is not a user account (uacflags=0x11001).
WARNING: Resetting ip-10-0-243-22$'s password may cause authentication problems if ip-10-0-243-22$ is being used as a server.
Reset ip-10-0-243-22$'s password [y/n]?"
Won't resetting the machine account password break the realm join that was done in prior steps?
Also, I think you should update the code snippet because "-pass myKeyTabFilePassword" is misleading if this command is actually updating the machine account password.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 401ad9a0-9e51-80a2-5846-82e9790d7257
Version Independent ID: fbc36c26-9992-1f4c-66d3-02f898ee7ec4
Content: Configure Windows Authentication in ASP.NET Core
Content Source: aspnetcore/security/authentication/windowsauth.md
Product: aspnet-core
Technology: aspnetcore-security
GitHub Login: @scottaddie
Microsoft Alias: riande

Hello @HelicalSyncromesh Let's wait until we're past this holiday weekend. I'll ping the author to comment.

@HelicalSyncromesh ... Need to wait a bit longer. All teams are 🏃😅 for 3.1 work. I'll call for engineering clarification after 3.1 releases.

@Tratcher ... a question on Windows Auth and Linux. I waited until after 3.1 to ping. 🏃😅
Whatever the answer, also let me know which bits should be covered from your response, if anything.

@HelicalSyncromesh ... Need to wait a bit longer. All teams are 🏃😅 for 3.1 work. I'll call for engineering clarification after 3.1 releases.

@guardrex we finished 3.1 weeks ago 😁.

Why are the HTTP SPNs needed in addition to the default HOST SPNs?

That's odd, the HTTP SPNs are required for a Windows server. I recall my Linux server not working without them, but I didn't try many variations. Which client are you using?

When I run this command I get prompted if I want to reset the password of the machine account:

Curious, I never saw that warning.
@davidsh, any insights on these?

Thanks for contacting us. We believe that the question you've raised have been answered. If you still feel a need to continue the discussion, feel free to reopen it and add your comments.

Thanks for contacting us. We believe that the question you've raised have been answered. If you still feel a need to continue the discussion, feel free to reopen it and add your comments.

Um no, this absolutely hasn't been answered.  Please reopen and explain what the SPNs are required for and what function they perform.  You guys also merged my other question about machine password resets and have provided no information about that either.   Management handles this decision.

@HelicalSyncromesh ... Need to wait a bit longer. All teams are 🏃😅 for 3.1 work. I'll call for engineering clarification after 3.1 releases.

@guardrex we finished 3.1 weeks ago 😁.

Why are the HTTP SPNs needed in addition to the default HOST SPNs?

That's odd, the HTTP SPNs are required for a Windows server. I recall my Linux server not working without them, but I didn't try many variations. Which client are you using?
Curious, I never saw that warning.

Clients I've been using is newest IE.
As far as password reset warning I'm getting that warning repeatably as are other team members in their own environments.  We've never been able to get the steps to work without getting that warning.

@HelicalSyncromesh ... Need to wait a bit longer. All teams are 🏃😅 for 3.1 work. I'll call for engineering clarification after 3.1 releases.

@guardrex we finished 3.1 weeks ago 😁.

Why are the HTTP SPNs needed in addition to the default HOST SPNs?

That's odd, the HTTP SPNs are required for a Windows server. I recall my Linux server not working without them, but I didn't try many variations. Which client are you using?

When I run this command I get prompted if I want to reset the password of the machine account:

Curious, I never saw that warning.
@davidsh, any insights on these?

Sorry I got no email about this particular reply.  Client used was IE, latest.  The machine password reset was observed repeatably by myself and two other dev team members.  Any insights on the potential long term impact of forcibly resetting?

Any insights on the potential long term impact of forcibly resetting?

Sorry, no, this scenario is new for us and we haven't experienced any long term side-effects yet.

OK, so, Kerberos Auth works for us against Windows AD in asp.net core 3.1 running on Linux. What we can't figure out is how to make the Authorize Attributes work with AD roles. It seems that the identity retrieved after the kerberos authentication has no claims associated with it. What do we need to configure to fetch the roles from AD?

@undecided2013 That's work we're considering for 5.x and is tracked by https://github.com/aspnet/AspNetCore/issues/12938.

@undecided2013 That's work we're considering for 5.x and is tracked by aspnet/AspNetCore#12938.

That makes sense, thank you. As a side-question, in the meantime, if we wanted to handle the fetching of claims ourselves using LDAP api, is there an injection point in the pipeline that would allow us to do that after the user has been authenticated but before the Authorize attribute is checked ? ([Authorize (Roles="")] ). We could then populate the claims onto the Identity ourselves. Thx

@undecided2013 check out NegotiateOptions.Events.OnAuthenticated.
https://github.com/aspnet/AspNetCore/blob/94b44141ce0437541fc1ff6b5fd8b48140548f66/src/Security/Authentication/Negotiate/test/Negotiate.Test/EventTests.cs#L280-L290
Beware that this runs on every request, even if the kerberos credentials don't change. You'll want to do some caching.

@undecided2013 check out NegotiateOptions.Events.OnAuthenticated.
https://github.com/aspnet/AspNetCore/blob/94b44141ce0437541fc1ff6b5fd8b48140548f66/src/Security/Authentication/Negotiate/test/Negotiate.Test/EventTests.cs#L280-L290
Beware that this runs on every request, even if the kerberos credentials don't change. You'll want to do some caching.

Hi Tratcher, I tried 2 approaches. One was to add the NegotiateEvent OnAuthenticated  in the ConfigureServices like this:
services.AddAuthentication(NegotiateDefaults.AuthenticationScheme).AddNegotiate(options =>
{
options.Events = new NegotiateEvents()
{
OnAuthenticated = context =>
{
context.Success();
return Task.CompletedTask;
}
};
});
I never saw the event being called though.
As a separate approach I created an IClaimsTransformation that took the username and went to LDAP directly to pull the claims.
I injected that using
services.AddSingleton<IClaimsTransformation, LDAPRoleAuthorizationTransform>();
That works for the most part as in my Controller the Identity has the claims I manually add to the ClaimsPrincipal in the TransformAsync methos of the IClaimsTransformation implementation.
What still does NOT work is the [Authorize (Roles="")].
It seems that the Authorize Attribute is unaware of all of the above work that I did.  It just throws a 401 everytime I add a Role for it to check.

@undecided2013 check out NegotiateOptions.Events.OnAuthenticated.
https://github.com/aspnet/AspNetCore/blob/94b44141ce0437541fc1ff6b5fd8b48140548f66/src/Security/Authentication/Negotiate/test/Negotiate.Test/EventTests.cs#L280-L290
Beware that this runs on every request, even if the kerberos credentials don't change. You'll want to do some caching.

OK, some more info:
In ConfigureServices I added this policy
services.AddAuthorization(options =>
{
options.AddPolicy("CanView", policy => policy.RequireClaim(@"role", new string[] { "ViewRole" }));
}
In the    IClaimsTransformation
TransformAsync(ClaimsPrincipal principal)
I create a new ClaimsIdentity with RoleClaimType 'role'.
In my BaseController derived controller I added an Authorize attribute with no policy, put a breakpoint in there and I can see the user is populated with
the claims I populate in my ClaimsTransformation and the claims have the correct RoleClaimType of 'role'.
BUT when I change the [Authorize] to [Authorize(Policy ="CanView")] I get a 403.
Is there a place I can put a break point to see what is happening?

@undecided2013 check out NegotiateOptions.Events.OnAuthenticated.
https://github.com/aspnet/AspNetCore/blob/94b44141ce0437541fc1ff6b5fd8b48140548f66/src/Security/Authentication/Negotiate/test/Negotiate.Test/EventTests.cs#L280-L290
Beware that this runs on every request, even if the kerberos credentials don't change. You'll want to do some caching.

Update, everything works now. I created an IClaimsTransformation to go to LDAP and I store the claims in a singleton InMemoryCache. Thanks for the help.


Replaced kind action with dev image setup-tools

Removed no longer supported engineerd/setup-kind action, replaced with straight k3d commands, using the minimum supported k8s version (v1.22).

Superseded by #153


Will Business Charts work in NAV2018?

I noticed in the Anniversary release, we now can use the Business Charts.  Will this work in NAV2018?

Arend Jan said all of this stuff will be shipped with R2 and we only get bugfixes with CU's.

Well, it's one thing to be able to compile.  It's another thing to be able to run.
Since the controls are already on the service tiers, I expect it to just run...


Use PolymorphicManager to create GeographicAreas.objects.

Turns out the reason I thought this wasn't needed.. was wrong :) so good, to merge this.

Codecov Report

Merging #355 (c5cddf9) into master (eb9d608) will decrease coverage by 0.02%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master     #355      +/-   ##
==========================================
- Coverage   90.98%   90.96%   -0.03%
==========================================
  Files         256      256
  Lines       14193    14194       +1
  Branches     1051     1051
==========================================
- Hits        12914    12912       -2
  Misses       1069     1069
- Partials      210      213       +3

Impacted Files
Coverage Δ

geo_areas/models.py
91.02% <100.00%> (+0.11%)
:arrow_up:

quotas/business_rules.py
96.06% <0.00%> (-1.58%)
:arrow_down:

measures/business_rules.py
88.21% <0.00%> (-0.29%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update eb9d608...c5cddf9. Read the comment docs.


ImageBufAlgo: Fix implicit float/double casts to half incorrectly flagging values as non-finite

Description
I recently discovered that, when running maketx on an HDR that included the sun, the extremely high channel values (> 145,000) were being rolled off to just over 65,000. Eventually, I was able to track the cause of the "rolloff" down to the use of --fixnan box3, and from there, I found that float/double values were being incorrectly flagged as non-finite due to an implicit cast to half.
Basically, because a cast to half is possible, the local isfinite in imagebufalgo_pixelmath.cpp is being preferred over std::isfinite for float and double values.
The fix uses a templated shim around std::isfinite, with an explicit specialization for half.
Tests
I can add an additional oiiotool-fixnan test if you think it's valuable.
Checklist:

[x] I have read the contribution guidelines.
[x] If this is more extensive than a small change to existing code, I
have previously submitted a Contributor License Agreement
(individual, and if there is any way my
employers might think my programming belongs to them, then also
corporate).
[ ] I have updated the documentation, if applicable.
[ ] I have ensured that the change is tested somewhere in the testsuite
(adding new test cases if necessary).
[x] My code follows the prevailing code style of this project.

I just came across this same problem, but I went with a different fix because I didn't realize it was already fixed in master. While the current code looks like it should work just fine, I wonder if maybe we should use the below code instead since it results in what I think is cleaner code.  Notice it's just one line instead of a bunch of new lines and a new function, not to mention it prevents possible bugs that could later arise if someone uses an isfinite() by accident (which compiles) instead of isfinite_()? Here's what it looks like if applied to the old broken code:
diff --git a/src/libOpenImageIO/imagebufalgo_pixelmath.cpp b/src/libOpenImageIO/imagebufalgo_pixelmath.cpp
index ba245d7df..b8a019af3 100644
--- a/src/libOpenImageIO/imagebufalgo_pixelmath.cpp
+++ b/src/libOpenImageIO/imagebufalgo_pixelmath.cpp
@@ -1000,16 +1000,18 @@ namespace {

 // Make sure isfinite is defined for 'half'
 inline bool
 isfinite(half h)
 {
     return h.isFinite();
 }

+// Make sure isfinite is defined for 'float' and other standard types
+using std::isfinite;

 template<typename T>
 bool
 fixNonFinite_(ImageBuf& dst, ImageBufAlgo::NonFiniteFixMode mode,
               int* pixelsFixed, ROI roi, int nthreads)
 {

Side note: the half(float) constructor should be made explicit so that these kinds of bugs can't happen. I verified that at least in my slightly older OIIO this compiles just fine after using the above fix and has a compile time error without any fixes. Of course that's an OpenEXR issue, so I'll officially raise this issue there, but I figured I'd mention it here too.

Oh, that's a more elegant solution, Thiago. Should I go ahead and make that change to fmath.h?

N/M, I misunderstood. Not a change to fmath.h, is it?
Still, is it better for me to add this to imagebufalgo_pixelmath.cpp and get rid of the slightly more awkward extra template?

Yes, I think it would be, provided my patch makes sense to others.

If it works reliably, then I'm all for cleaner code.


Move full cluster backup logic into the controller

Add an endpoint in the controller that acts the same as flynn cluster backup.

Note that for backwards compatibility we still need to compile this logic into the CLI so that clusters from before the change can still be backed up. It may make sense to abstract it into a package that can be used from the client or server.


make-disk-image: change to be less VM-centric

This changes much of the make-disk-image.nix logic (and thus most NixOS image building) to use LKL to set up the target directory structure rather than a Linux VM. The only work we still do in a VM is less IO-heavy stuff that while still time-consuming, is less of the overall load. The goal is to kill more of that stuff, but that will require deeper changes to NixOS activation scripts and switch-to-configuration.pl, and I don't want to bite off too much at once.
This is a new version of https://github.com/NixOS/nixpkgs/issues/21943, refactored to take advantage of the new nixos-prepare-root logic I introduce in #23026. There's still a couple of WIP things here but I wanted to get this out there to show what I've been talking about in the other PR.
Motivation for this change
Building disk images with VMs is miserable in EC2 and other cloud virtualization providers, and doesn't work at all in local VMWare due to some shady nested virtualization bugs.
Things done

[x] Tested using sandboxing
(nix.useSandbox on NixOS,
or option build-use-sandbox in nix.conf
on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] Linux

[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

How long does the build take on EC2 with this PR?

Under a minute for the default Amazon image module. I'll put up some stats
later! Faster on bare metal too
On Mon, Apr 17, 2017 at 10:21 Domen Kožar<EMAIL_ADDRESS>wrote:

How long does the build take on EC2 with this PR?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/NixOS/nixpkgs/pull/24964#issuecomment-294494508, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAAKP3NeoDQDkDM8KjVtVXDklPXmHqdKks5rw3V2gaJpZM4M-1RU
.

I just had a 3 hour deploy where AMI handling was ~80min so this is highly appreciated!!

Sorry to hear that! I hope to get this PR in a mergeable state later today,
so with any luck we'll all be fast by default very soon now :)
On Mon, Apr 17, 2017 at 10:24 Domen Kožar<EMAIL_ADDRESS>wrote:

I just had a 3 hour deploy where AMI handling was ~80min so this is highly
appreciated!!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/NixOS/nixpkgs/pull/24964#issuecomment-294495117, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAAKP606LbGYs0GSDGZmIiWTH6mv1zi8ks5rw3Y3gaJpZM4M-1RU
.

Hm, tools for cheap image builds sound like something useful for spinoffs, too…

@7c6f434c yes, I have a larger plan for all sorts of images that I start talking about a bit here: https://github.com/NixOS/nixpkgs/issues/23052

Pushed a few more changes that I think take this out of WIP land.
I also ran a few tests for speed in a loop just to get a sense for how this performs.
On (the same across all tries) physical hardware (with VT-X etc.):
Before I merged nixos-prepare-root (in case that affected it negatively):
real	3m39.639s
real	3m38.517s
real	3m40.729s
(I got sick of waiting)

This PR:
real	0m22.107s
real	0m21.942s
real	0m22.242s
real	0m22.511s
real	0m22.127s
real	0m22.318s
real	0m22.215s
real	0m22.328s
real	0m22.200s
real	0m22.235s

On EC2:
I don't have exact measurements handy but my EC2 image builds were in the 25-30 minute range and are now in the 30s-1m range.

@shlevy mind taking a look?

Would be nice to have make-disk-image also in a form of a script (not only a derivation) in order to be able to create huge images outside the nix store.

@copumpkin probably not until this weekend, sorry

@volth I'd certainly be open to that, but probably not as part of this ticket, which is purely trying to refactor the implementation of the existing interface. Perhaps make a ticket talking about how you might use that? The thought of having builds not managed by Nix blows my mind so I can't imagine it 😄

@copumpkin  ok, no problem.

It turns out I actually broke the old make-disk-image.nix in my last nixos-prepare-root PR. I'd rather not put effort into fixing it if we're going to replace it with this in the next day or two. Does anyone expect this PR to be particularly contentious?

Does anyone expect this PR to be particularly contentious?

Not I, FWIW.

The old thing didn't call activate, nope. I'm not sure why I started doing that or whether it's the correct thing to do. It also forced me to start doing umount -R, which might suggest I'm doing the wrong thing.

@copumpkin Perhaps it's best to keep the activate part as it was, then. Also, I could be wrong, but I thought there was a use case in the context of AMIs that went something like this:

Create an image with a particular configuration
When it first boots, the activation script reads some info from the environment, and possibly pulls down a new configuration.nix, which it then switches to

That's essentially what one of your old PRs did (which I think I contributed a bit to, IIRC), right? My memory is a little foggy here.
I would think calling activate would make it difficult (or impossible) to do such first-boot setup.

Both of those work today with this configuration but you're right, I probably don't want the activation script in here. I'll take it out for now. The EC2 boot configuration thing is what actually runs in our EC2 VM tests and those still pass after this PR :)

On Apr 21, 2017, at 14:19, Charles Strahan<EMAIL_ADDRESS>wrote:
@copumpkin Perhaps it's best to keep the activate part as it was, then. Also, I could be wrong, but I thought there was a use case in the context of AMIs that went something like this:
Create an image with a particular configuration
When it first boots, the activation script reads some info from the environment, and possibly pulls down a new configuration.nix, which it then switches to
That's essentially what one of your old PRs did (which I think I contributed a bit to, IIRC), right? My memory is a little foggy here.
I would think calling activate would make it difficult (or impossible) to do such first-boot setup.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

I'm not really all that familiar with this code and dont' really have an opinion either way. Fine by me if it works.

🚢 👍

Okay when I get back to my computer I'll remove the activation script invocation then merge. We can always revert if it's a disaster:)

On Apr 23, 2017, at 14:19, Charles Strahan<EMAIL_ADDRESS>wrote:
🚢 👍
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

Okay, removed the call to activate, so I'll merge now. Going to be making a few more commits in next few days adding some tests and switching some of the other image builders to use this.

I'll test this shortly. Thanks!


Option to rescale histograms to only show filtered

If you filter for a small subset, you can't see the filtered histograms at all. Maybe we have a toggle that only shows the filtered histograms

and option to change scale (like log scale)? Idk adding this might be too many options


ahash 0.7.2 test suite fails on 32-bit architectures

I'm building ahash 0.7.2 packages for Fedora, and I see three test failures on 32-bit architectures (x86 and armv7hl):
failures:
---- hash_quality_test::fallback_tests::fallback_keys_change_output stdout ----
thread 'hash_quality_test::fallback_tests::fallback_keys_change_output' panicked at '80513b7ff03f720b vs 80513b7ff03f720b: 8', src/hash_quality_test.rs:6:5
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
---- hash_quality_test::fallback_tests::fallback_keys_affect_every_byte stdout ----
thread 'hash_quality_test::fallback_tests::fallback_keys_affect_every_byte' panicked at 'assertion failed: `(left == right)`
  left: `18446744073709551615`,
 right: `18446744072640004095`: Bits changed: ffffffffc03fffff on num: 13', src/hash_quality_test.rs:150:5
---- hash_quality_test::fallback_tests::fallback_single_key_bit_flip stdout ----
thread 'hash_quality_test::fallback_tests::fallback_single_key_bit_flip' panicked at 'cb6ae85967184a78 vs cb6ae85967184a78: 8', src/hash_quality_test.rs:6:5
failures:
    hash_quality_test::fallback_tests::fallback_keys_affect_every_byte
    hash_quality_test::fallback_tests::fallback_keys_change_output
    hash_quality_test::fallback_tests::fallback_single_key_bit_flip

Looks like at least two of those might be caused by integer overflow issues (which cause panic!s in release mode).

Looks like at least two of those might be caused by integer overflow issues (which cause panic!s in release mode).

I think you meant debug mode. Either way aHash is using nopanic and handles all integer overflow explicitly.
These all involve assertions about the keys. My guess the key mixing on 32 bit is causing some of the input key bits not affect all bits to affect key2 but not key1 so it doesn't end up in pad or buffer but only in extra_keys.
If that's the case it is not a serious issue.
I'll look into it.

Your're right, I mixed up debug and release mode ...
Thanks for looking into it!

Fixes. It was what I described above. I've added github actions check to prevent regression.

Great, thank you!


UseConcurrencyLimit(1) does not take effect

Apologies if we are mistaking UseConcurrencyLimit on an endpoint; we would expect it to limit the concurrent thread count on an endpoint to the specified limit. We realize this may be more of a GreenPipes question and did try to debug, but ran into issues being able to debug at that level.
Is this a bug report?
Yes.

Can you also reproduce the problem with the lastest version?
Yes.
Environment

Operating system: Windows 10
Visual Studio version: 2017 (latest)
Dotnet version: 4.7.1

Steps to Reproduce
Message producer:
public class Program
	{
		static void Main(string[] args)
		{
			var bus = MassTransit.Bus.Factory.CreateUsingRabbitMq(sbc =>
			{
				var host = sbc.Host(new Uri("rabbitmq://localhost/"), h =>
				{
					h.Username(UserInfo.Name);
					h.Password(UserInfo.Password);
					h.PublisherConfirmation = false;
					h.Heartbeat(0);
				});

				sbc.PrefetchCount = 100;
				sbc.UseConcurrencyLimit(1);
				sbc.UseBinarySerializer();
			});

			bus.StartAsync().Wait();

			Console.WriteLine("Press escape to exit. Press any key to send.");
			while (Console.ReadKey().Key != ConsoleKey.Escape)
			{
				bus.Publish(new Message1());
				bus.Publish(new Message2());
			}
		}
	}
}`

Message consumer:
`namespace consumer
{
	class Program
	{
		static void Main(string[] args)
		{
			Console.WriteLine("Waiting to consume. Press any key to exit.");

			var bus = Bus.Factory.CreateUsingRabbitMq(sbc =>
			{
				var host = sbc.Host(new Uri("rabbitmq://localhost/"), h =>
				{
					h.Username(UserInfo.Name);
					h.Password(UserInfo.Password);
					h.PublisherConfirmation = false;
					h.Heartbeat(0);
				});

				sbc.UseBinarySerializer();

				sbc.UseRetry(retry => retry.None());
				sbc.Durable = false;
				sbc.PrefetchCount = 100;

				sbc.ReceiveEndpoint(host, UserInfo.queue, ep =>
					{
						ep.UseConcurrencyLimit(1);
						ep.PrefetchCount = 100;
						ep.PurgeOnStartup = true;
						ep.Durable = false;

						ep.Instance(new ConsumesMessage1());
						ep.Instance(new ConsumesMessage2());
					});

			});

			bus.StartAsync();

			Console.ReadKey();
		}
}

namespace mttest
{
	[Serializable]
	public class Message1 {}
	[Serializable]
	public class Message2 {}

	public class ConsumesMessage1 : IConsumer<Message1>
	{
		public Task Consume(ConsumeContext<Message1> context)
		{
			Console.WriteLine($"{DateTime.Now:O} BEGIN - Consume message 1");
			Thread.Sleep(5000);
			Console.WriteLine($"{DateTime.Now:O} END - Consume message 1");

			return Task.CompletedTask;
		}
	}

	public class ConsumesMessage2 : IConsumer<Message2>
	{
		public Task Consume(ConsumeContext<Message2> context)
		{
			Console.WriteLine($"{DateTime.Now:O} BEGIN - Consuming message 2");
			Thread.Sleep(200);
			Console.WriteLine($"{DateTime.Now:O} END - Consuming message 2");

			return Task.CompletedTask;
		}
	}
}
`

Behavior
Because receiving end's ep.UseConcurrencyLimit == 1;
Result would show 1 message being consumed, then a pause of 5 seconds. Then message 2 coming in synchronously.
Actual Behavior
Test result: Messages are consumed asynchronously. From sample application (consumer) output:
`Waiting to consume. Press any key to exit.
2018-02-12T21:25:11.5423980-05:00 BEGIN - Consume message 1
2018-02-12T21:25:11.5454120-05:00 BEGIN - Consuming message 2
2018-02-12T21:25:11.7465431-05:00 END - Consuming message 2
2018-02-12T21:25:16.5428798-05:00 END - Consume message 1`
Please advise if we are misunderstanding UseConcurrencyLimit wrongly. Thank you in advance!

I've tried to reproduce the issue you're seeing six different ways and I can't. I always see the behavior of the concurrency limit filter doing exactly what it should be doing.
I modified this test to mirror what you have in your example above and I can't break it.
https://github.com/MassTransit/MassTransit/blob/develop/src/MassTransit.RabbitMqTransport.Tests/ConcurrencyFilter_Specs.cs#L22

The issue is that multiple message types are being received on the endpoint, and there is a concurrency limit per message type configured, instead of a single shared concurrency limit across all receive endpoints. This is due to how the pipeline is created, where the ConsumeContext filters are apparently being applied to each message type instead of to the pipeline prior to the dynamic filter.

Thanks Chris!


Fix rustfmt lint

What type of PR is this?
/kind failing-test
What this PR does / why we need it:
Running make lint-rustfmt to fix-up the CI. Unfortunately, I forgot to double check this with the latest merge :grin:
Which issue(s) this PR fixes:
None

Special notes for your reviewer:
None
Does this PR introduce a user-facing change?

None

/lgtm


RFC: bin/run: Add --reporter-options

This PR depends on tapjs/tap-mocha-reporter#49; review that first.
This is inspired by Mocha's:
  --reporter-options <k=v,k2=v2,...>

Except:

I'm using a JSON value for easier parsing and more explicit typing.  This will end up using a few more characters, but the format is more explicit than Mocha's (which only uses string values?).  And callers are likely to already be familiar with JSON, so we save the mental overhead of teaching them a new serialization format.

I'm using a reporter namespace.  This allows us to add other namespaces in the future to address other configurable aspects of tap-mocha-reporter's Formatter.  For example, we could use this same CLI option to configure the runner.

Somewhat related to this, if we have plans for allowing multiple reporters (#335), we may want to namespace those now.  For example:
  --reporter-options {"reporter": {"progress": {"open": "(", "close": ")"}}}

to avoid the issues Mocha bumped into when trying to add multi-reporter support.

There's already --reporter-arg=<arg> or -r<arg>which can be set multiple times.  It's passed as arguments to the reporter constructor, if it's a stream module, or set as command-line arguments if it's a CLI program.
Try it out!  tap -Rtap-parser --reporter-arg=-t --reporter-arg=-f, and it'll spit out flattened TAP.
I'm more likely to port reports out of tap-mocha-reporter than add more functionality over there, tbh.


changed default interval limits to 95

Pull Request Test Coverage Report for Build 464

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 97.555%

Totals

Change from base Build 462:
0.0%

Covered Lines:
2593

Relevant Lines:
2658

💛  - Coveralls


No template found for BSD-2-Clause

Hi,
my knowledge of rust is exactly zero so sorry if this is something obvious. One of the packages I'm running this on (retworkx) has a dependency on numpy where I'm getting the following error:
[2021-12-11T17:23:33Z WARN  bundle_licenses_lib::found_license] No template for BSD-2-Clause license in numpy:0.15.0 - /Users/bastianzimmermann/.cargo/registry/src/github.com-1ecc6299db9ec823/numpy-0.15.0/Cargo.toml

I would assume that this is from the template check mentioned in the readme. I can find BSD-2-Clause in here but no idea if this is the right place to look and if something should be changed here: https://github.com/sstadick/cargo-bundle-licenses/blob/f824e2f97ba9372b87ae116f7f5f1591c20fba74/src/license.rs

Thanks for making an issue! (I'm answering both questions in this one response).
Some templates are very finicky / tricky with extra clauses and such, as noted in your apache issue, so I've erred on the side of producing warnings and having the user copy paste in known good licenses which should then be copied forward for you on future runs of the program.
This is actually the code that largely deals with the license templates. So you would need to add the template in the licenses dir and update that match block. I will try to write up a small "How to make a PR and add a license" section to the README because I'm sure there will be more licenses that people care about in the future.
PRs are very welcome!

Thanks for your answer. And thanks for the tool by the way. I found several PRs adding rust packages and it seemed to be a mess before this...

Some templates are very finicky / tricky with extra clauses and such, as noted in your apache issue, so I've erred on the side of producing warnings and having the user copy paste in known good licenses which should then be copied forward for you on future runs of the program.

Understood and that's what I've largely been doing. I'll create a PR for BSD-2-Clause but as mentioned have never programmed in rust before so please double check any changes. :)
How should I proceed with Apache 2 because there already is a template? Different names or what do you think is the best approach?

I will try to write up a small "How to make a PR and add a license" section to the README because I'm sure there will be more licenses that people care about in the future.

I think I can follow your explanation here now but that would probably be great for others. I'll make a mental note to add this to the conda-forge docs, if you don't mind.

Thanks for making the PR, I'm running the CI checks now 👍  Agreed on the other methods of License gathering for Rust projects in Conda forge.

Regarding Apache 2.0, that's super annoying. Looking here https://spdx.org/licenses/Apache-2.0.html the appendix looks standard, but looking at the XML of the licenses in Github that section of the appendix is listed as optional. It also kind of seems like only the paragraph saying how to apply the license is optional and the text of the next two paragraphs should be present.

I will set things up to modify the template to see if removing the:
   APPENDIX: How to apply the Apache License to your work.

      To apply the Apache License to your work, attach the following
      boilerplate notice, with the fields enclosed by brackets "[]"
      replaced with your own identifying information. (Don't include
      the brackets!)  The text should be enclosed in the appropriate
      comment syntax for the file format. We also recommend that a
      file or class name and description of purpose be included on the
      same "printed page" as the copyright notice for easier
      identification within third-party archives.

text from the template allows for matching both types. If not, I'll leave it as is for now since github auto-generates the long form license https://github.com/sstadick/TestLicese/blob/main/LICENSE and leave the apache2 issue you made open to be investigated when looking at pulling the licenses text sources from the github spdx repo where optional sections are appropriately marked.

I'll fix the REAMDE sometime in the next few days to add better instructions for PRs. Feel free to link this tool anywhere, I fully intend to be supporting it for others, as well as for my own present and future tools in conda-forge 👍

I will check out the grayskull implementation! Thanks for pointing that out. I haven't used grayskull yet.
See v0.4.0 for the BSD update. I'll ping you here when the README is also updated 👍

Awesome, thanks for your quick help here!

Hi @sstadick just a quick note here, I just stumbled upon this tool which should do the heavy lifting for the license matching: https://github.com/spdx/spdx-license-matcher

They are pulling the SPDX liceses it looks like, which I'm not totally opposed to doing, it's just pretty different than the existing internal structure of this tool.
The next time I publish a tool on conda I'm sure I'll be revisiting this and will investigate that route as well :+1: For the time being the semi-manual "copy-paste anything not covered by this tool" doesn't seem too painful for me.

Yeah makes sense. Definitely, the current setup seems to be working well so would also stick with it, I just saw it and wanted to mention it for completeness. :)

Totally! And please keep adding to this thread as you find more stuff! It is appreciated


tap?

It feels like _.tap is missing (map without the need to remember to return?)

An alias for 'doto' would be great. Often I don't change the object and in these cases 'tap' would make more sense.
Also: I was searching for a 'tap' method on the HL API page, couldn't find one and found this page via Google. There a probably other people, besides me and dweinstein, who search for 'tap' on the API page.
Btw., thanks a million for creating HL!

_.tap is much more comprehensive.

I'd support tap as an alias for doto to match other libraries.
@StreetStrider, what do you mean by "more comprehensive."
On Feb 17, 2015 12:42 AM, "Strider"<EMAIL_ADDRESS>wrote:

_.tap is much more comprehensive.
—
Reply to this email directly or view it on GitHub
https://github.com/caolan/highland/issues/109#issuecomment-74546206.

+1 tap aliasing doto

Anybody want to write the (two lines of) code to do this? ;)
+1 tap aliasing doto
—
Reply to this email directly or view it on GitHub
https://github.com/caolan/highland/issues/109#issuecomment-74604266.

@vqvu, I mean tap is simple and one-word name, instead doto is compound. tap means something that intercepts a transmission and do not change the message. doto sounds like «to do something to transmitted message» and much more looks like map.
I also prefer tap, because LoDash, for instance uses this name in it's chaining syntax in analogous role.

@StreetStrider I think you meant "comprehensible" rather than "comprehensive"

@quarterto, yes, that is my mistake, thanks for the tip.

Yep, +1 on this. While I can appreciate the logic of why it's named doto I think it would be better to be in line with the common naming convention of most libs.


1.21 Support

Mod needs to be updated to work with 1.21 :)

Yes, I really want to see him at 1.21

Sooo, no development on this mod anymore?

Ну что, эта мода больше не разрабатывается?

Why? Perhaps the developer has encountered problems and cannot update the mod right now

Currently, other projects and mods are being dealt with at the moment. Seamless is planned to be updated but such may be some about of time. I have yet to look at the changes nor look at the bugs to attempt fixes so please be patient.

Such has been done, uploaded to both modrinth and curseforge


model_kwargs["input_ids"].shape[0], peft_config.num_virtual_tokens KeyError: 'input_ids'

System Info
peft 0.6.2
pytorch 2.0.1
transformers 4.35.2
python 3.11
Who can help?
No response
Information

[x] The official example scripts
[x] My own modified scripts

Tasks

[X] An officially supported task in the examples folder
[X] My own task or dataset (give details below)

Reproduction
device = "cuda:6"
model_name_or_path = "./Model/t5-base"

peft_config = PromptTuningConfig(
    task_type=TaskType.CAUSAL_LM,
    prompt_tuning_init=PromptTuningInit.TEXT,
    num_virtual_tokens=8,
    prompt_tuning_init_text="Generate a title for the bug report:",
    tokenizer_name_or_path=model_name_or_path
)

T5_tokenizer = T5TokenizerFast.from_pretrained(model_name_or_path)
plm = T5ForConditionalGeneration.from_pretrained(model_name_or_path)
plm = get_peft_model(plm, peft_config)

inputs = T5_tokenizer(
    f'When I tried to open the window, a crash happen. Title : ',
    return_tensors="pt",
)

plm.to(device)

with torch.no_grad():
    inputs = {k: v.to(device) for k, v in inputs.items()}
    outputs = plm.generate(
        input_ids=inputs["input_ids"], attention_mask=inputs["attention_mask"], max_new_tokens=10, eos_token_id=3
    )
    print(T5_tokenizer.batch_decode(outputs.detach().cpu().numpy(), skip_special_tokens=True))

Expected behavior
I followed the guide to do prompt tuning. https://huggingface.co/docs/peft/task_guides/clm-prompt-tuning
Instead of using the "bigscience/bloomz-560m" model in the guide, I used T5-base and modified the script slightly to fit in my task.
The training process was fine, as the loss decreased slowly. However, when I tried to use the model to GENERATE, something went wrong. This may be related to the process of passing parameters.
Here is the stack trace.
Traceback (most recent call last):
  File "/data/mqs/KeyTitle2/eval2.py", line 223, in <module>
    outputs = plm.generate(
              ^^^^^^^^^^^^^
  File "/data/anaconda3/envs/mpt/lib/python3.11/site-packages/peft/peft_model.py", line 1060, in generate
    outputs = self.base_model.generate(**kwargs)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/data/anaconda3/envs/mpt/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/data/anaconda3/envs/mpt/lib/python3.11/site-packages/transformers/generation/utils.py", line 1673, in generate
    return self.greedy_search(
           ^^^^^^^^^^^^^^^^^^^
  File "/data/anaconda3/envs/mpt/lib/python3.11/site-packages/transformers/generation/utils.py", line 2518, in greedy_search
    model_inputs = self.prepare_inputs_for_generation(input_ids, **model_kwargs)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/data/anaconda3/envs/mpt/lib/python3.11/site-packages/peft/peft_model.py", line 1074, in prepare_inputs_for_generation
    model_kwargs["input_ids"].shape[0], peft_config.num_virtual_tokens
    ~~~~~~~~~~~~^^^^^^^^^^^^^
KeyError: 'input_ids'

I referred to the peft/peft_model.py file and found nothing quite special.
I wrote a simple code sample to use the model to generate something(shown above). It produced the same issue.

I haven't checked in detail, but note that T5 is not a causal LM, could you please try task_type=TaskType.SEQ_2_SEQ_LM?

I haven't checked in detail, but note that T5 is not a causal LM, could you please try task_type=TaskType.SEQ_2_SEQ_LM?

Thank you! I think that is the point! The model in the code sample generated a word after changing the task_type.
I was a little confused by the task_type when reading the guide. Because I thought the parameter was meant to choose from different downstream tasks, such as prefix tuning, prompt tuning and semantic segmentation.
Thanks a lot!!!

Great that it worked. I'll close the issue for now, feel free to re-open if you encounter more issues.


Support non correlated scalar subqueries.

Support non correlated scalar subqueries.
Scalar subqueries are rewritten into a join in a following manner.
From:
SELECT * FROM nation WHERE regionkey = (       SELECT regionkey FROM region WHERE name = 'AFRICA'    )
into:
SELECT * FROM nation, (       SELECT regionkey FROM region WHERE name = 'AFRICA'    ) temp   WHERE nation.regionkey = temp.regionkey
Also above subquery plan is wrapped in a ScalarNode which goal is to
maintain scalar subquery returns at most single value. To achieve that
during plan fragmentation, there is a plan fragment generated
from ScalarNode so all the results of the subquery goes through one
node.
Fixes #2878.

Rebased, comments addressed, some new tests and fixes.
@electrum @martint @losipiuk Please do a review.

@martint ping

rebased

@martint  ping

@kokosing, back to you for comments

@martint I applied all your comments and rebased the patch.

Merged, thanks!


Add Timeline entry model and migration.

We need somewhere to store the timeline entries from the coronavirus_landing_page.yml within the publishing application.
It turns out that rails can handle pluralizing ‘entry’ to ‘entries’ so we shouldn’t have to specify the association between the model and the table
Has basic validation to check presence of fields. These fields don't currently match the fields in publishing-api, but that doesn't matter right now. We can do the mapping later when it's time to update the payload to publishing-api.
⚠ This repo is Continuously Deployed: make sure you follow the guidance ⚠
Trello card

@GDSNewt I don't think position is being incremented every time a new timeline entry is created. Can you add a test for it to make sure?

@GDSNewt I don't think position is being incremented every time a new timeline entry is created. Can you add a test for it to make sure?

@GDSNewt I don't think position is being incremented every time a new timeline entry is created. Can you add a test for it to make sure?

Thanks Leena, as discussed we will add this in a subsequent PR 🙂

@GDSNewt I don't think position is being incremented every time a new timeline entry is created. Can you add a test for it to make sure?

Thanks Leena, as discussed we will add this in a subsequent PR 🙂


Change layer name after training

your work on model fusion is great , and give me more inspiration. however ,there is a problem ,you change your layer name after training odd/even caffemodel,  e.g, your odd caffemodel conv1 layer name is 'conv1', after your change, this layer name is 'odd/conv1' , it will be re-trained because of caffe rules（If we provide the weights argument to the caffe train command, the pretrained weights will be loaded into our model, matching layers by name， see here）. So if you change all the layers' name, your odd/even caffemodels can't have no usage.  In fact , your fusion model is just train from scratch.
I don't know is it right , so I hope you can give me some advice.

The fusion is done by
https://github.com/frombeijingwithlove/dlcv_for_beginners/blob/master/random_bonus/multiple_models_fusion_caffe/fuse_model.py
line 19, weights are explicitly copied from seperate model


Page Resume Missing

Page "Resume" is missing in the header on all pages except for the Home page

r


Cannot install gulp

It seems that gulp requires an older version of vinyl-fs.
I cannot install an older version of vinyl-fs (like npm install<EMAIL_ADDRESS>because older versions of vinyl-fs are not compatible with the latest version of node/npm (npm ERR! notsup Not compatible with your version of node/npm<EMAIL_ADDRESS>)
So I am stuck unable to install  gulp because gulp requires specific older versions of vinyl-fs which are not compatible with newer version of node/npm.
Anyone have a solution for this so I can install gulp?
Thanks,
David

We do not officially support prerelease versions of node.  However, the issue (and needed fix) related to the messages you are seeing is at https://github.com/wearefractal/vinyl-fs/issues/91#issuecomment-139069750


SCC Guide - Unable or unsure to run on multiple machines

This is wonderful work and I'm very grateful to find this repo. I'm having difficulty understanding how to scale to multiple networks following the SCC guide and also confused on the recommended architecture. The main issue is clients on separate servers are not finding messages from each other.
On a gcloud instance, i start the state (node server.js), broker( SCC_STATE_SERVER_HOST='[google given ip]' SCC_BROKER_SERVER_PORT='8888' node server ), and ( SCC_STATE_SERVER_HOST='[google given ip]' SOCKETCLUSTER_PORT='8000' node server ) client servers. Everything works and I can access the google given ip from anywhere.
On my localhost I start broker and client servers with the same commands with the google ips. The state server registers the brokers and workers on both machines:
Waiting 5000ms for initial scc-broker instances before allowing scc-worker instances to join
The scc-state instance is listening on port 7777
State server is now allowing scc-worker instances to join the cluster
The scc-broker instance 45a77768-c686-49f6-b79f-51b43d463822 at address ::ffff:<IP_ADDRESS> on port 8888 joined the cluster on socket qlcAdjbw6tXq6fp0AAAA
The scc-worker instance 1b75cc5e-8931-46ed-ab73-5aae6214e952 at address ::ffff:<IP_ADDRESS> on port 8000 joined the cluster on socket errAsDdh9SCCHSqYAAAB
The scc-broker instance 2c1d4737-6ede-4e48-b4ec-bea4cbc9c416 at address ::ffff:<IP_ADDRESS> on port 8888 joined the cluster on socket KwjMvKfKUR2VNfFEAAAC
The scc-worker instance 2327d3c0-7942-476e-a75a-f69857944c14 at address ::ffff:<IP_ADDRESS> on port 8000 joined the cluster on socket 2XZowZwuxkibGol_AAAD

The client server on the google ip reacts to emitting a message from the browser connecting to the google IP but the local client server does not react to emitting a message from the localhost browser connection. Both client servers are throwing:
{ SocketProtocolError: Client connection establishment timed out
    at SCClientSocket._onSCClose (/Users/34r7h/apps/xymba/node_modules/socketcluster-client/lib/scclientsocket.js:632:15)
    at SCTransport.<anonymous> (/Users/34r7h/apps/xymba/node_modules/socketcluster-client/lib/scclientsocket.js:304:12)
    at SCTransport.Emitter.emit (/Users/34r7h/apps/xymba/node_modules/socketcluster-client/node_modules/component-emitter/index.js:133:20)
    at SCTransport._onClose (/Users/34r7h/apps/xymba/node_modules/socketcluster-client/lib/sctransport.js:217:28)
    at Timeout.<anonymous> (/Users/34r7h/apps/xymba/node_modules/socketcluster-client/lib/sctransport.js:86:10)
    at ontimeout (timers.js:436:11)
    at tryOnTimeout (timers.js:300:5)
    at listOnTimeout (timers.js:263:5)
    at Timer.processTimers (timers.js:223:10)
  name: 'SocketProtocolError',
  message: 'Client connection establishment timed out',
  code: 4007 }

Am I missing something? I made one change to the broker server to use 'ws' since 'sc-uws' was giving compilation errors. Thanks!

Ah I found that by stopping the broker server on local has allowed client messages to connect to each other. So I only need one machine to run state and broker services, while other machines simply run the client servers?

https://www.youtube.com/watch?v=kzCQ6pfBzb4


Could not write header for output file #0 (incorrect codec parameters ?): Invalid argument

youtube-dl command: https://a.pomf.se/jdxxke.txt
ffmpeg command: https://a.pomf.se/mhtvxg.txt

Since in this case 'bestvideo' is a webm file and 'bestaudio' is m4a, you have to options:

Use --merge-output-format mkv
Explicity request a format with -f bestvideo[ext=mp4]+bestaudio[ext=m4a] (you can do the same with webm)

@jaimeMF
I probably should've posted the original steps I had taken in the OP, instead of the steps taken for that one video.
Originally, I was trying to download all of the videos from https://www.youtube.com/user/boburnham, and did it with youtube-dl using youtube-dl  -f bestvideo+bestaudio https://www.youtube.com/user/boburnham
When it got to https://www.youtube.com/watch?v=Eo9pU1q8sy8, it failed due to ffmpeg/merge issues.
I guess I'm requesting an option to ignore merge errors/skip the problematic video and continue on with the list of videos.
Output of youtube-dl --verbose -f bestvideo+bestaudio https://www.youtube.com/user/boburnham: https://a.pomf.se/vwfnfw.txt
I just don't think that youtube-dl should completely halt downloading due to problems with one single video.
Unsurprisingly, --continue and --ignore-errors did nothing, because from what I can tell from reading --help, they aren't intended to handle merge errors, but download errors instead, and I don't think there is an option in youtube-dl to handle merge errors.


Build Failed for nativescript-sse plugin

I have tried to create new project by the command

tns create SseApp

The app created and built successfully. Then installed the plugin nativescript-sse by the command

tns plugin add nativescript-sse

The plugin installed successfully and unfortunately the build gets failed. Please find the attached log file of the app build failure.
log.txt
Please kindly help.

Can you please try updating again there was a fix release i believe that version you got had the typo

The build gets succeeded and after I have followed the same link https://github.com/NickIliev/NS-Issues-2018/tree/master/others/t_1161642/app but when building the app I got some error like

Cannot read property 'extend' of undefined

Please find the attached log file and kindly look in to it also help us by solving the problem.
log.txt

It doesn't find the class 🤔

Am I missing something or any issue with the library?
From: Osei Fortune<EMAIL_ADDRESS>Sent: 18 April 2018 19:18
To: triniwiz/nativescript-sse<EMAIL_ADDRESS>Cc: Vigneshraagav Paulsamy<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [triniwiz/nativescript-sse] Build Failed for nativescript-sse plugin (#11)
It doesn't find the class 🤔
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/triniwiz/nativescript-sse/issues/11#issuecomment-382392334, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AkippMYsPYw-a62DGfdJR34zIU51nStLks5tp0QEgaJpZM4TYvZu.

I pushed a new update you can try updating before installing remove the platforms, node_modules and the package-lock it should guarantee a clean update

As you said it is a clean update, now it works fine. Thank you.
From: Osei Fortune<EMAIL_ADDRESS>Sent: 20 April 2018 11:05
To: triniwiz/nativescript-sse<EMAIL_ADDRESS>Cc: Vigneshraagav Paulsamy<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [triniwiz/nativescript-sse] Build Failed for nativescript-sse plugin (#11)
I pushed a new update you can try updating before installing remove the platforms, node_modules and the package-lock it should guarantee a clean update
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/triniwiz/nativescript-sse/issues/11#issuecomment-382982596, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AkippCGw0F1Qx-LMSyVfOqDRuALk08nRks5tqXNpgaJpZM4TYvZu.


Update repo

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@1de7ee3). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master       #1   +/-   ##
=========================================
  Coverage          ?   93.91%
=========================================
  Files             ?       28
  Lines             ?      740
  Branches          ?        0
=========================================
  Hits              ?      695
  Misses            ?       45
  Partials          ?        0

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1de7ee3...1f1b283. Read the comment docs.

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@1de7ee3). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master       #1   +/-   ##
=========================================
  Coverage          ?   93.91%
=========================================
  Files             ?       28
  Lines             ?      740
  Branches          ?        0
=========================================
  Hits              ?      695
  Misses            ?       45
  Partials          ?        0

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1de7ee3...1f1b283. Read the comment docs.


Handling of royalty during creation

Is your feature request related to a problem?
With collection royalties implemented on

#9109

we should rethink how to handle royalties on UI
Describe the solution you would like
The proposed system is

fetch collection royalty setting and prefil input
if nftRoyalty == collectionRoyalty, then on mint remove royalty attribute on nft call
if nftRoyalty !== collectionRoyalty, then set royalty attribute on item

Because I would hide set royalty on create NFT in asset hub, just to make info text

yeah this could be the simple solution since user might be confused with royalty set on collection compared to royalty set on item
Originally posted by @roiLeo in https://github.com/kodadot/nft-gallery/issues/9109#issuecomment-1907614028
Describe alternatives you have considered
Remove royalty input from create NFT ?
cc @exezbcz
Screenshots
No response
Are there opened related issues?
No response

👋🏼


Inline concatenates words from multiple lines

When I do style.Render("hello\nworld")
I am expecting 2 different words.
If I use Inline, the result is helloworld without space.
I think we want 2 separate words here, i.e. replace newlines by spaces during inline mode.
Found while working on #109.

Should we trim trailing newlines as it would add trailing spaces?

I found this behavior confusing.  Is there a way to apply just a style and leave newlines alone.  Without Inline trailing newlines are padded. With Inline newlines are removed completely.
To continue the CSS analogy I want a span and not a div.


Add 2005 player style

Hello, very cool project but lack in player style... can add style for 2005 player? THanks.

Yes mr @pixdoet there has a custom style currently running in /tests:

As you can see there has a very funny button down there ^^
Thanks for understand and fix will be added soon!

hello mr. ian there has already been commit that add 2005 player to dev branch
i will close this now thanks you for ur sugessiont.


Dutch and German translations

Hi, thanks for creating this package, excellent work.
I added translations for Dutch and German. I thought it would be nice to share.

Thanks for this PR @timwassenburg .
Feel free to contribute anytime


Remove find_in_load_path

find_in_load_path was introduced in a very early version of Zeus. It allowed you to pass a path to add_feature that is relative to something in the $LOAD_PATH, rather than an absolute path.  This made the semantics of add_feature equivalent to require. ba7c7d7a3018319d86a8c685c72f3476ff75a31f attempted to simplify this logic but actually broke it completely. The current code searches for the file in the $LOAD_PATH, which contains a list of directories so no Ruby filename will match. Things in the $LOAD_PATH should always exist so it's also duplicative of the File.exist? check.
We could roll back ba7c7d7a3018319d86a8c685c72f3476ff75a31f, but since no one has reported an issue, I suspect that code is not being relied on.  That makes some sense since it predates most Zeus adoption and the use of $LOADED_FEATURES to automatically handle most load
tracking. Instead, we can remove this feature entirely and substantially speed up tracking of files. Tracking our entire codebase on my laptop takes ~300-400ms before this diff and 80-150ms after.

cc @kgrz

r? @ptarjan

The current code searches for the file in the $LOAD_PATH, which contains a list of directories so no Ruby filename will match.

hashtag face palm
LGTM 👍


Convergence error encountered at self.enumerate_initial_shap()

Hi Dylan,
When I run BayesSHAP on my regression task, I encounter the convergence error at the self.enumerate_initial_shap function. Any idea why this happens?
I saw enumerate_initial is set to True as default which leads to this self.enumerate_initial_shap. Is it necessary to do so when performing BayesSHAP?
Also is BayesSHAP scalable to high input dimensions?
Best
Robin
Traceback (most recent call last):
  File "/home/miniconda3/envs/hpmodel/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 3441, in run_code
    exec(code_obj, self.user_global_ns, self.user_ns)
  File "<ipython-input-15-414d493a31bd>", line 14, in <module>
    e_i = exp.explain(X_bayesshap[i], **exp_kwargs)
  File "/home/Robin/BNN_Torch/bayesshap/explanations.py", line 651, in explain
    l2=l2)
  File "/home/Robin/BNN_Torch/bayesshap/explanations.py", line 457, in _explain_bayes_shap
    data_init, inverse_init = self._enumerate_initial_shap(data, max_coefs)
  File "/home/Robin/BNN_Torch/bayesshap/explanations.py", line 417, in _enumerate_initial_shap
    inverse = self.shap_info.discretizer.undiscretize(data)
  File "/home/miniconda3/envs/hpmodel/lib/python3.7/site-packages/lime/discretize.py", line 145, in undiscretize
    feature, ret[:, feature].astype(int)
  File "/home/miniconda3/envs/hpmodel/lib/python3.7/site-packages/lime/discretize.py", line 132, in get_undiscretize_values
    random_state=self.random_state
  File "/home/miniconda3/envs/hpmodel/lib/python3.7/site-packages/scipy/stats/_distn_infrastructure.py", line 980, in rvs
    vals = self._rvs(*args)
  File "/home/miniconda3/envs/hpmodel/lib/python3.7/site-packages/scipy/stats/_distn_infrastructure.py", line 913, in _rvs
    Y = self._ppf(U, *args)
  File "/home/miniconda3/envs/hpmodel/lib/python3.7/site-packages/scipy/stats/_continuous_distns.py", line 7163, in _ppf
    return _truncnorm_ppf(q, a, b)
  File "/home/miniconda3/envs/hpmodel/lib/python3.7/site-packages/scipy/stats/_continuous_distns.py", line 6933, in vf_wrapper
    return vf(*args)
  File "/home/miniconda3/envs/hpmodel/lib/python3.7/site-packages/numpy/lib/function_base.py", line 2163, in __call__
    return self._vectorize_call(func=func, args=vargs)
  File "/homeminiconda3/envs/hpmodel/lib/python3.7/site-packages/numpy/lib/function_base.py", line 2246, in _vectorize_call
    outputs = ufunc(*inputs)
  File "/home/miniconda3/envs/hpmodel/lib/python3.7/site-packages/scipy/stats/_continuous_distns.py", line 7113, in _truncnorm_ppf
    maxiter=TRUNCNORM_MAX_BRENT_ITERS)
  File "/home/miniconda3/envs/hpmodel/lib/python3.7/site-packages/scipy/optimize/zeros.py", line 780, in brentq
    r = _zeros._brentq(f, a, b, xtol, rtol, maxiter, args, full_output, disp)
RuntimeError: Failed to converge after 40 iterations.

Hello! Thanks for the question.
Would you mind providing some more detail so I can reproduce this? I don't really see why this should occur. Is this for tabular data?
It doesn't look like the enumerate_initial is causing the issue, it's the feature discretization... (but you can turn enumerate_initial off if you want to, it just tends to make the Shapley value estimation a bit better by fitting some higher weight coalitions first).
It can take a while to fit the model for large feature dimensions (that's why we use super pixels for images), so depending on how large your talking, you could potentially run into issues.


DOC: stats.invwishart: document LinAlgError raised when scale is not PD

Reference issue
Closes gh-6471
What does this implement/fix?
gh-6471 reported confusion that the error message LinAlgError: 2-th leading minor not positive definite raised by stats.invwishart meant that the scale matrix was not positive definite.
This PR resolves the issue by adding scipy.linalg.LinAlgError to the "Raises" section of the documentation.

I'm fine as-is, thanks! Just preempting a potential comment.

Merged, thanks!


Forces culture to en-US to give consistent date handling behaviour

For review.
Fixes #119.

I haven't tested this but I think the aspnet5 way of limiting to a particular culture would be by adding the following to the Startup.Configure method:
var usCultureInfo = new CultureInfo("en-US");
var requestCulture = new RequestCulture(usCultureInfo);
app.UseRequestLocalization(new RequestLocalizationOptions
{
    DefaultRequestCulture = requestCulture,
    SupportedCultures = new List<CultureInfo>(new []{ usCultureInfo }),
    SupportedUICultures = new List<CultureInfo>(new [] { usCultureInfo})
});

@ksk100 Would you like to test that out and see if it also solves the problem you were having? If that works it would give us a path to adding more cultures when we are ready.

Of course, I'll have a look.


Sorting Items A to Z

Hi,
Thanks for this great extension. It would be nice to be able to sort functions or methods alphabetically A to Z.
Kind Regards,

Hello,
on first open sorting doesn’t work A to Z.
Can you please tell me what "Pin" does?
Kind regards
René


[HOP-3606] Disabled java 11 tests

Resolves problems with some of ignored tests. Most common case is connected with new mockito argument matchers api which does not allow passing null values anymore using anyType() methods. E.g. anyString() could be replaced with nullable(String.class).
Also fixes problems with javassist incompatibility by upgrading to newest version.
Commits are divided by specific type of problems with tests.

Fixed mockito matchers, mostly by providing nullable(Class) instead 'anyType' which does not respect argument values anymore. Resolves issues:
HOP-3607, HOP-3608, HOP-3609, HOP-3610, HOP-3611, HOP-3614, HOP-3612, HOP-3624, HOP-3625, HOP-3646, HOP-3626, HOP-3630, HOP-3632, HOP-3631, HOP-3638, HOP-3639, HOP-3640, HOP-3644, HOP-3646, HOP-3649
Powermock upgrade Resolves:
HOP-3648
Upgraded Javassist for Powermock compatibility Resolves:
HOP-3637, HOP-3636, HOP-3635, HOP-3634
Added MockitoJUnitRunner Resolves:
HOP-3627, HOP-3628
Already working tests, removed ignore annotation Resolves:
HOP-3615, HOP-3616, HOP-3617

Seems that builds are failing because of an "An illegal reflective access" warnings.
This is common case when using things like powermock and reflective manipulation libraries in java 11 and above.
The question is - is it will be good enough to use "--illegal-access=permit/warn" flag in surefire plugin?
Or should we rather try to find another way to solve the problem with mocking/reflective manipulation libraries (probably will require much more refactoring)?
The first path could fit well in java-11 release. However, in java-17 the flag is removed and "--add-opens" seems to replace the behaviour but requires providing explicitly in argument which packages are opened for manipulation.
Surprisingly at the moment "--illegal-access=permit" is used by surefire plugin in root pom.xml, but seems to not work for submodules during github build?

for now I would go for the flag, we can take a look at a later stage to get these warnings gone.

I would go with the flag for now, however, keep in mind this will create one dependency when we upgrade hop to java 17.

After investigation build failure reason seems that '-illegal-access=permit' defined already in root pom.xml seems to work well and causes exactly that 'error' like warning which is not real build failure cause.
The real cause is in hop-transform-checksum CheckSumMetaTest.testSerialization
...
[ERROR] Tests run: 4, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 5.091 s <<< FAILURE! - in org.apache.hop.pipeline.transforms.checksum.CheckSumMetaTest
...
'Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M5:test (default-test) on project hop-transform-checksum: There are test failures.  '

The test was not marked as @Ignored before.
At first glance the test runs well on local machine. But then I tried to run it multiple times and it started failing after few repeats in a non deterministic way. Maybe case this needs separate bugfix?

Hi, thanks for all your commits :). I would say if this is a test that was failing before, separate the PR into two.... commit what u have fixed so far, and another one for the remaining...

@gvdutra thank you i reported a bug and separate PR for that that as u suggested
https://github.com/apache/hop/pull/1304

Thank you so much for this PR @pscigala !


Convert test suite to hspec

In preparation for adding a bunch more tests, is it OK if we convert the test suite to use hpec? It has some pretty nice features.

I like hspec! 👍


Terraform 0.14 upgrade

what

Upgrade to support Terraform 0.14 and bring up to current Cloud Posse standard

why

Support Terraform 0.14

/test all

/test all

Any progress on this merging? Actively waiting on it, thanks.

Any progress on this merging? Actively waiting on it, thanks.

Hi @maximmi
This merge (as released with v0.9.0 of this module) does not seem to work with terraform 0.14.4 for me:
Initializing modules...
Downloading cloudposse/ses/aws 0.9.0 for ses...
- ses in .terraform/modules/ses
Downloading cloudposse/iam-system-user/aws 0.16.0 for ses.ses_user...
- ses.ses_user in .terraform/modules/ses.ses_user
Downloading git::https://github.com/cloudposse/terraform-null-label.git?ref=tags/0.19.2 for ses.ses_user.this...
- ses.ses_user.this in .terraform/modules/ses.ses_user.this
Downloading cloudposse/label/null 0.22.1 for ses.this...
- ses.this in .terraform/modules/ses.this
Error: Unsupported Terraform Core version
  on .terraform/modules/ses.ses_user.this/versions.tf line 2, in terraform:
   2:   required_version = ">= 0.12.0, < 0.14.0"
Module module.ses.module.ses_user.module.this (from
git::https://github.com/cloudposse/terraform-null-label.git?ref=tags/0.19.2)
does not support Terraform version 0.14.4. To proceed, either choose another
supported Terraform version or update this version constraint. Version
constraints are normally set for good reason, so updating the constraint may
lead to other errors or unexpected behavior.

Hi @maximmi
This merge (as released with v0.9.0 of this module) does not seem to work with terraform 0.14.4 for me:
Initializing modules...
Downloading cloudposse/ses/aws 0.9.0 for ses...
- ses in .terraform/modules/ses
Downloading cloudposse/iam-system-user/aws 0.16.0 for ses.ses_user...
- ses.ses_user in .terraform/modules/ses.ses_user
Downloading git::https://github.com/cloudposse/terraform-null-label.git?ref=tags/0.19.2 for ses.ses_user.this...
- ses.ses_user.this in .terraform/modules/ses.ses_user.this
Downloading cloudposse/label/null 0.22.1 for ses.this...
- ses.this in .terraform/modules/ses.this
Error: Unsupported Terraform Core version
  on .terraform/modules/ses.ses_user.this/versions.tf line 2, in terraform:
   2:   required_version = ">= 0.12.0, < 0.14.0"
Module module.ses.module.ses_user.module.this (from
git::https://github.com/cloudposse/terraform-null-label.git?ref=tags/0.19.2)
does not support Terraform version 0.14.4. To proceed, either choose another
supported Terraform version or update this version constraint. Version
constraints are normally set for good reason, so updating the constraint may
lead to other errors or unexpected behavior.

@vdmkenny fixed in version 0.10.0

@vdmkenny fixed in version 0.10.0


Method Codesleeve\LaravelStapler\Commands\FastenCommand::handle() does not exist

i received this error while giving  php artisan stapler:fasten users profile

This is because commands now need to have a 'handle' method (renamed from 'fire')


Added another rule for missing SRI

What?
We were waiting to hear from lab for gene to be confirmed for one of the missing SRIs from Leeds,(detected during CASREF Refresh) so now it's added in this PR.
Why?
Fiona wanted to be sure if the combination of moleculartestingtype and indicationcategory is meant for MLH1 and asked lab to confirm. Today email has been answered by Rachel from Leeds.
How?
Rules have been updated to include above combination to determine gene.
Testing?
Have run locally and now query return expected result of 3845 -
select count(distinct(servicereportidentifier)) from restricted_results_all where original_filename like '%MMR%';
 count
-------
  3845
(1 row)

Anything else ?
For reference email dated 22 July 2024 from Fiona "FW: Leeds CRC SRIs" can be seen.

LGTM


Ci

Made the ci.yml

@dynamite-bud this PR should only introduce the ci.yml file. You will need to either git cherrypick or do an interactive rebase to remove all the commits from #11.


add default_language_only option to build default language only

see issue #32 for more details

cc @stanzilla could you try this and report back please?

Okay so I tested it and something seems to be not quite right:
mkdocs build with:
   - i18n:
       default_language: !ENV [DEFAULT_LANGUAGE, "en"]
       default_language_only: !ENV [DEFAULT_LANGUAGE_ONLY, true]
       languages:
         fr: Français (Beta)

52.3 seconds
and with the plugin commented out fully it's 17.06s

Okay so I tested it and something seems to be not quite right:

Can you show the exact command you used and the build output?

Okay so I tested it and something seems to be not quite right:

Can you show the exact command you used and the build output?

Yes, sir.

Very interesting, what about the time to build the whole site, languages included?

Very interesting, what about the time to build the whole site, languages included?

77.59s with
      default_language: en
      default_language_only: false
      languages:
        fr: Français (Beta)

Ok so it's better, but not enough ahah, let me think about it

Ok @Stanzilla try again please, that should be way better now

Ok @Stanzilla try again please, that should be way better now

28.75s!

Does that count as a green light? ;)

Does that count as a green light? ;)

I think so! I mean it's still an extra 10s but that is only on the first run of serve and for a full build I don't care as much since it is running in CI. I will test drive it some more and see if my contributors complain again :)
Thank you so much for the very quick turnaround on this!


avutil missing

@lucaro any clue what causes this?
11:09:10.057 [Thread-2] INFO  org.vitrivr.cineast.core.config.Config - config loaded
OpenJDK 64-Bit Server VM warning: You have loaded library /tmp/BridJExtractedLibraries539660464557911178/libbridj.so which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c ', or link it with '-z noexecstack'.
Sep 14, 2016 11:09:10 AM org.bridj.BridJ log
INFORMATION: Library not found : avutil
BridJ: dlopen error when loading avutil : avutil: Kann die Shared-Object-Datei nicht öffnen: Datei oder Verzeichnis nicht gefunden
Sep 14, 2016 11:09:10 AM org.libav.bridge.LibraryManager getInstance
SCHWERWIEGEND: unable to load native libraries
java.io.FileNotFoundException: Library 'avutil' was not found in path '[libav, null, ., /home/christian/bin, /home/christian/.local/bin, /usr/local/sbin, /usr/local/bin, /usr/sbin, /usr/bin, /sbin, /bin, /usr/games, /usr/local/games, /snap/bin, /usr/java/packages/lib/amd64, /usr/lib/x86_64-linux-gnu/jni, /lib/x86_64-linux-gnu, /usr/lib/x86_64-linux-gnu, /usr/lib/jni, /lib, /usr/lib, /usr/lib/jvm/java-8-openjdk-amd64/jre/bin, /lib/x86_64-linux-gnu, /usr/lib/x86_64-linux-gnu, /usr/lib64, /lib64, /usr/lib, /lib, /usr/local/lib]'
at org.bridj.BridJ.getNativeLibrary(BridJ.java:924)
at org.bridj.BridJ.getNativeLibrary(BridJ.java:901)
at org.bridj.BridJ.getNativeLibrary(BridJ.java:513)
at org.libav.avutil.bridge.AVUtilLibrary.(AVUtilLibrary.java:61)
at org.libav.bridge.LibraryManager.(LibraryManager.java:71)
at org.libav.bridge.LibraryManager.getInstance(LibraryManager.java:141)
at org.libav.avformat.FormatContextWrapperFactory.(FormatContextWrapperFactory.java:38)
at org.libav.DefaultMediaReader.(DefaultMediaReader.java:62)
at org.vitrivr.cineast.core.decode.video.JLibAVVideoDecoder.(JLibAVVideoDecoder.java:57)
at org.vitrivr.cineast.core.config.DecoderConfig.newVideoDecoder(DecoderConfig.java:49)
at org.vitrivr.cineast.core.run.ExtractionJobRunner.run(ExtractionJobRunner.java:418)
at java.lang.Thread.run(Thread.java:745)
Exception in thread "Thread-2" java.lang.ExceptionInInitializerError
at org.libav.DefaultMediaReader.(DefaultMediaReader.java:62)
at org.vitrivr.cineast.core.decode.video.JLibAVVideoDecoder.(JLibAVVideoDecoder.java:57)
at org.vitrivr.cineast.core.config.DecoderConfig.newVideoDecoder(DecoderConfig.java:49)
at org.vitrivr.cineast.core.run.ExtractionJobRunner.run(ExtractionJobRunner.java:418)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at org.libav.avformat.FormatContextWrapperFactory.(FormatContextWrapperFactory.java:38)
... 5 more

Especially since nothing in the build.gradle looks like it's loading that library

JLibAV has native dependencies which need to be present in order for the video decoder to work. What operating system (version) are you using?

linux-x86_64 Ubuntu

which Ubuntu?

Ubuntu 16.04.1 LTS

hmm, too bad, the video decoder is not compatible with the libav/ffmpeg version bundled with 16.04. On 14.04 it would have been sufficient to install the following packages:
libavcodec-dev libavutil-dev libswscale-dev libavformat-dev libavresample-dev
but in 16.04 they are to new for the library which has not been updated in a while. You can install them anyway, when you do it will give you more information about the expected version of the needed libraries. You will have to provide them in your class path in order for the extraction to work.

ok I will try it. Thank you!

Closing

Reopening Issue since it doesn't work on a fresh install 16.04
Exception in thread "main" java.lang.UnsatisfiedLinkError: Unsupported version of the avutil native library. (51.x.x <= required <= 52.x.x, found 54.31.100)
at org.libav.avutil.bridge.AVUtilLibrary.(AVUtilLibrary.java:75)
at org.libav.bridge.LibraryManager.(LibraryManager.java:71)
at org.libav.bridge.LibraryManager.getInstance(LibraryManager.java:141)
at org.libav.avformat.FormatContextWrapperFactory.(FormatContextWrapperFactory.java:38)
at org.libav.Default

Yes, as stated in my reply from September 14th, JLibav is quite old and no longer compatible with the libraries shipped with ubuntu 16.04. There is not really much that can be done about this short of adopting the JLibav project, which is not a viable option. To overcome this problem, I added an ffmpeg-based decoder which should work just fine...

There is a new Bridge here: https://code.google.com/archive/p/jlibav/ which has the following dependency: https://mvnrepository.com/artifact/com.nativelibs4java/bridj/0.7.0. However, this breaks the whole Decoder

The version of jlibav used (0.2.1) is the most recent one. The project is simply not updated anymore (https://github.com/operutka/jlibav/issues/2) and sadly no longer compatible with the current libav/ffmpeg API.

The FFMPEG Decoder works, thank you!


Support also zeus version

zeus version is working properly, no reason not to include it in the compatiable list.

As you pointed out.
The zeus version also works fine.
I could only confirm the version of Danfell.
Thank you very much.


message-parser: trailing punctuation including periods are included in urls/links extracted from messages

Description

Here is the description of the problem Origin issue
When I started to fix it, I found that there was also a problem in the project message-parser.

Steps to reproduce
As of the 6.0.0-develop version I tested with, this problem still exists

closing in favor of: https://github.com/RocketChat/Rocket.Chat/issues/28314
thanks for contributing, we are following up on that issue


[Gardening] Move a recovery test

Resolves rdar://38225184

@swift-ci please smoke test and merge


Bumping up google.golang.org/protobuf v1.30.0 to v1.33.0

Change to bump up a Dependabot fix for protobuf, that could not be automatically cherry-picked into this branch (different dependency versions causing a conflict).
Original PR: https://github.com/openshift/installer-aro-wrapper/pull/101
Test Plan:

Dev image including this change was tested to be able to create a cluster in a local RP.
Check the protobuf vulnerability is not present in quay in the dev image: https://quay.io/repository/mabadper/aroinstaller/manifest/sha256:1b9012035b0f956ca121db38956c0f743d47b23064aafe034be2e16fd812162f?tab=vulnerabilities

/LGTM

/approve


Mark pipelined_mult inputs as @data

This should prevent default zero generations and help frequency significantly.

LGTM!


Add project-BOMS-Probs.md

team leads:

Roozbeh Alishahian @RoozAUofT
Mahyar Rajabi @Mahyar-rajabi94
Sartaaj Khan @sartaajkhan
Mehrad Ansari @mehradans92
Xu Chen
Maryam Ebrahimiazar
Contributers:
Seyed Mohamad Moosavi
Mohammad Zargartalebi
Hanie Rezaei

Great! Thanks for the submission. Looks like a large team - but seems most people know each other/work together already. I changed to general, since it seems to have more of a coding/implementation focus, but feel free to edit back otherwise.


HDDS-3762. Intermittent failure in TestDeleteWithSlowFollower

What changes were proposed in this pull request?
Intermittent failure in testDeleteKeyWithSlowFollower seems to be caused by:

DeleteBlocksCommandHandler increments invocationCount near the beginning of handle(), and only updates deleteTransactionId later
TestDeleteWithSlowFollower waits for invocationCount >= 1, then asserts deleteTransactionId also increased

The test is fixed by changing the order in the handler: only increment invocationCount at the end, when deleteTransactionId is already updated.
I think invocationCount should be updated together with totalTime to provide (slightly more) correct average run time (getAverageRunTime).
https://issues.apache.org/jira/browse/HDDS-3762
How was this patch tested?
Passed 50x:
https://github.com/adoroszlai/hadoop-ozone/runs/1059570465#step:5:4
Regular CI:
https://github.com/adoroszlai/hadoop-ozone/runs/1059560880

Thanks @adoroszlai for the contribution.

Thanks @bshashikant for reviewing and committing it.


restart the application manager controller if there is a hub kubeconf…

…ig change
Signed-off-by: Xiangjing Li<EMAIL_ADDRESS>https://github.com/stolostron/backlog/issues/26180

/lgtm


angular2/forms: Validators.required is missing

Hi everyone,
typescript Validators.required seems to be missing from angular2.d.ts.
Also something I don't understand is why I have to import Validator from angular2/angular2 and not angular2/forms?

We have an internal package structure which is angular2/[component], and it's possible to access some angular internals by importing from there. The public API surface is all re-exported into the angular2/angular2 namespace.
Thanks for reporting the issue, I opened https://github.com/angular/angular/issues/3175 to track.


Add Entry.GetKeyBytes() method

Related to #163, #261 and #266.
Since the string encoding in Zip archive is such a great pain, is it possible to provide a byte[] which contains raw bytes of file name without decoding, so the user can employ other libs (e.g. Chardet) to process it later?
If you think it's okay, I am happy to do it and then open a PR :-)

Yeah, you should be able to do that.  It’s just raw bytes before I try to do something.
A PR with Chardet sounds cool

Using some custom decoder function on ArchiveEncoding with the changes in this PR would be good: https://github.com/adamhathcock/sharpcompress/pull/274

Solved with 0.18

Just to mention, there is a better and newer library for detecting encoding: https://github.com/CharsetDetector/UTF-unknown :P

Hah.  I had already started but this seems better and exactly the same as I'd do.


Basically just doesn't work. At all.

https://github.com/user-attachments/assets/6d99270e-263e-4091-8057-8ed495619d7d

same, Sonoma 14.6.1 on x64

Same, Sonoma 14.6.1 @arm64

Same problem, m3 pro Sonoma 14.5 (23F79)

Same, m3 pro Sonoma 14.3 😢

Just download the official arm64 image from Microsoft https://www.microsoft.com/en-us/software-download/windows11arm64

https://massgrave.dev/windows_arm_links

I had the same problem, solved by turning on vpn, apparently it was just a 403 from the image site


Prohibit some Random usage patterns

Math.abs(random.nextInt()) doesn't guarantee positivity
random.nextInt() % x
new Random() should never be used, ThreadLocalRandom.current() or SplittableRandom instead.

I also replaced most new Random(SOME_CONSTANT_SEED) in benchmarks with ThreadLocalRandom.current() because benchmarks shouldn't generally be always identical, randomness between the runs could make results statistically more reliable.

@leventov Can you fix conflicts?

@jon-wei fixed


Bug: Invite email template not sanitising/escaping values

If your blog title contains a " you will not be able to send an invite email.
Steps to Reproduce

Add a " character to the title of your blog
Try to send an invite, you will get an "Invite not sent, please try again" message.

In the logs you will see:

Warning: Error sending email: SenderError: Mail from command failed - 501 Syntax error Please check your email settings and resend the invitation.

The " character is somehow causing a syntax error when sending email.
As well as checking this case, we should ensure that the fix is applied to all values passed to all email templates.
Technical details:

Ghost Version: 0.11.8
Node Version: 4

Note: The error only happens because the blog title is used for the from field.
If you pass any quotes for the email template e.g. invitedByName: katharina", it doesn't matter.

Closed via #8453


Hide already chosen elements from completer

Reproduce:

Type c into field.
Select CSS and press Enter.
Type c into field. See CSS is proposed again.

This is one of 2 separate issues from #16749

A workaround mentioned in #16749


Created a infographic for wiki

Issue that this pull request solves
Closes: # (issue number)
Proposed changes
Brief description of what is fixed or changed
Types of changes
Put an x in the boxes that apply

[ ] Bugfix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Documentation update (Documentation content changed)
[ ] Other (please describe):

Checklist
Put an x in the boxes that apply

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[x] My changes generate no new warnings

Screenshots
Please attach the screenshots of the changes made in case of change in user interface
Other information
Any other information that is important to this pull request

There is a .png file in the images folder also. How can I remove the one which is outside the folder

From: Rohit Potter<EMAIL_ADDRESS>Sent: 26 March 2020 08:37
To: rpotter12/whatsapp-play<EMAIL_ADDRESS>Cc: Saksham Agarwal<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [rpotter12/whatsapp-play] Created a infographic for wiki (#255)
@rpotter12 commented on this pull request.

Share images in PR's comment.
Mention issue number in PR.
why you have included .png image outside images folder??

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/rpotter12/whatsapp-play/pull/255#pullrequestreview-381673883, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AHMPM2VTVRSQSJ7WDBS5HS3RJLBGNANCNFSM4LTSF6JQ.

Issue no #251


Closing this. The point of this PR was to confirm the E2E tests (ubuntu, headless) seem flakier with a more recent version of browsers.


set directive order for tailscale_auth

Now that we require Caddy 2.8, we can use the new RegisterDirectiveOrder func to specify the ordering of the tailscale_auth directive, rather than instructing users to set it manually.

Added an optional nit, also the examples still use the order directive

oh, good catch.  I really love how simple these example files are getting as we remove more unnecessary config!


STAT-81 ⁃ Database Limiting

Will track bytes for a code account as rows are stored, updated, and removed.  Each row's bytes will be calculated by the byte size of the passed in data plus a configured size ("row-overhead-db-limit-bytes") to account for scope, code, table, and key storage.  If we are not applying a received block, if the configured max storage ("per-code-account-max-storage-db-limit-mbytes") is exceeded, an exception will be thrown.
Acceptance Testing:

Write a contract that creates rows (store_),  modifies rows (store_ and update_), and deletes rows (remove_) at varying amounts
Set the "per-code-account-max-storage-db-limit-mbytes" to 1 (MB).
Verify that a limit can be reached and:

creates are rejected
modifies with larger new data are rejected
modifies with smaller new data are accepted
deletes are always accepted
creates or modifies in subsequent init are rejected

if testing with multiple nodes, after limit is reached, and blocks have been propogated, on a different node verify that:

creates are rejected
modifies with larger new data are rejected
modifies with smaller new data are accepted
deletes are always accepted

➤ Kevin Heifner commented:
[~admin] At the very least we need max table usage size by contract enforced. Assuming delta rate limit is handled by time limit. Do you have any additional requirements?

➤ David Moss commented:
[~kevin.heifner] Those are the current requirements. Let's get them implemented, then when we stand up the Testnet, we can write spamming scripts to see if this is adequate.

➤ Brian Johnson commented:
Tests are in place, going to rebase to master and submit pull request.

➤ Kevin Heifner commented:
https://github.com/EOSIO/eos/issues/353

➤ Bezwada Satyapravin commented:
I am not sure how to test this. Needs more information and detailed steps.
What I understood:

Create a smart contract that inserts data and if size of data exceeds a limit, it should reject.

Then I have questions:

If a db operation is rejected, how do I know how much of limit is available?

➤ Brian Johnson commented:
There is currently no way to retrieve that information from the eosd.  To know exactly how much memory is available, you will need to calculate the size of your rows (using the row calculation added to the ATC) and determine what the remainder is when you have approached the 1MB limit.

Ideally storage usage is not something that a contract can query, it is a limit set for "abuse purposes" but in theory we could change the rate limiting/billing algorithms in the future and it would be a shame to have to enforce all the old rules / calculations for ever.
Rate limits can only ever fail a transaction and they can never be tested or "branched upon".

➤ Brian Johnson commented:
test contract looks good

➤ Bezwada Satyapravin commented:
I implemented attached contract and after pushing the contract to eosd, I use the attached script to send multiple messages to eosd. I think it exceeds 5 MB but don't see any errors reported.
Attached are following:

smart contract implementation.
script to send messages in a loop.
picture of block and blockchain folder in data-dir of eosd.

➤ Brian Johnson commented:
[~pravin.bezwada] Since there is an automated test that verifies that the limit is reached, can we get the contract changed to print the: key, size of key string (which is passed into store_xx or update_xx, or remove_xx), and size of value buffer  (which is passed into store_xx or update_xx)
so that the calculation can be verified. Also, if you can keep going to see if a limit can be reached (as long as testing doesn't take too long)
The other option is if you could analyze my automated test and see if you can identify why that calculation works out right and your contract doesn't (or if my code incorrectly determines the limit being reached).

Verified.


[4.1.x] do not add route or sidebar content if it already exists

This PR separates from #2537 only this bit of logic - that the sidebar-content and route commands do not introduce duplicates when called.

A new inspection was created.

The inspection completed: 8 new issues, 3 updated code elements


Feat/wwise file location resolver hook

This PR makes ME2 also facilitate wwise bnk replacements for Elden Ring (tested v1.10.0) and AC6 (tested 1.03.1 through 10.5.0).
It does so by pattern matching for a function in the games that seems responsible for providing either an EblFileOperator or a plain disk-backed FileOperator implementation. If a file operator implementation is requested for a bnk this hook asserts if there is a replacement file and will swap the EblFileOperator for the disk-backed one.
There is a lot to be said about the replacement detection. It's messy, it's bad and it's a lot of hand-wavy code that relies on the convention of FromSoftware developers. There is nothing I can think of to improve this and I'm open for suggestions.
I also feel like it's inefficient to always be doing a full set of filesystem lookups but it seems the hooked functions are called infrequently enough to not cause a significant performance hit.

I managed to recover the link for the IAKFileLocationResolver::Open from browser history: https://www.audiokinetic.com/en/library/2021.1.14_8108/?source=SDK&id=class_a_k_1_1_stream_mgr_1_1_i_ak_file_location_resolver_abc328bc9dcf4120e8a0f427e287335e5.html#abc328bc9dcf4120e8a0f427e287335e5
This the function that is being hooked if I'm not mistaking. Since the API is defined by Wwise itself I don't think this code is very likely to change in a significant manner for either of the two games. Although it seems this function has been scrapped in favor of something else in edge builds of AK/Wwise so upcoming games might need a different strategy.


fix: memory leak in TransformNormalModuleFactoryPlugin

Problem: plugin wraps createLoaderContext without checking if it was
already done before. As a result, in a watch mode more and more wrappers
get added on top of the function and eat more and more memory. Fixed by
saving original function on module instance itself and wrapping saved
function instead.
Fixes #409

@SevInf thank you for finding this.
I'm increasing the timeout again in another PR for all tests since travis isn't reliable testing full webpack builds.


Initial version of RecordIterator and MergeJoin rewrite.

@jacques-n @StevenMPhillips @jaltekruse

Can you add some tests for the iterator? For example, I want to make sure we're not holding onto batches longer than is necessary, that having schema changes or weird iteroutcomes works well, etc.


Attacker.List Add Issue

If the list is empty, it adds the first person it fights with to the list, but when it attacks someone new, it doesn't add them to the list. I tried adding this manually as ATTACKER.ADD= but it still didn't add it.

It adds the char I attacked to the attacker list.

 // 4 returns the correct number, but the list content contains only 1 uid.