DetourCreateProcessWithDlls Injected DLL being unloaded almost immedietly once called, but DetourCreateProcessWithDllExA is fine

Describe the bug
When I specifically load my DLL via DetourCreateProcessWithDllExA it will stay loaded in the process, however I want to split a project across multiple DLLS, yet DetourCreateProcessWithDlls  seems to cause them to be unloaded almost immediately, I can't see documentation of this behavior in the notes.
Command-line test case
void Game::LookForPlugins()
{
	WIN32_FIND_DATAA FindFileData;
	CHAR CurrentDir[MAX_PATH];
	GetCurrentDirectoryA(MAX_PATH, CurrentDir);

	strncat(CurrentDir, "\\Plugins\\*.dll", sizeof("\\Plugins\\*.dll"));

	HANDLE hFind = FindFirstFileA(CurrentDir, &FindFileData);

	CHAR FullPathOfDll[MAX_PATH];
	GetCurrentDirectoryA(MAX_PATH, FullPathOfDll);
	strncat(FullPathOfDll, "\\Plugins\\", sizeof("\\Plugins\\"));

	int i = 0;
	do
	{
		auto bleh = std::string(FullPathOfDll) + std::string(FindFileData.cFileName);
		gDlls.push_back(bleh);
		gPlugins.push_back(gDlls.back().c_str());

		OutputDebugStringA(gDlls[i].c_str());
		i++;
	} while (FindNextFileA(hFind, &FindFileData) != 0);

	FindClose(hFind);
}

STARTUPINFO info = { sizeof(info) };
PROCESS_INFORMATION processInfo;
BOOL Status = false;
if (Plugins)
{
	Game::LookForPlugins();

	Status = DetourCreateProcessWithDlls(gGameLocation, NULL, NULL, NULL, TRUE, NULL, NULL, NULL, &info, &processInfo, gDlls.size(), gPlugins.data(), NULL);
}
else
{
	 Status = DetourCreateProcessWithDllExA(gGameLocation, NULL, NULL, NULL, FALSE, 0, NULL, gGamePath, &info, &processInfo,  "C:/Users/Johnathon/source/repos/Yu-Gi-Oh-Ex/x64/Debug/Plugins/Yu-Gi-Oh-GUI.dll", NULL);

}
return Status;
}

C:\Temp>cl.exe /EHsc /W4 /WX .\repro.cpp -I. ..\lib.X64\detours.lib
Microsoft (R) C/C++ Optimizing Compiler Version 19.27.29111 for x64
Copyright (C) Microsoft Corporation.  All rights reserved.

repro.cpp
Microsoft (R) Incremental Linker Version 14.27.29111.0
Copyright (C) Microsoft Corporation.  All rights reserved.

/out:repro.exe
repro.obj
..\lib.X64\detours.lib

C:\Temp>.\repro.exe
Test Case Result: Pass

Expected behavior
They stay loaded
Detours version
Latest commit

Sorry, I should also say, I have verifed the gDlls is populated with valid data, and the count is 1, I can't really work out why the dll is injected fine and works when called singular

gGamePath


Character "%" on start up

** Version:
Hyper 3.0.2 stable /hyper-3.0.2-x86_64_5def54eaf2324363580a3094c29efe8e.AppImage
** Os Version:
Arch Linux
Kernel x86 64 Linux 5.1.15-arch-1_ARCH
zsh 5.7.1
DE: gnome
** Hyper.js
https://gist.github.com/vaclavbenes/2ed8ace185e4f9c483e080265c94988b
** Devtools:
no errors, just plugins and time
Issue
Everytime if i start hyper , fresh start I see "%" and i dont think its a part of zsh or file hidden character. I cant find solution where that character comming from.
If i reload zsh from hyper , there is no "%".

duplicate #3586

fix hyper.js % at start in /.zshrc
unsetopt PROMPT_SP


GLES3 renderer not handling transparency in some edge cases

Godot version:
3.2 alpha
OS/device including version:
Fedora and others are effected too
Hardware: R9 390X
Issue description:
GLES 3 Result - Transparency not working / is black biased when it overlaps another object:

GLES 2 Result - Transparency working as expected

Steps to reproduce:

Best way to get the same results is to load master godot.
download fbx from here: https://developer.nvidia.com/orca/amazon-lumberyard-bistro
open Bistro_Exterior.fbx

Please note: FBX Importer currently sets the following properties on the transparent materials:
// anything transparent must be culled
if (image_data.raw_image->detect_alpha() != Image::ALPHA_NONE) {
    mat->set_feature(SpatialMaterial::FEATURE_TRANSPARENT, true);
    mat->set_depth_draw_mode(SpatialMaterial::DepthDrawMode::DEPTH_DRAW_ALPHA_OPAQUE_PREPASS);
    mat->set_cull_mode(SpatialMaterial::CULL_DISABLED); // since you can see both sides in transparent mode
}

Minimal reproduction project:
as described above, this is the only way I can reproduce the issue currently have tried creating the same setting in a new scene with same materials but no luck.

Updated with more information to help identify the problem.

Also black background only appears when at certain angles relative to the transparency.

Could this be related to http://the-witness.net/news/2010/09/computing-alpha-mipmaps/ ?

I don't know to be honest, right now I believe the problem is just in the glBlend related code, but need to look a bit deeper into the problem as the GLES2 renderer does this really well, and I want to know what the differences are

Took me a while to notice what the issue is on the screenshot, a quick description would have been good :)
For anyone with bad eyes like me, there are blending issues around the foliage and balcony fence.

@RevoluPowered Are those particular elements (balcony fence and foliage) using alpha scissor as well? I think it may be a matter of alpha scissor conflicting with the opaque pre-pass.

@akien-mga Apologies, for clarification yeah it's the window panes, and foliage.
@clayjohn The only options enabled on the materials is transparency but alpha scissor is off currently, but I am having this with normal transparent textures and only in GLES3 not in GLES2.
I did testing with alpha scissor but it's not functional for glass so really need the GLES3 issue fixed.
When I get a chance I'll record a quick video of this to show settings and various setup so that you can clearly see the issue with all the information.
Thanks both

Sorry just realized above the code includes an example of what options are set on the material.
The minimum reproduction project should work fine in godot master by just dragging in the fbx

Godot version:
3.2 alpha 1
OS/device including version:
Win 10
Hardware: Nvidia GTX 1050M
I have a similar issue, overlapping transparent images have black areas. It works perfectly well in 3.1.1 and it becomes black in 3.2. Here is an image and a sample project.

sample_project.zip


Implement CancelShard for WASM executor

https://github.com/filecoin-project/bacalhau/pull/1061 Introduced CancelShard API to executors to terminated a running job when it takes longer than the defined timeout value. CancelShard has been implemented for docker executor by stopping the container. What remains is implementing it for WASM executors
cc: @simonwo

Resolved in #1952.


Create a user profile page

Basic Information
This should display:

[x] User name
[x] User profile pic
[x] User email
[x] Selected regions
[ ] A link that directs the user to the POOPS homepage
[ ] a sign out button

Due to changes in the design, we will opt to have the user's profile be displayed within the contacts page. This page should remain unaffected but the link to it will no longer be in the navbar, possibly the header on the top right.
Other Information
Potential scopes:

A user profile page has been implemented in the contact list, currently waiting to be merged (#49).  This issue lists a few smaller details not present yet.  The contact page will need to be merged into branch i43-create_a_user_profile_page before this can begin.

This issue was solved earlier.


Add Electron-Forge support

Also adds a GitHub action to build it automaticially
Ignore me loosing my mind below lol

The app is already using electron-builder
I've detailed this in the #staff-lounge channel
I'll add the build workflow later on, when the app leaves early development


Windows 11 issue

Porting this discussion here:
https://github.com/JMarkstrom/yubikey-removal-behavior/issues/2
Doing my test now, just reuploaded the files in Intune with WIN11 statement and prepping my Windows 11 machine..will report back soon

Same condition it seems to not apply on Windows 11 (23H2).
Intune clearly does not apply the policy to the device( it does not even give not applicable, basically nothing happens)

We are looking into this!

Can you provide more information on what you have configured in intune. Specifically these things

The Device Configuration Profile you have created
The configuration policy you have created
The file you imported (ADMX)
Are you using an msi package?

You mean basically that when you import the ADMX file you cannot select it as a configuration profile in intune?

I have imported the ADMX template in Intune without errors , I tried your template first but it did not work on Windows 11 (Windows 10 was fine, but has another issue see issue 91)
Secondly I edited the template to set Windows 11 as OS  and uploaded it again to Intune

Everytime I created a policy in Intune where I configured the ADMX

Regards,
John

Hi John,
Great thanks. I managed to test this quickly. Target system is
OS Name:                   Microsoft Windows 11 Enterprise
OS Version:                10.0.22631 N/A Build 22631

On the target machine I removed the registry values that are setup using the ADMX template.
In the testing tenant I removed the Device configuration profile and the ADMX profile
Took the ADMX profile and the ADML file from this repo and uploaded it again
Created the new Device configuration profile
Assigned it to the target machine
Did a sync on the target machine, and it now says assigned to the device and the registry keys are back. This took about 30 minutes

So I cannot replicate your issue on Windows 11..

Ok that is strange, then it must have something to do with the sharedpc settings.
On Windows 10 it works to apply but the agent also only works once after a reboot (maybe also shared pc settings)
I will redeploy my WIN11 machine today with only your policy (no shared and no kiosk) and let you know asap!

Ok update!
I played around and my first impression was that the removal of shared PC settings was the solution.
But it turned out that the KIOSK settings are breaking the application.
When I log in with a KIOSK user not defined in the configuration (see below picture of
Entra user or group the application is working!

This start to make sense as KIOSK mode only always certain applications to run.
Assigned Access: In Windows, kiosk mode uses "Assigned Access," which allows an administrator to specify a single Universal Windows Platform (UWP) app or a Win32 app that a user can interact with. Other apps, the taskbar, system tray, and other OS features are inaccessible
So I start looking for a solution and my idea was to set the KIOSK to allow multiple applications (Edge and the Yubikey removal tool) but for that I need the Application user model ID (AUMID) of your application which I couldn't find on my test machine.

To clarify my goal
My total setup is to build a warehouse PC that is used by multiple users with Yubikeys on key cords. People use the station as flex machines to access certain business applications. When the walk away from the machine they need to remove their Yubikey and the machine should logout.
For this we leverage

Autopilot in self driven mode (no assigned user) to make it a non owned station
1 specific policy to set [shared pc settings](https://learn.microsoft.com/en-us/windows/configuration/shared-pc/set-up-shared-or-guest-pc?tabs=intune for profile management, cleanup and power settings
1 specific policy to set Kiosk mode with and edge browser and some favorites
1 policy to configure edge with specific settings
1 policy to set the password less experience (will remove certain credential providers)

I hope this all makes sense to you and IMHO we should build the Scriber application that it has an Application user model ID (AUMID) so I can put it on the 'allow list' besides the Edge browser and maybe 1 or 2 other allowed business apps for the warehouse people
Regards,
John

The stupid thing is that we had OS native support for years with Smartcards but this does not apply to FIDO2 tokens
Security Settings > Local Policies > Security Options > Interactive Logon: Smart Card Removal Behavior , set to Lock Workstation
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\PolicyManager\default\LocalPoliciesSecurityOptions\InteractiveLogon_SmartCardRemovalBehavior\

The stupid thing is that we had OS native support for years with Smartcards but this does not apply to FIDO2 tokens Security Settings > Local Policies > Security Options > Interactive Logon: Smart Card Removal Behavior , set to Lock Workstation
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\PolicyManager\default\LocalPoliciesSecurityOptions\InteractiveLogon_SmartCardRemovalBehavior\

Yea, we know.
We will have a look at AUMID and see if we can add that, otherwise meanwhile feel free to modify it and see if you can get it to work. We have more time in a few weeks to look at it.

Ok I think I have solution please see my pull request.

Ok I think I have solution please see my pull request.

Did this solve it on your side?

Breaking my head over a minor thing, I think I have the solution, are you available for a quick call to show you my code?

I have found it!

Ok I also found something else, could it be that the Yubikey USB-A is working but the USB-C not?
Working

This one does not do anything

Ok so after explaining a few things to one of my co-workers it just all connected in my brain.
Please follow me along.
Forget Intune and AUMID (wassted a whole day on this rabbit hole) for a moment and just focus on Assigned Access.
Assigned Access has applications 'above' lock screen (view) and 'below lock screen'
Assigned access in Windows 10 uses the lock framework. When an assigned access user logs in, a background task locks the desktop and launches the kiosk app above the lock.
Please see this article
https://learn.microsoft.com/en-us/windows-hardware/drivers/partnerapps/create-a-kiosk-app-for-assigned-access
So when the Yubilocker (running below the lock screen is triggering a logout or lock it does not work because the screen is locked by assigned access.
So what we need to do its call the LockApplicationHost.RequestUnlock() method from the YubiKeyLockerapp to Add a way out of Assigned Access mode and go back to the login screen
OR
Add an event handler to the *LockApplicationHost.Unlocking event from the Yubikey locker app that emulates that the user is pressing Ctrl+Alt+Del to exit the kiosk experience.
Do you think this is possible with the current code?

Anything is possible.

Question is are you willing to work with me to accomplish this?

Question is are you willing to work with me to accomplish this?

I'll have to get back to you because we limited on time for this right now, I can plan within the next few weeks to have a look at it and if you manage to get it to work submit a pull request and we can test it.


Fix assets paths when server started from different location than root of project

When you are starting Este by Passenger you are setting passenger_startup_file and then you are in different directory then expected.
By using __dirname you will get exact location of assets.js and then you can easily traverse to build directory

Thank you for PR. Please add explaining comment directly into code. As you can se in many places in Este source code, I am trying to explain everything unusual.

I was going to argue this in my earlier pull request dealing with this. ("what if you start gulp from your home directory")
Fwiw, this happens when you import in SASS (and likely the other style langs). You must resolve files from where the gulp process started.

Hmm, I am not sure wherher running app from another dir is correct approach. It can break other server side code I suppose.

@steida I had to do lot of thing to get it working under Nginx and Passanger. This ones was only fix that i needed to do to get it working, there was on other hand lot of nginx configuration for assets handling. If you are interested I can pass functional Nginx configuration.

Ok, I believe you. Thank you for PR.


Fixed #24783 -- Refactored template library registration.

Apologies in advance for the big patch. This refactoring had to touch a lot of files. Below is an outline of what changed.
API Overview:
The Engine class now accepts a dictionary of library paths. For example:
{
    'i18n': 'django.templatetags.i18n',
    'myapp_tags': 'myapp.templatetags.myapp_tags',
    ...
}

These values are stored as Engine.libraries. Each of these paths are imported and stored as a module in a dict: Engine.template_libraries. This is similar to how Engine.loaders and Engine.template_loaders works.
The DjangoTemplates class now also accepts a libraries argument.  Additionally, it runs discovery on the templatetags packages of each installed application. The results are collated and passed to the Engine instance.
The {% load %} tag is simplified to do a dict lookup on the Engine rather than running imports.
The big change is that libraries are now imported when the backend and engines are instantiated. This means syntax and import errors in template tag modules are now raised when the backend is instantiated rather than when a template is first compiled with a {% load %} tag.
Further, besides the builtins, instantiating Engine directly won't register any libraries not explicitly specified, e.g.  django.templatetags.i18n, etc.
I chose this implementation for the following reasons:

There should be one obvious way to handle tags. The old LoadNode looped through template tag modules in installed apps trying to import the library. Adding a dict lookup for Engine.libraries as an addition rather than a replacement here leads to odd code.

The DTL {% load %} tag shouldn't require django.apps, or installed apps at all, to be used. This is only possible if knowledge of installed applications is removed from the LoadNode and encapsulated instead on the engine.

The Engine class should be explicitly configurable without needing any knowledge of Django modules outside DTL.

Outline of code changes:
django.template.backends.django

Added DjangoTemplates.get_template_libraries which discovers template libraries in installed packages.
Modified DjangoTemplates.__init__ to do discovery and pass libraries to the internal Engine.

django.template.engine

Added builtins and libraries argument to the Engine class.
Added default_builtins attribute to the Engine class. This is copied and
extended by the builtins argument.
Added Engine.template_libraries and Engine.template_builtins
attributes. These are passed to the Parser.

django.template.base

Added libraries and builtins argument to Parser.
Template.compile_nodelist updated to pass libraries and builtins to Parser
from self.engine.
Removed libraries and builtins globals.
Moved library related code to django.template.library.

django.template.library (new module)

Separated SimpleNode and InclusionNode as top-level classes in
django.template.base. These take extra argument now rather being defined
at runtime with closures.
Removed django.template.base.generic_tag_compiler. Was used only by
Library.inclusion_tag.
Removed get_templatetags_modules.
Simplified import_library error checking and removed
is_library_missing. This isn't needed since errors are caught at compile
time.

django.template.defaulttags

LoadNode now looks for libraries with a dict lookup on
Parser.libraries rather than running imports.

django.contrib.admindocs.views

Fixed to find installed template tags from Engine.getdefault() rather than
doing it's own discovery.

tests/template_backends

Added discovery-related tests for libraries and builtins to
template_backends.test_django.

tests/template_tests

Updated tests to explicitly specify the tags they need when instantiating
Engine.
Moved testtags from template_tests.utils to their own file rather than using the register_test_tags decorator.
Updated tests that now fail when the backend is instantiated.
Updated setup decorator to allow libraries to be specified per test
class.

I don't have time at the moment to review the full patch in detail, but your description of the changes sounds excellent! Just the way it ought to work.

I'm in the same boat as @carljm. I read the comments and skimmed the patch. The design makes sense and the changes appear to have the correct order of magnitude for what you're trying to achieve.

This idea was previously discussed in https://code.djangoproject.com/ticket/17085.
@prestontimmons Could you read that ticket and make sure it doesn't contain any interesting ideas that you have rediscovered independently?

Thanks for all the feedback. The branch is updated. Let me know if the new release notes are clear enough.
If there's no objection, for the sake of failing earlier than later, I'll keep Engine.template_libraries and Engine.template_builtins as an attribute rather than a cached_property. I'll also convert Engine.template_loaders to an attribute in a separate commit.

No objection.

Thanks, Tim. I pushed an update.
The library code was basically moved verbatim from django.template.base, but I made the changes you suggested. I also added new test file, template_tests.test_library, since the library code lacked comprehensive tests.
Further, I normalized the exception raised for invalid values by inclusion_tag, simple_tag, and filter methods. Before these raised InvalidTemplateLibrary or TemplateSyntaxError, neither of which seem appropriate. They now all raise ValueError.
This is a bit dated, but a relative diff is available here for reference:
http://dpaste.com/2HEYBQT

Great job!


Open product from administration in saleschannel

1. Why is this change necessary?

2. What does this change do, exactly?

Add normal external links to sw-context-menu-item
Add API action to load product links in any sales channel
Add "Open in" button to admin product detail page

3. Describe each step to reproduce the issue or behaviour.

Know shopware 5
Miss features like opening the product in a saleschannel without navigating there first

4. Checklist

[ ] I have written tests and verified that they fail without my change
[x] I have squashed any insignificant commits
[ ] I have written or adjusted the documentation according to my changes
[ ] This change has comments for package types, values, functions, and non-obvious lines of code
[x] I have read the contribution requirements and fulfil them.

Can someone tell me why my external link entries in sw-context-menu-item are not loaded? I just get spans and no anchors.
I tested the generated links though. They work. Just opening them does not work yet.

Shopware suggested changes to merge my new context button into the save button that by now is a context button as well and now looks like this:

It has flaws as saving can invalidate the URL that has been used as target on menu item click and the correct URLs are only known after saving. The width of the context menu should be dependent on the URLs shown but is hard coded an this can break the design. This is already mentioned towards shopware and open to discussion in the Community Slack.

Hi @JoshuaBehrens,
I agree that it's not an optimal solution. Could you message me or post the relevant discussion?

I've create an internal design issue: NEXT-9629
It may take some time and sadly, I cannot make it public (jira workflow). But I'll mark this as incomplete. We are screening all incomplete pull request once each week, so we'll check the status regularly.

@pweyck I can understand it.

Hi @JoshuaBehrens,
you've got the design, right?

Hey @pweyck yes I received the design and there was a discussion that has been resolved this morning.

The design is neat but the popover in the sidebar button is not trivial as it looks 💦

Hi @JoshuaBehrens
Sorry for the long wait.
Blow is a screenshot of what our design apartment thinks would be best :)
It should be moved to the right sidebar.
I have attached the required svg as zip as well.
If you need anything, do not hesitate to ask :)

window-eye.zip

@pantrtxp I had a talk to the creator of the design (back in the days) and he mentioned there is an other preview feature that can supersede this pull request. The talk about it in the first place was that the popover component in the sidebar is hell.

We will take this with us and discuss this internally.
Sorry for the holdup.
Sunny regards
Pantrtxp

Hey @JoshuaBehrens, as discussed I have opened a ticket for you and we will take care of this internally. https://issues.shopware.com/issues/NEXT-12894

I still think this is a valid feature request. Eventhough 4 years have passed the Admin team will take this on directly now.
https://issues.shopware.com/issues/NEXT-35052


Add matrix token environment variable

cc @fgimenez is this the proper way to add an environment variable from CircleCI into the Docker container so that the container uses the variable at runtime?
It could go into the deploy step as well, but it wasn't clear to me how to do that.

Yeah, i think it's ok to do it this way, we could leverage also the secrets management we have in place, so that all the secrets are in a single place. In that case the token would be part of the config object, let me know wdty.

We already have the matrix token in the secrets config, this was intended as an alternative to that in case we need to change the matrix access token more often than the other secrets.


feat: russian README.md has been added

Russian README.md has been added.
Link to russian README.md has been added to main README.md.

Something went wrong...


Fix: False Positive "Range out of order in character class" in Regular Expressions in Unicode Modes

The first appears to be my fault; the second is a regression of #58339.

@graphemecluster can you provide a link to a bug or at least the PR that caused the bug for the first fix?

@sandersn
First: https://github.com/microsoft/TypeScript/pull/55600/files#diff-e19070e6b0ecc4de5f7d4bc6b42a9a71c8f23ce8ce155f7bd7cd48763170e506R1587
Second: https://github.com/microsoft/TypeScript/pull/58339/files?w=1#diff-e19070e6b0ecc4de5f7d4bc6b42a9a71c8f23ce8ce155f7bd7cd48763170e506R3462

@typescript-bot test all

@typescript-bot test it

@rbuckton Just as a heads up, you might want to merge this (and also #58981) before the beta release.


Separate node docker build logic from the standard way

This commit broke docker building logic, because now it starts building client every time container starts. Docker containers are versioned themselves and no need to trigger it.

I will review tomorrow :)


Kubectl command failed WSL

I have standard Windows installation of VSCode, and use it with WSL. I installed kubectl with snap
sudo snap install kubectl --classic
when I try to use Kubernetes extension, keep getting error Kubectl command failed: unable to run kubectl without any more logs and explanations.
Unfortunately previous solutions https://github.com/vscode-kubernetes-tools/vscode-kubernetes-tools/issues/522#issuecomment-645940091 do not work for Windows
Related issues: https://github.com/vscode-kubernetes-tools/vscode-kubernetes-tools/issues/770 https://github.com/vscode-kubernetes-tools/vscode-kubernetes-tools/pull/771

Thanks a lot, @fedorzh, for bringing this to our attention. If you have anything else specific steps to reproduce the issue, please share them, I can attempt to replicate it this.
We'll look into this and provide an update. Thank you so much.

Hi @fedorzh - I've tried installing kubectl with the snap command you shared but haven't been able to replicate the issue.
If you'd be willing to answer a couple more questions, I hope we can get a better idea of what's going wrong:

Is the kubectl path overridden in Settings?

Could you run Developer: Toggle Developer Tools from the command palette, and try doing anything that causes that error? I'm hoping you might get a message in the Console tab, something like *** failed to invoke kubectl (from ...), which might give us more information.

@peterbom so I removed kubectl from snap  and installed with vscode after the extension installation, in the interface. This error disappeared and now I get a different problem not connected to this one


transcriptomics tutorial

added missing boxes

@polkhe unfortunately we have a merge conflict here. Can you resolve this?

no need in merging, someone fixed all the typos :)


Error

I noticed that when I weight my training examples non-uniformly when training a regressor type MLP, my validation error becomes an order of magnitude better than my training error. Digging into the code it looks like the loss function purposely doesn't account for the weights when calculating the validation error. Given that my stop condition for training my neural network is that the validation error is steady for some number of iterations, I would have thought the validation error should be calculating with weights. Is there a specific reason it's not?
                loss += processor(Xb, yb, wb if wb is not None else 1.0)
            else:
                loss += processor(Xb, yb)
            count += 1```

See lines 322-325 of backend/lasagne/mlp.py


Add metadata to create VM - flavor, os, workload and used template

Pull Request Test Coverage Report for Build 302

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 60.822%

Totals

Change from base Build 235:
0.0%

Covered Lines:
460

Relevant Lines:
691

💛  - Coveralls

Pull Request Test Coverage Report for Build 237

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 60.822%

Totals

Change from base Build 235:
0.0%

Covered Lines:
460

Relevant Lines:
691

💛  - Coveralls


Allow login through a single portal for both Bank & Partner users.

Summary
We've consistently seen issues where Partners are trying to log in via the Bank login URL. This is due to nomenclature issues (some partners consider themselves banks) on top of UX red flags>
Instead of having Bank login to http://localhost:3000/users/sign_in and Partner login to http://localhost:3000/partner_users/sign_in, let's have both logins through http://localhost:3000/users/sign_in.
Things to Consider
A bit of historical context regarding having two login pages is that partner and diaper use to be two separate applications. After long thought and facing challenges, we decided it is best to merge the two applications. We had merged the applications but have kept the databases separate. That is, now we have User and Partners::User models which point to two different databases.
Ideally, we'll want to stop relying on having two databases and have a single database as the single source of truth. Is there a way that we can achieve that regarding the User and Partners::User models?
Criteria for Completion

[ ] As a partner user, I login through the http://localhost:3000/users/sign_in and it directs me to my partner dashboard.
[ ] As a bank user, I login through the http://localhost:3000/users/sign_in and it directs me to my bank dashboard
[ ] As a bank user with a partner account, I login through http://localhost:3000/users/sign_in and I am giving the option to login to my partner account or my bank.
[ ] Tests of the different cases of

[ ] User is only bank
[ ] User is only partner
[ ] User is partner and bank
[ ] User submitted incorrect login information

@edwinthinks, what's the reason that PartnerUser specifies devise, again? It's not that there's anyway for a user to log in as that but that we need some of the magic devise builds out for us, right?

@scooter-dangle I don't remember 100%, but I believe the reason is because Partners::Userdoesn't play nicely with devise.

@edwinthinks, heads-up: @exbinary is thinking of doing a setup where we retain both logins but have an initial login page that just takes your email. When you submit that, if you're only a bank, you go to the bank login with the email pre-filled in…if you're only a partner, you go to the partner login with the email pre-filled in…if your email is associated with both, you go to an interstitial where you choose (and then by your choice you go to one or the other).
That might reduce some of the tricky subtleties in the edge cases by making things more explicit while still automatically sending the majority of users to the single login that applies to them.


⚠ Samsung has degraded performance

In 47a3282, Samsung (https://samsung.com) experienced degraded performance:

HTTP code: 200
Response time: 2826 ms

Resolved: Samsung performance has improved in 6db900a.


Code is locked in setup if sensor is not present at boot time

Hi!
I just used this library and if sensor is not connected at boot time, then program stays in setup in an infinite loop.
void setup() {
  Serial.begin(9600);
  Wire.begin(D2, D1);

  Serial.println();

  sensor.begin(Bme280TwoWireAddress::Primary);  <---- here
  sensor.setSettings(Bme280Settings::indoor());
}

Bme280.cpp:
  while (isImUpdate()) {   <--- because of this
    delay(20);
  }

I fixed it by changing with:
 isImUpdate();

Is this code lock done intentionally or is it just a mistake?
Thank you, regards,
Peter

@ciberp Hi, thanks for the issue. I will think about how to solve the issue more elegantly. What do you suggest? Maybe, we can return an error code from the begin method?

Hi!
Error code to indicate the problem with sensor would be a good approach.

@ciberp Great news! Now, we can check the status of the begin, also we can change timeout via ARDUINO_BME280_TIMEOUT macro, by default it equals 10 seconds.


Fix off by one error when marking offset

I noticed that I wasn't able to mark an offset of 0 as being processed. This change should fix that.
Note: The MarkOffset function in Consumer does the actual offset movement.

Thanks


Different result between Ocelot result and sacrebleu result.

I have created a submission on the wmt2021 en-zh news translation task. This is my best submission:

After the reference of test set released, I test my translation result by sacrebleu:
cat ~/tmp/wmt_submit/hyp-tgt/en-zh/pe/zh | sacrebleu ~/datasets/wmt2021test/en-zh.zh -l en-zh -m bleu -b -w 4

the result is

Why did this happend.

Hi,
You did not specify the Chinese tokenizer (-tok zh), which OCELoT uses
(see:
https://github.com/AppraiseDev/OCELoT/blob/9237c1eb1d9feebb1a51966b8c1ef82b381b4b1e/leaderboard/models.py#L1046
).
Different tokenization choices will result in different scores.
Cheers and best, have a good day,
Christian
On Thu, Sep 23, 2021, 5:14 AM BrightXiaoHan @.***>
wrote:

I have created a submission on the wmt2021 en-zh news translation task.
This is my best submission:
[image: image]
https://user-images.githubusercontent.com/25839309/134449555-aa8ae6a8-1efb-42c2-860c-eab9bb9c2a55.png
After the reference of test set released, I test my translation result by
sacrebleu:
cat ~/tmp/wmt_submit/hyp-tgt/en-zh/pe/zh | sacrebleu ~/datasets/wmt2021test/en-zh.zh -l en-zh -m bleu -b -w 4
the result is
[image: image]
https://user-images.githubusercontent.com/25839309/134449721-bddf6356-23b3-411c-9f09-a95d93c2efd9.png
Why did this happend.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/mjpost/sacrebleu/issues/165, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AACSH2ELOLNAGBYEZTA7GNTUDKLRTANCNFSM5ESWXZTQ
.

Thanks for your reply. But I specify language pairs in my command:
-l en-zh

This will choose zh tokenizer in sacrebleu, which is the same as OCELoT.

Can you share the full signature of your SacreBLEU call?
On Thu, Sep 23, 2021, 12:07 PM BrightXiaoHan @.***>
wrote:

Thanks for your reply. But I specify language pairs in my command:
-l en-zh
This will choose zh tokenizer in sacrebleu, which is the same as OCELoT.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/mjpost/sacrebleu/issues/165#issuecomment-925673718,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AACSH2GFZ4QEXHKHFGITRR3UDL34RANCNFSM5ESWXZTQ
.

cat ~/tmp/wmt_submit/hyp-tgt/en-zh/pe/zh | sacrebleu ~/datasets/wmt2021test/en-zh.zh -l en-zh -m bleu -b -w 4

@BrightXiaoHan To get the SacreBLEU signature exclude the -b in your call and post here the output.

I have found the reason, sorry about that. There were some invalid lines when I extract raw text from xml files.


add an e-mail notification whenever someone is charged into / decharged from a committee

add an e-mail notification whenever someone is charged into / decharged from a committee so that:

the active member will get an active notification whenever their activism status is updated
the board has an overview of who they need to charge into or decharge from a committee in their board meetings

Acceptance criteria:

The active member gets an e-mail whenever he/she added to a committee:

If the member was not active before, then he/she will be notified of:

The privacy policy concerning active members
How to log into their IA mail account or how  to forward it to their personal mail

(optional) Merge with the notification when members become inactive

The board gets an e-mail whenever someone is new to a committee or leaves a committee
The mails will be sent at the end of the day so that function changes (new entries in committee membership) will not send unnessesary e-mails

Als bestuur graag wil dat we dit toevoegen doen we het, maar in principe lijkt het ons onnodig, aangezien de enige keer wanneer het relevant is is wanneer je voor het eerst actief wordt en dan krijg je al een mailtje over je actieveledenaccount.


Question: Is this compatible with Gatsby JS?

I'm trying to use it with Gatsby JS ?

But I have encountered an error.

@drailanjohngss Brother, I don't know because I'm not familiar with gatsby :(


Role policies and access control bug

Affected module
Backend
Describe the bug

When a user becomes data steward/data consumer, they are permitted to edit all assets in the catalogue. Naturally, they get policies to update all instances they find, even those belonging to another team. For example, data steward from team1 has permission to change team2's assets.
If we create a new role based on existing default policies (Data Steward, Data Consumer) and then change something in this new role, the existing policy is updated as well for the old role.
You change one role -> both roles are updated instantly.

To Reproduce
Screenshots or steps to reproduce

Expected behaviour
A clear and concise description of what you expected to happen.

Role policies should be limited to teams and their corresponding assets. Data steward or consumer from team1 shouldn't be able to edit/update team2's assets etc.
Newly created roles shouldn't be in codependency with the existing roles even if they're based on the same policy.

Version:

OS: [e.g. iOS]
Python version:
OpenMetadata version: 0.10.1
OpenMetadata Ingestion package version: [e.g. openmetadata-ingestion[docker]==XYZ]

Additional context
Add any other context about the problem here.

@Sachin-chaurasiya can you test this out and close it.

This is fixed with new roles and policy structures.


Fetch appropriate configlet binary

I noticed that when I am working on my Mac the fetched configlet binary fails.
This pull request adds a limited but smarter configlet binary fetcher that
tries to determine the OS and architecture and fetch the appropriate
configlet binary.

This looks ok to me, but I don't know much about the configlet. @kytrinyx any issues preventing me merging this in?

Nope, this looks great. Go for it :)


Playing several games against the same person skyrockets / ranks your rating

Beating someone by a similar margin ~ 5 times will destroy that person's rating and skyrocket yours; perhaps multiple matches against the same person at a similar time should be agregated?
proposed math: instead of score being
\frac{S_a}{S_a + S_b}

make it
\frac{\sum_{i = 1}^{N}{S_a}}{\sum_{i = 1}^{N}{S_a + S_b}}

where N is the number of games played in a single session against one player

Note: this effect may also be most exaggerated in the first rating period

Note 2: it is worth noting that the original rating system does not do this:

A fix for this more in line with the original spec would be to lower $\tau$

Regarding ping with this approach:
Perhaps we should only aggregate games if the ping for both matches (for both players) are similar (the "ping ability" - the function of sech - only differs by 0.05 or 0.1)

old:
new:

(players and matches:   )

For a graphical comparison:

before:

after:

Closing as completed, assuming my implementation doesn't have any bugs


TypeChain 2.0

[x] proper monorepo structure
[x] improve testability

[x] common structure for all tests
[x] a minimal and exhaustive set of contracts to use during tests,
[x] easy type-level tests
[x] typed assertions
[x] cover return type .send Closes https://github.com/ethereum-ts/TypeChain/issues/109
[x] test overridden functions
[x] test overridden events

[x] bring all changes from typechain ver 2 branch
[ ] revisit functions with no names on parser level
[ ] move all currently existing targets

[x] move web3-v1 target
[x] move truffle-v4 target
[x] move truffle-v5 target
[x] move ethers-v4 target
[ ] move web3-v2 target

[x] ensure correct package metadata for all new packages
[x] beta releases
[ ] examples

[x] web3-v1
[x] truffle-v4
[x] truffle-v5
[ ]  ethers-v4
[ ]  web3-v2

[ ] NatSpec support

[ ] more tests for NatSpec support

[ ] new contribution guide

Closes https://github.com/ethereum-ts/TypeChain/issues/203
Closes https://github.com/ethereum-ts/TypeChain/issues/99
Closes https://github.com/ethereum-ts/TypeChain/issues/150
Closes https://github.com/ethereum-ts/truffle-typechain-example/issues/5

Can you add Ethers v5 support :) 🙏


location of sphinxify.py

In WinPython <IP_ADDRESS>:
sphinxify.py is in \spyderlib\utils\inspector
In WinPython <IP_ADDRESS>:
sphinxify.py is in \spyderlib\utils\help
Why?
In both cases spyderlib.version = '3.0.0dev'
If I want sphinxify.py from spyderlib, how should I better import it given its location may vary?
Thanks!

WinPython is packaging Spyder 3.0 betas (not the final release). Somewhere along the way (after beta2 I think) we decided to rename the Object Inspector pane to Help, and so we also changed utils/inspector to utils/help.


Hide toolbar during remote session

The toolbar is taking up space of the screen during remote session, not too much but I think it would be better if it can be hidden and showed up only when needed.
So I came up with this little script (tested to work with the ye olde Internet Explorer 6), which you can check in the attached file. Hope that will be useful and be considered in next version of Myrtille.
toolbar.zip

It's indeed a good idea! if possible, could you please make a pull request, for easier integration (and automatically credit you as contributor)?
Thanks :)

Done into Myrtille 2.0.0! :)


No longer working - Chrome 61.0.3163.100

I followed your steps listed below and it worked once. All subsequent tabs are now default and not New Tab Reloaded.
Steps to fix this extension in Chrome 61+:

Open Chrome settings and change the search engine from Google to Bing.
Open a new tab page to see Bing's home page.
Change the search engine back to Google.
Open a new tab page and this extension will load correctly.

Unfortunately, the above steps didn't help here. Still loading default NTP.

I didn't have the Bing search engine in my list (I deleted it ages ago).. But I switched to another, and back to Google.. and I still get the default new tab page

Guess it's time to uninstall extension. Too bad, it was nice one.

Same issue here, extension no longer works even after removing entire settings dir (in fresh Browser).

This is an updated method for Chrome 62:

Open Chrome settings, extensions and a new tab page.
In the settings page, change the search engine from Google to Bing.
Go to the extensions page. Disable and then enable the "New Tab Reloaded" extension.
Change the search engine back to Google.
Open a new tab page and this extension will load correctly.

Thank you that worked! :+1:

Does anyone have the link to Bing? I deleted the Bing engine ages ago, and it seems changing it to another engine is not doing anything. So if it have to be Bing specificially, I don't have the URL anymore.

Bing
bing.com
https://www.bing.com/search?q=%s&PC=U316&FORM=CHROMN
Yahoo may also work.

The fix unfortunately doesn't survive a browser restart (at least for me).

OK, this was the change in chrome that disabled this extension.
https://codereview.chromium.org/2978953002/
https://stackoverflow.com/questions/38948958/does-content-script-have-access-to-newtab-page


problem authenticating with twitter

In v0.5.0, when I tried to authenticate my account in a twitter input node, it said:
on the console:
{ statusCode: 401,
data: 'Failed to validate oauth signature and token' }
and on the web page:
"yeah no. didn't work. "

Hi knolleary, have you only fixed the error message quality or was the auth error fixed, too? I'm using the twitter node in bluemix node-red and it throws a single word as the error message:
Unauthorized
What can i do to overcome the error?

@BerndGewehr , My problem is exactly the same than yours. ive tried on Google Chrome and Safari, and my os is OS X El Capitan 10.11.6 .
When i click the button "click here to authenticate with twitter", inside twitter output node > Edit twitter-credentials node, on node red, im redirected to this link:
https://natiar.mybluemix.net/red/twitter-credentials/c21ab585.fa4938/auth?callback=https%3A%2F%2Fnatiar.mybluemix.net%3A%2Fred%2Ftwitter-credentials%2Fc21ab585.fa4938%2Fauth%2Fcallback
that throws a single word:

Unauthorized

@knolleary , any solution ?


Automatically push to ghcr and build for ARM

Does this mean I have to add GITHUB_TOKEN to the repo secrets? What permissions should said token have?

Hi,
You don't need to add anything actually. It is a built-in variable for github actions, ref: https://docs.github.com/en/actions/security-for-github-actions/security-guides/automatic-token-authentication
As for permissions, it has been granted by .github/workflows/push-image-ghcr.yml::L15-17


remove nonvoid_storage usage from when_all.h

Hello, I was one of the volunteers from the university where you gave the c++20 coroutines workshop in Madrid. I got some free time now :sunglasses:
I saw that the last commit in this repo removed the nonvoid storage. when_all.h still had a reference to nonvoid_get() and it failed to compile the examples. Here's the fix :)

Would you mind if I asked you some questions regarding implementation stuff?
The code is super readable and I'm already learning a lot from it (thanks). But I'd like to have a good grasp of what's in here. I'm interested in implementing cancellation for algorithms like when_any. If you don't have any problem with me doing that, of course.
I don't mind asking through github's pull request comments. But if you are in some social media/discord/slack, maybe one of those is more suitable for these kind of interactions.


SuperSafe support for Scala 2.13.2

There is currently no build of SuperSafe available for the newly released Scala 2.13.2. Can you publish a build for that?
Thanks!

@Facsimiler Actually there is, 1.1.10. We are in the process of publishing an update to the site: https://github.com/scalatest/scalatest-website/pull/133

@bvenners Wow! That's what I call a quick response! Thanks, Bill!

@bvenners Actually, there is no SuperSafe 1.1.10 build for Scala 2.13.2 currently available, either in https://repo.artima.com/releases/com/artima/supersafe/ or in Maven Central. Is it in the process of being published?


Changing the source of the cluster provisioner

Searching the specs keys for a config wasn't as reliable as checking the status.driver field.
https://github.com/rancher/dashboard/issues/3714

I'm missing something, I can't see where mgmt provider is used in either tables. Can we go through this together, also to demo it (i'm still working on some cloud provider creds)

Home Page, lists mgmt clusters, uses status.provider
Cluster Management Cluster Page, lists provisioning clusters, uses prov Clusters machineProvider --> prov Clusters machinePools --> node pool provider --> node pool nodeTemplate.provider -->  node pool spec?.nodeTemplateName

The stacktrace looks something like:

management.cluster.provisioner
provisioning.cluster.provisioner
provisioning.cluster.provisionerDisplay
provisioning.cluster.render

I validated that the provisioner on the cluster list page worked for:

RKE2 AKS
RKE2 Azure
RKE2 EC2
RKE2 DO
RKE1 DO
Import
Local

For the detail page/node template I validated RKE1/2 on DO.
I'm going to go ahead and merge.


KAFKA-4183: centralize checking for optional and default values to avoid bugs

Cleaner to just check once for optional & default value from the convertToConnect() function.
It also helps address an issue with conversions for logical type schemas that have default values and null as the included value. That test case is probably not an issue in practice, since when using the JsonConverter to serialize a missing field with a default value, it will serialize the default value for the field. But in the face of JSON data streaming in from a topic being generous on input, strict on output seems best.

@rhauch @hachikuji for review

I'm not convinced that this new logic is equivalent. Before, the checking of whether the schema is optional or has a default occurred only after the method checks whether there is a schema. Now, that logic is performed earlier when it is not certain there will be a schema.

@rhauch updated, thanks for reviewing

@shikhar, this looks good.

@shikhar Good catch! Minor comment on testing, but otherwise LGTM.

@shikhar looks great to me. thanks for the fixes!

Thanks @shikhar. Merged to trunk.


Tip

Hey,
you could add an .editorconfig so it gets easier for other contributors to keep the styl guide.

Thank you for the tip, I'll add one.

You're welcome :)


SQL Bindings add telemetry points

This PR adds further telemetry points specifically where the user cancels out of the flow. This will help in understanding the cancel/error/success ratio metrics when a user utilizes the Create Azure Function with SQL Binding command.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

12 of 18 (66.67%)  changed or added relevant lines in 3 files are covered.
6 unchanged lines in 1 file lost coverage.
Overall coverage increased (+0.02%) to 42.253%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

extensions/sql-bindings/src/services/azureFunctionsService.ts
5
11
45.45%

Files with Coverage Reduction
New Missed Lines
%

extensions/sql-bindings/src/services/azureFunctionsService.ts
6
79.0%

Totals

Change from base Build<PHONE_NUMBER>:
0.02%

Covered Lines:
28193

Relevant Lines:
62358

💛  - Coveralls


Allow webcaptions to use inputs from either transcribe or translate operators

This fix is needed in order for Save Edits to work for subtitles in the Content Localization application.
Get source language from translate operator if transcribe operator is disabled.
Background:
This is needed by the Content Localization application. When a user clicks Save Edits to update transcripts, the resulting workflow only runs operators downstream from Transcribe. In that case, the Transcribe operator is disabled, and the webcaptions operators will fail to find the source language if they look for it in the input configuration for the transcribe operator.
Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

skipping code review since these changes are trivial


Create Operating System for computers

Prerequisites:

[ ] #6
[ ] Basic APIs
[ ] Networking
[ ] GUI drawing

Planned features:

[ ] Basic editing program
[ ] Linux-like filesystem
[ ] Sandboxing applications

Linux-like filesystem

What Linux, now?


Check that all github and gitlab links start with https

and have a certain structure
https://github.com/XXX is the minimum

This is done now.


SAK-44703: Samigo calculated questions do not evaluate large E expressions correctly

I'm not really an expert on this... but it seems working.
Maybe with only setting the epsilon with a small number could be enough...
but Mariusz Gromada (Mathparser's creator) recommend us using
mXparser.disableUlpRounding() before the calculate call.
https://mathparser.org/probability-theory/why-this-formula-gives-approximation-of-e/
@austin48, pls, could you check this one? Thanks!

Changes like this really need unit tests to understand them and to prevent future changes from breaking

Changes like this really need unit tests to understand them and to prevent future changes from breaking

Ok, I'll add them

@jesusmmp, I tried your patch on a local install of 20.2 and it seemed to work with the equation in the SAK-44703's test plan (I had to modify the test plan because I couldn't get the original equation working, so I simplified it).  I agree with Sam that unit tests would be a good idea.  Plus manual testing with other equations would be good as well.

@ern Added Unit Test. Please merge. Thanks.

CC: @bbailla2

lgtm


How to handle drag events?

Hello,
I try to understand how to handle drag events. I would like to detect when the drag is over, and send a request to a backend API to update the tree. From the docs it seems to me the event should have a dragged and a target key. As I test I try to drag a node which has the id of: id6
In the node-dragend callback I console.log the whole event, and it seems to me both
event.target.node
and
event.dragged.node.id
cointans the same value (id6), and I cannot find any info in the event which shows where (after or inside which node) I dragged the item.
Can somebody please show a minimal example on how to detect properly after or inside which node the drag ended?

In my case (the one one the repo dev.Vue) this is working fine.
you have a.target.node and a.dragged.node.id
If you want to try, you can:

clone the repo.
(npm / yarn) install
(npm / yarn) run dev
catch an event from @node-over (current is log but you can put whatever method you like)

If it does not work as expected, can you provide reproduction environment ?
Regards


Implement GameStates

Closes #17

This merge was done early. Another merge will be done to update to the latest commit from ISSUE17.


Definition of materials and a materials entry type

During the OPTIMADE workshop 2020 we have been discussing how to represent properties and "for what" those properties pertain to, i.e., materials.
Out of those discussions have come the following description of "a material":

For a system in an environment (temperature, pressure, ...) a certain number of 'microstates' (microscopic structure realizations) are the relevant ones, i.e., those that have any significant probability to appear in an observation of the system.
As outer conditions change, the relevant set of microstates may shift. This can happen as a discontinuous shift representing a phase transition, but it may also happen continuously over a path in the phase diagram.
Two systems with significantly different ensembles of relevant microstates are "different materials".
An OPTIMADE structure already allow the representation of sets of microstates via the disorder and assembly features. This creates a somewhat arbitrary division of where the division goes between "one structure" and "one material". However, we believe the present structure definition reasonably represents a consensus where that division should go.

Out of this comes a proposal:

We add a materials entry type, and corresponding /materials endpoint to OPTIMADE.
The type=materials objects have as properties:

A list of structures (zero to many) that represent the relevant microstates for this material.
A number of properties we standardize as representing models presently used in the field to indicate mixtures, grains, disordered defect systems, etc. which cannot be represented simply as a set of 'structures'.

Additional models can be added by database providers themselves using their own _prefix_ identifiers.
One such model should be a specification of synthesis conditions used to create a material in experiments. A materials entry with such a model should be interpreted as "the material (defined by a set of relevant microstates) that is produced when one follows these steps in synthesis".

Of course it is perfectly allowable to have a materials object that simply refers to a single structure without no disorder. That would be the proper representation of a perfect bulk single crystal (arguably the most common material in the computational field). But materials entries have far more freedom than this.
As we go on to standardize property data, it should then refer to these materials objects as the "for what" the reported property data pertains.

I think the definition above captures the essence, if I understand it correctly.

The "list of structures" could also arise from different assessments of the same "material", e.g., DFT-PBE vs. DFT-HSE06 vs. XRD or (in some cases) TEM or similar

A "chemical composition" designation of a material should probably be included, at least for "single-phase" (important for naming) - but on its own, not sufficient (polymorphs)

for experimental assessments, synthesis as a defining property ensures some degree of reproducibility and is therefore useful (already mentioned above)


ARROW-4930: [C++] Improve find_package() support

Backward incompatibilities:

find_package(Arrow) doesn't find Arrow Python.
Users need to use find_package(ArrowPython).

find_package(ArrowCuda) doesn't work on not Windows (case
sensitive environments). Use find_package(ArrowCUDA) instead.

Summary:

Create arrow_find_package() in FindArrow.cmake and use it in
Find*.cmake.

arrow_find_package() is a function that finds an Arrow related
package. It supports ARROW_HOME/PARQUET_HOME environment variable,
CMake package configuration and pkg-config.

arrow_find_package() can find libraries installed under
lib/x86_64-linux-gnu/ (on Debian), lib64/ (on CentOS), lib/,
bin/ (on Windows).

We can remove workaround for ARROW-1090 in python/setup.py:
https://issues.apache.org/jira/projects/ARROW/issues/ARROW-1090

Create Find*.cmake per component. It means that FindArrow.cmake
doesn't find Arrow Python. Use find_package(ArrowPython) instead
of find_package(Arrow).

Install Find*.cmake to be reusable.

Changes for Linux packages are for this.

Rename arrowConfig.cmake, arrowTarget.cmake and so on to
ArrowConfig.cmake, ArrowTarget.cmake and so on to use the same
package for FindArrow.cmake. arrow-config.cmake is added for
backward compatibility. So users can use find_package(arrow)
instead of find_package(Arrow).

ArrowConfig.cmake provides more useful variables such as
ARROW_SO_VERSION and ARROW_FULL_SO_VERSION.

Rename FindArrowCuda.cmake to FindArrowCUDA.cmake because "CUDA"
is the official name.

Use find_package_handle_standard_args() in Find*.cmake. It means
that we can check required version by find_package(Arrow 0.15.0).

Changes for Parquet are for detecting Parquet version.

Use consistent variable names in Find*.cmake with keeping backward
compatibility:

${PACKAGE}_LIBS -> ${PACKAGE}_LIB_DIR: Because we use
${ARROW_INCLUDE_DIR} and CMake uses _DIR, _DIRECTORY, _PATH and
so on.

${PACKAGE}_SHARED_IMP_LIB -> ${PACKAGE}_SHARED_IMPLIB: Because
CMake uses IMPLIB such as IMPORTED_IMPLIB.

Find*.cmake provides CMake targets such as arrow_shared and
arrow_static even if it uses ARROW_HOME or pkg-config. Users can
use them to link to Arrow.

Remove needless ABI_VERSION handling in python/CMakeLists.txt
because ABI_VERSION just exists just for backward compatibility.
We should use only SO_VERSION.

Rename "executable" to "plasma_store_server" in
plasma.pc. "executable" is deprecated.

Add arrow-python-flight.pc.

Resolved issues:

ARROW-5021 [C++] Review hardcoded "lib" paths in
Find$PACKAGE.cmake related to endogenous libraries
https://issues.apache.org/jira/browse/ARROW-5021

Removed workarounds:

ARROW-1090 [Python] build_ext usability
https://issues.apache.org/jira/projects/ARROW/issues/ARROW-1090

ARROW-5025 [Python][Packaging] wheel for Windows are broken
https://issues.apache.org/jira/browse/ARROW-5025

ARROW-5026 [Python][Packaging] conda package on non Windows is broken
https://issues.apache.org/jira/browse/ARROW-5026

@ursabot crossbow submit -g conda -g wheel -g linux

Codecov Report

Merging #5767 into master will increase coverage by 0.55%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #5767      +/-   ##
==========================================
+ Coverage   89.01%   89.56%   +0.55%
==========================================
  Files        1006      814     -192
  Lines      137493   121983   -15510
  Branches     1501        0    -1501
==========================================
- Hits       122388   109255   -13133
+ Misses      14740    12728    -2012
+ Partials      365        0     -365

Impacted Files
Coverage Δ

cpp/src/arrow/csv/column_builder.cc
95.54% <0%> (-1.49%)
:arrow_down:

cpp/src/plasma/thirdparty/ae/ae.c
71.22% <0%> (-0.95%)
:arrow_down:

python/pyarrow/tests/test_parquet.py
95.24% <0%> (-0.12%)
:arrow_down:

go/arrow/ipc/writer.go

go/arrow/math/uint64_amd64.go

go/arrow/memory/memory_avx2_amd64.go

go/arrow/ipc/file_reader.go

js/src/builder/index.ts

js/src/enum.ts

go/arrow/array/builder.go

... and 187 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7fd9bac...2dacca1. Read the comment docs.

@ursabot crossbow submit -g conda -g wheel -g linux

@ursabot crossbow submit ubuntu-xenial

@ursabot crossbow submit ubuntu-xenial -g wheel

@ursabot crossbow submit wheel-osx-cp37m

@ursabot crossbow submit -g conda -g wheel -g linux

@ursabot crossbow submit -g conda -g wheel -g linux

@ursabot crossbow submit centos-8


Package jaxsim pulled from conda-forge raises error because of conflct with new Jax update

The dependency from Jax listed in the environment.yml file is not correct for a conda-forge installation, as it conflicts with a newer update of the Jax library.
Error
The error is:
ImportError: cannot import name 'config' from 'jax.config'
from file src/jaxsim/__init__.py: line 9
How to reproduce

The requirements.txt file contains the output of conda list:
conda version: 23.11.0

Possible solution
Require jax version to be < 0.4.25 in environment.yml

Hi @lorycontixd, thanks for reporting! Yes you are right, jax >= 0.4.25 removed jax.config  and we used to use it in our __init__.py. Our main branch has been already fixed in #92, but we still need to make a new release and propagate it to conda-forge.
We are soon releasing a new v0.2 with brand new APIs (follow #108 for more details). If you are starting any kind of exploration with JaxSim, I warmly recommend to install a development version from the functional branch. Code based on v0.1 will no longer run on v0.2, and it would need major updates.

I guess that in the case of the functional branch, if you want to install jaxsim from source in a conda environment, you can use the environment.yml file, right @diegoferigo ?
In that the installation is basically:
git clone https://github.com/ami-iit/jaxsim -b functional
conda create -f ./jaxsim/environment.yml
conda activate jaxsim
pip install -e --no-deps ./jaxsim

Should get fixed bu https://github.com/conda-forge/jaxsim-feedstock/pull/2.

PR merged, closing

Great!


Quality of life issues

Print newlines between the separate tqdm loading blocks.
Put NUM_UP_NODES above NUM_DOWN_NODES in central_config.yaml.
Strip out wandb logging where it doesn't play a meaningful role.

Note that it's nice to have wandb up front in collect_acts.py, so nothing waits on your wandb credentials login in a  pipeline run.

Improved documentation and the tqdm stdout; the current wandb usage is fine, on reflection.


Implement non-function type alias support in web debuggers

This issue tracks support of the non-function type alias feature.  See the enclosing meta-issue for details.
cc @franklinyow @sigmundch @mit-mit

I don't believe there is any specific work required for this, other than validating that the feature works as expected.
@jacob314 @grouma - do you agree?

Yeah I think we just need to validate that it works and if it doesn't, likely make edits to the logic here.

@grouma do we have a plan for validating this?

I think making use of the feature in a package:dwds smoke test, along with some specific VM Service protocols, should give us enough confidence.

Maybe it is worth also adding a couple tests to cover https://github.com/dart-lang/sdk/issues/44925 as well?

Wouldn't hurt. We'll need to know the SDK version that contains these features.

@grouma this will be released in 2.13 are you waiting on a dev build or can you go ahead and validate?  This CL can be patched in to build a version with the feature on by default.

Ping me when a dev build is available. It's much easier to validate that way.

It seems we won't have a dev build this week due to Easter holiday in Europe , can we validate with the CL?

@grouma this has landed, can you please test on master (I don't expect we will have a dev build before the branch cut window opens).

I downloaded the latest SDK:
Dart SDK version: 2.13.0-203.0.dev (dev) (Mon Apr 5 09:39:33 2021 -0700) on "macos_x64"
I updated the minimum SDK for my example project and included this:
typedef JsonMap = Map<String, dynamic>;

There are no errors with analysis, however  I'm having issues building:
[SEVERE] build_web_compilers:entrypoint on web/main.dart: This builder requires Dart inputs without syntax errors.
However, asset:webdev_example_app/web/main.dart (or an existing part) contains the following errors.
main.dart:11:17: Invalid generic function type.

Try fixing the errors and re-running the build.

[INFO] Running build completed, took 3.7s
[INFO] Caching finalized dependency graph completed, took 180ms
[SEVERE] Failed after 3.9s
[INFO] ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

cc @jakemac53
Without being able to build it's impossible for me to validate.

@grouma This is not in any dev build and I don't think it will be until AAR is back from vacation which will be too late.  I think you need to test this out on master.

I'll build from master locally but I'm confused as to why this isn't in the latest raw SDK. I thought raw corresponded to master. The given timestamp says it was built this morning. Correct my understanding.

@grouma is this a pkg:analyzer issue then?  You may need a version of pkg:analyzer with this enabled - cc @scheglov .

I don't think this is an analyzer issue. There are no analysis errors. (There were some until I upgraded the SDK and updated the pubspec). I think this may be a package:build issue. cc @natebosch

FYI, I'm waiting for the flag switch to be rolled into google3, and will publish package:analyzer then.

@grouma webdev serve works for me.
I had to ensure that the language version is 2.13, and use a dependency_override on analyzer from my local SDK checkout since it isn't published yet. It also took a few other overrides to get a valid solve. Here is the pubspec I used in a project where this worked:
name: dart_repro

environment:
  sdk: ">=2.13.0-0 <3.0.0"

dev_dependencies:
  build_runner: any
  build_web_compilers: any

dependency_overrides:
  analyzer:
    path: ../dart-sdk/sdk/pkg/analyzer
  front_end:
    path: ../dart-sdk/sdk/pkg/front_end
  _fe_analyzer_shared:
    path: ../dart-sdk/sdk/pkg/_fe_analyzer_shared
  package_config: 2.0.0

Thanks @natebosch, I was able to get it working.
Debugging doesn't blow up so that's good. I'm not sure what the intended behavior is here though. The displayed types are desugared. Look at the variables and console in the screenshot below. I suppose that's the desired behavior?

Expanding the types seems like fine behavior to me.


BUG: Chatbot and Translate icons overlaps with each other

Is there an existing issue for this?

[X] I have searched the existing issues

What happened?

The chatbot and translate icons overlaps this can be fixed to make the overall ui better.
@anuragverma108 could you assign this to me
Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC'24 contributor
[X] I want to work on this issue

Thanks for creating the issue in SwapReads! The issue has been assigned to you.
Before you start working on your PR, please make sure to:

⭐ Star the repository if you haven't already.
Pull the latest changes to avoid any merge conflicts.
Attach before & after screenshots in your PR for clarity.
Include the issue number in your PR description for better tracking.

I'm excited to see your contribution as part of GSSOC EXT. 2024! 🎉
Don't forget to follow @anuragverma108  - Project Admin & @sailaja-adapa  - Project Mentor on GitHub for more updates.
Happy open-source contributing! 🚀


Fix the arch check of jq in Mac M1 environment

Description

No official arm64 build for now but the current amd64 binary works for the M1 env
Reference Github issue: https://github.com/stedolan/jq/issues/2386

Motivation and Context
As mentioned in #660

[ ] I have raised an issue to propose this change, which has been given a label of design/approved by a maintainer (required)

How Has This Been Tested?

-> % rm -rf $HOME/.arkade/bin/jq
-> % go build && ./arkade get jq
Downloading: jq
2022/04/04 00:55:10 Looking up version for jq
2022/04/04 00:55:11 Found: jq-1.6
Downloading: https://github.com/stedolan/jq/releases/download/jq-1.6/jq-osx-amd64
843.79 KiB / 843.79 KiB [---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------] 100.00%
/var/folders/yn/j63ycsqj2294wfsp3z56_s_w0000gn/T/jq-osx-amd64 written.
2022/04/04 00:55:11 Looking up version for jq
2022/04/04 00:55:11 Found: jq-1.6
2022/04/04 00:55:11 Copying /var/folders/yn/j63ycsqj2294wfsp3z56_s_w0000gn/T/jq-osx-amd64 to /Users/hwchiu/.arkade/bin/jq

Tool written to: /Users/hwchiu/.arkade/bin/jq

# Add arkade binary directory to your PATH variable
export PATH=$PATH:$HOME/.arkade/bin/

# Test the binary:
/Users/hwchiu/.arkade/bin/jq

# Or install with:
sudo mv /Users/hwchiu/.arkade/bin/jq /usr/local/bin/

-> % file $HOME/.arkade/bin/jq
/Users/hwchiu/.arkade/bin/jq: Mach-O 64-bit executable x86_64

-> % $HOME/.arkade/bin/jq --version
jq-1.6

Are you a GitHub Sponsor (Yes/No?)

[ ] Yes
[x] No

Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Documentation

[ ] I have updated the list of tools in README.md if (required) with ./arkade get -o markdown
[ ] I have updated the list of apps in README.md if (required) with ./arkade install --help

Checklist:

[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I've read the CONTRIBUTION guide
[x] I have signed-off my commits with git commit -s
[x] I have added tests to cover my changes.
[x] All new and existing tests passed.

[x] I have tested this on arm, or have added code to prevent deployment

@alexellis
Thanks for reviewing, have updated the page with the tested result.

LGTM
We would like to see you contribute again, if you're interested, take a look at other issues or suggest new apps in an issue.

@alexellis
Sure, I just set up my Mac M1 recently and try to make every tool I need can be installed by the arkade, would like to fix the existing issues and add new tools in the future.


ReferenceError: window is not defined (2.0.0)

As specified in the release notes the library now uses userLocale and it defaults to properties on the window object. This naturally throws an error in Node environment:
ReferenceError: window is not defined
While this (at least in my case) is not an issue as I can just submit it through the options object, I still think it should be made clear in usage examples that userLocale must be provided when using Node.

Sigh. Thank you!

@wubzz are there localization modules you commonly use? Like locale?
Or would it be better to parse process.env.LANG directly?
http://man7.org/linux/man-pages/man7/environ.7.html
It make sense to default to en if nothing is available.
I'm obviously haven't used node in years as I totally forgot to test there...

@jsmreese I think just overall that relying on moment.locale() getter would make most sense. By default it's en. If the user has imported momentjs with locale support, then generally one would configure moment.locale('sv') prior to using moment-duration-format.
One issue with the current default-value implementation for browser based applications is that the lib will yield different results from the same input data depending on the visitors browser settings, since window.navigator.language is normally the selected language of the browser.

@wubzz thanks for the input.
I had a reason for using the browser's locale a few weeks ago, something to do with the way toLocaleString was behaving with a locale of en... but after exploring the config options for toLocaleString again today, I don't see anything amiss. Most of my work on the new version has been in the middle of the night bouncing a baby who wouldn't stay asleep, so I'll chalk this up to that.
I'll change the default to point to moment's locale and get a new version published shortly!

https://github.com/jsmreese/moment-duration-format/releases/tag/2.0.1
Please let me know if you see any further issues in Node!


Query: Need Help on Some Queries related to this library. Please assit.

Hello Team,
I need to use this library in a production application which has a user base of millions of users.
I have following queries and some simple doubts:
I respect you all so please do not take my questions otherwise, I am a beginner and some questions can be very basic, please consider me.

Can I use this library for production application to obfuscate strings
Tis library is in Kotlin, but will it support Java Android App
Will this library be maintained in future (at least for next 10 years)
If I face any challenge/crash then will I receive timely support/help
What if this library gets removed from GitHub due to some reasons, then what impact it will have to my application
What impact it will have to my application, if this library is no longer maintained.
How this library works?

Hi @shrishkukde,

This library is used in an app with a few million DAU, and it has never caused any issues.
At this point the library hypothetically can be used with any JVM-based language.
There're absolutely no warrantees regarding long-term support and any other support, but it's open-sourced, so you can fork it in case of emergency.
Once again no warranties, but if the issue will seem critical to me I'll fix it.
I don't think it will be removed but its source code is published on Maven Central along with the built artifacts, so you'll be able to get sources from there. And nothing can be removed from Maven Central.
Your application might stop building but you can remove the plugin from build.gradle files and fix the build. However in this case you'll lose obfuscation.
It uses Android Transform API and patches application's bytecode replacing string literals with some other code.


Add LLM abstractions from LangChain TS for Claude Opus and Google Gemini

Task Description
Create LLM classes for OpenAI, Claude Opus and Google Gemini, with a design that allows easy addition of other models in the future. This is a typescript based es module NodeJS modern server application.
Task Instructions
1. Create a new base chat class src/models/baseChatModel.ts in a new file.
2. Then create src/models/openAiChat.ts, src/models/claudeOpusChat.ts and src/models/googleGeminiChat.ts for chat only
3. For the cloudeOpus use the @anthropic-ai/sdk npm
4. For the googleGemini use the @google/generative-ai npm
5. For the openAi use the openai npm
6. The baseChatModel and the child classes should only implement those two methods:
generate([{role:string,message:string}], streaming: boolean | undefined, streamingCallback: Function | undefined)
getNumTokensFromMessages([{role:string,message:string}])

Has been completed by Engineer. Fully automatically programmed: https://github.com/CitizensFoundation/policy-synth/commit/83d7826f92a6ee66db635d025827e113459f878e


AttributeError: 'Tensor' object has no attribute 'convert' with open_clip

Hello,
I'm getting the following problem, when I run the command python -m nuitka --follow-imports --standalone .\app-demo.py on my project.
Loading model
INFO:root:Loaded coca_ViT-L-14 model config.
INFO:root:Loading pretrained coca_ViT-L-14 weights (mscoco_finetuned_laion2B-s13B-b90k).
C:\Users\janwe\dev\SUPERS~2\TAURI-~1\SRC-TA~1\clip\APP-DE~1.DIS\torchvision\transforms\functional.py:1603: UserWarning: The default value of the antialias parameter of all the resizing transforms (Resize(), RandomResizedCrop(), etc.) will change from None to True in v0.17, in order to be consistent across the PIL and Tensor backends. To suppress this warning, directly pass antialias=True (recommended, future default), antialias=None (current default, which means False for Tensors and True for PIL), or antialias=False (only works on Tensors - PIL will still use antialiasing). This also applies if you are using the inference transforms from the models weights: update the call to weights.transforms(antialias=True).
Traceback (most recent call last):
  File "C:\Users\janwe\dev\SUPERS~2\TAURI-~1\SRC-TA~1\clip\APP-DE~1.DIS\app-demo.py", line 20, in <module>
  File "C:\Users\janwe\dev\SUPERS~2\TAURI-~1\SRC-TA~1\clip\APP-DE~1.DIS\torchvision\transforms\transforms.py", line 95, in __call__
  File "C:\Users\janwe\dev\SUPERS~2\TAURI-~1\SRC-TA~1\clip\APP-DE~1.DIS\open_clip\transform.py", line 53, in _convert_to_rgb
    return image.convert('RGB')
AttributeError: 'Tensor' object has no attribute 'convert'

So the actual program launches, but crashes almost instantly because of a missing attribute.
The error above is the second error, I got. First I got this:
Traceback (most recent call last):
  File "C:\Users\janwe\dev\SUPERS~2\TAURI-~1\SRC-TA~1\clip\APP-DE~1.DIS\app-demo.py", line 6, in <module>
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "C:\Users\janwe\dev\SUPERS~2\TAURI-~1\SRC-TA~1\clip\APP-DE~1.DIS\open_clip\__init__.py", line 3, in <module open_clip>
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "C:\Users\janwe\dev\SUPERS~2\TAURI-~1\SRC-TA~1\clip\APP-DE~1.DIS\open_clip\factory.py", line 20, in <module open_clip.factory>
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "C:\Users\janwe\dev\SUPERS~2\TAURI-~1\SRC-TA~1\clip\APP-DE~1.DIS\open_clip\tokenizer.py", line 153, in <module open_clip.tokenizer>
  File "C:\Users\janwe\dev\SUPERS~2\TAURI-~1\SRC-TA~1\clip\APP-DE~1.DIS\open_clip\tokenizer.py", line 76, in __init__
  File "C:\Users\janwe\dev\SUPERS~2\TAURI-~1\SRC-TA~1\clip\APP-DE~1.DIS\gzip.py", line 58, in open
  File "C:\Users\janwe\dev\SUPERS~2\TAURI-~1\SRC-TA~1\clip\APP-DE~1.DIS\gzip.py", line 174, in __init__
FileNotFoundError: [Errno 2] No such file or directory: 'C:\\Users\\janwe\\dev\\SUPERS~2\\TAURI-~1\\SRC-TA~1\\clip\\APP-DE~1.DIS\\open_clip\\bpe_simple_vocab_16e6.txt.gz'

So the open_clip module is missing bpe_simple_vocab_16e6.txt.gz file in the open_clip subfolder. I solved this by copying the module folder from my site-packages folder over to the dist directory. This seemed odd to me. First it's unlikely that I have to do that and second I wonder, why the folder wasn't copied even though it's in my import statement in my app-demo.py.
Here's a minmal example with which I can reproduce the issue:
import logging
import sys
import time
import torch
from PIL import Image
import open_clip

print("Loading model")

logging.basicConfig(level=logging.INFO, stream=sys.stdout)

model, _, transform = open_clip.create_model_and_transforms(
    model_name="coca_ViT-L-14", pretrained="mscoco_finetuned_laion2B-s13B-b90k"
)

with torch.no_grad(), torch.cuda.amp.autocast():
    start = time.time()
    # Generate a random image for performance measurement
    im = torch.randn(1, 3, 224, 224)
    im = transform(im).unsqueeze(0)
    generated = model.generate(im)
    end = time.time()
    performanceSample = end - start

Compile log
Nuitka-Options:INFO: Used command line options: --follow-imports --standalone .\app-demo.py
Nuitka-Options:INFO: Following all imports is the default for standalone mode and need not be specified.
Nuitka:INFO: Starting Python compilation with Nuitka '1.6.1' on Python '3.10' commercial grade 'not installed'.
Nuitka-Plugins:INFO: multiprocessing: Injecting pre-module load code for module 'multiprocessing':
Nuitka-Plugins:INFO: multiprocessing:     Monkey patching "multiprocessing" load environment.
Nuitka-Plugins:INFO: multiprocessing: Injecting post-module load code for module 'multiprocessing':
Nuitka-Plugins:INFO: multiprocessing:     Monkey patching "multiprocessing" for compiled methods.
Nuitka-Plugins:WARNING: anti-bloat: Undesirable import of 'unittest' in 'torch._dynamo.config_utils' (at
Nuitka-Plugins:WARNING: 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\_dynamo\config_utils.py:7')
Nuitka-Plugins:WARNING: encountered. It may slow down compilation.
Nuitka-Plugins:WARNING:     Complex topic! More information can be found at
Nuitka-Plugins:WARNING: https://nuitka.net/info/unwanted-module.html
Nuitka-Plugins:INFO: delvewheel: Detected usage of 'delvewheel' version '1.3.1' in module 'scipy'.
Nuitka-Plugins:INFO: implicit-imports: Injecting pre-module load code for module 'torch.jit._state':
Nuitka-Plugins:INFO: implicit-imports:     According to Yaml configuration.
Nuitka-Inclusion:INFO: Cannot find distribution 'jax' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:107', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'flax' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:108', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'datasets' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:120', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'datasets' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:121', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'detectron2' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:130', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'faiss' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:138', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'faiss-cpu' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:142', expect potential run time problem, unless this is unused code.Nuitka-Inclusion:INFO: Cannot find distribution 'coloredlogs' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:158', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'tf2onnx' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:174', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'onnx' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:182', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'pytorch_quantization' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:190', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'soundfile' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:198', expect potential run time problem, unless this is unused code.Nuitka-Inclusion:INFO: Cannot find distribution 'tensorflow_probability' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:206', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'natten' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:222', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'phonemizer' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:238', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'pyctcdecode' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:246', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'librosa' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:254', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'oneccl_bind_pt' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:265', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'decord' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:272', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'jieba' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:279', expect potential run time problem, unless this is unused code.
Nuitka-Inclusion:INFO: Cannot find distribution 'intel_extension_for_pytorch' at 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py:532', expect potential run time problem, unless this is unused code.
Nuitka-Plugins:WARNING: anti-bloat: Undesirable import of 'doctest' in 'sympy.testing.runtests' (at
Nuitka-Plugins:WARNING: 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\sympy\testing\runtests.py:26')
Nuitka-Plugins:WARNING: encountered. It may slow down compilation.
Nuitka-Plugins:WARNING:     Complex topic! More information can be found at
Nuitka-Plugins:WARNING: https://nuitka.net/info/unwanted-module.html
Nuitka-Plugins:WARNING: anti-bloat: Undesirable import of 'setuptools' in 'torch.utils.cpp_extension' (at
Nuitka-Plugins:WARNING: 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\utils\cpp_extension.py:8')
Nuitka-Plugins:WARNING: encountered. It may slow down compilation.
Nuitka-Plugins:WARNING:     Complex topic! More information can be found at
Nuitka-Plugins:WARNING: https://nuitka.net/info/unwanted-module.html
Nuitka-Plugins:WARNING: anti-bloat: Undesirable import of 'setuptools' in 'torch.utils.cpp_extension' (at
Nuitka-Plugins:WARNING: 'C:\Users\janwe\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\utils\cpp_extension.py:24')
Nuitka-Plugins:WARNING: encountered. It may slow down compilation.
Nuitka-Plugins:WARNING:     Complex topic! More information can be found at
Nuitka-Plugins:WARNING: https://nuitka.net/info/unwanted-module.html
Nuitka-Plugins:INFO: pkg-resources: Injecting post-module load code for module 'pkg_resources':
Nuitka-Plugins:INFO: pkg-resources:     Registering Nuitka loader with "pkg_resources".
Nuitka:INFO: Completed Python level compilation and optimization.
Nuitka:INFO: Generating source code for C backend compiler.
Nuitka:INFO: Running data composer tool for optimal constant value handling.
Nuitka:INFO: Running C compilation via Scons.
Nuitka-Scons:INFO: Backend C compiler: cl (cl 14.2).
Nuitka-Scons:INFO: Backend linking program with 3947 files (no progress information available for this stage).
Nuitka-Scons:INFO: Compiled 3947 C files using clcache with 3945 cache hits and 2 cache misses.
Nuitka-Plugins:INFO: data-files: Included data file 'certifi\cacert.pem' due to package data for 'certifi'.
Nuitka-Plugins:INFO: data-files: Included data file 'torch\bin\nvfuser_tests.exe' due to package data directory 'bin' for 'torch'.
Nuitka-Plugins:INFO: data-files: Included data file 'torch\bin\protoc.exe' due to package data directory 'bin' for 'torch'.
Nuitka-Plugins:INFO: data-files: Included 8105 data files due to package data directory 'include' for 'torch'.
Nuitka-Plugins:INFO: dll-files: Found 1 file DLLs from numpy installation.
Nuitka-Plugins:INFO: dll-files: Found 36 files DLLs from torch installation.
Nuitka-Plugins:INFO: dll-files: Found 3 files DLLs from torchvision installation.
Nuitka:INFO: Keeping build directory 'app-demo.build'.
Nuitka:INFO: Successfully created 'app-demo.dist\app-demo.exe'.

Nuitka version, full Python version, flavor, OS, etc. as output by this
command.

python -m nuitka --version

1.6.1
Commercial: None
Python: 3.10.11 (tags/v3.10.11:7d4cc5a, Apr  5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)]
Flavor: CPython Official
Executable: C:\Users\janwe\AppData\Local\Programs\Python\Python310\python.exe
OS: Windows
Arch: x86_64
WindowsRelease: 10

How did you install Nuitka and Python

Installed from pip

The specific PyPI names and versions

python -m pip freeze

Output
absl-py==1.4.0
altgraph==0.17.3
asttokens==2.0.8
astunparse==1.6.3
backcall==0.2.0
bark==0.1.0
boto3==1.26.118
botocore==1.29.118
cachetools==5.3.1
certifi==2022.12.7
charset-normalizer==3.1.0
click==8.1.3
colorama==0.4.6
debugpy==1.6.3
decorator==5.1.1
einops==0.6.1
encodec==0.1.1
entrypoints==0.4
executing==1.1.1
filelock==3.12.0
Flask==2.2.3
flatbuffers==23.5.26
ftfy==6.1.1
funcy==2.0
gast==0.4.0
google-auth==2.19.1
google-auth-oauthlib==1.0.0
google-pasta==0.2.0
grpcio==1.54.2
h5py==3.8.0
huggingface-hub==0.13.4
idna==3.4
ipykernel==6.16.0
itsdangerous==2.1.2
jax==0.4.12
jedi==0.18.1
Jinja2==3.1.2
jmespath==1.0.1
jupyter-core==4.11.1
jupyter_client==7.3.5
keras==2.12.0
libclang==16.0.0
Markdown==3.4.3
MarkupSafe==2.1.2
matplotlib-inline==0.1.6
ml-dtypes==0.2.0
mpmath==1.3.0
nest-asyncio==1.5.6
netaddr==0.8.0
networkx==3.1
Nuitka==1.6.1
numpy==1.23.5
oauthlib==3.2.2
open-clip-torch==2.17.1
opt-einsum==3.3.0
ordered-set==4.1.0
packaging==23.1
parso==0.8.3
pefile==2023.2.7
pickleshare==0.7.5
Pillow==9.5.0
prompt-toolkit==3.0.31
protobuf==3.20.3
psutil==5.9.2
pure-eval==0.2.2
pyasn1==0.5.0
pyasn1-modules==0.3.0
pyinstaller==5.10.1
pyinstaller-hooks-contrib==2023.2
python-dateutil==2.8.2
pywin32==304
pywin32-ctypes==0.2.0
PyYAML==6.0
pyzmq==24.0.1
regex==2023.3.23
requests==2.28.2
requests-oauthlib==1.3.1
rsa==4.9
s3transfer==0.6.0
scipy==1.10.1
sentencepiece==0.1.98
six==1.16.0
stack-data==0.5.1
suno-bark @ file:///C:/Users/janwe/dev/bark
sympy==1.11.1
tensorboard==2.12.3
tensorboard-data-server==0.7.0
tensorflow==2.12.0
tensorflow-estimator==2.12.0
tensorflow-intel==2.12.0
tensorflow-io-gcs-filesystem==0.31.0
termcolor==2.3.0
timm==0.6.13
tokenizers==0.13.3
torch==2.0.0+cu117
torchaudio==2.0.1
torchvision==0.15.1+cu117
tornado==6.2
tqdm==4.65.0
traitlets==5.4.0
transformers==4.28.1
typing_extensions==4.5.0
urllib3==1.26.15
waitress==2.1.2
wcwidth==0.2.5
WebOb==1.8.7
Werkzeug==2.2.3
wrapt==1.14.1
zstandard==0.21.0

This report is a bit messed up, I think you are saying it needs a data file configuration. And then, if you manually workaround that, there is an error as well. I like to deal with first errors first.

Yes, sure, that would make sense. I just wanted to document the steps I tried to resolve the issue.

I really would have preferred if you had read the manual to check out, how to add data files, but you can retry once I added the config, so it's done by default.


revisit identifier service spec

does id-proxy-api spec (written to our requirements but for hydrox + serverless) need rewriting for taco?

done via https://github.com/sul-dlss-labs/identifier-service/pull/39 & morning call.


In-Component Guard beforeRouteLeave not working

Vue.js / vue-router versions
2.1.8 / 2.1.1
Happens in Vue SPA app made with webpack vue cli template. Tested with fresh project.
See the details here: https://forum.vuejs.org/t/in-component-guard-beforerouteleave-not-working/4658/1

@posva I also tried using the beforeRouteLeave hook in multiple child view components and it still doesn't do anything. E.g below
<template>
  <canvas v-bind:id="'chart-hardsets-program-' + programId" width="400" height="150"></canvas>
</template>

<script>
import Chart from 'chart.js'

export default {
  props: {
    programId: {
      required: true,
      type: Number
    }
  },
  data: function () {...},

  methods: {...},

  beforeRouteLeave (to, from, next) {
    console.log('left child component')
  },
  mounted: function () {...} // mounted
}
</script>

@posva I also tried using the beforeRouteLeave hook in multiple child view components and it still doesn't do anything. E.g below
<template>
  <canvas v-bind:id="'chart-hardsets-program-' + programId" width="400" height="150"></canvas>
</template>

<script>
import Chart from 'chart.js'

export default {
  props: {
    programId: {
      required: true,
      type: Number
    }
  },
  data: function () {...},

  methods: {...},

  beforeRouteLeave (to, from, next) {
    console.log('left child component')
  },
  mounted: function () {...} // mounted
}
</script>

Solved here:  https://forum.vuejs.org/t/in-component-guard-beforerouteleave-not-working/4658

Solved here:  https://forum.vuejs.org/t/in-component-guard-beforerouteleave-not-working/4658

@smarbos Maybe you are using beforeRouteLeave in a sub component.
Check this issue

I've experienced this issue as well - i was autoregistering my components with require context
const componentContext = require.context("@/components", true, /\.vue$/);
const pagesContext = require.context("@/crm", true, /\.vue$/);

I was registering hooks after i registered my components
Component.registerHooks([
    "beforeRouteEnter",
    "beforeRouteLeave",
    "beforeRouteUpdate" // for vue-router 2.2+
]);

When moving the hooks registration above the component registration - it worked perfectly

The component using beforeRouteLeave or beforeRouteUpdate needs to be declared as a path in vue-router, otherwise it won't be recognized as one and view route updates won't be triggered.

Not stop when condition press button F5.

I've had this issue, the doc did not mention I needed to add:
Component.registerHooks([
    'beforeRouteEnter'
    'beforeRouteUpdate',
    'beforeRouteLeave'
]);

before my typescript class-component declaration.
As stated, it only works for root components, declared in the router declaration

@lgarczyn thanks a lot. I was scratching my head on this for many hours.


Replace function files with module classes

https://github.com/10up/wp-scaffold/tree/trunk/themes/10up-theme/includes
We should be consistent with how we use actions/filters. Either we should use functions everywhere or classes everywhere.

Thanks, @tobeycodes. I've added this to the Internal Tools working group agenda to be discussed. If you have any additional context/information that would be useful for those reviewing this, I'd greatly appreciate it if you could add it.
From my perspective, the issue here is that we have classes containing actions/filters, but then we also have functional PHP files containing actions/filters. The issue with mixing them is that:

We end up with poorly organised code because engineers disagree about where the best place to put them is.
Mixing functional and OOP code can be confusing when we could use OOP for everything.
Having one or the other would make it easier to implement tests across projects/the scaffold as we'd need less manual loading.

Is there anything there you think I've missed?

@darylldoyle Summed up perfectly


Properly finish the task with 'HideOnSuccess' enabled

This PR fixes an issue with syft hanging on syft packages with either SYFT_GOLANG_SEARCH_LOCAL_MOD_CACHE_LICENSES or  SYFT_GOLANG_SEARCH_REMOTE_LICENSES set.
I believe the issue is with the HideOnSuccess being used in the cataloger task. It depends on the value of RemoveOnCompletion but it seems to be true for licenses.
I know of workarounds with enabling the verbose mode or using a file output for the report, but none work for me, tbh.

Thanks @kzantow!


Update toc.yaml

Proposed changes

Unreleased project version (optional)

Related issues (optional)
#8715

Deploy preview for docsdocker ready!
Built with commit 029b5032d7a67ea628c2902c909f8d6b8e853ef5
https://deploy-preview-8925--docsdocker.netlify.com


Wider testing of instructions from the team

As part of our stability effort, it would be good to get some additional testing to supplement what William has done.
Propose that people try the different instructions:

[ ] FHIR data pipes single machine instruction
[ ] End-to-end example instructions

Can you add the URLs that we should try out?

https://github.com/google/fhir-data-pipes/wiki/Analytics-on-a-single-machine-using-Docker

Collecting observations on my end in testing documentation

[ ] FHIR-data-pipes could use some overall restructuring to fix navigation.
[ ] It would be good to have a "prerequisites" section that in one shot explains what tooling needs to be set up to try things.


Decoded HTML characters

Replaced > with > and < with <.

Thanks for the PR, sorry I didn't see it a few years sooner!