Support barrier mode for mapInPandas/mapInArrow [databricks]

To fix https://github.com/NVIDIA/spark-rapids/issues/10344
Spark 3.5 has introduced a new feature supporting barrier mode for mapInPandas/mapInArrow, more detail can be found at https://issues.apache.org/jira/browse/SPARK-42896. However, spark-rapids missed this feature which resulted in unexpected behavior. For example
spark.range(10).mapInPandas(lambda x: x, "id long", True)

The same tasks of the above code will run on barrier mode on the CPU, while on non-barrier mode on the GPU with spark-rapids.

build


Add support for Latin-1, Cyrillic, and CJK characters inside \text{}

Summary:
This diff provides support for Latin-1, Cyrillic, and CJK characters
inside \text{} groups.  For Latin-1 and Cyrillic characters we use
glyph metrics from a glyph from Basic Latin that has roughly the same
bounding box.  We use the metrics for a capital 'M' to approximate the
full-width CJK characters.  Half-width characters are not supported yet.
Test Plan:

make test

TODO:

[ ] make screenshots

Those CJK characters don't look like Computer Modern. Are they supposed to?

@spicyj good eye.  This diff is a stop-gap measure for Latin-1.  The plan is to eventually get https://github.com/Khan/KaTeX/pull/409 merged in and then create accented characters using combining marks that already exist in our fonts.  When the happens I use the correct font metrics for those characters.
I played around with it a bit and it seems to be doing the correct the thing for fractions and roots.  I'll post some more screenshots in a bit.

The screenshot tests are failing b/c I didn't include a screenshot in this diff b/c my docker setup is broken for the moment.  I'm going to try out @gagern's docker-machine branch.

@spicyj sorry you were asking about the CJK characters.  Those are also not CM.  I'm hesitant to include a specific font especially for CJK because it will take a while to download.

Yeah. We could have a separate font file for CJK and browsers should only download it if it's used, but I'm guessing there isn't even CM type for CJK chars? The Latin-1 chars do look like CM to me – am I crazy?

The Latin-1 chars do look like CM to me – am I crazy?

Times New Roman is pretty close to CM.

No, this is what those chars look like in Times New Roman:

This is a nice feature, and pretty important in Germany (due to ÄÖÜäöüß). Personally I'd say that even imperfect rendering should be preferable to no rendering in these cases. So a stopgap like this is great!
In case this approach will be around a while longer (and I assume that to be the case for CJK at least), perhaps we should empower site authors by providing config callbacks to determine CSS classes and character metrics for given glyphs. But that's probably best discussed in a follow-up ticket once the core here is in. Or as part of #123 and its duplicates.
Regarding this whole substitute letter magic I'd suggest keeping two things in mind. Firtly, you are substituting the metrics of a similar letter but in a completely different and unknown font. So don't get your expectations too high about the accuracy of that. Secondly, even though #366 added widths, KaTeX isn't actually using them, is it? So the key point to concentrate on for substitute characters is vertical metrics. Which is tricky, since descenders in particular vary greatly between fonts and languages. In many fonts ß will have a considerable descender, but you can't know that if you don't know the font. Ignoring accents will lead to incorrect vertical metrics as well. So my main point is: don't put too much effort (and code size) into this since it's going to be wrong in many cases despite your efforts.
FYI: I just had a look at CSS3 Writing Modes and verified that the dominant baseline of mixed-script inline text is defined to be alphabetic (for horizontal writing), deferring configurability to “a future CSS module”. So if the font doesn't fit its metrics, we'd most likely see problems at the upper boundary of the box.

Look at the ï in the first row of your screenshot! It looks as though an i with dot was combined with a combining diaresis. So I'd guess that these glyphs are indeed CM, and your browser's text rendering engine is doing its best to generate the glyphs in question from the requested font before falling back to another font.

@gagern really good points about the inexact science of providing substitute metrics for characters.  The ascender is the important thing.  Unfortunately, characters with accents will have the wrong ascender for now so people should avoid doing \vec{\text{À}} for now.

No, this is what those chars look like in Times New Roman:

I really wasn't paying attention to the i.  It has

The KaTeX fonts have the dotless i in the right position.  I wonder why the browser isn't using it.

The screenshot tests made me sad b/c there are not CJK fonts install on the selenium docker images which means we'll have to make some custom images.  Hopefully we can derive them from the images we're currently using.

Instead of modifying the selenium images, I'd suggest adding some suitable fonts as webfonts, adding them to the css of the test html, and serving them as static content.

@gagern great idea.  I'll do that as part of this PR.
In the meantime, I've update the code to use serif fonts for CJK glyphs and i with accents don't have the extra dot anymore.

I just noticed I have Korean twice.

Although I added the "fallback" class and was able to get that working with different fonts in the test page, I wasn't able to get those other fonts showing when doing the screenshot tests.  I'm going to leave that as a task for a future PR.

It appears DejaVu doesn't have Korean, contrary to what I'd have expected. Maybe we should choose something different, perhaps something available on TeX as well.

This looks fine to me, once the screenshot tests look good :)

The screenshots work now.  It took a while finding fonts that actually worked inside of the docker container.

What's the license of these font's you're putting into the repo? For the Honoka Mincho font I'd guess these terms apply, which as far as I understand it requires redistribution of the license term along with the font. The Baekmuk Batang tarball contains a LICENSE file which also requires distribution of said notice along with the font.

Personally I'd prefer not to put 18M of font data into the repository just for this single test, and instead have that downloaded by some script, or perhaps packaged as an npm dependency. This is not my project, so others will have to decide on this, but I'd like to make you aware of the considerable increase in repo size as a consequence of this PR as it stands now.

@gagern really good point about the license and the size of these fonts.

I put the fonts in a separate repo along with LICENSE files for each of them.

It looks like everyone's concerns have been address so I'm going to merge this now.

How does this work? Do I need to configure something special?
I just get this:
ParseError: KaTeX parse error: Expected '}', got 'ß' at position 9: \text{Maß̲einheit}```. Same for `ä` etc.

@i-am-the-slime this is on master.  We still need to do a release.


added initializer for kaminari hooks

Coverage increased (+0.007%) to 97.201% when pulling aee7c6d5e89a23f2edee1d52624f8d3e44403eac on ninech:kaminari-init into ce5af7c4367cfc208f2402e263646c1c51758ff4 on rbCAS:master.

I'll first do some testing (as it should've been done before...)

This change is necessary because kaminari wasn't initialised correctly. Therefore their was an exception when using the pagination.
I've no idea how this was working before locally. (Maybe there's was a kaminari-initializer lying around in our sso app, which I missed to consider)
Sorry for the inconveniences. At least some lessons learned for the future ;-)

third time's the charm


[core-http] prepare CHANGELOG for 2021 November release

Update date and bug fix entries.

/check-enforcer override


AES Encryption link

Hi colleagues,
AES encryption for AD authentication (Preview) currently links to:
https://docs.microsoft.com/en-us/azure/azure-netapp-files/azure-netapp-files-create-volumes-smb
It should link to:
https://docs.microsoft.com/en-us/azure/azure-netapp-files/create-active-directory-connections#create-an-active-directory-connection
Gr. Rutger

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 8380a849-c87e-6769-0c7d-c4913b5e98eb
Version Independent ID: b7192f4f-534d-69b0-40ee-38740598c28c
Content: What's new in Azure NetApp Files
Content Source: articles/azure-netapp-files/whats-new.md
Service: azure-netapp-files
GitHub Login: @b-juche
Microsoft Alias: b-juche

Thanks for reporting this. I have assigned the issue to the content author to investigate further and update the document as appropriate.

Thanks @RutgerKosters!  Fixed.
#please-close


Fix double-escaped underscores in Direct3D 12 Video GUIDs section header

@takerukoushirou : Thanks for your contribution! The author(s) have been notified to review your proposed change.


Users lost access to their own private indices and tenant indices.

I patched the OS of our ES cluster today and suddenly users are seeing a blank white screen when trying to access the “Discover” app in Kibana.
Looking at the logs, its because the user can no longer access the indices in question
No index-level perm match for User [name=user.name, backend_roles=[Incident Response Users], requestedTenant=Incident Response] Resolved [aliases=[.kibana_-1461739569_incidentresponse], indices=[], allIndices=[.kibana_-1461739569_incidentresponse_2], types=[*], originalRequested=[.kibana_-1461739569_incidentresponse, .kibana_-1461739569_incidentresponse_2], remoteIndices=[]] [Action [indices:data/read/mget[shard]]] [RolesChecked [Incident Response Users, own_index]]

I am able to create a new tenant and grant access to that and it all works. If I delete the users .kibana indices they get created and that works too…
As an administrator I have access without issue. If I gave access specifically to these indices it works, but that is not how it’s supposed to be.

@adammike Mike, can you provide more information on the patch applied?

They were operating system patches, nothing related to Elasticsearch or opendistro. The opendistro* and elasticsearch-oss packages are version locked. Here is the yum log:
Mar 10 16:21:32 Updated: nss-util-3.44.0-4.el7_7.x86_64
Mar 10 16:21:32 Updated: libsss_idmap-1.16.4-21.el7_7.1.x86_64
Mar 10 16:21:32 Updated: libuuid-2.23.2-61.el7_7.1.x86_64
Mar 10 16:21:32 Updated: samba-common-4.9.1-10.el7_7.noarch
Mar 10 16:21:33 Updated: samba-client-libs-4.9.1-10.el7_7.x86_64
Mar 10 16:21:33 Updated: libwbclient-4.9.1-10.el7_7.x86_64
Mar 10 16:21:33 Updated: samba-common-libs-4.9.1-10.el7_7.x86_64
Mar 10 16:21:33 Updated: libblkid-2.23.2-61.el7_7.1.x86_64
Mar 10 16:21:33 Updated: libmount-2.23.2-61.el7_7.1.x86_64
Mar 10 16:21:34 Updated: samba-libs-4.9.1-10.el7_7.x86_64
Mar 10 16:21:34 Updated: libsmbclient-4.9.1-10.el7_7.x86_64
Mar 10 16:21:34 Updated: nss-softokn-freebl-3.44.0-8.el7_7.x86_64
Mar 10 16:21:34 Updated: libsmartcols-2.23.2-61.el7_7.1.x86_64
Mar 10 16:21:44 Updated: selinux-policy-3.13.1-252.el7_7.6.noarch
Mar 10 16:21:45 Installed: python2-typing-<IP_ADDRESS>-4.el7.noarch
Mar 10 16:21:45 Updated: ppp-2.4.5-34.el7_7.x86_64
Mar 10 16:21:46 Updated: ca-certificates-2019.2.32-76.el7_7.noarch
Mar 10 16:21:56 Updated: 1:java-11-openjdk-headless-<IP_ADDRESS>-1.el7_7.x86_64
Mar 10 16:21:56 Updated: 1:java-11-openjdk-<IP_ADDRESS>-1.el7_7.x86_64
Mar 10 16:21:56 Updated: firewalld-filesystem-0.6.3-2.el7_7.3.noarch
Mar 10 16:21:56 Updated: http-parser-2.7.1-8.el7_7.2.x86_64
Mar 10 16:21:57 Updated: libsss_nss_idmap-1.16.4-21.el7_7.1.x86_64
Mar 10 16:21:57 Updated: sssd-client-1.16.4-21.el7_7.1.x86_64
Mar 10 16:21:57 Updated: kernel-tools-libs-3.10.0-1062.12.1.el7.x86_64
Mar 10 16:21:58 Updated: libsss_sudo-1.16.4-21.el7_7.1.x86_64
Mar 10 16:21:58 Updated: python-sssdconfig-1.16.4-21.el7_7.1.noarch
Mar 10 16:21:58 Updated: libsss_autofs-1.16.4-21.el7_7.1.x86_64
Mar 10 16:21:58 Updated: libipa_hbac-1.16.4-21.el7_7.1.x86_64
Mar 10 16:21:58 Updated: python-firewall-0.6.3-2.el7_7.3.noarch
Mar 10 16:21:58 Updated: sqlite-3.7.17-8.el7_7.1.x86_64
Mar 10 16:21:58 Updated: nss-softokn-3.44.0-8.el7_7.x86_64
Mar 10 16:21:58 Updated: nss-sysinit-3.44.0-7.el7_7.x86_64
Mar 10 16:21:58 Updated: nss-3.44.0-7.el7_7.x86_64
Mar 10 16:21:58 Updated: libsss_certmap-1.16.4-21.el7_7.1.x86_64
Mar 10 16:21:58 Updated: libcurl-7.29.0-54.el7_7.2.x86_64
Mar 10 16:21:59 Updated: sssd-common-1.16.4-21.el7_7.1.x86_64
Mar 10 16:21:59 Updated: sssd-krb5-common-1.16.4-21.el7_7.1.x86_64
Mar 10 16:21:59 Updated: sssd-common-pac-1.16.4-21.el7_7.1.x86_64
Mar 10 16:21:59 Updated: 1:NetworkManager-libnm-1.18.0-5.el7_7.2.x86_64
Mar 10 16:22:00 Updated: 1:NetworkManager-1.18.0-5.el7_7.2.x86_64
Mar 10 16:22:00 Updated: sssd-ad-1.16.4-21.el7_7.1.x86_64
Mar 10 16:22:00 Updated: sssd-ipa-1.16.4-21.el7_7.1.x86_64
Mar 10 16:22:00 Updated: sssd-ldap-1.16.4-21.el7_7.1.x86_64
Mar 10 16:22:00 Updated: sssd-krb5-1.16.4-21.el7_7.1.x86_64
Mar 10 16:22:00 Updated: sssd-proxy-1.16.4-21.el7_7.1.x86_64
Mar 10 16:22:00 Updated: sssd-1.16.4-21.el7_7.1.x86_64
Mar 10 16:22:00 Updated: 1:NetworkManager-ppp-1.18.0-5.el7_7.2.x86_64
Mar 10 16:22:00 Updated: 1:NetworkManager-tui-1.18.0-5.el7_7.2.x86_64
Mar 10 16:22:00 Updated: 1:NetworkManager-team-1.18.0-5.el7_7.2.x86_64
Mar 10 16:22:00 Updated: curl-7.29.0-54.el7_7.2.x86_64
Mar 10 16:22:00 Updated: nss-tools-3.44.0-7.el7_7.x86_64
Mar 10 16:22:01 Updated: firewalld-0.6.3-2.el7_7.3.noarch
Mar 10 16:22:01 Updated: kernel-tools-3.10.0-1062.12.1.el7.x86_64
Mar 10 16:22:01 Updated: 1:java-11-openjdk-devel-<IP_ADDRESS>-1.el7_7.x86_64
Mar 10 16:22:02 Updated: m2crypto-0.31.0-4.el7.x86_64
Mar 10 16:22:16 Updated: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch
Mar 10 16:22:17 Updated: util-linux-2.23.2-61.el7_7.1.x86_64
Mar 10 16:22:17 Updated: samba-common-tools-4.9.1-10.el7_7.x86_64
Mar 10 16:22:18 Updated: python2-pip-8.1.2-12.el7.noarch
Mar 10 16:22:18 Updated: sudo-1.8.23-4.el7_7.2.x86_64
Mar 10 16:22:18 Updated: 1:NetworkManager-config-server-1.18.0-5.el7_7.2.noarch
Mar 10 16:22:18 Updated: python-perf-3.10.0-1062.12.1.el7.x86_64
Mar 10 16:22:26 Updated: 2:microcode_ctl-2.1-53.7.el7_7.x86_64
Mar 10 16:22:38 Installed: kernel-3.10.0-1062.12.1.el7.x86_64
Mar 10 16:22:38 Installed: xe-guest-utilities-latest-7.17.0-2.el7.x86_64
Mar 10 16:22:39 Updated: binutils-2.27-41.base.el7_7.2.x86_64
Mar 10 16:22:39 Updated: iprutils-<IP_ADDRESS>-3.el7_7.x86_64
Mar 10 16:22:40 Updated: numactl-libs-2.0.12-3.el7_7.1.x86_64
Mar 10 16:22:40 Updated: iproute-4.11.0-25.el7_7.2.x86_64
Mar 10 16:22:41 Updated: filebeat-7.6.1-1.x86_64
Mar 10 16:22:41 Updated: auditbeat-7.6.1-1.x86_64
Mar 10 16:22:42 Updated: python2-psutil-5.6.7-1.el7.x86_64
Mar 10 16:22:42 Updated: nss-softokn-freebl-3.44.0-8.el7_7.i686
Mar 10 16:22:50 Erased: xe-guest-utilities-7.12.0-2.el7.x86_64

Here are the version locks I have in place for open distro and elasticsearch
0:opendistroforelasticsearch-1.4.0-1.*
0:opendistro-performance-analyzer-<IP_ADDRESS>-1.*
0:opendistro-sql-<IP_ADDRESS>-1.*
0:opendistro-security-<IP_ADDRESS>-0.*
0:opendistro-alerting-<IP_ADDRESS>-1.*
0:opendistro-index-management-<IP_ADDRESS>-1.*
0:opendistro-job-scheduler-<IP_ADDRESS>-1.*
0:elasticsearch-oss-7.4.2-1.*

@adammike Did you get this resolved? If not, which version are you currently using? Could you provide copy of the roles.yaml file?

no, I had to add explicit permissions for the users to access their own indices. Ultimately we moved away from opendistro and onto the paid version of Elasticsearch.

Closing as at this point we might not be able to reproduce with the information above, especially as reporting user has since moved on from ODFE.


[Feature Request] 印章生成工具

Checklist

[X] I searched exising issues and no one else requests similar feature.
[X] I think that 25%+ users are positive towards this feature.

Describe the feature

Additional context
https://github.com/864381832/xJavaFxTool-plugin/tree/master/littleTools/x-SealBuilderTool

只在中文系统中使用

Hello @unknowIfGuestInDream. This issue is marked as deprecated and closed.


Adding C implementation for @stdlib/node_moudles/math/base/special/sin

Description

What is the purpose of this pull request?

This pull request:
Adds native C implementation for @stdlib/math/base/special/sin
double stdlib_base_sin ( const double x );
Related Issues
Issue Tracker: https://github.com/stdlib-js/stdlib/issues/2018
This pull request:

Adds C Implementation of @stdlib/node_moudles/math/base/special/sin

Questions

Any questions for reviewers of this pull request?

No.
Other

Any other information relevant to this pull request? This may include screenshots, references, and/or implementation notes.

No.
Checklist

Please ensure the following tasks are completed before submitting this pull request.

[ ] Read, understood, and followed the contributing guidelines.

@stdlib-js/reviewers

NOTE:
The sin function contains precision upto 4 floating points. (ie. +-0.00001)
Thanks!

@xaman27x As is, we cannot accept the changes introduced in this PR. Please ensure you study how other packages include C implementations.
E.g., don't write your own binding.gyp file, copy it from other packages, comments and all.
You shouldn't be modifying the contents of package.json, except for gypfile and directories. Use project Makefiles, copying them from other packages.
We have project tooling for compilation. Learn that tooling.
Your addon interface does not conform to our conventions.
Your C implementation needs considerable work. sin depends on rempio2: https://svnweb.freebsd.org/base/release/9.3.0/lib/msun/src/s_sin.c?view=markup. Meaning, the prerequisite for adding a C implementation to sin has not been satisfied in order to add this implementation.

Alright! I'll copy all necessary files henceforth! And since the Sin implementation requires C implementation of 'rempio2' as well, I'll work upon that first!
Thank you for consideration
Best.

This PR has been superseded by #2349. Will go ahead and close. Thank you, @xaman27x, for your interest in stdlib.


Fancy Zones does not keep mainscreen definition

ℹ Computer information

PowerToys version: 0.22.0
PowerToy Utility: Fancy Zones
Running PowerToys as Admin: no
Windows build number: [run "winver"] 1909

📝 Provide detailed reproduction steps (if any)

Connect Laptop to one screen
Adjust Fancy Zones on both monitors
Shutdown Laptop
Connect Laptop to two differnet monitors
Fancy Zones do get back up running correct except the resolution on on the laptop (mainscreen in both configs) is sized differently
Reaply Fancy Zones settings without changing anything gets it back up running as expected

✔ Expected result
Should keep it's zones width and height on the mainscreen
❌ Actual result
Does not
📷 Screenshots

Are there any useful screenshots? WinKey+Shift+S and then just paste them directly into the form

@andyfrei
can you please clarify step 5?

Fancy Zones do get back up running correct except the resolution on on the laptop (mainscreen in both configs) is sized differently

Please have a look at the gif.Does that clarify enough?andyonthemove
-------- Ursprüngliche Nachricht --------Von: Enrico Giordani<EMAIL_ADDRESS>Datum: 28.09.20  11:45  (GMT+01:00) An: microsoft/PowerToys<EMAIL_ADDRESS>Cc: Andy Frei<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Betreff: Re: [microsoft/PowerToys] Fancy Zones does not keep mainscreen definition (#6862)
@andyfrei
can you please clarify step 5?
Fancy Zones do get back up running correct except the resolution on on the laptop (mainscreen in both configs) is sized differently
—You are receiving this because you were mentioned.Reply to this email directly, view it on GitHub, or unsubscribe.

@andyfrei

Please have a look at the gif.Does that clarify enough?

No, it doesn't provide enough information on the exact repro steps with exact actions at each step.

Connect Laptop to one screen <- What does it mean? Are you connecting an external monitor to the laptop?
Adjust Fancy Zones on both monitors <- "Adjust" is just a generic description, it doesn't provide enough information on what you are doing in this step
Shutdown Laptop <- OK
Connect Laptop to two differnet monitors <- Is this a required step or connecting to just one external monitor is enough to reproduce the problem? Waht type of connection are you using? The monitor are connected directly to the laptop or though a docking station?
Fancy Zones do get back up running correct except the resolution on on the laptop (mainscreen in both configs) is sized differently <- Can you provide a screenshot showing the zones layout when activated while dragging a window?

What are the DPI scaling settings for each monitor?

Ok, I'll try to clearify :-)

Connecting my Laptop with primary screen to a second monitor
By adjust I meant "just" opening Fancy Zones Zones Editor and hit apply, not changing/editing any zones at all, just open the editor, select the same template as it was set (is already highlighted) and hit apply
shutdown
I have three different configurations: A) single monitor (Laptop on it's own), B) Laptop plus one monitor on the right side of the LAptop (at home) and C) Laptop plus two monitors, both on the left side of the Laptop. If I reconnect to the same config, fancy zones does keep it's settings as expected. Everytime I swap configs, moving from home to office for example, fancy zones does either exceed or falls below the Laptops or monitors resolution, alltough the actual resolution has not changed at all. Laptop monitor stays on the same resolution in each config, all the monitors stay the same resolution in each config, it's just the amount of connected monitors that are changing.
I will try to get that screenshot next time I swap configs, also the DPIs of each monitor.

Enough clarification?

@andyfrei
can you please upload %localappdata%\Microsoft\PowerToys\FancyZones\zones-settings.json?
Zip it or change the extension from .json to .txt so GitHub will accept the file.

zones-settings.zip
Here you go :-)

@andyfrei
this was the settings after a reboot when they were lost or after you re-applied the layouts?

zones-settings 2monitor-after.zip
zones-settings 2monitor-before.zip
The one before was after resetting on my 3 monitor config. Here are two before reconfig (right after bootup) and one right after reconfig of fanzyzones on my 2 monitor setting.
Seems like with version 0.23 (just updated two days ago) this is fixed, it's just that the second monitor lost it's config (could not move windows through zones from one monitor to the other), maybe also because of the update. I will repeat this steps once I'm back in the office (3 monitor config) and share another before and after config.

here they are:

bootup of my laptop with the 3monitor config > 3before.zip
adjusting fancy zones > 3after.zip
zones-settings 3after.zip
zones-settings 3before.zip

@andyfrei
if for you it's acceptable to install a private unsigned build, I've attach a build that may fix the issue.
Since we haven't been able to reproduce it, we are not sure it will fix the problem, so we need the community feedback.
Note that this build doesn't contain the Video Conference Mute module.
We understand if you prefer to not install an unsigned build.
PowerToysSetup-0.23.1-x64.zip

Hey Enrico
Alltough I would love to install but I cannot install an unsigned built. I will wait for the next release then.
Regards
Andy
From: Enrico Giordani<EMAIL_ADDRESS>Sent: Wednesday, October 7, 2020 11:10 AM
To: microsoft/PowerToys<EMAIL_ADDRESS>Cc: Andy Frei<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [microsoft/PowerToys] Fancy Zones does not keep mainscreen definition (#6862)
@andyfrei https://github.com/andyfrei
if for you it's acceptable to install a private unsigned build, I've attach a build that may fix the issue.
Since we haven't been able to reproduce it, we are not sure it will fix the problem, so we need the community feedback.
Note that this build doesn't contain the Video Conference Mute module.
We understand if you prefer to not install an unsigned build.
PowerToysSetup-0.23.1-x64.zip https://github.com/microsoft/PowerToys/files/5339411/PowerToysSetup-0.23.1-x64.zip
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub https://github.com/microsoft/PowerToys/issues/6862#issuecomment-704802336 , or unsubscribe https://github.com/notifications/unsubscribe-auth/AIKS4EWIRBTM7RTAIS7F65TSJQV7VANCNFSM4R4CDN2Q .  https://github.com/notifications/beacon/AIKS4EWJERFUSMGYZLHREDTSJQV7VA5CNFSM4R4CDN22YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOFIBG4IA.gif

@andyfrei
sure, no problem.

@andyfrei
is this problem still happening with 0.29.2?

@andyfrei
is this problem still happening with 0.29.2?


[24.12.14] [BUG] Switching submarine from manual to auto throws an error

Factorio & Maraxsis version number
Factorio 2.0.23 win64
Maraxsis 1.23.43
Describe the bug
Switching a submarine manual to auto with an empty waypoint list throws an error:
Error while running event SpidertronPatrols::on_spider_command_completed (ID 181)
SpidertronPatrols/scripts/spidertron-control.lua:230: attempt to index local 'waypoint' (a nil value)
stack traceback:
SpidertronPatrols/scripts/spidertron-control.lua:230: in function 'handler'
core/lualib/event_handler.lua:47: in function <core/lualib/event_handler.lua:45>
To Reproduce
Steps to reproduce the behavior:

build a new submarine
switch it from Manual to Auto without adding any waypoints

Thanks for the report. This is an upstream issue with spidertron patrols. I've raised the issue with that mod.

Fixed in Spidertron Patrols 2.5.8 :)


googlejam4.tar is not made of 1669 project

so where is 1669 project

Hi,
After download the dataset, I find that there is 1665 projects in the dataset actually. So I wonder where the remaining four projects are, or for some reasons the remain are cut off.

Hi,
After download the dataset, I find that there is 1665 projects in the dataset actually. So I wonder where the remaining four projects are, or for some reasons the remain are cut off.

the g4_npy is made of 1669 project,but they're not made of the googlejam4.tar

Thanks for your reply.
Does the g4_npy contain all the projects in the googlejam4.tar or not. I wonder the relationship between the g4_npy and the googlejam4.jar.
Looking forward to your reply.

Thanks for your reply.
Does the g4_npy contain all the projects in the googlejam4.tar or not. I wonder the relationship between the g4_npy and the googlejam4.jar.
Looking forward to your reply.

I wonder the relationship between the g4_npy and the googlejam4.jar，too


srml/authority-discovery: Abstract session key type

Previously srml/authority-discovery depended on the srml/im-online
session key type directly. With this patch srml/authority-discovery is
generic over the session key type it is going to use, as long as it
implements the RuntimeAppPublic trait.
With this patch one can use the srml/authority-discovery module
without the srml/im-online module.
Next to the above, this patch configures node/runtime to use the babe
session keys for the authority discovery module.

@bkchr thanks for the review! Can you take another look?

can merge when passing


Embed indent.js as a static dependency

The synctos package has a single non-development dependency: indent.js. To keep the project light and self contained, embed the most recent version of indent.js statically into the synctos npm project's lib directory.

Addressed by #122.


Add JohnNiang as a reviewer, he is a member of KubeSpher DevOps SIG

/cc @kubesphere/sig-devops

/lgtm


Add support for cudf.Series

This PR allows  cudf.Series to go via columnar initalizlizer .
This pr fixes the code-path to follow when the label is a cudf.Series .
Example to show impact:
X_train = cudf.DataFrame({'1':
                          cudf.Series( np.random.randint(low = -1000, high = 50_000 , size= 1_000_000, dtype=np.int32))})
Y_train = cudf.Series(np.random.randint(low = 0,high = 2 ,size = 1_000_000, dtype=np.int32))

Before this pr below took  2min 18s
%time xgb.DMatrix(X_train,Y_train)

After this PR below takes  10.5 ms
%time xgb.DMatrix(X_train,Y_train)

Thanks for the fix.  Will add a test for that.

@VibhuJawa Could you allow "edits from maintainers"?  I added a test and:
fatal: remote error:
  You can't push to git://github.com/VibhuJawa/xgboost.git
  Use https://github.com/VibhuJawa/xgboost.git

@VibhuJawa Could you please enable "Allow edits from maintainers." ? Or apply the following patch:
0001-Test-from-series.zip

@VibhuJawa Could you please enable "Allow edits from maintainers." ? Or apply the following patch:
0001-Test-from-series.zip

I think allowing edit from maintainers should be on. Anyways added the patch.
Thanks a lot for your help.

@RAMitchell I think I really need to bring back the profiling branch for both CPU and GPU.  Our memory usage issue needs to be solved, or at least be monitored.

@trivialfis can you get what you need from https://github.com/dmlc/xgboost/blob/82ee2317e80f93465685529e1ab9acff52b683c7/src/common/device_helpers.cuh#L212

@RAMitchell I meant with trace.  At least when bad_alloc happens we know where is the root, how much more memory do we need etc.

@VibhuJawa Thanks.


musescore: 3.6.1 -> 3.6.2

Motivation for this change
Update to latest version.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

This MR and https://github.com/NixOS/nixpkgs/pull/115880 are duplicates. Which one should we close?

Duplicate of #115880


Automate issue creation and PRs

The issue creation right now can be improved to use a template.

[ ] Bug issue
[ ] Feature Request

Also, similarly each time a PR is made it should have some prerequisites and message.

[ ] Link an issue
[ ] Describe PR
[ ] Add a demo (image or video)

https://docs.github.com/en/communities/using-templates-to-encourage-useful-issues-and-pull-requests/about-issue-and-pull-request-templates


Adding L4r0x and two of my recent projects

Thank you for the contributions!

Thank you for the contributions!


[feature] Export template path for convinence

When i use brunch with your plugin i end up with code like this:
// This is needed to actually add template to angular's cache.
// Also path string must be WITHOUT extension
require('directives/comments-box/comments-box.template');

angular.module('beagle')
  .directive('commentsBox', function($templateCache, OAuth) {
    return {
      // here we NEED to add extension. And this is just duplicate of previous path
      templateUrl: 'directives/comments-box/comments-box.template.html',
      restrict: 'E',
      scope: true,
      link: function(scope, element, attrs) {
      },
    };
  });

which is horrible. templateUrl: require('template/path/with.ext') will be very nice.

Maybe there is some workaround, which will allow use of templates without require? Please don't suggest just to turn commonJS wrappers off for whole project. This is not a solution.

It's been a while since I used this. The way I remember doing so is I had my templates in a joinTo, using some regex, so I did not have the repetition that you describe. Is that what you mean by not using commonJS?

Brunch have an ability to turn off CommonJS wrappers so all of your code wil be concatenated as is. Of course in this case will appear issues with concatenation order so i really want to use default modular approach. The thing with your plugin is that every template become CommonJS module and you need to explicitly require them. Not a big deal but for now it is just inconvinent.

I think that all we need is just loader for HTML, because then we can just template: require('./template.html')


Add Travis config to test sdk

https://travis-ci.org/

Hey @blackleg, thanks very much for that, that's a great idea. I've just created a Mangopay Travis account, so could you update the link in the readme please: "peertopark" -> "Mangopay"

@hobailey Link updated

Great, thank you!

Hey @blackleg, have you any ideas why our build is failing, when in theory it's identical to your PR which is passing?
It seems it's something to do with a buffer overflow, and I noticed that travis isn't running the two tests against the same Java version for some reason, but I don't see where the difference in version comes from. Any help/ideas would be much appreciated :-)

https://github.com/Mangopay/mangopay2-java-sdk/pull/35

Great, thanks so much! We'll see how that goes :-)

Works a treat, thanks so much @blackleg :-)


[Enhancement]: Error in script.js file of Tic Tac Toe game

Is your enhancement request related to a problem? Please describe.➕
There are 2 errors in the script.js file :

First, the function "reset.addEventListener" does not have a closing parenthesis.

Second, the "excited.gif" does not disappear on clicking the Reset button.

Describe the solution you'd like
This can be achieved by improving the code of the js file.
Select program in which you are contributing
GSSoC23
Code of Conduct

[X] I follow CONTRIBUTING GUIDELINE of this project.

Hey @Abhishek-Rajput-81 , You can't have another issue before completing the previous one 😀
you already have the following 1 open issues 👀 ! :
#1879

Hey @Abhishek-Rajput-81 ! Thank you so much for your raising the issue💗
It’s all yours, you can come anytime again and make some contributions! 🚀
Alone, we can do little, but together we can do so much! 😇

Hey @Abhishek-Rajput-81 !
Thank you for raising an issue 💗
You can self assign the issue by commenting /assign in comment 😀
Make sure you follow CODE OF CONDUCT and CONTRIBUTING GUIDELINES 🚀
Don’t Forget to ⭐ our GameZone🎮
Make sure you join our Discord🕹

/assign


Show history in frontend

What's done:

Changed execution entity
Added logic to view history
Added request to backend to take history information

Closes #61

@kentr0w , also there is a problem, related to histroy view, as stated in the issue:

Also, href from ProjectView, which opens HistoryView on submission, is broken: opens /history instead of #/owner/name/history

Please fix it in this PR as well


[CLU] Fixing read me and sample links

Adding links to the sample markdowns to the sample "index".
Fixing some broken links in the readme, however two links are still broken.

The service's REST API docs. (Which is still not yet developed)
The SDK docs parallel to this one for question answering.

closes #25192


sqlite: add metric to track when the driver is called after close

This is theoretically prohibited by the database/sql package, but after the sql.RawBytes issues we ran into we'd like to verify that there's no other lingering behaviour that's causing us to call SQLite functions after a Close.

@bradfitz - just changed the stmt logic to set closed = true in the stmt.Close call and then set it back to false when handing out a cached persistent query; PTAL?


prettier ignore not worked!

how to ignore formatter for block of sql
like this :

// prettier-ignore
or
-- prettier-ignore

SQL Formatter is not Prettier. It has not been developed to be compatible with Prettier. Heck, the first version of SQL Formatter was released before Prettier existed.
I know there exists prettier-plugin-sql, which uses SQL Formatter under the hood, but I have no control over that project.
If you're interested in more Prettier-compatible SQL formatting solution, I suggest you try prettier-plugin-sql-cst. This doesn't support the ignore-comments, but there exists more of a chance that such a feature gets implemented.
In this project, the best one could hope for would be a feature where you mark both start and end of the formatted code, like:
-- sql-formatter:ignore-start
SELECT * FROM tbl
-- sql-formatter:ignore-end

There could be a point for implementing something like this, as it would help in working around scenarios where the formatter currently fails to produce a sensible output or even crashes. Like:

#184
#144

Implemented in 15.1.0 release.


Added ToStringTester

When working with openpojo I ran into the problem that the current Validator doesn't have any options to check the toString method when it is overridden with the BusinessIdentity.toString() method. Since we want to achieve a code coverage as high as possible I'd also want to test this method. In order to do this in a uniform way I've added a ToStringTester.
I think it would make a nice addition to the openpojo framework so users can easily achieve a meaningful 100% test coverage with little extra effort.

Thank you for the change request Kleeven... A missing feature indeed.

Please merge this pull request, I've used it and it works brilliantly. 100% coverage across all my model classes.

Please merge this PR as early as possible. It is great add on.


Implementation of integrals over Gaussian orbitals

This patch adds the following objects:

Primitive: dataclass for a primitive Gaussian type orbital
Orbital: dataclass for a linear combination of Primitive, these are sometimes called contractions in the literature.
Basis: dataclass of Orbitals with an associated factory function basisset that can read from the basis-set-exchange database.
Structure: dataclass for storing molecular structure (geometry and atom types)

Adds implementations as derived in Gaussian-expansion methods for molecular integrals for the following:

overlap
kinetic energy
nuclear attraction
electron-repulsion

All these integrals are implemented at the Primitive level and the results from these are used to build up the result of integration over the entire Basis.
Adds the following dependencies:

basis-set-exchange
periodictable
sympy

Also adds a github action for running tests using the jax cpu backend by default and a few tests that run on the IPU model.  Note that the ERI tests cannot be tested on the github action runners due to requiring more than the 7GB of memory available.

in Gaussian-expansion methods for molecular integrals f
This link is paywalled?   Is there an openly viewable equivalent?

I wonder if it might be better to move the folder e.g.
pyscf-ipu/pyscf_ipu/experimental -> pyscf-ipu/experimental/jax-integrals

I'd like to leave this until it becomes clearer how much we are going to build into the experimental module.  Either at some point functionality here stops becoming experimental and is moved into a top-level namespace or it stops being useful and we might as well delete it right?


[Keys] consider making eris-keys key files compatible with ethereum clients

@Gustav-Simonsson commented on Wed Sep 09 2015
To get compatibility between all Ethereum clients we worked out a spec for a common key file: https://github.com/ethereum/wiki/wiki/Web3-Secret-Storage-Definition
While GCM is nice and we probably should have gone with it instead of CTR + MAC, for the moment Ethereum clients generate key files with CTR.
However the current go-ethereum code supports multiple key formats for backwards compatibility; both scrypt and PBKDF2 for KDF and both CTR and CBC for encryption mode. This could be extended to support GCM if defined by the cipher field present in version 3 (latest) of the spec.
Would recommend we strive for compatibility between platforms here. This could be done quite easily if eris-keys rebases on go-ethereum's crypto/key_store_passphrase.go to pickup version 3 of it's key file format and defines it's GCM mode usage by setting the  cipher field to something like aes-128-gcm (we use aes-128-ctr to denote CTR mode)

@ebuchman commented on Wed Sep 09 2015
yes I would love to do this. thanks for the details.

@benjaminbollen commented on Tue May 10 2016
@zramsay @VoR0220 @AFDudley shall we post progress on this issue here ?

@VoR0220 commented on Tue May 10 2016
yesh

I need to learn some more crypto acronyms, but the intention of this ticket seems like a good one.

I am inclined to agree with @ebuchman here: https://github.com/tendermint/go-crypto/issues/13. Hoard also makes use of OpenPGP armor


MediaEmbed: no button

Hi!
I have an issue with MediaEmbed - there is no button in the toolbar.
I have created an empty rails application to test this issue, and I have no MediaEmbed button (but it is enabled in config).
Gemfile:
gem 'rails_admin'
gem 'carrierwave'
gem 'mini_magick'
gem 'rich', github: 'kreativgebiet/rich'
rich.rb:
config.backend = :carrierwave
config.editor[:allow_embeds] = true
editor config:
{:height=>400, :stylesSet=>[], :extraPlugins=>"stylesheetparser,richfile,mediaembed,showblocks", :removePlugins=>"scayt,image,forms", :contentsCss=>:default, :removeDialogTabs=>"link:advanced;link:target", :startupOutlineBlocks=>true, :forcePasteAsPlainText=>true, :format_tags=>"h3;p;pre", :toolbar=>[["Styles", "Format", "Font", "FontSize"], ["Bold", "Italic", "Underline", "Strike", "Subscript", "Superscript"], ["JustifyLeft", "JustifyCenter", "JustifyRight", "JustifyBlock"], ["TextColor", "BGColor"], ["RemoveFormat"], ["NumberedList", "BulletedList", "Blockquote"], ["Link", "Unlink"], ["richImage", "richFile", "MediaEmbed"], ["Source", "ShowBlocks"]], :language=>:en, :richBrowserUrl=>"/rich/files/", :uiColor=>"#f4f4f4", :allow_embeds=>true}
I see that there is a request for http://<IP_ADDRESS>:3000/assets/ckeditor/plugins/mediaembed/plugin.js?t=F0RD in the log.
But there is no button:

And there are no any errors in js console, so I have no idea why it doesn't work.
Is it just a misconfiguration in my config? Or bug? Any thoughts?

config.editor[:allow_embeds] = true

Sorry, my bad.
Should be config.allow_embeds = true .
Works now.


Allow configuration of SSE recover retries.

Fixes: #246

Coverage increased (+0.01%) to 89.407% when pulling 4c2d1f925d653a241b4436d9554b152762f9662d on expose_sse_retries into b1c1ec5b1e30a40a7a531d220cfa49036ef5831c on master.

@janisz  @adamdubiel Thanks guys!!


Add community page

https://reactnative.dev/help

Since this page do not include any customization and reminds more docs page than custom one I have converted it to the Markdown page.

Page migration is complete.


New release?

Hi Antonin, could we make a new minor release? We'd like to use the watch port fix, and a release would help with that.

Done. As discussed at the last P4 API WG meeting, P4Runtime v1.3.0 has been released.


make AFNetworking allowing ANY self-signed certificate without adding it in the project?

I have this issue and I made many attempt to solve it, here the problem:
I need a connection with Self Signed Certificates. I found many responses where we need to put the CER or PER into the project. But in my case I just can't because I have to connect to many servers. Some people argue that iOS is disabling that because security reason, but in fact it's untrue. First, in safari it's working, and most importantly, the NSURLConnectionDelegate allow it.
Exemple of code that doesn't work:
    - (AFHTTPRequestOperation *) createOperation:(NSString *)protocol to: (NSString *)service withBody: (NSString *)json{

        AppDelegate *appDelegate = (AppDelegate *)[[UIApplication sharedApplication] delegate];
        NSString *url=[NSString stringWithFormat:@"%@%@",appDelegate.urlSecure, service];
        NSLog(@"BoxDelegate - create operation to %@",url);

        //here the policy attempts
        AFHTTPRequestOperationManager *manager = [[AFHTTPRequestOperationManager alloc] initWithBaseURL:[NSURL URLWithString:url]];
        manager.securityPolicy = [AFSecurityPolicy policyWithPinningMode:AFSSLPinningModeNone];
        manager.securityPolicy.allowInvalidCertificates = YES;
        manager.securityPolicy.validatesCertificateChain = NO;
        [manager setRequestSerializer:[AFHTTPRequestSerializer serializer]];
        [manager.requestSerializer setAuthorizationHeaderFieldWithUsername:appDelegate.email password:appDelegate.pass];

        NSError *error = nil;
        NSMutableURLRequest *request = [manager.requestSerializer requestWithMethod:protocol URLString:url parameters:nil error:&error];
        NSData *body = [json dataUsingEncoding:NSUTF8StringEncoding];
        [request setHTTPBody:body];
        [request setValue:@"application/json" forHTTPHeaderField:@"Content-Type"];
        AFHTTPRequestOperation *operation = [[AFHTTPRequestOperation alloc] initWithRequest:request];
        return operation;
    }

(FYI I also open a question on SO: http://stackoverflow.com/q/30706480/4406065?sem=2)

If you set the policy to PinningModeNone, and allow invalid certificates set to YES, it should work.
But I would STRONGLY suggest not doing that. Anyone could be a man in the middle with that configuration.

AFSecurityPolicy.m
if (self.SSLPinningMode == AFSSLPinningModeNone) {
return self.allowInvalidCertificates || AFServerTrustIsValid(serverTrust);
}
its not going to check self signed certificate!

`
BOOL AFServerTrustIsValid(SecTrustRef serverTrust) {
BOOL isValid = NO;
SecTrustResultType result;
__Require_noErr_Quiet(SecTrustEvaluate(serverTrust, &result), _out);
isValid = (result == kSecTrustResultUnspecified || result == kSecTrustResultProceed);
_out:
return isValid;
}
`
I looked SecTrustEvaluate function at the document,apple say
‘ This function will completely evaluate trust before returning,
possibly including network access to fetch intermediate certificates or to
perform revocation checking. Since this function can block during those
operations, you should call it from within a function that is placed on a
dispatch queue, or in a separate thread from your application's main
run loop. Alternatively, you can use the SecTrustEvaluateAsync function. ’
Whether we need to modify to SecTrustEvaluateAsync function?

`static BOOL AFServerTrustIsValid(SecTrustRef serverTrust) {
BOOL isValid = NO;
SecTrustResultType result;
__Require_noErr_Quiet(SecTrustEvaluate(serverTrust, &result), _out);
isValid = (result == kSecTrustResultUnspecified || result == kSecTrustResultProceed);
_out:
return isValid;
}`
I looked SecTrustEvaluate function at the document,apple say
‘ This function will completely evaluate trust before returning,
possibly including network access to fetch intermediate certificates or to
perform revocation checking. Since this function can block during those
operations, you should call it from within a function that is placed on a
dispatch queue, or in a separate thread from your application's main
run loop. Alternatively, you can use the SecTrustEvaluateAsync function. ’
Whether we need to modify to SecTrustEvaluateAsync function?

I looked SecTrustEvaluate function at the document,apple say
‘ This function will completely evaluate trust before returning,
possibly including network access to fetch intermediate certificates or to
perform revocation checking. Since this function can block during those
operations, you should call it from within a function that is placed on a
dispatch queue, or in a separate thread from your application's main
run loop. Alternatively, you can use the SecTrustEvaluateAsync function. ’
Whether we need to modify to SecTrustEvaluateAsync function?

static BOOL AFServerTrustIsValid(SecTrustRef serverTrust) {
BOOL isValid = NO;
SecTrustResultType result;
__Require_noErr_Quiet(SecTrustEvaluate(serverTrust, &result), _out);
isValid = (result == kSecTrustResultUnspecified || result == kSecTrustResultProceed);
_out:
return isValid;
}
I looked SecTrustEvaluate function at the document,apple say
‘ This function will completely evaluate trust before returning,
possibly including network access to fetch intermediate certificates or to
perform revocation checking. Since this function can block during those
operations, you should call it from within a function that is placed on a
dispatch queue, or in a separate thread from your application's main
run loop. Alternatively, you can use the SecTrustEvaluateAsync function. ’
Whether we need to modify to SecTrustEvaluateAsync function?


using tonic in  place of spikedata

adapted notebooks to use tonic instead of the deprecated spikedata module

added a DATADIR variable to let user choose their data directory (/tmp has the nice property of getting easily flushed..)

fixed an error to a call of a deprecated torch function: AttributeError: module 'torch' has no attribute '_six'

removed all outputs to reduce size of notebooks

Note that I left the cells with the deprecated code as it still works.

Sorry this took me so long! All looking good. Those examples are pretty old and janky so not sure if the notebooks work anymore, but will probably just build a fresh set of dataset tutorials.


nginx.yml is not imported into nas.yml

Describe the bug
In nas.yml, there is no import of the tasks for nginx
all.yml Variables
nginx_enabled: true
Expected behavior
add Nginx container and Letsencrypt Container
Actual behavior
never listed
Steps to reproduce
download current ansible-nas, set nginx_enabled: true

It's actually not supposed to be - this was a hangover from prior to using Traefik as a reverse proxy. nginx.yml has now been removed.

It's actually not supposed to be - this was a hangover from prior to using Traefik as a reverse proxy. nginx.yml has now been removed.


Create learning pathway landing page and start to populate with content

User story
As a user, I want to find the FED learning pathway, so I can learn to be a front end developer
Acceptance criteria

[x] Review Nick's learning pathway design, provide feedback, and work out how this will translate into the landing page.
[x] Create skeleton landing page
[x] Review some of the content, update it, and enter it onto the pathway page so we can see how it looks and can provide feedback. For this, we will probably choose the first two basic JavaScript modules, as they are in good shape.

Link to Nick's current designs: https://mozilla.invisionapp.com/share/H4TBESKJFRX#/377509962_Pathways_Article_-_CTA

I've done this task — see page here:
https://developer.mozilla.org/en-US/docs/Learn/Front-end_web_developer


chore: release 2.1.0

:robot: I have created a release *beep* *boop*
2.1.0 (2019-05-28)
Bug Fixes

Add overloads for doc() and doc(id:string) (#662) (cb189e9)
retry on abort and limit retry count to 10 (#655) (9e97656)

Features

Support listDocuments()/listCollections() via the Firestore Emulator (#654) (eaf5a4e)

Codecov Report

Merging #657 into master will increase coverage by 0.08%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #657      +/-   ##
==========================================
+ Coverage   61.54%   61.63%   +0.08%
==========================================
  Files          21       21
  Lines        3425     3425
  Branches      460      460
==========================================
+ Hits         2108     2111       +3
+ Misses       1254     1252       -2
+ Partials       63       62       -1

Impacted Files
Coverage Δ

dev/src/reference.ts
99.01% <0%> (ø)
:arrow_up:

dev/src/watch.ts
97.68% <0%> (+1.15%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cb189e9...228d13b. Read the comment docs.

Release is at https://github.com/googleapis/nodejs-firestore/releases/tag/v2.1.0

The release build has started, the log can be viewed here. :sunflower:

:egg: You hatched a release! The release build finished successfully! :purple_heart:


Remove unused category name for palette

[x] Bugfix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)

Proposed changes
When I checked i18n support, I found used category name, "mobile" for palette. Therefore, I removed it in the pull request.
Checklist

[x] I have read the contribution guidelines
[ ] For non-bugfix PRs, I have discussed this change on the mailing list/slack team.
[x] I have run grunt to verify the unit tests pass
[ ] I have added suitable unit tests to cover the new/changed functionality

Coverage increased (+0.05%) to 76.084% when pulling df20b228cba05cbb28d49a479c0644213fc00972 on kazuhitoyokoi:master-removeunusedcategory into dfa077fd5f99cc64829b0e4494af45f463d7f622 on node-red:master.

We did have nodes in the mobile category in the very very early days of Node-RED. Clearly we don't have core nodes in there today... the question is whether we should remove the category or leave it in coreCategories so it appears in that order if a node is added.
It doesn't hurt anything leaving it there...

@knolleary I understand that the order of categories will suddenly be changed if mobile category is deleted. Therefore, I will close it. Thank you for sharing Node-RED history!


[Bug] LDAP Users aren't able to view their imported roles

Bug
LDAP Users aren't able to view their imported roles

Expected behavior
When I try to view my AD roles in the Manage page, I don't see my AD roles.

Actual behavior
I don't see my AD roles listed in the Manage page.

Repro steps
Sign in with a user that owns a AD role

Build
0.7.1

Severity
2. blocks functionality

Details/Notes
Caused by the NEXT ID implementation that started in Sprint 14.

migrated to new tmobile/sawtooth-next-directory repo


Partial Schur decomp does not hold?

> A = sprand(10_000, 10_000, 10 / 10_000) + 3I
> r = IRAM.restarted_arnoldi(A, 5, 30, 3, 0.00001, 100);
...
> vecnorm(A * r.Q[:,1:1] - r.Q[:,1:1] * r.R[1:1,1:1])
6.287699132134216e-10
> vecnorm(A * r.Q[:,1:2] - r.Q[:,1:2] * r.R[1:2,1:2])
0.35214245086088336

In complex arithmetic the second eigenvalue needs way more iterations to converge, but it does converge:
> A′ = convert(SparseMatrixCSC{Complex128,Int}, A);
> r = IRAM.restarted_arnoldi(A′, 5, 30, 3, 0.00001, 200);
> vecnorm(A′ * r.Q[:,1:1] - r.Q[:,1:1] * r.R[1:1,1:1])
4.6068872080697494e-10
> vecnorm(A′ * r.Q[:,1:2] - r.Q[:,1:2] * r.R[1:2,1:2])
8.367884143667247e-6

Maybe #15 is related or maybe even #14

Same for this one then! (cc @NymanLauri)


Simple script to build armnn

the step by step instructions are too many step. can we give a script to build armnn on different platforms? One click with some selections will easy our life

Hi @perise,
May I suggest you take a look at the ArmNN-MLPerf repository where we describe how to build ArmNN and run MLPerf Inference workloads with a few simple commands via the Collective Knowledge framework?

Hi @perise,
Did you manage to complete the setup? There is also a Docker solution in review right now which might make things easier for you. If I hear nothing back I'll close this in a week or so.
Colm.


Request: Please make a "koa-mongodb-session" module

Hi,
I'm working on subdomains with servers for each domain. Most of them working with express 4 and your session store. The session is shared between all subdomains (domain cookie).
But I want to switch from express 4 to koa 2. The problem now: the session stores for koa sessions use an other scheme and that conflicts with yours.
It would by nice if there were also a "koa-mongodb-session" module of you, so I can bring my koa and express servers together.

There are a couple modules out there already: https://www.npmjs.com/search?q=koa+mongodb although I imagine they don't support koa 2. They'd be a good starting point, but unfortunately I don't think I'll have the time to build one for at least the next several months. Appreciate the suggestion though, I didn't know that koa 2 was already out.

That's a pity.
I allready have a working mongoDB session store for koa. The problem is still: it uses another scheme.
The shared cookie get resolved to the wrong/non existent documents on the other famework (both directions).
It would be nice if there were interchangeable solutions, collected under you organization.
Perhaps I could build the module on my own, if I find the time.

It was easier then I thought. I have the "koa-mongodb-session" ready and working. If you want to have it, I can send you a PR or transfere ownership.
But I found a even better solution. I can use the "express-session"-module with "connect-mongodb-session" if I use the "koa-connect" middleware-bridge.
That works for me.

Glad you figured it out. It's all yours, you wrote it, I barely even use koa :)


fix(shared-data,api): Correct addressable area positions

Overview

Test Plan

Changelog

Review requests

Risk assessment

Oopsies, wrong branch.


Correction for raw affiliation Cerema, Research Team ENDSUM, 23 Avenue de l′Amiral Chauvin, 49136 Les Ponts de Cé, France

Correction needed for raw affiliation Cerema, Research Team ENDSUM, 23 Avenue de l′Amiral Chauvin, 49136 Les Ponts de Cé, France
raw_affiliation_name: Cerema, Research Team ENDSUM, 23 Avenue de l′Amiral Chauvin, 49136 Les Ponts de Cé, France
new_rors: 05k0nvr25
previous_rors: 05k0nvr25;02nwvxz07
works_examples: W4321601892
contact: 02c0f440a997fef1eebf9b71f574f80b:0707a745f722244c7bfdefaf8318a7 @ recherche.gouv.fr

This issue was accepted and ingested by the OpenAlex team on 2024-10-10. The new affiliations should be visible within the next 7 days.


PEP 257 Standards in DocStrings

We need to find a way to have standardized DocStrings.

I will try to search for a solution, using PyLint in Both Visual Studio Code and PyCharm.


The function still exists under the slot after swapping it with a clean slot

OS: All
Build Version: v1.14.4-alpha.0
Regression: Not a Regression
Repro Steps:

Create a Linux Node Function App with App Service Plan host plan -> Create two slots (slot1 and slot2) to it.
Deploy a JavaScript project to the slot1.
Swap slot1 with slot2.
Check whether there is no function under the Functions node of the slot1 after swapping slots.

Expect:
There is no function under the Functions node of the slot1.
Actual:
The function still exists under the slot1.

Does refreshing the parent node fix the issue?

@MicroFish91 verified this issue with the build 1.15.1-alpha.0, it doesn't reproduce for now.


node json parse error fix

The communication between rails server and node server sometimes breaks. This PR fixes this issue.
Improvements to be made:

The process now uses eof symbol to signal the end of input for a request / response. While it's very unlikely to break, it is not 100% safe method. The safe implementation is to transmit the number of bytes in request / response
Node server doesn't restart when the server bundle changes.
You have to remove manually node.sock after node server stops.
Render now uses eval, which means that all async calls inside the server bundle becomes sync calls

This change is

Review status: 0 of 2 files reviewed at latest revision, 1 unresolved discussion.

lib/generators/react_on_rails/templates/node/base/client/node/server.js, line 14 [r1] (raw file):

}

Handler.prototype.handle = function (connection) {

Note that fat arrow usage introduces a bug here - it binds this to be a global one, but this is required to be Handler inside this function.

 I mentioned above that fat arrow introduces a bug here.

Also I don't see why function usage would produce lint errors.

Comments from Reviewable

@alleycat-at-git Please fix these small lint issues and push.
npm run eslint -- --fix

rubocop -a

> eslint .
The react/require-extension rule is deprecated. Please use the import/extensions rule from eslint-plugin-import instead.
/home/travis/build/shakacode/react_on_rails/lib/generators/react_on_rails/templates/node/base/client/node/server.js
  14:28  warning  Missing function expression name  func-names
  15:20  warning  Missing function expression name  func-names
  40:32  warning  Missing function expression name  func-names
✖ 3 problems (0 errors, 3 warnings)
cd /home/travis/build/shakacode/react_on_rails && npm run jscs
><EMAIL_ADDRESS>jscs /home/travis/build/shakacode/react_on_rails
> jscs -e -v .
cd /home/travis/build/shakacode/react_on_rails && npm run flow
><EMAIL_ADDRESS>flow /home/travis/build/shakacode/react_on_rails
> flow check node_package
Found 0 errors
cd /home/travis/build/shakacode/react_on_rails && bundle exec rubocop .
Inspecting 93 files
........................................................................C....................
Offenses:
lib/react_on_rails/server_rendering_pool/node.rb:54:21: C: Style/SpaceAroundOperators: Surrounding space missing for operator =.
          eof_symbol="\r\n\0"
                    ^
lib/react_on_rails/server_rendering_pool/node.rb:57:36: C: Style/SpaceAroundOperators: Surrounding space missing for operator +.
            js_context.send(js_code+eof_symbol, 0)
                                   ^
lib/react_on_rails/server_rendering_pool/node.rb:59:19: C: Style/ParenthesesAroundCondition: Don't use parentheses around the condition of a while.
            while (result[-eof_symbol.length..-1] != eof_symbol)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
93 files inspected, 3 offenses detected
rake aborted!
Command failed with status (1): [cd /home/travis/build/shakacode/react_on_r...]
/home/travis/build/shakacode/react_on_rails/rakelib/task_helpers.rb:20:in `block in sh_in_dir'
/home/travis/build/shakacode/react_on_rails/rakelib/task_helpers.rb:20:in `each'
/home/travis/build/shakacode/react_on_rails/rakelib/task_helpers.rb:20:in `sh_in_dir'
/home/travis/build/shakacode/react_on_rails/rakelib/lint.rake:7:in `block (2 levels) in <top (required)>'
/home/travis/.rvm/gems/ruby-2.3.1/gems/rake-11.2.2/exe/rake:27:in `<top (required)>'
/home/travis/.rvm/gems/ruby-2.3.1/bin/ruby_executable_hooks:15:in `eval'
/home/travis/.rvm/gems/ruby-2.3.1/bin/ruby_executable_hooks:15:in `<main>'
Tasks: TOP => default => lint => lint:lint => lint:rubocop
(See full trace by running task with --trace)
The command "rake" exited with 1.
cache.2
store build cache
$ bundle clean
Cleaning all the gems on your system is dangerous! If you're sure you want to remove every system gem not in this bundle, run `bundle clean --force`.
0.00s
10.96schange detected (content changed, file is created, or file is deleted):
/home/travis/build/shakacode/react_on_rails/node_modules/archive-type/index.js
/home/travis/build/shakacode/react_on_rails/node_modules/archive-type/license
/home/travis/build/shakacode/react_on_rails/node_modules/archive-type/package.json
/home/travis/build/shakacode/react_on_rails/node_modules/archive-type/readme.md
/home/travis/build/shakacode/react_on_rails/node_modules/array-differ/index.js
/home/travis/build/shakacode/react_on_rails/node_modules/array-differ/package.json
/home/travis/build/shakacode/react_on_rails/node_modules/array-differ/readme.md
/home/travis/build/shakacode/react_on_rails/node_modules/babel-cli/node_modules/babylon/CHANGELOG.md
/home/travis/build/shakacode/react_on_rails/node_modules/babel-cli/node_modules/babylon/lib/parser/expression.js
/home/travis/build/shakacode/react_on_rails/node_modules/babel-cli/node_modules/babylon/lib/parser/lval.js
/home/travis/build/shakacode/react_on_rails/node_modules/babel-cli/node_modules/babylon/lib/parser/statement.js
/home/
...
changes detected, packing new archive
.
uploading archive
Done. Your build exited with 1.

@alleycat-at-git a few small lint issues. We should merge this.

@alleycat-at-git we should get this merged
@rocLv, please take a look
We should consider using an express server rather than unix threads, to do the rendering, as is done with this solution: https://github.com/airbnb/hypernova. We should investigate how we could integrate or leverage that github repo. @rocLv This is the thing to research!

@alleycat-at-git can we release this as-is? I'd like to do a release this weekend.

CI is still broken. Let's get this merged.

Please update the CHANGELOG.md and fix the lint issues.

see #641


add services configuration and use service modules in the front instead of dependencies

Previously in the front page, dependencies are shown as microservice names, with this new feature, the microservices types are loaded from the services field from the application.yml.

ignore io.spring.initializr.web.project.MainControllerServiceMetadataIntegrationTests.validateJson? @sophiaso

@yaweiw Ignored, too many.

src/test/java/com/example/demo/DemoApplicationTests.java is not generated.
pom generated may be incorrect.


Apply new technique for strong heterogenous array types

This uses a variation of the technique from Simpler Variadic Function Types in Typescript to improve the types of zipArray and combineArray for TS, allowing them to scale to any arity.
It also improves the type of mergeArray, allowing it to be heterogeneous while remaining strongly typed.  Essentially, this extends the union behavior of merge to arbitrary arrays of streams.  This works by leveraging the fact that TS union types obey a distributive law.
Potential Gotchas
In general, I see strong heterogeneous types as a plus.  However, there could be a couple downsides:

They could be surprising or confusing for some users.
I haven't found any way to achieve parity in Flow.  What are the implications for documentation?

Todos

[ ] ToStreamsArray is duplicated, consider extracting it somewhere
[ ] Figure out the implications for docs, given that Flow can't handle this (afaict)

I’m going to try to find some time to investigate this technique in Flow.  I’ve been looking for a generic solution for this pattern for a while.

I'd love to find at least an approximation in Flow.  I tried (very) briefly to get something working with type-level functions (via $Call), but never managed to find something I was really happy with.  It'll be great to have someone else give it a go!

@unscriptable Here's the gist of what I was fiddling with.  Maybe it'll be helpful.

Figure out the implications for docs, given that Flow can't handle this (afaict)

After looking at the docs, I'm inclined just to go with them as is, and let the Flow limitations manifest themselves as type errors for now.  IOW, let's see if the current Flow arity limitations are problem in reality before we try to figure out what to do about it.


Inject variables into Bash

Make an extends: /Packages/ShellScript/Bash.sublime-syntax language that adds ${{…}} etc. in the appropriate places.

initial work completed in https://github.com/SublimeText/YamlPipelines/commit/5ca54c38b1649e27624f32ba1ac976777c0b8c6a, but I suspect there will be more places that need it, I just don't have examples/syntax tests for them yet. Contributions welcome!

Rather sounds like a job for embed: Bash.sublime-syntax


ProcessUnexpectedlyTerminatedException

Describe the bug
When trying to run this code i get the error:

production.ERROR: Nesk\Rialto\Exceptions\ProcessUnexpectedlyTerminatedException: The process has been unexpectedly terminated.

Reproducible example
    $puppeteer = new Puppeteer([
        'executable_path' => 'C:\Program Files\nodejs\node.exe'
    ]);
    $browser = $puppeteer->launch();

Expected behavior
Expected it to run without problems
Environment (please complete the following information):

OS: [e.g. Windows 10]
Node version: [v8.9.4]
PHP version [PHP 7.2.3]

My Node package manager is:

[x] NPM (specify the version)
[ ] Yarn (specify the version)
[ ] Other (specify the name and version)

Additional context
I have been looking at https://github.com/bobthecow/psysh/wiki/Configuration but i do not have this folder. I am using Lumen framework. There is no psysh folder. https://github.com/bobthecow/psysh/issues/198

@AsimTariq did you ever overcome this issue? I'm experiencing the exact same problem

If it helps anyone, I'm getting the following in the process error log (%HOMEPATH%\AppData\Local\Temp\sf_proc_00.err)

'git' is not recognized as an internal or external command,
operable program or batch file.

I have no idea why this would happen, @AsimTariq are you getting the same error?

https://github.com/nesk/puphpeteer/issues/88#issue-598199063;
I also encountered such a problem, how did you deal with it?

I had an issue similar to this where puphpeteer was falling over due to the js-portion receiving an invalid json payload- this was due to loading too much data via setContent, dumping the content to file & loading the file eliminated my particular issue.

Related to #87

I had this same issue and have been debugging for the past 3 days. In my case it was working on dev through a symfony local web server, but was failing on live which is an IIS Web server.
My problem turned out to be that the user tied to the Application Pool for the IIS website did not have permissions to perform these actions, so I set the user to someone who did and it we're up and running again! I found the solution here https://stackoverflow.com/questions/11575386/foo-cmd-wont-output-lines-in-process-on-website


🤖 update backend endpoint

Looks good to me

maybe I wait to merge #22 first

It's written just on top of #22, so you could close that and keep this

ok I close the #22 and review this

Awesome!


Issue15 2

Please always provide the GitHub issue(s) your PR is for, as well as test URLs where your change can be observed (before and after):
Fix #
If your change will impact authors (new block or block variant, etc.) please update the authoring guide and block inventory pages.
Test URLs:

Before: https://main--blogs-keysight--hlxsites.hlx.page/inds/2023/01/06/the-importance-of-phase-coherent-rf-signal
After: https://issue15-2--blogs-keysight--hlxsites.hlx.page/inds/2023/01/06/the-importance-of-phase-coherent-rf-signal

Overall looks good. We do need to look at that CLS though.
I see some style declarations that appear to be copied from the current site and probably be removed, but we can do that later.


[Bug]: If you create a logical table in the schema, you will be redirected to the current window, not the window where the table is created

ODC version
odc 4.3.2
OB version
no related
What happened?
If you create a logical table in the schema, you will be redirected to the current window, not the window where the table is created

What did you expect to happen?
If you click Create Logical Table in the logic database, you should be redirected to the table creation window, instead of the currently open window
How can we reproduce it (as minimally and precisely as possible)?
Select a logic in the project and click Create Logical Table
Anything else we need to know?
No response

Fixed In Commit c1469755bb913bc85ab7c9b46b43e454079713fd
------
畅晚
Fri Sep 20 18:48:17 2024 +0800

pass


feat(types); Update default values for poll creation

Document default values for duration and allowMultiselect CreatePoll

Upstream: https://github.com/discord/discord-api-docs/pull/6968
fixes: #3700
depends on: #3694

This pr depends on #3694 since changing the default to 24 but still having "up to 7 days" would be very confusing

LGTM! But why create this PR? Why not just push another commit to #3694 ?

idk lol i did thinked about just reporpusing that pr however i didn't know so i ended up creating this pr, if you think it is a better idea i can retarget this pr to that branch and merge it


AddJaxrsTestHelper

Note: the original class name was JaxRsTestHelper but to be consistent with all the other JaxrsXxx classes in kiwi and in kiwi-test, we are renaming to JaxrsTestHelper

Referenced this accidentally in #87 , so re-opened it


improve changePrototype scenario

Whenever we change prototype of an object, we invalidate all proto inline caches of all the properties present in all of the object's prototype chain. However this can be avoided if the object is not a prototype of any other object since it would have never got registered in proto inline cache as a prototype object. So, skip invalidation if the object is not a prototype of any object.
The only thing that should be done in that case is to change the type of object so that if it's properties were using proto inline caches, they will be invalidated by type mismatch and we will update their proto inline cache on next property access.
Gives approx. 20% gain in AcmeAir benchmarks of node.
Test: UnitTest pass, Internal test runs in progress.

@pleath , @curtisman , please review.


⚠ PrivateHD has degraded performance

In 50ca108, PrivateHD ($PHD) experienced degraded performance:

HTTP code: 200
Response time: 2017 ms

Resolved: PrivateHD performance has improved in 9e855d2.


Missing page number in pagination if total page number is even and by 1 greater than visible pages

Current behavior

Missing page number in pagination if total page number is even and by 1 greater than visible pages.
Expected behavior

First and last page numbers should be always displayed.
Steps to reproduce the issue

Go to https://capybara.storefrontcloud.io/men/tops-men/tops-12?page=3
Total page number is 4.
Click page number 2.
Total page number is 3.

Can you handle fixing this bug by yourself?

[ ] YES
[ ] NO

Environment details

Browser: any
OS: any
Code Version: latest

Additional information
Issue probably related to https://github.com/DivanteLtd/storefront-ui/issues/1182

Issue seems to be resolved now. Closing.


Using dask.delayed to work with zarr data on a remote Dask cluster

I am running calculations on a remote Dask cluster. Some of the data is only available on the workers, not on the client. It is already possible to have an xarray dataset that "points" to a remote NetCDF data collection by using the parallel option with xarray.open_mfdataset() like this:
from dask.distributed import Client
import xarray as xr

client = Client('<dask_scheduler_ip>:<port>')
ds = xr.open_mfdataset(remote_nc_file_paths, combine='by_coords', parallel=True)

Then it will use dask.delayed and, for example, the following simple mean calculation will be distributed between the workers, the result returned to the client:
ds['Temp'].mean().compute()

Unfortunately, I cannot do the same thing with zarr, because open_mfdataset() does not support it, and open_zarr() does not have an option to utilize dask.delayed. Would it be possible to add dask.delayed support to the zarr backend? Or, perhaps, I am missing something, and there is another better way to work with zarr data on a remote Dask cluster?

You can use the pseudocode here: https://xarray.pydata.org/en/stable/io.html#reading-multi-file-datasets and change open_dataset to open_zarr and then things should work (if I understand things correctly)

Hi @dmedv -- thanks a lot for raising this issue here!
One clarification question: is there just a single zarr store you are trying to read? Or are you trying to combine multiple stores, like open_mfdataset does with multiple netcdf files?

Some of the data is only available on the workers, not on the client.

Can you provide more detail about how the zarr data is distributed across the different workers and client.

@rabernat
Each Dask worker is running on its own machine. The data is distributed among workers, but all data is accessible from any individual worker via cross-mounted NFS shares, so this works like a shared data storage, basically. None of this data is available on the client.
For now, I'm trying to open just a single zarr store. I have only mentioned open_mfdataset as an example, because it has this parallel option, unlike open_dataset or open_zarr. This is really not about combining multiple datasets, but about working with data on a remote Dask cluster. Sorry, if I haven't made it absolutely clear from the start.
@dcherian
You mean this code?
def modify(ds):
    # modify ds here
    return ds

# this is basically what open_mfdataset does
open_kwargs = dict(decode_cf=True, decode_times=False)
open_tasks = [dask.delayed(xr.open_dataset)(f, **open_kwargs) for f in file_names]
tasks = [dask.delayed(modify)(task) for task in open_tasks]
datasets = dask.compute(tasks)  # get a list of xarray.Datasets
combined = xr.combine_nested(datasets)  # or some combination of concat, merge

In case of a single data source, I think, it can be condensed into this:
open_kwargs = dict(
    decode_cf=True,
    decode_times=False
)
ds = dask.compute(dask.delayed(xr.open_dataset)(file_name, **open_kwargs))[0]

But it doesn't work quite as I expected, either with zarr, or with NetCDF. First I'll have to explain what I get with open_dataset and a NetCDF file. The code above runs, but when I try to do calculations on the obtained dataset, for example
ds['Temp'].mean().compute()

I get
FileNotFoundError: [Errno 2] No such file or directory
on the client. Only if I wrap it in dask.delayed again, it will run properly:
dask.compute(dask.delayed(ds['Temp'].mean)())

So, this approach is not fully equivalent to what open_mfdataset does, and unfortunately that doesn't work for me, because I would like to be able to use the xarray dataset transparently, without having to program Dask explicitly.
If I add chunks={} to open_kwargs, similar to this line in the open_mfdataset implementation https://github.com/pydata/xarray/blob/v0.14.1/xarray/backends/api.py#L885 , then it starts behaving exactly like open_mfdataset and I can use the dataset transparently. I don't quite understand what's going on there, but so far so good.
Now, back to zarr:
ds = dask.compute(dask.delayed(xr.open_zarr)(zarr_dataset_path, **open_kwargs))[0]

doesn't run at all, regardless of the chunks setting, giving me
ValueError: group not found at path ''
so I don't even get a dataset object. Seems that something is quite different in the zarr backend implementation. I haven't had the chance to look at the code carefully yet, but I will do so in the next few days.
Sorry for this long-winded explanation, I hope it clarifies what I'm trying to achieve here.

Here is the stacktrace (somewhat abbreviated):
distributed.protocol.pickle - INFO - Failed to deserialize b'\x80\x04\x95\x92\x13\x01\x00\x00\x00\x00\x00\x8c\x13xarray.core.dataset\x94\x8c\x07Dataset\x94\x93\x94)\x81\x94

...

KeyErrorTraceback (most recent call last)
~/miniconda3/lib/python3.6/site-packages/zarr/hierarchy.py in __init__(self, store, path, read_only, chunk_store, cache_attrs, synchronizer)
    109             mkey = self._key_prefix + group_meta_key
--> 110             meta_bytes = store[mkey]
    111         except KeyError:

~/miniconda3/lib/python3.6/site-packages/zarr/storage.py in __getitem__(self, key)
    726         else:
--> 727             raise KeyError(key)
    728

KeyError: '.zgroup'

During handling of the above exception, another exception occurred:

ValueErrorTraceback (most recent call last)
<ipython-input-60-5c7db35096c7> in <module>
      6     chunks={}
      7 )
----> 8 ds = dask.compute(dask.delayed(_xr.open_zarr)('/sciserver/filedb02-01/ocean/LLC4320/SST',**open_kwargs))[0]

...

~/miniconda3/lib/python3.6/site-packages/distributed/protocol/pickle.py in loads(x)
     57 def loads(x):
     58     try:
---> 59         return pickle.loads(x)
     60     except Exception:
     61         logger.info("Failed to deserialize %s", x[:10000], exc_info=True)

~/miniconda3/lib/python3.6/site-packages/zarr/hierarchy.py in __setstate__(self, state)
    269
    270     def __setstate__(self, state):
--> 271         self.__init__(*state)
    272
    273     def _item_path(self, item):

~/miniconda3/lib/python3.6/site-packages/zarr/hierarchy.py in __init__(self, store, path, read_only, chunk_store, cache_attrs, synchronizer)
    110             meta_bytes = store[mkey]
    111         except KeyError:
--> 112             err_group_not_found(path)
    113         else:
    114             meta = decode_group_metadata(meta_bytes)

~/miniconda3/lib/python3.6/site-packages/zarr/errors.py in err_group_not_found(path)
     27
     28 def err_group_not_found(path):
---> 29     raise ValueError('group not found at path %r' % path)
     30
     31

ValueError: group not found at path ''

I tried to do serialization/deserialization by hand:

logged in to one of the Dask worker, loaded zarr data locally using open_zarr, pickled the resulting dataset

ds = xr.open_zarr("/sciserver/filedb02-01/ocean/LLC4320/SST")
pickle.dump(ds, open("/home/dask/zarr.p", "wb"))

copied the pickle file to the client, tried to unpickle it

ds = pickle.load(open("zarr.p", "rb"))

It failed with the same error:
UnpicklingErrorTraceback (most recent call last)
<ipython-input-77-4809dc01c404> in <module>
----> 1 a = pickle.loads(s)

UnpicklingError: pickle data was truncated

import pickle, xarray
pickle.load(open("zarr.p", "rb"))
zarr = pickle.load(open("zarr.p", "rb"))

KeyErrorTraceback (most recent call last)
~/miniconda3/lib/python3.6/site-packages/zarr/hierarchy.py in __init__(self, store, path, read_only, chunk_store, cache_attrs, synchronizer)
    109             mkey = self._key_prefix + group_meta_key
--> 110             meta_bytes = store[mkey]
    111         except KeyError:

~/miniconda3/lib/python3.6/site-packages/zarr/storage.py in __getitem__(self, key)
    726         else:
--> 727             raise KeyError(key)
    728

KeyError: '.zgroup'

During handling of the above exception, another exception occurred:

ValueErrorTraceback (most recent call last)
<ipython-input-83-cd9f4ae936eb> in <module>
----> 1 zarr = pickle.load(open("zarr.p", "rb"))

~/miniconda3/lib/python3.6/site-packages/zarr/hierarchy.py in __setstate__(self, state)
    269
    270     def __setstate__(self, state):
--> 271         self.__init__(*state)
    272
    273     def _item_path(self, item):

~/miniconda3/lib/python3.6/site-packages/zarr/hierarchy.py in __init__(self, store, path, read_only, chunk_store, cache_attrs, synchronizer)
    110             meta_bytes = store[mkey]
    111         except KeyError:
--> 112             err_group_not_found(path)
    113         else:
    114             meta = decode_group_metadata(meta_bytes)

~/miniconda3/lib/python3.6/site-packages/zarr/errors.py in err_group_not_found(path)
     27
     28 def err_group_not_found(path):
---> 29     raise ValueError('group not found at path %r' % path)
     30
     31

ValueError: group not found at path ''

I then tried the same thing with a NetCDF dataset, and it worked fine. Also, the pickle file for NetCDF was much smaller. So I guess in the case of zarr dataset there is some initialization code that tries to open the zarr files when the dataset object gets deserialized on the client, and of course it cannot, because there is no data on the client. That explains a lot... although I'm still not sure if xarray was ever intended to be used that way.  Maybe I'm trying to do a completely wrong thing here?

Thanks for these detailed reports!
The scenario you are describing--trying to open a file that is not accessible at all from the client--is certainly not something we ever considered when designing this. It is a miracle to me that it does work with netCDF.
I think you are on track with the serialization diagnostics. I believe that @jhamman has the best understanding of this topic. He implemented the parallel mode in open_mfdataset. Perhaps he can give some suggestions.
In the meantime, it seems worth asking the obvious question...how hard would it be to mount the NFS volume on the client? That would avoid having to go down this route.

@rabernat
Fair enough. In our case it would be possible to mount NFS shares on the client, and if all else fails I will do exactly that. However, from architectural perspective, that would make the whole system a bit more tightly coupled than I would like, and it's easy to imagine other use-cases, where mounting data on the client would not be possible. Also, the ability to work with remote data using just xarray and dask, the way it already works with NetCDF, looks pretty neat, even if unintentional, and I am inclined to pursue that route at least a bit further.

The scenario you are describing--trying to open a file that is not accessible at all from the client--is certainly not something we ever considered when designing this. It is a miracle to me that it does work with netCDF.

True. I think its fair to say that the behavior you are enjoying (accessing data that the client cannot see) is the exception, not the rule. I expect there are many places in our backends that will not support this functionality at present.
The motivation for implementing the parallel feature was simply to shard the fileIO time when opening large collections (>10k) of netcdf files.
Ironically, this dask issue also popped up and has some significant overlap here: https://github.com/dask/dask/issues/5769
In both of these cases, the desire is for the worker to open the file (or zarr dataset), construct the underlying dask arrays, and return the meta object. This requires the object to be fully pickle-able and for any references to be maintained. It is possible, as indicated by your traceback, that the zarr backend is trying to reference the zgroup file and its not there. The logical place to start would be to look into why we can't pickle xarray datasets that come from zarr stores.

Also, @dmedv, can you add the output of xr.show_versions() to your original post?

Here is the output of xr.show_versions():
INSTALLED VERSIONS
------------------
commit: None
python: 3.6.7 |Anaconda custom (64-bit)| (default, Oct 23 2018, 19:16:44)
[GCC 7.3.0]
python-bits: 64
OS: Linux
OS-release: 3.10.0-862.2.3.el7.x86_64
machine: x86_64
processor: x86_64
byteorder: little
LC_ALL: None
LANG: None
LOCALE: None.None
libhdf5: 1.10.4
libnetcdf: 4.6.3

xarray: 0.14.1
pandas: 0.25.3
numpy: 1.17.3
scipy: 1.4.1
netCDF4: 1.5.3
pydap: None
h5netcdf: None
h5py: 2.8.0
Nio: None
zarr: 2.3.2
cftime: <IP_ADDRESS>
nc_time_axis: None
PseudoNetCDF: None
rasterio: None
cfgrib: None
iris: None
bottleneck: 1.2.1
dask: 2.9.1
distributed: 2.9.1
matplotlib: 3.1.2
cartopy: None
seaborn: 0.9.0
numbagg: None
setuptools: 40.4.3
pip: 18.1
conda: 4.8.0
pytest: 3.8.2
IPython: 7.0.1
sphinx: 1.8.1

I did another experiment: copied the metadata to the client (.zgroup, .zarray, and .zattrs files only), preserving the directory structure. That worked, i.e. I could run calculations with remote data by wrapping them inside dask.delayed. I guess if the metadata could be cached in the object, that would solve my problem.

Zarr documentation is not entirely clear on whether metadata gets pickled or not with zarr.storage.DirectoryStore: https://zarr.readthedocs.io/en/stable/tutorial.html#pickle-support
but the code shows that the metadata is read from a file upon __init__, and I guess xarray is simply relying on zarr's own serialization, and there is no easy way to bypass it.
See
https://github.com/zarr-developers/zarr-python/blob/v2.4.0/zarr/hierarchy.py#L113
and
https://github.com/zarr-developers/zarr-python/blob/v2.4.0/zarr/storage.py#L785-L791
I think at this point I will just give up and mount the necessary directories on the client, but at least I have a much better understanding of the issue now.
Feel free to close if you think there's nothing else that can/should be done in xarray code about it.

@dmedv and @rabernat - after thinking about this a bit more and reviewing the links in the last post, I'm pretty sure we're bumping into a bug in zarray's directory store pickle support. It would be nice to confirm this with some zarr-only tests but I don't see why the store needs to reference the zgroup files when the object is unpickled.

@jhamman I did already confirm it with a zarr-only test, pickling and unpickling a zarr group object. I get the same error as with an xarray dataset: ValueError: group not found at path ''

It would be wonderful if we could translate this complex xarray issue into a minimally simple zarr issue. Then the zarr devs can decide whether this use case is compatible with the zarr spec or now.


Setup CI/CD pipeline with Travis CI

Should we set up CI/CD for each pull request?

Yeah I think so we should setup CI/CD for all the projects if you can help on this please go ahead, it's free right?.

@totiz It's free for a public repo. I've set for libra-service and PR.

@suraneti Ok, I'm on testing why tx3 error? will merge soon.

TODO

[x] Create .travis.yml file.
[ ] Setup unit test all components.
[ ] Connect with travis-ci from origin repo.

@suraneti What should we do next? please consult me to setup travis-ci

@totiz OK, I'll contact you about Travis-ci integration.

Nice, now working


Create minor release with bug fixes from PR#127

Would it be possible to create a minor release with https://github.com/onelogin/python3-saml/pull/127 ?
Thanks!

cc: @pitbulk

Yes, I plan to add a new feature this week, so expect a new release in 4-8 days

@pitbulk thanks for the fast response and release info :+1: I'll close the issue once the release is out if that's ok with you

hey @pitbulk how's the release looking?

Sorry for the delay, hope to release it very soon.

1.6.0 released
https://pypi.org/project/python3-saml/

thanks, much appreciated!


Make datapipe for GSP,PV,NWP and Satellite

Detailed Description
Make a data pipe that takes all for inputs. Should have option if GSP and PV is used to make locations
Context
Good to have this for nowcatsing project and SBRI
Possible Implementation
Similar to other data pipelines

I'll close this for the moment, need to test it works with GCP, but its there ready to go


SVG Preview fails on all but Optimized SVG file when saving from InkScape 1.1

Microsoft PowerToys version
0.55.1
Running as admin

[X] Yes

Area(s) with issue?
SVG Preview, SVG Thumbnail
Steps to reproduce
Using the latest version of InkScape to create SVG files, when testing with a few simple shapes (square, star, circle), I've found that the Thumbnail preview works well for when you save an InkScape file as;

Inkscape SVG
Optimized SVG
Plain SVG

The Thumbnail doesn't work for;

Compressed SVG (.svgz)

Unfortunately, the Windows Explorer Preview only works for;

Optimized SVG

The following tested formats fail to display a preview, showing only a white page, or compressed string text;

Inkscape SVG
Plain SVG
Compressed SVG (.svgz)

✔ Expected Behavior
I was expecting to see a vector image preview for;

Inkscape SVG
Plain SVG

And possibly also for;

Compressed SVG (.svgz)

Currently, the only format that I've found to both preview and thumbnail correctly and as expected is;

Optimized SVG

❌ Actual Behavior
The following tested formats fail to display a Windows Explorer preview, showing only a white page, or compressed string text;

Inkscape SVG
Plain SVG
Compressed SVG (.svgz)

The Thumbnail doesn't work for;

Compressed SVG (.svgz)

Other Software
Tested using the free to use InkScape 1.1
I'd just like to add that these added SVG improvements to Windows Explorer are AWESOME! Thank you so much, it's hugely appreciated.

@Karlstens Thanks for reporting.  I'm not an every day user of SVG files, so it would be great if you could attach few files here that SVG previewer don't work with. Also, could you attach /bugreport?

Hi there!We need a bit more information to really debug this issue. Can you add a "Report Bug" zip file here?  Then drag the zipfile from your desktop onto the GitHub comment box in this issue. Thanks!

Cool, thanks so much for looking at this. ☕
Please find the PowerToys bug report attached, alongside a screenshot that shows the SVG files I've tested and the working explorer preview for the Optized SVG. Only the Optimized SVG file is displaying both the thumbnail and preview correctly (but unfortunately it's many clicks to generate through InkScape).
PowerToysReport_2022-02-05-09-54-00.zip

shapes_Compressed SVG.zip

@Karlstens Thanks for reporting. I'm not an every day user of SVG files, so it would be great if you could attach few files here that SVG previewer don't work with. Also, could you attach /bugreport?

@Karlstens Thanks for reporting. I'm not an every day user of SVG files, so it would be great if you could attach few files here that SVG previewer don't work with. Also, could you attach /bugreport?

Thanks stefansjfw - I've uploaded the files in my previous reply (accidentally closed/re-opened the thread too, sorry about that! I'm new to Github 😂).

pretty sure #15764  would resolve this issue as it would migrate stuff to webview2 which is a far more modern web engine.

The weird thing is, the thumbnail was generated

Looks like System.IO.Compression.GZipStream can handle SVGZ files. Here is a sample script:
#Requires -Version 7.2

using namespace System.Management.Automation
using namespace System.IO
using namespace System.IO.Compression

[CmdletBinding()]
param (
  # Specifies a path to one or more locations.
  [Parameter(Mandatory, Position=0, ValueFromPipeline, ValueFromPipelineByPropertyName)]
  [Alias("LiteralPath", "PSPath")]
  [ValidateNotNullOrEmpty()]
  [String] $Path
)

function Expand-SVGZ {
  Write-Warning "Expand-SVGZ: This function is for demo only; it has no error-checking mechanisms."

  $FullPath = (Get-Item $Path -ErrorAction Stop).FullName
  $DestinationPath = ($FullPath -replace '\.svgz$','') + '.svg'

  try {
    [FileStream]$compressedFileStream = [File]::Open($FullPath, [FileMode]::Open)
    [FileStream]$outputFileStream     = [File]::Create($DestinationPath)
    $Decompressor = [System.IO.Compression.GZipStream]::new($compressedFileStream, [System.IO.Compression.CompressionMode]::Decompress)

    $Decompressor.CopyTo($outputFileStream);

    $Decompressor.Dispose();
    $outputFileStream.Dispose();
    $compressedFileStream.Dispose();
  }
  catch {
    throw
  }
}

Expand-SVGZ @args

Use it like this:
& '.\Decompress SVGZ.ps1' -Path .\car.svgz

You people are awesome, thanks so kindly for looking into these SVG File Explorer Preview updates. 😃

First and foremost, the "Issue-Bug" tag is unsuitable. SVGZ is not SVG. This is a feature request.
Second, previewing a GZip stream has non-negligible overhead.

Hi skycommand.
I think the issues with the standard SVG-types are not a feature request. Only the talk about support for SVGZ files in the later part of the tread.
I have looked a little bit into the problem as I have experienced it my self.
The problems seems to be one of the XML namespace declarations that Inscape inserts in the top of the SVG files.
It goes:
...
<svg
...
xmlns="http://www.w3.org/2000/svg"
xmlns:svg="http://www.w3.org/2000/svg">
...
If you delete the xmlns:svg ... declaration from the XML file the thumbnails are rendered "correctly". I have not found any use of the :svg namespace in the few files I have looked through, but there probably are some use if it in some cases.
I am not that much into the rules of the XML 1.0 to say if the declaration of 2 similar URLs in both the default and a subspace is a violation or it is just the XML-interpreter/thumbnail generator that is doing something wrong?

I've attached 2 example-files:
TEST1_Inkscape.svg is a svg-file with the :svg declaration
TEST2_Inkscape.svg is the same file with the :svg declaration removed.

.

@Carse7 You're right. We already identified this issue and fixed it https://github.com/microsoft/PowerToys/pull/18825
SVG coming from InkScape1.1 should be previewed correctly now

@stefansjfw Thks for rply! I have now seen the issue #18825 you've linked. The problem I've experienced is only the icon-thumbnail not being generated, #18825 only talks about the preview in fileexplorer. My versions are (and were) updated (MSPT v0.60.1 and IS1.2.1). Probably the same parser issue is present in the thumbnail-XML-parser?

@Carse7 Once again, you're right.  :) Same fix for thumbnail was added later and will be included in next PowerToys release :)

Marking this one as a duplicate of https://github.com/microsoft/PowerToys/issues/17527 . If this issue still occurs please reopen the issue
/dup of https://github.com/microsoft/PowerToys/issues/17527


Added a way to invoke external functions.

The plugin currently does not support functions that are not defined within the current serverless.yml.
This commit adds a way to define an endpoint for these functions so the can be called anyway as a rest call.
One can make a function callable by defining events.http section.

@EgorDm Thank you for your contrib.
Could you please elaborate the use case for this?
Is this supposed to work with a secondary stack and the serverless-offline plugin?
Could you provide a full example, including the dataSource ?
Thanks,

Hey @bboure,
Sorry for a late response.
I have just added an example on how it should be used.
This is indeed supposed to be used with a second stack. For example, if a lambda function is defined in a separate serverless.yml from the appsync config.
When using serverless offline, one can run it using an HTTP request (for example http://localhost:3016/2015-03-31/functions/myLambda/invocations).
When deploying one can usually specify an ARN for a function to be called. But while offline it is not possible to invoke it.


Replace abandoned Sensiolabs security checker

This PR replaces the abandoned Sensiolabs security checker with the Enlightn security checker.

This PR has several advantages over https://github.com/EdgedesignCZ/phpqa/pull/214:

The Enlightn security checker is licensed under MIT so it can be used in any app. The other PR uses local php security checker which is licensed under AGPLv3, and thus cannot be used by any non-AGPL app.
This Enlightn security checker can be pulled in via composer whereas the local-php-security-checker needs to download binaries. This depends on system architecture and needs hacky solutions / shell scripts to make it work.

This PR has several advantages over https://github.com/EdgedesignCZ/phpqa/pull/214:

The Enlightn security checker is licensed under MIT so it can be used in any app. The other PR uses local php security checker which is licensed under AGPLv3, and thus cannot be used by any non-AGPL app.
This Enlightn security checker can be pulled in via composer whereas the local-php-security-checker needs to download binaries. This depends on system architecture and needs hacky solutions / shell scripts to make it work.

Looks interesting. Composer.lock is not uploaded anywhere, am I correct?

That's right @zdenekdrahos, it just looks for the lock file in the current directory. It's very similar to how the old Sensiolabs security-checker worked.

Could you support symfony/finder:2? I'd like to keep support for older php and symfony versions.

https://travis-ci.org/github/EdgedesignCZ/phpqa/jobs/756550442#L596
enlightn/security-checker v1.3 requires symfony/finder ^3|^4|^5 but these conflict with your requirements or minimum-stability.

Hey @zdenekdrahos, I've added support all the way upto PHP 5.6 with https://github.com/enlightn/security-checker/pull/6. We need a min of symfony/yaml 3.4 and symfony/console 3.4 for everything to work right now.
Given that 5.6 was EOL in 2018, I think it's a good version to support for now. I'm open to PRs for expanding support though but this as far as I can get for now. Hope that works!