Serialization/deserialization happens in the sessionStore, the utility class only handles the DB operations. 2. SessionTableAttributes was completely removed 3. ExpiredSessionReaper was completely removed 4. The serialization/deserialization happens with Tomcat's own methods. 5. The DB structure was simplified. Only a key (sessionID) and the serialized session data are stored. (Tomcat's reaper needs no more, it checks the expiration date in the deserialized session object) 6 A DB synchronization added to the keys() method (It refresh the keys in each hour from the DB).

Here is the full story behind this version:
I tried to explore the issue discussed here:
https://github.com/aws/aws-dynamodb-session-tomcat/issues/18
I took the trouble and examined how the session handling works in Tomcat and also analysed the whole package line by line. It turned out that this is not a simple bug but a very serious logic error in the algorithm.
Let's see the issues step by step:

The serialization of the sessions happens in the utility class but the deserialization happens in the DynamoDBSessionStore class. Well it's not a bug but not too nice and also a bad omen...

The inner structure of the DB is exposed via the public SessionTableAttributes class. Why do we need this if we have a utility class for accessing the DB? Bad omen 2.

The package has an ExpiredSessionReaper for deleting the expired sessions. But Tomcat has it's own process for this task what runs in every minute. Why do we need an additional reaper? Still not a real bug, but this was the third bad omen... a very evil thing must be near...

Tomcat's own reaper works in a general way. It has no direct access to the actual storage, so it uses the public methods of the storage implementation, like the load and remove methods. It loads the sessions one by one, checks they expiration date and remove them from the storage if needed. Let's check the load method in the DynamoDBSessionStore! We can find the following line is in it:

manager.add(session);
The session is added to the manager inside the load method. Let's see what happens here:
Let's assume a user has made some changes in his session but the session is not stored yet, because it's only stored after a 30 seconds idle interval. Then Tomcat's own sessionReaper starts working. It goes through all the sessions in the store, so it also loads this user's session too using the load method mentioned above. Of course the session is not expired so it won't delete it, but during the load method the freshly loaded - but out-of-date session will be registered to the manager. Because it has the same sessionId as the already existing - and updated - session (of course) it will simply override the actual session in the manager! And that's exactly what we experienced and what was described in the mentioned issue above. The session has switched back to an earlier state!

But removing this line from the load method won't solve the problem.  The session creation itself also register the session to the manager:

Session session = getManager().createSession(id);
Basically when you provide an id and a manager object to a session, it will be instantly registered to the manager. There is only one exception: If we use the StandardSession's own deserialization method. Because it HAS an own and very well implemented serialization and deserialization method in it!
So, why do we want to serialize and deserialize the session objects by our own way, when we could use the original, well tested and managed methods? The JSBCSessionStore and FileSessionStore implemetations also use these methods and they work perfectly.

I've found one more glitch: The DynamoDBSessionStore manages a set of session keys  in the memory. It is a faster solution than loading back the session keys from the DB each time but other instances could also add or remove sessions from the DB, so some keys could become obsolete over time. We should synchronize this list with the DB time to time to avoid unnecessary checks.

So I made the following changes:

Serialization/deserialization happens in the sessionStore, the utility class only handles the DB operations.
SessionTableAttributes was completely removed
ExpiredSessionReaper was completely removed
The serialization/deserialization happens with Tomcat's own methods.
The DB structure was simplified. Only a key (sessionID) and the serialized session data are stored. (Tomcat's reaper needs no more, it checks the expiration date in the deserialized session object)
6 A DB synchronization added to the keys() method (It refresh the keys in each hour from the DB).

I also changed the major version number, because the new manager is NOT compatible with the previous versions. The sessions are stored in a different format now in the DB.

Hey @Selindek, after looking into this I agree with your original assessment. I had hoped to be able to preserve backwards compatibility with previous versions by only setting the manager after all fields on the session have been set (setManager is just a normal setter with no additional side effects of registering the session). Unfortunately when going down that avenue I discovered that we are not setting the accessed time correctly. We only set the creation time of the session which initializes the access time to the same value, we store the last accessed time in the database but do nothing with it. This too is a pretty serious bug as sessions can be reaped before they are truly expired. The access time doesn't have an exposed setter, calls to access() just set the last accessed time to the current time. It looks like the only option to set the last accessed time would be to subclass StandardSession to gain direct access to those fields or use the serialization/deserialization methods you pointed out in your pull request. I prefer your approach as it's less susceptible to breaking changes in StandardSession across different versions of Tomcat but would like to discuss the options with @fulghum before proceeding.

We have decided to accept this pull request with a few changes to allow existing customers to migrate without rebuilding the session table. Can you confirm you are submitting the code to Amazon under the Apache 2.0 license?

Yes, I confirm.

Thanks for your contribution @Selindek!


requestId overflow

Hi,
In file:
https://github.com/mongodb-js/mongodb-core/blob/d40cb87ad415cfe224ae00d7696fc549fbbd0c62/lib/connection/msg.js#L105
requestId is used to write 2 bytes into header, but there is no limitation on how big this.requestId can be. It is growing with every message:
https://github.com/mongodb-js/mongodb-core/blob/d40cb87ad415cfe224ae00d7696fc549fbbd0c62/lib/connection/msg.js#L133
And so, eventually it will reach maximum allowed value:
As node documentation is saying:
https://nodejs.org/api/buffer.html#buffer_buf_writeint32le_value_offset
value should be a valid signed 32-bit integer. Behavior is undefined when value is anything other than a signed 32-bit integer.
In reality it means error which cannot be fixed even by re-connection to database:
TypeError: "value" argument is out of bounds
  at checkInt (buffer.js:1185:11)
  at Buffer.writeInt32LE (buffer.js:1375:5)
  at Msg.toBin (/node_modules/mongodb/node_modules/mongodb-core/lib/connection/msg.js:105:12)

Hi @djpeton, I see NODE-2067 was opened for this. I'm going to close this ticket (since issues will shortly be disabled on this repository) in favor of that one. Thanks!


Display record without url parameter

I'm wondering if it's possible to display builder record on my landing page without passing url parameters (because it's landing page). I have column called published, that is linked to switch. If switch is true, then that record would be displayed.
So it's maybe possible to display record details if database column parameter is active, or should I use record list for this case?

You can use Record list with "published = true" filter as simplest solution for your case.
Or you may spend several hours to learn how to work with Laravel Models and Eloquent :)


[CRASH] Tropical slimes are crashing client when rendered

1.18.2, when a tropical slime is rendered, it crashes the client.
2022-07-11-7.log

@Slexom Any updates on this crash? This is pretty severe, and I have to disable slimes to stop my server from crashing.

It's been nearly a month since I've reported this. Please maintain this mod. It's far too incredible to be forgotten.

1.18.2 Is not maintained

It was maintained when I posted this github, right? Is this bug fixed in the newer versions?


consolidate preconditions within party

Propagate changes from https://github.com/MinaProtocol/mina/pull/11096 to Party.Fee_payer.t and archive schema

Addressed in #11332


Is there a way to control the file picker options

I dont want the options to be shown to pick the image from camera or folder. is it possible. if so please guide me

I am aware of this
https://codesandbox.io/s/busy-nightingale-oox7z?file=/src/App.js
but it doesnt work in ios

As far as I know, that's a default browser behaviour and there is no way to change it.
What do You mean by "it doesn't work in iOS"? We've tested the hook on multiple operating systems (including iOS) and everything works as expected. Could You elaborate on Your issue with iOS?

@MrKampla Thank you very much for your reply.
I see. So it's the browser behavior right?
I actually meant, in Android when i only try to get image from the gallery of the device following the codes in
https://codesandbox.io/s/busy-nightingale-oox7z?file=/src/App.js ,
it really works well.
However in iOS, it shows up the popover menu options including camera. So, according to you its impossible in iOS to open the gallery directly because it's due to iOS browser behavior.  Am I correct?

@RuzenDev yes, it's impossible as it's a default iOS behavior, and we can't change it. Technically, the browser doesn't want to restrict users to only pick images from the gallery because a user can have some images stored in different directories.

@MrKampla Thank you so much. I understand it.
Thanks for your great library.


Some "issues"

hey evan,
first of all: this is an amazing tool. love it!
I run it on a windows 10 machine and run into 2 little "i ssues".
1: on my xdj 1000mk2 Player, ive got the error"E-8309 Link Access Error"
the player will play without any problems and the Error comes and goes every xy seconds. thats not a big deal, since the music wont stop and everything runs just fine.
2: If I loaded a new track, it will not always be displayed the same way. some times it displays the track right after loading. some times it displays after xy seconds without playing, only cue´ed. some times it displays the track after 16bars, which is right i guess.
one question: is there a way to delete the cover section from the overlay?
greetings from germany!
edit
it seems that rekordbox is the issue. if i play from usb sticks, everything works as expected. most of the time i play from rekordbox with linked players.

Hi Evan
here's the same problem.
every 15 seconds, players display the link. Error.
the players cdj2000nxs working fine.
Even if I play with linked USB stuck, error showing up.
newest firmware on the player and also rekordbox is on the newest 5.x version

Hey Guys, I think there is a limitation where it does not work with rekordbox at all, this is because Rekordbox locks exclusive socket access to the CDJ's and the overlay can no longer read the players.
You must have rekordbox closed before launching the overlay

Nope.. It also happen if rekordbox is closed and only play with linked USB stick.

To add some information here, I was just testing this out on a 2015 macbook pro that I have upgraded to catalina and ran into the exact same problem.
setup overview:
2015 macbook pro / os x catalina (upgrade - not clean install)
apple branded thunderbolt to ethernet adapter
trendnet teg-s82g 8 port gigabit ethernet switch
2x xdj-1000mk2 (latest firmware installed today)
128G and 256G samsung USB drive
I have a feeling there is an issue with using such large drives, as it took nearly 6 minutes to start loading track info data to be displayed, but then it worked for the playlists I was in.  Once I switched playlists it took another 5-6 minutes to load data.
Every 1-3 minutes I get E-8309 Link Access Error, although the tracks continue playing and the error goes away within just a few seconds.
I'm going to test smaller USB drives, a different switch, new cables, and a windows 10 laptop to see if the issue continues.  I can also try direct connecting a player to the laptop without a switch and see how that goes.  I had read somewhere (although can't find the article anymore) that pioneer can be finicky with switches and prolink, however I've had this switch for ~2 years with no problems just direct connecting players together.  I'll report back later.

Hey guys, also having the same issue: tried on Windows & Mac, with static IPs and dhcp - I can see the cdjs (2x CDJ2000)  coming on but don't get any events on play/stop etc. beatlinktrigger seems to work fine though. Also getting the E-8309 Link Access Error, no Rekordbox on the network. looking forward to solve this, awesome work btw!
best, matthias

The link access error is normal, cause this open source project doesn't have a legal license from Pioneer 😉
Holen Sie sich Outlook für Androidhttps://aka.ms/ghei36

From: Matthias Lein<EMAIL_ADDRESS>Sent: Thursday, April 23, 2020 3:25:56 AM
To: EvanPurkhiser/prolink-tools<EMAIL_ADDRESS>Cc: markusglow<EMAIL_ADDRESS>Comment<EMAIL_ADDRESS>Subject: Re: [EvanPurkhiser/prolink-tools] Some "issues" (#5)
Hey guys, also having the same issue: tried on Windows & Mac, with static IPs and dhcp - I can see the cdjs (2x CDJ2000) coming on but don't get any events on play/stop etc. beatlinktrigger seems to work fine though. Also getting the E-8309 Link Access Error, no Rekordbox on the network. looking forward to solve this, awesome work btw!
best, matthias
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://github.com/EvanPurkhiser/prolink-tools/issues/5#issuecomment-618123010, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ALMAK24S6ACZLSNHPFVDX2DRN6KKJANCNFSM4GL5WVGA.
Markus Schimmer
+49 2152 9696755
+49<PHONE_NUMBER>0
<EMAIL_ADDRESS>Mobile DJs & Eventmanagement
47906 Kempen

I believe all of these issues should be fixed now :)


fix: update version string

Describe your PR, what does it fix/add?
this pr updates version string from 0.10.0 to 0.10.3 and fixes formatting
Is there anything you want to mention? (unchecked code, possible bugs, found problems, breaking compatibility, etc.)
Is it ready for merging, or does it need work?
yes

What the hell is that diff
Please run nix fmt

Updated version with proper formatting in 8feb6f7.


Live response - advanced feature

[Enter feedback here]
According to docs, if the customer selected role as Live response - Advanced, the customer can "Upload a file to the remote device".
But we tried to this feature, when we set only "Live response - Advanced", MDATP's GUI "Upload file to library" is disabled.
So we cannot upload local file to remote device.
Then we added "Managed security settings in Security Center" role, "Upload file to library" button is enabled and we can upload local file to remote device.
I guess this is document bug, because Antonio(anvascon) said this is by design via e-mail.
Could you check this issue and if document bugs, please resolve this issue.
If you have any concerns or questions, please let me konw<EMAIL_ADDRESS>Cheers,
Ayumi

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 6b246db4-2ef2-fc54-8db1-7a75a4974304
Version Independent ID: 57290170-ba72-9f26-5a9c-311f6980ea19
Content: Create and manage roles for role-based access control - Windows security
Content Source: windows/security/threat-protection/microsoft-defender-atp/user-roles.md
Product: w10
GitHub Login: @mjcaparas
Microsoft Alias: macapara

@ayfukumo . Please record video and upload in online storage, paste the link.  So  That MDATP advanced experienced users can give solution.
I am not an expert in this case.

Hi,
I will prepare recoded videos regarding this issue.
Cheers,
Ayumi
From: VARADHARAJAN K<EMAIL_ADDRESS>Sent: Thursday, October 8, 2020 8:51 AM
To: MicrosoftDocs/windows-itpro-docs<EMAIL_ADDRESS>Cc: Ayumi Fukumoto<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [MicrosoftDocs/windows-itpro-docs] Live response - advanced feature (#8421)
@ayfukumohttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fayfukumo&data=04|01|Ayumi.Fukumoto%40microsoft.com|bcb4b8981249419cbd6808d86b1be597|72f988bf86f141af91ab2d7cd011db47|1|0|637377114849731726|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=QOE%2BmtZTx0huxQWgxXd1m2t823rv%2B2hEgXeA43VYaU4%3D&reserved=0 . Please record video and upload in online storage, paste the link. So That MDATP advanced experienced users can give solution.
I am not an expert in this case.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoftDocs%2Fwindows-itpro-docs%2Fissues%2F8421%23issuecomment-705251686&data=04|01|Ayumi.Fukumoto%40microsoft.com|bcb4b8981249419cbd6808d86b1be597|72f988bf86f141af91ab2d7cd011db47|1|0|637377114849741683|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=AZfltFW%2FTY4SfVGb04m%2FVXJVmBJiRz2gNIxugMafJhw%3D&reserved=0, or unsubscribehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAQ7VVDTEW6GWZSXI6NYCEMDSJT5HXANCNFSM4SHCG6HQ&data=04|01|Ayumi.Fukumoto%40microsoft.com|bcb4b8981249419cbd6808d86b1be597|72f988bf86f141af91ab2d7cd011db47|1|0|637377114849741683|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=xmmBYagQBH3NC%2Brwxw1vyhxwsos%2BJBS7TpFhdnM3N%2Bc%3D&reserved=0.

Hi,
My colleague Kei makes record video regarding this issue.
Could you check video from below URL?
[mp4 icon] https://microsoftapc.sharepoint.com/:v:/t/nagano/Edtho16_6oFCnIPjqY2sJ2kBLUdDb4TdPUayUpux5Bq0Sw?e=wyn5xh
Please let me know if you have any concerns or questions.
Cheers,
Ayumi
From: VARADHARAJAN K<EMAIL_ADDRESS>Sent: Thursday, October 8, 2020 8:51 AM
To: MicrosoftDocs/windows-itpro-docs<EMAIL_ADDRESS>Cc: Ayumi Fukumoto<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [MicrosoftDocs/windows-itpro-docs] Live response - advanced feature (#8421)
@ayfukumohttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fayfukumo&data=04|01|Ayumi.Fukumoto%40microsoft.com|bcb4b8981249419cbd6808d86b1be597|72f988bf86f141af91ab2d7cd011db47|1|0|637377114849731726|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=QOE%2BmtZTx0huxQWgxXd1m2t823rv%2B2hEgXeA43VYaU4%3D&reserved=0 . Please record video and upload in online storage, paste the link. So That MDATP advanced experienced users can give solution.
I am not an expert in this case.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoftDocs%2Fwindows-itpro-docs%2Fissues%2F8421%23issuecomment-705251686&data=04|01|Ayumi.Fukumoto%40microsoft.com|bcb4b8981249419cbd6808d86b1be597|72f988bf86f141af91ab2d7cd011db47|1|0|637377114849741683|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=AZfltFW%2FTY4SfVGb04m%2FVXJVmBJiRz2gNIxugMafJhw%3D&reserved=0, or unsubscribehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAQ7VVDTEW6GWZSXI6NYCEMDSJT5HXANCNFSM4SHCG6HQ&data=04|01|Ayumi.Fukumoto%40microsoft.com|bcb4b8981249419cbd6808d86b1be597|72f988bf86f141af91ab2d7cd011db47|1|0|637377114849741683|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=xmmBYagQBH3NC%2Brwxw1vyhxwsos%2BJBS7TpFhdnM3N%2Bc%3D&reserved=0.

Hi,
Could you tell me where is data store for our recorded video?
I tried to compressed but it exceeded to GitHub's limitation.
Cheers,
Ayumi

@ayfukumo . upload the recorded video  to Google drive or one drive and share the link, then paste the link here.
or else upload in YouTube, paste the link

https://1drv.ms/u/s!AgFD4Gly0bpLgbBsnPbhySt6RovwZw?e=J28bvt
Could you download video from above link?

Hello @ayfukumo - Thank you for sharing the details. Looks like I can't access the video from any of the above-mentioned links. I have noted a point when you raise the issue regarding a document that because Antonio(anvascon) said this is by design via e-mail. Can you please forward me that email.
@anvascon - Can you please share your input regarding this so that I can make necessary changes in the document.
Thanks
Imran.

Hi,
Could you try below links?
https://1drv.ms/v/s!AgFD4Gly0bpLgbBtNVjWNKNHQ5brxw?e=q95jdD
Thanks,
Ayumi
From: ImranHabib<EMAIL_ADDRESS>Sent: Thursday, December 31, 2020 9:51 PM
To: MicrosoftDocs/windows-itpro-docs<EMAIL_ADDRESS>Cc: Ayumi Fukumoto<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [MicrosoftDocs/windows-itpro-docs] Live response - advanced feature (#8421)
Hello @ayfukumohttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fayfukumo&data=04|01|Ayumi.Fukumoto%40microsoft.com|a00bdc2c963342840cd408d8ad8ac8e4|72f988bf86f141af91ab2d7cd011db47|1|0|637450158940686517|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=ksGwWmD4mFV94A%2FvK1AznDz82xQd89d0MaF5WWNtZhc%3D&reserved=0 - Thank you for sharing the details. Looks like I can't access the video from any of the above-mentioned links. I have noted a point when you raise the issue regarding a document that because Antonio(anvascon) said this is by design via e-mail. Can you please forward me that email.
@anvasconhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fanvascon&data=04|01|Ayumi.Fukumoto%40microsoft.com|a00bdc2c963342840cd408d8ad8ac8e4|72f988bf86f141af91ab2d7cd011db47|1|0|637450158940686517|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=kwJZg2kibxQr3BvSMXsbv44FD%2FCDrla9giw%2FTbvMJGU%3D&reserved=0 - Can you please share your input regarding this so that I can make necessary changes in the document.
Thanks
Imran.

You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoftDocs%2Fwindows-itpro-docs%2Fissues%2F8421%23issuecomment-752951553&data=04|01|Ayumi.Fukumoto%40microsoft.com|a00bdc2c963342840cd408d8ad8ac8e4|72f988bf86f141af91ab2d7cd011db47|1|0|637450158940696512|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=dh%2B%2F7pI4OtBqYtq4KGwP0DxTZjFFMsMecP3M6J5wDE4%3D&reserved=0, or unsubscribehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAQ7VVDWHOFC4AKIJG556MWTSXRXU3ANCNFSM4SHCG6HQ&data=04|01|Ayumi.Fukumoto%40microsoft.com|a00bdc2c963342840cd408d8ad8ac8e4|72f988bf86f141af91ab2d7cd011db47|1|0|637450158940696512|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=AU8qu3bwjphrEex5rGaqKtxLkjru8z1b9ghf5aR1Qy8%3D&reserved=0.

Hi,
Could you try below links?
https://1drv.ms/v/s!AgFD4Gly0bpLgbBtNVjWNKNHQ5brxw?e=q95jdD
Thanks,
Ayumi
From: ImranHabib<EMAIL_ADDRESS>Sent: Thursday, December 31, 2020 9:51 PM
To: MicrosoftDocs/windows-itpro-docs<EMAIL_ADDRESS>Cc: Ayumi Fukumoto<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [MicrosoftDocs/windows-itpro-docs] Live response - advanced feature (#8421)
Hello @ayfukumohttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fayfukumo&data=04|01|Ayumi.Fukumoto%40microsoft.com|a00bdc2c963342840cd408d8ad8ac8e4|72f988bf86f141af91ab2d7cd011db47|1|0|637450158940686517|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=ksGwWmD4mFV94A%2FvK1AznDz82xQd89d0MaF5WWNtZhc%3D&reserved=0 - Thank you for sharing the details. Looks like I can't access the video from any of the above-mentioned links. I have noted a point when you raise the issue regarding a document that because Antonio(anvascon) said this is by design via e-mail. Can you please forward me that email.
@anvasconhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fanvascon&data=04|01|Ayumi.Fukumoto%40microsoft.com|a00bdc2c963342840cd408d8ad8ac8e4|72f988bf86f141af91ab2d7cd011db47|1|0|637450158940686517|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=kwJZg2kibxQr3BvSMXsbv44FD%2FCDrla9giw%2FTbvMJGU%3D&reserved=0 - Can you please share your input regarding this so that I can make necessary changes in the document.
Thanks
Imran.

You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoftDocs%2Fwindows-itpro-docs%2Fissues%2F8421%23issuecomment-752951553&data=04|01|Ayumi.Fukumoto%40microsoft.com|a00bdc2c963342840cd408d8ad8ac8e4|72f988bf86f141af91ab2d7cd011db47|1|0|637450158940696512|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=dh%2B%2F7pI4OtBqYtq4KGwP0DxTZjFFMsMecP3M6J5wDE4%3D&reserved=0, or unsubscribehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAQ7VVDWHOFC4AKIJG556MWTSXRXU3ANCNFSM4SHCG6HQ&data=04|01|Ayumi.Fukumoto%40microsoft.com|a00bdc2c963342840cd408d8ad8ac8e4|72f988bf86f141af91ab2d7cd011db47|1|0|637450158940696512|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=AU8qu3bwjphrEex5rGaqKtxLkjru8z1b9ghf5aR1Qy8%3D&reserved=0.

Thanks, @ayfukumo - I have seen the video and what I have found is that you have selected Live Response Capabilities as "Basic" when the upload file was grayed out. In your query, you have mentioned that when you have selected Live Response as "Advance" it was grayed out. Whereas, when the upload file was grayed out or available, the only change that happened was Manage security settings from the security center option was not checked.

Whereas in the document it is listed to use the advance option for the file upload option.

Thanks, @ayfukumo - I have seen the video and what I have found is that you have selected Live Response Capabilities as "Basic" when the upload file was grayed out. In your query, you have mentioned that when you have selected Live Response as "Advance" it was grayed out. Whereas, when the upload file was grayed out or available, the only change that happened was Manage security settings from the security center option was not checked.

Whereas in the document it is listed to use the advance option for the file upload option.


BadElfAnalysis classification as PopulationAnalysis

similar to how bader is a population-analysis type, I think badelf workflows should be too

@jacksund I'm fine with this, but I think we should change the population-analysis table so that it doesn't inherit from the static-energy table. I think in most use cases the users looking for BadELF will have already run the DFT calculation. Thoughts?

yep we can do this. we can have it inherit from Structure instead of StaticEnergy -- or even have PopulationAnalysis as its own basic mix-in class. I'm sure there are population analyses out there that don't involve a static energy calc (maybe like ML predictions).
The counter argument is that the static energy fields are optional and only there if you need them. So at worst there are just empty columns if the user already ran their dft calculation. Still, we'll likely simplify the table like you suggested


perlPackages.GSSAPI: depend on krb5Full, fix misspelling

Motivation for this change
Updated GSSAPI to depend upon MIT krb5 rather than heimdal. I expect this
is safe as I only submitted the PR to add the GSSAPI module a few weeks back.
Also corrected a misspelling in the package name and updated the fetchurl
to match the convention employed by nix-generate-from-cpan.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option build-use-sandbox in nix.conf on non-NixOS)
Built on platform(s)

[X] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[X] Tested execution of all binary files (usually in ./result/bin/)
[X] Fits CONTRIBUTING.md.

also backported to 18.03.


Functional visitor

This PR was originally made in https://github.com/timowest/scalagen/pull/84
I've dug much deeper than I initially planned and made quite some changes to scalagen, but I hope they pay off:

I replaced the Maven build by an SBT one which gives much nicer compilation speed and other goodies and is the de facto standard for most Scala projects.
I transformed the statefull ScalaDumpVisitor into a stateless ScalaStringVisitor which instead of modifying a local SourcePrinter returns Strings in all visit methods.
Formatting is now handled by Scalafmt which gives much more flexibility on how to format code and reduces the complexity of scalagen a little.
The Java parser library is updated to a version that supports Java 8 and the corresponding visit methods implemented, so we should be able to transform Java 8 code (most likely there's some bugs in there, which we can fix as we discover them)
Comments are copied as good as possible. There's still some edge cases where they can get lost, especially when multiple comments occur in a row.

It would be great if you could have a look at this so we can start discussing on how to integrate and release this. If I have time, I'll publish a build on Bintray so that people can already start trying this out and finding bugs :wink:
Phew, that was a journey! :smile:

Sorry, I wanted to point this against the new repo...


wpsoffice: don't need wrapGAppsHook nor wrapQtAppsHook & use autoPatchelfIgnoreMissingDeps

Description of changes
wrapGAppsHook and wrapQtAppsHook should not be necessary for wpsoffice

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

It seems that the extra dependencies introduced in this PR is caused by the removed postUnpack hook. Is the postUnpack hook causing any problems? Because if postUnpack just works, bothering adding these dependencies might be not necessary.

It seems that the extra dependencies introduced in this PR is caused by the removed postUnpack hook. Is the postUnpack hook causing any problems? Because if postUnpack just works, bothering adding these dependencies might be not necessary.

They are propagated build dependencies  introduced by  wrapGAppsHook and wrapQtAppsHook
Only  xorg.libXv  caused by the removed postUnpack, to fix libpdfbatchcompressionapp.so we previously removed
0293e7f (#232244)

$ nix build nixpkgs/c839521d172f2bf656c3f8a3e66faa786fb07878#wpsoffice --impure -L
wpsoffice> qtPreHook
wpsoffice> Error: wrapQtAppsHook is not used, and dontWrapQtApps is not set.
error: builder for '/nix/store/2chqcmn12r3w8d187lknky6wk0bqca5a-wpsoffice-<IP_ADDRESS>98.drv' failed with exit code 1;
       last 2 log lines:
       > qtPreHook
       > Error: wrapQtAppsHook is not used, and dontWrapQtApps is not set.
       For full logs, run 'nix log /nix/store/2chqcmn12r3w8d187lknky6wk0bqca5a-wpsoffice-<IP_ADDRESS>98.drv'.

It doesn't build currently. If you don't think it is ok now, better to convert to draft pr.

forgot to test :( https://github.com/NixOS/nixpkgs/compare/21dee4c7115f1f8d8b7d0dac4ec20ea73eaa2599..0293e7f20dee19e0f9a694783f8adf449539d770
 dontWrapGApps = true; is still needed because qtbase is one of buildInputs

I tried removing  libxslt, gdk-pixbuf, xorg.libXrandr, xorg.libXcomposite, cups and pango from buildInputs, and it build successfully and works well under my basic tests. Are they necessary for some reason?

I tried removing libxslt, gdk-pixbuf, xorg.libXrandr, xorg.libXcomposite, cups and pango from buildInputs, and it builds successfully and works well under my basic tests. Are they necessary for some reason?

They are determined to be required by autoPatchelfHook，it should be other dependencies (probability is qtbase and gtk3
) propagate them，so they are still in the build environment while removed from buildInputs
I'm not against removing them but keeping them should be ok

From my opinionated perspective, the clean way is either listing all dependencies regardless of the propagated ones, or listing the minimal set of dependencies needed. The former approach is hard to verify so I would prefer the later approach. Anyway this is not a strict requirement so if you are satisfied with it, I will approve later.


PT Run focus issue with browser

Microsoft PowerToys version
0.35.0
Running as admin
Yes
Area(s) with issue?
PowerToys Run
Other Software
No response
Steps to reproduce
Open  webpage.(In my case it happened to be the github page )
Click on the github search bar text field.
Click out of it anywhere on the webpage without scrolling down.  //The bug happens even if you dont do this.
Press the shortcut to open power toys run while
Then start typing.
✔ Expected Behavior
The typed text appears in the powertoys run text field.
❌ Actual Behavior
The text appears in the browsers top search text field.

I can't repro this via Edge.  Can you maybe do a recording with like, screentogif?

Here is a link of the video recording:
https://imgur.com/IyqK3mC
In the video, the first time I bring up PT Run it works as intended. But the second and third time it demonstrates the problem.
Also this has happened randomly to me even when using it on the desktop.
It works sometimes as intended but the behavior is inconsistant.

@rp1231, I kinda see what is happening but can't seem to repro on at least Edge.  I do notice a weird flash for the search box.

What browser are you on?
Can you help fill this out to be hyper targeted on the repro since i can't reproduce it?

open this bug in new browser instance
go to search in Github via mouse
Type something
Click 10531 (won't repro unless you do this clicking step WITHOUT scrolling)
Alt-Space to open PT Run
type in PT Run

@crutkas
I am using Brave browser.
I'm afraid I don't understand what you want me to fill (Do you mean the steps 1-6 mentioned above?)
Also in the steps you have mentioned,
I don't understand step number 4 where you say I have to click 10531.
Sorry I'm not a dev so I might not understand all the terms that you are using.
From what little I understood from google repro means reproducing the error?

I did the steps 1)-6) mentioned above and I was able to reproduce the bug multiple times.
Though some times it does work as intended.
For step number 4) I clicked on the white space in the browser without scrolling.
(Not sure what the 10531 means)

Also this focus issue happens intermittently even when not using the browser so it might not be related to the browser at all.
I came across another thread in the issues section in which the same issue has been reported by other people as well.

This issue has been open for a while and there have been lots of improvements since then! I'm on 0.47.0 and I can't reproduce this issue, could you please update to the latest and see if this issue still repros? Thanks!

I've changed browsers since then,
So don't know if it was browser specific.
And had stopped using the run feature since I was encountering bugs.
I have updated to the latest version and don't seem to be encountering the issue for now on opera.
Closing the issue, but will reopen if I face it again.


Introduce warning if membership term is not one year

Currently there are no constraints on length of membership term, allowing typos like this for what should be a full year membership.

If the membership term != 1 year then the user should get a warning and be asked if they want to continue.

A few more notes on fixes needed - it appears to automatically populate membership start date and end date as today, and allows for end date to be before start date.

Required changes:

automatically populate membership end date as today+1yr
display warning if the selected end date is not (start date + 1yr)

Question (in both cases): should the "+1yr" be understood as the same date with next year (ie. March 20, 2021 -> March 20, 2022), or 365 days (ie. March 20, 2021 -> March 19, 2022)?

Required changes:

automatically populate membership end date as today+1yr
display warning if the selected end date is not (start date + 1yr)

Question (in both cases): should the "+1yr" be understood as the same date with next year (ie. March 20, 2021 -> March 20, 2022), or 365 days (ie. March 20, 2021 -> March 19, 2022)?

@ErinBecker I know we typically don't hold people down to the exact day, but for the purposes of this workflow, could you answer question 1 above?
Question 2 - The warning should be displayed on the new membership form.

@ErinBecker I know we typically don't hold people down to the exact day, but for the purposes of this workflow, could you answer question 1 above?
Question 2 - The warning should be displayed on the new membership form.

@pbanaszkiewicz  I don't want this question to hold you back.  Let's go with same date the following year (March 20, 2021 -> March 20, 2022).

@pbanaszkiewicz  I don't want this question to hold you back.  Let's go with same date the following year (March 20, 2021 -> March 20, 2022).


can't read parameters.yml on version 2.3.21

I get the following error while trying to update using composer or trying to clear cache:
PHP Warning:  file_get_contents(ROOT/apps/app_name/config/parameters.yml): failed to open stream: No such file or directory in /ROOT/vendor/sensio/distribution-bundle/Sensio/Bundle/DistributionBundle/Configurator/Configurator.php on line 165

Whenever i change back to version 2.3.20 it works again.
Our parameters.yml is located at ROOT/apps/config/parameters.yml

It has been fixed, but I forgot to release a new version. Done now.


[Bug] OTC / Proctored fields: Invalid device_id matches to otc N value.

Describe the bug
1 bug found during Otc/proctored field functional testing
https://github.com/CDCgov/prime-reportstream/pull/1238
When a receiver has a quality filter with matcher having rule has otc set to N e.g qualityFilter: [ "matches(test_authorized_for_otc, N)" ] and device_id is not in the mapping lookup, receiver receives this data.
Impact
impact is low to medium
To Reproduce
Steps to reproduce the behavior:

Use the attached organization-local.yaml and replace the local yaml. Re-start the settings container for the new settings to be applied on the prime-router. docker compose restart settings
run the above curl command for each request

curl -X POST   -H 'client: waters'     -H 'Content-Type: text/csv'       --data-binary<EMAIL_ADDRESS>   'http://localhost:7071/api/reports'

actual

 "destinations" : [ {
    "organization" : "reference_all",
    "organization_id" : "reference_all",
    "service" : "reference_all",
    "sending_at" : "2021-07-06T14:41-04:00",
    "itemCount" : 1
  }, {
    "organization" : "Qreceiver_otcN",
    "organization_id" : "Qreceiver_otcN",
    "service" : "Qreceiver_otcN",
    "sending_at" : "2021-07-06T14:41-04:00",
    "itemCount" : 1
  } ]```
4. expected - for invalid device id, I expect data to be received by reference_all org only & not by Qreceiver_otcN
**Expected behavior**

**Screenshots**
If applicable, add screenshots to help explain your problem.

[https://app.zenhub.com/files/304423150/0c713826-fc49-4975-bfc4-179b1f413a04/download](https://app.zenhub.com/files/304423150/0c713826-fc49-4975-bfc4-179b1f413a04/download)![Screen Shot 2021-07-06 at 2.43.13 PM.png](https://images.zenhubusercontent.com/60d4a9caade8db8307dd798a/aaa59edb-8c3e-44de-946e-d45ffc2ad283)

Another way to reproduce this bug is:

Go to editor.swagger.io
Open the openap.yml file in their editor
https://raw.githubusercontent.com/CDCgov/prime-reportstream/master/prime-router/docs/openapi.yml
Result: the swagger editor reports two errors with the api:

Structural error at components.schemas.Destination.properties.sending_at.type should be equal to one of the allowed values allowedValues: array, boolean, integer, number, object, string
Line 548
Semantic error at components.schemas.Receiver.properties.translations.items.anyOf.2.$ref
$refs must reference a valid location in the document
Line 716

@TomNUSDS - is your comment on the right ticket? - it seems unrelated to this ticket (which we are planning to close, as @carlosfelix2 is reworking the is_otc feature anyway)

@jimduff-usds You're right, it does seem unrelated. I probably just put a comment on the wrong open tab.


Silent crashes in the middle of long downloads?

Hello,
I'm attempting a large download of an entire archive, 16,000 images. I've had two completely silent, apparently error-free program "crashes" that may or may not have been actual crashes, but it just quit part way through the download.
I'm retrying in admin mode and windows 7 compatibility mode. The computer in question is quite stable and hasn't been giving me any trouble. The internet connection is hard-wired and 300Mbit, although it appears to be all over the place and averaging 20 mbit, throttled on Flickr's end.
I'd love to be more helpful, but the logs look to be pretty sparse, and I walk back to the computer and I just don't see anything.
Can I start the program in a verbose mode?
<log4j:event logger="FloydPink.Flickr.Downloadr.UI.MainClass" timestamp="1533151813730" level="INFO" thread="1"><log4j:message>Application Start.</log4j:message><log4j:properties><log4j:data name="log4jmachinename" value="Andrew-PC" /><log4j:data name="log4japp" value="flickr-downloadr.exe" /><log4j:data name="log4net:Identity" value="" /><log4j:data name="log4net:UserName" value="ANDREW-PC\Andrew" /><log4j:data name="log4net:HostName" value="Andrew-PC" /></log4j:properties><log4j:locationInfo class="FloydPink.Flickr.Downloadr.UI.MainClass" method="Main" file="" line="0" /></log4j:event>
<log4j:event logger="FloydPink.Flickr.Downloadr.UI.MainClass" timestamp="1533151813757" level="INFO" thread="1"><log4j:message>Found GTK# version 2.12.26</log4j:message><log4j:properties><log4j:data name="log4jmachinename" value="Andrew-PC" /><log4j:data name="log4japp" value="flickr-downloadr.exe" /><log4j:data name="log4net:Identity" value="" /><log4j:data name="log4net:UserName" value="ANDREW-PC\Andrew" /><log4j:data name="log4net:HostName" value="Andrew-PC" /></log4j:properties><log4j:locationInfo class="FloydPink.Flickr.Downloadr.UI.MainClass" method="CheckWindowsGtk" file="" line="0" /></log4j:event>
<log4j:event logger="FloydPink.Flickr.Downloadr.UI.MainClass" timestamp="1533151824186" level="INFO" thread="1"><log4j:message>Application Exit.</log4j:message><log4j:properties><log4j:data name="log4jmachinename" value="Andrew-PC" /><log4j:data name="log4japp" value="flickr-downloadr.exe" /><log4j:data name="log4net:Identity" value="" /><log4j:data name="log4net:UserName" value="ANDREW-PC\Andrew" /><log4j:data name="log4net:HostName" value="Andrew-PC" /></log4j:properties><log4j:locationInfo class="FloydPink.Flickr.Downloadr.UI.MainClass" method="Quit" file="" line="0" /></log4j:event>

The Preferences window allows to changing the log level (as detailed here: https://github.com/flickr-downloadr/flickr-downloadr-gtk/issues/50#issuecomment-292722777)

I was having this happen, and figured out (eventually) that it was a really long filename causing it.  I tried the image in question by itself and it caused the same silent crash.  I renamed it, and moved the name to the description and it was fine then.  However, the really annoying part is that you have no idea when it's stopped!  I was lucky with this one, that it was at the start of the download.  (I've been doing it album by album).  It would be awesome if there was a way to skip long filenames and produce a list at the end, for you to download manually.

@wiccked - which OS are you on?
Also, could you please share the length of the name for the failing photo along with the length of the full path to the download folder?

windows10,
The filename was originally "This little dog has been into the creek three times!  The first time she walked in- because I was in there, the next two times she jumped in! Because I was still in there ;) very cute little miss."
the path was "E:\My Pictures\Photos\flickr\flickr-downloadr-[Sunshine Coast]-2018-11-17_16-27-45"


UX analysis of Klientdelegering

We need the analysis below for all the individual components in the panel "Klientdelegering" except for Toggle Button and the List. See pictures below to see the Klientdelegering.

Description
Simple description of component
Figma
Link to correct placement in our Figma component library.

[x] Check if there are similar components/variants from Altinn 2, Altinn Studio or Altinn 3 that need to be considered.
[x] Are there any WCAG issues with the component
[x] Component is created in Figma
[ ] All relevant states are created
[ ] Functionality/animation is described and prototyped

Tokens

[ ] The size is described with tokens
[ ] spacing is described with tokens
[ ] The color of all states are described with tokens
[ ] Border width or styling is described with tokens
[ ] Text size are described with tokens

Replace with size tokens

Replace with padding

Replace with colors

Replace with border width

Replace with text

SVG

[x] If there are used any svgs in this component is it available for the developer?

Beskrivelse for forsiden på klientdelegering når klienter er valgt.

Her er alle skissene samlet under overskriften klientdelegering: https://www.figma.com/file/ESobgAq072y7eQa4gP1JCKER/Profil?node-id=4289%3A109483


Multiply matrix in java

A program to multiply two matrix in java.
I am a GSSOC'21 participant, and I would like to contribute the Java code for this problem. I will make sure that the code is commented properly and follows all the given guidelines. Please give me this opportunity. Thankyou!
@tarun26091999

already present at #86


[improve] Upgrade to zk 3.8.1

Motivation
Upgrade to zk 3.8.1
Release notes: https://zookeeper.apache.org/doc/r3.8.1/releasenotes.html
Among other changes it includes improvement to "Reduce the performance impact of Prometheus metrics".
Modifications
ZK upgrade
Verifying this change

[ ] Make sure that the change passes the CI checks.

This change is a trivial rework / code cleanup without any test coverage.
Does this pull request potentially affect one of the following parts:

If the box was checked, please highlight the changes

[x] Dependencies (add or upgrade a dependency)
[ ] The public API
[ ] The schema
[ ] The default values of configurations
[ ] The threading model
[ ] The binary protocol
[ ] The REST endpoints
[ ] The admin CLI options
[ ] The metrics
[ ] Anything that affects deployment

Documentation

[ ] doc
[ ] doc-required
[x] doc-not-needed
[ ] doc-complete

Matching PR in forked repository
PR in forked repository: https://github.com/dlg99/pulsar/pull/8

This PR should be cherry-picked to patch the release branch, so I removed the tag release/2.9.5 and release/2.10.4.  This PR has been cherry-picked to branch-2.10, Please push another PR to revert this cherry-pick @liangyepianzhou. cc/ @codelipenghui

@lhotari I noticed you have added release/2.9.5 release/2.10.4` labels, do you have any context about it? Just to make sure we will not miss critical fixes in the next release (2.10.5)


Skip nvdisasm test on win64

for a problem that is unique to the Anaconda buildfarm.
For now, we skip all win64 testing since we don't want it to hold up the release.
Optionally, we can just not run the win64-gpu worker given all its other problem.

numba_smoketest_cuda_yaml_230 has 3 passing builds (other are failing since the DAG has not been fully adapted for the current dependency)

We will opt to skip win64-gpu testing instead of skipping the test.


[SPARK-17587][PYTHON][MLLIB] SparseVector getitem should follow getitem contract

What changes were proposed in this pull request?
Replaces ValueError with IndexError when index passed to ml / mllib SparseVector.__getitem__ is out of range. This ensures correct iteration behavior.
Replaces ValueError with IndexError for DenseMatrix and SparkMatrix in ml / mllib.
How was this patch tested?
PySpark ml / mllib unit tests. Additional unit tests to prove that the problem has been resolved.

Test build #65582 has started for PR 15144 at commit 4b90ee5.

Test build #65582 has finished for PR 15144 at commit 4b90ee5.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65582/
Test PASSed.

LGTM!

It looks like SparseMatrix also raises a ValueError.  Can you fix that here also?

Test build #65608 has started for PR 15144 at commit 4162b06.

@BryanCutler Sure, here you are. Actually both Sparse and Dense had to be fixed.
Note: Technically speaking this can is a breaking change if someone expects ValueError.
On a side note it would be nice to support slice and iteration over rows as well but I still hope there is a chance for doing something with SPARK-16626.

Test build #65608 has finished for PR 15144 at commit 4162b06.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65608/
Test PASSed.

test this please

Test build #66292 has started for PR 15144 at commit 4162b06.

Test build #66292 has finished for PR 15144 at commit 4162b06.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66292/
Test PASSed.

LGTM, merging with master and branch-2.0
Thank you @zero323 for the PR and @BryanCutler for reviewing !


Increase minimum netstandard support to v1.3

Increases the minimum netstandard target to v1.3

Ready for review.


DSA key support

I am using a key generated from https://pgptool.github.io/ with a password.
When I tried to use it with $encrypted = \OpenPGP_Crypt_Symmetric::encrypt($key,new OpenPGP_Message(array($data)));
I got "Only RSA keys are supported."

After some research, so OpenPGP-php does not support DSA keys...

I just ran into this also.


bbox_loss is always zero when I train R-FCN with OHEM

when i train a R-FCN t with OHEM----rfcn_end2end_ohem.sh, I get loss_bbox = 0 (* 1 = 0 loss) from the very beginning. However, when i train the verision without OHEM, everything is ok and i got a MAP of 0.78. So i'm sure there is nothing to do with my data annotation. WHAT else can cause this?

#85 Here i get the solution!


Fix kl

Describe your changes

Enhance KullbackLeibler implementation. Wrap 2 backends (numpy/numba) with different classes

Describe any testing you have performed
Please add any demo scripts to CIL-Demos/misc/

Create unittests for numpy/numba using CIL and SIRF datacontainers

Link relevant issues
#1271, #1270 #1269
Checklist when you are ready to request a review

[x] I have performed a self-review of my code
[x] I have added docstrings in line with the guidance in the developer guide
[x] I have implemented unit tests that cover any new or modified functionality
[ ] CHANGELOG.md has been updated with any functionality change
[x] Request review from all relevant developers
[x] Change pull request label to 'Waiting for review'

Contribution Notes
Please read and adhere to the developer guide and local patterns and conventions.

[x] The content of this Pull Request (the Contribution) is intentionally submitted for inclusion in CIL (the Work) under the terms and conditions of the Apache-2.0 License.

if should_return:
    return out

Update all the methods with the above suggestion.


Unable to load configuration, please open an issue on GitHub: OpenVR Init Error

Hello everyone :)
Loading the firmware on the ESP32 worked as planned, but as soon as I started "open gloves" on steam, I got the error message written in the title. Serial and BT connection both result in the same error.

Just to check, you got SteamVR installed and running, yes?

yes it is running

You'll also need to make sure that you have a headset connected. Do you have one connected?

Awesome, thank you very much! I did not know I needed to connect a headset.

Great, no problem. Going to close this now but feel free to reach out if you have any other problems.


Infinite loop

Hello, I have run the following command:
nvidia-docker run --rm -v $(pwd):/images albarji/neural-style --content a.jpg --style starry_night.jpg
INFO:__main__:Running neural style transfer with
INFO:__main__:	Contents = ['/images/a.jpg']
INFO:__main__:	Style = ['/images/starry_night.jpg']
INFO:__main__:	Algorithm = gatys
INFO:__main__:	Style weights = None
INFO:__main__:	Style scales = None
INFO:__main__:	Size = None
INFO:__main__:	Tile overlap = None
WARNING:neuralstyle.algorithms:Unknown GPU model GeForce GT 740M, will use default tiling parameters
INFO:neuralstyle.algorithms:Starting tiling strategy

But I noticed that even after an hour, I just keep getting the same snippet below again and again. What am I doing wrong? Thanks.
Capturing style target 1
Running optimization with L-BFGS
<optim.lbfgs> 	creating recyclable direction/step/history buffers
Iteration 50 / 500
  Content 1 loss: 29657681.250000
  Style 1 loss:<PHONE_NUMBER>50
  Style 2 loss: 1487927.246094
  Style 3 loss:<PHONE_NUMBER>12
  Style 4 loss: 1219033.325195
  Style 5 loss: 1532.736421
  Total loss: 32701008.954072
Iteration 100 / 500
  Content 1 loss: 31124437.500000
  Style 1 loss: 94640.571594
  Style 2 loss: 1027202.392578
  Style 3 loss:<PHONE_NUMBER>94
  Style 4 loss:<PHONE_NUMBER>29
  Style 5 loss: 1136.814833
  Total loss: 32932743.099928
Iteration 150 / 500
  Content 1 loss: 31253296.875000
  Style 1 loss: 76798.995972
  Style 2 loss:<PHONE_NUMBER>39
  Style 3 loss: 87324.279785
  Style 4 loss:<PHONE_NUMBER>27
  Style 5 loss: 1016.887546
  Total loss: 32776410.243869
Iteration 200 / 500
  Content 1 loss: 31234756.250000
  Style 1 loss: 64344.253540
  Style 2 loss:<PHONE_NUMBER>01
  Style 3 loss: 73042.816162
  Style 4 loss:<PHONE_NUMBER>55
  Style 5 loss: 952.963293
  Total loss: 32626714.782751
Iteration 250 / 500
  Content 1 loss: 31371515.625000
  Style 1 loss: 53600.486755
  Style 2 loss:<PHONE_NUMBER>40
  Style 3 loss: 61470.520020
  Style 4 loss:<PHONE_NUMBER>15
  Style 5 loss: 912.382960
  Total loss: 32594982.443690
Iteration 300 / 500
  Content 1 loss:<PHONE_NUMBER>3600.000000
  Style 1 loss:<PHONE_NUMBER>81792000.000000
  Style 2 loss:<PHONE_NUMBER>46813952000.000000
  Style 3 loss:<PHONE_NUMBER>3832192000.000000
  Style 4 loss:<PHONE_NUMBER>692998144000.000000
  Style 5 loss:<PHONE_NUMBER>2208000.000000
  Total loss:<PHONE_NUMBER>130488979456.000000
Iteration 350 / 500
  Content 1 loss: 53824475.000000
  Style 1 loss:<PHONE_NUMBER>12
  Style 2 loss: 4403482.910156
  Style 3 loss: 1467386.352539
  Style 4 loss: 34660351.562500
  Style 5 loss: 6897.786140
  Total loss: 94648168.806648
Iteration 400 / 500
  Content 1 loss: 44946846.875000
  Style 1 loss: 50263.446808
  Style 2 loss:<PHONE_NUMBER>83
  Style 3 loss: 98170.982361
  Style 4 loss:<PHONE_NUMBER>37
  Style 5 loss: 1197.893023
  Total loss: 46334840.342212
Iteration 450 / 500
  Content 1 loss: 42118831.250000
  Style 1 loss: 32140.338898
  Style 2 loss:<PHONE_NUMBER>00
  Style 3 loss: 62662.532806
  Style 4 loss:<PHONE_NUMBER>76
  Style 5 loss: 934.317052
  Total loss: 43148467.181432
Iteration 500 / 500
  Content 1 loss: 40941896.875000
  Style 1 loss: 24490.972519
  Style 2 loss:<PHONE_NUMBER>63
  Style 3 loss: 50130.981445
  Style 4 loss:<PHONE_NUMBER>76
  Style 5 loss: 837.709486
  Total loss: 41861482.301390
<optim.lbfgs> 	reached max number of iterations
INFO:neuralstyle.algorithms:Running command: cd /app/neural-style; th neural_style.lua -backend cudnn -cudnn_autotune -normalize_gradients -init image -content_weight 100 -save_iter 10000 -proto_file /app/neural-style/models/VGG_ILSVRC_19_layers_deploy.prototxt -model_file /app/neural-style/models/VGG_ILSVRC_19_layers.caffemodel -num_iterations 500 -content_image /tmp/tmpw8hhbycw/rgb.png -style_image /tmp/tmpw8hhbycw/style.png -style_weight 500.0 -style_scale 1.0 -output_image /tmp/tmpzst_vto1.png -image_size 474
tput: No value for $TERM and no -T specified
[libprotobuf WARNING google/protobuf/io/coded_stream.cc:537] Reading dangerously large protocol message.  If the message turns out to be larger than<PHONE_NUMBER> bytes, parsing will be halted for security reasons.  To increase the limit (or to disable these warnings), see CodedInputStream::SetTotalBytesLimit() in google/protobuf/io/coded_stream.h.
[libprotobuf WARNING google/protobuf/io/coded_stream.cc:78] The total number of bytes read was 574671192
Successfully loaded /app/neural-style/models/VGG_ILSVRC_19_layers.caffemodel
conv1_1: 64 3 3 3
conv1_2: 64 64 3 3
conv2_1: 128 64 3 3
conv2_2: 128 128 3 3
conv3_1: 256 128 3 3
conv3_2: 256 256 3 3
conv3_3: 256 256 3 3
conv3_4: 256 256 3 3
conv4_1: 512 256 3 3
conv4_2: 512 512 3 3
conv4_3: 512 512 3 3
conv4_4: 512 512 3 3
conv5_1: 512 512 3 3
conv5_2: 512 512 3 3
conv5_3: 512 512 3 3
conv5_4: 512 512 3 3
fc6: 1 1 25088 4096
fc7: 1 1 4096 4096
fc8: 1 1 4096 1000
Setting up style layer  	2	:	relu1_1
Setting up style layer  	7	:	relu2_1
Setting up style layer  	12	:	relu3_1
Setting up style layer  	21	:	relu4_1
Setting up content layer	23	:	relu4_2
Setting up style layer  	30	:	relu5_1
Capturing content targets
nn.Sequential {
  [input -> (1) -> (2) -> (3) -> (4) -> (5) -> (6) -> (7) -> (8) -> (9) -> (10) -> (11) -> (12) -> (13) -> (14) -> (15) -> (16) -> (17) -> (18) -> (19) -> (20) -> (21) -> (22) -> (23) -> (24) -> (25) -> (26) -> (27) -> (28) -> (29) -> (30) -> (31) -> (32) -> (33) -> (34) -> (35) -> (36) -> (37) -> output]
  (1): nn.TVLoss
  (2): cudnn.SpatialConvolution(3 -> 64, 3x3, 1,1, 1,1)
  (3): cudnn.ReLU
  (4): nn.StyleLoss
  (5): cudnn.SpatialConvolution(64 -> 64, 3x3, 1,1, 1,1)
  (6): cudnn.ReLU
  (7): cudnn.SpatialMaxPooling(2x2, 2,2)
  (8): cudnn.SpatialConvolution(64 -> 128, 3x3, 1,1, 1,1)
  (9): cudnn.ReLU
  (10): nn.StyleLoss
  (11): cudnn.SpatialConvolution(128 -> 128, 3x3, 1,1, 1,1)
  (12): cudnn.ReLU
  (13): cudnn.SpatialMaxPooling(2x2, 2,2)
  (14): cudnn.SpatialConvolution(128 -> 256, 3x3, 1,1, 1,1)
  (15): cudnn.ReLU
  (16): nn.StyleLoss
  (17): cudnn.SpatialConvolution(256 -> 256, 3x3, 1,1, 1,1)
  (18): cudnn.ReLU
  (19): cudnn.SpatialConvolution(256 -> 256, 3x3, 1,1, 1,1)
  (20): cudnn.ReLU
  (21): cudnn.SpatialConvolution(256 -> 256, 3x3, 1,1, 1,1)
  (22): cudnn.ReLU
  (23): cudnn.SpatialMaxPooling(2x2, 2,2)
  (24): cudnn.SpatialConvolution(256 -> 512, 3x3, 1,1, 1,1)
  (25): cudnn.ReLU
  (26): nn.StyleLoss
  (27): cudnn.SpatialConvolution(512 -> 512, 3x3, 1,1, 1,1)
  (28): cudnn.ReLU
  (29): nn.ContentLoss
  (30): cudnn.SpatialConvolution(512 -> 512, 3x3, 1,1, 1,1)
  (31): cudnn.ReLU
  (32): cudnn.SpatialConvolution(512 -> 512, 3x3, 1,1, 1,1)
  (33): cudnn.ReLU
  (34): cudnn.SpatialMaxPooling(2x2, 2,2)
  (35): cudnn.SpatialConvolution(512 -> 512, 3x3, 1,1, 1,1)
  (36): cudnn.ReLU
  (37): nn.StyleLoss
}

Hi there! You are probably not doing anything wrong... it's just the algorithm is quite slow.
Since you are using a GPU model that the code wasn't prepared for, it's using some pretty conservative tiling parameters. So probably your image is being split into many small tiles, and the style transfer algorithm is being run over each one of those tiles.
I would recommend trying again with a smaller image and see if everything works out. If it does, then you know the algorithm is working fine, you will just need to wait longer for the larger image.

It indeed was just slow. :) It may have occurred to me that processing two 4K images is not going to perform well. (: Thank you.


Add morph target names to gltf serializer

By convention, GLTF includes moph target names in the "extras" field of the mesh. This PR adds the corresponding data to the serialized GLTF.
https://github.com/KhronosGroup/glTF/issues/1036

Please make sure to label your PR with "bug", "new feature" or "breaking change" label(s).
To prevent this PR from going to the changelog marked it with the "skip changelog" label.

Snapshot stored with reference name:
refs/pull/14329/merge
Test environment:
https://babylonsnapshots.z22.web.core.windows.net/refs/pull/14329/merge/index.html
To test a playground add it to the URL, for example:
https://babylonsnapshots.z22.web.core.windows.net/refs/pull/14329/merge/index.html#WGZLGJ#4600
Links to test babylon tools with this snapshot:
https://playground.babylonjs.com/?snapshot=refs/pull/14329/merge
https://sandbox.babylonjs.com/?snapshot=refs/pull/14329/merge
https://gui.babylonjs.com/?snapshot=refs/pull/14329/merge
https://nme.babylonjs.com/?snapshot=refs/pull/14329/merge
To test the snapshot in the playground with a playground ID add it after the snapshot query string:
https://playground.babylonjs.com/?snapshot=refs/pull/14329/merge#BCU1XR#0


Update MD file on new branch 2017-12-11_13-40-20

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

split/updateTestCon1.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Take ownership of my Snap package build repository

In https://github.com/diddledan/powershell-snap I have worked with @TravisEz13 to scaffold a working Snap package build based on Snapcraft and Docker build processes. Can you review and take ownership or propose alternative way of proceeding.

@diddledan Do you want to go ahead and transfer ownership to the PowerShell org?

Yes, I can transfer now if everything is ready...

Everything is ready.  Request transfer and mention that you have and I'll have someone take ownership.

Seems I can't request a transfer to the PowerShell organisation on GitHub without "create repository" permission granted to my account (https://help.github.com/articles/transferring-a-repository-owned-by-your-personal-account/). I suggest instead that, either I transfer to a member of the organisation's personal account (you, @TravisEz13?) who does have create repository permission and they re-transfer it from their personal account into the PowerShell org; or, someone with create repository permission can use GitHub's "Import Repository" (https://github.com/new/import) to copy my repo, not fork, into the PowerShell org.

The import (https://github.com/new/import) seems like the easiest way
@SteveL-MSFT  can you import this repository into the PowerShell org.

@TravisEz13 @diddledan done: https://github.com/PowerShell/PowerShell-Snap

@TravisEz13 what is this blocked on? Are you using this to track the Snap package now, or is this considered done because we have our repo now?

This is done.  I need to do an RFC for preview snaps


drop bespoke mat, intro simpler macros

Resolves #477 (partially)
I'm guessing that the CRUD macros for tables and views will also need to be added to get this working properly. See dbt-postgres's versions in the table/ and view/ directories within main/plugins/postgres/dbt/include/postgres/macros/relations. Other adapters (Snowflake, Redshift, and soon BQ) will have the same macros all will require this work

This is more what I was expecting.  But are you saying even this is not required for 1.7.0?  Or is this level what we need for 1.7.0, and the more substantial refactor is 1.7.x timeline?


TS-4432: TSVConnFdCreate, double free on connectUp failure

How are you seeing the double free?  The original code looks good.

int
UnixNetVConnection::connectUp(EThread *t, int fd)
{
int res;
thread = t;
if (check_net_throttle(CONNECT, submit_time)) {
check_throttle_warning();
action_.continuation->handleEvent(NET_EVENT_OPEN_FAILED, (void *)-ENET_THROTTLING);
free(t);   ------> free(t) has been called before the connectUp() return CONNECT_FAILURE to TSVConnFdCreate
return CONNECT_FAILURE;
}

Can one of the admins verify this patch?

[approve ci]

Build triggered. sha1 is merged.

Build finished successfully.
No test results found.

Thanks @oknet


⚠ Mobitopup has degraded performance

In 0e9e514, Mobitopup (https://napcard.voz.tech) experienced degraded performance:

HTTP code: 200
Response time: 5977 ms

Resolved: Mobitopup performance has improved in 6a1cc2a.


Fetching information for a few handles not working

This might be because of the change in handles on AtCoder itself.
Examples:

ankitcode99
hardikb09

They have 0 submissions on the AtCoderProblems website but non-0 on AtCoder. Can we do some workaround for this? Also in such cases can we return some different response on the atcoder-api/results?user=<user_handle> to effectively communicate the state.

AtCoderProblems will update existing data, but it takes a few days or more. Meanwhile, you can get the submissions, that are not updated, with the old handle.

Also in such cases can we return some different response on the atcoder-api/results?user=<user_handle> to effectively communicate the state.

Since it's not an official service, we don't know which handle is changed.


Remove uppercase top nav

Please always provide the GitHub issue(s) your PR is for, as well as test URLs where your change can be observed (before and after):
Fix #168
Test URLs:

Before: https://main--elixirsolutions--hlxsites.hlx.live/
After: https://remove-uppercase-top-nav--elixirsolutions--hlxsites.hlx.live/

@janefrommaine Unfortunately we cannot make it bigger right now because of the media size.
I am all for unbolding to match is was just a tad light to me but its not a preference of mine.

@janefrommaine I removed the bolding. Future design I want to change the logo (the one without a tagline) and top nav layout a bit, I am going to include making the nav font larger in that ticket since it will be a little more intensive redesign.

@sforschen, oh I see - there are a couple things that need to be tweaked with the main nav.
If you want to add the bold back until we can fix the other issues, that makes sense to me. I see what you mean that the small text + bold might be easier to read while we bridge the gap.
Happy to go with whichever you prefer (small bold vs. small unbold)
One thing I was looking into was:

larger font
no bold
removing the --default-content-gap padding on the navigation (keep it at 1rem) for the (min-width: 56.25em) breakpoint but adding it back for the (min-width: 75em)

Definitely still some alignment issues though.

@janefrommaine Know of any way to delete or rescind a commit? If I could delete the bolding one this will be good to go for now.


Errors after uploading sketch to T-SIMCAM module

Hello I bought a Lilygo T-SIMCAM module and wanted to start with the example sketch pic2cloud without mPCIE card mounted.
After uploading the sketch the ESP throws errors in a loop. I also tried with a simplified class, see below.
I use the platformio.ini from the example:
[platformio]
src_dir = .

[env]
platform = espressif32
framework = arduino
platform_packages = framework-arduinoespressif32@https://github.com/espressif/arduino-esp32.git#2.0.3

[env:t-camera-sim]
extends = env
board = esp32s3box
upload_port = COM3
monitor_port = COM3
monitor_speed = 115200
build_flags = -D BOARD_HAS_PSRAM
              -D CAMERA_MODEL_TTGO_T_CAM_SIM
              -D CORE_DEBUG_LEVEL=3
              -D TINY_GSM_MODEM_SIM7600
              -D ARDUINO_USB_MODE=1
              -D ARDUINO_USB_CDC_ON_BOOT=1
              -D LOGGING

lib_deps = https://github.com/vshymanskyy/TinyGSM.git
           https://github.com/bblanchon/ArduinoJson.git
           arduino-libraries/ArduinoHttpClient @ 0.4.0
           https://github.com/knolleary/pubsubclient.git

; board_build.partitions=default_8MB.csv
board_build.partitions=default_8MB.csv
board_build.f_cpu = 240000000L
board_build.arduino.memory_type = qspi_opi
board_build.flash_freq=80m
board_build.flash_size =16MB
board_build.flash_mode = dio
board_build.boot=qio
board_build.flash_type = qspi
board_build.psram_type = opi
board_build.memory_type = qspi_opi
board_build.boot_freq = 80m

And this simple main class:
#include <Arduino.h>

void setup() {
    Serial.begin(115200);
}

void loop() {
    Serial.println("In Loop");
    delay(10000);
}

Errors are following:
Building in release mode
Retrieving maximum program size .pio\build\t-camera-sim\firmware.elf
Checking size .pio\build\t-camera-sim\firmware.elf
Advanced Memory Usage is available via "PlatformIO Home > Project Inspect"
RAM:   [          ]   4.0% (used 13060 bytes from 327680 bytes)
Flash: [=         ]   6.4% (used 215217 bytes from 3342336 bytes)
Configuring upload protocol...
AVAILABLE: cmsis-dap, esp-bridge, esp-builtin, esp-prog, espota, esptool, iot-bus-jtag, jlink, minimodule, olimex-arm-usb-ocd, olimex-arm-usb-ocd-h, olimex-arm-usb-tiny-h, olimex-jtag-tiny, tumpa
CURRENT: upload_protocol = esptool
Looking for upload port...
Using manually specified: COM3
Uploading .pio\build\t-camera-sim\firmware.bin
esptool.py v4.2.1
Serial port COM3
Connecting...
Chip is ESP32-S3
Features: WiFi, BLE
Crystal is 40MHz
MAC: 68:b6:b3:20:a6:70
Uploading stub...
Running stub...
Stub running...
Changing baud rate to 921600
Changed.
Configuring flash size...
Flash will be erased from 0x00000000 to 0x00003fff...
Flash will be erased from 0x00008000 to 0x00008fff...
Flash will be erased from 0x0000e000 to 0x0000ffff...
Flash will be erased from 0x00010000 to 0x00044fff...
Warning: Image file at 0x0 is protected with a hash checksum, so not changing the flash size setting. Use the --flash_size=keep option instead of --flash_size=16MB in order to remove this warning, or use the --dont-append-digest option for the elf2image command in order to generate an image file without a hash checksum
Compressed 13824 bytes to 9619...
Writing at 0x00000000... (100 %)
Wrote 13824 bytes (9619 compressed) at 0x00000000 in 0.3 seconds (effective 349.3 kbit/s)...
Hash of data verified.
Compressed 3072 bytes to 129...
Writing at 0x00008000... (100 %)
Wrote 3072 bytes (129 compressed) at 0x00008000 in 0.1 seconds (effective 345.4 kbit/s)...
Hash of data verified.
Compressed 8192 bytes to 47...
Writing at 0x0000e000... (100 %)
Wrote 8192 bytes (47 compressed) at 0x0000e000 in 0.1 seconds (effective 484.3 kbit/s)...
Hash of data verified.
Compressed 215600 bytes to 118587...
Writing at 0x00010000... (12 %)
Writing at 0x0001cd66... (25 %)
Writing at 0x000224ff... (37 %)
Writing at 0x000279c5... (50 %)
Writing at 0x0002cebd... (62 %)
Writing at 0x00035769... (75 %)
Writing at 0x0003d7b2... (87 %)
Writing at 0x0004318e... (100 %)
Wrote 215600 bytes (118587 compressed) at 0x00010000 in 2.4 seconds (effective 712.9 kbit/s)...
Hash of data verified.

Leaving...
Hard resetting via RTS pin...
======================================================================================================================================= [SUCCESS] Took 6.49 seconds =======================================================================================================================================
--- Terminal on COM3 | 115200 8-N-1
--- Available filters and text transformations: colorize, debug, default, direct, esp32_exception_decoder, hexlify, log2file, nocontrol, printable, send_on_enter, time
--- More details at https://bit.ly/pio-monitor-filters
--- Quit: Ctrl+C | Menu: Ctrl+T | Help: Ctrl+T followed by Ctrl+H
ESP-ROM:esp32s3-20210327
Build:Mar 27 2021
rst:0x3 (RTC_SW_SYS_RST),boot:0x2a (SPI_FAST_FLASH_BOOT)
Saved PC:0x403bb0ce
SPIWP:0xee
mode:DIO, clock div:1
load:0x3fcd0108,len:0x39c
load:0x403b6000,len:0x9a4
load:0x403ba000,len:0x2868
entry 0x403b61c0
ESP-ROM:esp32s3-20210327
Build:Mar 27 2021
rst:0x3 (RTC_SW_SYS_RST),boot:0x2a (SPI_FAST_FLASH_BOOT)
Saved PC:0x403bb0ce
SPIWP:0xee
mode:DIO, clock div:1
load:0x3fcd0108,len:0x39c
load:0x403b6000,len:0x9a4
load:0x403ba000,len:0x2868
entry 0x403b61c0
ESP-ROM:esp32s3-20210327
Build:Mar 27 2021
rst:0x3 (RTC_SW_SYS_RST),boot:0x2a (SPI_FAST_FLASH_BOOT)

Can someone help? I've never worked with an ESP32-S3
Thank you very much!

thx


new atmos res C1120

I am not sure do we need to add C1120 to gcm_setup?
It is candidate for FP but I am not sure what is good time and do we need to add it as option.
There are matching PRs for boundary conditions and remap restarts packages but those we did since we do use them.
https://github.com/GEOS-ESM/GEOS_Util/pull/94
https://github.com/GEOS-ESM/GEOSgcm_GridComp/pull/961
Also if this starts running as candidate it will always have v12 bcs as default and I think 181 lev.
What do you think @mathomp4  and @sshakoor1  ?

I think we are good here. The c1120 resolution is in the candidate v12 branch added by @wmputman:
https://github.com/GEOS-ESM/GEOSgcm_App/blob/2b1739feef7b8811cc798700a6fcfc69f971d3f3/gcm_setup#L245
I mean, it doesn't work and won't until the bcs are in the "right" place, but it's there!

What do you mean by bcs are not at right place?
Both Bill and I use it from centralized location:
/discover/nobackup/projects/gmao/bcs_shared/fvInput/ExtData/esm/tiles/v12/

@biljanaorescanin Oh. I guess I didn't know that the c1120 were there yet! I guess I thought Bill or others were pointing to a "temporary" spot. 😄


piecewise-definition of coefficients on subdomains

Consider a Laplace equation with variable coefficient, ∇⋅ (k ∇ u) = 0, with k piecewise-constant on ‘regions’ or ‘subdomains’; e.g. steady conduction of heat between two blocks of different thermal conductivity (with no thermal contact resistance).
I think that such problems could also be done with mortar methods (which I see from ex04 are implemented, at least for two-dimensional problems, via InterfaceMesh1D); however, monolithic approaches can be convenient too.  The issue here is to assign different values to k depending on which submesh an element belongs to, e.g. as defined in Gmsh as Physical Surface (in two dimensions).  Should k be defined with ElementTriP0?  And then populated using the cell_data returned by pygmsh.generate_mesh or the .cell_data attribute of the meshio.Mesh returned  by meshio.read—I don't think skfem.mesh.from_meshio currently does this, it only looks for tags on facets, e.g. for mixed boundary conditions.

The additional parameter w given to asm, i.e.
asm(bilinf, basis, w=w)

has shape number-of-elements x number-of-quadrature-points.
Each row corresponds to a single element. If the material field is constant within each element, you can simply create 1D array of length mesh.t.shape[1] (number-of-elements) and replicate this by the number of quadrature points. The result can be passed to asm.

Ok, now that I meditated this for a while: I think we should create a method to GlobalBasis (say GlobalBasis.indicator) which takes in Submesh and outputs 2-d array which can be passed to asm via the keyword argument w.
This 2-d array represents the indicator function, i.e. it is 1 if the respective quadrature point belongs to the Submesh and 0 otherwise.
These indicator function arrays can be multiplied with specified values and summed together at will.
What do you think?

That would be very useful for switching on a term in a subdomain, yes.   Sticking with the example of the heat equation for concreteness, it's very common for tbe source term to be confined to a region.  The Joule-heated wire in an insulator is a textbook case.
For the piecewise-constant conductivity though, this style would involve one asm for each region and there could be a few of those, so the P0 approach, simplified as above ('simply create') would be more convenient.
I think both idioms should be available and both work well side by side.  Both are available in the FreeFem++ language, for example.

Here is a method for InteriorBasis:
def indicator(self, submesh):
    ind = np.zeros((self.nelems, len(self.W)))
    ind[submesh.t, :] = 1.0
    return ind

A similar one could be created to FacetBasis to indicate facet subsets.
Then you could create Submeshes and input them to InteriorBasis.indicator:
left_ind = basis.indicator(m.submesh(lambda x, y: x<0.0))
right_ind = basis.indicator(m.submesh(lambda x, y: x>0.0))

During assembly you could define piecewise constant fields like this:
asm(bilinf, basis, w = 3.0*left_ind +2.0*right_ind)

I've found a reference for the aforementioned insulated wire:

Carslaw, H. S., & J. C. Jaeger (1959). Conduction of Heat in Solids (2nd ed.). Oxford University Press. §7.2.V, pp 191–192

This might be a better example than #90 .  It demonstrates both features of subdomains:

subdomain-dependent coefficient (the thermal conductivity)
variational forms only active in a subdomain (the Joule heating)

In variational form, with a slight change of notation (so that h becomes a heat transfer coefficient), the problem is (grad u, k grad T) + h [u, T] = (u, A) where the square brackets denote the inner product over the boundary and k = k0 for 0 < r < a and k1 for a < r < b and A = A0 in 0 < r < a and 0 in a < r < b.

I got that working in insulated.py on branch piecewise-89 #90.
I used a very quick hack in skfem.mesh.mesh.from_meshio https://github.com/kinnala/scikit-fem/blob/a7ca4936db69ed7ce62698110c5b599a64b88306/skfem/mesh/mesh.py#L267
which will probably want some thought and then some tidying.
This is then used in the script: https://github.com/kinnala/scikit-fem/blob/a7ca4936db69ed7ce62698110c5b599a64b88306/docs/examples/insulated.py#L60 and for the subdomain-dependent coefficients as https://github.com/kinnala/scikit-fem/blob/a7ca4936db69ed7ce62698110c5b599a64b88306/docs/examples/insulated.py#L70-L71
and the subdomain-dependent linear form as https://github.com/kinnala/scikit-fem/blob/a7ca4936db69ed7ce62698110c5b599a64b88306/docs/examples/insulated.py#L77-L84 .
I haven't checked the result against the closed-form solution yet but it looks O. K.

Yes, I can see why one would like to have all data outputted by meshio accessible.
I propose that we create a single attribute Mesh.external or Mesh.ext which contains all the field data, cell data, etc. of the respective meshio object (e.g. Mesh.ext.cell_data) and where the word external or ext emphasizes that we aim not to document its contents within scikit-fem since it might depend on the format.
Still, I will probably at some point improve the wrapper from_meshio to create Submesh-objects from subdomains since I find them to be convenient regarding my future plans. I'll probably move the gmsh-specific parts of from_meshio into a separate method at some point.

Yes, I was starting to think of something like a .external attribute too.  It could very well be that what's returned by meshio.read changes; the resolution of nschloe/meshio#175 doesn't seem like the last word on how to serialize subdomains.

Check 37be054.

Thanks for the review here. This is a very useful feature.
I'll probably continue to tweak the user-level code in the insulated-wire example #90 as I begin to make real use of the feature myself, but I think this issue can be closed for now.
Later I might also try comparing this monolithic approach with one based MeshInterface1d for the same boundary value problem.


code -r .  does not work properly on vscode web

An excellent bug report was submitted by @axonasif to Gitpod's repo which explains the issue and how to reproduce it. Does anyone know how to fix this?
Quoted below is the text of the original bug report followed by vscode and OS versions that I've added:

Bug description
Trying to reopen the VSCode web instance with a different code-workspace root directory and a relative file to it does not work as expected. This is not an issue on VSCode desktop.
See the video below if it's not fully clear what I mean:
https://user-images.githubusercontent.com/39482679/191192199-8b1648c7-cdb0-4fc9-9baa-b0509f774c94.mp4
Steps to reproduce:

Open a workspace on vscode web.

Inside your workspace, create a dir, e.g src.

Copy or create a file inside the src dir, e.g README.md.

Then on your terminal run cd src && code -r . README.md

Notice that the vscode-instance switched to src dir as it's code-workspace root but didn't open README.md there, however it got opened on the parent instance.

Expected behavior
The files relative to the new code-workspace root dir should also get opened as like VSCode-desktop.
Anything else?
Originally bought up by @TimothyStiles
https://discord.com/channels/816244985187008514/1020773220279922789/1021538242752946196

VS Code Version:
results of running `code -v` in the window's integrated terminal below:

1.71.2
9ae312771e40d3399bac2b7b43c5bb4a1514517c
x64

OS Version:
Firefox 104.0.2

@joyceerhl one of gitpod's maintainers updated me and think it may be specific to their fork of vscode. Closing for now but may reopen later.

You write 'open vscode web', I assume you mean VS Code in Brower running against a backend.
I tested your steps using a code server (https://code.visualstudio.com/docs/remote/vscode-server#_quick-start), and all worked.
Please provide steps based on VS Code products to make sure this is not a Gitpod issue.


page.collectGarbage()

I would like to collect garbage in the process of tests so that I can do metrics and doing traces between operations.
Chrome dev tools has a clear garbage button on the performance tab.
Can we get access to the operations of that button please in the same way as you can do it manually  on the performance tab.
something like page.collectGarbage() would be really appreciated.

Since we are waiting for #31 you can use at this moment Chrome DevTools Protocol - HeapProfiler.collectGarbage:
await page._client.send('HeapProfiler.enable');
await page._client.send('HeapProfiler.collectGarbage');

cc @a1ph

@aslushnikov is this feature still desired? If so, I'd be happy to implement it with some guidance on what exactly the internals should be. Perhaps it is just HeapProfiler.enable > HeapProfiler.collectGarbage > HeapProfiler.disable?

@trentmwillis @Everettss @pragmaproducts The page.collectGarbage() would be quite racy, I'm not convinced this is anyhow useful. Consider the following pptr script:
// This would successfully collect garbage
await page.collectGarbage();
// However, by the time control is returned to pptr,
// the page could've produced a ton more garbage
startCollectingMyMetrics();

If you do memory analysis, queryObjects API is much more robust.
Can you guys share your usecases?

@aslushnikov In my case, I would like to make sure that the scheduled garbage collection can not affect my performance metrics:
// It would be nice to force the GC here:
await page.collectGarbage();
const startTime = performance.now();
// Some actions that I measure
const endTime = performance.now() - startTime;

@aslushnikov In my case, I would like to make sure that the scheduled garbage collection can not affect my performance metrics:

Unfortunately, even after calling gc manually, there's no guarantee it won't be triggered during the measured code snippet.
We can re-consider this later if there are more usecases; closing for now.


[Cosmos] Be TSDoc compliant

This PR updates the cosmosdb package to be TSDoc compliant. See #12912 for why we are making the move from JSDoc to TSDoc. Resolves #12951
Majority of the changes in this PR fall under the below categories:

Remove type info from @param and @returns tags. TS tooling can infer this without us adding to these tags
Remove the @param tag if only the parameter name is present without parameter description. Such instances add no value to TS tooling. This can also serve as a reminder to add relevant description. Feel free to provide suggested edits in this PR for such cases.
Use the hypen as a delimitor between parameter name and description when using the @param tag
Remove @hidden tag if  @internal is already applied
Remove JSDoc tags that make sense in JS files, but not are not required in TS files and so are invalid in TSDoc.

@class
@constructor
@interface
@instance
@memberof
@summary
@description

In some cases, I found stale docs detailing parameters that are no longer used in the methods. I have deleted such entries
Use backticks where applicable to avoid the linter from thinking that presence of {, } is some kind of TSDoc entity
Remove trailing backslash in the end of a line. I believe this was added to denote that the text continues in the next line. This is invalid in TSDoc, and I am not aware of any tooling that relies on this. Please do share if any such tooling exists

I'm taking a look at this - pulling down since I see some issues with jsdoc formatting

@zfoster Fixed the formatting and build errors!

ah, I did too 👍 i'll review now

/azp run js - cosmosdb - ci

Closing in favor of #13849


Resizing of target_specs widget shrinks QLineEdit fields

When the height of the top level widget is reduced to a certain point, the height of the target_specs window is reduced and the QLineEdit widgets are compressed, even when the scroll bar appears.
The encompassing QScrollArea() has setWidgetResizable(True) as suggested in  https://www.qtcentre.org/threads/14938-Dynamic-updates-of-a-QWidget-in-a-QScrollArea so this seems not to be a problem.
Modifying minimumSizeHint() as suggested in https://stackoverflow.com/questions/46361675/pyqt-enforcing-sizehint-dimensions-on-two-widget-app-with-layout-manager#46393700 also didn't work.
This has probably to do with the freq_specs and amplitude_specs subwidgets where fields are added and removed dynamically to a QGridLayout depending on the filter type.
See https://stackoverflow.com/questions/21253755/qscrollarea-with-dynamically-changing-contents
Possible solutions in freq_specs.py that have some effect on the behaviour:

self.adjustSize()
qlineedit_widget.setFixedHeight(qlineedit_widget.sizeHint().height()) # not so much
self.layGSpecs.setSizeConstraint(QtWidgets.QLayout.SetMinAndMaxSize)

The last one has the most effect, the size of the subwidget now stays fixed when the size of the top level window is reduced. However, now the parent widget (target_specs.py) is reduced in size, making a part of the input fields invisible. Maybe this can be combined with monitoring resize events.
setSizePolicy(QSizePolicy.Minimum) sets the minimum size to the size hint and could be set on target_specs to prevent the widget from shrinking. Tried this on freq_specs and target_specs without effect

Fixed in v0.9.6 - the culprit was one missing `QSizePolicy() setting ...