Blank swagger documentation page

Following the link from Help > Using the API > Swagger documentation opens a blank page https://www.ebi.ac.uk/ols4/swagger-ui/index.html

The routing is fixed so it routes to swagger, but it returns the API for a pet store.
https://www.ebi.ac.uk/ols4/swagger-ui/index.html#/

@udp @serjoshua
This is how it looks like in my local installation. I have never encountered the petstore.

Hi,
I noticed the same issue so I came here: the pet store is just the default configuration, a sample for when your server is not yet fully configured.
I'm not quite sure that applies here, but I think we had similar issues in Reactome, because of the context-path when deployed, it was basically pointing to the wrong thing, we fixed that with this snippet:
https://github.com/reactome/content-service/blob/261bb77e264f9ac9b19d1ecade0eb8ef7d7f143e/src/main/java/org/reactome/server/service/config/SwaggerConfig.java#L21-L34
And more specifically this part:
new OpenAPI().addServersItem(new Server().url(context.getContextPath()));

Not sure it's gonna fix your issue, but maybe worth trying :D

Thanks @EliotRagueneau !
@serjoshua can you see if this works?

It's accessible at https://www.ebi.ac.uk/ols4/swagger-ui/index.html now ; just need to update links in the docs


Skip hyphen values (i.e. no value is marked with '-')

This is more of a question than an issue or feature request.
In our IIS logs a non-value is marked with '-', see example below:
2018-11-19 13:00:38 W3SVC1 <IP_ADDRESS> GET /keto-app/cleanup-02.min.css - 443 - <IP_ADDRESS> Mozilla/5.0+(iPhone;+CPU+iPhone+OS+12_1+like+Mac+OS+X)+AppleWebKit/605.1.15+(KHTML,+like+Gecko) https://www.lowcarbmaven.com/keto-chocolate-chip-cookies/?utm_source=keto-app&utm_medium=referral 200 0 0 46
For example the hyphen just before 443 in the line above is the query string. When marked with '-' it simply means there is no query string for the given request.
Is there a way to handle this correctly in goaccess or do I need to pre-process and clean-up the logs before passing them to goaccess?
Also is there a way to translate 443 to HTTPS and 80 to HTTP ?
Here's the config for the IIS logs:
log-format %d %t %^ %^ %m %U %^ %^ %^ %h %u %R %s %^ %^ %L
date-format %Y-%m-%d
time-format %H:%M:%S
Thank you

So just wanted to add that I also have this problem and it would be good to have some sort of option to treat the dash as empty or something along those lines, or even have the ability to do some simple logic or regex but I see that as more complications.

I'm using .NET 8 Preview 7 and Microsoft's Kestrel Web Server with W3CLogging enabled builder.Services.AddW3CLogging(options => on an Ubuntu 22.04 VPS and if there's no query string it writes the a - to the log file.
If it's possible I would like an option to ignore the - (for any field, and possibly a char you can define yourself) because my console (without a query string) looks now like this:

@JeepNL Could you share a few lines from your access log along with the format you're using? This would help me examine it more effectively.

ASP.NET Core W3CLogger for Kestrel Web Server creates a space delimited log file.

Kestrel is a cross-platform web server that is included and enabled by default in ASP.NET Core
If a field is not available it writes a - to the log file. In my example this happens with cs-uri-query (GoAccess: %q) But it can also happen with, for example, Referrer
In my example I've enabled:
date time c-ip s-port cs-method cs-uri-stem cs-uri-query sc-status time-taken cs-version cs-host

and my GoAccess CLI parameters are:
goaccess *.txt --log-format='%d %t %h %^ %m %U %q %s %L %H %v' --date-format='%Y-%m-%d' --time-format='%H:%M:%S'


Automatic collections do not look up children classes, missing most shmups and versus fighting games in the process

Concerned project
Both
Distribution Version
Batocera 40 2024/07/31 14:37 + Retrobat 6.4.0-stable-win64
Architecture
Raspberry Pi 5 B + Windows 11
Issue description
When switching automatic collections ON for some genres, games who are classified as a sub-genre of the main one don't show up in the collection.
Most fighting games don't show up in the collection 'Fight' because they are labelled as 'Versus' who is a children genre of the 'Fight' genre.
Same issue for Shmups who are mostly labelled as 'Vertical' or 'Horizontal', both sub-genre of 'Shmup', yet they don't show up in the collection.
In both cases, the games start showing up if one manually changes the metadata to select the parent genre.

Logs and data
No response

behaviour in video
https://github.com/user-attachments/assets/59b39453-ec77-4ab9-ac22-43035c045787


Release/v1.17.0

What
Release PR for OT instrumentation
How to review
Ensure all changes are ready to go
Who can review
Anyone

Closing this PR as it's been superseded


Polyfill has a lot of dead code...

None of this can be executed.

Thanks - polyfill code in proposal repos isn't that important; the actual polyfill is https://www.npmjs.com/package/promise.prototype.finally / https://github.com/es-shims/Promise.prototype.finally/blob/master/implementation.js which gets its speciesConstructor implementation from https://github.com/ljharb/es-abstract/blob/master/es6.js#L237-L255.
I'll put up a fix shortly.


JSX support?

Hi devs, how about adding JSX support into javascript.js?

If you want to work on this, the way to do it would be to make the JavaScript mode extensible, so that you can override the way it parses expressions. And then write an extension that, in case an expression starts with a <, switches to the JSX mode.

What about this?
https://code.google.com/p/lite/source/browse/trunk/Lite/web/doc/codemirror/jsx.js?spec=svn1482&r=1482
I've tried using it, but I get an error: Uncaught RangeError: Maximum call stack size exceeded

:+1: Would also love to see this feature.

+1

The link @eranimo posted looks a lot like the approach I would take if I were to implement it. So instead of posting +1's here, you could try debugging and fixing it (though note that it's LGPL code -- you might want to contact the author and ask if it can be moved under an MIT license first).

+1

:+1:

Hi,
I was using CJSX (the coffeescript analogue of JSX) recently in codemirror,
and needed syntax highlighting and indent.  I found a mode for Adobe
Brackets and rewrote it to work in codemirror, and put it here:
https://github.com/sagemathinc/smc-public/blob/master/static/codemirror-5.3/mode/coffeescript2/coffeescript2.js
Anybody is welcome to it (under the Brackets's MIT license)...
William
On Fri, May 29, 2015 at 12:16 PM, Patrick Costanzo<EMAIL_ADDRESS>
wrote:

[image: :+1:]
—
Reply to this email directly or view it on GitHub
https://github.com/codemirror/CodeMirror/issues/3122#issuecomment-106906712
.

--
William (http://wstein.org)

for the moment I use this trick:
https://github.com/abdelouahabb/CodeMirror/commit/521c476de9b8a961a3205e7284863de88d012a96

Hello, why not try the codemirror-grammar add-on (author) and do it your-self quite easily. On top of that one can have a base js-grammar and only the necessary extensions for JSX etc.. and extend the base as needed, if needed
Cheers

this has driven me crazy for months I finally broke down and just wrote a better mode
https://gist.github.com/jquense/265b46c740da4d20a718
It doesn't handle jsx expressions as well as I'd like (see comments) someone smarter than me, please improve it!

@jquense My patch-up approach was rejected. Could I try to improve your code and send PR again?

@kidwm please do! the current issues with my approach is tracking the inline jsx expressions right now it just works when the js starts and ends on the same line. I've tried more nuanced attempts at it (tracking brackets in state) but haven't had the time to solve the issues there.
I'd be great if you took a whack at it :)

@jquense You may find this useful (similar to first link) - https://github.com/antimatter15/codemirror-jsx/blob/master/jsx.js

This should be closed after #3742.

:tada: WOOHOO! Thanks so much @marijnh


DL3-35 secure middleware courses endpoint

Description
Secured the middleware's backend endpoint for retrieving the Harmony course catalog using the LTI id_token.
Motivation and Context
Only users who have a valid LTI registration who are accessing the Deep Linking menu through a valid LTI flow should be permitted to access the course catalog via the middleware.
Fixes
DL3-35
How Has This Been Tested?

Ensure as a prerequisite that the tool was registered and deployed in D2L and that a Deep Linking Quicklink Link has been added to the Deployment and that there is an org unit appropriately given permission to access the tool.
Go to the course (org unit) that has permission to access the tool in D2L.
Click on Content in the top navigation.
Click "Add a module...", write a name for it, and hit enter to create the module.
Click the dropdown for Existing Activities
Click on the Deep Linking Quicklink (e.g. I named mine "Lumen Content Selector").
Ensure that the course catalog displays with the expected data being sent from the Harmony /course_catalog endpoint and that the pagination is in place if there are more than 10 courses.
Note: If all of the courses in the catalog are using the brain image and were released on 1/18/2022, then this is an indication that the call to Harmony failed and test data has been returned.

Screenshots
N/A
Database changes
N/A
⚠ Deployment instructions ⚠
N/A
New ENV variables
N/A

Checklist

[x] I have reviewed the AC for this feature and my changes meet all requirements
[x] (For UI changes) I have considered the accessibility of this feature (see https://www.a11yproject.com/checklist/ for a high-level checklist)
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes
[x] Any dependent changes have been merged and published in downstream modules
[x] My change requires a change to the documentation.
[x] I have updated the documentation accordingly.
[x] I have requested a review from at least one other dev

I believe I've addressed all of the comments and set this as ready for review. Let me know if there are any additional changes I should make. Thank you!

Thank you for the updates Mary!


Add lua implementation for sqids

Add lua implementation for sqids.

[x] Add Unit Tests
[x] Add Github Actions
[x] Installable using package manager
[x] Update readme

Hi @nascarsayan, thank you for the PR! :)
Sent you an invite with maintainer rights, feel free to push as needed. I'll update the site.


Improving the timeline: day banner is sticky

@tbergq This is sort of working, but it is sketchy.
I believe that the timeout waiting times will be dependent on the number of elements of the list... So this is still WIP, but if you could check out the branch and see for yourself the current behaviour and give me your feedback, that would be great.
Also, if you can see some obvious improvements, do let me know.

@tbergq  PR improved


Fix missing symbols in region on Windows

@qmfrederik

@hughbe,
Thanks for having already signed the Contribution License Agreement. Your agreement was validated by .NET Foundation. We will now review your pull request.
Thanks,
.NET Foundation Pull Request Bot

I can merge them, but I wanted to break it up into bitesized related chunks that are specific to each component
It's kinda effort to combine them, but I don't mind if that's what you'd like


all custom component names to be in any case

UPPERCASE, lowercase, or camelCase. see #274 why.

Wont fix. Attributes should be registered as they're used in the templates for explicity. E.g:
template("<div attr-key='value' attrKey='value' />", {
  'attr-key': AttrClass,
  'attrKey': AttrClass
});


PyDeequ support to Apache Spark 3.4.0 (and ideally 3.5.0)

Is your feature request related to a problem? Please describe.
I'm currently facing issues with the PyDeequ support to Apache Spark version 3.4.0, since it is impacting several projects in my organization that uses PyDeequ as a data quality tool. The problem arises because our EMR clusters are required to support the latest version releases, but since the release of emr-6.12.0, the support for Apache Spark 3.3.x has been dropped.
Describe the solution you'd like
I would like PyDeequ to be updated to support Apache Spark 3.4.0 and ideally, also the most recent version 3.5.0. I would also like to understand the requirements for this support, such as whether there are any backwards compatibility requirements for PyDeequ, and whether it is necessary for all future PyDeequ versions to continue supporting all of the currently supported Spark and Deequ versions, or if there is scope for dropping support for some versions, as mentioned on #178.
Describe alternatives you've considered
As an alternative, we have considered migrating to Great Expectations due to its active maintenance and large community. However, PyDeequ is still preferred due to its seamless integration with our internal PySpark library. The transition to a new tool would also require significant resources and time. Therefore, having PyDeequ support Apache Spark 3.4.0 and 3.5.0 would be the most beneficial solution for us.
Additional context
It seems that Deequ is already supporting Apache Spark 3.4.0 (#505) and most recently 3.5.0 (#514).

We treat backward compatibility very seriously, as all AWS API or owned library does. Dropping support for EOL Spark version can be an option but it need a bit more research.
I don't think it's very hard to fix https://github.com/awslabs/python-deequ/issues/169 but the change should be made at Deequ Scala land (adding overloaded functions with the old parameters). We currently do not have a date.

As a workaround, you can set env var SPARK_VERSION=3.3 and to my knowledge most PyDeequ features should continue work. Although unlikely, there might be runtime errors from any breaking changes between Spark versions 3.3 and 3.5.

As a workaround, you can set env var SPARK_VERSION=3.3 and to my knowledge most PyDeequ features should continue work. Although unlikely, there might be runtime errors from any breaking changes between Spark versions 3.3 and 3.5.

I see. But is a native support of higher spark versions planned at all? If yes, for when is it scheduled?

Is there a date for when this update might be expected? I am currenlty working in a project that uses pyspark 3.4.1 in databricks and I would like to use pydeequ

Hello! Just checking in to see if there's any news on when we might expect that new feature to drop? Any rough idea of a release date? I'm using this library in my project and need to upgrade to Spark 3.4 since we're on Databricks runtime 13.3LTS and would like keep using this. Thanks!

Hey guys,
Any plans on upgrade to spark 3.4

@chenliu0831 do you have a release date for spark 3.5 upgrades

I think we are getting very close https://github.com/awslabs/python-deequ/pull/203 (only 2 test failures down to a dep issue ).

@chenliu0831  how is it looking buddy?
can we expect release this week?
Also are you doing it for both 3.4 and 3.5?

@hardiktalati the fix for the 2 failures would need Deequ release I think, please be patient and I will post updates. I think it should solve both 3.4 & 3.5 and we may release it together.

Hello! Any refreshing news? I know it’s complicated, and we have to be patient. I’m just checking if there is an approximate release date because my project is blocked and would like keep using this. Thanks😊

@chenliu0831 bro you mentioned it's nearly done how far

@chenliu0831  any updates??

@chenliu0831 atleast response back ... so that we can make decision

We developed a DQ solution based on Pydeequ.
After moving to Databricks we lost the ability to continue working with the solution.
We would appreciate your update regarding the implementation of SPARK 3.5 and the official support (or supporting Delta Table) as part of Pydeequ.

@hardiktalati @D2Bull @sqlkabouter We apologize for the inconvenience. We are actively working on the upgrade to Spark 3.4 and we aim to finish it as soon as possible. The upgrade to Spark 3.5 will follow right after.

@rdsharma26 thanks for getting back. Is it possible to know tentative dates so that I can comms back to the colleagues

@hardiktalati At the moment, we don't have a date to share. We are trying to root cause the failure of two unit tests. Upgrading PyDeequ to Spark 3.4 and using Deequ's 2.0.7 Spark 3.4 library is resulting in the following error.
py4j.protocol.Py4JJavaError: An error occurred while calling o3327.run.
java.lang.NoSuchMethodError: 'breeze.generic.UFunc$UImpl2 breeze.linalg.DenseVector$.dv_dv_Op_Double_OpDiv()'

Once the RCA is done, if a new release of Deequ is required, then it can take a week until PyDeequ is fixed. If the fix is within PyDeequ itself, the new version with Spark 3.4 can be released within a few days.
Once the Spark 3.4 support is added, we will work on Spark 3.5 next.

We took a different approach from my previous message. Looks like we might need a new Deequ release to upgrade the Breeze dependency for Spark 3.4. In light of that , created a PR that adds Spark 3.5 support: https://github.com/awslabs/python-deequ/pull/210

@rdsharma26 Let us know once you have released a release candidate :)
Btw is it worth supporting older spark version? I think mantainance is 18 months. I would probably cut release with older versions at some point. Especially if breaking changes :)

Spark 3.5 support has been added in https://pypi.org/project/pydeequ/1.4.0/ 🚀
@datanikkthegreek That's a great point. We did recently drop support for Spark 2.4. Spark 3.4 is still a relatively newer version, so we will add support for it soon.

Spark 3.5 support has been added in https://pypi.org/project/pydeequ/1.4.0/ 🚀
@datanikkthegreek That's a great point. We did recently drop support for Spark 2.4. Spark 3.4 is still a relatively newer version, so we will add support for it soon.

What I'm missing, it seems that the latest announcement is regarding Spark 3.30.
Where is Spark 3.5 mentioned?
🎉 Announcements 🎉
NEW!!! 1.1.0 release of Python Deequ has been published to PYPI https://pypi.org/project/pydeequ/. This release brings many recency upgrades including support up to Spark 3.3.0! Any feedbacks are welcome through github issues.

@D2Bull The README has been updated in the master branch. The project description in PyPI will not change until the next release.

Hi folks.
I'm on a middle of a migration of my data quality pipeline from Spark 3.1 to 3.5. Unfortunately I don't have means to change my environment and I need to run my code at 3.5.
Unfortunately things are broken at pydeequ 1.4.0 mostly because since Spark 3.4: : "...  Spark Connect supports most PySpark APIs, including DataFrame, Functions, and Column. However, some APIs such as SparkContext and RDD are not supported"  (source)
Which causes things like this to break

Any thoughts on it?

Hi folks.
I'm on a middle of a migration of my data quality pipeline from Spark 3.1 to 3.5. Unfortunately I don't have means to change my environment and I need to run my code at Spark 3.5.
Unfortunately things are broken at pydeequ 1.4.0 mostly because since Spark 3.4: : "... Spark Connect supports most PySpark APIs, including DataFrame, Functions, and Column. However, some APIs such as SparkContext and RDD are not supported" (source)
Which causes things like this to break

Any thoughts on it?

Just choose single user access mode isolation in Databricks. This error you mentioned is only related to SparkConnect environment (see Databricks shared access mode limitations)
@MrPowers FYI

Hi everyone,
after the update, we are using DBR 14.3. on Databricks with Spark 3.5. when running with Job Clusters it fails with this error will with interactive cluster everything works fine. We use single access mode.
Any ideas? :)

Hi everyone,
after the update, we are using DBR 14.3. on Databricks with Spark 3.5. when running with Job Clusters it fails with this error will with interactive cluster everything works fine. We use single access mode.
Any ideas? :)

I would check first that Deequ JAR is in the JVM Class Path, actually. And that the version of Deequ is the same as reuqired by python-deequ.


Create an RCV File workflow

Create an RCV file workflow called 'clinvar-rcv-ingest' based on the clinvar-ingest code base.
clinvar-rcv-ftp-watcher will call into this worflow and pass the same info as it does, but for the rcv weekly file.

Based on discussion on 2024-06-25:
When an RCV or VCV ingest pipeline is finished, they should look for a corresponding VCV or RCV release on the same day or within 1 day of itself. If it finds one, it should run the linker script to link the SCVs to the RCV/TraitSets

Closed by #197


"cannot find load_fusefs" on macOS with OSXFUSE 3.10.2

Hi Zach,
I had a look at your code and I really liked the structure of it 👍 So now I am trying to get adbfs working on my Mac, but I'm getting the error above. I take it it's coming from go-fuse (MountRoot function). I wonder if it's an incompatiblity between the old go-fuse version and the up-to-date OSXFUSE. Any ideas?

Ok I switched the dependency management from "godep" to "dep" and managed to update go-fuse to a recent version which apparently did the trick.


Gelocator.getCurrentPosition() method not returning precise location in ios

💬 Questions and Help
For questions or help we recommend checking:
so in ios im trying to fetch the current location to check user location mean while sometime the package doesnt return accurate data
its reporting more in ios by clients android it never occurs
is there any change i should make to get precise location i did checked the phone settings for location picking even tho it is all active and user precise location still that issue arise.
any solution? or any other way i can implement to get precise location of user in IOS excatlly
final Position position = await Geolocator.getCurrentPosition(
desiredAccuracy: LocationAccuracy.high);

The Flutter tag in Stack Overflow

same issues

I am facing the same problem . I am using the 9.0.2 the latest version of geolocator . Now , I downgrade the version of geolocator to 9.0.0 . Now , issues resolves ,It gives preciese location with accuracy.

I am facing the same problem . I am using the 9.0.2 the latest version of geolocator . Now , I downgrade the version of geolocator to 9.0.0 . Now , issues resolves ,It gives preciese location with accuracy.

i had this issue when gelocator was on 8.2.1 now i have updated to 9.0.2 but havnt test in live audience im hoping it will be fixed when i push the updated package

It got to do with the iOS stimulator. Go to Stimulator, then Features in the top navigator bar -> Location -> select custom location (anything but none).

so i made some observation after raising this issue here

phone never returns your location with 0% accuracy the best example is when we go to google map and tap on locate my location you can see it wont be that accurate. it will sometime move here and there. so thats one thing.
secondly when u fetch current location make sure u estimate around 40 m radious to expected result.
and another is keep updating package new updates always bring best results.
in phone check for location permission sply in ios check if the app has location access as well above 14 version check the precise location service is enabled for the app.
there is no greater fix we jst have to make our expcetation of location wider.

Please bear in mind that the location is determined by the OS based on several factors like: GPS, WIFI and many others.  Furthermore testing indoor or outdoor might result in different accuracies. We will close this issue because it lacks enough information for us to be able to solve the issue. If you have additional information like the output of flutter doctor -v and some. minimal code to reproduce, it helps a lot when solving this issue.


Function cumulative_hazard_at_times(timeline) of NelsonAalenFitter is not implemented

Hi, I am trying to get the cumulative hazards that are estimated by the NelsonAalenFitter for a specific time but the function throws a not implemented error. Is this intentional?

Hi @Dekermanjian, hm, looks like a problem on my end - that should exist. For now, you can use the naf.predict method to get c.hazard at specific times. Let me know if that works or not!

Yes! That works. Thank you very much.

Reopen so I fix this


Bug: refers to a value

Could you create a reproducible repo and steps how to reproduce the issue?
From the first look it seems that it is not related to vue-gtm itself but an issue with html-webpack-plugin 🤔

在项目根目录的 tsconfig.json 里的 "compilerOptions" 对象中增加："lib": ["es5", "es2015.promise"]

If you have any further issues, please open them at https://github.com/gtm-support/vue-gtm or https://github.com/gtm-support/core


TTS Commands

I have the Module working in all parts but the Direct TTS command. /play - /playsound
When I use /play the window appears, I select the voice and enter text then when I hit send it either deletes the text or does nothing.
/playsound seems to have no visible effect.
When I interact with the selected NPC it works as intended, even with voiced lines.
So I assume it's an issue with the chat command Properly Piping to ElevenLabs

Also, it seems that my Players can not hear the Voice when I can as he responds.
And, you might be interested in knowing that the AI was able to respond to multiple players talking to him

The players should be able to hear Elevenlabs (as in, I've managed to get it so that everyone can hear them in my games) - but the problem might be happening because each player may have to put the API key into their settings menu for the module. If you are comfortable sharing the API key with your players you can check to see if that fixes the problem.
Multiple player characters should be able to talk to an NPC - at the moment Inworld AI doesn't support talking to multiple NPCs at once in the same session, you have to decide which NPC to load at the start of the session, which makes it impossible to have lots of NPCs talking to each other and the players at the moment. This is such an important feature that I'm sure they will add it soon and then I'll try and update the module so that you can have all of the NPCs in a scene load at the same time and then use targeting or commands to talk to them individually.

Ahh, Awesome. I misinterpreted the Instructions on that one. I'll test further with the API's. Thank you and Happy Holidays

I still can't get anyone else to hear it. It seems to be when he replies to another player as when I'm the game master on another PC it works but when I'm player 2 there is no sound on the same PC.
Also the /Play dosen't work so it might be connect


Update Playlist Image Bad Request

Hi there!
I'm trying to make an image the cover of a playlist and I keep getting a Bad Request error.
The picture is base64 encoded, a jpeg, I've reduced it to 0.01 of it's original size and the permissions are the ones refered on the spotify api website.
Any ideia on what this error could be?
Here is the full error:
Fatal error: Uncaught SpotifyWebAPI\SpotifyWebAPIException: Bad request. in ...\vendor\jwilsson\spotify-web-api-php\src\Request.php:45 Stack trace: #0 ..\vendor\jwilsson\spotify-web-api-php\src\Request.php(254): SpotifyWebAPI\Request->parseBody(Object(stdClass), 400) #1 ..\vendor\jwilsson\spotify-web-api-php\src\Request.php(126): SpotifyWebAPI\Request->send('PUT', 'https://api.spo...', 'ZGF0YTppbWFnZS9...', Array) #2..\vendor\jwilsson\spotify-web-api-php\src\SpotifyWebAPI.php(76): SpotifyWebAPI\Request->api('PUT', '/v1/playlists/1...', 'ZGF0YTppbWFnZS9...', Array) #3 ...\vendor\jwilsson\spotify-web-api-php\src\SpotifyWebAPI.php(1705): SpotifyWebAPI\SpotifyWebAPI->sendRequest('PUT', '/v1/playlists/1...', 'ZGF0YTppbWFnZS9...') #4 ..\php\createPlaylist.php(23): SpotifyWebAPI\SpotifyWebAPI->updatePlaylistImage('1UJzLOz61XQJV7Z...', 'ZGF0YTppbWFnZS9...') #5 {main} thrown in ..\vendor\jwilsson\spotify-web-api-php\src\Request.php on line 45

Hey!
That's strange. It's working when I try it.
Could you share the code you're using? And have you tried with another playlist and/or image?

Sure! I'll try share the important parts:
I have a form that runs this php code:
$playlistName = $_POST['playlistname']; //creates playlist
$newPlaylist = $api->createPlaylist([
'name' => $playlistName
]);
$songTotal = $_POST['songTotal']; //add songs
for($i = 0; $i < $songTotal; $i++) {
$api->addPlaylistTracks($newPlaylist->id, [
$_POST['songId' . $i]
]);
}
if($_POST['cover'] == 'use') { //define cover
$imageData = base64_encode($_POST['playlistImg']);
$api->updatePlaylistImage($newPlaylist->id, $imageData);
}
Then the image that I want to use is the canvas, converted to jpg:
let canvas = document.getElementById('defaultCanvas0');
let img = new Image(200, 200);
img.src = canvas.toDataURL('image/jpeg', 0.01); //this defines the format and the quality
document.querySelector('.preview').appendChild(img);
Since this all happens in a pop up, I'm creating the input with the image data:
let playlistImg = document.createElement('input');
playlistImg.setAttribute('type', 'hidden');
playlistImg.setAttribute('name', 'playlistImg');
playlistImg.setAttribute('value', img.src);
document.querySelector('.create-playlist form').appendChild(playlistImg);
I've checked if the base64 encoding is right, and it seems to be.
Thank you for the quick response

All right, I tryed with another image like you said and it works. It's my mistake, I'll figure it out, thank you for your help!


[WIP] Chapter 9

@NattapolPraew I think you meant to open this PR against this repo https://github.com/reactbkk/react-in-patterns-th

Sorry I merge to wrong fork


Setting api_tokens may import underlying unsecured issue

Some people may upload their sublime configurations (including GitSavvy.sublime-settings) to github to synchronize, so it may be unsafe to set api_tokens in the GitSavvy.sublime-settings file. Could you add an interactive mode to let users input their api_tokens each time when needed? I think this may be more welcome. Thanks!

Or simply store them in .git/config as a git setting as I suggested elsewhere. (other tools do this)

Do people really keep tokens just laying around to paste in via some sort of interactive mode?

I think @yyyc514 is spot on.  We'll add functionality to store these tokens in Git config.  If we're going to prompt every time its needed, we might as well prompt for username and password - the user would be more likely to have that memorized, anyway.  Also, the lack of defined api_tokens only means that the module will make the HTTP request with no credentials.  For public repos, this works just fine.

I've looked at a number of other Sublime packages, and adding tokens and other secrets to the User/GitSavvy.sublime-settings seems to be the pattern used by everybody.  For that reason, closing this as wont-fix.


Azure scenarios are training successful in VS, but their status is "Failed" in Azure Portal.

System Information (please complete the following information):
Windows OS: Windows-11-Enterprise-22H2
ML.NET Model Builder 2022: <IP_ADDRESS>6401 (Main Build)
Microsoft Visual Studio Enterprise: 2022(17.7.4)
.NET: 6.0; 7.0
Describe the bug

On which step of the process did you run into an issue:
Azure scenarios are training successful in VS, but their status is "Failed" in Azure Portal.

Test Matrix
https://docs.microsoft.com/en-us/dotnet/machine-learning/tutorials/object-detection-model-builder#create-a-new-vott-project
To Reproduce
Steps to reproduce the behavior:

Select Create a new project from the Visual Studio start window.
Choose the C# Console App (.NET Core) project template.
Add model builder by right click on the project.
Select "Image classification" or "Object detection" scenario.
On the Environment page, choose "Azure" and set up the workspace.
On Data page, choose the data source to complete the training.
After the training successful in VS, open the run link in Azure Portal to check the status.

Expected behavior
The status should be "Completed" in Azure Portal.
Screenshot

Additional context

Run ID: https://ml.azure.com/experiments/id/9ef0c316-eb2b-49df-9bca-38c2fa07b43b/runs/ztskkgdvxcsjnta?wsid=/subscriptions/83635e26-687a-4333-a2a0-33e3cd1f573a/resourceGroups/FullTestPass/providers/Microsoft.MachineLearningServices/workspaces/FullTestPass&tid=72f988bf-86f1-41af-91ab-2d7cd011db47#overview
Training log:
MLModel1-UFS6KT.txt

The bug is not repro on the latest main build <IP_ADDRESS>7201.


[OSX] Building from terminal from folder doesn't work

Hi
I am currently working on a sublime addon that will make it possible for me to compile polycode applications directly from the Sublime Text IDE. I've noticed though that when you compile from terminal, and are located in a deeper layer from where the .polyproject is, then polybuild won't copy folders or their content, and will instead just spit out a 1kb file, with a xx.polyapp and DemoApp.polyapp (both 0 byte) within the compiled .polyapp
For example if we say i'm located in the Game/Scripts folder run this:
polybuild --config=../Game.polyproject --out=../Game.polyapp
then I would expect it to look back into the parent folder, and wrap up everything nicely, However while it locates the polyproject file and compiles successfully, it doesn't copy the folders.
If i'm located in /Game/ (the parent folder) and run:
polybuild --config=Game.polyproject --out=Game.polyapp
then it works.
This is a bug right, or have I misunderstood something?

Hey,
when the IDE starts applications like polybuild, polyimport or anything else it uses a parameter to say in which folder to work. So the command to be executed looks like cd "workFolder" && applicationToExecute --param (see CocoaCore)
I guess it would be a nice addition if it would search for the right directory by itself - but it is not necessary when used integrated in Polycode ... maybe the command cd .. && ..  structure helps you, too?

Ahh okay, yeah I thought it would have to be something like this. Bah.. then i'll have to resort to some shell script for this to work properly with Sublime -.-'
Thanks anyway fodinabor ;)


feat: add roave/security-advisories dev-dependency

Codecov Report
Base: 6.79% // Head: 6.79% // No change to project coverage :thumbsup:

Coverage data is based on head (174ebec) compared to base (0ad211e).
Patch has no changes to coverable lines.

Additional details and impacted files
@@           Coverage Diff           @@
##              main    #481   +/-   ##
=======================================
  Coverage     6.79%   6.79%
  Complexity      58      58
=======================================
  Files           18      18
  Lines          162     162
=======================================
  Hits            11      11
  Misses         151     151

Flag
Coverage Δ

unittests
6.79% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

Not relevant


Add more info on cloudflare_zones data source breaking change

I appreciate the effort you've taken in an attempt to clarify this. Unfortunately, I don't think it conveys the message any differently or specifically to what is already there. In fact, it may be misleading as the release itself addressed a couple of edge cases where calling /zones for a single endpoint was returning an error (see #702).
I've provided a suggestion (removing the sentence about invalid permissions) and if we're happy with that, I'll merge this update.

Cheers @tomaspinho! This is greatly appreciated!


SDG Data team questions

It would be good to get some clarity on how disability status is defined and whether it is in line with the GSS harmonised disability criteria? As it doesn’t look like the disability status is in the typical “disabled”/”not disabled” format. It would also be helpful for me to get an understanding on how the disability breakdown is established at the local authority level.

To what extent does the data you’ve produced fit it or differ with the produced by the UN at the city level for various UK urban areas? https://data.unhabitat.org/datasets/GUO-UN-Habitat::11-2-1-percentage-access-to-public-transport/explore?showTable=true

In terms of geography, from reading the UN metadata the indicator seems to very specifically focus on urban areas (using the UN definition), whereas we seem to have departed from this to use local authorities as the main geography, I’m guessing this was intentional but would be good to get some background on this.

This may have also been discussed previously but was it deemed unattainable to disaggregate data for low capacity (buses) and high capacity (trains, metro, ferries) public transport?

Also mentioned by Max (in an internal email)
"The values are in the correct location but it looks like you need to swap the unit measure and multiplier around (e.g. unit measure = percentage (%), unit multiplier = units"
I have created a new issue to address this: https://github.com/ONSdigital/SDG_11.2.1/issues/179

After creating this milestone to correct the data according to this feedback, I am going to close this issue.


SW expansion not working

twin dragon expansion will not start,
had to go back to a older commit to just get the right verion of the game to start, maybe need to go back more to get  twin dragon expansion to work also.

Hi i tried every possible way to run twin dragon its not working,wanton expansion is working though

this as been verified to be working, and there was a fix by the dev to clear up the first issue so the script was changed back.
the dragon zip should only have the files int it. if there is a folder within the zip, that is holding the files that is the problem.
once i pulled the files out of the folder and only have the required files in the .zip Twin Dragon started just fine

so the wrong way,(the way i had before) was
dragon.zip
|
dragon(a folder)
|
all the *.MAP, *.VOC, *.ART and *.ANM files from "Classic Complete" version (free download from GOG)
this way will not work, all the *.MAP, *.VOC, *.ART and *.ANM files cant be in a folder
they need to be this
dragon.zip
|
all the *.MAP, *.VOC, *.ART and *.ANM files from "Classic Complete" version (free download from GOG)
theres going to be about 73 files in the dragon.zip (or there is for mine
hope this helps. so you know there is no title change, the only way you know it will work is if you go to play the registered version of the game( i know weird there is no title letting you know what you are playing)
if its still not working for you, i dont know, it is working for me and s1eve-mcdichae1 since he is the one who cleaned up the script, i had him check to make sure it works.

So i put in a folder: the sw executable the dragon.zip the tdragon.grp the sw.grp and all the MAP, *.VOC, *.ART and *.ANM files from the shadow warrior retail game and i run the game with ./sw -tdragon.grp ??
Thanks

this is what i have in my folder using the script that we have made
dragon.zip
sw.grp
sw.rts
wanton.dat
wt.grp
a folder named music with all the .ogg files in it
if you are doing this your own way, yes you need the sw executable
and you use sw -gdragon.zi and select the registered-version episode
you dont need tdragon.grp

Just an info the ogg files working only inside the folder that has the sw executable and not if they are in a folder with the name :music
Wanton works if you have only the wt.grp and the sw exe only in the same folder and not another file/s  otherwise it loads the normal game
Twin dragon did not work no mater what i did its like the "-" switch is not acceptable
All the files are taken from the gog release of the game.

then something is messed up with your build, i have loaded a clean OS and used the install script, and the games start just fine for me,
yes the music does not work sitting in the music folder, once out it works fine
sorry i cant be anymore help with this for you as its working as it should for me,
thanks for the fix for the music though

No problem apparently my dragon.zip file is not correct i get a" bus error " on running
It has 73 files inside including the loader.iaf file otherwise they 72.

i have added my dragon.zip to my game data repo.
you might have to download the whole repo, but its there.

Thanks


Add autocomplete + tests + type checking

Fix https://github.com/huggingface/huggingface_hub/issues/1036.
This PR adds static imports in huggingface_hub.__init__.py file. This allows IDEs to have autocomplete capabilities when importing stuff from huggingface_hub:
from huggingface_hub import c # <- "create_commit" suggested here

create_commit( # <- docstring + args help suggested here

To allow this, explicit imports have to be made under the if TYPE_CHECKING section which means newly added modules/functions have to be duplicated in the file (once for lazy load, once for static part). Suggested by @sgugger in https://github.com/huggingface/huggingface_hub/issues/1036#issuecomment-1238095147. I didn't implement it exactly the same way as transformers as we don't need the same level of detail/technicality.
In order to mitigate discrepancies, I added a test that checks all modules are declared twice. When adding a new module in the lazy-loading part, one need to run the following command to generate the static part and then commit the changes:
pytest tests/test_init_lazy_loading.py -k test_static_imports --update-init-file

Finally, this PR adds mypy type checking in the CI for the root __init__.py file. This is to check that we don't have a module exposed that doesn't exist (we previously had from .hf_api import login, logout but login and logout apparently doesn't exist anymore).
EDIT: also added a part in the test to ensure _SUBMOD_ATTRS definition is alphabetically ordered and rewrite it if it's not the case. Doesn't change much things but I tend to prefer (easier to read it/easier to look for something in it).

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

Also very very very much not a fan of mypy. I would have personally written a custom script to do the same check, but to each their own.

@sgugger Out of curiosity, what would be the advantage of having a custom script instead of using mypy here ? Some import stuff is not always trivial so I thought relying mypy would save some hassle to check they are all legit.
 Not highest prio but more on a mid-term perspective.

In my experience, mypy is the one making the stupid mistakes as soon as you have some complex types ;-)

I like the automated completion but IMO it shouldn't be done via pytest but via make style (will add the new lines in init) and make quality (will check that the init is properly written).

@sgugger I made the requested change to have it in a separate folder utils and add the command to make style and make quality. It follows more the transformers pattern like this.
For mypy I'll keep it as it is for now as it is working fine.


Bobcat - HIP19 amendments for alternate security implementations

rendered view: https://github.com/helium/HIP/blob/a1bc6e6bc0d54477298873cb83c9cd81f70e8676/0019-third-party-manufacturers/Bobcat.md

Thanks Jackey!

Hi @JackeyTY, was this meant to fully replace the original easylinkin.md file? This one:
https://github.com/helium/HIP/blob/master/0019-third-party-manufacturers/easylinkin.md
Thanks

I'm going to just merge this since I believe it is a replacement for easylinkin.md

Sorry Jamie, I was traveling back to US last week, must have missed your message! Yes, it can replace the original Easylinkin HIP.

Actually I am planning to make a small change to the HIP19 amendment, stating that the ecc alternative will be used both on light hotspots and full hotspots, should I make another PR under deli-alliance/hotspot-manufacturers?

Yes please!
On Tue, Aug 17, 2021 at 6:55 PM JackeyTY @.***> wrote:

Actually I am planning to make a small change to the HIP19 amendment,
stating that the ecc alternative will be used both on light hotspots and
full hotspots, should I make another PR under
deli-alliance/hotspot-manufacturers?
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/helium/HIP/pull/238#issuecomment-900684378, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAAAO37R4IPDUZDALDK3GBLT5LSGNANCNFSM5AV6LP3Q
.

--
@jamiew https://twitter.com/jamiew | https://jamiedubs.com
https://www.jamiedubs.com/

PR created, thanks!


Add an example of going to deep sleep from wake stub (IDFGH-6564)

Is your feature request related to a problem? Please describe.
Deep sleep wake stubs allow small pieces of code to be executed quickly after deep sleep. For example, deep sleep wake stub may check GPIOs or read some sensor. The deep sleep stub code may need to put the chip back into deep sleep if some condition isn't met.
Describe the solution you'd like

An API which can be called from deep sleep wake stub to go back to deep sleep
Documentation or an example for this API

Describe alternatives you've considered

Let the application boot and then use regular esp_deep_sleep_start function — too slow, affects power consumption
Use ULP coprocessor instead — more difficult to program, limited set of peripherals and GPIOs can be used

Additional context
Originally the feature for the ESP32 was requested in https://www.esp32.com/viewtopic.php?t=2369, and an ESP32 specific example is available at https://gist.github.com/igrr/54f7fbe0513ac14e1aea3fd7fbecfeab. In comments to that gist, users have requested this feature to be provided for ESP32-C3

I will be ready for testing and providing feedback, may stub works for after the first wakeup, the time second wakeup the C3 boots and does not call the sub entry.

Same here

My stub also is not executed second time. I had to revert to older version for this to work. I hope for a solution soon otherwise I am stuck with older version of IDF

@baamiis Can you name the lastest esp-idf version where it still works?

4.22 release it works
4.30 it does not work

I did some further testing. In short, it boils down to the fact that the WDT resets the chip after deep sleep has been re-initiated by the wake up stub.

In my testing, the wakeup is done without a reset, I believe that the WDT does a reset @tsVestor

ESP32S3 has code that looks like
void esp_set_deep_sleep_wake_stub(esp_deep_sleep_wake_stub_fn_t new_stub)
{
#if SOC_PM_SUPPORT_DEEPSLEEP_VERIFY_STUB_ONLY
    wake_stub_fn_handler = new_stub;
#else
    REG_WRITE(RTC_ENTRY_ADDR_REG, (uint32_t)new_stub);
#endif
}

with SOC_PM_SUPPORT_DEEPSLEEP_VERIFY_STUB_ONLY set to 1, so I'm not sure that writing to RTC_ENTRY_ADDR_REG has the desired effect.

Hi @helmut64 @tsVestor @baamiis , about the issue that ESP32-C3 wake stub works for the first wakeup, on second wakeup the C3 boots and does not call the sub entry. Please call ROM function set_rtc_memory_crc() after set wake_stub address to RTC_ENTRY_ADDR_REG.
    // Set the pointer of the wake stub function.
    REG_WRITE(RTC_ENTRY_ADDR_REG, (uint32_t)&wake_stub);
    // Set rtc memory crc to RTC_MEMORY_CRC.
    set_rtc_memory_crc();
    // Go to sleep.
    CLEAR_PERI_REG_MASK(RTC_CNTL_STATE0_REG, RTC_CNTL_SLEEP_EN);
    SET_PERI_REG_MASK(RTC_CNTL_STATE0_REG, RTC_CNTL_SLEEP_EN);
    // A few CPU cycles may be necessary for the sleep to start...
    while (true) {
        ;
    }
    // never reaches here.

@gm-jiang yes the missing "set_rtc_memory_crc ()" was the problem, it has already been discussed and solved here:
https://github.com/espressif/esp-idf/issues/8208

My understanding is that S2/S2 also needs the set_rtc_memory_crc()
The stub code is in common with all ESP32 MCUs

@andrew-elder @helmut64， ESP32-S3 support SOC_PM_SUPPORT_DEEPSLEEP_VERIFY_STUB_ONLY  that it only needs check the CRC value of stub code instead of all of the RTC memory. The stub code entry and stub code CRC could be set by S3 ROM function esp_rom_set_rtc_wake_addr((esp_rom_wake_func_t)esp_wake_stub_entry, stub_length) .

Some codes like
#if SOC_PM_SUPPORT_DEEPSLEEP_CHECK_STUB_ONLY
    extern char _rtc_text_start[];
#if CONFIG_ESP32S3_RTCDATA_IN_FAST_MEM
    extern char _rtc_noinit_end[];
    size_t rtc_fast_length = (size_t)_rtc_noinit_end - (size_t)_rtc_text_start;
#else
    extern char _rtc_force_fast_end[];
    size_t rtc_fast_length = (size_t)_rtc_force_fast_end - (size_t)_rtc_text_start;
#endif // CONFIG_ESP32S3_RTCDATA_IN_FAST_MEM
    // Please note, the entry address of stub code is a fixed address at `_rtc_text_start`.
    esp_rom_set_rtc_wake_addr((esp_rom_wake_func_t)_rtc_text_start, rtc_fast_length);
#else
    // Set the pointer of the wake stub function.
    REG_WRITE(RTC_ENTRY_ADDR_REG, (uint32_t)&wake_stub);
    set_rtc_memory_crc();
#endif // SOC_PM_SUPPORT_DEEPSLEEP_CHECK_STUB_MEM

Thank you for the advise.

@gm-jiang - thank you! That works on my ESP32S3.
I also see that ESP32S3 uses
uint64_t rtc_time_get(void)
{
    SET_PERI_REG_MASK(RTC_CNTL_TIME_UPDATE_REG, RTC_CNTL_TIME_UPDATE);
    uint64_t t = READ_PERI_REG(RTC_CNTL_TIME0_REG);
    t |= ((uint64_t) READ_PERI_REG(RTC_CNTL_TIME1_REG)) << 32;
    return t;
}

so no need to spin/wait for the RTC reading to be populated in the registers.

Hi @andrew-elder, is there any problem found in function rtc_time_get()?

@gm-jiang - no problem at all that I am aware of. The code is just a little different than that used by an ESP32 in other related postings. It took me a while to figure out that ESP32S3 required a different sequence, so I posted here for others to use.

@andrew-elder Thanks for your question, I think it's an improvement in hardware design, but needs to be double-checked.

Hi @andrew-elder, It's been confirmed that this is a hardware improvement.

I'm new to the ESP32-C3. All the above examples are fantastic for me to get started, but what's the easiest way to transmit and receive on the UART in the rtc wake stub? Any example code or pointers will be greatly appreciated. Thanks.

Hi @jasaw , before enter deep-sleep wake stub, BootROM will do some initialization work on uart0. The
transmit and receive functions provided by ROM can work in stub. You can find these functions in components/esp_rom/include/esp_rom_uart.h.

Thank you for the response and pointing me to the right direction.
I've been looking for example of how to memory map the SPI flash. Looks like there's a spi_flash_mmap function in ROM, but it appears to be overridden by the SDK implementation that lives in RAM.
Is it safe for me to call the ROM version spi_flash_mmap directly from my RTC wake-up stub or is there a recommended way of doing SPI flash mmap?

Hi @jasaw, Yeah，we do provide an option to choose whether to use the spi_flash_mmap API in ROM or the API in IRAM，the purpose is to save RAM for some applications.
In fact, flash mmap still has many system-related dependencies, such as the system-level function malloc/free. These system-level functions may not be able to run in wake stub.
RTC wake up stub should be as simple as possible, e.g. read some sensor data, pulse count，etc.
Could you tell me why you need call flash mmap API in wake stub?

@gm-jiang I'm trying to write data into a partition in the SPI flash from the RTC wake-up stub, and at a minimum, I'll need spi_flash_write to write to flash and provide an absolute address if I don't have memory map.
Related question, is it safe to call the ROM version of spi_flash_write and spi_flash_read?

@jasaw the wakeup stub should be used only for very little code blocks, it has tons of restrictions and every line code must be done with care, no C runtime code can be called (e.g. 64bit multiply, etc. because this code is in the flash)
I recommend to collect your sensor data into the RTC memory and wakeup completely after certain amount of records. This allows to access the flash using the full tuning OS.
Regards Helmut

I suggest that wake-up stub receive sensor data and save this data to RTC_RAM,  then write the data to flash when boot chip.
For example: you can make the chip boot up every one hour, and write data to flash in the main program. But please note that the RTC RAM is small and can not store too much data.

@jasaw For read and write data from/to SPI flash, I think you can refer to https://docs.espressif.com/projects/esp-idf/en/latest/esp32/api-reference/storage/spi_flash.html#spi-flash-access-api

@jasaw, I think you need call  ROM function esp_rom_spiflash_config_param to set chip_size after esp_rom_spiflash_attach,  IIRC the default chip_size was initialized as 2MB.

@gm-jiang Thanks. Calling esp_rom_spiflash_config_param to set the chip size fixed the read issue for me.
esp_rom_spiflash_erase_area appears to be missing from the ESP32-C3 linker file. Should I copy the ESP32 implementation or can I add that function in the linker file?

@jasaw You can find this  PROVIDE( SPIEraseArea = 0x400001e4 ) it in components/esp_rom/esp32c3/ld/esp32c3.rom.ld, and you can rename it PROVIDE ( esp_rom_spiflash_erase_area = SPIEraseArea ); if needed.

I'm having troubles going back to sleep in the stub, either it continues to boot or it bootloops.
target = ESP32c3
To start deepsleep:
esp_deep_sleep_enable_gpio_wakeup(PIN_BIT_MASK(GPIO_NUM_3) , ESP_GPIO_WAKEUP_GPIO_HIGH);  esp_sleep_enable_timer_wakeup(5*1000*1000);  esp_set_deep_sleep_wake_stub(controller_wakeup_stub);  esp_deep_sleep_start();
Then the stub is simply (as a test):
`
static void RTC_IRAM_ATTR controller_wakeup_stub()
{
REG_WRITE(RTC_ENTRY_ADDR_REG, (uint32_t)&controller_wakeup_stub);
set_rtc_memory_crc();
CLEAR_PERI_REG_MASK(RTC_CNTL_STATE0_REG, RTC_CNTL_SLEEP_EN);
SET_PERI_REG_MASK(RTC_CNTL_STATE0_REG, RTC_CNTL_SLEEP_EN);
while (true) {
    ;

}
`
in sdkconfig I have
CONFIG_BOOTLOADER_RESERVE_RTC_SIZE=0x10 CONFIG_BOOTLOADER_CUSTOM_RESERVE_RTC=y CONFIG_BOOTLOADER_CUSTOM_RESERVE_RTC_SIZE=0
(not much documentation in the two different sizes, I already tried increasing both but the outcome is the same

@peturdainn Could you test your wake up stub code without secure boot?

@peturdainn Could you test your wake up stub code without secure boot?

This does not seem to change anything
I created a stripped down project to run on a devboard, first test is wake from timer.
Would like to know what is wrong with it: either does a boot loop or quits deep sleep.
Does it need reprogramming the timer perhaps?
Next test is wake from GPIO
sdkconfig.defaults.txt
main.c.txt

First conclusion for GPIO deep sleep wakeup:
wake_stub with secure bootloader doesn't work, I get rst:0x1 POWERON
Ran same code with or without secure bootloader (two different boards, yes)
IMPORTANT question: is this by design?
Because if this isn't supported there are some big implications for this project.

Hi @peturdainn, could you provide more detials about the "Datasheet says lower 16 bits", like in TRM(Technical Reference Manual) v0.5 in x pages. I do not see anythings about this in the Datasheet or TRM, thanks!
If you want read some sensor periodically in the stub, it is indeed necessary to configure the wake-up time in the stub, then set stub entry and CRC, then going to deep sleep again.
And I will try your example, we need to confirm further the issue about "wake_stub with secure bootloader doesn't work".

Looks like I misread the datasheet, significant bits are indeed 15-31. Sorry about that. Debug sessions getting too long ;)
Have figured out as much, now trying to get this working properly
thanks, I'll put my testcode on github later today for reference

Everything OK now, managed to create some code that uses wake stub for GPIO and Timer wakeup.
I also got another devkit to test with secure bootloader, and this works too.
Presumably the issue with secure bootloader is related to the device I tested on.
Have created a test/demo app for ESP32-c3:
https://github.com/peturdainn/ESP32c3_deepsleep_wakestub_test
There is both a secure and non-secure sdkconfig.defaults included, bring your own signing key ;)
Remarks welcome.

@peturdainn I also tested that the RTC wakeup stub works with secure boot (using flash encryption).
About the issue The bootloop was fixed by clearing RTC_CNTL_INT_CLR_REG (well, clearing the INTs by writing 0xFFFF)， we'll provide an api for the user's stub code that can reconfigure the wakeup timer, maybe something like this
static uint64_t RTC_IRAM_ATTR wake_stub_rtc_time_get(void)
{
    SET_PERI_REG_MASK(RTC_CNTL_TIME_UPDATE_REG, RTC_CNTL_TIME_UPDATE);
#ifdef CONFIG_IDF_TARGET_ESP32
    while (GET_PERI_REG_MASK(RTC_CNTL_TIME_UPDATE_REG, RTC_CNTL_TIME_VALID) == 0) {
        esp_rom_delay_us(1);
    }
    SET_PERI_REG_MASK(RTC_CNTL_INT_CLR_REG, RTC_CNTL_TIME_VALID_INT_CLR);
#endif
    uint64_t t = READ_PERI_REG(RTC_CNTL_TIME0_REG);
    t |= ((uint64_t) READ_PERI_REG(RTC_CNTL_TIME1_REG)) << 32;
    return t;
}

void RTC_IRAM_ATTR esp_wake_stub_set_wakeup_time(uint64_t time_in_us)
{
    uint32_t slow_clk_value = REG_READ(RTC_SLOW_CLK_CAL_REG);
    uint64_t rtc_count_delta = ((time_in_us * (1 << RTC_CLK_CAL_FRACT)) / slow_clk_value);
    uint64_t rtc_curr_count = wake_stub_rtc_time_get();

    rtc_hal_set_wakeup_timer(rtc_curr_count + rtc_count_delta);
}

@gm-jiang a yes, rtc_hal_set_wakeup_timer() is what I need(ed), it takes care of setting RTC_CNTL_MAIN_TIMER_ALARM_EN
looking back, these were probably the two issues that I had:

RTC_CNTL_MAIN_TIMER_ALARM_EN was getting cleared by setting the new trigger
RTC_CNTL_INT_CLR_REG is needed for timer (worked without it for GPIO)

Any API is better than having to scrape bits and pieces together ;)

Turns out that when starting deep sleep, the function esp_deep_sleep_wakeup_prepare() will modify some GPIO settings, something I would have expected would be done in esp_deep_sleep_enable_gpio_wakeup()
This includes switching pull-up/down based on configured level and HOLD.
IMHO this functionality could be split better, and pin config could be left to the caller (or print an error if configured incorrect)?

Thanks for reporting and sharing the updates, fix is available at https://github.com/espressif/esp-idf/commit/a6f7035c8c7badd83e5f348b92704b3c499dbea8, feel free to reopen. Thanks.

@Alvin1Zhang any comment on my last remark about the GPIO settings changed in esp_deep_sleep_wakeup_prepare()?
As I wrote, it would make more sense to have this in esp_deep_sleep_enable_gpio_wakeup() so for specific hardware setups it is still possible to override the PU/PD config
Or do I need to create a new issue for this since this remark is not the topic of this issue?

Hi, @peturdainn In esp_deep_sleep_wakeup_prepare, the IO that is set to wake up at high level will be configured as pull-down, and the IO that is set to wake up at low level will be configured as pull-up, which I think is reasonable. If you have more questions, it's better to create a new issue and describe your application scenario and expected behavior in detail.

Hi,
How do I do Bluetooth transmit and receive in the wake stub? I can send my own raw bluetooth packets, so I don't need the bluetooth stack.

@jasaw This is not feasible, in wake_stub, radio is not initialized yet, and the size of RTC_RAM is not enough to store the initialization code

@esp-wzh Is the radio initialization code in ROM? I can map the ROM radio init code and call the from RTC_RAM?

No, the initialization process is very complicated and it is  placed in Flash, and the radio will rely on some pll clock and power initialization in the bootloader, so if you needs to use the radio, it is worth running the bootloader


Some questions about the project

Two questions:
1.Do you find performance reduction if you increase the size of the generated image? Such as the dataset of the sketch? Can you give some suggestions if I want to increase the size of the results?
2.How to modify the network if I want to generate specific kind of images, just like the conditional GAN? Any suggestions?
Thanks!

We didn't really perform any experiments with increased image resolution. But my intuition says simply increasing the image size would result in performance deterioration. I think you'd have to correspondingly increase the dataset size. Also, I think it'll require some hyperparameter tuning. But I think you should observe better performance once you make these changes.
In order to get conditional generation in a DeliGAN setting, just take any conditional GAN framework, and sample from the mixture of Gaussian setup as in DeliGAN, instead of using a unit normal distribution . This was the point of DeliGAN. View it more like a layer that can be plugged into any other architecture to learn a more flexible prior distribution for the generator. You could also tweak the DeliGAN model we have provided to emulate the conditional GAN setup, but that would be more cumbersome.


chore: fix up comments

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#606  👈 (View in Graphite)
#605
#604
master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Merge activity

Dec 10, 6:21 PM EST: A user started a stack merge that includes this pull request via Graphite.


added rails 5, added fix for timedout flash message from devise

Thanks for this contribution, but I thought it's unreliable (and indirect) to check the value for being Boolean, so I made my own take on this which is a key whitelist.


Rename Decorator to Directive

Decorator is used internally in TS to mean something else

Note that directive is also commonly used in TS internals ("use strict", triple slash directives, type reference directives)


All my tests except HostFrameIntegration on the validator failed with a NullReferenceException

Hello,
I just finished implementation of a wopi host in Java. The CheckFileInfo and GetFile are accessible at the endpoints http://domain.com/wopi/files/(fileId)[/contents]. The second test group (BaseWopi) failed and I don't understand why.
Here is how my restful is declared:
@Stateless @Path("wopi") public class Wopi {  ...... }
And here is the method for CheckFileInfo request :
`  @GET
@Path("/files/{idFile}")
@Produces(MediaType.APPLICATION_JSON)
public Response checkFileInfo(@QueryParam("access_token") String token, @PathParam("idFile") String idFile, @Context ContainerRequestContext containerRequest) {
    UriInfo info = containerRequest.getUriInfo();
    CheckFileInfo fileInfo = new CheckFileInfo();  // Class with CheckFileInfo properties
    TNewUser user = null;
    try {
        user = tokenService.validateToken(token, info.getPath()); // validate token; got null if not valid
    } catch (ParseException ex) {
        java.util.logging.Logger.getLogger(Wopi.class.getName()).log(Level.SEVERE, null, ex);
    }
    if(user == null){
        Response.ResponseBuilder responseBuilder = Response.status(Response.Status.UNAUTHORIZED);
        responseBuilder.entity("Unknown User");
        return responseBuilder.build();
    }`

`
TFile f = tFileFacadeREST.find(idFile);   // Looking for file in DB
    if (f == null) {
        Response.ResponseBuilder responseBuilder = Response.status(Response.Status.NOT_FOUND);
        responseBuilder.entity("File not found");
        return responseBuilder.build();
    }
    fileInfo.setOwnerId(f.getOwner().getIdUser());
    fileInfo.setBaseFileName(f.getName() + (f.getFileExtension() != null ? "." + f.getFileExtension() : ""));
    fileInfo.setSize(f.getMaxSize());
    fileInfo.setVersion(f.getVersion());
    fileInfo.setUserId(f.getOwner().getIdUser());
    Response.ResponseBuilder responseBuilder = Response.ok((Object)fileInfo);
    responseBuilder.header("Content-Type","application/json");
    responseBuilder.header("X-WOPI-HostEndpoint","/wopi/files/"+idFile);
    responseBuilder.header("X-WOPI-MachineName",audit.getHostName(request));
    responseBuilder.header("X-WOPI-ServerVersion","1.0");
    return responseBuilder.build();
}`

Here is the stack trace of the exception:
CheckFileInfoFieldsNotToBeSetByHosts details System.NullReferenceException: Object reference not set to an instance of an object. at WopiValidator.Core.Requests.RequestBase.GetResponseData(HttpWebResponse response, Boolean isTextResponseExpected, TimeSpan elapsed) at WopiValidator.Core.Requests.RequestBase.ExecuteRequest(RequestExecutionData executionData, String userAgent, Boolean hasToBeSuccessful) at WopiValidator.Core.Requests.WopiRequest.Execute(String endpointAddress, String accessToken, Int64 accessTokenTtl, ITestCase testCase, Dictionary2 savedState, IResourceManager resourceManager, String userAgent, RSACryptoServiceProvider proofKeyProviderNew, RSACryptoServiceProvider proofKeyProviderOld)
at WopiValidator.Core.TestCaseExecutor.ExecuteTestCase(ITestCase testCase)
at System.Linq.Enumerable.WhereSelectListIterator2.MoveNext() at System.Linq.Enumerable.FirstOrDefault[TSource](IEnumerable1 source, Func2 predicate) at WopiValidator.Core.TestCaseExecutor.Execute() at Microsoft.Office.Web.WopiTestService.ExecuteTestMethod.ProcessRequest(HttpContext context)
Can somebody help me to solve this issue please ?

@adar237 Is your WOPI domain on the test environment allow list? If not, then Office Online will refuse to make outgoing WOPI requests to your domain. This applies to the validator as well as all the apps.

@tylerbutler thank you for your answer. yes it is.

@adar237 OK, please follow the troubleshooting guide and provide a Fiddler trace of the validator page while it is executing the tests. That will give me enough info to diagnose the problem.
Also, if you're passing an access_token_ttl value, try removing it. It possible you're using an invalid value there.

@tylerbutler thanks for your quick answer. I've followed the troubleshooting guide and when I activate the capture, I'm unable to access secure sites. As you can see in the attachment this is also the case of onenote.officeapps-df.live.com. Don't know how to do now. :(

@tylerbutler forget about my last comment I've been able to solve it (thanks to http://www.telerik.com/blogs/configuring-firefox-for-fiddler); now I can provide you the .saz file in the archive attached.
trace.zip

@adar237 Your WOPISrc points to a port other than 80 or 443: http://www.niix2u.com:8282/wopi/files/...
Office Online only makes outgoing network requests to ports 80 or 443 (and only 443 in production, since HTTPS is required in production).

@tylerbutler it's working now ; indeed I completely missed this points. Thanks once dude. :+1:


Configuration Modification！

Hi MingTao,
Great of your work！My server configuration has only two 3090 GPUs, how do I modify the script/train.sh file?
thanks.

Hi MingTao,
When I was troubleshooting the problem, I found that the dataset was not loading. Further I found out that the reason was that the dataset did not have... /data/coco/train/filenames.pickle file, can you provide some information about this file? I look forward to your reply.

When I was troubleshooting the problem, I found that the dataset was not loading. Further I found out that the reason was that the dataset did not have ../data/coco/text/COCO_train2014_000000106379.txt file, can you provide some information about this file? I look forward to your reply.

Hi, you can modify the set CUDA_VISIBLE_DEVICES=0,1 and nodes=2 in train.sh for your training. The data error looks like there is no prepared dataset under ./data. You can download it according to the readme.

Hi, you can modify the set CUDA_VISIBLE_DEVICES=0,1 and nodes=2 in train.sh for your training. The data error looks like there is no prepared dataset under ./data. You can download it according to the readme.

Thank you very much for your reply. Based on your answer, I solved the current problem. I am a new graduate student and I just came across the text to image task. I couldn't find . /cfg/coco.yml inside . /data/coco/npz/coco_val256_FIDK0.npz file, can you tell me where I can download this file and the information about it?

Hello, the coco.yml is under ./code/cfg/ folder and the npz file has been uploaded to Google Drive, you can find the link (https://drive.google.com/file/d/15Fw-gErCEArOFykW3YTnLKpRcPgI_3AB/view?usp=sharing) in the readme.


Google colab

Hi! Can somebody please make a google colab version? Like this https://colab.research.google.com/github/jantic/DeOldify/blob/master/ImageColorizerColab.ipynb

I will add a colab version for evaluation. It will take some time.

Is there any updates?

I have found it here https://colab.research.google.com/github/tugstugi/dl-colab-notebooks/blob/master/notebooks/SuperSloMo.ipynb
But, I get an error about MKV container. Don't know what to do ....


Hybrid - Android - App crashes on tapping "Domains" in settings page

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: V9. 0.66-0
Reproducible in staging?: N
Reproducible in production?: N
If this was caught on HybridApp, is this reproducible on New Expensify Standalone?: Y
Issue reported by: Applause Internal Team
Action Performed:

Launch app
Tap settings
Tap Domains

Expected Result:
App must not crash on tapping "Domains" in settings page.
Actual Result:
App crashes on tapping "Domains" in settings page.
Workaround:
Unknown
Platforms:

[ ] Android: Standalone
[x] Android: HybridApp
[ ] Android: mWeb Chrome
[ ] iOS: Standalone
[ ] iOS: HybridApp
[ ] iOS: mWeb Safari
[ ] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos
2311.txt
https://github.com/user-attachments/assets/4ab0aeed-f476-4e55-9c63-89e9a0255f1e

View all open jobs on GitHub

I am not sure if this is hybrid app related, this button just opens the page in a browser

I couldn't reproduce this one in Browserstack @mountiny

This is the exception for this case
Fatal Exception: com.facebook.react.common.JavascriptException: Error: TaskQueue: Error with task : [Pusher] instance not found. Pusher.subscribe()
            most likely has been called before Pusher.init(), js engine: hermes, stack:
anonymous@1:3789481
processNext@1:846927
_processUpdate@1:845633
anonymous@1:524029
_callTimer@1:522946
_callReactNativeMicrotasksPass@1:523147
callReactNativeMicrotasks@1:525099
__callReactNativeMicrotasks@1:217573
anonymous@1:215773
__guard@1:217447
flushedQueue@1:215684
callFunctionReturnFlushedQueue@1:215540

       at com.facebook.react.modules.core.ExceptionsManagerModule.reportException(ExceptionsManagerModule.java:65)
       at com.facebook.jni.NativeRunnable.run(NativeRunnable.java)
       at android.os.Handler.handleCallback(Handler.java:942)
       at android.os.Handler.dispatchMessage(Handler.java:99)
       at com.facebook.react.bridge.queue.MessageQueueThreadHandler.dispatchMessage(MessageQueueThreadHandler.java:27)
       at android.os.Looper.loopOnce(Looper.java:211)
       at android.os.Looper.loop(Looper.java:300)
       at com.facebook.react.bridge.queue.MessageQueueThreadImpl$4.run(MessageQueueThreadImpl.java:235)
       at java.lang.Thread.run(Thread.java:1012)

I believe this might have been fixed now, feel free to ask for a retest and close

Sounds good — thanks Vit!

Still waiting for it to be retested, so not overdue!

Still waiting on testing!

Before this goes overdue — still waiting for it to be tested 😂

Going to also post in the room to see if we can get this moving

Posted in #qa here — https://expensify.enterprise.slack.com/archives/C9YU7BX5M/p1733941658006679

not repro
https://github.com/user-attachments/assets/9b43ca75-fff5-4cd0-81ee-75f2b09e5d58

Issue not reproducible during KI retests. (First week)

If this is no longer happening, let's close


Compile and run bal files with jballerina run commond

Purpose

Support jballerina run sample.bal
Also support running main functions via CLI for unit tests
Fix services with main functions

Fixes #
https://github.com/ballerina-platform/ballerina-lang/issues/15817
Approach

Describe how you are implementing the solutions along with the design details.

Samples

Provide high-level details about the samples related to this feature.

Remarks

List any other known issues, releated PRs, TODO items or any other notes related to the PR.

Check List

[ ] Read the Contributing Guide
[ ] Required Balo version update
[ ] Updated Change Log
[ ] Checked Tooling Support (#)
[ ] Added necessary tests

[ ] Unit Tests
[ ] Spec Conformance Tests
[ ] Integration Tests
[ ] Ballerina By Example Tests

[ ] Increased Test Coverage
[ ] Added necessary documentation

[ ] API documentation
[ ] Module documentation in Module.md files
[ ] Ballerina By Examples

Codecov Report

Merging #15837 into jballerina will decrease coverage by 0.06%.
The diff coverage is 0%.

@@               Coverage Diff                @@
##             jballerina   #15837      +/-   ##
================================================
- Coverage         13.07%   13.01%   -0.07%
+ Complexity         3317     3307      -10
================================================
  Files              1494     1494
  Lines             75564    75564
  Branches           9865     9865
================================================
- Hits               9879     9833      -46
- Misses            64753    64799      +46
  Partials            932      932

Impacted Files
Coverage Δ
Complexity Δ

...ballerinalang/compiler/desugar/ServiceDesugar.java
0% <0%> (ø)
0 <0> (ø)
:arrow_down:

...inalang/stdlib/file/service/endpoint/Register.java
0% <0%> (-33.34%)
0% <0%> (-5%)

...lerinalang/stdlib/file/service/endpoint/Start.java
0% <0%> (-27.78%)
0% <0%> (-1%)

...a/org/ballerinalang/net/grpc/ServicesRegistry.java
63.15% <0%> (-26.32%)
1% <0%> (ø)

.../ballerinalang/stdlib/file/service/FSListener.java
0% <0%> (-19.45%)
0% <0%> (-2%)

...ang/stdlib/file/service/endpoint/InitEndpoint.java
25.92% <0%> (-7.41%)
3% <0%> (-1%)

...allerinalang/net/grpc/ServerServiceDefinition.java
57.14% <0%> (-2.05%)
3% <0%> (-1%)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 28e2c78...9c4baa8. Read the comment docs.


Add switches for match only/mismatch only

Do this once https://github.com/AndrewRathbun/SigHunter/issues/6 is implemented


Support proxy auth

Fixes #476.
Let me know if it sounds right to you.

Coverage increased (+0.2%) to 94.393% when pulling 48bc8fbadeb3b9e1e52d13fa7f524d0244058a7c on mawrkus:support-proxy-auth into e8c5c49ea2f2cf4fd45eaf81270a6d23546e2c93 on mzabriskie:master.

Coverage increased (+0.2%) to 94.393% when pulling 8647ffa410b09337c16508089fe3837fe0fa6662 on mawrkus:support-proxy-auth into e8c5c49ea2f2cf4fd45eaf81270a6d23546e2c93 on mzabriskie:master.

Thanks for the PR. Looks like there is a merge conflict. Would you mind resolving and we'll get this merged?

Coverage remained the same at 94.419% when pulling 3d1ec20ab336aef80f2220fe829bba7520f32fbc on mawrkus:support-proxy-auth into b78f3fe79298a000f056ff40bbd1447c2d667cc5 on mzabriskie:master.


Add the table of content to the sidebar

Similar to how Google Docs would display the document outline on the left sidebar.

Done @ 86a81036e437de83abf0368e85493ae8a0af836c.


misleading requirements

keras-rl works fine with python 3.5, the readme should reflect this.

Maybe it's better to just mark it as Python 2.7+ as well.

I think mentioning 2.7 and 3.5 is fine since we have tests for these 2. Thanks!


OAuth2 Endpoint for Google Updated

What version of Go are you using (go version)?

$ go version
go version go1.14.1 darwin/amd64

Does this issue reproduce with the latest release?
Yes
What did you do?
I'm building an OAuth app, and it looks like the endpoint for authorization for OAuth2 for google is: https://pkg.go.dev/golang.org/x/oauth2/google?tab=doc#pkg-variables
var Endpoint = oauth2.Endpoint{
        AuthURL:   "https://accounts.google.com/o/oauth2/auth",
        TokenURL:  "https://oauth2.googleapis.com/token",
        AuthStyle: oauth2.AuthStyleInParams,
}

What did you expect to see?
But it looks like https://developers.google.com/identity/protocols/oauth2/web-server#httprest recommends this endpoint:

Google's OAuth 2.0 endpoint is at https://accounts.google.com/o/oauth2/v2/auth. This endpoint is accessible only over HTTPS.

I already asked this question on golang nuts last week, with no response: https://groups.google.com/g/golang-nuts/c/_3Eu_yfWzEc

Hi,
You should open an issue in this repo https://github.com/golang/oauth2

Thanks! https://github.com/golang/oauth2/issues/428


Error when executing Sphinx command

What happened?
Execute make -C docs livehtml in the project root path, and an error is reported
What should've happened instead?
Additional details

If you choose use_docker =no when creating a project, no error will be reported if you do not use docker


How can this project be compiled with MinGW on Windows 10?

How can this project be compiled with MinGW on Windows 10? I really need this way to compile. Because other third-party libraries in my project are compiled with MinGW.

This is an old mirror, please see: https://bugzilla.nasm.us/


fix: add required permissions and credentials setup guide

Issue #, if available:
fixes: #7
Description of changes:
This adds instructions on how to load credentials as well as the permissions those credentials require.
Also, prettierifies CONTRIBUTING and CODE_OF_CONDUCT because apparently those weren't prettierified yet.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
Check any applicable:

[ ] Were any files moved? Moving files changes their URL, which breaks all hyperlinks to the files.

Thanks


Add Python wrappers for all DPC++ implementations of benchmarks using dpctl

Along with directly calling the DPC++ implementations of the benchmark, we should also add a Python wrapper for all such DPC++ versions of the benchmarks. Once we have the wrappers the native benchmarks can be evaluated via Python. Another benefit is to catch any overhead introduced by dpctl bindings.

[x] black-scholes
[x] pairwise-distance
[x] knn
[x] kmeans
[X] l2-norm
[x] dbscan
[x] rambo

An initial attempt to implement a native wrapper for the black-scholes benchmark is in #61

All sycl implementations are available now


Unresolved assembly binding redirect

Why assembly binding redirect is not resolved for assembly System.Numerics.Vectors <IP_ADDRESS> (package : 4.5.0) ?
It should be emited on app.config as package Microsoft.CodeAnalysis.CSharp 3.0.0 depends on package System.Numerics.Vectors >= 4.4.0 (assembly: <IP_ADDRESS>)
We have to add it manually to the app.config to avoid a FileLoadException
Steps to reproduce
Project file
<Project Sdk="Microsoft.NET.Sdk">
  <PropertyGroup>
    <OutputType>Exe</OutputType>
    <TargetFramework>net471</TargetFramework>
  </PropertyGroup>

  <ItemGroup>
    <PackageReference Include="System.Numerics.Vectors" Version="4.5.0" />
    <PackageReference Include="Microsoft.CodeAnalysis.CSharp" Version="3.0.0" />
  </ItemGroup>
</Project>

Directory contents:
/
- RarDemo.csproj
- Program.cs

Program.cs content
using Microsoft.CodeAnalysis.CSharp;

namespace RarDemo
{
    class Program
    {
        static void Main(string[] args)
        {
            CSharpSyntaxTree.ParseText("class X { private int _x; }");
        }
    }
}

Command line
msbuild RarDemo.csproj /bl

Expected  behavior
Execute without any exception
Actual behavior
System.IO.FileLoadException: 'Could not load file or assembly 'System.Numerics.Vectors, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. The located assembly's manifest definition does not match the assembly reference. (Exception from HRESULT: 0x80131040)'
Environment data
msbuild /version output:
Microsoft (R) Build Engine version 15.9.21+g9802d43bc3 for .NET Framework
Copyright (C) Microsoft Corporation. All rights reserved.
<IP_ADDRESS>4
OS info: windows 10 v1709 (Build 16299.547)

any chance to make this work without adding manual SuggestedBindingRedirects ?


Allow --px-icon-stroke-width to be set from parent element(s)

Pull Request

A description of the changes proposed in the pull request:

The CSS variable --px-icon-stroke-width can now be applied from a parent element.
For example:
<my-cool-element style="--px-icon-stroke-width: 3;">
  <px-icon icon="px-fea:analysis"></px-icon>
</my-cool-element>

A reference to a related issue (if applicable):

An alternative approach to https://github.com/predixdesignsystem/px-app-nav/pull/96

this also resolves https://github.com/predixdesignsystem/px-app-nav/pull/96


Uncaught TypeError: Cannot read property 'length' of undefined in Chrome 48

As of Chrome 48 (specifically tested on 48.0.2564.97), the following error appears upon initialization
Messenger()

yields...
Uncaught TypeError: Cannot read property 'length' of undefined (line 840)

It appears this.history is not being set...

Is no one else having this issue? Now on Chrome 51 and issue still exists. Even with 1.5

I also have this error, but not how to fix it

@crissty I ended up removing the plugin and using my own code since this project doesn't seem to be thriving

Do either of you have an example page where this is happening? I can't seem to replicate it.

I am having a similar issue but for this.options.themes in the file https://github.com/HubSpot/messenger/blob/master/docs/welcome/javascripts/theme-sel.js#L25:

Uncaught TypeError: Cannot read property 'themes' of undefined

Got it!!! My similar issue was gone with UnderscoreJS VERSION 1.4.3 and BackboneJS VERSION 0.9.10.


Adding reading time post does not include the Tag files

https://github.com/satnaing/astro-paper/blob/main/src/content/blog/how-to-add-an-estimated-reading-time.md
to get this to work on mine I needed to add await to the getPostsByTag method in the index.astro.
I might also need to do the same in the [page].astro too

Yep
I think I've also mentioned that in this blog post.

Hi @satnaing, I could not see that in the post, that's why I made the issue


Bookkeeper OOM

We're getting OOM from bookkeepers only in a single cluster.
I'm attaching config file, an output of jmap -histo and a heap dump of a bookie experiencing OOM.
We're setting heap space to 4g, I wonder if  dbStorage_rocksDB_blockCacheSize=4294967296 could be the issue, does this memory come from direct memory? or heap space?
By the way, we've disabled readAheadCache because we were getting horrible performance, directly reading from disk stressed the disks much more and proved to be more effective at draining backlog, though this seems strange.
jmap-histo.txt
bookkeeper.conf.txt
ip-10-64-102-226-heap.bin

We're setting heap space to 4g, I wonder if dbStorage_rocksDB_blockCacheSize=4294967296 could be the issue, does this memory come from direct memory? or heap space?

The rocksdb memory is allocated from the C++ library, and it's completely outside the JVM. It won't contribute to neither heap or direct memory.
I tried to open the heap dump with several tools but it looks invalid and the fail to process it.
From the histo, it looks like the reason for the OOM are the 3.7G of heap retained in long[] arrays
 num     #instances         #bytes  class name
----------------------------------------------
   1:<PHONE_NUMBER>224  [J
   2:          4249        4305384  [Ljava.lang.Object;
...

Can you take a look where the references to these arrays are coming from?
In any case, if you are storing a lot of entries for long time, try to increase the JVM heap size.
You can check the current heap & direct mem utlization in bookies on the data/bookkeeper/bookie-stats.json:
...
 "jvm.DIRECT_MEMORY_TOTAL" :<PHONE_NUMBER>,
  "jvm.DIRECT_MEMORY_USED" : 178203,
  "jvm.GC_OLD_COUNT" : 0,
  "jvm.GC_OLD_TIME" : 0,
  "jvm.GC_YOUNG_COUNT" : 2,
  "jvm.GC_YOUNG_TIME" : 102,
  "jvm.HEAP_TOTAL" :<PHONE_NUMBER>,
  "jvm.HEAP_USED" : 145288440,
  "jvm.NETTY_POOL_ALLOCATED" : 268435456,
  "jvm.NETTY_POOL_USED" : 1056768,
...

@merlimat we're gonna try incrementing heap without decrementing rocksdb cache then.
Do you know why  readAheadCache is not working for us? we have desabled it now.

@merlimat We increased our heap to 8GB and had the same issue. We took another dump (you can download it here: https://s3.amazonaws.com/pulsardumps/dump_ip-10-64-103-165.tar.gz)
We found the same behaviour with the long[]:

These are the objects referencing those longs:

Heap Usage of the last two days:

@estebangarcia I took a look at the heap dump.
It seems like there are a lot of entries that were stored into the read cache. Just the hashmaps that are used to track the read cache are taking 1.7Gb of heap memory.
You are saying that you have the read-ahead cache disabled, right? In any case, the entries are inserted into read-cache after reading (the intention is to save eventual subsequent reads, though it might not be the best option...).
I think you can reduce the heap size needed by the hashmap, if you reduce the size of the read-cache:
dbStorage_readAheadCacheMaxSizeMb=12288

Try to tune this down to something like 512m or 1G and the memory usage should not grow much.

To clarify, the 12Gb configured there are referring to direct memory where the entries are stored in the read cache.
On top of it, we need to keep a hashmap (in JVM heap) to index the entries with their location in the direct memory. For each entry there will be (8 * 4) bytes + the overhead of the hasmap (target fill rate is 66%, before triggering a hashmap expansion).

@merlimat, thanks for the help.
Have you considered using a full off-heap map for this use case? I found this two libraries https://github.com/cfelde/BinaryOffheapHashMap and https://github.com/snazy/ohc
Using a full off-heap map would allow the readahead cache to grow indefinitely without affecting heap and GC, the only downside is that keys have to be serialized and copied for usage, which would introduce a small overhead, this would be great for misses most of all, if this is seen as a problem we could use something like a HyperLogLog on heap to know if a key is present in the off-heap cache before accessing it.

I think the question here is answered. Close this issue. We can open a new issue if we need to introduce the off-heap entry index map.


Surface more information during reader/plugin selection

See the original issue here for more information from aicsimageio. In short, it would be useful in some use cases to provide more information about what BioImage (previously AICSImage) is doing under the hood during reader selection.
Originally submitted by @tlambert03

I wonder if it would be enough to have:
get_all_readers_for_given_file(filepath)
then loop over readers, try each one, get some string message back about why it didn't work.

The difference between what it does now and what you are proposing being that currently we stop at the first reader that works but it would be ideal to see all working readers? That seems doable & easy to implement

If I recall correctly, the main issue was about surfacing why something didn't work (not just that it didn't work).  The Bioformats reader is particularly tough because it requires a java runtime, so even if you have bioformats_jarinstalled, but don't have openjdk or the like, then you'll get an error, but the implementation as it was in aicsimageio didn't surface that issue, it just said:
>>> rdr = AICSImage.determine_reader('/Users/talley/Downloads/coupe shg stack_0001.oir')

AICSImage does not support the image:
 '/Users/talley/Downloads/coupe shg stack_0001.oir'. File extension suggests
format: 'oir'. Install extra format dependency with: `pip install bioformats_jar`.

when in fact the real issue was only surfaced if you manually went in and tried to instantiate a bioformats reader:
>>> im = BioformatsReader('/Users/talley/Downloads/coupe shg stack_0001.oir')

RuntimeError:
BioformatsReader requires a java executable to be available
in your environment. If you are using conda, you can install
with `conda install -c conda-forge scyjava`.

Note: you may need to reactivate your conda environment after
installing opendjk. If you still have this error, try:

# mac and linux:
export JAVA_HOME=$CONDA_PREFIX

# windows:
set JAVA_HOME=%CONDA_PREFIX%\Library

so, the crux of that issue was more about surfacing useful error messages.  Without it, would probably bang their head against a wall saying "I DID install bioformats_jar darn it!"

but, I'd need to familiarize myself with whatever equivalent you have for determine_reader here to have a suggestion

I wonder if we need better logging / path tracing then?
We should have different errors for ReaderInitError vs UnsupportedFileFormatError?

@tlambert03 @evamaxfield @SeanLeRoy @toloudis I am returning to this now and wanted to define a couple of specific changes to make as this issue seems mostly a discussion.
Possible features to add:

[ ] Add function get_all_readers_for_given_file(filepath) to report each reader compatibility
[ ] Add robust explanation in determine_plugin
[ ] Add error separation for ReaderInitError vs UnsupportedFileFormatError

@BrianWhitneyAI those all sound great to me!


Allow deleting peers that have never accepted invitation

If you have made a mistake in adding a peer and the invitation has not yet been used you may want to delete the peer in order to recreate it instead of modifying the sqlite database.

Do you think this might be best solved with just adding an expiration time to invites, and the server can then automatically prune old invite allocations?

That probably works best for this use case.


InvalidArgumentError

Hello, I encountered an error, as follows:
The input_chord_left is array([[14, 14, 14, 14, 15, 14, 14, 14, 14]], dtype=int32)
"""
2022-03-09 11:28:57.595376: I tensorflow/stream_executor/platform/default/dso_loader.cc:53] Successfully opened dynamic library libcuda.so.1
2022-03-09 11:28:57.623071: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:937] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-03-09 11:28:57.623404: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1733] Found device 0 with properties:
pciBusID: 0000:01:00.0 name: GeForce RTX 3060 computeCapability: 8.6
coreClock: 1.852GHz coreCount: 28 deviceMemorySize: 11.76GiB deviceMemoryBandwidth: 335.32GiB/s
2022-03-09 11:28:57.623423: I tensorflow/stream_executor/platform/default/dso_loader.cc:53] Successfully opened dynamic library libcudart.so.11.0
2022-03-09 11:28:57.625232: I tensorflow/stream_executor/platform/default/dso_loader.cc:53] Successfully opened dynamic library libcublas.so.11
2022-03-09 11:28:57.625266: I tensorflow/stream_executor/platform/default/dso_loader.cc:53] Successfully opened dynamic library libcublasLt.so.11
2022-03-09 11:28:57.625994: I tensorflow/stream_executor/platform/default/dso_loader.cc:53] Successfully opened dynamic library libcufft.so.10
2022-03-09 11:28:57.626158: I tensorflow/stream_executor/platform/default/dso_loader.cc:53] Successfully opened dynamic library libcurand.so.10
2022-03-09 11:28:57.626239: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2022-03-09 11:28:57.626631: I tensorflow/stream_executor/platform/default/dso_loader.cc:53] Successfully opened dynamic library libcusparse.so.11
2022-03-09 11:28:57.626727: I tensorflow/stream_executor/platform/default/dso_loader.cc:53] Successfully opened dynamic library libcudnn.so.8
2022-03-09 11:28:57.626737: W tensorflow/core/common_runtime/gpu/gpu_device.cc:1766] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...
2022-03-09 11:28:57.627027: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-03-09 11:28:57.627332: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1258] Device interconnect StreamExecutor with strength 1 edge matrix:
2022-03-09 11:28:57.627340: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1264]
0%|          | 0/1 [00:00<?, ?it/s]2022-03-09 11:29:12.128660: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:176] None of the MLIR Optimization Passes are enabled (registered 2)
2022-03-09 11:29:12.147969: I tensorflow/core/platform/profile_utils/cpu_utils.cc:114] CPU Frequency:<PHONE_NUMBER> Hz
0%|          | 0/1 [01:13<?, ?it/s]
Traceback (most recent call last):
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/contextlib.py", line 130, in exit
self.gen.throw(type, value, traceback)
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/tensorflow/python/ops/variable_scope.py", line 2833, in variable_creator_scope
yield
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/keras/engine/training.py", line 1702, in predict
tmp_batch_outputs = self.predict_function(iterator)
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/tensorflow/python/eager/def_function.py", line 889, in call
result = self._call(*args, **kwds)
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/tensorflow/python/eager/def_function.py", line 957, in _call
filtered_flat_args, self._concrete_stateful_fn.captured_inputs)  # pylint: disable=protected-access
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/tensorflow/python/eager/function.py", line 1961, in _call_flat
ctx, args, cancellation_manager=cancellation_manager))
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/tensorflow/python/eager/function.py", line 596, in call
ctx=ctx)
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/tensorflow/python/eager/execute.py", line 60, in quick_execute
inputs, attrs, num_outputs)
tensorflow.python.framework.errors_impl.InvalidArgumentError:  indices[0,4] = 15 is not in [0, 15)
[[node model_1/embeded_chord_left/embedding_lookup (defined at home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/keras/layers/embeddings.py:184) ]] [Op:__inference_predict_function_99639]
Errors may have originated from an input operation.
Input Source operations connected to node model_1/embeded_chord_left/embedding_lookup:
model_1/embeded_chord_left/embedding_lookup/79737 (defined at home/aaa/anaconda3/envs/kerasss/lib/python3.7/contextlib.py:112)
model_1/embeded_chord_left/Cast (defined at home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/keras/layers/embeddings.py:183)
Function call stack:
predict_function
python-BaseException
input_chord_left
Python 3.7.10 (default, Jun  4 2021, 14:48:32)
Type 'copyright', 'credits' or 'license' for more information
IPython 7.28.0 -- An enhanced Interactive Python. Type '?' for help.
PyDev console: using IPython 7.28.0
"""

Did you change the code before you encountered this problem?

No, I use the code clone from the master branch.

Then, are you sure that all the dependencies are the same as mine (please check README)?

Yes. I used the same python and package version. I noticed that the input_dim=15 of the embedding layer of chord_model, mul_seg(chord_segs,i,segments_length,'left',15) will add 15 as a separator, resulting in out of embedding, is this the problem?

Thank you!

Traceback (most recent call last):
File "/media/aaa/code2/autoharmonizer/harmonizer.py", line 431, in
chord_model = build_chord_model(SEGMENTS_LENGTH, CHO_RNN_SIZE, CHO_NUM_LAYERS, 'chord_'+WEIGHTS_PATH)
File "/media/aaa/code2/autoharmonizer/chord_model.py", line 268, in build_chord_model
model.load_weights(weights_path)
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/keras/engine/saving.py", line 492, in load_wrapper
return load_function(*args, **kwargs)
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/keras/engine/network.py", line 1230, in load_weights
f, self.layers, reshape=reshape)
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/keras/engine/saving.py", line 1234, in load_weights_from_hdf5_group
K.batch_set_value(weight_value_tuples)
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py", line 2960, in batch_set_value
tf_keras_backend.batch_set_value(tuples)
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/tensorflow/python/keras/backend.py", line 3384, in batch_set_value
x.assign(np.asarray(value, dtype=dtype(x)))
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/tensorflow/python/ops/resource_variable_ops.py", line 846, in assign
self._shape.assert_is_compatible_with(value_tensor.shape)
File "/home/aaa/anaconda3/envs/kerasss/lib/python3.7/site-packages/tensorflow/python/framework/tensor_shape.py", line 1117, in assert_is_compatible_with
raise ValueError("Shapes %s and %s are incompatible" % (self, other))
ValueError: Shapes (16, 4) and (15, 4) are incompatible

Have you retrained the model?

I did not retrain the model

It will work fine if you do not want to retrain the model, but you need to make sure the model is running on the GPU and not the CPU. I now confirm that the issue you mention occurs when using the CPU. However, if you run it on a GPU, you won't get this error reported.