MSID: 88971 Version: 2 DOI: 10.1101/2<IP_ADDRESS>3172

MSID: 88971
Version: 2
Preprint DOI: https://doi.org/10.1101/2<IP_ADDRESS>3172
Step 1. Awaiting reviews
Editorial to post reviews via hypothesis
Useful links:

DocMap: https://data-hub-api.elifesciences.org/enhanced-preprints/docmaps/v2/by-publisher/elife/get-by-manuscript-id?manuscript_id=88971
New model tracking: https://docs.google.com/spreadsheets/d/1_fHaoOy7hjyocptKtVJRijeNpUY4hBS7Ck_aVmx6ZJk/
Reviews on sciety: https://sciety.org/articles/activity/10.1101/2<IP_ADDRESS>3172

For trouble shooting (e.g. no Docmaps available):

DocMap issue addressing: https://miro.com/app/board/uXjVNCwK6EI=/
Explore DataHub DocMaps API: https://lookerstudio.google.com/reporting/4c2f0368-babb-4beb-b5b3-497e7e7b0f08/page/ejphD
Unmatched submissions and preprints: https://lookerstudio.google.com/u/0/reporting/9f86204f-3bf7-477c-9b18-5c5ef141bf69/page/p_gxi57ha93c
Unmatched manuscripts spreadsheet: https://docs.google.com/spreadsheets/d/15QcK8w-ssB7109RQEDtFpJPZ0J5HTGxoHa_2TtpMBbg/edit#gid=1336081641

Step 2. Preview reviewed preprint
Production QC content ahead of publication
Instructions:

QC preview: https://prod--epp.elifesciences.org/previews/88971v2
Update ticket with any problems (add blocked label)
When QC OK, add QC OK label to ticket and add publication date and time to https://docs.google.com/spreadsheets/d/1amAlKvdLcaDp5W8Z8g77NmkwbMF5n_u89ArSqPMO8jg
Move card to next column
(At end of the day post link in #enhanced-preprint and ask for PDF to be generated)

Useful links:

Preprint DOI :  https://doi.org/10.1101/2<IP_ADDRESS>3172
Confirm reviews returned by EPP: https://prod--epp.elifesciences.org/api/reviewed-preprints/88971/v2/reviews
To update the MECA path in the docmap: https://docs.google.com/spreadsheets/d/1mctCQuNFBjSn97Lihy7_vBO6z7-N-oqyLv4clyi6zHg

Step 3: Awaiting search reindex
This step adds the reviewed preprint to the homepage: https://elifesciences.org
The search reindex is triggered once an hour. We need the reviewed preprint to be indexed as the search application serves the journal homepage.
Useful links:

Jenkins pipeline to reindex search can be triggered sooner or monitored here: https://alfred.elifesciences.org/job/process/job/process-reindex-reviewed-preprints/

Step 4: Published! PDF requested
Waiting for PDF to be generated
Useful links:

PDF tracking: https://docs.google.com/spreadsheets/d/106_XeDjmuBae7gexOTNzg60lapeqjl2aRn9DzupGyS8/

Step 5: Introduce PDF to data folder and git repo
Upload PDF to relevent folder in git repo https://github.com/elifesciences/enhanced-preprints-data/
Step 6: Done!

[ ] Kettle is on!

@acollings I think this assessment needs tweaking to remove important?

Hi @JGilbert-eLife: sorted, thanks!


Update gensim to 4.3.3

Checklist

[x] Used a personal fork of the feedstock to propose changes
[x] Bumped the build number (if the version is unchanged)
[x] Reset the build number to 0 (if the version changed)
[ ] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[x] Ensured the license file is being packaged.

@mpenkov if you are ok with not supporting python3.12 for now, this is what can skip the build - though I am not 100% sure about the consequences.

@conda-forge/core maybe someone could comment whether skipping a failing build is accepted practice or not?

Let's give people a little while to chime in.

This is likely just an upstream issue with sdist and wheels not using the same build setup:
# curl -sL https://files.pythonhosted.org/packages/ec/bc/36ce4d510085cf150f17d79bb5e88cde942aeba2a894aed5893812ea1e6d/gensim-4.3.3.tar.gz | bsdtar -xO \*/gensim/models/word2vec_inner.c 2> /dev/null | head -1
/* Generated by Cython 0.29.32 */
# curl -sL https://files.pythonhosted.org/packages/79/7b/747fcb06280764cf20353361162eff68c6b0a3be34c43ead5ae393d3b18e/gensim-4.3.3-cp312-cp312-win_amd64.whl | bsdtar -xO gensim/models/word2vec_inner.c 2> /dev/null | head -1
/* Generated by Cython 0.29.37 */

@mpenkov, would it be possible upstream to generate the sdist first and then build the wheels from that sdist?
That way you could avoid potential inconsistencies like this one.

In theory, yes, I think it would be possible. @piskvorky Do you have any objections?
I practice, I think it would require significant effort. I personally don't have the time to refactor gensim's wheel building process at the moment. It has taken us a while to get to a stage where all our wheels build automatically without issues.
Are you able to make a PR to upstream and support it?

It sounds reasonable to me. But like @mpenkov , I won't have time in foreseeable future, so this would need to be taken up & steered & thoroughly tested by a strong contributor.

No, sorry, can't either.
To fix the issue at hand, it would likely suffice to rebuild the sdist with a newer Cython version.
(Alternatively, one could run Cython in this feedstock's build too, of course; but a more general upstream fix which others apart from conda-forge can benefit from is preferable.)

Any idea who I would need to contact about this @piskvorky and @mbargull ?

Merged. Thank you @hechth


github_packages: handle "manifest unknown"

[x] Have you followed the guidelines in our Contributing document?
[x] Have you checked to ensure there aren't other open Pull Requests for the same change?
[x] Have you added an explanation of what your changes do and why you'd like us to include them?
[ ] Have you written new tests for your changes? Here's an example.

[x] Have you successfully run brew typecheck with your changes locally?
[x] Have you successfully run brew tests with your changes locally?

This seems to be very similar to "name unknown".

Review period will end on 2021-04-13 at 18:00:06 UTC.

Review period skipped due to critical label.

Makes sense, thanks @Bo98!


Incorrect page title reported via Analytics

Description
Hi! I'm working on a project with NuxtJS (SSR mode) and I've installed this library to use with GA v4. It pretty much works outside the box, but I've noticed that if you use "pageTrackerScreenviewEnabled", the dt value is not properly reported on subsequent navigations.
Example:
Page 1: (rendered from SSR): correctly reports the values on the screenview event
Page 2: (navigating to a link - I think this is rendered browser based): the screenview event "dt" property still has the old value
Page 3: (navigating to another link): the screenview event "dt" property has the value from page 2
I checked the code and it seems to be correct, by using the router.onReady and router.afterEach events, but somehow, even if Vue.nextTick is used, it doesn't actually ensure the entire DOM was loaded.
Expected behavior
The library should report the correct page title to analytics.
Actual behavior
The library reports the previous page title to analytics on subsequent navigations in the browser.
Environment
Run this command in the project folder and fill in their results:
npm ls vue-gtag<EMAIL_ADDRESS>Then, specify:

Operating system: Mac OS
Browser and version: Chrome

Reproducible Demo
export default ({ app }) => {     Vue.use(VueGtag, {       config: { id: 'G-XXXXX' },       appName: 'XXXX',       pageTrackerScreenviewEnabled: true     }, app.router) }

The third image show the title from the second image. The second image from the first image. And the first image is correct, because the page was rendered via SSR.

unfortunately, SSR always gives issues with vue-router, I can't do much more than waiting for VueRouter to be ready and triggering a nextTick on each route change.
This is more an issue with Nuxt or VueRouter or both combined.


Add DDP and FSDP helper functions

Thank you for the PR! LGTM. Did you have a chance to check if the FSDP tests are running correctly?

Yes, the ddp_test.py, ddp_variation_test.py and fsdp_test.py all run fine.


[Feature Request] Adding other sites to youtube-viewer ?

Hello, I was wondering if there's a wiki or any relevant information that could help me add other websites to this program, I would like to build support in youtube-viewer for minds.com, gab.ai, bitchute.com, stream.me and D-Live :)

Hi. This is not going to happen, unfortunately.
But feel free to create a new program with a different name, based on youtube-viewer and add support for more websites.


Filecoin source data

What is it?
Looks like they maintain public Google datasets here, so it might be easier to integrate than expected
https://lilium.sh/data/dumps/
https://filecoin-data-portal.on-fleek.app/index.html

@ravenac95 @ccerv1 can we see if Arbitrum and Optimism does something similar for transactions and traces data?

can we see if Arbitrum and Optimism does something similar for transactions and traces data?

Transactions for these chains should be available on BigQuery preview datasets!

bigquery-public-data.goog_blockchain_arbitrum_one_us
bigquery-public-data.goog_blockchain_optimism_mainnet_us

Traces are a different beast! :sweat_smile:

select   *  from lily-data.lily.block_headers order by height desc
They're still working on documentation, we can ask David for more details.
We should publish this on our Data Exchange

I think there might be some tables with duplicates and missing data so perhaps the best thing would be to create a small dataset with simple views deduplicating and exposing only the useful / complete tables.

Debugging the Filecoin data transfer job here
https://github.com/opensource-observer/oso/pull/2073

Attempting another auth fix here
https://github.com/opensource-observer/oso/pull/2081

Getting closer...
https://github.com/opensource-observer/oso/pull/2082

Adding more auth scopes
https://github.com/opensource-observer/oso/pull/2083

It worked!
https://dagster.opensource.observer/runs/dbae570a-c146-4532-87a0-f4408323c6f3

:rocket:


GridView::filterSelector  not flexible

I want to set filter selector:
"$id input :not([type='checkbox']), #$id select"

but I cannot do it without overriding GridView::getClientOptions(). Maybe GridView::filterSelector will not append the default selector("#$id input, #$id select"), but replace it with?

You can close this, I see in the code filterSelector is APPENDED to the base/default selector.


Add documentation for Minimal Catalog Selection

RFCs:
Minimal Catalog Selection - Labels
Minimal Catalog Selection - Priority

Related to #1132

Related to #1132

https://github.com/operator-framework/operator-controller/pull/1227 is merged. So closing this issue.


[Obsolete] missing attribute usage

Hi recently I've tried to update library from 1.9.0 to 2.0.2. I've encountered some errors in IAdminClient.ListGroups API:
System.OverflowException: Arithmetic operation resulted in an overflow.
   at System.IntPtr.op_Explicit(IntPtr value)
   at Confluent.Kafka.Impl.SafeKafkaHandle.CopyBytes(IntPtr ptr, IntPtr len)
   at Confluent.Kafka.Impl.SafeKafkaHandle.<>c.<ListGroupsImpl>b__73_3(rd_kafka_group_member_info mi)
   at System.Linq.Utilities.<>c__DisplayClass2_0`3.<CombineSelectors>b__0(TSource x)
   at System.Linq.Enumerable.SelectRangeIterator`1.ToList()
   at Confluent.Kafka.Impl.SafeKafkaHandle.<>c.<ListGroupsImpl>b__73_1(rd_kafka_group_info gi)
   at System.Linq.Utilities.<>c__DisplayClass2_0`3.<CombineSelectors>b__0(TSource x)
   at System.Linq.Enumerable.SelectRangeIterator`1.ToList()
   at Confluent.Kafka.Impl.SafeKafkaHandle.ListGroupsImpl(String group, Int32 millisecondsTimeout)
   at Confluent.Kafka.Impl.SafeKafkaHandle.ListGroups(Int32 millisecondsTimeout)
   at Confluent.Kafka.AdminClient.ListGroups(TimeSpan timeout)

While checking what changed I found out someone added comment:

   ///     DEPRECATED.
   ///     Superseded by ListConsumerGroups and DescribeConsumerGroups.

But he has not added [Obsolete("Do something comment")] attribute. This not good because no one will know you wish everyone to move to new API. If you add proper obsolete than IDE will notify clients of your library that they should take some action.

Thanks for the feedback. I've created a PR to fix this.


set chunk as synced only by push sync

This PR addresses the problem of data integrity with relation to setting chunk as synced by both pull and push syncing while garbage collection can remove a chunk from retrieval index (as synced by push sync) and leave its address in push index.
As discussed with @zelig and @acud, the chunk should be set as synced only by push sync.

/run beekeeper

/run beekeeper

This PR is ready for a review bit it is blocked by issues with the gc integration test https://github.com/ethersphere/bee/runs/1357493088?check_suite_focus=true#step:29:11, not to interfere with the progress on fixing that test.

@janos i looked at the link you posted and it seemed to have passed eventually right? i remember tinkering around with it a few days ago and it eventually came back into life after a few restarts. i guess this is a flake regarding the amount of data we put into the cluster with the gc test. it is true that currently on master, having an item in gc index depends on the fact that we must sync the data (or at least offer it). are the slash commands failing now repeatedly?

this should sort out https://github.com/ethersphere/bee/issues/819 and #894

LGTM
this needs to be complemented by renewing accessTimestamp for newly synced chunks

Thanks. This is actually already the case in the master https://github.com/ethersphere/bee/blob/master/pkg/localstore/mode_set.go#L277. We are setting new time on every sync.

/run beekeeper

@acud it is still failing on the run command, also failed and succeeded once on the master branch.
I am not sure if this PR should be merged in regards the gc integration test. It seems still flaky.

@janos i think https://github.com/ethersphere/beekeeper/pull/64 should improve this

/run beekeeper

Beekeeper tests re now passing. Thanks @acud.


[YouTube] Unable to download live chat from membership stream

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm reporting that yt-dlp is broken on a supported site
[X] I've verified that I have updated yt-dlp to nightly or master (update instructions)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched known issues and the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue
[x] I've read about sharing account credentials and I'm willing to share it if required

Region
No response
Provide a description that is worded well enough to be understood
For upcoming public YouTube streams, I can can start downloading the live chat as soon as the stream URL is up and chat is enabled:
yt-dlp.exe --no-download --ignore-no-formats-error --cookies-from-browser firefox::yt-dlp --write-subs  --sub-langs live_chat https://www.youtube.com/watch?v=XXXXX
When I run the same command for an upcoming members-only stream it seems to download data at first, but as soon as the fragment counter ticks up to 2, at around 1MiB transfered, it fails with "ERROR: The downloaded file is empty"
If I run the same command after the stream has started (or after it has ended), it works flawlessly.
Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[x] If using API, add 'verbose': True to YoutubeDL params instead
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
yt-dlp.exe -vU --no-download --ignore-no-formats-error --cookies-from-browser firefox::yt-dlp --write-subs --sub-langs live_chat https://www.youtube.com/watch?v=XXXXXXXX
[debug] Command-line config: ['-vU', '--no-download', '--ignore-no-formats-error', '--cookies-from-browser', 'firefox::yt-dlp', '--write-subs', '--sub-langs', 'live_chat', 'https://www.youtube.com/watch?v=XXXXXXXX']
[debug] Encodings: locale cp1252, fs utf-8, pref cp1252, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version<EMAIL_ADDRESS>from yt-dlp/yt-dlp [7ea278792] (win_exe)
[debug] Python 3.10.11 (CPython AMD64 64bit) - Windows-10-10.0.22631-SP0 (OpenSSL 1.1.1t  7 Feb 2023)
[debug] exe versions: ffmpeg N-110125-g0684e58886-20230329 (setts), ffprobe N-110125-g0684e58886-20230329, phantomjs 2.1.1
[debug] Optional libraries: Cryptodome-3.21.0, brotli-1.1.0, certifi-2024.08.30, curl_cffi-0.5.10, mutagen-1.47.0, requests-2.32.3, sqlite3-3.40.1, urllib3-2.2.3, websockets-13.1
[debug] Proxy map: {}
Extracting cookies from firefox
[debug] Extracting cookies from: "C:\Users\sillybilly\AppData\Roaming\Mozilla\Firefox\Profiles\rz17doal.default-release\cookies.sqlite"
[debug] Only loading cookies from firefox container "yt-dlp", ID 17
Extracted 19 cookies from firefox
[debug] Request Handlers: urllib, requests, websockets, curl_cffi
[debug] Loaded 1837 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Latest version<EMAIL_ADDRESS>from yt-dlp/yt-dlp
yt-dlp is up to date<EMAIL_ADDRESS>from yt-dlp/yt-dlp)
[youtube] Extracting URL: https://www.youtube.com/watch?v=XXXXXXXX
[youtube] XXXXXXXX: Downloading webpage
[debug] [youtube] Extracted SAPISID cookie
[youtube] XXXXXXXX: Downloading ios player API JSON
WARNING: [youtube] YouTube said: ERROR - Request contains an invalid argument.
WARNING: [youtube] HTTP Error 400: Bad Request. Retrying (1/3)...
[youtube] XXXXXXXX: Downloading ios player API JSON
WARNING: [youtube] YouTube said: ERROR - Request contains an invalid argument.
WARNING: [youtube] HTTP Error 400: Bad Request. Retrying (2/3)...
[youtube] XXXXXXXX: Downloading ios player API JSON
WARNING: [youtube] YouTube said: ERROR - Request contains an invalid argument.
WARNING: [youtube] HTTP Error 400: Bad Request. Retrying (3/3)...
[youtube] XXXXXXXX: Downloading ios player API JSON
WARNING: [youtube] YouTube said: ERROR - Request contains an invalid argument.
WARNING: [youtube] Unable to download API page: HTTP Error 400: Bad Request (caused by <HTTPError 400: Bad Request>)
[youtube] XXXXXXXX: Downloading mweb player API JSON
WARNING: [youtube] This live event will begin in 5 hours.
[info] XXXXXXXX: Downloading subtitles: live_chat
WARNING: No video formats found!
[debug] Sort order given by extractor: quality, res, fps, hdr:12, source, vcodec, channels, acodec, lang, proto
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, hdr:12(7), source, vcodec, channels, acodec, lang, proto, size, br, asr, vext, aext, hasaud, id
[debug] Default format spec: bestvideo*+bestaudio/best
WARNING: Requested format is not available
[info] Writing video subtitles to: YYYYYYYYYYYY [XXXXXXXX].live_chat.json
[debug] Invoking youtube_live_chat downloader on "https://www.youtube.com/watch?v=XXXXXXXX&bpctr=9999999999&has_verified=1"
[youtube_live_chat] Downloading live chat
[youtube_live_chat] Total fragments: unknown (live)
[download] Destination: YYYYYYYYYYYY [XXXXXXXX].live_chat.json
[debug] File locking is not supported. Proceeding without locking
[download]    1.08MiB at  790.24KiB/s (00:00:02) (frag 2)ERROR: The downloaded file is empty
  File "yt_dlp\__main__.py", line 17, in <module>
  File "yt_dlp\__init__.py", line 1093, in main
  File "yt_dlp\__init__.py", line 1083, in _real_main
  File "yt_dlp\YoutubeDL.py", line 3604, in download
  File "yt_dlp\YoutubeDL.py", line 3577, in wrapper
  File "yt_dlp\YoutubeDL.py", line 1613, in extract_info
  File "yt_dlp\YoutubeDL.py", line 1624, in wrapper
  File "yt_dlp\YoutubeDL.py", line 1780, in __extract_info
  File "yt_dlp\YoutubeDL.py", line 1839, in process_ie_result
  File "yt_dlp\YoutubeDL.py", line 3010, in process_video_result
  File "yt_dlp\YoutubeDL.py", line 177, in wrapper
  File "yt_dlp\YoutubeDL.py", line 3266, in process_info
  File "yt_dlp\YoutubeDL.py", line 4350, in _write_subtitles
  File "yt_dlp\YoutubeDL.py", line 3198, in dl
  File "yt_dlp\downloader\common.py", line 464, in download
  File "yt_dlp\downloader\youtube_live_chat.py", line 192, in real_download
  File "yt_dlp\downloader\fragment.py", line 300, in _finish_frag_download
  File "yt_dlp\YoutubeDL.py", line 1090, in report_error
  File "yt_dlp\YoutubeDL.py", line 1018, in trouble

Sorry, it now turns out it doesn't work after the stream has started either - same behavior, same stacktrace. I'm sure it worked until recently but it's hard to tell for certain since I have no way of setting up members-only streams for testing myself...

seems like this has been going on for a while: #11454

seems like this has been going on for a while: #11454

I saw that one, but wasn't sure if it was relevant - I have no problems downloading live chat replay from members-only VODs, only live streams (double-checked just now). I'd prefer to be able to start recording messages in advance, since messages from before the stream started aren't included in the live chat replay.

This seems to have been a problem with my YouTube session/cookies - after a while I stopped being able to access members-only content completely, and when I checked on the Firefox container I use for yt-dlp I was completely logged out. After logging in again I have been able to record live chat, including pre-chat, in multiple members-only streams without problems.


Operation timeout randomly

Do you want to request a feature or report a bug?
Bug
What did you do?
I have setup traefik on kubernetes cluster running in gke.
My configs:
kind: Deployment
apiVersion: extensions/v1beta1
metadata:
  name: traefik-ingress-controller
  namespace: default
  labels:
    k8s-app: traefik-ingress-lb
spec:
  replicas: 1
  template:
    metadata:
      labels:
        app: traefik-ingress-lb
        name: traefik-ingress-lb
    spec:
      terminationGracePeriodSeconds: 60
      serviceAccountName: traefik-ingress-controller
      volumes:
        - name: config
          configMap:
            name: traefik-config
      containers:
      - image: traefik
        name: traefik-ingress-lb
        imagePullPolicy: Always
        volumeMounts:
          - mountPath: "/config"
            name: "config"
        ports:
        - name: admin
          containerPort: 8080
          hostPort: 8080
        - name: http
          containerPort: 80
          hostPort: 80
        - name: https
          containerPort: 443
          hostPort: 443
        args:
        - --web
        - --kubernetes
        - --logLevel=DEBUG
---
kind: Service
apiVersion: v1
metadata:
  name: traefik-ingress-service
  namespace: default
spec:
  type: LoadBalancer
  selector:
    k8s-app: traefik-ingress-lb
  ports:
    - name: http
      protocol: TCP
      port: 80
      targetPort: 80
    - name: https
      protocol: TCP
      port: 443
      targetPort: 443
    - name: admin
      protocol: TCP
      port: 8080

apiVersion: v1
kind: Service
metadata:
  name: traefik-web-ui
  namespace: default
spec:
  selector:
    k8s-app: traefik-ingress-lb
  ports:
    - protocol: TCP
      port: 8080
---
apiVersion: extensions/v1beta1
kind: Ingress
metadata:
  name: traefik-web-ui
  namespace: default
  annotations:
    kubernetes.io/ingress.class: traefik
spec:
  rules:
  - http:
      paths:
      - path: /
        backend:
          serviceName: traefik-web-ui
          servicePort: 8080

What did you expect to see?
Having no problems, when accessing my services and also the dashboard.
What did you see instead?
Sometimes, like every second or third request traefik does not respond and I get a operation timeout.
This happens to all my services and also to the dashboard of traefik. There aren't any special logs or events, which give me a clue why this happens. This issue happens when using the browser, curl, postman etc. So it's definitely an issue with traefik (or my configuration). The service to service communications works as expected, when sending requests within the cluster to service-name.namespace.cluster.local. So kubernetes works as expected.
Output of traefik version: (What version of Traefik are you using?)

1.7.0

What is your environment & configuration (arguments, toml, provider, platform, ...)?
defaultEntryPoints = ["http"]
[entryPoints]
  [entryPoints.http]
    address = ":80"
  [kubernetes]
    [kubernetes.ingressEndpoint]
        publishedService = "default/traefik-ingress-controller

Hi! I'm Træfiker :robot: the bot in charge of tidying up the issues.
I have to close this one because of its lack of activity :disappointed:
Feel free to re-open it or join our Slack workspace for more community #support.


FAILURE: Build failed with an exception.

Describe the bug
build fail
ERROR: For input string: ""
Screenshots

git is correct.

What happened? thank you very much

It looks like the "git rev-list --count HEAD".execute() returns "" in your case. Your "git is correct" is executed in master/ while your code is being built in tindroid-0.16.9/.

It looks like the "git rev-list --count HEAD".execute() returns "" in your case. Your "git is correct" is executed in master/ while your code is being built in tindroid-0.16.9/.

thanks!

i have same problem how to solve this problem lease guide me


Add optional ServiceMonitor for deployments

Description
Make it easy to enable scraping of metrics from v8 applications
Related Issue(s)

#{issue number}

Verification

[ ] Your code builds clean without any errors or warnings
[ ] Manual testing done (required)
[ ] Relevant automated test added (if you find this hard, leave it and we'll help out)
[ ] All tests run green

Documentation

[ ] User documentation is updated with a separate linked PR in altinn-studio-docs. (if applicable)

The only potential use for this now I think is if someone explicitly want scraping from their app, and configure the OTel SDK in apps as such. The OTel PR in lib does expose this possibility: https://github.com/Altinn/app-lib-dotnet/pull/589
But I'm not sure if we want to enable that. By default they will be pushed directly now, and in the future through an agent

If the apps don't need this by default we should leave it out. Less dependencies on crds that might change.
My suggestion is to just close this pr


update avatarlegends html and css

Submission Checklist
Required

[ ] The pull request title clearly contains the name of the sheet I am editing.
[ ] The pull request title clearly states the type of change I am submitting (New Sheet/New Feature/Bugfix/etc.).
[ ] The pull request makes changes to files in only one sub-folder.
[ ] The pull request does not contain changes to any json files in the translations folder (translation.json is permitted)

Changes / Description
fix some display bugs

Character Sheet Info Roll20 Internal Use only.


Fix shebang

it needs to be the first line
no spaces between # and !

Without this, you get errors running exe/jumon. It also doesn't correctly get syntax highlighting in most editors.

Thank you!


[Corehttp] Refactor tests imports

This will allow whl_no_aio to still pass.

Feel free to ignore the containerregistry/communication failure on pypy.

/check-enforcer override

/check-enforcer override


BUG REPORT: Spam and senseless reviews in the review section

Description
Hello, I would like to suggest some improvement for the review section. Most reviews are completely nonsensical. Other projects under GSSOC'24 have quite a good review section, and I would like to create the same for this website.
I can improve the review section of this website by writing proper and genuine-sounding reviews
Screenshots

Additional information
As seen from the screen shots, there are a lot of spam like reviews written. I can remove spam/test reviews can write proper reviews in there place.
I would like to work on this issue, please assign it to me under GSSOC'24". Thank you.
What browser are you seeing this bug on?
Firefox
Checklist

[X] I have checked the existing issues
[X] I have read the Contributing Guidelines
[X] I have read the Code Of Conduct
[X] The changes don't break the code

Thank you for assigning this issue to me. Please add the GSSOC label.


Roll Plugins from fa95cde07812 to f6c2ed4f3c5a (12 revisions)

https://github.com/flutter/plugins/compare/fa95cde07812...f6c2ed4f3c5a
2021-02-19<EMAIL_ADDRESS>[image_picker] use nnbd version of deps to resolve ci failure (flutter/plugins#3580)
2021-02-19<EMAIL_ADDRESS>[path_provider] Bump platform packages to NNBD stable (flutter/plugins#3575)
2021-02-19<EMAIL_ADDRESS>[flutter_plugin_android_lifecycle-sdk] Update Flutter SDK constraint
2021-02-19<EMAIL_ADDRESS>[image_picker_platform_interface] Bump NNBD version to stable (flutter/plugins#3573)
2021-02-19<EMAIL_ADDRESS>[package_info] Bump version for NNBD stable (flutter/plugins#3571)
2021-02-19<EMAIL_ADDRESS>[flutter_plugin_android_lifecycle] Bump version for NNBD stable (flutter/plugins#3569)
2021-02-19<EMAIL_ADDRESS>[path_provider] Bump platform interface package to stable NNBD (flutter/plugins#3568)
2021-02-19<EMAIL_ADDRESS>[in_app_purchase]  Migrate to NNBD (flutter/plugins#3555)
2021-02-19<EMAIL_ADDRESS>[url_launcher] Bump platform interface package to stable NNBD (flutter/plugins#3570)
2021-02-19<EMAIL_ADDRESS>[google_maps_flutter] Migrate to NNBD (flutter/plugins#3548)
2021-02-19<EMAIL_ADDRESS>[image_picker_for_web] Add doc comments to point out that some arguments aren't supported on the web (flutter/plugins#3566)
2021-02-19<EMAIL_ADDRESS>[path_provider] Migrate examples to null-safety (flutter/plugins#3559)
If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-plugins-flutter-autoroll
Please CC<EMAIL_ADDRESS>on the revert to ensure that a human
is aware of the problem.
To report a problem with the AutoRoller itself, please file a bug:
https://bugs.chromium.org/p/skia/issues/entry?template=Autoroller+Bug
Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/master/autoroll/README.md

Merging with flutter-build red, to fix. Apologies for the breakage!


Create an "Aligning reads for ChIP-seq" markdown

Do not need Alignment theory slides -- take what we need and add it to this markdown where relevant
https://github.com/hbctraining/Intro-to-ChIPseq/blob/master/lectures/alignment_theory.pdf

For code:

use mm10 as the reference genome (bowtie2 index will be made available)
Present the code for bowtie2 on a single sample (but have a #DO NOT RUN). Use this time to  discuss the parameters. Running a single sample interactively will be a long wait
Exercise: create a job submission script to run bowtie2 on a single sample (WT rep1; this has a lower alignment rate ~60-70%). This will be the first job submission script so provide guidance on the different SBATCH options. This same sample shows lower signal in profile plots. We will want to discuss this later with data viz. Another exercise question - look at your .err file - comment on the alignment rate
Describe SAM/BAM file
Turn SAM (default output) into BAM file. Present code for samtools; discuss samtools and also the need for smaller file
Have a note that we are not actually using the SAM file, and we could (in theory) delete it. In automation we will pipe so that we do not create this intermediate file
After the alignment, also need to index the final bam files.

for file in *.bam do echo "processing $file" samtools index $file done

The "Creating and index" can be updated such that the current note on shared databases can become main text. We will not be providing them a reference instead they will be pointing to /n/groups/shared_databases/bowtie2_indexes/mm10

Updated the content


How to quickly make code changes and test in a project?

I've got my own material-ui fork in a folder, and I've run npm link so I can link it to a project I'm working on. This works fine, but I'm wondering how I can make changes to material-ui and then quickly test those in my project, without having to relink? I tried npm run build in the material-ui folder, but now I get this error in my project:
Uncaught TypeError: Cannot read property 'cyan500' of undefined

What should my process be?

We have introduced a breaking change. Have a look at https://github.com/callemall/material-ui/pull/2825.

Your doing right. that is only a breaking change we had to introduce for the 0.15.0 release. see #2825

:laughing: :laughing:

I branched off the master branch though. package.json still says it's version 0.14.4

I branched off the master branch though. package.json still says it's version 0.14.4

We don't currently update the package.json until we do a release (so it would have the package.json version in master will reflect the latest released version).

Ok, I'm confused. Can someone fill me in on why linking is not working and how to fix it?

Sorry @ffxsam, I'm a little unclear as to what issue you're having right now? I'm also not super familiar with npm link. I've tried it in the past but never had a ton of luck with it. What I do is I have material-ui as an alias to my webpack configuration and that works for me. Are you using webpack?

No, I'm using Meteor 1.3 beta which removes the need for webpack (though Meteor does use npm). I just want the ability to make changes in my own fork (~/GitHub/material-ui/) and have that reflect in other folders/projects. Someone told me npm link was the way to do that, so I did:
$ cd ~/GitHub/material-ui
$ npm link
$ cd ~/myproject
$ npm link material-ui

If there's a better way, I'd love to know! I plan on making a whole bunch of contributions to Material UI soon.

I'm not too familiar with Meteor but what you are doing should work (provided you installed dependencies and ran the build in your ~/GitHub/material-ui folder. It also shouldn't require you to keep relinking, you should only need to do it once (though you will likely have to rebuild material-ui if you are making changes in it's source).
As @oliviertassinari and @alitaheri pointed out, if the only issue you're running into is that color error, that was because of a breaking change that was made in master, you have to now import colors differently. Was there something else?

Right, linking was working before. The strange thing is, I'm not referencing colors anywhere, so it seems that it's entirely within the material-ui code that's breaking. But let me try again in a fresh clone and double check.

The strange thing is, I'm not referencing colors anywhere, so it seems that it's entirely within the material-ui code that's breaking.

Oh okay, I understand now. Yeah maybe refresh everything and let us know. If you can pinpoint which line of code it's complaining about colors too that'd be helpful.

I think might want to (temporarily) hack the package.json to use src rather than lib - we do this sometimes when on a custom branch...

@chrismcv you can also use webpack to alias the directory

@chrismcv Can you elaborate a bit on this? Which line do I change in package.json to use src, so I don't have to build every time?

@ffxsam are you using webpack?

No, using webpack. I have a feeling this may not work for me since I'm using Meteor.

@ffxsam I would advise against modifying the package.json unless you are forking the repo and installing your own fork.

Yes, that's what I'm doing. I've forked the repo and I'd like my apps to use my local fork. But I have a feeling with the setup I have, it won't work just pointing to src, and I may have to do an npm run build every time.

Hey @ callemall team, I am also running into this same type of issue. I think you will see a lot more helpful contributions and a lot less +1s if you can put together some cohesive strategy for working on this repo without having to do anything crazy, or the case of attempting to use npm link, attempt something crazy only to hit a roadblock.
For me, I end up with very strange errors in the process of building or starting (which first builds) the app, after npm linking to my local fork of Material UI.
ERROR in ../material-ui/lib/styles/getMuiTheme.js
Module build failed: ReferenceError: Unknown plugin "transform-runtime" specified in "base" at 0, attempted to resolve relative to "/Users/netpoetica/Desktop/git/material-ui/lib/styles"
...
ERROR in ../material-ui/lib/svg-icons/navigation/chevron-right.js
Module build failed: ReferenceError: Unknown plugin "transform-runtime" specified in "base" at 0, attempted to resolve relative to "/Users/netpoetica/Desktop/git/material-ui/lib/svg-icons/navigation"

I get about 10 of those. If I use the same exact commit sha that is being npm linked to, but instead I npm install it via git+ssh (and then perform some local hacks to imitate what happens when you publish your tags...) it works.
This is what I am doing right now:

Make changes on my fork
Push to my own branch
Run this script ./bin/update-mui

#!/bin/bash

rm -rf node_modules/material-ui && npm install --production && cd node_modules/material-ui && npm install && npm run build && rm -rf node_modules/react

Test within my own project

Sometimes, if I am making very simple tweaks, I do this instead:

Open the file I want to target in ./node_modules/material-ui/src/*
Make the changes I want to see the world
Run this script ./bin/rebuild-mui

#!/bin/bash

cd node_modules/material-ui && npm run build && rm -rf node_modules/react

Test within my own

This is not a viable process, one I am proud of, or one that I want to share with my team members as our project grows. I would prefer to be able to work within the community to help grow this library, but I haven't come up with a viable methodology for working with a local fork and have been always 1 step away from throwing it out and rolling custom components.
I think a combination of

Making sure npm link w/ a local fork works
Utilizing src/ so you don't have to build every time you nudge something 1 pixel

would be a viable solution. This is where people probably keep going hoping to find instructions like that ;)

I got this working with no issues. Here are the steps that worked for me:

cd ~/GitHub/material-ui (location of my fork)
npm link
cd ~/Projects/my-project
npm link material-ui
rm -rf ~/GitHub/material-ui/node_modules/react (prevents an error about duplicate inclusions of React)

That's it! Any time I modify my fork, I just go into the material-ui folder and run npm run build to update the lib folder.


PhantomJS should be registered as devDependency

Hi,
I’m using svg-sprite through gulp-svg-sprite and everything works well, except that PhantomJS is always downloaded on our CI because it is registered as dependency.
I didn’t check the whole code, but I think you’re only using it for your tests, so it shouldn’t be a dependency but a devDependency.
What do you think?

@nicolas-goudry Duplicate of #100, pls see there for details. On another note, I'll probably start a rewrite of svg-sprite this week and try to split out PhantomJS.

Thanks for your answer! Will see that later then, it’s not a huge matter 😃


Dynamic content

Builds on the changes made in #171 and aims to align the different ways of opening pages dynamically.
Main aims

Give all open and close actions the same shape for both pages and tabs
Provide simpler names for the information in the above actions
Use all of the dynamic information as a key to the screen for dynamic tabs - this means the same screen can be opened with different macros in different tabs, possibly with the same tab title

Challenges for another day

Moving information from URL to context or Redux
One pair of open/close actions for both pages and tabs - this will require runtime knowledge of whether a container is a page or a tab and might be achievable as part of, or after, the above point

Proposed type to be used for dynamic content:
interface dynamicContent {
  name: string; // Name associated with the content
  location: string; // Location of component to target
  description?: string; // Optional description of action
  file: {
    // All information required for an embedded display
    path: string; // Name or file of path (without suffix ?)
    type: "json" | "opi" | "bob"; // File type - which parser and suffix
    macros: { [key: string]: string }; // Macros
    defaultProtocol: string; // Default PV prefix for parser
  };
}

Notes

location is called Mode in CS-Studio, but ours is more general
the suffix for the file is almost always the same as the type but requiring the suffix to be excluded so we can add it is a likely source of errors

someone passes path of myfile.bo and type of opi -> assumptions made by us could cause problems
easiest and simplest would be to require both full path and type - although this could still cause errors if users do not specify the correct parser?

name is currently required - in the future this could perhaps be specified in the file as in CS-Studio

Goals one and two have been completed

Give all open and close actions the same shape for both pages and tabs
Provide simpler names for the information in the above actions

Goal three requires further work

Use all of the dynamic information as a key to the screen for dynamic tabs - this means the same screen can be opened with different macros in different tabs, possibly with the same tab title

Probably we need a specialised function to compare dynamic information against each other to avoid both the shallow comparison and stringify problem. I see the "stringify problem" being that the same specification could be written with the keys in a different order, leading to another new tab where there shouldn't be one.
If we are going to use all this information as a key, then we probably don't need a key/value setup, as the value would be redundant. However, we would still like to be able to address tabs or pages quickly, to ascertain whether it has already been described or not. A set would be useful for this: https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Set


my-test-repo: add a line to new-file.txt

About to delete the fork before accepting the PR to see what happens.

Just deleted the fork repository where this PR came from and this PR appears to have survived!
Excellent.  About to accept the PR.

It worked.  Sweet.


Lazy loading Log component causes Curve canvas to scale weirdly

https://github.com/speedy-tuner/speedy-tuner-cloud/blob/master/src/App.tsx#L34-L36

Fixed in: bee5cefc79f45067eae6ecf3b70f84d592706274


Cherrypick #1045 release 1.0

Cherrypick of #1045

@Random-Liu pkg/server/helpers_test.go:295:19: g.Config undefined (type generator has no field or method Config)


color not found in emmet

Issue Type: Feature Request
Hello, today I was planning to start doing some coding for my website, everything started well, however. I encouter an issue. which was the following emmet does  not have color option within it. I was trying to get some colour on my page. but that option does not appear to exist on here. please would fix the issue.
I would highly appreciated it,
Thank you.
VS Code version: Code 1.58.2 (c3f126316369cd610563c75b1b1725e0679adfb3, 2021-07-14T22:10:15.214Z)
OS version: Windows_NT x64 10.0.19042
Restricted Mode: No

Not related to marketplace, thus closing


Cannot download metadata for 10.1038/s41591-020-1061-7

Describe the bug
I cannot download the metadata for the dataset with id: homosapiens_blood_2020_10x5transcriptionprofiling_dengqing_001_10.1038/s41591-020-1061-7
urllib.error.HTTPError: HTTP Error 404: Not Found
To Reproduce
>>> import os
>>> basedir = '.'
>>> datadir = os.path.join(basedir, 'raw')
>>> metadir = os.path.join(basedir, 'meta')
>>> cachedir = os.path.join(basedir, 'cache')
>>> ds = sfaira.data.Universe(data_path=datadir, meta_path=metadir, cache_path=cachedir)
Ontology <class 'sfaira.versions.metadata.base.OntologyMondo'> is not a DAG, treat child-parent reasoning with care.
Ontology <class 'sfaira.versions.metadata.base.OntologyUberon'> is not a DAG, treat child-parent reasoning with care.
Ontology <class 'sfaira.versions.metadata.base.OntologyUberonLifecyclestage'> is not a DAG, treat child-parent reasoning with care.
>>> ds.subset(key="id", values=["homosapiens_blood_2020_10x5transcriptionprofiling_dengqing_001_10.1038/s41591-020-1061-7"])
>>> ds.datasets
{'homosapiens_blood_2020_10x5transcriptionprofiling_dengqing_001_10.1038/s41591-020-1061-7': <sfaira.data.dataloaders.base.dataset.DatasetBase object at 0x7fc842eef4f0>}
>>> ds.download()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/nfs/home/students/adietrich/.cache/R/basilisk/1.4.0/SimBu/0.99.6/SimBu_env_0_99_4/lib/python3.9/site-packages/sfaira/data/dataloaders/base/dataset_group.py", line 964, in download
    x.download(**kwargs)
  File "/nfs/home/students/adietrich/.cache/R/basilisk/1.4.0/SimBu/0.99.6/SimBu_env_0_99_4/lib/python3.9/site-packages/sfaira/data/dataloaders/base/dataset_group.py", line 404, in download
    v.download(**kwargs)
  File "/nfs/home/students/adietrich/.cache/R/basilisk/1.4.0/SimBu/0.99.6/SimBu_env_0_99_4/lib/python3.9/site-packages/sfaira/data/dataloaders/base/dataset.py", line 395, in download
    if 'Content-Disposition' in urllib.request.urlopen(url).info().keys():
  File "/nfs/home/students/adietrich/.cache/R/basilisk/1.4.0/SimBu/0.99.6/SimBu_env_0_99_4/lib/python3.9/urllib/request.py", line 214, in urlopen
    return opener.open(url, data, timeout)
  File "/nfs/home/students/adietrich/.cache/R/basilisk/1.4.0/SimBu/0.99.6/SimBu_env_0_99_4/lib/python3.9/urllib/request.py", line 523, in open
    response = meth(req, response)
  File "/nfs/home/students/adietrich/.cache/R/basilisk/1.4.0/SimBu/0.99.6/SimBu_env_0_99_4/lib/python3.9/urllib/request.py", line 632, in http_response
    response = self.parent.error(
  File "/nfs/home/students/adietrich/.cache/R/basilisk/1.4.0/SimBu/0.99.6/SimBu_env_0_99_4/lib/python3.9/urllib/request.py", line 561, in error
    return self._call_chain(*args)
  File "/nfs/home/students/adietrich/.cache/R/basilisk/1.4.0/SimBu/0.99.6/SimBu_env_0_99_4/lib/python3.9/urllib/request.py", line 494, in _call_chain
    result = func(*args)
  File "/nfs/home/students/adietrich/.cache/R/basilisk/1.4.0/SimBu/0.99.6/SimBu_env_0_99_4/lib/python3.9/urllib/request.py", line 641, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found

Expected behavior
A clear and concise description of what you expected to happen.
System [please complete the following information]:

OS: e.g. Ubuntu 18.04.6
Language Version: Python 3.9
Virtual environment: Conda
Sfaira version: 0.3.12

Additional context
The data file can be downloaded, a GSE151511_RAW.tar file is downloaded into the raw folder. Only the metadata link seems to be stuck.
What I find strange is that the link seems to be working if i try to request it outside of sfaira:
>>> ds.datasets['homosapiens_blood_2020_10x5transcriptionprofiling_dengqing_001_10.1038/s41591-020-1061-7'].download_url_meta
(['https://static-content.springer.com/esm/art%3A10.1038%2Fs41591-020-1061-7/MediaObjects/41591_2020_1061_MOESM3_ESM.xlsx'],)
>>> import requests
>>> requests.get('https://static-content.springer.com/esm/art%3A10.1038%2Fs41591-020-1061-7/MediaObjects/41591_2020_1061_MOESM3_ESM.xlsx').ok
True

I can also download this file manually and place it into the raw directory.
Is this behavior expected for some datasets? Should I then resort to downloading these files manually and then move on with ds.load()?
Thanks for your help,
Alex

I just realized that this dataset is flagged as not annotated:
>>> ds.datasets['homosapiens_blood_2020_10x5transcriptionprofiling_dengqing_001_10.1038/s41591-020-1061-7'].annotated
False

So my first thought would be that you did not have a working or stable internet connection on the compute node on which you ran this? Could you or did you already try running the code on a laptop or local machine where you can ensure an internet connection?


Make [Document discovery] step optional through OAuth configuration

I'm building an App that can connect to several OIDC/OAuth2 providers. Thus, I created an external configuration file, that corresponds roughly to OauthConfig object structure.
I know for sure that some OIDC/Oauth2 providers I'm using don't allow any document discovery process.
Instead of managing personal additional configuration for knowing whether a provider allows or not discovery, I suggest that this capacity shall also be expressed in the Oauth configuration object.
For example :
{
"loginUrl": "https://github.com/login/oauth/authorize",
"tokenEndpoint": "https://github.com/login/oauth/access_token",
"userinfoEndpoint": "https://api.github.com/user",
"redirectUri": "[some redirect url]",
"silentRefreshRedirectUri": "[some refresh url]",
"clientId": "[The Github app client id]",
"dummyClientSecret": "[The Github app secrent id]",
"scope": "user:email",
"requireHttps": false,
"oidc": false,
"skipIssuerCheck": false,
"clearHashAfterLogin": false,
"responseType": "code",
"disablePKCE": true,
"disableAtHashCheck": true,
"loadDiscoveryDocument": false   <== This is the suggested new attribute
}

This way, loadDiscoveryDocumentAndTryLogin and tryLogin could (and should) be merged into 1 single method (that would perform discovery only if enabled).
Describe the solution you'd like
The solution I would like is described above.
Describe alternatives you've considered
None so far.

What you want is already possible, it's just the other way around. There is:

loadDiscoveryDocument()
tryLogin()
loadDiscoveryDocumentAndTryLogin() which merely combines the previous two

If you do not want to load the discovery document... then don't :sweat_smile:. Just omit a call to that and immediately start with other methods.
Don't think there's a need for additional configuration options or methods?

@jeroenheijmans  Thank you for your prompt response.
What i'm saying is that I cannot know whether to perform discovery by being based on OauthConfig object, I had to use an extra configuration file for this. This is because my app can be deployed with several different possible Authentication providers.
I suggest that this parameter shall be included in OAuthConfig file, because discovery may fail / be disabled for different providers (e.g. : discovery can be difficult/impossible for Azure for example)
Also, please take a look at following site, where they can configure whether to perform discovery :
https://fusionauth.io/docs/v1/tech/identity-providers/openid-connect/github
If we add this parameter :

in "loadDiscoveryDocument" method, we could return directly with a warning message such as "Discovery is not enabled", instead of failing with a stack trace when Discovery is not available
Many users could call only "loadDiscoveryDocumentAndTryLogin", and this would work whether discovery is available or not

Hmm, I see. This is a very app-specific use case though, not sure if such a feature toggle should be in the library?
If you need to determine runtime whether you want to load the disco document you can make that an application feature too, something like:
export class MyAuthService {
  constructor(
    private oauthService: OAuthService,
    private appConfiguration: AppConfiguration,
  ) {
    if (this.appConfiguration.shouldLoadDiscoDocument) {
        this.oauthService.loadDiscoveryDocumentAndTryLogin();
    } else {
      this.oauthService.tryLogin();
    }
  }

Put differently, there's millions of different login sequences (my sample has 6ish steps that can all be individually used or not used depending on your app's needs) possible, having feature flags for various combinations in the library seems like overkill to me, personally.


[BUG]  Universal Checkpoint Conversion: Resumed Training Behaves as If Model Initialized from Scratch

I'm experiencing an issue when using DeepSpeed's universal checkpointing. After converting my DeepSpeed checkpoint to a universal checkpoint using ds_to_universal.py, resuming training from the converted checkpoint results in the model behaving as if it was initialized from scratch—the training loss is significantly higher, similar to starting training from the beginning.
Environment:

DeepSpeed version: 0.15.0
PyTorch version: 2.4.1
Python version: 3.9
Model: Llama
ZeRO Optimization Stage: 3
Number of GPUs: 16
Distributed Backend: NCCL

Steps to Reproduce:

Train a model using DeepSpeed with ZeRO Stage 3 optimization and save checkpoints.

Use ds_to_universal.py to convert the DeepSpeed checkpoint to a universal checkpoint:
python ds_to_universal.py \
    --input_folder path_to_deepspeed_checkpoint \
    --output_folder path_to_universal_checkpoint \
    --num_extract_workers 1 \
    --num_merge_workers 1

Correspondiing Logs:

Click me
[2024-10-30 11:42:34,345] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
args = Namespace(input_folder='.global/', output_folder='global_universal', num_extract_workers=1, num_merge_workers=1, keep_temp_folder=False, strict=True, inject_missing_state=False)
Convert DeepSpeed Checkpoint to Universal Checkpoint
Converting DeepSpeed checkpoint in ./global_universal
ds_to_universal.py:449: FutureWarning: You are using torch.load with weights_only=False (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for weights_only will be flipped to True. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via torch.serialization.add_safe_globals. We recommend you start setting weights_only=True for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
state_dict = torch.load(optim_files[0], map_location=torch.device('cpu'))
ds_to_universal.py:407: FutureWarning: You are using torch.load with weights_only=False (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for weights_only will be flipped to True. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via torch.serialization.add_safe_globals. We recommend you start setting weights_only=True for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
return torch.load(files[0], map_location=torch.device('cpu'))[PARAM_SHAPES]
*** 1. Extracting ZeRO fragments
0%|                                                                                | 0/16 [00:00<?, ?it/s] ds_to_universal.py:153: FutureWarning: You are using torch.load with weights_only=False (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for weights_only will be flipped to True. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via torch.serialization.add_safe_globals. We recommend you start setting weights_only=True for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
state_dict = torch.load(optim_files[dp_index], map_location='cpu')
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 16/16 [01:46<00:00,  6.68s/it]
*** 2. Merging slices .....
0%|                                                                                | 0/201 [00:00<?, ?it/s] ds_to_universal.py:217: FutureWarning: You are using torch.load with weights_only=False (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for weights_only will be flipped to True. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via torch.serialization.add_safe_globals. We recommend you start setting weights_only=True for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
shards = [torch.load(p) for p in paths]
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 201/201 [01:34<00:00,  2.13it/s]
*** 3. Saving common optimizer states
ds_to_universal.py:423: FutureWarning: You are using torch.load with weights_only=False (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for weights_only will be flipped to True. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via torch.serialization.add_safe_globals. We recommend you start setting weights_only=True for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
sd = torch.load(optim_files[0], map_location=torch.device('cpu'))
*** Done!

Modify the training script to resume training from the universal checkpoint:

Set load_universal to True in the DeepSpeed config.
Load the checkpoint using model.load_checkpoint().

Resume training using the converted universal checkpoint.

Expected Behavior:

The model should resume training from the checkpointed state, with training loss consistent with the point at which training was paused.

Actual Behavior:

Upon resuming training, the training loss is significantly higher, as if the model weights and optimizer states were not correctly restored.
It appears that the model is starting from random initialization rather than the checkpointed state.

Additional Details:

Optimizer State Loading:

After loading the checkpoint the optimizer states are updated

Checkpoint Conversion:

The conversion script ds_to_universal.py runs without errors.
The generated universal checkpoint seems to have the correct structure.

Resuming from Original Checkpoint:

When resuming training from the original DeepSpeed checkpoint (before conversion), the training loss is consistent, indicating the issue arises after conversion to the universal checkpoint.

Code Snippets:
Relevant sections of my training script:
# DeepSpeed initialization
model, optimizer, _, lr_scheduler = deepspeed.initialize(
    model=model,
    optimizer=optimizer,
    lr_scheduler=lr_scheduler,
    model_parameters=model.parameters(),
    config=deepspeed_config,
)

assert model.load_universal_checkpoint() == args.universal_checkpoint, f"{args.universal_checkpoint} checkpoint not found"
model.load_checkpoint("path_to_universal_checkpoint")

DeepSpeed configuration:
{
    "bf16": {
        "enabled": "auto"
    },
    "zero_optimization": {
        "stage": 3,
        "overlap_comm": true,
        "contiguous_gradients": true,
        "sub_group_size": 5e8,
        "reduce_bucket_size": 5e8,
        "stage3_max_live_parameters": 5e8,
        "stage3_max_reuse_distance": 5e8,
        "stage3_gather_16bit_weights_on_model_save": true
    },
    "train_micro_batch_size_per_gpu": args.batch_size,
    "gradient_clipping": args.gradient_clipping,
    "gradient_accumulation_steps": args.gradient_accumulation_steps,
    "checkpoint": {
        "load_universal": true
    }
}

Attempts to Resolve:

Verified Configuration:

Ensured that load_universal is set to True in the DeepSpeed config.
Captured optimizer and lr_scheduler returned by deepspeed.initialize().

Monitoring:

Checked learning rate and global steps before and after loading the checkpoint.
Observed that the learning rate remains the same, and global steps do not reflect the checkpointed state.

Testing:

Reduced the number of extract and merge workers to 1 when running ds_to_universal.py to rule out parallelism issues.
Ensured version consistency of DeepSpeed and PyTorch across training, conversion, and resumption.

Questions:

All the examples provided already have a high loss like the ones in the repo continued training from loss of 7 or so,  is there an example continuing training from a chekcpoint that is trained well for a long time/high number of tokens?
Is there a known issue with ds_to_universal.py not correctly converting optimizer states for ZeRO Stage 3 and continuing with higher loss?

Any help or guidance would be greatly appreciated.

Any update on this issue?


Replace version constant with check against composer runtime.

Use Composer Runtime utilities to check for root pacakge version.
Currently blocked by Box not fully supporting the Composer Runtime Utilities, yet.
Fixes #704

Closed for now until box-project/box supports reading the root package version.


show GitHub stars in header

We may want some caching if we load the config lazily on each request… #695


FAI-346: [Scorecard Editor] Data Dictionary validation

JIRA ticket: https://issues.redhat.com/browse/FAI-346
This PR adds validation for data types inside the Data Dictionary

I'll take a proper look tomorrow but I noticed the following.
We decided to remove the inline Alert from the secondary properties page however it might be needed still:
Errors out of view

Errors scrolled into view

I'll take a proper look tomorrow but I noticed the following.
We decided to remove the inline Alert from the secondary properties page however it might be needed still:
Errors out of view

Errors scrolled into view

Another green one.. these are hard to come by!
@tiagobento Let's strike while the iron is hot and get this merged before the Git Action Gods turn nasty and this red!

Another green one.. these are hard to come by!
@tiagobento Let's strike while the iron is hot and get this merged before the Git Action Gods turn nasty and this red!


Falco Rule Integration Test

Motivation
The accuracy of anomaly detection with Falco heavily depends on Falco rules. Providing an integration test framework or example to validate a Falco alert given an event generated by this project would enable automated Falco rule testing and give users higher confidence when updating new Falco version, deploying new rules, reusing rules in a different OS/kernel.
Feature
User can use the framework to write an integration test that utilizes event-generator to trigger Falco rule alerts, captures these alerts using Falco client-go, and validates alert strings (ex. containerName should not be empty, alert text should contain a certain string, etc.)
Alternatives
Manual testing with event-generator

I was already thinking about something similar, and I really like your proposal.
Using the gRPC connection could be useful to perform a test in a live Falco installation.
Thank you!
:+1:

/Assign

Hey @Krishan-Sharma and @natchaphon-r
After thinking a little on this topic, I would like to create a simple interface that allows other components to hooks into the runner workflow, that would allow implementing the "tester" in its package (ie. pkg/tester) and keep the two things decoupled.
As soon as I can I will push my experiments in a separate branch.
Moreover, be also aware that we're changing the way gRPC is communicating, that was needed to solve some issues we encountered the current gRPC implementation. This improvement should be released on the next Falco version.
That being said, please don't stop your contribution. We can cooperate on this, feel free to contact me on Slack, open PRs and so on. I'm happy to help :)
Thanks.

Update:
I experimented a bit in this branch and I have found some issues that should be solved shortly.
If someone is working on this pls contact me on Slack.

Hey @leogr , I'll sync up with you on Slack.


Add check if proposed CIDRs are from Akamai

Due to previously observed error add option to make a check if a CIDR/IP belongs to akamai.
i.e. --valdate-akamainet ( or equivalent )

Not gonna add it to siteshield, please use diagnostic tools


Supress check for mustNotSplit

Hi, i've played a bit with configuration and didn't find a way to add only check for N characters length to break imports. My requirement is to let pass both
import {a, b} from "c"
and
import {
    a,
    b,
} from "c"

in case if import string length is less than configured value.
What could be the solution?

Please upgrade to version 1.2.0 and set the new forceSingleLine config option to false. This should allow for the behaviour you described. If you run into any problems, please feel free to reopen the issue.

Thx a lot 🚀


vcvrack: init at 0.5.1

Motivation for this change
VCVRack is an aweseome tool and a joy to play around with.
I had to update rtmidi and glew to make it work (they are separate commits though)
I'm not sure about the version handling of rtmidi this is a major version bump (2.1.1 -> 3.0.0).
Somebody should check this thing with the nox I'm not that deep into Nix to understand what is going on there.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option build-use-sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS (using my overlay )
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

@yegortimoshenko I fixed most of the things you commented, and add 2 more plugins (which bring in some good features, like recording or sending fixed numbers).
I would like to separate the plugins, but it is expected they are compiled via make allplugins in the plugins folder. Did not have time to check out if that is really necessary.
I'm using fetchgit for all, because some of them need to pull submodules. I thought it might help to create an attrset loop later. Btw I could need some help on this topic. We just need to put the plugin sources in the $src/plugins/ folder.
I put everything in $out/share/vcvrack and create a link to $out/bin if that is ok. I did not understand the other comment of yours, sorry :(
Hope you are satisfied.

Thank you a lot for your work! I'll review it now.
For loop, here is an inspiration for future packages if need arises: https://github.com/yegortimoshenko/nixpkgs/blob/05dc1bd798d1a445b9d2459d41229ea50e349564/pkgs/tools/inputmethods/ibus/default.nix#L38
But of course it's not required for merge.

By the way, it's 5 AM in my time zone and I usually go to bed at around 12 PM so I probably align with New Zealand pretty well :-)

@yegortimoshenko  I had some time yesterday, and I improved the plugin part using map.
I also put some more plugins. There are (plugin manager proposed on the website is not working as expected, so it is a good idea to deliver as much plugins as possible I would say)

Sorry for not publishing this earlier as I totally forgot about it but here's my hackish attempt - I've packaged the dependencies as well (if it makes sense to add them) https://github.com/sorki/nixpkgs/commit/2508164a9fa4cda912f8260a916a355d27811e20
Regarding plugins I really like what you did. To make the built-in plugin-manager working too you need to pass VERSION to make, see https://github.com/sorki/nixpkgs/commit/5264512c61a75cbdfec4b0910a864076de545fe4#diff-0a96701bbd982f577aab66458a659b5eR59

I bumped some of the plugin versions, because there was something happening the last month.
@yegortimoshenko I guess you have been busy the last time, or forgot about this pull-request.

Hi, I also created a PR for the same package (I was not aware of this PR at first). Maybe we can compare our packages. I created the package for the current master of VCVRack.

@yegortimoshenko I guess you had a lot of other troubles to do and had time (or other problems) figuring out what if the rtmidi version bump breaks anything.
I could create a rtmidi3 package so we'll be on the safe side, and can merge this pull-request, this was your last issue as far as I read (and remember).
(just give me a small go and I'll do it)

I could create a rtmidi3 package so we'll be on the safe side, and can merge this pull-request.

Yes I think that is the best solution. I think newer major versions of rtmidi and rtaudio are not backwards compatible with older versions. Hence, if you update these libraries, you break all projects that still depend on these older major versions. Making the new versions of these libraries available while defaulting to the existing version is the best way to go.

@yegortimoshenko I created a new packages (rtmidi3) to avoid dependency problems with other packages. This was the last issue here, so this pull-request should be ready to merge.

I'm closing this Pull-Request, because VCVRack 0.6.0 is out and has to be build in a different way. Maybe on of you (@svanderburg @sorki) are quicker the next time. Please ping me when you created a pull-request, so will wont.

@svanderburg @sorki @yegortimoshenko If you want to use version 0.6 I created a build in my overlay. This is the commit The pain point are the dependencies.


Accompanying PR for F* #2785

Syntactic changes for F* PR #2785.
I had to increase ifuel for one proof from 0 to 1. Digging into the proof, I was convinced that the proof does need 1 ifuel, why it was going through earlier is still a mystery to me.
Proposed changes
Describe the big picture of your changes here to communicate to the maintainers why we should accept this pull request. If it fixes a bug or resolves a feature request, be sure to link to that issue.
Types of changes
What types of changes does your code introduce to HACL*?
Put an x in the boxes that apply

[x] Proof maintenance (non-breaking change which fixes a proof regression)
[ ] Bugfix (non-breaking change which fixes an issue)
[ ] New algorithm or feature (non-breaking change which adds functionality)
[ ] Improved performance (fix or feature that would improve performance of some algorithm on some platform)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Documentation Update (if none of the other choices apply)

Checklist
Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code.

[x] I have read the CODE_OF_CONDUCT.md doc
[x] I have read and agree to submit my changes under the LICENSE
[x] I have added necessary documentation (if appropriate)
[x] I have edited CHANGES.md (if appropriate)

Further comments
Not applicable.


Refactoring DB Models

You can go over and check based on our new schema if I forgot something. I'll do some tests with dummy data and update accordingly.

@assaftal391
Are the tests passed?
If so, Let's merge it


Grant Application: Non-fungible Reference Bloc…

…kchain System
Grant Application
This application is:

[x] speculative (use this by default).
[ ] an RFP response.

This application is:

[ ] fully public.
[x] public with private finances.

Abstract

Provide a brief description of your project here summarising key points (1-2 paragraphs).
If your application is a follow-up to a previous one, please mention which one in the first line of the abstract and include a link to previous pull requests if applicable.
The details should be in the application document that is being added to the repository via this pull request.

In order to build a truly decentralized Web3, we want to propose a new reference system on blockchain that records and reflects the reference relationship between the referred old works and the new works that are based on others’ old works. By referring to the old work of others openly, anyone could freely do any improvements, updates or combinations on the old work to create new work, and all the earnings of the new work will be traced and shared transparently among the new work and all its referred old works to reward the old works for their opening and sharing of governance rights.
Checklist

[ ] The README has been read and understood.
[ ] The abstract above is succinct and complete.
[ ] The application form will be filled out accurately. Note that you will require the URL of this pull request.

The application:

[ ] is being added to the correct directory, either rfp-responses or  speculative.
[ ] includes the names of all team members.
[ ] contains a summary of the team's experience.
[ ] links to the GitHub and LinkedIn profiles of all team members that have one.
[ ] includes a comprehensive timeline of development.
[ ] includes an estimate of the funds required (optional).
[ ] provides an indication of the team's long term plans.

Hi Jieliang Yin,
Thank you for your application. We would like to learn more about your project.
Will you be available for a meeting this week? Perhaps friday.
Contact me and let me know what time you might be available:
<EMAIL_ADDRESS>Best,
Oliver Thormann
Concordium

Dear Oliver Thormann:
Hello!
Glad to have an opportunity to further discuss with you about it. I have sent a reply to your email address.
I will be available at 10am to 12pm, or 3pm to 5pm, or 9pm to 11pm in Eastern Standard Time (EST) anyday. Feel free to arrange a meeting at the time suitable for you and send me the meeting link.
Thanks a lot and see you then!
Kindly Regards,
Jieliang Yin


Update parse transform name in monad documentation

Coverage remained the same at 43.443% when pulling e59a440b47d51c268c8f626a03cdccafdb548fec on KrzysiekJ:patch-1 into 0a10b4f71c46c0ae5caaa0ee5939ad6219b8b4bf on fogfish:master.

Thank you for fixes!


Add windows support

AC:

Add Github Action windows runner to test against windows
Decide how Makefile / variables.env should work on Windows platform, and adjust for windows (e.g. should we support PowerShell, any other requirements?)

minimally we need to quote more. ex this:
--- a/.bingo/Variables.mk
+++ b/.bingo/Variables.mk
@@ -21,23 +21,23 @@ GOIMPORTS := $(GOBIN)/goimports-v0.1.2
 $(GOIMPORTS): $(BINGO_DIR)/goimports.mod
        @# Install binary/ries using Go 1.14+ build command. This is using bwplotka/bingo-controlled, separate go module with pinned dependencies.
        @echo "(re)installing $(GOBIN)/goimports-v0.1.2"
-       @cd $(BINGO_DIR) && $(GO) build -mod=mod -modfile=goimports.mod -o=$(GOBIN)/goimports-v0.1.2 "golang.org/x/tools/cmd/goimports"
+       @cd "$(BINGO_DIR)" && $(GO) build -mod=mod -modfile=goimports.mod -o="$(GOBIN)/goimports-v0.1.2" "golang.org/x/tools/cmd/goimports"

I think spaces just won't work. there are a bunch of reasons why. windows would only work if you can use non-spaces for both go and the checked out project

one main issue is that go env GOPATH comes out like `c:...'
The result is this is ambiguous and fails
GOBIN  ?= $(firstword $(subst :, ,${GOPATH}))/bin

This seems to work around things well enough in git bash assuming you have git installed in a non-spaced directory such as you'd get using https://github.com/travis-ci/gimme
--- a/.bingo/Variables.mk
+++ b/.bingo/Variables.mk
@@ -2,7 +2,9 @@
 # All tools are designed to be build inside $GOBIN.
 BINGO_DIR := $(dir $(lastword $(MAKEFILE_LIST)))
 GOPATH ?= $(shell go env GOPATH)
-GOBIN  ?= $(firstword $(subst :, ,${GOPATH}))/bin
+# This handles translation for Windows, but only in cygwin or similar environments
+PATHSEP := $(if $(COMSPEC),;,:)
+GOBIN  ?= $(firstword $(subst $(PATHSEP), ,$(subst \,/,${GOPATH})))/bin
 GO     ?= $(shell which go)


Port copy operator

Description of Changes
Ported the remove operator from the decomposition of the restructure operator discussed here: OpenTelementry#68.
Please check that the PR fulfills these requirements

[X] Tests for the changes have been added (for bug fixes / features)
[X] Docs have been added / updated (for bug fixes / features)
[X] Add a changelog entry (for non-trivial bug fixes / features)
[ ] CI passes

Log Files
Logs / Second
CPU Avg (%)
CPU Avg Δ (%)
Memory Avg (MB)
Memory Avg Δ (MB)

1
1000
1.517267
+0.086159945
123.46471
-1.5402756

1
5000
5.069
-0.22423983
132.36813
+0.6053314

1
10000
10.534681
+0.05178833
140.22589
-1.613678

1
50000
49.414505
-1.9135361
168.88281
-3.4187775

1
100000
101.15273
+0.7429428
244.03624
-1.515213

10
100
1.9137586
-0.051844478
130.04822
+1.9942017

10
500
6.310247
+0.1722455
135.76819
+2.300644

10
1000
11.603522
-0.22446632
141.71605
-0.9181061

10
5000
56.207355
-0.5174866
184.31479
+4.580017

10
10000
107.20577
+1.0642929
219.5594
-4.530304


Update gradlew.bat

Custom environment variable added:
The only change is the addition of set MY_CUSTOM_VARIABLE=custom_value to set the custom environment variable.

Custom environment variable added:
The only change is the addition of set MY_CUSTOM_VARIABLE=custom_value to set the custom environment variable.


Changed send_zulip() to add topic to beginning of content if topic needs to be truncated

#10539
Testing Plan:
Borrowed and adjusted tests from https://github.com/zulip/zulip/pull/12041/commits/5a098968c2de3edff00ea8f75d59285f5aed9953
GIFs or Screenshots:

Thanks for working on this!
Check out our GitHub guide and commit guidelines for details on our policies.

Thanks for working on this!
Check out our GitHub guide and commit guidelines for details on our policies.

Sure! Sorry about the messy commits, still a beginner!

Closing in favor of the more current https://github.com/zulip/zulip/pull/19913.


Use map for let bindings

Changes the let-bindings syntax from
(let ((x 1)
      (y 2)
      (z 3))
  body)

into using a map:
(let {x 1
      y 2
      z 3}
  body)

As a Lisper, I need to get used to this 😄 It makes all the sense. I can't find (at least now) any reason we this wouldn't be a good change.  But I disliked it in Clojure... so I have some internal conflicts to solve hehe!


The app is too slow when render too much polygons at google map flutter

Steps to reproduce
fill polygons with thousands of points
and try to notice the map
it takes 10 seconds to render
Expected results
it should render fast
Actual results
it takes 10 seconds to render
Code sample
GoogleMap(
                 mapType: MapType.normal,
                 initialCameraPosition: initialPosition,
                 onMapCreated: (GoogleMapController controller) async {
                   _controller.complete(controller);
                   _googleMapController = await _controller.future;
                   _googleMapController?.setMapStyle(
                       '[{"featureType": "poi","stylers": [{"visibility": "off"}]}]');
                 },
                 polygons: widget.mapPolygons ?? {},
                 zoomControlsEnabled: false,
                 myLocationButtonEnabled: false,
                 myLocationEnabled: true,
                 buildingsEnabled: false,
                 compassEnabled: false,
               ),

Screenshots or Video

Screenshots / Video demonstration
[Upload media here]

Logs
Logs
[Paste your logs here]

Flutter Doctor output
Doctor output
[Paste your output here]

@Aymaan-2024
Can you provide flutter doctor -v and plugin version you are using ? What platform are you seeing this behavior ?

fill polygons with thousands of points

This probably isn't realistic to have so many polygons. Do you have concrete steps that shows slowness of the maps ? You can check below related / similar issues to see if they resemble your case or not:
https://github.com/flutter/flutter/issues/146041
https://github.com/flutter/flutter/issues/138324
https://github.com/flutter/flutter/issues/60750

i've updated the issue

@Aymaan-2024
You are on old version of stable. Please upgrade to latest stable (3.24.5) with latest plugin version and re-run your scenario to check if the behavior still persist or not.
If so, please provide us complete minimal reproducible code sample (ex: main.dart)


chore: Remove algebra imports to Data.Fin.Basic

Move the algebraic instance on Fin n from Data.Fin.Basic to a new file Algebra.Group.Fin. I credit Yakov for https://github.com/leanprover-community/mathlib/pull/5010.
The one bit of algebra that is still imported in Data.Fin.Basic is NeZero. This is in prevision of its future upstreaming to Batteries or Std.

+ [NeZero

@adomani, another formatting issue here!

This presumably comes from a nameless instance: do you have any suggestion of what to print instead?

Probably instance : typeOfInstance is fine, even if typeOfInstance doesn't contain all the binders (because some of them are declared in variable and you're using a regex).

@YaelDillies, with the changes in #12935, the move-decls bot would have report what is below for this PR:

+ instance [NeZero n] {a : ℕ} : OfNat (Fin n) a where
+ instNatCast
+ natCast_def

Amazing! Can you get rid of where/:=? That's just noise here

With the update that I just pushed, you would see here:

+ instance [NeZero n] {a : ℕ} : OfNat (Fin n) a
+ instNatCast
+ natCast_def

bors merge

With the update that I just pushed, you would see here:

+ instance [NeZero n] {a : ℕ} : OfNat (Fin n) a
+ instNatCast
+ natCast_def

Is there a reason why the backticks are around the + and - instead of around the lemma names?


Need to add a Try for multisessions data

@mndbrandt is reporting that script is not flexible for running multi sessions when there are missing runs. An easy fix is to add a try and keep going if the session is not present.

it should go here.
https://github.com/cosanlab/cosanlab_preproc/blob/24739382dbcd1b85437a477e40681a7dcdd10a97/cosanlab_preproc/wfmaker.py#L113


Fix Maven download URLs

There are a few scripts used by the CloudFormation templates that install Maven onto AWS resources by downloading it from a URL. These downloads are failing as it looks like Apache mirrors only host the binaries for the most recent version of Maven, and there has recently been a new 3.5.x release. This is causing the deployment of all CloudFormation templates to fail.

Merged into develop


Use tool.poetry.dependencies.python from pyproject.toml to constrain the Python version

Resolves #17

@robdimsdale Could you add label semver:minor? This is pretty raw, probably won't be ready for a day or two.

Merging BLOCKED on a CPython buildpack release that includes pyproject.toml as a VersionSource with higher priority than default.

LGTM 👍


iscroll 5.2.0 can not scroll on nexus 6 in chrome

phone:motorola nexus 6
android:6.0
chrome:56.0.2924.87
iscroll:5.2.0
I runned 2d-scroll demo,and it can not scroll smoothly.

https://github.com/cubiq/iscroll/issues/1130#issuecomment-324517231
https://github.com/cubiq/iscroll/issues/1109
https://github.com/cubiq/iscroll/issues/1137


How to cite scikit-optimize?

Hi,
Currently I've been performing some modelling for experimentalists (academic research).
I have found skopt to be very useful and I would like to cite it.
Do you have any preferred format when citing skopt? (I've searched the repo and docs but couldn't find any guidance)
Also, do you offer any recommendations on what other references to cite (I've used forest_minimize for example)?

+1
Maybe a Zenodo DOI?

Right now we don't have anything beyond a link to the repo 😄
Thanks for bringing this up. We haven't discussed this much yet.
My preference would be to make a submission to JOSS, this then gives everyone something to cite. However Zenodo DOI and JOSS have the annoying feature that it is for a particular version of the software. Which is nice if you want to track versions, but means we'd have to make a new submission for every release ... so I have a slight preference towards creating a "thing" that people can cite that is valid forever and then specify by hand which release they used.
Another thing to ponder, can we put "The scikit-optimize contributors" as the author? Then there is the whole question of should we do that ... (in HEP there is a field for the collaboration in citations now so often you see Aardvark et al. [XYZ collaboration], ...)

Regarding a reference for forest_minimize: it is inspired by the work in SMAC, but I don't think we implement exactly what they do. Maybe SMAC cites something telling us what inspired them?

JOSS looks really nice.
Personally, I think that requesting a Zenodo DOI for each version is only a minor inconvenience. Submitting a new JOSS entry seems to be a little bit more intensive.
As for the authors, scikit-learn seem to include all the contributor into the authors list. At the same time I think it is 100% ok to mention a scikit-optimize collaboration and reference AUTHORS.md.

@bjodah how soon do you need an answer? I think we will take a few more days to make up our mind, so if you need to move faster, feel free to do what you think is best 😃

A few days waiting time is no problem (I am guessing we will submit in a few weeks but I'm not the main author so hard to say for sure).
Not that it is any of my business, but I thought I could mention that there is also JORS (Journal of Open Research Software).

Any thoughts?
Otherwise I would say let's create zenodo entry for every (future) release -> DOI for people to cite to signify which version they use.
If and when we do something nice that is original research (or otherwise should be documented in an article) we tackle that on a case by case basis.

If we want to discuss this more I would suggest we start with collecting a list of the problems that we are trying to solve via citation as that will help us figure out what the solution should be.

fine with me.

In machine learning, there is a long tradition of publishing short software papers in JMLR OSS+arXiv (http://www.jmlr.org/mloss/). These papers are then used for citations. This is not ideal because the list of authors is fixed and prevent future contributors from getting proper credits, but at the same time they are much better indexed and accounted for than Zenodo and alikes.

Problems we need to solve:

give credit to all contributors
create citable entity so people can document version of skopt they used
create citable entity so people can give credit for ideas

Can we write a JMLR OSS for every release that is text wise only a minor update on the previous paper?
Can we update the authorlist for a arxiv paper? Then we could create one arxiv entry and update it for ever release. In some sense arxiv is "ideal" for this as they already support multiple versions of one paper. (it would totally screw with any kind of naive citation counting if you became an author at some point in the future)
(I am a little outside of the citation collecting game ATM so I am biased towards lowest hassle/most radical solution.)

Or would we be happy to publish an article on "all of skopt" every ~6months? This might be slow enough that we don't run into unhappy editors who don't like us (re)publishing essentially the same text every few months. This is opposed to publishing on every release.

One thing we could do as well is have a collective author name, e.g "the scikit-optimize authors" and then publish once in JMLROSS / arXiv.

I think we should make a submission to JOSS with a collective author name as first author (or only author??) with the next release. THen we can ponder what to do next after. WDYT?

Ah, well if you ever change your mind... tiny PR here is welcome :) CITE.md


PHPUnit 11.3.1 | AssertIsList: sync error message with upstream

PHPUnit 11.3.1 improved the type information in select assertion failure messages.
For the polyfills, this only affects the AssertIsList polyfill.
Now the choice was between the following:

Just update the test(s) to have a different message expectation for PHPUnit 11.3.1+.
Update the polyfills to mirror the improvement made in PHPUnit upstream.

I've chosen to implement the latter as it makes the message significantly more informative.
This means that on PHPUnit 6.x to 9.x and 11.3.1+, the new, improved message is shown. While on PHPUnit 10.0 - 11.3.0, the "old" message is shown as, in that case, the PHPUnit native assertIsList() method is used without the message improvements.
Includes:

Renaming the assertIsListFailureDescription() method parameter from $other to $value to be more descriptive.
Updating the tests, including adding an extra test with an anonymous class as that has separate handling for the error message in the polyfill.

Refs:

https://github.com/sebastianbergmann/phpunit/commit/5e8b79e52717cf330ce1023ec4b255541812ba70
https://github.com/sebastianbergmann/phpunit/commit/42cfc7d5982eac708fab2a566021959b31a49aa5

coverage: 97.152% (+0.05%) from 97.104%
when pulling a0766bb1b7b82b3a8dfa38682e5f1d3edbdb66e3 on feature/3.x/assertislist-sync-error-message-with-upstream
into f0cd55ea6fcc53b90e1af73598f41b59d05558a5 on 3.x.


hPut and friends

It would be nice to be able to output a ShortText to a handle in a more direct way that explicitly converting to a bytestring and using bytestring's functions for this.

ShortText ought to be outputted as text, i.e. re-coded into whatever encoding Handle is using. I.e. it would be ~broken as Data.Text.IO. That's probably a reason why Data.Text.Short was never added.
To make it clear: In general converting to bytestring and outputting directly (as bytes) is wrong, but it works when e.g. user terminal expects UTF-8. You can do it in the app, it would be wrong to do that in the library.

I'm not clear on whether or not you would be in favor of a hPut that recodes based on the Handle's encoding (which I believe would match the behavior in Data.Text.IO).

I'd rather not add that either, as it's hard to use correctly. With text-2 converting to Text will be cheap, so its output functions could be used, or bytestring's. Whateever is more appropriate.

Alright, that seems fine.


grid search on thundersvm?

Hi, I'm a confused how to do grid search on thundersvm from python interface? Is it possible? Kindly update docs about it :) Thank you.

Hi.
For scikit python interface, kindly refer to grid search in scikit. Just pass thundersvm as its estimator.

thank you @shijiashuai , can I ask more question about how to load the model with load_from_file? Please help and thank you :)

For example:
x,y = load_svmlight_file("../dataset/test_dataset.txt")
clf = SVC(verbose=True, gamma=0.5, C=100)
clf.fit(x,y)
clf.save_to_file('./model')
Next time you run python:
clf = SVC()
clf.load_from_file('model')
Then you can directly use clf to do prediction without fit():
x2,y2=load_svmlight_file("../dataset/test_dataset.txt")
clf.predict(x2)

Thank you @GODqinbin , and I have tried using gridsearch from scikit but it give me this error:
FATAL [default] Check failed: [error == cudaSuccess] invalid device pointer
2018-07-04 01:18:15 PST2018-07-04 08:18:15,057 WARNING [default] Aborting application. Reason: Fatal log at [/floyd/home/thundersvm/src/thundersvm/syncmem.cpp:29]
What should i do?

Can you tell us the instructions you used and share your dataset? I've tried the gridsearch for the test_dataset.txt and it worked fine.

You can see my code here : https://www.floydhub.com/talenta10/projects/ta-fit-svm-adaboost/126/files/ta-fit-smote-pca-svm-test.py
and my dataset here : https://www.floydhub.com/talenta10/datasets/my-cool-dataset
Thank you before

Hi @GODqinbin,
Or maybe I have to convert my CSV dataset to txt libsvm format? Is it possible? Kindly give me your advice for this problem. Thank you :)

Since you have extracted x and y from CSV dataset, you needn't convert it to txt libsvm format. I can't locate your problem now since I didn't met your problem. I tried to train your dataset using svc.fit() and it worked fine. I can run your script on my machine after changing your script as following:
clf = GridSearchCV(SVC(), param_grid, scoring=score, n_jobs=-1,verbose= 2, cv=5) -> clf = GridSearchCV(SVC(), param_grid, scoring=score, cv=5)
I suggest that you can try to train the dataset first without grid search as following:
clf = SVC(verbose=True, gamma=0.01, C=0.1)
clf.fit(xtest, ytest)
If you can run it successfully, then there should be no problem in dataset training and the problem should be in grid search.

Yeay, thank you @GODqinbin . I think n_jobs caused it. Thank you again :)


Code Not Working

Hi Norm, Hope you are well!
Ok. So I have code all over my app. It has been amazing. I love _mc. I was one of your first and it has helped.
I have added a new section to my app and I can't get it to work. I have no idea what I am doing wrong. The code works in the previous areas.
HERE View_1872 - The code works great! _trk works great too!

I created a new record table, and I am creating new pages, grids, and views for it. But I can't get the same code to work!
View_2084 I added _mc=status and _trk

Any Idea? What am I doing wrong?
I finally got the developer tools, lol, And I even updated it to the latest version.

Hi Alisha,
This is unexpected indeed.  It should work.  Did you check the console logs?
Can you give me access to this page?  If so, send me the password at this email<EMAIL_ADDRESS>I already have the link you gave me in an email.
Norm

I don't even know how to check the logs. I sent you a PW. I am sure I broke something. I think I made things worse when I was trying to trouble shoot myself.

Alisha,
I am now in your app, on the page with the issue you're having.  There is a bug indeed.
But I can't see any data.  When I add an entry, it disappears right away...
Can you populate some rows for me so I can see something?
Norm

Which packlist are you viewing. The packlist line items are linked to the packlist name.

It's ok, I managed to see something last night.
But then, I stumbled on another bug due to grouping.
But I should be able to fix this today, depending on my workload with Morbern.
I'll keep you posted,
Norm

@Ampurcell,
I've fixed all bugs, but only in the Dev version for now.  I will do an official release shortly, hopefully today.
Can you test the Dev version please?
Click here to see how to do it:

Norm

Sweet! Dev works.

Glad to read that it works now.
Don't worry, you have nothing to do with the bug.  It's all KTL's fault!!!
I'll close this now.
Feel free to re-open if you see anything else related.
Cheers,
Norm


Convert raw queries to Sequelize: users.repository.js

Notice: this issue is causes by #10
In the PR above was done implementation of setup of Sequelize. So in this issue its need to convert all queries in users.repository.js to Sequelize.
If you need help you can talk with me (@fabioalmeida100) and I'll help you in onboarding of back-end project.

Important: if need you will have to setup others relation between the models. Each model is inside models folder (all models are pre setup to use Sequelize).


Add a search field in article and category view in Flat and Light themes.

This PR adds a search field to the Flat and Light themes in article and category views.

Hey @cr0vy thanks for adding this PR. I generally don't take PRs that materially change an existing theme, but you are welcome to incorporate this into a new theme, or you may be able to accomplish this with javascript added through the settings > design.

If a new theme is created, will that be incorporated into the hosted edition of Helpy and available to Helpy customers? As a hosted edition customer, I am specifically interested in development that helps the customer experience of hosted edition users get better.

Yes, that is what I was thinking.  If there was a new theme (say light2) or something like that we would incorporate it into both the open source and hosted versions.


⚠ Roblox Site has degraded performance

In 40969e6, Roblox Site (roblox.com) experienced degraded performance:

HTTP code: 200
Response time: 2944 ms

Resolved: Roblox Site performance has improved in a5a35f9 after 9 minutes.