Stuck at Running pub upgrade

Added environment variables path
D:\Apps\Flutter\flutter\bin\cache\dart-sdk
D:\Apps\Flutter\flutter\bin
downloaded flutter beta from git
then opened flutter.bat
fatal: not a git repository (or any of the parent directories): .git
Checking Dart SDK version...
Downloading Dart SDK from Flutter engine 9a28c3bcf40ce64fee61e807ee3e1395fd6bd954...                                    Unzipping Dart SDK...                                                                                Building flutter tool...
Running pub upgrade...

and stuck for hours

Hi @naveenjujaray
could you provide your flutter doctor -vv log?

i've removed the latest version of flutter stable sdk then installed previous one of April 2020 then it was working.

@naveenjujaray
does it work if you run flutter upgrade, flutter doctor (to upgrade to the latest version)?

No it won't work

Please guys I need help. I've been stuck with Running pub upgrade... for two weeks and it still not working. How to resolve this issue?

It's just been looked like this for several minutes.No other log files found in file system.Older version works. @VladyslavBondarenko
Could you plz reopen this issue?

It's just been looked like this for several minutes.No other log files found in file system.Older version works. @VladyslavBondarenko
Could you plz reopen this issue?

newly installed

Error (69): Unable to 'pub upgrade' flutter tool. Retrying in five seconds... (9 tries left)

@CoderTyn  @kehinsoft
Could everyone who still has this problem please file a new issue with the exact description of what happens, logs, and the output of flutter doctor -v.
All system setups can be slightly different, so it's always better to open new issues and reference related issues.

@TahaTesser emmm,I commented some pics about this problem,no more logs found in the filesystem or the commandline.

Facing the exact same issue... This should be re-opened.
flutter doctor -v returns no more info...
>flutter doctor -v
Building flutter tool...
Running pub upgrade...

Facing the exact same issue... This should be re-opened.
flutter doctor -v returns no more info...
>flutter doctor -v
Building flutter tool...
Running pub upgrade...

发件人: Pedro Nunes<EMAIL_ADDRESS>答复: flutter/flutter<EMAIL_ADDRESS>日期: 2021年1月5日 星期二 下午12:43
收件人: flutter/flutter<EMAIL_ADDRESS>抄送: Subscribed<EMAIL_ADDRESS>主题: Re: [flutter/flutter] Stuck at Running pub upgrade (#61719)
23423423423424
Facing the exact same issue... This should be re-opened.
flutter doctor -v returns no more info...

flutter doctor -v

Building flutter tool...
Running pub upgrade...
―
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/flutter/flutter/issues/61719#issuecomment-754391135, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAYMPMKZ3YNJ6K55WPTMO3DSYKKIBANCNFSM4O6GAL3Q.

发件人: Pedro Nunes<EMAIL_ADDRESS>答复: flutter/flutter<EMAIL_ADDRESS>日期: 2021年1月5日 星期二 下午12:43
收件人: flutter/flutter<EMAIL_ADDRESS>抄送: Subscribed<EMAIL_ADDRESS>主题: Re: [flutter/flutter] Stuck at Running pub upgrade (#61719)
23423423423424
Facing the exact same issue... This should be re-opened.
flutter doctor -v returns no more info...

flutter doctor -v

Building flutter tool...
Running pub upgrade...
―
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/flutter/flutter/issues/61719#issuecomment-754391135, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAYMPMKZ3YNJ6K55WPTMO3DSYKKIBANCNFSM4O6GAL3Q.

Could everyone who still has this problem please file a new issue with the exact description of what happens, logs, and the output of flutter doctor -v.
All system setups can be slightly different, so it's always better to open new issues and reference related issues.

Could everyone who still has this problem please file a new issue with the exact description of what happens, logs, and the output of flutter doctor -v.
All system setups can be slightly different, so it's always better to open new issues and reference related issues.

I'm having the same problem
i have tried to remove the previous version  and install it again but faced the same issue
Checking Dart SDK version...
Downloading Dart SDK from Flutter engine ae90085a8437c0ae94d6b5ad2741739ebc742cb4...
Unzipping Dart SDK...
Building flutter tool...
Running pub upgrade...

I'm having the same problem
i have tried to remove the previous version  and install it again but faced the same issue
Checking Dart SDK version...
Downloading Dart SDK from Flutter engine ae90085a8437c0ae94d6b5ad2741739ebc742cb4...
Unzipping Dart SDK...
Building flutter tool...
Running pub upgrade...

The problem is probably related to poor internet connection. In my case, using a mirror fixed this issue.

The problem is probably related to poor internet connection. In my case, using a mirror fixed this issue.

The problem is probably related to the poor internet connection. In my case, using a mirror fixed this issue.

That's right. What's more, notice the git proxy setting if you have changed the proxy port before.

The problem is probably related to the poor internet connection. In my case, using a mirror fixed this issue.

That's right. What's more, notice the git proxy setting if you have changed the proxy port before.

I turned off Windows Defender, Firewall,  and other anti-virus programs. It worked.

Had a previous version of flutter, deleted it.
Took a pull of the latest stable branch, and ran flutter doctor -v
No logs as such, just the below ones, and it was stuck.
Internet is fine, disabled antivirus, disabled firewall. Still the same issue persists.
D:\flutter>flutter doctor -v
Checking Dart SDK version...
Downloading Dart SDK from Flutter engine 2f0af3715217a0c2ada72c717d4ed9178d68f6ed...
Unzipping Dart SDK...
Building flutter tool...
Running pub upgrade...
Downloaded the "zip" file from the below location. Still facing the same issue.
https://flutter.dev/docs/get-started/install/windows

For me it seems a problem on macos, where
pub upgrade (or pub get) runs for a while then it times out with socket error.
I kill the process then run it again, it would get a few more packages then time out again. Rinse and repeat like 40 times until it's all done. It seems to be something with rate limiter not working on macos, or pub server thinking it's ddos, I have no idea, but Flutter is totally unusable on Mac.
I'm in europe, network is ok, no firewall, no antivirus. I have a Windows machine on the same router, where pub works just fine.
Dart Team <misc@dartlang.org>","homepage":"http://www.dartlang.org","name":"charcode"},"archive_url":"https://pub.dartlang.org/packages/charcode/versions/1.0.0.tar.gz","published":"2014-06-26T09:28:21.694420Z"},{"version":"1.0.0+1","pubspec":{"environment":{"sdk":">=1.0.0 <2.0.0"},"version":"1.0.0+1","description":"Constants for ASCII and common non-ASCII character codes.\nWhen working with characters in Dart, there is no simple way to represent the code point of a character. This library declares readable symbolic names for character codes.\n","author":"Dart Team <misc@dartlang.org>","homepage":"http://www.dartlang.org","name":"charcode"},"archive_url":"https://pub.dartlang.org/packages/charcode/versions/1.0.0%2B1.tar.gz","published":"2014-09-05T09:47:41.933800Z"},{"version":"1.1.0","pubspec":{"environment":{"sdk":">=1.0.0 <2.0.0"},"version":"1.1.0","description":"Constants for ASCII and common non-ASCII character codes.\nWhen working with characters in Dart, there is no simple way to represent the code point of a character. This library declares readable symbolic names for character codes.\n","author":"Dart Team <misc@dartlang.org>","homepage":"http://www.dartlang.org","name":"charcode"},"archive_url":"https://pub.dartlang.org/packages/charcode/versions/1.1.0.tar.gz","published":"2014-09-10T09:54:12.532630Z"},{"version":"1.1.1","pubspec":{"environment":{"sdk":">=1.0.0 <2.0.0"},"homepage":"https://github.com/dart-lang/charcode","version":"1.1.1","name":"charcode","author":"Dart Team <misc@dartlang.org>","description":"Constants for ASCII and common non-ASCII character codes.\nWhen working with characters in Dart, there is no simple way to represent the code point of a character. This library declares readable symbolic names for character codes.\n"},"archive_url":"https://pub.dartlang.org/packages/charcode/versions/1.1.1.tar.gz","published":"2016-11-19T17:35:15.793Z"},{"version":"1.1.2","pubspec":{"environment":{"sdk":">=1.0.0 <3.0.0"},"homepage":"https://github.com/dart-lang/charcode","version":"1.1.2","name":"charcode","author":"Dart Team <misc@dartlang.org>","description":"Constants for ASCII and common non-ASCII character codes. When working with characters in Dart, there is no simple way to represent the code point of a character. This library declares readable symbolic names for character codes."},"archive_url":"https://pub.dartlang.org/packages/charcode/versions/1.1.2.tar.gz","published":"2018-07-11T17:46:00.382487Z"},{"version":"1.1.3","pubspec":{"name":"charcode","version":"1.1.3","description":"Constants for ASCII and common non-ASCII character codes represented by top-level constants.","homepage":"https://github.com/dart-lang/charcode","environment":{"sdk":">=2.0.0 <3.0.0"},"dev_dependencies":{"pedantic":"^1.0.0"}},"archive_url":"https://pub.dartlang.org/packages/charcode/versions/1.1.3.tar.gz","published":"2020-02-11T15:37:32.663984Z"},{"version":"1.2.0-nullsafety","pubspec":{"name":"charcode","version":"1.2.0-nullsafety","description":"Constants for ASCII and common non-ASCII character codes represented by top-level constants.","homepage":"https://github.com/dart-lang/charcode","environment":{"sdk":">=2.10.0-0 <2.10.0"},"dev_dependencies":{"pedantic":"^1.0.0"}},"archive_url":"https://pub.dartlang.org/packages/charcode/versions/1.2.0-nullsafety.tar.gz","published":"2020-07-29T16:13:16.511645Z"},{"version":"1.2.0-nullsafety.1","pubspec":{"name":"charcode","version":"1.2.0-nullsafety.1","description":"Constants for ASCII and common non-ASCII character codes represented by top-level constants.","homepage":"https://github.com/dart-lang/charcode","environment":{"sdk":">=2.10.0-0 <2.11.0"},"dev_dependencies":{"pedantic":"^1.0.0"}},"archive_url":"https://pub.dartlang.org/packages/charcode/versions/1.2.0-nullsafety.1.tar.gz","published":"2020-09-22T15:49:23.459366Z"},{"version":"1.2.0-nullsafety.2","pubspec":{"name":"charcode","version":"1.2.0-nullsafety.2","description":"Constants for ASCII and common non-ASCII character codes.\n","environment":{"sdk":">=2.10.0-0 <2.12.0"},"dev_dependencies":{"test":"^1.16.0-nullsafety","pedantic":"^1.10.0-nullsafety"}},"archive_url":"https://pub.dartlang.org/packages/charcode/versions/1.2.0-nullsafety.2.tar.gz","published":"2020-10-26T10:44:46.720944Z"},{"version":"1.2.0-nullsafety.3","pubspec":{"name":"charcode","version":"1.2.0-nullsafety.3","description":"Constants for ASCII and common non-ASCII character codes.\n","environment":{"sdk":">=2.12.0-0 <3.0.0"},"dev_dependencies":{"test":"^1.16.0-nullsafety","pedantic":"^1.10.0-nullsafety"}},"archive_url":"https://pub.dartlang.org/packages/charcode/versions/1.2.0-nullsafety.3.tar.gz","published":"2020-11-04T10:56:47.500858Z"},{"version":"1.2.0","pubspec":{"name":"charcode","version":"1.2.0","repository":"https://github.com/lrhn/charcode","description":"Constants for ASCII and common non-ASCII character codes.","environment":{"sdk":">=2.12.0-0 <3.0.0"},"dev_dependencies":{"test":"^1.16.0-nullsafety","pedantic":"^1.10.0-nullsafety"}},"archive_url":"https://pub.dartlang.org/packages/charcode/versions/1.2.0.tar.gz","published":"2021-02-02T17:11:52.888788Z"}],"_fetchedAt":"2021-03-17T16:38:25.424503"}
IO  : Retry #3 for GET https://pub.dartlang.org/api/packages/timing...
IO  : HTTP GET https://pub.dartlang.org/api/packages/timing
    | Accept: application/vnd.pub.v2+json
    | X-Pub-OS: macos
    | X-Pub-Command: upgrade
    | X-Pub-Session-ID: 333927E5-91DF-4F46-825D-BCA5838AAA2E
    | X-Pub-Reason: dev
    | user-agent: Dart pub 2.13.0-143.0.dev
IO  : HTTP response 200 OK for GET https://pub.dartlang.org/api/packages/timing
    | took 0:00:00.155037
    | transfer-encoding: chunked
    | date: Wed, 17 Mar 2021 14:38:25 GMT
    | content-encoding: gzip
    | vary: Accept-Encoding
    | strict-transport-security: max-age=31536000; preload
    | via: 1.1 google
    | content-type: application/json; charset="utf-8"
    | x-frame-options: SAMEORIGIN
    | x-xss-protection: 1; mode=block
    | x-content-type-options: nosniff
    | server: dart:io with Shelf
IO  : Writing 3896 characters to text file /Users/rudolf.martincsek/.pub-cache/hosted/pub.dartlang.org/.cache/timing-versions.json.
FINE: Contents:
    | {"name":"timing","latest":{"version":"1.0.0","pubspec":{"name":"timing","version":"1.0.0","description":"A simple package for tracking the performance of synchronous and asynchronous actions.","repository":"https://github.com/dart-lang/timing","environment":{"sdk":">=2.12.0 <3.0.0"},"dependencies":{"json_annotation":"^4.0.0"},"dev_dependencies":{"build_runner":"^1.0.0","json_serializable":"^4.0.0","pedantic":"^1.1.0","test":"^1.0.0"}},"archive_url":"https://pub.dartlang.org/packages/timing/versions/1.0.0.tar.gz","published":"2021-03-10T19:07:29.480196Z"},"versions":[{"version":"0.1.0","pubspec":{"version":"0.1.0","name":"timing","author":"Dart Team <misc@dartlang.org>","description":"Timing is a simple package for tracking performance of both async and sync actions","homepage":"https://github.com/dart-lang/timing","environment":{"sdk":">=2.0.0 <3.0.0"},"dev_dependencies":{"test":"^1.0.0"}},"archive_url":"https://pub.dartlang.org/packages/timing/versions/0.1.0.tar.gz","published":"2018-09-11T19:10:03.736537Z"},{"version":"0.1.1","pubspec":{"version":"0.1.1","name":"timing","dependencies":{"json_annotation":"^1.0.0"},"author":"Dart Team <misc@dartlang.org>","description":"Timing is a simple package for tracking performance of both async and sync actions","homepage":"https://github.com/dart-lang/timing","environment":{"sdk":">=2.0.0 <3.0.0"},"dev_dependencies":{"build_runner":"^0.10.0","test":"^1.0.0","json_serializable":"^1.0.0","pedantic":"1.1.0"}},"archive_url":"https://pub.dartlang.org/packages/timing/versions/0.1.1.tar.gz","published":"2018-09-18T18:13:31.185989Z"},{"version":"0.1.1+1","pubspec":{"version":"0.1.1+1","name":"timing","dependencies":{"json_annotation":">=1.0.0 <3.0.0"},"author":"Dart Team <misc@dartlang.org>","description":"Timing is a simple package for tracking performance of both async and sync actions","homepage":"https://github.com/dart-lang/timing","environment":{"sdk":">=2.0.0 <3.0.0"},"dev_dependencies":{"build_runner":"^1.0.0","test":"^1.0.0","json_serializable":"^1.0.0","pedantic":"^1.1.0"}},"archive_url":"https://pub.dartlang.org/packages/timing/versions/0.1.1%2B1.tar.gz","published":"2018-10-23T21:36:58.968733Z"},{"version":"0.1.1+2","pubspec":{"version":"0.1.1+2","name":"timing","dependencies":{"json_annotation":">=1.0.0 <4.0.0"},"author":"Dart Team <misc@dartlang.org>","description":"A simple package for tracking the performance of synchronous and asynchronous actions.","homepage":"https://github.com/dart-lang/timing","environment":{"sdk":">=2.2.0 <3.0.0"},"dev_dependencies":{"build_runner":"^1.0.0","test":"^1.0.0","json_serializable":"^3.1.0","pedantic":"^1.1.0"}},"archive_url":"https://pub.dartlang.org/packages/timing/versions/0.1.1%2B2.tar.gz","published":"2019-08-08T17:37:21.554879Z"},{"version":"0.1.1+3","pubspec":{"name":"timing","version":"0.1.1+3","description":"A simple package for tracking the performance of synchronous and asynchronous actions.","repository":"https://github.com/dart-lang/timing","environment":{"sdk":">=2.2.0 <3.0.0"},"dependencies":{"json_annotation":">=1.0.0 <5.0.0"},"dev_dependencies":{"build_runner":"^1.0.0","json_serializable":"^3.1.0","pedantic":"^1.1.0","test":"^1.0.0"}},"archive_url":"https://pub.dartlang.org/packages/timing/versions/0.1.1%2B3.tar.gz","published":"2020-12-09T01:58:10.348672Z"},{"version":"1.0.0","pubspec":{"name":"timing","version":"1.0.0","description":"A simple package for tracking the performance of synchronous and asynchronous actions.","repository":"https://github.com/dart-lang/timing","environment":{"sdk":">=2.12.0 <3.0.0"},"dependencies":{"json_annotation":"^4.0.0"},"dev_dependencies":{"build_runner":"^1.0.0","json_serializable":"^4.0.0","pedantic":"^1.1.0","test":"^1.0.0"}},"archive_url":"https://pub.dartlang.org/packages/timing/versions/1.0.0.tar.gz","published":"2021-03-10T19:07:29.480196Z"}],"_fetchedAt":"2021-03-17T16:38:25.822727"}

IO  : Get versions from https://pub.dartlang.org/api/packages/term_glyph.
IO  : HTTP GET https://pub.dartlang.org/api/packages/term_glyph
    | Accept: application/vnd.pub.v2+json
    | X-Pub-OS: macos
    | X-Pub-Command: upgrade
    | X-Pub-Session-ID: 333927E5-91DF-4F46-825D-BCA5838AAA2E
    | X-Pub-Reason: dev
    | user-agent: Dart pub 2.13.0-143.0.dev
IO  : HTTP response 200 OK for GET https://pub.dartlang.org/api/packages/term_glyph
    | took 0:00:00.154957
    | transfer-encoding: chunked
    | date: Wed, 17 Mar 2021 14:38:25 GMT
    | content-encoding: gzip
    | vary: Accept-Encoding
    | strict-transport-security: max-age=31536000; preload
    | via: 1.1 google
    | content-type: application/json; charset="utf-8"
    | x-frame-options: SAMEORIGIN
    | x-xss-protection: 1; mode=block
    | x-content-type-options: nosniff
    | server: dart:io with Shelf
IO  : Writing 4455 characters to text file /Users/rudolf.martincsek/.pub-cache/hosted/pub.dartlang.org/.cache/term_glyph-versions.json.
FINE: Contents:
    | {"name":"term_glyph","latest":{"version":"1.2.0","pubspec":{"name":"term_glyph","version":"1.2.0","description":"Useful Unicode glyphs and ASCII substitutes.","homepage":"https://github.com/dart-lang/term_glyph","environment":{"sdk":">=2.12.0-0 <3.0.0"},"dev_dependencies":{"csv":">=3.0.0 <5.0.0","dart_style":">=0.2.0 <2.0.0","meta":"^1.3.0-nullsafety","test":"^1.16.0-nullsafety"}},"archive_url":"https://pub.dartlang.org/packages/term_glyph/versions/1.2.0.tar.gz","published":"2021-02-02T23:21:11.938521Z"},"versions":[{"version":"1.0.0","pubspec":{"version":"1.0.0","name":"term_glyph","author":"Dart Team <misc@dartlang.org>","description":"Useful glyphs and Windows-safe equivalents.","homepage":"https://github.com/dart-lang/term_glyph","environment":{"sdk":">=1.8.0 <2.0.0"},"dev_dependencies":{"test":"^0.12.0","dart_style":"^0.2.0","csv":"^3.0.0"}},"archive_url":"https://pub.dartlang.org/packages/term_glyph/versions/1.0.0.tar.gz","published":"2017-01-06T01:48:24.071Z"},{"version":"1.0.1","pubspec":{"version":"1.0.1","name":"term_glyph","author":"Dart Team <misc@dartlang.org>","description":"Useful glyphs and Windows-safe equivalents.","homepage":"https://github.com/dart-lang/term_glyph","environment":{"sdk":">=1.8.0 <3.0.0"},"dev_dependencies":{"test":">=0.12.0 <2.0.0","dart_style":">=0.2.0 <2.0.0","csv":"^3.0.0"}},"archive_url":"https://pub.dartlang.org/packages/term_glyph/versions/1.0.1.tar.gz","published":"2018-07-17T17:18:51.851569Z"},{"version":"1.1.0","pubspec":{"version":"1.1.0","name":"term_glyph","author":"Dart Team <misc@dartlang.org>","description":"Useful Unicode glyphs and ASCII substitutes.","homepage":"https://github.com/dart-lang/term_glyph","environment":{"sdk":">=1.8.0 <3.0.0"},"dev_dependencies":{"test":">=0.12.0 <2.0.0","dart_style":">=0.2.0 <2.0.0","csv":">=3.0.0 <5.0.0","meta":">=0.9.0 <2.0.0"}},"archive_url":"https://pub.dartlang.org/packages/term_glyph/versions/1.1.0.tar.gz","published":"2019-01-10T01:28:02.303526Z"},{"version":"1.2.0-nullsafety","pubspec":{"name":"term_glyph","version":"1.2.0-nullsafety","description":"Useful Unicode glyphs and ASCII substitutes.","homepage":"https://github.com/dart-lang/term_glyph","environment":{"sdk":">=2.10.0-0 <2.10.0"},"dev_dependencies":{"csv":">=3.0.0 <5.0.0","dart_style":">=0.2.0 <2.0.0","test":">=0.12.0 <2.0.0"}},"archive_url":"https://pub.dartlang.org/packages/term_glyph/versions/1.2.0-nullsafety.tar.gz","published":"2020-07-29T16:23:51.220281Z"},{"version":"1.2.0-nullsafety.1","pubspec":{"name":"term_glyph","version":"1.2.0-nullsafety.1","description":"Useful Unicode glyphs and ASCII substitutes.","homepage":"https://github.com/dart-lang/term_glyph","environment":{"sdk":">=2.10.0-0 <2.11.0"},"dev_dependencies":{"csv":">=3.0.0 <5.0.0","dart_style":">=0.2.0 <2.0.0","test":">=0.12.0 <2.0.0"}},"archive_url":"https://pub.dartlang.org/packages/term_glyph/versions/1.2.0-nullsafety.1.tar.gz","published":"2020-09-22T16:56:45.009904Z"},{"version":"1.2.0-nullsafety.2","pubspec":{"name":"term_glyph","version":"1.2.0-nullsafety.2","description":"Useful Unicode glyphs and ASCII substitutes.","homepage":"https://github.com/dart-lang/term_glyph","environment":{"sdk":">=2.10.0-0 <2.12.0"},"dev_dependencies":{"csv":">=3.0.0 <5.0.0","dart_style":">=0.2.0 <2.0.0","test":"^1.16.0-nullsafety"}},"archive_url":"https://pub.dartlang.org/packages/term_glyph/versions/1.2.0-nullsafety.2.tar.gz","published":"2020-10-23T21:33:38.244228Z"},{"version":"1.2.0-nullsafety.3","pubspec":{"name":"term_glyph","version":"1.2.0-nullsafety.3","description":"Useful Unicode glyphs and ASCII substitutes.","homepage":"https://github.com/dart-lang/term_glyph","environment":{"sdk":">=2.12.0-0 <3.0.0"},"dev_dependencies":{"csv":">=3.0.0 <5.0.0","dart_style":">=0.2.0 <2.0.0","test":"^1.16.0-nullsafety"}},"archive_url":"https://pub.dartlang.org/packages/term_glyph/versions/1.2.0-nullsafety.3.tar.gz","published":"2020-11-03T22:36:54.776382Z"},{"version":"1.2.0","pubspec":{"name":"term_glyph","version":"1.2.0","description":"Useful Unicode glyphs and ASCII substitutes.","homepage":"https://github.com/dart-lang/term_glyph","environment":{"sdk":">=2.12.0-0 <3.0.0"},"dev_dependencies":{"csv":">=3.0.0 <5.0.0","dart_style":">=0.2.0 <2.0.0","meta":"^1.3.0-nullsafety","test":"^1.16.0-nullsafety"}},"archive_url":"https://pub.dartlang.org/packages/term_glyph/versions/1.2.0.tar.gz","published":"2021-02-02T23:21:11.938521Z"}],"_fetchedAt":"2021-03-17T16:38:25.265367"}
IO  : Get versions from https://pub.dartlang.org/api/packages/charcode.
IO  : HTTP GET https://pub.dartlang.org/api/packages/charcode
    | Accept: application/vnd.pub.v2+json
    | X-Pub-OS: macos
    | X-Pub-Command: upgrade
    | X-Pub-Session-ID: 333927E5-91DF-4F46-825D-BCA5838AAA2E
    | X-Pub-Reason: dev
    | user-agent: Dart pub 2.13.0-143.0.dev
IO  : Retry #3 for GET https://pub.dartlang.org/api/packages/stream_transform...
IO  : HTTP GET https://pub.dartlang.org/api/packages/stream_transform
    | Accept: application/vnd.pub.v2+json
    | X-Pub-OS: macos
    | X-Pub-Command: upgrade
    | X-Pub-Session-ID: 333927E5-91DF-4F46-825D-BCA5838AAA2E
    | X-Pub-Reason: dev
    | user-agent: Dart pub 2.13.0-143.0.dev
IO  : HTTP error:
    | SocketException: Connection failed, address = pub.dartlang.org, port = 443
    |
    | dart:_http                                                                            _HttpClient.openUrl
    | package:http/src/io_client.dart 30:38                                                 IOClient.send
    | package:pub/src/http.dart 66:43                                                       _PubHttpClient.send
    | package:http_retry/http_retry.dart 108:33                                             RetryClient.send
    | ===== asynchronous gap ===========================
    | dart:async                                                                            _asyncThenWrapperHelper
    | package:pub/src/http.dart 173:39                                                      _ThrowingClient.send
    | package:pub/src/http.dart 376:31                                                      _ThrottleClient.send
    | ===== asynchronous gap ===========================
    | dart:async                                                                            _asyncThenWrapperHelper
    | package:http/src/base_client.dart 93:38                                               BaseClient._sendUnstreamed
    | package:http/src/base_client.dart 27:7                                                BaseClient.get
    | package:http/src/base_client.dart 51:28                                               BaseClient.read
    | package:pub/src/source/hosted.dart 207:35                                             BoundHostedSource._fetchVersions
    | dart:async                                                                            _CustomZone.runUnary
    | package:pub/src/rate_limited_scheduler.dart 87:27                                     RateLimitedScheduler._processNextTask.runJob
    | package:pub/src/rate_limited_scheduler.dart 85:21                                     RateLimitedScheduler._processNextTask.runJob
    | package:pub/src/rate_limited_scheduler.dart 90:30                                     RateLimitedScheduler._processNextTask
    | package:pool/pool.dart 127:28                                                         Pool.withResource
    | ===== asynchronous gap ===========================
    | dart:async                                                                            _asyncThenWrapperHelper
    | package:pub/src/rate_limited_scheduler.dart 117:25                                    RateLimitedScheduler.withPrescheduling.<fn>
    | package:pub/src/source/hosted.dart 237:24                                             BoundHostedSource._fetchVersions.<fn>
    | package:pub/src/source/hosted.dart 234:57                                             BoundHostedSource._fetchVersions.<fn>
    | package:pub/src/http.dart 289:51                                                      withDependencyType
    | package:pub/src/source/hosted.dart 234:17                                             BoundHostedSource._fetchVersions
    | ===== asynchronous gap ===========================
    | dart:async                                                                            _CustomZone.runUnary
    | package:pub/src/rate_limited_scheduler.dart 87:27                                     RateLimitedScheduler._processNextTask.runJob
    | package:pub/src/rate_limited_scheduler.dart 85:21                                     RateLimitedScheduler._processNextTask.runJob
    | package:pub/src/rate_limited_scheduler.dart 90:30                                     RateLimitedScheduler._processNextTask
    | package:pool/pool.dart 127:28                                                         Pool.withResource
    | ===== asynchronous gap ===========================
    | dart:async                                                                            _asyncThenWrapperHelper
    | package:pub/src/rate_limited_scheduler.dart 134:37                                    RateLimitedScheduler.schedule.<fn>
    | ===== asynchronous gap ===========================
    | dart:async                                                                            scheduleMicrotask
    | package:pub/src/rate_limited_scheduler.dart 134:7                                     RateLimitedScheduler.schedule
    | package:pub/src/source/hosted.dart 348:41                                             BoundHostedSource.doGetVersions
    | package:pub/src/source.dart 170:12                                                    BoundSource.getVersions
    | package:pub/src/solver/package_lister.dart 76:44                                      PackageLister._versions.<fn>.<fn>
    | dart:async                                                                            runZoned
    | package:pub/src/http.dart 290:10                                                      withDependencyType
    | package:pub/src/solver/package_lister.dart 75:33                                      PackageLister._versions.<fn>
    | package:pub/src/solver/package_lister.dart 74:66                                      PackageLister._versions.<fn>
    | dart:async                                                                            new Future.sync
    | package:async/src/async_memoizer.dart 43:45                                           AsyncMemoizer.runOnce
    | package:pub/src/solver/package_lister.dart 74:58                                      PackageLister._versions
    | package:pub/src/solver/package_lister.dart 111:21                                     PackageLister.countVersions
    | package:pub/src/solver/version_solver.dart 333:44                                     VersionSolver._choosePackageVersion.<fn>
    | package:pub/src/solver/version_solver.dart 332:49                                     VersionSolver._choosePackageVersion.<fn>
    | dart:async                                                                            Future.wait
    | package:pub/src/utils.dart 285:39                                                     minByAsync
    | package:pub/src/solver/version_solver.dart 332:25                                     VersionSolver._choosePackageVersion
    | package:pub/src/solver/version_solver.dart 94:24                                      VersionSolver.solve.<fn>
    | ===== asynchronous gap ===========================

I'm getting this behavior as well, and noticed that connections to pub.dartlang.org are failing.  I opened a browser and pointed it there, and the result was a "502 Server Error".
If someone is facing this right now, it's likely because of the server error and not because anything is wrong with the local installation of Flutter.

I'm getting this behavior as well, and noticed that connections to pub.dartlang.org are failing. I opened a browser and pointed it there, and the result was a "502 Server Error".
If someone is facing this right now, it's likely because of the server error and not because anything is wrong with the local installation of Flutter.

I am also facing the same error "502 Server Error" on browser

flutter 2.0.3 upgrade error
Facing isssue


[SPARK-48042][SQL] Use a timestamp formatter with timezone at class level instead of making copies at method level

What changes were proposed in this pull request?

This PR creates a timestamp formatter with the timezone directly for formatting. Previously, we called withZone for every value in the format function. Because the original zoneId in the formatter is null and never equals the one we pass in, it creates new copies of the formatter over and over.
...
     *
     * @param zone  the new override zone, null if no override
     * @return a formatter based on this formatter with the requested override zone, not null
     */
    public DateTimeFormatter withZone(ZoneId zone) {
        if (Objects.equals(this.zone, zone)) {
            return this;
        }
        return new DateTimeFormatter(printerParser, locale, decimalStyle, resolverStyle, resolverFields, chrono, zone);
    }

Why are the changes needed?

improvement
Does this PR introduce any user-facing change?

no
How was this patch tested?

Existing tests
I also ran the DateTimeBenchmark result locally, there's no performance gain at least for these cases.

Was this patch authored or co-authored using generative AI tooling?
no

Merged to master for Apache Spark 4.0.0.


Not working on Rider. Potentially a problem with the groovy loader

I already tried reinstalling everything. It works on Intellij but not on Rider.
This problem with Rider is happening in only one computer. The plugin works fine on other computers.
Any ideas besides reinstalling Windows? Thanks
Errors:
org.codehaus.groovy.control.MultipleCompilationErrorsException: startup failed:file:/C:/Users/Dell/scoop/apps/rider-eap-portable/current/profile/config/plugins/live-plugins/find-dialog/plugin.groovy: 6: unable to resolve class AnActionEvent @ line 6, column 50.   usFindDialog", "alt shift F") { AnAction                                 ^1 error
	at org.codehaus.groovy.control.ErrorCollector.failIfErrors(ErrorCollector.java:311)

org.codehaus.groovy.control.MultipleCompilationErrorsException: startup failed:file:/C:/Users/Dell/scoop/apps/rider-eap-portable/current/profile/config/plugins/live-plugins/find-dialog/plugin.groovy: 1: expecting EOF, found 'static' @ line 1, column 9.   import static liveplugin.PluginUtil.*           ^1 error
	at org.codehaus.groovy.control.ErrorCollector.failIfErrors(ErrorCollector.java:311)

org.codehaus.groovy.control.MultipleCompilationErrorsException: startup failed:file:/C:/Users/Dell/scoop/apps/rider-eap-portable/current/profile/config/plugins/live-plugins/find-dialog/plugin.groovy: 1: unexpected token: * @ line 1, column 18.   import java.awt.*                    ^1 error
	at org.codehaus.groovy.control.ErrorCollector.failIfErrors(ErrorCollector.java:311)

The errors you posted look like compilation errors.
If you try running examples bundled with liveplugin, do they work?
(Please don't reinstall windows 😅)

Nop, no groovy code is working. It seems Rider is unable to interpret it at all but is still trying to compile it (Java or Kotlin, maybe?). I tried changing the JVM runtime of Rider to a custom one with the Choose Runtime plugin but no success. Kotlin plugins work, I tried to convert the code but couldn't figure out the right APIs.
Everything normally works when Rider is installed exactly the same way in my personal machines, which I install myself. This one I started using straight away, I'm suspecting it might be some dll conflict. Already tried reinstalling Rider with and without scoop. I installed Intellij in this machine too and the groovy plugin worked there. Pretty spooky 😂


Question regarding envoy build issue.

If you are reporting any crash or any potential security issue, do not
open an issue in this repo. Please report the issue via emailing
<EMAIL_ADDRESS>where the issue will be triaged appropriately.
Title: *Unable to build envoy in local machine or remote *
Description:
I am trying to build envoy in my local mac. Followed  this tutorial to install necessary packages but couldn't build envoy successfully.  I have tried other options(Building envoy with Remote execution and Building Envoy with Docker sandbox) as well but was unsuccessful. Included all failure reports here. Please help.
OS - MacOS Ventura
bazel -version -6.0.0rc4

[optional Relevant Links:]
bazel build //source/exe:envoy-static --verbose_failures is failing with following error.
/private/var/tmp/_bazel_shyam.govindaraj/9fb1f5a16f24bcfd406266dd7220b973/sandbox/darwin-sandbox/286/execroot/envoy/external/local_config_cc/cc_wrapper.sh  -O2 -fomit-frame-pointer -Wall  -DLUAJIT_ENABLE_LUA52COMPAT  -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE -U_FORTIFY_SOURCE  -DLUA_ROOT=\"/private/var/tmp/_bazel_shyam.govindaraj/9fb1f5a16f24bcfd406266dd7220b973/sandbox/darwin-sandbox/286/execroot/envoy/bazel-out/darwin-fastbuild/bin/external/envoy/bazel/foreign_cc/luajit.build_tmpdir/luajit\" -DLUA_MULTILIB=\"lib\" -fno-stack-protector  -U_FORTIFY_SOURCE -fstack-protector -Wall -Wthread-safety -Wself-assign -Wunused-but-set-parameter -Wno-free-nonheap-object -fcolor-diagnostics -fno-omit-frame-pointer -no-canonical-prefixes -Wno-builtin-macro-redefined -D__DATE__=redacted -D__TIMESTAMP__=redacted -D__TIME__=redacted -DABSL_MIN_LOG_LEVEL=4 -fno-function-sections -fno-data-sections -c -o lib_base.o lib_base.c
CC        lj_ffrecord.o
lj_err.c:290:8: error: thread-local storage is not supported for the current target
static __thread _Unwind_Exception static_uex;
       ^
1 error generated.
make[1]: *** [lj_err.o] Error 1
make[1]: *** Waiting for unfinished jobs....
/private/var/tmp/_bazel_shyam.govindaraj/9fb1f5a16f24bcfd406266dd7220b973/sandbox/darwin-sandbox/286/execroot/envoy/external/local_config_cc/cc_wrapper.sh  -O2 -fomit-frame-pointer -Wall  -DLUAJIT_ENABLE_LUA52COMPAT  -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE -U_FORTIFY_SOURCE  -DLUA_ROOT=\"/private/var/tmp/_bazel_shyam.govindaraj/9fb1f5a16f24bcfd406266dd7220b973/sandbox/darwin-sandbox/286/execroot/envoy/bazel-out/darwin-fastbuild/bin/external/envoy/bazel/foreign_cc/luajit.build_tmpdir/luajit\" -DLUA_MULTILIB=\"lib\" -fno-stack-protector  -U_FORTIFY_SOURCE -fstack-protector -Wall -Wthread-safety -Wself-assign -Wunused-but-set-parameter -Wno-free-nonheap-object -fcolor-diagnostics -fno-omit-frame-pointer -no-canonical-prefixes -Wno-builtin-macro-redefined -D__DATE__=redacted -D__TIMESTAMP__=redacted -D__TIME__=redacted -DABSL_MIN_LOG_LEVEL=4 -fno-function-sections -fno-data-sections -c -o lib_io.o lib_io.c
/private/var/tmp/_bazel_shyam.govindaraj/9fb1f5a16f24bcfd406266dd7220b973/sandbox/darwin-sandbox/286/execroot/envoy/external/local_config_cc/cc_wrapper.sh  -O2 -fomit-frame-pointer -Wall  -DLUAJIT_ENABLE_LUA52COMPAT  -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE -U_FORTIFY_SOURCE  -DLUA_ROOT=\"/private/var/tmp/_bazel_shyam.govindaraj/9fb1f5a16f24bcfd406266dd7220b973/sandbox/darwin-sandbox/286/execroot/envoy/bazel-out/darwin-fastbuild/bin/external/envoy/bazel/foreign_cc/luajit.build_tmpdir/luajit\" -DLUA_MULTILIB=\"lib\" -fno-stack-protector  -U_FORTIFY_SOURCE -fstack-protector -Wall -Wthread-safety -Wself-assign -Wunused-but-set-parameter -Wno-free-nonheap-object -fcolor-diagnostics -fno-omit-frame-pointer -no-canonical-prefixes -Wno-builtin-macro-redefined -D__DATE__=redacted -D__TIMESTAMP__=redacted -D__TIME__=redacted -DABSL_MIN_LOG_LEVEL=4 -fno-function-sections -fno-data-sections -c -o lj_ffrecord.o lj_ffrecord.c
make: *** [src/luajit] Error 2
+ set +x
cp: /private/var/tmp/_bazel_shyam.govindaraj/9fb1f5a16f24bcfd406266dd7220b973/sandbox/darwin-sandbox/286/execroot/envoy/bazel-out/darwin-fastbuild/bin/external/envoy/bazel/foreign_cc/luajit.build_tmpdir/luajit/*: No such file or directory

Other options that I tried was also unsuccessful.
1. Building envoy with Remote execution:
bazel build envoy --config=remote-clang \
    --remote_cache=grpcs://remotebuildexecution.googleapis.com \
    --remote_executor=grpcs://remotebuildexecution.googleapis.com \
    --remote_instance_name=projects/envoy-ci/instances/default_instance
INFO: Invocation ID: 02c0eeb2-2287-40e7-815f-bdaa325783e0
ERROR: Failed to init auth credentials: The Application Default Credentials are not available. They are available if running in Google Compute Engine. Otherwise, the environment variable GOOGLE_APPLICATION_CREDENTIALS must be defined pointing to a file defining the credentials. See https://developers.google.com/accounts/docs/application-default-credentials for more information.
ERROR: Error initializing RemoteModule
shyam.govindaraj@shyamgo-ltma4mf envoy % bazel build envoy --config=docker-clang
INFO: Build options --action_env, --crosstool_top, --define, and 4 more have changed, discarding analysis cache.
ERROR: /private/var/tmp/_bazel_shyam.govindaraj/9fb1f5a16f24bcfd406266dd7220b973/external/envoy_build_tools/toolchains/configs/linux/clang/cc/BUILD:47:19: in cc_toolchain_suite rule @envoy_build_tools//toolchains/configs/linux/clang/cc:toolchain: cc_toolchain_suite '@envoy_build_tools//toolchains/configs/linux/clang/cc:toolchain' does not contain a toolchain for cpu 'darwin'
ERROR: /private/var/tmp/_bazel_shyam.govindaraj/9fb1f5a16f24bcfd406266dd7220b973/external/envoy_build_tools/toolchains/configs/linux/clang/cc/BUILD:47:19: Analysis of target '@envoy_build_tools//toolchains/configs/linux/clang/cc:toolchain' failed
ERROR: /Users/shyam.govindaraj/Documents/envoy/source/exe/BUILD:24:16: errors encountered resolving select() keys for //source/exe:envoy-static
ERROR: Analysis of target '//:envoy' failed; build aborted:
INFO: Elapsed time: 1.281s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (82 packages loaded, 568 targets configured)

Building Envoy with Docker sandbox

bazel build envoy --config=docker-clang
ERROR: /private/var/tmp/_bazel_shyam.govindaraj/9fb1f5a16f24bcfd406266dd7220b973/external/envoy_build_tools/toolchains/configs/linux/clang/cc/BUILD:47:19: in cc_toolchain_suite rule @envoy_build_tools//toolchains/configs/linux/clang/cc:toolchain: cc_toolchain_suite '@envoy_build_tools//toolchains/configs/linux/clang/cc:toolchain' does not contain a toolchain for cpu 'darwin'
ERROR: /private/var/tmp/_bazel_shyam.govindaraj/9fb1f5a16f24bcfd406266dd7220b973/external/envoy_build_tools/toolchains/configs/linux/clang/cc/BUILD:47:19: Analysis of target '@envoy_build_tools//toolchains/configs/linux/clang/cc:toolchain' failed
ERROR: /Users/shyam.govindaraj/Documents/envoy/bazel/BUILD:209:29: errors encountered resolving select() keys for //bazel:gcc_build
ERROR: /Users/shyam.govindaraj/Documents/envoy/source/exe/BUILD:24:16: errors encountered resolving select() keys for //source/exe:envoy-static
ERROR: Analysis of target '//:envoy' failed; build aborted:
INFO: Elapsed time: 0.256s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (0 packages loaded, 0 targets configured)

For the first option of building natively on your mac, try passing --macos_minimum_os=12.0 --host_macos_minimum_os=12.0 (or lower if you don't have macOS 12)

--macos_minimum_os=12.0 --host_macos_minimum_os=12.0

Not helping. Getting same error with below command.
bazel build //source/exe:envoy-static --verbose_failures --macos_minimum_os=12.0 --host_macos_minimum_os=12.0

If you don't need the lua extension you can avoid building luajit entirely by removing this line:
https://github.com/envoyproxy/envoy/blob/4fb3eeb1a12b9005133639e96425fef16816c2a4/source/extensions/extensions_build_config.bzl#L123
I'm surprised others don't see this issue otherwise. Do you have a full Xcode installation or just the command line tools? If you only have the command line tools I think you might actually need a different flag for the minimum macOS version, specifically --copt=-mmacos-version-min=12.0 --host_copt=-mmacos-version-min=12.0

I do have only the command line tools. I can successfully build envoy with these options --copt=-mmacos-version-min=12.0 --host_copt=-mmacos-version-min=12.0. Thank you for the help @keith


Add dependencies for copied tasks for grouping task retry

Abstract

This PR fixes #701 (which I reported).
Modify DatabaseSessionStoreManager#copyInitialTasksForRetry to add dependencies for copied tasks, for grouping task retry.

Detail

In 0.9.21, when digdag executes the following workflow, +task3 is retried despite that the upstream task(+task2) was failed.

+first:
  echo>: ""
  append_file: out
+doit:
  _retry: 3
  +task1:
    echo>: "try"
    append_file: out
  +task2:
    fail>: task failed expectedly
  +task3:
    echo>: "skipped"
    append_file: out

I think this is not expected behavior, and @komamitsu gave me a comment that this looks like a bug here(Qiita comment).
Then, I found that copied tasks, for retrying, do not have any upstreams when they are generated in  DatabaseSessionStoreManager#copyInitialTasksForRetry.
I thought this is the cause of this phenomenon.
So, I modified to set the before tasks of each copied tasks as upstream tasks.

Note

This is my first PR in this product, so I wonder whether this is the best approach.
For example, I used DatabaseTaskControlStore#addDependencies to add dependencies, but I'm not sure that using this method is the suitable in this case...
So please point out if I have modified with wrong way. I'll fix it.
This is my research note (Sorry, this is written in Japanese)

@komamitsu
I rebased this branch on the latest master branch and force pushed today.
I confirmed this problem in also 0.9.24.  (latest version for now)
Do you have any progress about this issue?

It seems that copyInitialTasksForRetry was completely missing consideration of task dependencies. This PR fixes a part of it. So thank you, this PR looks good. However, there is another missing issue for nested tasks. For example,
+success1:
    echo>: 'success1'

+success2:
    echo>: 'success2'

+fail:
    _retry: 3

    +nested_success1:
        echo>: 'nested_success1'

    +nested_success2:
        +nested_success2_nested1:
            sh>: sleep 60

        +nested_success2_nested2:
            echo>: 'nested_success2'

    +nested_fail:
        sh>: exit 1;

    +nested_success3:
        echo>: 'nested_success3'

+success3:
    echo>: 'success3'

Task +nested_success2_nested2 should depend on +nested_success2_nested1. But with current code, it doesn't copy the dependencies.
Because addSubtask(long attemptId, Task task) takes Task, it doesn't (can't) consider fields of StoredTask at all including StoredTask::getUpstreams. So, copyInitialTasksForRetry is responsible to copy them.
To do it, we will need to implement a mechanism similar to TaskControl.addTasks. It would be:

Create Map<Long, Long> oldIdToNewId = new HashMap<>().
After calling addSubtask, put new entry's id there:
oldIdToNewId.put(task.getId(), newTaskId);
Rebuild dependencies based on it:
store.addDependencies(newTaskId, task.getUpstreams().stream().map(oldIdToNewId::get).collect(toImmutableList());

I created #738.

@frsyuki
Thank you for your comment and following up!


Enforce standard format

We're using the trick shown here to enforce gofmt standard formatting.
For reference, in case the link fails in the future:
test -z $(gofmt -l .)

That command will return -1 if gofmt -l lists any  file that deviates from the standard formatting.

Note: the command will only be executed on linux OS, but that is enough in order to fail the build if the code is not properly formatted.

maybe just add configuration file for golangci-lint and enable gofmt linter in it?
https://golangci-lint.run/usage/configuration/#config-file
https://golangci-lint.run/usage/linters/#gofmt

@LukaszKokot no problem. Also there is a separate github action for it: https://github.com/golangci/golangci-lint-action


Using Git & GitHub to launch your professional career - Online - 06/26/21

Event Title
Using Git & GitHub to launch your professional career
Event Date
June 26, 2021
Event description
Haven't contributed to the open source projects? Don't know Git & GitHub? Learn more from your GitHub Campus Expert 🇵🇭 on how you can use Git & GitHub to launch your professional career.
Event Poster

Event Report
In total, 81 people attended the event. All of them are students from different schools/universities in the Philippines. There were more male participants than female participants.


Bayesian optimization priors

For hyper parameter optimization, it's very expensive to run. Assuming you've optimized your hyper parameters once.
But you add another hyper parameter or change your model a little bit.
Can you use the previous runs as a prior for Bayesian optimization to help speed up the process?

Two options come straight to mind:

use the previous evaluations as initial points (pass as x0 and y0). If you added a dimension you will have to think about how to assign a value for that
you can change the distribution from which values are sampled for each dimension of your search space (take a look at the skopt.space.Real/Integer classes)

More complex schemes have been discussed (see for example #332) but not yet done.

From #332 and #325 it seemed like the most simple and yet efficient thing would be to just reuse points with minimal / low values of objective from previous optimization problems as initialization for new ones. One could attempt also to learn one surrogate model for multiple optimization problems, but at least at the time it seemed to lead to models which converge quickly initially, but seem to be overconfident in what space was explored, and hence skip points with good objective values. These results are biased however towards ML domain. Better but more surrogate specific results you can find in here.
Do you have some particular use case in mind maybe?

That gives me a better idea of what to do. Thank you!
The use case for me was hyperparameter optimization.


Handling javascript errors (onError() ?)

Is there a built-in method for handling javascript errors similar to:
browser.onConsole((msg) => {
console.log(msg);
})
?

Hi @rtbz ! Sorry for the delay on the reply, I was out for a few days.
You mean a method to catch exceptions?
Cheers,
Luciano

Hi Luciano,
Im also interested to know how to best handle the exception. A sample snippets would be great.
Paul

@fusionx1 , you mean the Unhandled exception thrown when something fails?
You can just add a try-catch statement outside your navigation recipe.
You can see the example here:
https://github.com/LucianoGanga/simple-headless-chrome/blob/master/examples/clickSelector.js
If you mean exceptions thrown by the browser, I'm preparing an example with a function that can output what's in the browser's console.
I'll upload it in a minute.
Cheers,
Lucho

Awesome thanks @LucianoGanga


Update extension id from v.V to vlanguage.vscode-vlang

Corrects the extension id to automatically install on creating the container

thank you @revosw ! I'll merge this PR and update the main branch to use latest V!


Can't proceed with ADO Demo Generator

Hi @sweeyoongl78
Kindly provide more info on what issue you encountered. We can look into it.
Thanks


Add slides into lazy load list based on the initial slide

lazyLoadedList should also consider the initialSlide config setting

When it would be merged in master?

Fixed this in latest release


meshConfig.defaultConfig.holdApplicationUntilProxyStarts not working as expected in 1.9.0

meshConfig.defaultConfig.holdApplicationUntilProxyStarts not working as expected in 1.9.0
I can see that the istio-proxy starts before the main container even when this flag is set.
This used to work in 1.8.1
[ ] Docs
[ ] Installation
[X] Networking
[ ] Performance and Scalability
[ ] Extensions and Telemetry
[ ] Security
[ ] Test and Release
[ ] User Experience
[ ] Developer Infrastructure
[ ] Upgrade
Expected behavior
When this flag is set the istio proxy container should be started at the beginning instead of in the end.
Steps to reproduce the bug
Sample pod describe
  Type     Reason     Age        From                        Message
  ----     ------     ----       ----                        -------
  Normal   Scheduled  <unknown>                              Successfully assigned myapp-cloud/emc-edr-processing-57b6c9467-wdzg8 to test-dev-smene
  Normal   Pulled     79s        kubelet, test-dev-smene  Container image "istio/proxyv2:1.9.0" already present on machine
  Normal   Created    78s        kubelet, test-dev-smene  Created container istio-init
  Normal   Started    78s        kubelet, test-dev-smene  Started container istio-init
  Normal   Pulling    78s        kubelet, test-dev-smene  Pulling image "myapp-emc/edr-processing:4.0.20"
  Normal   Pulled     77s        kubelet, test-dev-smene  Successfully pulled image "myapp-emc/edr-processing:4.0.20" in 561.747434ms
  Normal   Created    77s        kubelet, test-dev-smene  Created container emc-edr-processing
  Normal   Started    77s        kubelet, test-dev-smene  Started container emc-edr-processing
  Normal   Pulled     76s        kubelet, test-dev-smene  Container image "istio/proxyv2:1.9.0" already present on machine
  Normal   Created    76s        kubelet, test-dev-smene  Created container istio-proxy
  Normal   Started    76s        kubelet, test-dev-smene  Started container istio-proxy

Version (include the output of istioctl version --remote and kubectl version --short and helm version --short if you used Helm)
istio 1.9.0
kubernetes 1.18
How was Istio installed?
Istio operator
Environment where the bug was observed (cloud vendor, OS, etc)
Additionally, please consider running istioctl bug-report and attach the generated cluster-state tarball to this issue.
Refer cluster state archive for more details.

When is the next official release planned? 1.9.1?

When is the next official release planned? 1.9.1?

@samene Probably early next week.


Add bytes()/bytes(Charset)/bytes(String) navigation methods to AbstractStringAssert

Feature summary
Add AbstractStirngAssert#extracting(Charset)AbstractByteArrayAssert so that the byte[] can be verified.
Example
String actual  = "";
assertThat(actual)
        .hasSize(0)
        .extracting(StandardCharset.US_ASCII) // AbstractByteArrayAssert
        .hasSize(0)
;

What if we would stay closer to getBytes(Charset)?
Following the style of other navigation methods, we could add bytes(Charset):
String actual  = "";
assertThat(actual)
        .hasSize(0)
        .bytes(StandardCharset.US_ASCII) // AbstractByteArrayAssert
        .hasSize(0)

I would also consider the variant without parameters and the one with String.

@scordio The bytes(Charset) seems nice. Thank you.

@scordio I was looking into this one as it seems like a good starting point.
I've noticed that there are already methods such as AbstractStringAssert::asByte and AbstractByteArrayAssert::asString and AbstractByteArrayAssert::asString(Charset).  What do you think about using the "as" prefix for consistency? so basically asBytes() and asByts(Charset)

Thanks for your interest, @etrandafir93!

I've noticed that there are already methods such as AbstractStringAssert::asByte and AbstractByteArrayAssert::asString and AbstractByteArrayAssert::asString(Charset). What do you think about using the "as" prefix for consistency? so basically asBytes() , asBytes(Charset) and asBytes(String)

To the best of my knowledge, there is no asByte in AbstractStringAssert but we do have other methods like asBase64Decoded.
We tend to favor the as prefix for methods that perform additional transformations under the hood, while we prefer not to use any prefix when we delegate the execution to an API provided by the underlying type. An example is AbstractThrowableAssert::cause that delegates to Throwable::getCause.
For this reason, I would go with bytes for this case.

Lastly, what do you think the expected behavior should be in case of a null (actual) String? Should It throw an exception right away? or return a ByteArrayAssert with a null actual value? There are a few examples in the PR link

It doesn't make much sense to execute navigation methods when the object under test is null, therefore I suggest performing an isNotNull() call internally before creating the new assertion object.

@scordio this is the asByte() method i was referring to. I have now applied the suggestions and fixed the formatting issues.

Right, I was mistakenly looking at the released version instead of the latest codebase, sorry 🙂

Hello @scordio, @joel-costigliola,
I've opened the https://github.com/assertj/assertj/pull/3232 some time ago.  I'd appreciate your feedback here whenever you have a moment - your time and expertise in reviewing this would mean a lot.
Let me know if there's anything I can do to assist in the process. Thanks, and I'm looking forward to your response.

Hi @etrandafir93 , thanks a lot and apologies for the delay.
We're currently finalizing 3.25.0 and we'll need some time before we can jump on your PR.
As we want to freeze the release scope, I'll schedule your changes for 3.26.0.

No worries, thanks for reaching out and explaining the process!

Closed by https://github.com/assertj/assertj/pull/3232


Extension is disabled in Chrome app mode

Hi, I am using Chrome on Linux with configuration to open several urls in app mode using google-chrome --app=<url>
Now i am not sure if there is a limitation with Chrome or the extension itself has an issue but I can not use this extension in app mode. Pressing the shortcut key does nothing. Did some research online, but could not find anything helpful. I have some other extensions that I can use in app mode (namely cVim).
Any idea about this issue ?

I can reproduce this, looks like Chrome doesn't support extensions that launch via commands.
https://github.com/dannyvankooten/browserpass/blob/82e69b5be4c5192e87c186d1be312671570e2308/chrome/manifest.json#L32-L37
I found two valuable pieces of information:

You are definitely not the only one asking, here is another unsolved question about extensions in app mode.
Using google-chrome --kiosk <url> opens the same borderless window, but there extensions work! The only difference I found is that the window starts in full screen, but at least in i3 I can easily exit the full screen mode.

I'm afraid there is nothing we could do on our side to solve the issue. I suggest you to either use --kiosk mode or submit a bug report for Chromium.

Thanks @maximbaz I will submit a bug report I think. Kiosk does not really work if you have a chrome running in the background, or a chrome instance is already running.
It seems to work only if you start Chrome the first in kioks mode it seems to work. Which makes sense as the names suggest it is for kiosks.

@breneser can you provide a link to the bug report?

Never mind...I found a solution. You have to add --enable-extensions also to the startup command.
e.g.: google-chrome --app=<url> --enable-extensions

Nice finding!

On windows with chrome 73, I can get app mode in the presence of existing chrome windows complete with extensions running with something as simple as the following:
chrome.exe --app=https://duckduckgo.com --new-window
Without --new-window, the --app argument is ignored if there is a running instance of chrome already.


Template repository is confusing

Right now when you share your hubot repo with other people, they get the template repository. This is fine, but it's really confusing right now without any information in the README. Where is hubot's source code? Where's the executable? How the eff does this thing work? How do I test scripts? Stuff like that.
We need to work on the README to make it a bit clearer that there's a core library somewhere else that does all the heavy lifting.

Yeah i have no idea how to run it on heroku
2011-10-25T20:06:06+00:00 heroku[web.1]: Starting process with command `bin/hubot -a campfire -n Hubot`
2011-10-25T20:06:06+00:00 app[web.1]: bin/hubot: 3: npm: not found
2011-10-25T20:06:06+00:00 app[web.1]: /usr/bin/env: coffee: No such file or directory
2011-10-25T20:06:07+00:00 heroku[web.1]: Process exited

@dmishe: http://devcenter.heroku.com/articles/node-js

Docs merged in 017aef55bbf19a977eb5ded9eb5a52036deececc


Update package.json

Hello, I looked at your dependencies in the project, I found out that you wrote the wrong version of node, most of the dependencies already work with the new version of the node

devDependencies

mocha >= 14.0.0
SuperTest >= 6.4.0
nyc >= 8.9
connect-redis >= 12
eslint ^12.22.0 || ^14.17.0 || >=16.0.0

dependencies

cookie-signature >=6.6.0

Hello, and thank you for your pull request. The version of Node.js listed this is correct, as Express.js 4.x (the master branch) was created in the era of Node.js 0.10, so it continues to support from that version, as changing that would be a semver major change. There is the in progress 5.0 branch that bumps up a lot of dependencies and we are bumping the minimum supported Node.js version there as well 👍


Allow Github Enterprise as well

I wasn't able to get the extension working on a private instance of GHE.

As I don't know much about GHE, can you give us additional details on the URL structure? Even better would be a PR! :)


from langchain.agents import initialize_agent

System Info
When I try to import initialize_agent module from langchain.agents I receive this error. cannot import name 'CursorResult' from 'sqlalchemy'
Who can help?
No response
Information

[ ] The official example notebooks/scripts
[ ] My own modified scripts

Related Components

[ ] LLMs/Chat Models
[ ] Embedding Models
[ ] Prompts / Prompt Templates / Prompt Selectors
[ ] Output Parsers
[ ] Document Loaders
[ ] Vector Stores / Retrievers
[ ] Memory
[X] Agents / Agent Executors
[ ] Tools / Toolkits
[ ] Chains
[ ] Callbacks/Tracing
[ ] Async

Reproduction
from langchain.agents import initialize_agent
Expected behavior
Run the cell without a problem.

I fixed this by installing SQLAlchemy==2.0.1


hwdata: Use content-addressed source file; previous source tarball changed contents

This is a merge from master.
(cherry picked from commit 00f16e3d7c4239bcb4c0b55302e4956adf69d691)
Motivation for this change
Source tarball https://git.fedorahosted.org/cgit/hwdata.git/snapshot/hwdata-0.291.tar.xz changed contents, which has rendered this package unbuildable. This change switches the source tarball URL to a content-addressed mirror instead, which will probably and hopefully be more stable.
Things done

[ ] Tested using sandboxing
(nix.useSandbox on NixOS,
or option build-use-sandbox in nix.conf
on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] Linux

[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

OK, picked directly as 9363db49ce.


getobjgap not implemented

Hello
I could not get the gap out of a Gurobi model, I don't see the function implemented in the code.
regards

Hi bbrunaud.
I just faced this same problem. I found a improvised solution for it. According to the Documentation (see here: https://jump.readthedocs.io/en/latest/refmodel.html#methods), the bound can be computed by the formula |b - f| / | f |, where

b is the best bound, and can be obtained by getobjectivebound(m::Model)
f is the best feasible objective value, and can be obtained by getobjectivevalue(m::Model)
| . | is the abs function.
You'll get a number between 0 and 1.

Note: my version of JuMP is 0.18.

Hi @luistertulino,
There is a MIPGap parameter, so it should be sufficient to go (I haven't tested this):
getobjgap(model::GurobiMathProgModel) = get_dblattr(model.inner, "MIPGap")

We'll accept a PR implementing this (with tests). Let me know if you need help making the PR.


INTG-609: Hook Integrations CI/CD deployment to invoke deployment endpoint

INTG-609: Hook Integrations CI/CD deployment to invoke deployment endpoint

@mnazir-tp  & @qcm-trebor I know this is already merged, I just have a very small nit that you can choose to just ignore if you want :)
You may want to look at the method name here:
https://github.com/invitation-homes/mulesoft-deploy-action/blob/754f8e888b7b919e8eb6792b7419b5c99565b018/dist/index.js#L10590
exportDeploymentDetailsToEventBridge is what's called a "leaky abstraction" -- the fact that behind this API is something that puts a message on Event Bridge is an implementation detail specific to the API that you're consuming, and may change in the future (i.e. we may decide that we're going to use Kafka instead of Event Bridge behind this API, or may decide to write it directly to a DB). If that were to happen, future people looking at this method might be confused.
Instead, I'd suggest something like
postDeploymentDetails, since that's what the method is actually doing.

@mnazir-tp & @qcm-trebor I know this is already merged, I just have a very small nit that you can choose to just ignore if you want :)
You may want to look at the method name here:
https://github.com/invitation-homes/mulesoft-deploy-action/blob/754f8e888b7b919e8eb6792b7419b5c99565b018/dist/index.js#L10590
exportDeploymentDetailsToEventBridge is what's called a "leaky abstraction" -- the fact that behind this API is something that puts a message on Event Bridge is an implementation detail specific to the API that you're consuming, and may change in the future (i.e. we may decide that we're going to use Kafka instead of Event Bridge behind this API, or may decide to write it directly to a DB). If that were to happen, future people looking at this method might be confused.
Instead, I'd suggest something like
postDeploymentDetails, since that's what the method is actually doing.

@davidaayers I agree and I will accommodate your suggestion in the next PR.


[FEATURE] Allow renaming an index

Description
Indices cannot easily be renamed once they have been created.  Migrations are one of the few opportunities to change the index name, it would be useful if this was supported.
What solution would you like?
When selecting indices for migration if source->target names could be specified this would allow for updating naming decisions that were made when the index was created but should be revisited.

This will be enabled with https://opensearch.atlassian.net/browse/MIGRATIONS-2146 and https://opensearch.atlassian.net/browse/MIGRATIONS-2152


Add some manifests for testing

Testing #2
Copied 50 manifests (random) from Main bucket.

[x] I have read the Contributing Guide.

/verify

@chawyehsu the CI ran only on the first commit of the PR. It should run on each and every commit. I think deleting this line https://github.com/ScoopInstaller/Tests/blob/ec58caa9c2d272a1cb957e7341619e8619fcd4b5/.github/workflows/ci.yml#L5 will help.

@chawyehsu the test fails but the status is still green 😅 What gives?

Need to update bin/test.ps1 to expose Pester's test result.
https://github.com/chawyehsu/bucket-gh-ci-test/blob/9d09f096a2b2ec169cfc744dee2c4f8fd4190954/bin/test.ps1#L3

That's it

Oh, I wonder why that wasn't required for Appveyor?
Also, we would need to do that here too, right? https://github.com/ScoopInstaller/Scoop/blob/master/bin/test.ps1

AppVeyor directly calls test/bin/test.ps1, which has exposed the result, from the Core.
https://github.com/ScoopInstaller/Scoop/blob/develop/appveyor.yml#L35
https://github.com/ScoopInstaller/Scoop/blob/develop/test/bin/test.ps1#L11
For a bucket, it can either call test/bin/test.ps1 from the Core directly or call the wrapper bin/test.ps1 from itself.


NOW JIO TV IS WORKING THANKS TO TEAM

:::""BUY INSTALLING THIS PLUGIN MANUALLY
https://github.com/botallen/repository.botallen/files/10365806/plugin.video.jiotv-1.0.1.zip
BUT THERE IS PROBLEM WITH CHANNEL SWITCHING
NOT PLAYING EXACTLY CHANNEL PLAYED ANOTHER CHANNEL
LIKE I AM WATCHING SONY MAX AND WANT TO SWITCH ZEE TV THEN IT WILL NOT PLAY ZEE TV PLAY ANOTHER CHANNEL (LIKE B4U ).WHEN SWITCH TO B4U PLAY ANOTHER CHANNEL
SO PLEASE SOLVE CHANNEL SWITCHING PROBLEM AND ALSO TAKE MORE TIME TO SWITCH CHANNEL

Yeah it's taking a bit more seconds to switch between channels but I am not facing the other issue you are taking about

For me only few channels load but most doesn't.

how can add new plugin kodi

how can add new plugin kodi

Just go to the mentioned repository and download the files. Import those files to your device. Follow the instructions on this post. https://github.com/botallen/repository.botallen/issues/344>

not understand actually whre the zip file input
On Sun, 8 Jan, 2023, 5:28 pm PBijalwan, @.***> wrote:

how can add new plugin kodi
Just go to the mentioned repository and download the files. Import those
files to your device. Follow the instructions on this post.
https://github.com/botallen/repository.botallen/issues/344>
—
Reply to this email directly, view it on GitHub
https://github.com/botallen/repository.botallen/issues/345#issuecomment-1374818549,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A5EMF7LKNCJXOVQQQEVJRTLWRKTXBANCNFSM6AAAAAATUPGZ6Q
.
You are receiving this because you commented.Message ID:
@.***>

not understand actually whre the zip file input
On Sun, 8 Jan, 2023, 5:28 pm PBijalwan, @.***> wrote:

how can add new plugin kodi
Just go to the mentioned repository and download the files. Import those
files to your device. Follow the instructions on this post.
https://github.com/botallen/repository.botallen/issues/344>
—
Reply to this email directly, view it on GitHub
https://github.com/botallen/repository.botallen/issues/345#issuecomment-1374818549,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A5EMF7LKNCJXOVQQQEVJRTLWRKTXBANCNFSM6AAAAAATUPGZ6Q
.
You are receiving this because you commented.Message ID:
@.***>

Wait for some time as @iMro0t will push an update very soon

@iMro0t  bhai please come and help... we are waiting for an update from you as i can say " YOU ARE ONLY ONE WHO CAN SORT IT OUT " ..!!!!

thanks to team finally today all working fine
buy using this method::::::::::::::::
To all the users who are facing issues with JioTV plugin, I have stumbled upon the solution and it is as follows:
Uninstall Kodi
Reinstall Kodi and add BotAllen. Wait for notification "BotAllen" added. However, do not install JioTV plugin from BotAllen repository.
Instead install the plugin from
https://github.com/Geletinousamigo/plugin.video.jiotv
Attaching the plugin if you want to directly download [plugin.video.jiotv-main.zip]
(https://github.com/botallen/repository.botallen/files/10365866/plugin.video.jiotv-main.zip)
And you are done. Install the PVR client and now all channels should be working
All credit to https://github.com/Geletinousamigo

Awesome, thanks for the update!
On Fri, 13 Jan, 2023, 12:24 pm KRISHNAPRIYASHARMA, @.***>
wrote:

thanks to team finally today all working fine
buy using this method::::::::::::::::
To all the users who are facing issues with JioTV plugin, I have stumbled
upon the solution and it is as follows:
Uninstall Kodi
Reinstall Kodi and add BotAllen. Wait for notification "BotAllen" added.
However, do not install JioTV plugin from BotAllen repository.
Instead install the plugin from
https://github.com/Geletinousamigo/plugin.video.jiotv
Attaching the plugin if you want to directly download
[plugin.video.jiotv-main.zip]
(
https://github.com/botallen/repository.botallen/files/10365866/plugin.video.jiotv-main.zip
)
And you are done. Install the PVR client and now all channels should be
working
All credit to https://github.com/Geletinousamigo
—
Reply to this email directly, view it on GitHub
https://github.com/botallen/repository.botallen/issues/345#issuecomment-1381390316,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A5EMF7JWY23CBCMN6UFWCCDWSD3ZDANCNFSM6AAAAAATUPGZ6Q
.
You are receiving this because you commented.Message ID:
@.***>

yet not working.. sometimes it shows notification error.... :|


Incorrect location

I tried to open IFC using the latest web-ifc-three. It seems loaded with incorrect location.
So I tried it on 0.0.81, it works correctly.
How to load IFC correctly? Please help me.
Web-IFC-Three

ArchiCAD

I solved as set COORDINATE_TO_ORIGIN to false.


Report inconsistency in the command INCR

This issue is all about ensuring we are as close to Redis as possible. The command in focus for this issue is INCR.
Go through the official documentation of the command INCR on Redis and identify the inconsistencies. The inconsistencies could be in

unhandled edge case
unexpected behavior
unsupported option

Because we are trying to be compatible with Redis v7.2.5, I would recommend you try out different variants of the command with different inputs on that specific version. The instructions on running Redis v7.2.5 locally

from source code
use Docker

Once you find the discrepancy, you can either

raise an issue on Dice repository with details, or
try to fix it yourself and raise a PR

If you are raising the issue, make sure you provide the details such as

use the template and provide the following details
steps to reproduce (series of commands)
observed output on DiceDB
observed output on Redis v7.2.5

Also, feel free to update the documentation and raise the PR in the docs repository.

You will need to go deeper into the command make sure you are covering all cases and reporting the inconsistencies or fixing them. The deeper the work, the better our stability will be. Also, it is possible that we do not find any discrepancies, so please mention the same in the comment on this issue. Mention the PR or issue links that you create under this issue.

can i take this up please

Hey @arpitbbhayani
I've run a series of tests to check for inconsistencies and edge cases that weren't originally covered in TESTincr. Here's what I found:

Incrementing a Non-Existent Key:

Expected Behavior: The key should be created and set to 1.
Result: Worked as expected.

Incrementing a String Representing an Integer:

Expected Behavior: The value should increment correctly.
Result: Worked as expected.

Incrementing a Non-Integer String:

Expected Behavior: An error should be returned.
Result: Worked as expected.

Incrementing a Float String:

Expected Behavior: An error should be returned.
Result: Worked as expected.

Incrementing from the Minimum 64-Bit Integer:

Expected Behavior: The value should increment correctly without issues.
Result: Worked as expected.

Incrementing a Key with Expiration:

Expected Behavior: The key should expire as expected during the increment operation, resetting its value to 0 upon expiration.
Result: Worked as expected.

Incrementing to the Maximum 64-Bit Integer:

Expected Behavior: The value should increment to math.MaxInt64 without overflow. Further increments should return an "Out of bounds" error.
Result: Worked as expected.
I tested how the system handles unsupported options by providing empty spaces, tab spaces, and multiple options. It successfully identified and rejected unsupported options.
I’m comfortable with the code and test structure, i found some of tests can be added to the TESTIncr, should i raise a PR for it, I am beginner in golang but can understand the codebase. : @arpitbbhayani
Also additionally, I was testing it with JSON.SET var and different structures, It returns PONG for them and when i pass it some arguements it return incorrect Args for "ping" command. So when these commands get implemented with can test it here too for edge cases by doing INCR on these structures.

Inconsistencies found only with the error messages and not in functionality.

Data types:
Redis: "INCR strkey": "Error: value is not an integer or out of range"
DiceDB: "INCR strkey": "Error: the operation is not permitted on this encoding"
Redis: "INCR floatkey": "Error: value is not an integer or out of range"
DiceDB: "INCR floatkey": "Error: the operation is not permitted on this encoding"
This is the case for all non-integer values.
The error messages are different, though the behavior (not incrementing non-integer values) is consistent.

Overflow handling:
Redis: "INCR maxint": "Error: increment or decrement would overflow"
DiceDB: "INCR maxint": "Error: value is out of range"
The error messages differ, but both prevent overflow.

Cases working correctly:

Basic functionality (INCR and GET)
Incrementing large integers within range, integer string value
Negative numbers handling
Zero handling
Large increments
Key naming (empty string and colon-separated keys)
Multiple increments
INCR and DEL interaction
INCR and RENAME
INCR and COPY

To test with keys that have expiry I had to run the following:
"INCR with EXPIRE": [
        "SET expirablekey 10",
        "EXPIRE expirablekey 60",
        "INCR expirablekey",
        "TTL expirablekey"
]

This can be achieved by using SETEX. Could be a good addition.
Another good to have will be the FLUSHALL command.
Can raise a PR making the error messages consistent. @arpitbbhayani

I completely agree with @Maveric-k07, error messages are different and can be made consistent,
and one other point SETEX is deprecated, but SET key1 10 EX 5, you can use, it i also in dice DB, i tested it last night too.
And yes i agree that FLUSHALL command will be good to have.
@Maveric-k07 can work on making error messages consistent
and i can add the additional test cases to TestINCR.

Having multiple PRs for this might not be a good idea. Can you take up the change in error messages as well? @vanshavenger

I guess you can push commits and then you can push changes to my PR or vice-versa
as i have locally implemented those tests, just waiting for @arpitbbhayani suggestions on the same.

@Maveric-k07 @vanshavenger Thanks for all the work. Are you guys still waiting for Arpit's response to this?
Let's discuss this in the discord discussions and we can close this out asap. Thanks.

@vanshavenger can you take up the changes in the error messages as well please, it's a small change in addition to the test cases you wanted to add. feel free to ping in the the discord channel.

@Maveric-k07 I may not get the time before the weekends because of the job, will raise a PR for Tests suite by night as they are already handy with me, last time i made

Hey @vanshavenger I Hope you are doing well. Can you please update any latest findings or work you have done?

Hello @Maveric-k07,
There has been no activity on this issue for the past 5 days.
It would be awesome if you keep posting updates to this issue so that we know you are actively working on it.
We are really eager to close this issue at the earliest, hence if we continue to see the inactivity, we will have to reassign the issue to someone else. We are doing this to ensure that the project maintains its momentum and others are not blocked on this work.
Just drop a comment with the current status of the work or share any issues you are facing. We can always chip in to help you out.
Thanks again.

I will make the necessary changes, I was waiting on vansh for an update but I'll create a PR today.

Hello @Maveric-k07,
There has been no activity on this issue for the past 5 days.
It would be awesome if you keep posting updates to this issue so that we know you are actively working on it.
We are really eager to close this issue at the earliest, hence if we continue to see the inactivity, we will have to reassign the issue to someone else. We are doing this to ensure that the project maintains its momentum and others are not blocked on this work.
Just drop a comment with the current status of the work or share any issues you are facing. We can always chip in to help you out.
Thanks again.


Implement Arrow C struct <=> sparrow classes conversion functions

These functions should allow the following:

Build a sparrow array from Arrow C data structures, taking ownership of the memory; the C data structures can be safely destroyed
Build a sparrow array from Arrow C data structures, not taking ownership of the memory; the C data structures must be kept alive
Build Arrow C data structures from sparrow array, taking ownership; the C releaser should be set accordingly befor the sparrow array is destroyed
Build Arrow C data structures from sparrow array, not taking ownerhips; the C releaser should be the null pointer, and the sparrow array should be kept alive.

The conversion functions transfering the ownership have been implemented in #79. The mising functions need #106 to be implemented first.

These functions have been implemented in the new array class.


ENH?: make layer= mandatory if multiple layers in a file?

At the moment, when a file being read contains > 1 layer and the layer parameter isn't specified, the first layer encountered in the file is being read.
This isn't really transparent behaviour, and I think it would be better if an error would be thrown when trying to read a multi-layer file without specifying layer. This isn't backwards compatible, but maybe now is the time still to change this?
An alternative that wouldn't break backwards compatibility would be to raise a warning.
Something to consider: what is a "layer": e.g. Geopackage files can also contain attribute tables which can be read by pyogrio. Are they to be considered as layers or can they be ignored if there is only one layer with geometries?

True: it isn't always obvious to the user when there are additional layers.
I think we always read the first layer, even if it is tabular, though I haven't tripped over this with anything I've used so far.
I think a warning makes sense, possibly with a deprecation warning, if we want to make this required in a later version.  Or we could just jump straight to raising an exception since we're still < 1.0.  I'm not sure I have a strong preference.
In either case, we have to sort out the following situations:

mutiple "layers" but only one of them has geometries; the remainder are tabular.  Do we default to the one with geometries?  Do we raise a warning or exception in this case?
multiple geometry layers: raise a warning or exception

Does anyone here have a strong preference for warning vs exception?

Or we could just jump straight to raising an exception since we're still < 1.0

Given pyogrio is going to be a default engine of geopandas, we should be really careful here. It is not a small change and ´geopandas.read_file` have this behaviour for a long time, way predating pyogrio. People just expect it to work.
I do agree that it is not ideal and I have been answering questions about that myself before so there is a space for improvement but I would definitely try to avoid raising.
I'd warn for multilayer GPKG or any other layered file that a layer is unspecified and that we read the first one + give a name of it.

Do we default to the one with geometries? Do we raise a warning or exception in this case?

What do we do now? I don't even know how would I create a file like that :D.

multiple geometry layers: raise a warning or exception

I'd warn.

Or we could just jump straight to raising an exception since we're still < 1.0

Given pyogrio is going to be a default engine of geopandas, we should be really careful here. It is not a small change and ´geopandas.read_file` have this behaviour for a long time, way predating pyogrio. People just expect it to work.

I do agree that we need to be careful.
Possibly not really relevant, as the main thing that matters is to try avoiding working code to start breaking, nonetheless: I wonder if there are truly people that consciously expect that "the first table" is read if no layer is passed or is it just by accident that it works as they want. Or... are there just quite some bugs out there because people never noticed a wrong layer is being read...

Do we default to the one with geometries? Do we raise a warning or exception in this case?
What do we do now?

I had a look in GDAL, and the layers/tables are determined with a SQL statement that does a union all of all layers with geometry, then all attribute tables. So at the moment typically the first layer with geometry (if there is one) that was created in the GPKG will be returned.
Note that there is no ORDER BY clause in the SQL query used, so the order of this result isn't quaranteed (on long term). Extract from the SQLite docs:
If there is no ORDER BY clause, then the order in which rows are extracted is undefined.
(In the current implementation, the queue becomes a FIFO if the ORDER BY clause is
omitted, but applications should not depend on that fact since it might change.)

I don't even know how would I create a file like that :D.

from pathlib import Path
import geopandas as gpd
import pandas as pd
import pyogrio
from shapely import Point

path = Path("test.gpkg")
path.unlink(missing_ok=True)
df = pd.DataFrame({"attr_table1_col": ["a1", "a2", "a3"]})
pyogrio.write_dataframe(df, path, layer="attr_table1")
gdf = gpd.GeoDataFrame({"point1_col": ["p1", "p2", "p3"]}, geometry=[Point(1, 2)] * 3)
pyogrio.write_dataframe(gdf, path, layer="point1")
gdf = gpd.GeoDataFrame({"point2_col": ["p1", "p2", "p3"]}, geometry=[Point(1, 2)] * 3)
pyogrio.write_dataframe(gdf, path, layer="point2")
df = pd.DataFrame({"attr_table2_col": ["a1", "a2", "a3"]})
pyogrio.write_dataframe(df, path, layer="attr_table2")
read_df = pyogrio.read_dataframe(path)
print(read_df)

I wonder if there are truly people that consciously expect that "the first table" is read if no layer is passed or is it just by accident that it works as they want. Or... are there just quite some bugs out there because people never noticed a wrong layer is being read...

I do expect that the first layer is read in some cases. Since I am aware of this behaviour I tend to save those few characters specifying layer if I know which I saved first.
And yes, I've seen students running into bugs because they did not notice a wrong layer is read or had no clue the file has more layers.

So at the moment typically the first layer with geometry (if there is one) that was created in the GPKG will be returned.

Let's stick to that I'd say.


Update DS prototype for DAC retest

Update the prototypes at https://ons-design-system-prototypes.netlify.app/ to use the latest DS release so we can book a DAC retest once all issues reported in June 2022 have been rectified.

DAC retest booked for 26th Sept


Fix redirect_uri option : options need to be mutated

Without this mutation the finale params look like :
{ ... 'redirect_uri' => 'http...', redirect_uri: 'http...' }

And the generated request has two time the param redirect_uri, probably not a bug for most servers but when you upgrade oauth2 all your webmocks fail...
For a better fix I think we should remove all mutations on the options attribute, but I don't imagine all side effects.

Coverage remained the same at 95.858% when pulling 0e2f772398e4a15dfc3e9fd283e1c32ca9bc4732 on mathieulaporte:fix-redirect-uri-options into 96daaf56765652a5ffc792f645f6b3a4a42ce9bb on intridea:master.

Coverage remained the same at 95.858% when pulling 0e2f772398e4a15dfc3e9fd283e1c32ca9bc4732 on mathieulaporte:fix-redirect-uri-options into 96daaf56765652a5ffc792f645f6b3a4a42ce9bb on intridea:master.

Instead of mutating the options hash, maybe just change 'redirect_uri' to a symbol? I generally try to avoid mutating external variables to avoid potential side effects.

It would be super great if we could not mutate external variables.  PoLS, and all that. 👍

I'm not sure why this change is needed. The only purpose of the redirection_params method is convert the redirect_uri key from a symbol to a string before sending it as extra query params to Faraday::Connection#build_url. But that method accepts either key type, and if both are provided it only uses one.
2.4.2 :015 > conn = Faraday.new('http://github.com')
 => #<Faraday::Connection:0x00007fb2269a4bd0 @parallel_manager=nil, @headers={"User-Agent"=>"Faraday v0.12.2"}, @params={}, @options=#<Faraday::RequestOptions (empty)>, @ssl=#<Faraday::SSLOptions (empty)>, @default_parallel_manager=nil, @builder=#<Faraday::RackBuilder:0x00007fb2269a40e0 @handlers=[Faraday::Request::UrlEncoded, Faraday::Adapter::NetHttp]>, @url_prefix=#<URI::HTTP http://github.com/>, @proxy=nil>
2.4.2 :029 > conn.build_url('hello_world', {'redirect_uri' => 'http...uri_str.com', redirect_uri: 'http...uri_sym.com'}).to_s
 => "http://github.com/hello_world?redirect_uri=http...uri_sym.com"

2.4.2 :029 > conn.build_url('hello_world', {redirect_uri: 'http...uri_sym.com'}).to_s
 => "http://github.com/hello_world?redirect_uri=http...uri_sym.com"

2.4.2 :030 > conn.build_url('hello_world', {redirect_uri: 'http...uri_sym.com', 'redirect_uri' => 'http...uri_str.com'}).to_s
 => "http://github.com/hello_world?redirect_uri=http...uri_str.com"

It seems the right move would be just remove redirection_params altogether and pass the params as-is to build_url. The default query encoder in Faraday converts all keys to strings here.
It is possible to provide a custom query encoder that makes a distinction between string and symbol keys, but I find it hard to think of a use case and this minor backwards compatibility break seems it could fit into the v2.0 nicely.
I'll open a PR to continue the discussion of going the route of removing redirection_params.

@mastermatt great analysis, but I am not understanding how the web mocks began failing with a doubled param if your analysis captures all leakage of the double param.

@pboling this PR should be closed to avoid further confusion.

@mastermatt thanks!

This is fixed in master branch as of #575


Enhance cloud-init syntax support

Is your feature request related to a problem? Please describe.
Currently we partially support cloud-init syntax, but it is limited to a small subset of the features.
Describe the solution you'd like
To extend the syntax already supported to include:

growpart (which can be provided by the Layout plugin)
uid and  lock_passwd into the users fields

Additional context
So lima can load cOS images cc @ibuildthecloud
#cloud-config
# vim:syntax=yaml

growpart:
  mode: auto
  devices: ['/']

users:
  - name: "darren"
    uid: "1000"
    homedir: "/home/darren.linux"
    shell: /bin/bash
    sudo: ALL=(ALL) NOPASSWD:ALL
    lock_passwd: true
    ssh-authorized-keys:
    - ...

write_files:
 - content: |
      #!/bin/sh
      set -eux
      LIMA_CIDATA_MNT="/mnt/lima-cidata"
      LIMA_CIDATA_DEV="/dev/disk/by-label/cidata"
      mkdir -p -m 700 "${LIMA_CIDATA_MNT}"
      mount -o ro,mode=0700,dmode=0700,overriderockperm,exec,uid=0 "${LIMA_CIDATA_DEV}" "${LIMA_CIDATA_MNT}"
      export LIMA_CIDATA_MNT
      exec "${LIMA_CIDATA_MNT}"/boot.sh
   owner: root:root
   path: /var/lib/cloud/scripts/per-boot/00-lima.boot.sh
   permissions: '0755'

there was a request for locked_passwd as well on the user fields

there was a request for locked_passwd as well on the user fields

completely missed it! updated the card, thanks!

growpart:
  mode: auto
  devices: ['/']

is a bit unclear to me. In our case / is mounted over an image, so growing partition might have a different meaning, my expectations here is to have COS_PERSISTENT to be enlarged instead of the image file

Support for uid and lockpasswd introduced here: https://github.com/mudler/yip/commit/d5345d29f2c60e7fd4196beb56626804c1048ae3

https://github.com/mudler/yip/releases/tag/0.9.12 has been released and supports also adds growpart support, although if the intention is to grow COS_PERSISTENT should point to /usr/local or at the respective label


Allow stubbing #throw on any_instance [#1067]

Corresponding issue.

Thanks for this, sorry it took so long to get to

No problem at all, glad to be off help. Thanks for your time and commitment!


Latest update to Android's 'Play Protect' prevents RenderDocCmd app to install

Description

I downloaded the latest version of RenderDoc (1.34) and it turned out that the 'RenderDocCmd' application that is installed on the phone with Android 10 required to be updated with the newer version.
During the installation of this application, the message 'Google Play Protect' pops up about blocking 'Harmful app' (RenderDocCmd).
However, after selecting the option 'More details' and 'Install anyway', and entering the password in the form of 'pattern' to draw, nothing is installed on the device.
In the previous version of RenderDoc (1.33), the behavior was similar, but the application installed on the device and you could run 'remote server'.
After further investigation, it appears that after updating the Play Store, the 'Play Protect' feature is still blocking the app from installing even though we have allowed it.
Steps to reproduce

Connect Android 10 device to PC (Windows 10 x64) via USB
Open RenderDoc v 1.34
Go to 'Tools > Manage Remote Servers'
Select Android 10 device on list and press 'Run Server'
When popup appears on device, select 'install anyway'
Installation fails and popup to install again will appear again

Same issue appears when changing from 'Local' to '<device name>' option in bottom left corner of RenderDoc window.
As workaround do this:

Open 'Play Store' app on device
Go to Account settings (tap on your avatar at top right corner) - you must be logged in
Select 'Play Protect' option
Go to 'Play Protect' settings (tap on cog icon at top right)
Turn off 'Scan apps with Play Protect'
Install RenderDocCmd app following previous steps.
Turn back on 'Scan apps with Play Protect'

Now everything should work as expected.

Environment

RenderDoc version: 1.34 (probably all versions are affected. Tested this with 1.33 too - it worked back then, now it does not)
Operating System: Windows 10 x64 / Android 10 aarch64
Graphics API: OpenGL ES 3.2

I'm not able to reproduce this on my devices but I spoke to some people who did get the popup. They were able to get through it eventually by clicking 'install anyway' and repeating the process until the app was installed - it might require several attempts and manually granting some permissions that were unable to be granted automatically as a result of this. They could then successfully capture and replay.
When you do get these popups, after clicking 'install anyway' you say that installation fails and the popup appears again - does that repeat forever or if you try a few more times does it eventually install?
It might also be that the workaround you mention of turning off this 'play protect' might be necessary for RenderDoc if the 'play protect' breaks things on your device in such a way that it can't be recovered. Unfortunately Android is a truly terrible and broken platform so problems like this occur constantly and there's little that can be done from the developer side, beyond documenting this limitation or mentioning it in error messages if it can be detected.

When you do get these popups, after clicking 'install anyway' you say that installation fails and the popup appears again - does that repeat forever or if you try a few more times does it eventually install?

After many tries to install it just gives up.
You can see at 'Remote Host Manager' window that you can again try to 'Run Server', but result is the same.
I'll attach logcat file. It contains couple of tries to install app. Maybe it will provide some clues. Just search for renderdoc.
logcat.txt

What device are you running on?

Xiaomi Mi 10 Lite 5G
MIUI version <IP_ADDRESS> Global Stable (QJIEUXM)
Android version 10 QKQ1.191222.002

Do you have a different device you can test with? Ideally from a different manufacturer, as Xiaomi devices have caused a lot of problems and incompatibilities in the past.
To clarify: you may have to install the app multiple times going through the popup each time, manually grant permissions afterwards, and then reconnect once the server is installed.

I've tested RenderDocCmd installation on Samsung Galaxy A20e (One UI 1.1; Android 9) and app installed (and launched) on second try after 'Install anyway' option was selected.
Play Protect was enabled, but I was logged off of the Play Store. You can find Play Protect feature in Android's settings (just search for it). RenderDocCmd app is listed as 'Harmful app' there with option to uninstall.
Weird thing is that RenderDocCmd is listed twice there as if 2 apps were installed.

In that case it sounds like the issue of being unable to go successfully through the "install anyway" path is a Xiaomi-device specific problem. As mentioned these devices have had quite a few unique problems in the past. If you want to use them I'd recommend using the workaround of disabling playprotect that you have.
The two apps is normal and expected and will happen even if this error doesn't occur, at least for 64-bit devices because there is a different app for 32-bit and 64-bit.


Migrate tRPC endpoints to Drizzle

Expected Behavior
We are trying to move from Prisma to Drizzle and have started to migrate.
There are a tonne of endpoints that need to be migrated to Drizzle.
If you want to take an endpoint, just let me know which one is below, and you can take it.
One PR per endpoint, please, since it'll make it easy to test. 🧪

I looked into some of these previously. Drizzle and Prismas query API dont overlap completely unfortunately. Are you happy with the querys being recreated in standard SQL?

Prisma VS Drizzle docs https://www.prisma.io/docs/orm/more/comparisons/prisma-and-drizzle#:~:text=Drizzle exposes the underlying filter,by looking at string filters.
Its from Prisma so I assume theres pros aswell


Update go-ycsb to export raw data

Is your feature request related to a problem? Please describe.
Currently the go-ycsb benchmark only provides a summary of the results, not the full raw data. This makes it difficult to analyse further.
Describe the solution you'd like
go-ycsb to output full raw data when finished running for later, more extensive analysis.
Describe alternatives you've considered
Making use of the summaries as is, but this doesn't fit so well with the other benchmark methods.
Additional context
https://github.com/pingcap/go-ycsb/issues/255

Completed in #119


ERROR: No native Menu implementation available. Qt Labs Platform requires Qt Widgets on this setup. Add 'QT += widgets' to .pro and create QApplication in main().

A user on Ubuntu 18.04 is getting the following warnings:
ERROR: No native Menu implementation available.
Qt Labs Platform requires Qt Widgets on this setup.
Add 'QT += widgets' to .pro and create QApplication in main().

What could be going wrong? I'm using the FileDialog from Qt.labs.platform 1.1. Using the experimental one because it works slightly better than the non-experimental one on Windows: both take a really long time to open (30s+) while they try to enumerate network drives...

It looks like we need to add QT += widgets into this file.
Do you have a minimal Main.qml to reproduce so that I can test it locally?

I'm afraid no, this was reported by a user - I'm not getting the same issue (https://github.com/health-validator/Hammer/issues/115). We can ask them to test a build, though!


Fix for #913 - problem with properties in object #ref

Please approve the fix for #913

@eugeniace thanks!


Get a number from Number Server for all Datasets.

Ambry has a number server that doles out unique numbers. It is called when creating new bundles, in ambry.cli.source.source_new()
Add a field to the dataset model called "vid" and when a new dataset is created, get it a number from the server.
The number should be user editable in the dataset form.
from ambry.run import  get_runconfig
from ..identity import NumberServer

rc = get_runconfig()
nsconfig = rc.service('numbers')
ns = NumberServer(**nsconfig)
id_number_as_string = str(ns.next())

Requires migration.

ERROR Coverages search failed with too many values to unpack error.


Missing comment object in post object

Comment object is missing from the post object response, all comments of a specific post should always be returned with that post when requested. Unless comments are going to be requested separately?

In terms of the "feed", are comments immediately required? Polling comments along is quite expensive to say the least.

That's true, thus in current php backend only the latest 3 comments of each post in feed is returned. Need a discussion regarding whether to display the comment or not in the new feed layout.


Unused variable (IServiceFactory)?

https://github.com/AngleSharp/AngleSharp/blob/9da30e34c2c5cffd814d22f0e122db6bda968dd5/src/AngleSharp/ConfigurationExtensions.cs#L154
It seems like useless.

Is not there in devel (i.e., even though it may be useless right now in master it won't appear in future versions anyway).
Thanks for spotting it!