🐛 [firebase/auth] "An unknown error has occurred" calling signInWithCredential

Bug report
Describe the bug
I am integrating with a not-common OAuth provider "hivesigner.com" and want to integrate with Firebase Auth, as I will also be allowing signin with Twitter, Facebook, Apple, etc. When I call signInWithCredential and pass in my accessToken, I receive an error.
Steps to reproduce
Steps to reproduce the behavior:

Obtain access token from hivesigner
Make call as follows to create credential

      final oauthCredential = OAuthProvider("hivesigner.com").credential(
        accessToken: accessToken,
        rawNonce: rawNonce,
      );

Pass credential to firebase:

        await _firebaseAuth.signInWithCredential(oauthCredential);

Get the following response:

FLTFirebaseAuth: An error occurred while calling method Auth#signInWithCredential, errorOrNil => (null)
flutter: Failed firebaseAuthException [firebase_auth/unknown] An unknown error has occurred.
flutter: #0      MethodChannelFirebaseAuth.signInWithCredential (package:firebase_auth_platform_interface/src/method_channel/method_channel_firebase_auth.dart:448:7)
<asynchronous suspension>
#1      FirebaseAuth.signInWithCredential (package:firebase_auth/src/firebase_auth.dart:497:7)
<asynchronous suspension>
#2      AuthenticationRepository.logInWithHivesigner (package:authentication_repository/src/authentication_repository.dart:310:9)
<asynchronous suspension>
#3      LoginCubit.logInWithHivesigner (package:leomobile/login/cubit/login_cubit.dart:52:7)
<asynchronous suspension>
#4      _HivesignerLoginButton.build.<anonymous closure> (package:leomobile/login/view/login_form.dart:80:15)
<asynchronous suspension>

Expected behavior
I expect to receive a proper UserCredentials object.
Sample project
If needed, I can provide something, but I don't think it is needed.
Additional context
Add any other context about the problem here.

Flutter doctor
Run flutter doctor and paste the output below:
Click To Expand
Doctor summary (to see all details, run flutter doctor -v):
[✓] Flutter (Channel stable, 2.5.3, on macOS 11.6 20G165 darwin-x64, locale en-US)
[✓] Android toolchain - develop for Android devices (Android SDK version 31.0.0)
[✓] Xcode - develop for iOS and macOS
[✓] Chrome - develop for the web
[✓] Android Studio (version 2020.3)
[✓] VS Code (version 1.61.2)
[✓] Connected device (2 available)

• No issues found!

Flutter dependencies
Run flutter pub deps -- --style=compact and paste the output below:
Click To Expand
Dart SDK 2.14.4
Flutter SDK 2.5.3
authentication_repository 0.0.1

dependencies:
- cache 1.0.0
- crypto 3.0.1 [collection typed_data]
- equatable 2.0.3 [collection meta]
- firebase_auth 3.2.0 [firebase_auth_platform_interface firebase_auth_web firebase_core firebase_core_platform_interface flutter meta]
- firebase_core 1.10.0 [firebase_core_platform_interface firebase_core_web flutter meta]
- flutter 0.0.0 [characters collection meta typed_data vector_math sky_engine]
- http 0.13.4 [async http_parser meta path]
- json_annotation 4.1.0 [meta]
- meta 1.7.0
- sign_in_with_apple 3.2.0 [flutter meta]
- very_good_analysis 2.4.0

dev dependencies:
- build_runner 2.1.4 [args async analyzer build build_config build_daemon build_resolvers build_runner_core code_builder collection crypto dart_style frontend_server_client glob graphs http_multi_server io js logging meta mime package_config path pool pub_semver pubspec_parse shelf shelf_web_socket stack_trace stream_transform timing watcher web_socket_channel yaml]
- flutter_test 0.0.0 [flutter test_api path fake_async clock stack_trace vector_math async boolean_selector characters charcode collection matcher meta source_span stream_channel string_scanner term_glyph typed_data]
- json_serializable 5.0.2 [analyzer build build_config collection json_annotation meta path source_gen source_helper]
- mocktail 0.2.0 [collection matcher test]

transitive dependencies:
- _fe_analyzer_shared 26.0.0 [meta]
- analyzer 2.3.0 [_fe_analyzer_shared cli_util collection convert crypto glob meta package_config path pub_semver source_span watcher yaml pedantic]
- args 2.3.0
- async 2.8.1 [collection meta]
- boolean_selector 2.1.0 [source_span string_scanner]
- build 2.1.1 [analyzer async convert crypto glob logging meta path]
- build_config 1.0.0 [checked_yaml json_annotation path pubspec_parse yaml]
- build_daemon 3.0.1 [built_collection built_value http_multi_server logging path pool shelf shelf_web_socket stream_transform watcher web_socket_channel]
- build_resolvers 2.0.4 [analyzer async build crypto graphs logging path package_config pool pub_semver stream_transform yaml]
- build_runner_core 7.2.2 [async build build_config build_resolvers collection convert crypto glob graphs json_annotation logging meta path package_config pool timing watcher yaml]
- built_collection 5.1.1
- built_value 8.1.3 [built_collection collection fixnum meta]
- characters 1.1.0
- charcode 1.3.1
- checked_yaml 2.0.1 [json_annotation source_span yaml]
- cli_util 0.3.3 [meta path]
- clock 1.1.0
- code_builder 4.1.0 [built_collection built_value collection matcher meta]
- collection 1.15.0
- convert 3.0.1 [typed_data]
- coverage 1.0.3 [args logging package_config path source_maps stack_trace vm_service]
- dart_style 2.2.0 [analyzer args path pub_semver source_span]
- fake_async 1.2.0 [clock collection]
- file 6.1.2 [meta path]
- firebase_auth_platform_interface 6.1.4 [firebase_core flutter meta plugin_platform_interface]
- firebase_auth_web 3.2.0 [firebase_auth_platform_interface firebase_core firebase_core_web flutter flutter_web_plugins http_parser intl js meta]
- firebase_core_platform_interface 4.1.0 [collection flutter meta plugin_platform_interface]
- firebase_core_web 1.2.0 [firebase_core_platform_interface flutter flutter_web_plugins js meta]
- fixnum 1.0.0
- flutter_web_plugins 0.0.0 [flutter js characters collection meta typed_data vector_math]
- frontend_server_client 2.1.2 [async path]
- glob 2.0.1 [async collection file path pedantic string_scanner]
- graphs 2.1.0 [collection]
- http_multi_server 3.0.1 [async]
- http_parser 4.0.0 [charcode collection source_span string_scanner typed_data]
- intl 0.17.0 [clock path]
- io 1.0.3 [meta path string_scanner]
- js 0.6.3
- logging 1.0.2
- matcher 0.12.10 [stack_trace]
- mime 1.0.0
- node_preamble 2.0.1
- package_config 2.0.2 [path]
- path 1.8.0
- pedantic 1.11.1
- plugin_platform_interface 2.0.2 [meta]
- pool 1.5.0 [async stack_trace]
- pub_semver 2.1.0 [collection meta]
- pubspec_parse 1.1.0 [checked_yaml collection json_annotation pub_semver yaml]
- shelf 1.2.0 [async collection http_parser path stack_trace stream_channel]
- shelf_packages_handler 3.0.0 [path shelf shelf_static]
- shelf_static 1.1.0 [convert http_parser mime path shelf]
- shelf_web_socket 1.0.1 [shelf stream_channel web_socket_channel]
- sky_engine 0.0.99
- source_gen 1.1.1 [analyzer async build dart_style glob meta path source_span yaml]
- source_helper 1.3.0 [analyzer collection source_gen]
- source_map_stack_trace 2.1.0 [path stack_trace source_maps]
- source_maps 0.10.10 [source_span]
- source_span 1.8.1 [collection path term_glyph]
- stack_trace 1.10.0 [path]
- stream_channel 2.1.0 [async]
- stream_transform 2.0.0
- string_scanner 1.1.0 [charcode source_span]
- term_glyph 1.2.0
- test 1.17.10 [analyzer async boolean_selector collection coverage http_multi_server io js node_preamble package_config path pedantic pool shelf shelf_packages_handler shelf_static shelf_web_socket source_span stack_trace stream_channel typed_data web_socket_channel webkit_inspection_protocol yaml test_api test_core]
- test_api 0.4.2 [async boolean_selector collection meta source_span stack_trace stream_channel string_scanner term_glyph matcher]
- test_core 0.4.0 [analyzer async args boolean_selector collection coverage frontend_server_client glob io meta package_config path pedantic pool source_map_stack_trace source_maps source_span stack_trace stream_channel vm_service yaml matcher test_api]
- timing 1.0.0 [json_annotation]
- typed_data 1.3.0 [collection]
- vector_math 2.1.0
- vm_service 7.3.0
- watcher 1.0.0 [async path pedantic]
- web_socket_channel 2.1.0 [async crypto stream_channel]
- webkit_inspection_protocol 1.0.0 [logging]
- yaml 3.1.0 [collection source_span string_scanner]

I got the same error. Make sure your desired method is enabled in the firebase console eg. anonymous sign-in.

@shawnlauzon
Please check above comment and see if it helps to resolve.

I just enabled anonymous sign-in because it was not enabled.

Unfortunately, still the same problem.

I am integrating with a not-common OAuth provider "hivesigner.com"

I think the issue stems from here, as this is regarded as a custom OAuthflow and may not necessarily work / compatible with firebase_auth.

#2      AuthenticationRepository.logInWithHivesigner (package:authentication_repository/src/authentication_repository.dart:310:9)

#3      LoginCubit.logInWithHivesigner (package:leomobile/login/cubit/login_cubit.dart:52:7)

#4      _HivesignerLoginButton.build. (package:leomobile/login/view/login_form.dart:80:15)

The error log also seems to be pointing to the third party package you are using. There's a third party plugin that you may try https://pub.dev/packages/firebase_auth_oauth and see if it helps in your case, because the custom OAuthflow as I mentioned earlier, may have something to do with the error you are getting.

Actually authentication_repository is my own code as well, just separated into a different package.

may not necessarily work / compatible with firebase_auth

This is what I'm confused about. It seems like there is support for generic OAuth providers, but in that case there should't be a problem with something being incompatible; or if it is incompatible, I should be able to create an adapter to make it compatible, if the error was more detailed than "unknown error".

There's a third party plugin that you may try https://pub.dev/packages/firebase_auth_oauth and see if it helps in your case

I will try that out and report back here.

if the error was more detailed than "unknown error".

yeah, the error maybe a bit general that may lead to confusion, but you may confirm using the plugin and see what you get.

Sorry for the slow reply. I tried the package you mentioned and it didn't work for me. TBH I don't remember what the failure was, but it was even further from working.
I decided to skip trying to integrate the auth flow into firebase and am just managing it myself.

Thanks for the update. I'll close this for now. If you get a concrete steps to replicate (even better if without any 3rd party plugins), please write in comments and I'll reopen it and address accordingly.


Calculate text order (L->R or R->L) using character types from the document, then adapt the Reading Order algorithm to it

In an endeavor to support right to left languages, it could be useful to calculate text order (L->R or R->L) using character types from the document, then adapt the Reading Order algorithm to it.
For example: if the majority of the text is in the arabic script, adapt the reading order XY cut alogrithm to inverse the X.
Same goes for top-down languages.

Certainly nice to have, but not essentiel!


Add new behavior for handling longs

Add new behavior for handling longs. We no longer truncate them and output garbage. We would handle them based on the error policy.

@dubansal : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#sign-off


Converted FAQs to Accordion

Pull Request Template

Please provide all of the details below. Pull requests missing any of the information below will be closed!
Providing the issue number/url helps us identify the problem being solved and keep the issues tab clean and tidy

What issue does this fix?.
Converted FAQs to Accordion
Summarize what this PR fixes:-
Converting FAQs to an accordion instead of raw text, so that the user sees the answer on clicking on each question.

What ISSUE NUMBER does this fix?
Fixes #971
Checklist
(Add an x between the brackets to check the items)

[x] I have summarize what this PR fixes above
[x] I have provided the issue ID/URL above
[x] I have not added Bootstrap or jQuery and used correct styling guide.
[x] This PR fixes only the issue mentioned above (create separate PRs for separate issues)
[x] I was the first one to claim the issue or I created the issue - I created the issue

That's a great idea, however, they do not work. I only see the questions and cannot click them to open.

@brittneypostma Thanks for pointing that out.😅 Somehow the js file for the accordion to work didn't go through. I've made a new PR #982 with the same. Thank you!


Added factoryfn to resolver

Simple implementation that attempts to fix the issue #27

add a factoryFn to the default resolver
setup a default factoryFn that simply instantiates the handler class
add a setter so users can replace the default factoryFn with their custom implementation

Since the mod is done on #26, I close this one


inserire una o più slide che illustrano il concept drift

Ad esempio si potrebbe usare quanto detto in "Discussion and review on evolving data streams and concept drift adapting":

Hereafter a general example for explaining the difference
between these three types of concept drift. Let consider
the Harry Potter film series where watchers have to consider
them as interesting or junk. Suppose that the watchers
are adults who initially enjoyed the films for their
special effects; after a long period of time, they may no
longer enjoy them as their special effects become outdated.
This is known by Real concept drift because a
change has occurred in the watcher preference. Another
situation is when considering the watchers as children
who are enjoying the films today; after a certain period
of time, children grow up and their personal preferences
grow up too. Thus, if they are still enjoying the Harry Potter
films, then we will consider this evolution as Virtual
concept drift because it does not affect their preference.
Finally, when the watchers may no longer be interested by
the Harry Potter films because of the emergence of new
wizard film series, this can considered as Class prior concept
drift.

Let us do an example for explaining the difference among these three types of concept drift. Let us consider the case of predicting extreme weather phenomena occurrences based on atmospheric pressure and temperature. Usually, extreme weather phenomena occur in the case of low atmospheric pressure and high temperature. In the XX century, the distribution of atmospheric pressure and temperature did not change, but the extreme weather phenomena were more frequent. This is known as class prior concept drift. Instead, in the first two decades of XXI century, the atmospheric pressure and air temperature conditions, in which these phenomena occur, also started to change, but not so drastically to move the decision boundary we use for predicting them. This is known as virtual concept drift. Finally, due to the on going climate change, these phenomena start occurring more frequently with higher atmospheric pressure and lower temperature. As a consequence, we have to update the decision boundary to keep an high predictive performance. This is known as real concept drift.


Fixed proto when not passing a matchId

FIXED: Check for null and set matchId to 8 if true.
REMOVED: -
ADDED: -

Thanks.
Not a big deal but next time, please use === instead of ==.


Openstack Credentials: missing field

Hi,
Why are you omitting the OS_TENANT_ID ?
Depending of openstack version, I also need in credentials --os-region-name
Let me know if the below looks like ok for you:
def getOsCredentialsFromEnvironment():
credentials = {}
try:
credentials['VERSION'] = os.environ['OS_COMPUTE_API_VERSION']
credentials['USERNAME'] = os.environ['OS_USERNAME']
credentials['PASSWORD'] = os.environ['OS_PASSWORD']
credentials['TENANT_NAME'] = os.environ['OS_TENANT_NAME']
credentials['AUTH_URL'] = os.environ['OS_AUTH_URL']
if os.environ['OS_REGION_NAME']:
credentials['REGION'] = os.environ['OS_REGION_NAME']
....
if credentials['REGION']:
nt = client.Client(credentials['VERSION'], credentials['USERNAME'], credentials['PASSWORD'], os_tenant_name, credentials['AUTH_URL'], credentials['REGION'], service_type="compute")
else:
nt = client.Client(credentials['VERSION'], credentials['USERNAME'], credentials['PASSWORD'], os_tenant_name, credentials['AUTH_URL'], service_type="compute")
Best,
M.

Hi,
well, I'm not omitting OS_TENANT_ID; I just don't use it :) But you're right, it might be a sensible addition.
Regarding the region name I agree, but prefer different code. Something like this:
credentials['REGION'] = 'regionOne' if not os.environ['OS_REGION_NAME'] else os.environ['OS_REGION_NAME']
...
nt = client.Client(credentials['VERSION'], credentials['USERNAME'], credentials['PASSWORD'], credentials['TENANT_NAME'], credentials['AUTH_URL'], credentials['REGION'], service_type="compute")

I hope you get my intention. Just drop me a PR.
Best regards,
Lukas

Hi Lukas,
Sorry for the delay.
I worked on your script and made some modifications:

care list of networks instead of one
use fixed ip instead of floating ip
add region name (if relevant)

TODO: add "vars" field under group to care group vars value.
I will update you soon.
Best,
M.

@milaw : Do you have the updated script?

@lukaspustina The script is throwing the below error
./openstack_dynamic_inventory.py
Traceback (most recent call last):
File "./openstack_dynamic_inventory.py", line 127, in
main(sys.argv)
File "./openstack_dynamic_inventory.py", line 52, in main
nt = client.Client(credentials['VERSION'], credentials['USERNAME'], credentials['PASSWORD'], os_tenant_name, credentials['AUTH_URL'], service_type="compute")
NameError: global name 'os_tenant_name' is not defined
I see all the nova environment details are available.
MacBook-Pro:ansible gvenka008c$ echo $OS_TENANT_NAME
SSD - XPLAT
Please suggest.

Come on! That's totally my fault, I messed that up -- Copy & Paste error.
@gvenka008c Please try last commit.

@lukaspustina Thanks.


fix: Could NOT find OpenSSL problem in install-mac.sh

install-mac.sh script will fail in building uWebSockets if OPENSSL_ROOT_DIR is not set.
Reference: link

Looks like the pull request is based on your working branch, and you have pushed many things to the branch after creating this request. As a result, this request involves more than 2000 file changes.
By the way, I think this pull request is a duplicate of #18 , although your fix is diff to his.

Closing out due to this seeming to include a lot of other observation files from your own working branch. Feel free to submit a new pull request just specific to the issues above if you'd like.


Deathbanks aren't being cleared after clicking "Take all"

I've tried to replicate this and can't, I'll need steps to replicate this issue before I can fix it.


Needs contact field

GIMP needs a contact field in the store. Probably should be https://github.com/snapcrafters/gimp/issues.

Blocked by: https://launchpad.net/bugs/1692037

The snap definition in the store now links to this issue tracker

Hmm?
$ snap info gimp
name:      gimp
summary:   "GNU Image Manipulation Program"
publisher: snapcrafters
description: |
  Whether you are a graphic designer, photographer, illustrator, or scientist,
  GIMP provides you with sophisticated tools to get your job done. You can
  further enhance your productivity with GIMP thanks to many customization
  options and 3rd party plugins.
snap-id: KDHYbyuzZukmLhiogKiUksByRhXD2gYV
commands:
  - gimp
tracking:    beta
installed:   2.8.22 (25) 141MB -
refreshed:   2017-09-12 21:41:22 +0100 BST
channels:
  stable:    2.8.22 (25) 141MB -
  candidate: 2.8.22 (25) 141MB -
  beta:      2.8.22 (25) 141MB -
  edge:      2.8.22 (25) 141MB -

Do we need to file a new Launchpad bug on this or just comment on the existing one?


X-Cf-Warnings header is not displayed to user

While working on a feature to add warnings for clients of the Cloud Controller, we noticed that the CLI is not showing these warnings to the CLI user currently.
Trying follow the CLI history here, we first have these two stories #76833522 and #77395800. Our reading of these stories is that the first story removes the warning output from the CLI, but the second story adds it back after finding out that the warnings were used not just for deprecation messages but also actual warnings.
A while afterwards, there is this commit that removes the warningsCollector.PrintWarnings() call from the main.go. We are not totally sure, but we believe that this was an unintended change and caused the warnings to no longer be printed.
Ideally we would like to see the CLI print this warnings to users again, but wondering what your thoughts are as well.
@crhino && @yuzhangcmu

Tracker discussion on Pivotal Tracker story.


"An appropriate check for a message body was not found on the enclosing Step or Flow." raised for ExtractVariables policy after ServiceCallout

ServiceCallout policy executes -- response is assigned to myServiceCalloutResponse in the policy using <Response>myServiceCalloutResponse</Response>
ExtractVariables policy executes -- retrieves field from myServiceCalloutResponse.content using <JSONPath> and <Source clearPayload="false">myServiceCalloutResponse.content</Source>
Violation is raised where the ExtractVariable policy gets executed during the flow (after the service callout) -- I think it is because it doesn't see a condition to check any of the below variables -- instead the condition in my flow to execute the ExtractVariables policy checks for the custom variable myServiceCalloutResponse written in the ServiceCallout.

response.content
response.form
request.content
request.form
message.content
message.form
message.verb
request.verb
request.header.Content-Length
response.header.Content-Length

Rule ID is: PO003

Hello @OllieReynolds
Thank you for reporting this. I'll take a look at this but it doesn't seem easy to fix.
For now, you can simply flag the issue as "Resolve as false positive" in Sonar itself once beeing logged in.

The same thing happens when extracting variables using error.content as the source.
If I use apigeelint this error is not reported. I checked their code and the main difference I think is this part:
`if (sourceElement.length) {
source = sourceElement[0].data;
  condRegExp = !source.match(condRegExp) ? source : condRegExp;

}`
If the source data doesn't match the regex condition it then uses the source element text as the regex condition.
var condRegExp = "(response.content|response.form|request.content|request.form|message.content|message.form|message.verb|request.verb)";
I guess that's the reason apigeelint is more flexible in regards to this particular error.
Thanks for maintaining this plugin.

Hello @OllieReynolds  and @eduandrade A quick update to inform that I'm currently working on a fix for this issue.
Many thanks to @eduandrade for providing the exact solution.
The fix will be released in a couple of days ou weeks due to the announcement process of plugins for SonarSource. I'll let you know when the RC-1 is available for tests.

This is issue has been fixed in the release 2.1.0.
Directly available in the marketplace with SQ 7.9+.
Manual installation if you use SQ <7.9


update consul chart link to current

What this PR does:
Which issue(s) this PR fixes:
Fixes #
Checklist

[ ] CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

Changelog entry is not necessary, you can drop it


Switch to forked repositories to add PHP 7.3 compatibility

Fix #7138
PS: this PR is not yet ready: we also need to fork zendframework/zend-stdlib...

This should be ready now

Superseded by #7302


Including CloudFlare adapter

I don't know if that is outside of the scope of this package, but it would be nice to include CloudFlare as an adapter/server.

You probably already saw the cf-worker example using a shim, since some things need to change in order to have it work properly. The server structure right now can't use workers as they should be used, but if I figure out a good way of doing this then I'll try it out.

Included in v6.


Notifying about index completion

Hi,
expanding on our PR #221, we are currently exploring a simple gRPC-based notification scheme for stenotype's index creation (more on that in a later post). To prevent rejection of a subsequent PR later on, we'd like to enquire whether moving from stenotype's current GNU-Makefile to a CMake-build configuration handling protoc's code generation would be acceptable to you.

I'd be supportive of this, go for it 👍


Unexpected exit with code -1073741571 (0xC00000FD)

there is no error level log, it no longer appears after deleting the data, maybe
last line is [3][t 5][1591159052.329422712][MessagesManager.cpp:17447][#1][!Td] Loaded message of size 1028 from database
log has been sent to @tdlib_bot

Which TDLib version are you using?

@levlam e2fd1c13e9a0fbb21aa2992b7b2b2b4a7e66204a

The issue was introduced on May 22 and fixed on May 31. I pushed the latest TDLib 1.6.6, which includes the fix.


'https://apt.dockerproject.org/repo ubuntu-xenial Release' does not have a Release file

Description
Following the install instructions , I cannot get passed the apt-get updatestep. The update consistently fail with this error:
W: The repository 'https://apt.dockerproject.org/repo ubuntu-xenial Release' does not have a Release file.
Here is the relevant part of the output. Notice bad header line.
 Done
W: The repository 'https://apt.dockerproject.org/repo ubuntu-xenial Release' does not have a Release file.
N: Data from such a repository can't be authenticated and is therefore potentially dangerous to use.
N: See apt-secure(8) manpage for repository creation and user configuration details.
E: Failed to fetch https://apt.dockerproject.org/repo/dists/ubuntu-xenial/main/binary-amd64/Packages  Bad header line
E: Some index files failed to download. They have been ignored, or old ones used instead.

I've spent hours crawling through the other similar issues online, nothing helped. The part that is unique to my issue, from what I've seen online, is the "bad header line" part
I've tried on fresh Aliyun Ubuntu 14.04 and 16.04 instances. All yield the same results.

ping @andrewshu possibly GFW issue?

FYI, I can properly curl https://apt.dockerproject.org/repo

@thaJeztah @andrewhsu @m4nuc have the same error in Aliyun Ubuntu 16.04

I tried to reproduce this on a regular Ubuntu 16.04, and wasn't able to; I'm not sure what changes are in Aliyun Ubuntu compared to a "regular" Ubuntu version?

@thaJeztah any guesses on what could be the cause? I can tinker around.
I can't seem to find any useful information regarding apt-get  Bad header line, I assume this is the cause of the error: W: The repository 'https://apt.dockerproject.org/repo ubuntu-xenial Release' does not have a Release file. ?

Is there non-SSL mirror that I could try maybe?

I think it's accessible without SSL as well (there's also a mirror in china that's provided by Azure; https://github.com/docker/docker/blob/v1.13.1/hack/install.sh#L37-L56 - see https://github.com/docker/docker/pull/27005)

@thaJeztah Thanks, unfortunately still no luck.
Err:11 https://mirror.azure.cn/docker-engine/apt/repo ubuntu-xenial/main amd64 Packages
  Bad header line
Ign:12 https://mirror.azure.cn/docker-engine/apt/repo ubuntu-xenial/main all Packages
Ign:13 https://mirror.azure.cn/docker-engine/apt/repo ubuntu-xenial/main Translation-en
Fetched 247 kB in 1min 2s (3970 B/s)
Reading package lists... Done
W: The repository 'https://mirror.azure.cn/docker-engine/apt/repo ubuntu-xenial Release' does not have a Release file.
N: Data from such a repository can't be authenticated and is therefore potentially dangerous to use.
N: See apt-secure(8) manpage for repository creation and user configuration details.
E: Failed to fetch https://mirror.azure.cn/docker-engine/apt/repo/dists/ubuntu-xenial/main/binary-amd64/Packages  Bad header line
E: Some index files failed to download. They have been ignored, or old ones used instead.

Also non-SSL connections are refused by the docker endpoint and the mirror.

I can install using the test.docker.com, is there a similar process to installing the latest docker binaries?

@m4nuC if you can install from the https://test.docker.com curl script (installs RC releases), then you can use the corresponding https://get.docker.com script to get the official GA release.
What is the result of hitting the azure.cn mirror for you? $ curl -v https://mirror.azure.cn/docker-engine/apt/repo/dists/ubuntu-xenial/Release > /dev/null
It should return a 200 response with a header of Content-Length: 29373 like the official repository:
$ curl -v https://apt.dockerproject.org/repo/dists/ubuntu-xenial/Release > /dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0*   Trying <IP_ADDRESS>...
* TCP_NODELAY set
* Connected to apt.dockerproject.org (<IP_ADDRESS>) port 443 (#0)
* TLS 1.2 connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
* Server certificate: *.dockerproject.org
* Server certificate: Amazon
* Server certificate: Amazon Root CA 1
* Server certificate: Starfield Services Root Certificate Authority - G2
> GET /repo/dists/ubuntu-xenial/Release HTTP/1.1
> Host: apt.dockerproject.org
> User-Agent: curl/7.51.0
> Accept: */*
>
< HTTP/1.1 200 OK
< Content-Type: text/plain
< Content-Length: 29373
< Connection: keep-alive
< Date: Wed, 08 Feb 2017 19:57:58 GMT
< x-amz-meta-s3cmd-attrs: uid:0/gname:root/uname:root/gid:0/mode:33261/mtime:1486542750/atime:1486542783/md5:c0c1181ac7aaadc8642331afe831286f/ctime:1486542750
< Last-Modified: Wed, 08 Feb 2017 19:41:34 GMT
< x-amz-version-id: x.gp5OuYEvxzHOqZditd.TG.GKVVzhXH
< ETag: "c0c1181ac7aaadc8642331afe831286f"
< Server: AmazonS3
< Age: 237
< X-Cache: Hit from cloudfront
< Via: 1.1 55676da1e5c0a9c4e60a94a95b01dc04.cloudfront.net (CloudFront)
< X-Amz-Cf-Id: s55Ys5Nr0xyR8jR0zGPdSKVhcHbxjB7ooh3Jd50PxT6QGg-fuNGZfw==
<
{ [15757 bytes data]
* Curl_http_done: called premature == 0
100 29373  100 29373    0     0   303k      0 --:--:-- --:--:-- --:--:--  305k
* Connection #0 to host apt.dockerproject.org left intact

Azure endpoint output:
 curl -v https://mirror.azure.cn/docker-engine/apt/repo/dists/ubuntu-xenial/Release > /dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:--  0:00:04 --:--:--     0*   Trying <IP_ADDRESS>...
  0     0    0     0    0     0      0      0 --:--:--  0:00:05 --:--:--     0* Connected to mirror.azure.cn (<IP_ADDRESS>) port 443 (#0)
* found 173 certificates in /etc/ssl/certs/ca-certificates.crt
* found 694 certificates in /etc/ssl/certs
* ALPN, offering http/1.1
* SSL connection using TLS1.2 / ECDHE_RSA_AES_128_GCM_SHA256
* 	 server certificate verification OK
* 	 server certificate status verification SKIPPED
* 	 common name: mirror.azure.cn (matched)
* 	 server certificate expiration date OK
* 	 server certificate activation date OK
* 	 certificate public key: RSA
* 	 certificate version: #3
* 	 subject: C=CN,ST=Shanghai,L=Shanghai,O=Shanghai Blue Cloud Technology Co. Ltd,OU=Azure,CN=mirror.azure.cn
* 	 start date: Wed, 28 Sep 2016 02:03:50 GMT
* 	 expire date: Fri, 28 Sep 2018 02:03:50 GMT
* 	 issuer: C=CN,O=WoSign CA Limited,CN=WoSign Class 3 OV Server CA G2
* 	 compression: NULL
* ALPN, server did not agree to a protocol
> GET /docker-engine/apt/repo/dists/ubuntu-xenial/Release HTTP/1.1
> Host: mirror.azure.cn
> User-Agent: curl/7.47.0
> Accept: */*
>
< HTTP/1.1 403 Forbidden
< Server: nginx/1.10.2
< Date: Tue, 14 Feb 2017 01:23:09 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 169
< Connection: keep-alive
<
{ [169 bytes data]
100   169  100   169    0     0     28      0  0:00:06  0:00:05  0:00:01    38
* Connection #0 to host mirror.azure.cn left intact

Docker endpoint
curl -v https://mirror.azure.cn/docker-engine/apt/repo/dists/ubuntu-xenial/Release > /dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:--  0:00:04 --:--:--     0*   Trying <IP_ADDRESS>...
  0     0    0     0    0     0      0      0 --:--:--  0:00:05 --:--:--     0* Connected to mirror.azure.cn (<IP_ADDRESS>) port 443 (#0)
* found 173 certificates in /etc/ssl/certs/ca-certificates.crt
* found 694 certificates in /etc/ssl/certs
* ALPN, offering http/1.1
* SSL connection using TLS1.2 / ECDHE_RSA_AES_128_GCM_SHA256
* 	 server certificate verification OK
* 	 server certificate status verification SKIPPED
* 	 common name: mirror.azure.cn (matched)
* 	 server certificate expiration date OK
* 	 server certificate activation date OK
* 	 certificate public key: RSA
* 	 certificate version: #3
* 	 subject: C=CN,ST=Shanghai,L=Shanghai,O=Shanghai Blue Cloud Technology Co. Ltd,OU=Azure,CN=mirror.azure.cn
* 	 start date: Wed, 28 Sep 2016 02:03:50 GMT
* 	 expire date: Fri, 28 Sep 2018 02:03:50 GMT
* 	 issuer: C=CN,O=WoSign CA Limited,CN=WoSign Class 3 OV Server CA G2
* 	 compression: NULL
* ALPN, server did not agree to a protocol
> GET /docker-engine/apt/repo/dists/ubuntu-xenial/Release HTTP/1.1
> Host: mirror.azure.cn
> User-Agent: curl/7.47.0
> Accept: */*
>
< HTTP/1.1 403 Forbidden
< Server: nginx/1.10.2
< Date: Tue, 14 Feb 2017 01:23:09 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 169
< Connection: keep-alive
<
{ [169 bytes data]
100   169  100   169    0     0     28      0  0:00:06  0:00:05  0:00:01    38
* Connection #0 to host mirror.azure.cn left intact
manu@praisly:~|⇒  curl -v https://apt.dockerproject.org/repo/dists/ubuntu-xenial/Release > /dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:--  0:00:04 --:--:--     0*   Trying <IP_ADDRESS>...
  0     0    0     0    0     0      0      0 --:--:--  0:00:05 --:--:--     0* Connected to apt.dockerproject.org (<IP_ADDRESS>) port 443 (#0)
* found 173 certificates in /etc/ssl/certs/ca-certificates.crt
* found 694 certificates in /etc/ssl/certs
* ALPN, offering http/1.1
* SSL connection using TLS1.2 / ECDHE_RSA_AES_128_GCM_SHA256
* 	 server certificate verification OK
* 	 server certificate status verification SKIPPED
* 	 common name: *.dockerproject.org (matched)
* 	 server certificate expiration date OK
* 	 server certificate activation date OK
* 	 certificate public key: RSA
* 	 certificate version: #3
* 	 subject: CN=*.dockerproject.org
* 	 start date: Sat, 19 Mar 2016 00:00:00 GMT
* 	 expire date: Wed, 19 Apr 2017 12:00:00 GMT
* 	 issuer: C=US,O=Amazon,OU=Server CA 1B,CN=Amazon
* 	 compression: NULL
* ALPN, server accepted to use http/1.1
> GET /repo/dists/ubuntu-xenial/Release HTTP/1.1
> Host: apt.dockerproject.org
> User-Agent: curl/7.47.0
> Accept: */*
>
< HTTP/1.1 200 OK
< Content-Type: text/plain
< Content-Length: 29373
< Connection: keep-alive
< Date: Wed, 08 Feb 2017 19:43:42 GMT
< x-amz-meta-s3cmd-attrs: uid:0/gname:root/uname:root/gid:0/mode:33261/mtime:1486542750/atime:1486542783/md5:c0c1181ac7aaadc8642331afe831286f/ctime:1486542750
< Last-Modified: Wed, 08 Feb 2017 19:41:34 GMT
< x-amz-version-id: x.gp5OuYEvxzHOqZditd.TG.GKVVzhXH
< ETag: "c0c1181ac7aaadc8642331afe831286f"
< Server: AmazonS3
< Age: 208
< X-Cache: Hit from cloudfront
< Via: 1.1 e1f964df08c871d715f4be444ffd4e19.cloudfront.net (CloudFront)
< X-Amz-Cf-Id: 9mOOS5sN3f7ci_ffw-D_IuUnkuN1JMkcE90mPVN7wbW_y5wSy3t-Sw==
<
{ [16384 bytes data]
100 29373  100 29373    0     0   4912      0  0:00:05  0:00:05 --:--:--  6574
* Connection #0 to host apt.dockerproject.org left intact

But I still can't install with apt-get.
Is there a way to install without using the packet manager ?

You can download the .deb for your platform; http://apt.dockerproject.org/repo/pool/main/d/docker-engine/
And install with dpkg http://unix.stackexchange.com/questions/159094/how-to-install-a-deb-file-by-dpkg-i-or-by-apt

However the amd64 endpoint returns 403
curl -v https://apt.dockerproject.org/repo/dists/ubuntu-xenial/amd64 > /dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:--  0:00:04 --:--:--     0*   Trying <IP_ADDRESS>...
  0     0    0     0    0     0      0      0 --:--:--  0:00:05 --:--:--     0* Connected to apt.dockerproject.org (<IP_ADDRESS>) port 443 (#0)
* found 173 certificates in /etc/ssl/certs/ca-certificates.crt
* found 694 certificates in /etc/ssl/certs
* ALPN, offering http/1.1
* SSL connection using TLS1.2 / ECDHE_RSA_AES_128_GCM_SHA256
* 	 server certificate verification OK
* 	 server certificate status verification SKIPPED
* 	 common name: *.dockerproject.org (matched)
* 	 server certificate expiration date OK
* 	 server certificate activation date OK
* 	 certificate public key: RSA
* 	 certificate version: #3
* 	 subject: CN=*.dockerproject.org
* 	 start date: Sat, 19 Mar 2016 00:00:00 GMT
* 	 expire date: Wed, 19 Apr 2017 12:00:00 GMT
* 	 issuer: C=US,O=Amazon,OU=Server CA 1B,CN=Amazon
* 	 compression: NULL
* ALPN, server accepted to use http/1.1
> GET /repo/dists/ubuntu-xenial/amd64 HTTP/1.1
> Host: apt.dockerproject.org
> User-Agent: curl/7.47.0
> Accept: */*
>
< HTTP/1.1 403 Forbidden
< Content-Type: text/html; charset=utf-8
< Content-Length: 454
< Connection: keep-alive
< Date: Tue, 14 Feb 2017 01:34:57 GMT
< Server: AmazonS3
< X-Cache: Error from cloudfront
< Via: 1.1 e1f964df08c871d715f4be444ffd4e19.cloudfront.net (CloudFront)
< X-Amz-Cf-Id: bB-ChGiVuvdlPAMr9J7pNGFyu4EhYfcdluSGqJq5OSCd_gPHE7MFyQ==
<
{ [454 bytes data]
100   454  100   454    0     0     70      0  0:00:06  0:00:06 --:--:--   114
* Connection #0 to host apt.dockerproject.org left intact

Even on my laptop, on VPN, I can't reach https://apt.dockerproject.org/repo/dists/ubuntu-xenial/amd64

the path is http://apt.dockerproject.org/repo/dists/ubuntu-xenial/main/binary-amd64/

Ok, http://apt.dockerproject.org/repo/dists/ubuntu-xenial/main/binary-amd64/ can be curled fine then.

I had the same problem, because I was trying to install Docker on a 32bit machine and Docker requires 64bit. Just to point this out for anyone who is reading this in the future, if this isn't the case with original poster.

I got the same problem, and also on Aliyun Ubuntu 16.04 amd64

@wangjingfei Yes, that worked! Thanks a lot, you've made my day!

Hi All,
I am getting the same error. I am not able to troubleshoot because above @wangjingfei 's reference link is down-
I tried to change the path also still its causing the same error.
Error Text -
Url 1-
The repository 'https://apt.dockerproject.org/repo ubuntu-xenial main | Release' does not have a Release file.
Url 2 -
W: The repository 'http://apt.dockerproject.org/repo/dists/ubuntu-xenial/main/binary-amd64 | Release' does not have a Release file.
Thank you in advance.

Just, follow the new docker installation instructions in
https://docs.docker.com/engine/install/ubuntu/

Just stumbled upon this issue. Upgrading ubuntu 16.04.1 LTS to 18.04 and on a do-release-upgrade I get this error.
None of the suggestions in the thread has worked.

@thebravoman the paths in the new repositories is different, also make sure you update the repository to use bionic (Ubuntu 18.04) instead of xenial (Ubuntu 16.04)  (the path corresponding with the old one would be https://download.docker.com/linux/ubuntu/dists/bionic/). You may want to remove the old repository from your apt config, and add the new one using the instructions on https://docs.docker.com/engine/install/ubuntu/

@thaJeztah tried it
Got
E: The repository 'https://download.docker.com/linux/ubuntu/dists/bionic ubuntu-bionic Release' does not have a Release file.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.

The ubuntu-bionic part looks suspicious (should be bionic). Is the repository perhaps still defined in a different place?
What does grep -r docker /etc/apt show?
grep -r docker /etc/apt
Binary file /etc/apt/trusted.gpg matches
/etc/apt/sources.list.d/docker.list:deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic edge


Update GHA CI to allow providing runner versions

Tool name
Github actions CI
Tool license
N/A
Add or update?

[ ] Add
[X] Update

Desired version
N/A
Approximate size
No response
Brief description of tool
Github actions should provide a way to also specify runner version along with OS. Off late I have been seeing quite a lot of instability across runner versions and users of the CI are left wondering why the build is failing and is required to wait till it is fixed/addressed by the team. Allowing users to set the runner version will help them in reverting to the operational runner version and unblock their CI till the appropriate fixes go in.
URL for tool's homepage
No response
Provide a basic test case to validate the tool's functionality.
No response
Platforms where you need the tool

[ ] Azure DevOps
[X] GitHub Actions

Runner images where you need the tool

[ ] Ubuntu 20.04
[ ] Ubuntu 22.04
[ ] macOS 11
[ ] macOS 12
[ ] macOS 13
[ ] Windows Server 2019
[ ] Windows Server 2022

Can this tool be installed during the build?
No response
Tool installation time in runtime
No response
Are you willing to submit a PR?
No response

I completely agree, our CI just overworked after yesterday's update. Right on release day.

+1, we need the ability to pin a specific runner because the latest version of MacOS running is causing issues.

@disa6302 , please provide more details. currently it looks too general.

@ilia-shipitsin ,
Is there a specific detail you are looking for?
To be precise, my request indicates adding a new field in the yaml script, something like runner-version to allow users to specific the version. I am looking for something like:
  mac-os-build-gcc:
    runs-on:
        os: macos-13
        runner-version: 3.7.1

The version I am talking about is the one that shows up in the Setup step of the build:
Current runner version: '**2.307.1**'
Operating System
Runner Image
Runner Image Provisioner
GITHUB_TOKEN Permissions
Secret source: Actions
Prepare workflow directory
Prepare all required actions
Getting action download info
Download action repository 'actions/checkout@v3' (SHA:c85c95e3d7[2](https://github.com/awslabs/amazon-kinesis-video-streams-producer-c/actions/runs/5741154558/job/15560609881?pr=388#step:1:2)51135ab7dc9ce3241c5835cc595a9)
Download action repository 'aws-actions/configure-aws-credentials@v1-node1[6](https://github.com/awslabs/amazon-kinesis-video-streams-producer-c/actions/runs/5741154558/job/15560609881?pr=388#step:1:7)' (SHA:023daa7fe5f7f8[17](https://github.com/awslabs/amazon-kinesis-video-streams-producer-c/actions/runs/5741154558/job/15560609881?pr=388#step:1:21)faa31fc0fc4a8d0fb6[22](https://github.com/awslabs/amazon-kinesis-video-streams-producer-c/actions/runs/5741154558/job/15560609881?pr=388#step:1:26)4ed0)
Complete job name: mac-os-build-gcc

Hello! We currently do not have plans to implement something like that in the near future, regarding macOS 13 we would like to remind everyone that the image is still in public beta, it means it may pose problems time to time.

@mikhailkoliada ,
The builds are unreliable not only in MacOS 13 but other mac versions as well (I have another open ticket item in this repo that is being looked into). Had there been a runner version that could be specified, it would have unblocked me. But now I am blocked on that build running to make it to release.
Hence the idea. Its alright if its not in the plans right now, but I would appreciate if this is tracked seriously for future because this will be pretty powerful in working around the instability of the runners through updates.


Update README.md

As my project now automatically updates all the packages which are distributed via GitHub Releases, I think this should be added in the README in order to avoid duplicates.
Microsoft Reviewers: Open in CodeFlow

@denelon

@jedieaston Wait... I think you have gone wrong? GitHub Workflow Runs can be very easily found: https://github.com/vedantmgoyal2009/winget-pkgs-automation/actions/workflows/automation.yml.

Yeah, I was looking in the wrong place. Apologies.
Doesn't change my point though, this isn't supported by Microsoft.

We have work on the backlog to look at doing essentially the same thing. Rather than re-inventing the wheel we will likely ask for proposals from the community to see what the best path forward is. Part of this work will involve attempting to identify the best source/mechanism for updating packages. There are several different community members keeping collections up to date. We would still prefer to have publishers provide their own manifests, but this would be a secondary option until then.
We would also be more likely to use and suggest https://github.com/microsoft/wingetcreate as it has the ability to detect architectures and installer types. I'm expecting to change the pipelines to use that tool instead of the code we originally wrote before the Windows Package Manager Manifest Creator existed.

https://github.com/microsoft/winget-pkgs/issues/500#issuecomment-932892281

We would still prefer to have publishers provide their own manifests, but this would be a secondary option until then.

This is the best option but I also agree with Felipe Santos that "But there are some packages in which the developers of it will never care about doing so, but still, we would want them up-to-date in WinGet repo."

I totally agree with @felipecrs on that.
One of the things we've been considering is leveraging the .package file (similar to the .validation) file to identify the source and mechanism for detecting updates, and generating manifests. The good news about that approach is once the publisher has become "verified", it's the same file to let them start managing updates themselves.

I was already prepared for that 🙂 and I am already skipping packages from the automatic upgrade like Oh-my-posh and Rainmeter, etc... (these two I have them on my fingers) which are already automated/published by the developer.

I like the idea of having designated community members that usually update specific packages. Some people here know a lot about how certain apps install (Visual Studio and Python are two example off the top of my head) and it would be nice to have that written down somewhere. Not to pin responsibility on anyone, of course, but having a designated .package or .maintainer file that says "@jedieaston knows about this, mention them in issues" wouldn't be a bad idea.
Chocolatey has something similar, see the "Package Maintainers" section to the left of this page.

Also, re searching for open PRs, you can use in:path <path to files> in GitHub's PR search to find pull requests that modify certain paths in the repo. It would be not too hard to see if there was already a PR for a certain version of a package.
For example, is:pr in:path manifests/m/Microsoft/Edge/94.0.992.38 gets me my PR from earlier today which adds version 94.0.992.38 of Microsoft Edge.

@vedantmgoyal2009 your project is brilliant, really.

Thank you. It made my day to hear that.

That said, the concern from @jedieaston about not being a Microsoft supported project is valid (I believe).
I think the farest you could reach would be:
After the new "verified" mechanism is in place (referring to @denelon's message), you could apply for claiming the responsibility for the packages which your project updates automatically.
And then, this PR could be changed to something like:

You can apply for claiming the responsibility of updating packages through [link] and then write code for updating it in the WinGet repo automatically. As example, there are some projects in the community which already does that:
https://github.com/vedantmgoyal2009/winget-pkgs-automation

This would solve the issue about not-being a Microsoft supported project, I guess.

Yes, this can be the better option as it gives the opportunity to other community members. This way, more users would get the chance to contribute to the repository in this way. I would like to know if the Microsoft team agrees with this.

Also, re searching for open PRs, you can use in:path <path to files> in GitHub's PR search to find pull requests that modify certain paths in the repo. It would be not too hard to see if there was already a PR for a certain version of a package (you can search PRs via GitHub's API).
For example, is:pr in:path manifests/m/Microsoft/Edge/94.0.992.38 gets me my PR from earlier today which adds version 94.0.992.38 of Microsoft Edge.

@jedieaston The search API gives only 30 requests per minute so I will have to be careful. I am already making a thousand requests (approximately) in a very short amount of time. Btw, I have created an issue on my repo (https://github.com/vedantmgoyal2009/winget-pkgs-automation/issues/18) for which I will start working within a week or so.

Do we know who else has built automation like this? I'd rather have a "community" section in the README than to point to a specific one in the event there may be others. I also want to reference some of the work we have on the backlog to further refine the functionality and bring it into this repository as a longer term plan. I think we might make an automation specific page declaring some of our preferences like publishers submitting their own manifests. It also makes it easier to mention the Windows Package Manager Manifest Creator, and tie that into CI/CD scenarios. I can also see some benefit in providing a template to make it easier to submit requests to other open source projects with instructions and options for automation.

Also, re searching for open PRs, you can use in:path <path to files> in GitHub's PR search to find pull requests that modify certain paths in the repo. It would be not too hard to see if there was already a PR for a certain version of a package (you can search PRs via GitHub's API).
For example, is:pr in:path manifests/m/Microsoft/Edge/94.0.992.38 gets me my PR from earlier today which adds version 94.0.992.38 of Microsoft Edge.

Searching this, it should give #29349 in the result.

@denelon The GitHub CLI repo has one, as does Azure CLI (I don't think theirs is public, though).
I can come up with a few others though.


Clean and format the Debugging Siddhi Applications page

Create the Debugging Siddhi Applications page by cleaning and formatting the text in [1]. Some rewording and rephrasing might be needed depending on the UI changes.
[1] https://github.com/wso2/docs-ei/blob/master/en/streaming-integrator/docs/develop/debugging-a-Siddhi-Application.md

There are still broken links in this page because the pages that the links should open are not ready yet.

Added [1] for the EI 7.0.0 release.


Fixed steps in GettingStarted.md

The wizard creates a subfolder that you need to cd into order for the steps to work.
Without it you hit an issue:
MyNewProject % pwd
/Users/carlton/Projects/Swift/Hummingbird/MyNewProject
MyNewProject % ../template/configure.sh MyNewProject
Configuring your Hummingbird project
Outputting to /Users/carlton/Projects/Swift/Hummingbird/MyNewProject/MyNewProject
Enter your package name: [MyNewProject] >
Enter your executable name: [App] >
~/Projects/Swift/Hummingbird/template ~/Projects/Swift/Hummingbird/MyNewProject
~/Projects/Swift/Hummingbird/MyNewProject
MyNewProject % swift run App
error: Could not find Package.swift in this directory or any of its parent directories.
MyNewProject % cd MyNewProject
MyNewProject % swift run App

Looking at this there are unnecessary steps here. You only need four steps

git clone https://github.com/hummingbird-project/template
./template/configure MyNewProject (creates new project)
cd MyNewProject (enter project directory)
swift run

@carltongibson Would you be up for editing the file?

@adam-fowler OK, updated. Much nicer. 👍

Great. Thanks.

@carltongibson And its live https://docs.hummingbird.codes/2.0/documentation/hummingbird/gettingstarted


A typo in Customize WebApplicationFactory section

Hi everyone! I'm working on integration tests in my web application, and trying to customize WebApplicationFactory. I found sample here, but when I tried it, it didn't work.
I think there is a mistake when from app's context remove DbContextOptions<ApplicationDbContext> instead of ApplicationDbContext (in 9 line). When I noticed that, I change DbContextOptions<ApplicationDbContext> to ApplicationDbContext and all worked as expected.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 77889d43-fedb-f8b4-8fea-379ec946555c
Version Independent ID: f499b131-8b14-7e10-1728-543fdd5a5656
Content: Integration tests in ASP.NET Core
Content Source: aspnetcore/test/integration-tests.md
Product: aspnet-core
Technology: aspnetcore-test
GitHub Login: @Rick-Anderson
Microsoft Alias: riande

Hello @MatsyshynAnton ...
The app runs here in it's present form ...

... but your SUT's dB context might be registered differently.
I see two registrations when the sample solution's SUT runs ...

Service: Microsoft.EntityFrameworkCore.DbContextOptions`1[[RazorPagesProject.Data.ApplicationDbContext, RazorPagesProject, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=null]]
Lifetime: Scoped
Instance:
Service: RazorPagesProject.Data.ApplicationDbContext
Lifetime: Scoped
Instance: RazorPagesProject.Data.ApplicationDbContext

I wonder if it should be ApplicationDbContext and we didn't update it when some changes were made over the history of this document. This topic is one of our older topics, and it has received a couple of rounds of significant updates over the years. This might have been a line update that was missed.
We can't ask engineering a question about this at the moment. The engineer who works with us to maintain this topic is heads-down on high priority work for the next couple of weeks. 🏃
I'll schedule this and ask him when he gets free. Until then, I'm glad you found an approach that works for you.
Note to self: I don't think it's necessary to check for a null descriptor before calling Remove. If Remove doesn't find it, I believe it will just return false (i.e., not throw).

@MatsyshynAnton ... Can you show your SUT's db context? Did you set it up exactly like the SUT does? ...
public class ApplicationDbContext : IdentityDbContext
{
    public ApplicationDbContext(DbContextOptions<ApplicationDbContext> options)
        : base(options)
    {
    }

    ...

@guardrex Thank you for response :) Looks like here is my mistake
Here is my database context:
public class HomeworkDbContext:DbContext
    {
        public HomeworkDbContext(DbContextOptions<HomeworkDbContext> options)
            : base(options) { }
            ...
    }

I have tried to replace this context with context which use SQLite in-memory database (for integration tests) like this:
    public class CustomWebApplicationFactory : WebApplicationFactory<Startup>
    {
        protected override void ConfigureWebHost(IWebHostBuilder builder)
        {
            builder.ConfigureServices(services =>
            {
                var descriptor = services.SingleOrDefault(d => d.ServiceType == typeof(HomeworkDbContext));

                if (descriptor != null)
                {
                    services.Remove(descriptor);
                }

                var connection = new SqliteConnection("Filename=:memory:");
                connection.Open();

                services.AddDbContext<HomeworkDbContext>(options =>
                {
                    options.UseSqlite(connection);
                });
               ...
            }
        }
     }

But, this approach didn't work, somehow I kept working with my old database context and create/read/update/delete entities from my SQL-server.
When I tried sample from docs one more time, all start worked as expected. Here is code for my case:
    public class CustomWebApplicationFactory : WebApplicationFactory<Startup>
    {
        protected override void ConfigureWebHost(IWebHostBuilder builder)
        {
            builder.ConfigureServices(services =>
            {
                var descriptor = services.SingleOrDefault(d => d.ServiceType == typeof(DbContextOptions<HomeworkDbContext>));

                if (descriptor != null)
                {
                    services.Remove(descriptor);
                }

                var connection = new SqliteConnection("Filename=:memory:");
                connection.Open();

                services.AddDbContext<HomeworkDbContext>(options =>
                {
                    options.UseSqlite(connection);
                });

                var sp = services.BuildServiceProvider();

                using (var scope = sp.CreateScope())
                {
                    var scopedServices = scope.ServiceProvider;
                    var db = scopedServices.GetRequiredService<HomeworkDbContext>();

                    db.Database.EnsureCreated();
                }
            });
        }
    }

I don't know what I did wrong first time, anyway thank you for your answer.
P. S. Sorry if I wasted your time) I found difference in code and in comment to this code and thought I can help to improve documentation.

That's ok ... no worries. In fact, let's leave this open for a sec. I want to drop that conditional check. Remove just returns false if the service isn't found. The conditional check isn't doing anything there.
Also, I'd like to move the code comments into the text. They aren't localized when they're in the code like that, and I'd like to change a little bit of the language used.
This issue will close automatically when the PR merges.


HARVESTER:feat: image upload

Add progress bar and error message on the image list page
Remove the source of annotations and replace it with value.spec.sourceType
Fix image size is NAN B
Fix state does not display removing and failed
Filename will auto-fill into name, when the name is empty

@n313893254  test


[GraphQL] Remove version related routes

Description
Removes the version related routes.
Test plan
Existing tests

Release notes
Check each box that your changes affect. If none of the boxes relate to your changes, release notes aren't required.
For each box you select, include information after the relevant heading that describes the impact of your changes that a user might notice and any actions they must take to implement updates.

[ ] Protocol:
[ ] Nodes (Validators and Full nodes):
[ ] Indexer:
[ ] JSON-RPC:
[x] GraphQL: GraphQL only supports one version instead of beta, stable, legacy. This change removes the previous routes and only allows for / and /graphql, which will always point to the latest version.
[ ] CLI:
[ ] Rust SDK:
[ ] REST API:

Checked #19191 and indeed my mistake was that I only removed the extra routes in the service built during tests 😬 thanks for the clean up!


chore(ci): add ci pipeline

Add workflow file and support both local and ci build

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


how to access  i2b2 dataset

Hi, I am a participant of source-free-domain-adaptation. When I apply for the access to the i2b2 2010 Challenge data fowllowing task instruction, the websites shows that Registration is not open for Unstructured notes from the Research Patient Data Registry at Partners Healthcare at this time. It seems that i2b2 2010 Challenge data could not be accessed through n2c2/DBMI Data Portal.
Are there other ways to get these data?  Any suggestions for data access? Thanks.

I'm told that there is some temporary downtime but it should be back to normal this week.


[V2] Update v2

Checklist

[X] Run tests locally to make sure nothing is broken using make test.

[X] Run the formatter to format the code using make lint.

Updated tasks and their metadata

Updated the score function in AbsTaskRetrieval

Thanks @Samoed!  Score function looks good. Is the ColBERT stuff new here - I am a bit confused by the commit threads.

Yes, this is a new model and was integrated into the main branch, but GitHub is displaying it a bit oddly. I've added you to review the score_function changes in RetrievalEvaluator. If the RetrievalEvaluator changes look good, I’ll proceed with merging into v2.

Yes refactor looks good! Only one small nit, model.score in the model classes as a replacement is a bit ambiguous, would prefer something like score_fn or distance_fn or something more verbose.
Otherwise LGTM, feel free to merge.


Test for thelounge nick when greeting, and use monospace formatting

I'm not totally sure if this actually worked, but nick is supposed to be bold, and IRC command is supposed to be monospaced:

Expected result:

If it didn't work, I'm not sure how to pass the styling characters.
See this for new default nick.

Not sure if it should be bold as it will be colored

It's not colored in queries.


Possible to change app permissions to "less invasive"

Originally reported on Google Code with ID 182
(Not so much an issue, but more of a request)

Saving requests is great -- recently the app updated itself and reset the local database,
deleting my saved requests, and unfortunately I did not have them synced to Google
Drive.

Currently the app requires "view all metadata" permission for Google Drive in order
to save requests, which makes sense in that you allow users to choose the folder to
save requests too.  Offering control to the user is nice.

But, "metadata" is a pretty wide range of information beyond just title and folder
-- it includes thumbnails and indexable text, among other things like location, etc.
 Some of this could be sensitive (i.e. controlled by other restrictions).

Is it possible to remove or reduce this permission?  Much like the suggestions in this
thread: https://groups.google.com/forum/?fromgroups#!topic/shiftedit/-oc3LhjzEP4

Potentially, like Google Scratchpad, where it creates a single folder and all information
is saved to that folder, thus the app doesn't need to look outside that folder?

Reported by jeremys.atwork on 2013-06-07 20:42:14

I rethinked your proposal.
I guess it may be more convenient to the user to have only one place where you can store your requests. You are right, this is the only (intended) app which can use this data so users don't really care about where the file are stored.
There  should be one folder with all saved requests and potentially a folder for data export.
Whole Drive integration and flow must be rethinked then.
Thanks for reporting and good arguments in discussion.

After trying different approach I decided to not change the permissions. The Drive API require this permissions to allow my app work normally. For example I couldn't open shared with me files without this permissions because the files wasn't created by this particular instance of the app. Even if the file was created by the app. So I can't limit the number of permissions to drive API. The only alternative is not to use Drive with the app.


Use filename for scene root of imported models

Closes #27408
EDIT:
Changed the code so it only uses filename if you didn't change the default root name (since apparently it's possible via import tab).

Thanks!

Cherry-picked for 3.1.2.


Fixes regression generating func.yaml. auto detected runtimes weren't…

… added to file.
Closes https://github.com/fnproject/fn/issues/608

Removed println's


feat: Update scaling policy

Update:

Prevent downscaling

@begelundmuller, following some discussions with the infra team, we've decided to temporarily disable down-scaling.
Regarding the disabling of scaling for manually-specified slots, I have left a comment seeking further assistance.
Concerning the cap at 20%, I am guessing that temporarily disabling down-scaling may suffice for our needs.
However, I am concerned that this cap might become a bottleneck, especially when scaling from smaller values (e.g., scaling from 4 to 8).
On the other hand, I'm cautious about introducing overly complex logic to determine the slots, considering we already have a recommended value for slots.
Additionally, I'm wondering about the has-sla tagging.
Is this a widely applicable tag?
If we disable scaling for projects tagged with has-sla, it might impact a large number of our production-level services, which are primarily scaled for flexibility and cost savings.
cc: @himadrisingh @kaspersjo

As discussed previously, we are using the following tags:

sla=prod to indicate projects that are considered in production
sla-dev to indicate projects that are under active development
dashboard_latency=10s for the expected dashboard latency before we trigger alerts (we are currently defaulting to 10s for duckdb-backed projects and 20s for Druid-backed)


Feature: Implement Instance snapshots

Feature: Upload VM snapshots using Aleph STORE message.
Feature: Restore existing snapshots as STORE Aleph message.

I am closing this PR since we are facing performance issues in this implementation and want to evaluate the use of Qcow2 as a replacement.


AttributeError: 'module' object has no attribute 'AnalyzeParameters'

See issue # 53, when using the provided code sample the error returns,
analyzeParams = arcrest.manageorg.AnalyzeParameters()
AttributeError: 'module' object has no attribute 'AnalyzeParameters'
code that I am using;
import arcrest
if name == "main":
username = ""
password = ""
csv_file = r"C:\Users\GeoffreyWest\Desktop\bing_output.csv"
sh = arcrest.AGOLTokenSecurityHandler(username, password)
admin = arcrest.manageorg.Administration(securityHandler=sh)
content = admin.content
usercontent = content.usercontent(username=username)
ip = arcrest.manageorg.ItemParameter()
ip.title = "BingParameterTest"
ip.type = "CSV"
ip.tags = ""
ip.overwrite = True
ip.thumbnailurl = ""
res = usercontent.addItem(itemParameters=ip,
                          filePath=csv_file, overwrite= True)

print res

itemId = res['id']
print itemId
#  Now you need to analyze the item to publish it
#
featureContent = content.featureContent
analyzeParams = arcrest.manageorg.AnalyzeParameters()
analyzeResult = featureContent.analyze(itemId=itemId, analyzeParameters=analyzeParams)
#  Published based off the analyze function
#
if 'publishParameters' in analyzeResult:
    pp = analyzeResult['publishParameters']
    publishParams = arcrest.manageorg.PublishCSVParameters(name=pp['name'],
                                           locationType=pp['locationType'],
                                           layerInfo=pp['layerInfo'],
                                           latitudeFieldName=pp["Y_COR"],
                                           longitudeFieldName=pp['X_COR'])
    print usercontent.publishItem(fileType="csv",
                                  publishParameters=publishParams,
                                  itemId=itemId, overwrite = True)
print 'finished'

Do you have the latest version of ArcREST?
It's in there: https://github.com/Esri/ArcREST/blob/master/src/arcrest/manageorg/parameters.py

Yes, the error no longer appears, can you provide an example of how ['layerinfo'] should be structured?

See: http://resources.arcgis.com/en/help/arcgis-rest-api/#/Layer/02r30000004q000000/
Andrew Chapkowski | Professional Services
esri | 1325 Morris Drive, Suite 201 | Chesterbrook, PA 19087
Phone:<PHONE_NUMBER> ext. 5930 | E-mail: achapkowski<EMAIL_ADDRESS>[DevA_EDDA]
From: Geoffrey West<EMAIL_ADDRESS>Sent: Wednesday, May 20, 2015 11:36 AM
To: Esri/ArcREST
Cc: Andrew Chapkowski
Subject: Re: [ArcREST] AttributeError: 'module' object has no attribute 'AnalyzeParameters' (#59)
Yes, the error no longer appears, can you provide an example of how ['layerinfo'] should be structured?
—
Reply to this email directly or view it on GitHubhttps://github.com/Esri/ArcREST/issues/59#issuecomment-103929167.

Not sure why it's not publishing, print usercontent.publishItem(fileType="CSV",  does not print a result, and addItem fails intermittently. With error 500 as mentioned in issue # 53, this error seems to be dependent of the publishing section of the script.
publishParameters=publishParams,
itemId=itemId)
my ['layerinfo'] is a json that I am reading from disk as
jsonfile = 'C:\Users\GIS\Desktop\eastvalley.json'
with open(jsonfile, "r") as f:
  data = json.loads(f.read())

if 'publishParameters' in analyzeResult:
pp = analyzeResult['publishParameters']
publishParams = arcrest.manageorg.PublishCSVParameters(name=pp['CSVPublishTest'],
locationType=pp['none'],
layerInfo=pp[jsonfile])
print usercontent.publishItem(fileType="CSV",
publishParameters=publishParams,
itemId=itemId)
print 'finished'
I am using this JSON structure found http://resources.arcgis.com/en/help/arcgis-rest-api/index.html#//02r30000008q000000
{
"name": "My CSV File Dataset",
"locationType": "none",
"description": "test description",
"maxRecordCount": 500,
"copyrightText": "test copyright",
"layerInfo": {
"name": "Illinois",
"type": "Feature Layer",
"geometryType": "none",
"minScale": 0,
"maxScale": 0,
"hasAttachments": false,
"htmlPopupType": "esriServerHTMLPopupTypeNone",
"objectIdField": "GeographyId",
"globalIdField": "",
"typeIdField": "",
"fields": [
{
"name": "GeographyId",
"type": "esriFieldTypeString",
"alias": "FID",
"sqlType": "sqlTypeInteger",
"nullable": false,
"editable": false,
"domain": null
},
{
"name": "GeographyName",
"type": "esriFieldTypeString",
"alias": "Geog Name",
"nullable": false,
"editable": true,
"domain": null
},
{
"name": "GeographyType",
"type": "esriFieldTypeString",
"alias": "Geog type",
"nullable": false,
"editable": true,
"domain": null
},
{
"name": "StateAbbreviation",
"type": "esriFieldTypeString",
"alias": "State Abbr.",
"nullable": false,
"editable": true,
"domain": null
}
],
"types": [],
"templates": [],
"capabilities": "Query,Editing"
}
}

I would suggest installing Fiddler and walk through the process using ArcGIS Online or Portal and see what differs from the calls you are making in ArcRest.  Can you post the entire scripts and a sample CSV that we can use to repo the issue?

No code posted or fiddler traffic, issue closed.  Please feel free to post your issue again.


Pagination issue

If I try to paginate the users result then there is an error.
How to paginate the users since at the moment return all rows the server side process?
Did I need to do this manually or is handle by custom request of your package?
Thanks

Seem work fine using query().
I try different way by using repository, I am using this: https://github.com/andersao/l5-repository
Is there a way to handle this?

@macagoraga I think the repository package is good for handling on API centric development. For the dataTables, I suggest you use a model or a Query Object for complex queries.
Anyways, if there is a way for the that package to get the query() instance, it should also work fine. Just note that pagination is already handled by the package thus paginate() should not be used.

Thanks!


RCON issues with Garry's Mod

Bug Report
System Information

Windows Server 2019 Standard
v2.4.6, built 02/08/2023
Mainline

I confirm:

[x] that I have searched for an existing bug report for this issue.
[x] that I am using the latest available version of AMP.
[x] that my operating system is up-to-date.

Symptoms

Whenever users try and send commands to Garry's Mod servers, many times the commands fail to reach the server. I cant tell if it is an RCON issue or not, as sometimes RCON seems to never connect (according to the logs) yet the console is still responding, while other times RCON does connect successfully (according to the console) yet you can not send any commands to the server
When normally sending commands the server responds with either a command confirmation or invalid command
Currently often it does not work
I have noticed if i restart the instance and than try on first boot up it works without issue, but after any server restart it stops working.

Reproduction

I install or start the server from a stopped state
Manage the server
Turn on the server
I test to see if i can send the command SV_CHEATS 1
it will than typically respond back confirming that the command went through
I then restart the server
than am not able to send commands
The issue will persist until i fully restart the instance
Upon the same steps taking place the issue will resume

Closed as duplicate of #901 and #485 - Please search before posting.


Changing the active catalog panel may affect the selection and cause the top window to appear

Seems to be fixed.


Analytics behaviour: Podium

When scrolling down an article on Podium, and a new one is loaded in, this is not logged on GA, there's no refresh.
This functionality makes sense for the blogroll—but not for Podium.

CC @arnasziedavicius for discussion regarding GTM implementation.

Hi @chrismplus @dianewang,
When testing the new GTM setup I've noted that new articles are being logged as page views in GA.
Let's observe and come back to this once we can test on staging.
Re: https://github.com/mplusmuseum/mplusmuseum-stories/pull/261#issue-288802633


fix: Re-introduce 1 second sleep to reconcile informer

Fixes: #3665
This line was removed in v2.9.0, but issues arose with the controller picking up outdated versions of workflows, operating on them, then attempting to update the resources on the cluster. Since the workflows were outdated, conflicts arose when attempting to update, causing our conflict resolution code to be invoked. The conflict resolution code was not perfect and workflow information was not correctly persisted, causing undefined behavior.
Testing procedure:

Make a build without this line.
Run multiple workflows
See undefined behavior (hanging pending pods, hanging running nodes, etc.); see the following log:Error updating workflow: Operation cannot be fulfilled on workflows.argoproj.io \""WF_NAME\"": the object has been modified; please apply your changes to the latest version and try again Conflict"

Make a build containing this line.
Run multiple workflows
See no undefined behavior; don't see the problematic log.

I think we should look at alternative methods to do this, but not today. Today, lets fix the bug with a know working solution.

This is available in https://github.com/argoproj/argo/releases/tag/v2.10.0-rc6

Available in v2.9.5


feat(core): Add support for working with env files

Discovered from issue: #670
Users should not be required to load each env var manually if they have an env file.
Added support for loading a dot-env file.
Usage:
with DockerContainer("nginx:latest").with_env_file("my_env_file"):
    # We now have a container with the relevant env vars from the file

This is an implementation of docker run --env-file <file> ...

@Tranquility2
It is great, but not sure that it will be useful, to me at least.
I will explain my workflow, because maybe I am using testcontainers-python in non optimal way and somebody can correct me.
I start testcontainers-python  via pytest and have 3 containers running: redis, postgres and my own FastAPI app.
I am accessing redis, postgres from FastAPI app and from pytest directly(for simulating rest of the system)
What I have found that different IP and ports are needed if my own FastAPI app(container) is accessing redis and postgres containers or if pytest is accessing redis and postgres container.
IP and port also changes if I am using Linux(docker engine) or OSX (Docker Desktop).
Do to all this I can not use one dot-env file.
If I am doing something wrong, please correct me.

Let me try an sort this out :)

your workflow is fine, you need dynamic data that your are obtaining for previous runs, that's not the use case for env files.
This PR relates to the first part of your question where you raised a very interesting point regarding using dotenv and sending  current/some os.environ to the Container and thats where env file can be used. (You simply reflected something deeper in the question. maybe it was not intentional)
For example, if I would have an Redis service with some config:

# Redis Bike Commpany Demo Application: Example .env file.
REDIS_URL=redis://localhost:6379/?decode_responses=True
BIKE_INDEX_NAME="idx:bikes"
STORE_INDEX_NAME="idx:stores"
REDIS_KEY_BASE="redisbikeco"
BIKE_KEY_BASE="redisbikeco:bike"
STORE_KEY_BASE="redisbikeco:store"
FLASK_ENV=development

We would now be able to load it without evoking  with_env 7 times + keeping a single source of truth for the env config.
TL;DR your current solution is great as its dynamic, we also need to support static config from file (As this is the common case for quite a few services)

@Tranquility2 OK, thanks for explanation.
Is there some way, one line, to get container internal IP address ?
Only solution that I have found is:
import docker
client = docker.from_env()

# redis
redis_container_id = redis.get_wrapped_container().id
redis_container = client.containers.get(redis_container_id)
redis_container_ip_address = redis_container.attrs['NetworkSettings']['Networks']['bridge']['IPAddress']

I assume you mean redis as the model in testcontainers, you can use this:
from testcontainers.redis import RedisContainer

with RedisContainer() as redis:
    redis_container_ip_address  = redis.get_docker_client().bridge_ip(redis._container.id)

(This should provide the same data as in the example you found)

Some more details (if you are interested)
Usually get_container_host_ip is good enough (it is based on client.api.base_url from the docker API)
but as you can see in the code, https://github.com/testcontainers/testcontainers-python/blob/4912725c2a54a9edce046416fbf11e089cc03cb0/core/testcontainers/core/container.py#L141 some of the DinD code was disabled, but you can clearly see
self.get_docker_client().gateway_ip(self._container.id)
and self.get_docker_client().bridge_ip(self._container.id) are very useful for some cases.

@Tranquility2 thanks
P.S.
from my experience on Linux(docker engine) I need bridge_ip if one container want to communicate with other.
On OSX(docker Desktop) I just replace localhost with host.docker.internal

im not sure about this use case. the issue linked sets hostnames as variables. shouldn't those be constants in code for easy updating? like youre passing the same hostname in the same function (same module at least) to both set and pass to other containers. im not convinced.

I see this is confusing, let me open a new issue :)

@alexanderankin update the related issue to https://github.com/testcontainers/testcontainers-python/issues/687 (sorry for the mix up)

@alexanderankin is this not also intend to be merged?

Moved to #737 to clean the irrelevant discussion :)


Beginner's doubts.

Hello,
I am a beginner in MFC. I find MFC to be very different from other open source programs.
Other open source programs need to write their own programming syntax and program files (for example, through loops or judgment statements to get what they need), and need users to conceive their own programming logic (calling various functions in the program to complete their requirements).
But MFC gets the final result by editing the input file (case.py). I would like to know if I want to make changes to MFC, can I only change the corresponding source file in .src? If I want to output some statement that says the result I have to change the fortran file in src? (Can't customize the output?)
Finally, as a beginner of MFC, after I understand the user documentation, are there any other suggestions you can give me to further understand and use MFC?
Best wishes!

If you want to change what the code does, you change the source files in src/, if you want to change the specific problem it is solving, you change case.py. Thanks for your interest in MFC!

Okay, thanks!
I'll come back and ask for your advice when I have problems in learning MFC.~


spleeter-gpu broken

I followed through with installing spleeter-gpu and when i try to run it this is the ouput I get.
(spleeter-gpu) swissbeats93@ApexHunter:~/Documents/Development$ spleeter separate -i spleeter/audio_example.mp3 -p spleeter:2stems -o output
INFO:spleeter:Loading audio b'spleeter/audio_example.mp3' from 0.0 to 600.0
INFO:spleeter:Audio data loaded successfully
Traceback (most recent call last):
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1356, in _do_call
return fn(*args)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1341, in _run_fn
options, feed_dict, fetch_list, target_list, run_metadata)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1429, in _call_tf_sessionrun
run_metadata)
tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found.
(0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
[[{{node conv2d_7/Conv2D}}]]
[[strided_slice_13/_905]]
(1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
[[{{node conv2d_7/Conv2D}}]]
0 successful operations.
0 derived errors ignored.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/bin/spleeter", line 8, in
sys.exit(entrypoint())
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/spleeter/main.py", line 47, in entrypoint
main(sys.argv)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/spleeter/main.py", line 41, in main
entrypoint(arguments, params)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/spleeter/commands/separate.py", line 178, in entrypoint
output_naming=output_naming)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/spleeter/commands/separate.py", line 132, in process_audio
for sample in prediction:
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 637, in predict
preds_evaluated = mon_sess.run(predictions)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow/python/training/monitored_session.py", line 754, in run
run_metadata=run_metadata)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow/python/training/monitored_session.py", line 1252, in run
run_metadata=run_metadata)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow/python/training/monitored_session.py", line 1353, in run
raise six.reraise(*original_exc_info)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/six.py", line 696, in reraise
raise value
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow/python/training/monitored_session.py", line 1338, in run
return self._sess.run(*args, **kwargs)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow/python/training/monitored_session.py", line 1411, in run
run_metadata=run_metadata)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow/python/training/monitored_session.py", line 1169, in run
return self._sess.run(*args, **kwargs)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 950, in run
run_metadata_ptr)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1173, in _run
feed_dict_tensor, options, run_metadata)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1350, in _do_run
run_metadata)
File "/home/swissbeats93/anaconda3/envs/spleeter-gpu/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1370, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found.
(0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
[[node conv2d_7/Conv2D (defined at /lib/python3.7/site-packages/spleeter/model/functions/unet.py:90) ]]
[[strided_slice_13/_905]]
(1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
[[node conv2d_7/Conv2D (defined at /lib/python3.7/site-packages/spleeter/model/functions/unet.py:90) ]]
0 successful operations.
0 derived errors ignored.
Errors may have originated from an input operation.
Input Source operations connected to node conv2d_7/Conv2D:
strided_slice_3 (defined at /lib/python3.7/site-packages/spleeter/model/init.py:195)
Input Source operations connected to node conv2d_7/Conv2D:
strided_slice_3 (defined at /lib/python3.7/site-packages/spleeter/model/init.py:195)
Original stack trace for 'conv2d_7/Conv2D':
File "/bin/spleeter", line 8, in
sys.exit(entrypoint())
File "/lib/python3.7/site-packages/spleeter/main.py", line 47, in entrypoint
main(sys.argv)
File "/lib/python3.7/site-packages/spleeter/main.py", line 41, in main
entrypoint(arguments, params)
File "/lib/python3.7/site-packages/spleeter/commands/separate.py", line 178, in entrypoint
output_naming=output_naming)
File "/lib/python3.7/site-packages/spleeter/commands/separate.py", line 132, in process_audio
for sample in prediction:
File "/lib/python3.7/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 619, in predict
features, None, ModeKeys.PREDICT, self.config)
File "/lib/python3.7/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1146, in _call_model_fn
model_fn_results = self._model_fn(features=features, **kwargs)
File "/lib/python3.7/site-packages/spleeter/model/init.py", line 392, in model_fn
return builder.build_predict_model()
File "/lib/python3.7/site-packages/spleeter/model/init.py", line 334, in build_predict_model
output_dict = self._build_output_dict()
File "/lib/python3.7/site-packages/spleeter/model/init.py", line 130, in _build_output_dict
self._params['model']['params'])
File "/lib/python3.7/site-packages/spleeter/model/functions/unet.py", line 173, in unet
return apply(apply_unet, input_tensor, instruments, params)
File "/lib/python3.7/site-packages/spleeter/model/functions/init.py", line 26, in apply
params=params)
File "/lib/python3.7/site-packages/spleeter/model/functions/unet.py", line 90, in apply_unet
conv1 = conv2d_factory(conv_n_filters[0], (5, 5))(input_tensor)
File "/lib/python3.7/site-packages/tensorflow/python/keras/engine/base_layer.py", line 634, in call
outputs = call_fn(inputs, *args, **kwargs)
File "/lib/python3.7/site-packages/tensorflow/python/keras/layers/convolutional.py", line 196, in call
outputs = self._convolution_op(inputs, self.kernel)
File "/lib/python3.7/site-packages/tensorflow/python/ops/nn_ops.py", line 1079, in call
return self.conv_op(inp, filter)
File "/lib/python3.7/site-packages/tensorflow/python/ops/nn_ops.py", line 635, in call
return self.call(inp, filter)
File "/lib/python3.7/site-packages/tensorflow/python/ops/nn_ops.py", line 234, in call
name=self.name)
File "/lib/python3.7/site-packages/tensorflow/python/ops/nn_ops.py", line 1953, in conv2d
name=name)
File "/lib/python3.7/site-packages/tensorflow/python/ops/gen_nn_ops.py", line 1071, in conv2d
data_format=data_format, dilations=dilations, name=name)
File "/lib/python3.7/site-packages/tensorflow/python/framework/op_def_library.py", line 788, in _apply_op_helper
op_def=op_def)
File "/lib/python3.7/site-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
return func(*args, **kwargs)
File "/lib/python3.7/site-packages/tensorflow/python/framework/ops.py", line 3616, in create_op
op_def=op_def)
File "/lib/python3.7/site-packages/tensorflow/python/framework/ops.py", line 2005, in init
self._traceback = tf_stack.extract_stack()

I'm not a dev here, but this looks like the kind of error you might get if you didn't have the right CUDA/cuDNN installed for TF 1.14.

 Closing.
We will soon provide a ready to use GPU version from conda forge.

@Faylixe I've looked around, and I might have missed it, but is the GPU version of spleeter ready from conda forge yet?

Never mind. I still haven't figured out why I can't GPU split.

I used pip. Something like this:
tensorflow-gpu==1.14.0
pandas==0.25.1
requests
pip
museval==0.3.0
musdb==0.3.1
norbert==0.2.1
spleeter
ffmpeg-python

Make sure you already have python 3.7 and ffmpeg installed

@aolney are those pip commands? How do I apply those things to my system?

Write them to a text file (requirements.txt) and then do a pip install - r
requirements.txt
I'll try creating a conda yaml and see how it goes
On Wed, 04 Dec 2019, 16:55 aidv<EMAIL_ADDRESS>wrote:

@aolney https://github.com/aolney are those pip commands? How do I
apply those things to my system?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/deezer/spleeter/issues/60?email_source=notifications&email_token=AHLHSDP7EKPWMW2QMJIUIEDQW7HGLA5CNFSM4JLAW7IKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEF5PUJQ#issuecomment-561707558,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AHLHSDKC5X5RFHRU53L4ZJDQW7HGLANCNFSM4JLAW7IA
.

@swissbeats93 @aolney  it seems to work Nice!!!!!!!!!!!

Not for me yet, I have Cuda 10.0 and Cuda 10.1 so there's some conflict there I guess

TF 1.14 aligns with CUDA 10.0, see this page.
Here's more information about installing TF.
You can build TF from source if you want to (first link) and use alternative CUDA versions.
However, If I were you, I'd purge CUDA and install version 10.0, which is appropriate for TF (first link) as well as Pytorch.

I'll look into that when I have some time, it's quite busy for me at the moment or I might just wait for 20.04 LTS and fix everything then

I did the Cuda 10.0 installation for those reasons but it was after I had already set up 10.1, everything else works on my system except for when I test spleeter-gpu. I'll try testing spleeter on my development environment and see if it works

I don't remember exactly what I tried prior to your suggestions, but I do remember that I

Uninstalled Cuda 10.1

Installed TF 1.14 from Conda shell using the following instrunction:  https://www.tensorflow.org/install/gpu

Update: I just tested it now after installing spleeter-gpu from conda forge and it's working perfectly

Update: I just tested it now after installing spleeter-gpu from conda forge and it's working perfectly

how to install and use spleeter-gpu ? some commads like:"conda install -c conda-forge spleeter-gpu"?

I also meet the similar problem:
Node: 'conv2d/Conv2D' 2 root error(s) found.   (0) UNIMPLEMENTED: DNN library is not found.          [[{{node conv2d/Conv2D}}]]          [[strided_slice_21/_905]]   (1) UNIMPLEMENTED: DNN library is not found.          [[{{node conv2d/Conv2D}}]] 0 successful operations. 0 derived errors ignored.
the reason is: I create a new conda environment, and then pip install spleeter, The default downloaded version of TensorFlow==2.12, which just too high for my drive version.
so, first I pip install tensorflow==2.8.2, then pip install spleeter

export CUDA_VISIBLE_DEVICES="-1"


How to hide the Scroll bar for ScrollView Element..?

Need to hide that Scroll bar While Scrolling
Used

@JaganJonnala please notice that this repository is for login issues, bugs and features related to nativescript-angular. For how-to related question use the community channels like discourse.nativescript.org SO or Slack.
To disable the scroll you can take a look at the techniques discussed in  this forum thread or use this plugin which provides this functionality

Try this:
set a id to ScrollView like: adtsumscrl
@ViewChild('adtsumscrl') scrollview : ElementRef;
ngAfterViewInit() {
let scrollvie = this.scrollview.nativeElement;
    setTimeout(() => {
        if(isAndroid){
            scrollvie.android.setHorizontalScrollBarEnabled(false);
        }
        else if (isIOS) {
            scrollvie.ios.showsHorizontalScrollIndicator = false;
        }
    }, 10);
}


Make adsClientConnections not a global variable

Just a refactoring

@howardjohn: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-distroless-k8s-tests_istio
9de9fcf307121d517579c6056286acb972d18de5
link
/test integ-distroless-k8s-tests_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest

@howardjohn: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-pilot-local-tests_istio
9de9fcf307121d517579c6056286acb972d18de5
link
/test integ-pilot-local-tests_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

There is a data race

that's weird.. how can it be worse than it was before.. I'll take a look thanks

@howardjohn: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-local-tests_istio
dc65df39cd0e506363e5f485dcd8cee2695b2829
link
/test integ-local-tests_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest


How do you handle the editor cursor?

I love darker themese too, but I often can't see where the insertion cursor is. All the old hacks I tried stopped working in Xcode 9, do you have a solution or just go along with it?

Found the solution, works really well and cursor is super obvious now.
It uses Mousecape project, but the follow the steps in the link above as it contains the link to proper iBeam cursor to use.


UDP not receiving data, also missing settings?

UDPcomponent doesn't seem to create any listeners on the given port. Also tried with manually launching the Open Receive Socket, which successfully fires, but UDP does not start any port listeners. Can't send dummy packets to localhost/<IP_ADDRESS> etc. "Netstat -na" does not show any listening UDP ports on port "3002".
Also UDPcomponent doesn't seem like it has the same settings as the picture on the plugin's main page.
See attachments.

It appears that you're not adding your UDP component to an actor via Add component but as some variable. This is incorrect.
It should look something like this:


onLoad() never get called for exoplayer but if I use default player then only black screen with sound.

for version 5.2.1 if I use default player then video sometimes was playing but black screen only the audio was coming. but if I use exoplayer then onload() never get called.  I also tried to do manual linking but no progress.

version 5.2.1 is deprecated and is no longer supported - I encourage you to test v6

version 5.2.1 is deprecated and is no longer supported - I encourage you to test v6

But my react native version is 0.67.2

Unfortunately I can't do anything about it. It is recommended to update react-native https://github.com/reactwg/react-native-releases


Added displayFormat prop to change the text display of the selected dates

Hi @NoahMLoomis
Thank you for contributing.
Please pull the latest master and try to do this PR again.