Code : 2, Message: "unable to retrieve location", PERMISSION_DENIED:1,POSITION_UNAVAILABLE: 2. in IOS

Environment

Platforms

Versions

Android:
iOS:
react-native-geolocation:
react-native:
react:

Description

Code : 2, Message: "unable to retrieve location", PERMISSION_DENIED:1,POSITION_UNAVAILABLE: 2. in IOS simulator
Reproducible Demo

Any solution for this? i am also facing the same problem

Any solution??

Click your simulator then Select Features > Location > Custom Location

Thank you for your reply
On Fri, May 8, 2020 at 12:35 PM Ryan mark Supremo<EMAIL_ADDRESS>wrote:

Click your simulator then Select Features > Location > Custom Location
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/react-native-community/react-native-geolocation/issues/108#issuecomment-625671142,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AOGOMTMWI7225DC35L5IK73RQOVM7ANCNFSM4MUASDPQ
.

so this problem is just on simulator?

same problem on android device (not simulator)

any solution?, i have same problem on real android device

same problem on real android device

same problem on real ios device

Is this a common known issue? Why is this happening?

Try to toggle the location button by swiping down the notification tray.

@goodryanboy answer solved for me.

Click your simulator then Select Features > Location > Custom Location

{"code":3,"message":"Unable to fetch location within 30.0s.","PERMISSION_DENIED":1,"POSITION_UNAVAILABLE":2,"TIMEOUT":3} I have been getting this on ios, although it still gets the position

How can we use your code when it is not even reliable?
This is something that is hard to QA and even harder to solve!
I am out of RN after I am done with this APP! Garbage!

Same on iOS devices. Any idea when this can be fixed?

Same problem in ios emulator or real device. Any idea of how can we fix it?

Same issue in Android 10.  Unable to get the the location {"PERMISSION_DENIED":1,"POSITION_UNAVAILABLE":2,"TIMEOUT":3, "code":2, "message":"No location provider available"}

Click your simulator then Select Features > Location > Custom Location

I had success the iOS simulator after making sure a Custom Location was set (The default setting is None).
Perhaps making the error message a bit more descriptive than "No location provider available" could help steer people in that direction?

add the following to top of App.js:
let skipPermissionRequests = false
let config = { skipPermissionRequests }
import Geolocation from '@react-native-community/geolocation';
Geolocation.setRNConfiguration(config);

same issue with ios!

I am receiving this error on Android API 28 only. It works on API 29. Any idea why?

none whatsoever. sorry

On Sep 17, 2020, at 1:24 AM, Sabri Meviş<EMAIL_ADDRESS>wrote:
I am receiving this error on Android API 28 only. It works on API 29. Any idea why?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub https://github.com/react-native-community/react-native-geolocation/issues/108#issuecomment-693886421, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABGSMAQ3XJIQHNCSWLVGDNDSGGMPFANCNFSM4MUASDPQ.

I am receiving this error on Android API 28 only. It works on API 29. Any idea why?
{"PERMISSION_DENIED": 1, "POSITION_UNAVAILABLE": 2, "TIMEOUT": 3, "code": 3, "message": "Location req
uest timed out"}

Same issue i am facing as well , still not able to figure what actually issue is
Location is not working on these devices where it's working other devices .

hawaii p8 lite android Version 5
hawaii y7 prime

Permission
<uses-permission android:name="android.permission.ACCESS_FINE_LOCATION" />
React Native and lib version
"@react-native-community/geolocation": "^2.0.2",
"react-native": "0.62.2",

这个问题有人解决吗？

Only on the location of device then run again the app and select allow you have good to go

if not gone then add fine-access-location permission in AndroidManifest File

hawaii

SOLUTION
My location permission is working on every device
DONOT USE
@react-native-community/geolocation
I simply use react-native-geolocation-service and it start working on every device of android
Permission
<uses-permission android:name="android.permission.ACCESS_FINE_LOCATION" />
USE Library
https://github.com/Agontuk/react-native-geolocation-service

Getting the same error on windows electron platform when using ionic native plugin - https://github.com/apache/cordova-plugin-geolocation/issues/213

Working on android but same issue with iOS

anyone found any solution .??
its heck.

There doesn't seem to be any way to catch this error, it definitely occurs when a user denies permission.. But I too switched to react-native-geolocation-service, and found it properly returns a useable error. We'll see if there's any new issues that come along with it..

There doesn't seem to be any way to catch this error, it definitely occurs when a user denies permission.. But I too switched to react-native-geolocation-service, and found it properly returns a useable error. We'll see if there's any new issues that come along with it..

hawaii

SOLUTION
My location permission is working on every device
DONOT USE
@react-native-community/geolocation
I simply use react-native-geolocation-service and it start working on every device of android
Permission
<uses-permission android:name="android.permission.ACCESS_FINE_LOCATION" />
USE Library
https://github.com/Agontuk/react-native-geolocation-service

What about iOS  ?

I have the same problem on a real IOS device.

Software Version: <= 14.4 and 14.4.1 it’s working

Software Version: 14.4.2 it’s not working

Any solution?

please turn on gps or location :+1:

having same issue on real android device -
Error {"message":"Unable to retrieve location","code":2}
any update on this issue ?

Same issue here.

Try the following
return new Promise(resolve => {
    Geolocation.getCurrentPosition(
      position => {
        resolve(position);
      },
      err => resolve(err),
      {
        enableHighAccuracy: true,
        timeout: 15000,
        maximumAge: 10000,
      }
    );
  });

info.plist
NSLocationWhenInUseUsageDescription
NSLocationAlwaysUsageDescription
NSLocationAlwaysAndWhenInUseUsageDescription

AndroidManifest.xml
<uses-permission android:name="android.permission.ACCESS_COARSE_LOCATION" />
<uses-permission android:name="android.permission.ACCESS_FINE_LOCATION" />

enableHighAcuracy does not work on Android and times out. @matijagrcic

enableHighAcuracy does not work on Android and times out. @matijagrcic

You can try with https://github.com/Agontuk/react-native-geolocation-service#usage that's what I'm using.

I tried it but if timesout on iOS when "Allow once" is selected. Upon next app start the geolocation is not fetched, no permission dialog is shown, it just times out.
As for android the service requires me to have already asked for the user permission (which I expect the service itself to do!). How would I ask for permissions then?

My 2 cents: was stuck on this on physical iOS 17.5.1:
{"code":2,"message":"Unable to retrieve location.","PERMISSION_DENIED":1,"POSITION_UNAVAILABLE":2,"TIMEOUT":3}
If I enter the app's permissions and uncheck Precise Location it works.
Maybe these two NSLocationWhenInUseUsageDescription NSLocationAlwaysAndWhenInUseUsageDescription are not enough in Info.plist (I don't support iOS < 10 nor need location while app is in background so I shouldn't need NSLocationAlwaysUsageDescription  and the background capability thing)
If I discover how to grant precise location I will edit this comment


WKWebViewJavascriptBridge did not support Swift?

I used WebViewJavascriptBridge in my Xcode6.4 project(Swift),it is ok.
But when I tried to import WKWebViewJavascriptBridge in the same project,I got that compiler error:
Undefined symbols for architecture x86_64:
"OBJC_CLASS$_WKWebViewJavascriptBridge", referenced from:
__TMaCSo25WKWebViewJavascriptBridge in WKWebViewController.o
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)

I have the same issue. It works for UIWebView but WKWebView throws said error... :(

I'm seeing the same error on an Objective-C project in Xcode 7.0.1.  I was using WebViewJavascriptBridge fine with UIWebView, but when I tried to switch to WKWebViewJavascriptBridge for WKWebView, I started seeing this linker error.

Same issue here. Is there a workaround?

@rexpie I needed to move on and was able to drop iOS 7 support, so I personally switched to just using WKScriptMessage/WKScriptMessageHandler.

@dwieringa Okay thanks for that.
Hey I just worked out a way to get this right.
In file WKWebViewJavascriptBridge.h, find these lines:
#if (__MAC_OS_X_VERSION_MAX_ALLOWED > __MAC_10_9 || __IPHONE_OS_VERSION_MAX_ALLOWED > __IPHONE_7_1)
#define supportsWKWebKit
#endif

Then remove the #if #endif pair, just leave the #define supportsWKWebKit bit out. But make sure you are using iphone 7.1 or above or it won't support WKWebkit.

Hey guys,
WKWebView is only available in iOS 8 and later (https://developer.apple.com/library/ios/documentation/WebKit/Reference/WKWebView_Ref/).
I believe the problem you're seeing is due to attempting to use WKWebViewJavascriptBridge.h in iOS 7 when you should be using WebViewJavascriptBridge.h.
Feel free to reopen if you think I got it wrong.
Cheers!

See https://github.com/marcuswestin/WebViewJavascriptBridge/blob/master/Example Apps/ExampleSwiftApp-iOS/ExampleSwiftApp-iOSTests/ExampleSwiftApp_iOSTests.swift for working Swift unit tests that demonstrate usage.


Setting up CRU of CRUD for all the microservices

[x] Explain what this PR does

This PR is for getting all the basic functions working with the microservices BE. The D in CRUD is a little more complicated so another PR will have to handle that

[ ] Documentation updated (if needed)
[ ] Code reviewed by someone else on the team
[ ] PR is ready and can be merged (do not check this until all other boxes are checked)

CR works for the attachment service. This work now has to be replicated for the 3 other primary services (meetings, calendars, and participants).

This PR just requires review from someone else on the team before merging. @Lmd117 would you be able to do that?

I'm going to go ahead and merge because I need to move ahead with other tasks.


TLS handshake failure (after client-hello) with big_http_download sample

Describe the bug
A clear and concise description of what the bug is.
TLS handshake failure (after client-hello) with big_http_download sample
Please also mention any information which could help others to understand
the problem you're facing:

Target platform: native_posix
Captured the wireshark traces (attached here) and identified the 3-way handshake & TLS client-hello

To Reproduce
Steps to reproduce the behavior:

[terminal 1] Go to Zephyr tools folder & run "sudo ./net-setup.sh
[terminal 2] Compile: west build -b native_posix samples/net/sockets/big_http_download -p -- -DCONF_FILE="prj.conf overlay-tls.conf"
[terminal 2] run: west build -t run
[terminal 2] see the handshake error in the console

Expected behavior
TLS handshake should be successful and the TLS data communication should be started.
Impact
Major: Without HTTPS/TLS, we cannot proceed with our investigation.
Logs and console output
Uploaded wireshark traces -> tls-handshare-error.zip. Within this zip file, attached the following pcap files

tls.pcap -> contains full trace
tls-stream-3.pcap -> contains network trace relevant for this bug (TCP stream = 3)

Environment (please complete the following information):

OS: Linux (Ubuntu 20.04)
Toolchain: Zephyr version: 3.1.99; west version: 0.13.1
taken the 'big_http_download' sample

Additional context

Same behavior is seen, if we try to connect with any other HTTPS server.
If we disable TLS, the sample is able to download the file using HTTP.

tls-handshake-error.zip

Setting as medium for now, assignee / networking folks can downgrade if necessary

It seems to be a problem with the web server the sample uses, I've encountered the issue recently. Either the certificate has expired and we need to use a new one in the sample, or we need to find a new server to connect to.
@gokultv-private In a meantime, you could evaluate https://docs.zephyrproject.org/latest/samples/net/sockets/http_get/README.html, I see no issues with TLS communication with  the server used by that sample.
Given that the issue appears to be releated to an individual sample, not the TLS stack per se, I think we could lower the issue priority to low.

Thank you @rlubos . The http_get sample is working for me. This tells the core TLS library is not having any issue.
Interestingly, if I replace the http_get sample to connect our internal HTTPS server, we are seeing the same issue. I believe it is not to do with the certificate but with the default supported cipher suites from the client-side.
I've attached the following wireshark traces,

http_get_unmodified.pcap -> Unmodified http_get sample connecting to https://google.com:443 and it is working as expected.
http_get_modified_to_new_server.pcap -> Modified http_get sample to use new HTTPS server URL & cert. Not working.

http_get traces.zip
I'll debug further & share the updates tomorrow.

I believe it is not to do with the certificate but with the default supported cipher suites from the client-side.

The ciphersuites avaialble depend on the mbed TLS configuration (https://github.com/zephyrproject-rtos/zephyr/blob/main/modules/mbedtls/Kconfig.tls-generic), if you know exactly which ciphersuite is expcted from the client you can enable specific configs, otherwise you could try to enable everything (here's an example) and then optimize.
If you still see issues with the handshake after enabling the correct ciphersuite in mbed TLS, make sure the mbed TLS heap is large enough (CONFIG_MBEDTLS_HEAP_SIZE) the library is known to be a heavy heap user.

Thank you @rlubos . Once we enable all the cipher suites in mbedtls config, we are not seeing issues even with big_http_download!
But with our private server, when we connect we see the client_hello & server_hello, certificates - but after than the client is rejecting with the error 'bad certificate'.
Our private server's root certificate is from 'Entrust Root Certification Authority (G2)', serial num: 4a 53 8c 28, expiry: 12/7/2030 and downloaded the certificate from entrust_download_link . The downloaded certificate is converted to der using the command
openssl x509 -outform der -in entrust_g2_ca.cer -out entrust_g2_ca.der
I've attached the wireshark trace. Not sure what we are missing?
hget_privsrv_entrust_ca.zip

Did you set the hostname with TLS_HOSTNAME socket option accordingly? Note, that by default hostname verification is enabled and is a part of the certificate check (it must much the target certificate CN field). This check can be disabled by providing NULL pointer to the TLS_HOSTNAME socket option.
You can also try to enable mbed TLS logs (https://github.com/zephyrproject-rtos/zephyr/blob/main/tests/benchmarks/mbedtls/prj.conf#L10) to see what's going under the hood of mbed TLS (it should give a more specific information about the reason of the failure than the alert message).

Thank you very much @rlubos . I found the root-cause. The issue is our server's (target) certificate CN field is different from its hostname (found it via wireshark). Surprisingly, the Windows/Google-browser UI is showing the actual hostname (when compared to the wireshark & mbedtls logs).
Until, our IT team fixes this certificate issue, I'm disabling the hostname verification.
PS:- let me know if you want to raise a separate issue to fix the http_big_download sample.


Can we export data into csv instead of json

Can we export data into csv instead of json because when i am trying to convert csv from json it is given me error.

Just at the end of command "Get-UnifiedAuditLog" pipe it to ConvertFrom-Json.
For example:
Get-UnifiedAuditLog ... | ConvertFrom-Json -ErrorAction Continue


CASino not sending extra attributes at times

Hi,
In mi CAS client user model, I have cas_extra_attributes method for receiving these parameters from the server.
I have detected the following situation: Sometimes CASino is sending the roles (extra_attribute) as an empty array, and in the users DB the roles are there for sure.
I was wondering if this might be caused for one of these two:

Problems with associated attributes in the user model (Such as roles, these are managed in a separate application)
Problems with having multiple instances of the CAS server and clients
Ticket expirations problems?

Any help would be amazing.

So right now, I don't have any clue how this can happen. I saw several different configurations where the extra_attributes worked consistently well.
The only difference was that there was always only one CAS server (CASino), maybe it was running multiple instances through mod_passenger but it was always running on only one server.
Could you provide us the configuration you are using? Maybe also the XMLs request and response of the client<->server communication of such an empty array response.
Is it always the same user(s)? Or is this random?


Search by error tag does not work

Describe the bug
Filter "error=true" does not show traces with errors.
To Reproduce
Steps to reproduce the behavior:

Use clickhouse storage plugin
Run HotROD and produce some traces
In Jaeger UI select "Redis" service and find traces. Check that there are traces with errors in Redis service.
Add Tags filter "error=true"
See "No trace results. Try another query."

Expected behavior
Traces with Redis error found
Screenshots

Version (please complete the following information):

OS: windows
Jaeger version: 1.27
Deployment: docker-compose
Clickhouse plugin version: 0.8
Clickhouse version: yandex/clickhouse-server:21

What troubleshooting steps did you try?
Tag filter works as expected with another tags (e.g. "param.driverID").
Error tag filter works with Elasticsearch plugin.
I use that docker-compose to compare ELK and Clickhouse storages.

Same issue. http.status_code=200 works fine, error=true returns empty results. Tested with jaeger hotrod.

Root cause: there could be more than one tag with the same name in tags.key / tags.value columns of jaeger_index_local table but we only check the first occurrence of it. This is because we also serialize events (logs) into tags.* column.
So we end up with multiple "error" tag:
client-uuid=534bc4dfd268070c
driver_id=T762908C
error=redis timeout
error=true
...
span.kind=client

And only first value could be found because we use filter tags.value[indexOf(tags.key, ?)] == ?

Seems there is no easy way to get all array indexes of values so it's hard to check all tag values.
Should we really support searching for events (log) attributes?
We could either stop serialize them into tags columns or at least prefix with "event." to distinguish from boolean error tag.


How can I get ip from this memcached_servers.txt file myself?

How can I get ip from this memcached_servers.txt file myself?

https://github.com/MHProDev/MHDDoS/issues/25


Update for intl 0.18

Because dash_chat_2 0.0.15 depends on intl ^0.17.0 and no versions of dash_chat_2 match >0.0.15 <0.1.0, dash_chat_2 ^0.0.15 requires intl ^0.17.0.
So, because papplic depends on both intl ^0.18.0 and dash_chat_2 ^0.0.15, version solving failed.

Because dash_chat_2 0.0.15 depends on intl ^0.17.0 and no versions of dash_chat_2 match >0.0.15 <0.1.0, dash_chat_2 ^0.0.15 requires intl ^0.17.0.
So, because papplic depends on both intl ^0.18.0 and dash_chat_2 ^0.0.15, version solving failed.

👍

please update for intl 0.18

The same issue


Complement the _Dynamic.html feature with a Dynamic PageCode

At the moment, unknown urls are passed to the _Dynamic.html PageView but must be processed by a _Common PageCode.  The common pagecode must then check to see if an actual page has been requested rather than a dynamic one, before performing its dynamic processing.
It would be good if PHP.Gt treated _Common as normal (for all requests) but then called a _Dynamic pagecode if (and only if) this was a dynamic request.
If no _Dynamic PageCode or PageView exist, a 404 should still be thrown.

Can confirm this will be made as a feature soon.

Please see https://github.com/PhpGt/WebEngine/wiki/Dynamic-URIs-and-Pages for implementation documentation.


Updates react-fast-compare to get support for Preact

In 3.1.1 react-fast-compare added support for preact's internal data
structure when handling recursive objects so it now ignores those
correctly. This means the maximum call stack size exceeded issue
doesn't happen any longer.

It seems to be complaining about yarn.lock vs package-lock.json. Do I have to use yarn to update the dependency?

@esbenam I think so for now until we settle on a standard.

@cwelch5 it seems that did the trick. I have signed the CLA, but the CLAAssistant doesn't seem to pick up on it. Do I have to do anything else?

I can see you already have dependabot creating the same PR. Should I just close this on?

Thanks @esbenam , but I'll look at yours over the bots 😂 - you deserve the credit.  Let me give it a quick run through on my machine because it is a major upgrade of a core dependency.

Thank you @esbenam.
@cwelch5 Any idea when this is going to get into release? Many broken preact apps are waiting for this...

Released with 6.1.0.


Use now to deploy on my own server

Is there any documentation that will guide me to deploy my site on my own server using now and also I can use my DNS.

There's Up.

@HarshOB we are working on Universal Now and other exciting new additions to the Now product lineup in 2018 to address on-premise and beyond. Stay tuned!


Name input interrupted when entering "L"

Problem

When entering the key <l> during direct editing in DRD view the input is interrupted and the lasso tool gets activated.

Expected Behavior

[ ] <l> can be typed without canceling direct editing
[ ] single letter key bindings activate tools outside the scope of an editable input only

Cannot reproduce on Linux.

after further investigation I figured out that the character 'L' is not compatible with the name input.
Reason: by pressing 'l' the lasso tool will be activated
Solution: deactivate keyboard shortcuts while the user is in the name edit mode

Thanks for providing these additional details. I've update the description accordingly.
:cake:

As a workaround you can use the letter i uppercase (looks the same).

I cannot reproduce this in v1.16.0. Since the shortcuts are properly deactivated once you start editing a label you can't trigger any editor actions. This seems to make the code that prevents this in the BPMN and CMMN editor unnecessary.


Email, maybe a new one?

What do you think about conform's email?
https://github.com/leebenson/conform/blob/master/conform.go#L31-L51

I don't know if it's necessary TBH, what does manipulating only the domain portion give you if not extracting it?

I do not understand. Are you saying that checking that part is superfluous?
I'm trying to create something convenient for developers that corrects incorrect or inaccurate user input, e.g.:
<EMAIL_ADDRESS>-><EMAIL_ADDRESS>Because I know according to rfc5321, "The local-part of a mailbox MUST BE treated as case sensitive".
How would you do it?

I'm just not sure how this would be used? is all caps after the @ actually incorrect?


High number of SELECT queries on UM_USER_ATTRIBUTE table during token request

Is your suggestion related to an experience ? Please describe.
It was noticed that high number of SELECT queries (about ten) were executed during a one token generation when features like account lock, account disable and suspend idle account are enabled.
Two of these SELECT queries are intended for retrieving the user attributes for jwt token and id token generation. But rest of the SELECT queries are for retrieving the user claim values for the handlers like AccountLockHandler[1] and AccountDisableHandler[2].
Describe the improvement
During the analysis, we noticed that if we could optimise the code to reduce the number fo calls to the userStoreManager.getUserClaimValues() method for each time a claim value is required, we could greatly reduce the number of SELECT queries to the database.

The no of redundant DB calls used in AccountDisableHandler.java class not that significant to be refactored.
Therefore continueing with only the AccountLockHandler.java changes.


Add optional pv viewer to limit transfer speed

Emulates the feel for the output a bit. :)

LGTM 👍🏼


Add z-index to notifications so they always show up.

Right now, notifications do not show in ionic, as there are elements at higher z-indexes.

@jessamynsmith, thanks for the addition!

Thank you for a great package! Now I can use it in Ionic with less custom CSS :)


Separate Reference and Active Rule Lists

In Parser, store the reference rules and active rules in a different list to save on loop iterations when parsing. The lists should either be combined before passed into NestedRegexRules or be passed in as separate parameters. New ActiveRules and ReferenceRules properties should be added to Parser.

This effort is ongoing. Separating the lists should increase the speed of parsing due to not having to cycle through all the reference rules every time parsing, but tests indicate otherwise. Using a dictionary to associate a rule's name to its index to remedy some speed decreases from separating the lists didn't help with the speed decrease.

This may now be obsolete due to adding the tokenization layer and not having any reference rules included anymore.

Made obsolete by #76


Error on deploy stage of CICD Run

Good day...
As per Freddy, I am creating this as a new issue.
When running the CICD action on our AL-Go environment we get the following error:
Error: Deploying to QA failed.  Exception calling "GetResult" with "0" argument(s): "An error occurred while sending the request."
Error: Process completed with exit code 1.
We have two apps in the repo of which one is quite big, about 1.5mb.  The pipeline publishes this first (base) app but doesn't install it.
It errors before or while installing the app.
I am able to install the app from the Extension Management Page as well as publish and install the second app in the repo without issues.
The first run I did, this did work correctly....
Herewith a screenshot of the action:

Herewith the log:
Run<EMAIL_ADDRESS>  with:
    shell: powershell
    environmentName: QA
    artifactsFolder: .artifacts
    type: CD
    deploymentEnvironmentsJson: {"QA":{"companyId":"","EnvironmentType":"SaaS","ppEnvironmentUrl":"","Branches":[],"EnvironmentName":"QA","runs-on":["windows-latest"],"Projects":"*","continuousDeployment":null,"shell":"powershell","BranchesFromPolicy":[],"SyncMode":null}}
    token: ***
  env:
    workflowDepth: 1
    ALGoOrgSettings: {
      "useCompilerFolder": true,
      "doNotPublishApps": true
  }
    ALGoRepoSettings:
    type: PTE
    powerPlatformSolutionFolder:
    Settings: {"keyVaultCertificateUrlSecretName":"","microsoftTelemetryConnectionString":"InstrumentationKey=84bd9[2](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:2)23-67d4-4[3](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:3)78-8590-9e4a46023be2;IngestionEndpoint=https://westeurope-1.in.applicationinsights.azure.com/","type":"PTE","sendExtendedTelemetryToMicrosoft":false,"appBuild":[4](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:4)9,"installTestApps":[],"versioningStrategy":0,"installApps":[],"installTestLibraries":false,"runNumberOffset":0,"codeSignCertificatePasswordSecretName":"codeSignCertificatePassword","vsixFile":"","country":"w1","alDoc":{"continuousDeployment":false,"deployToGitHubPages":true,"maxReleases":3,"groupByProject":true,"includeProjects":[],"excludeProjects":[],"header":"Documentation for {REPOSITORY} {VERSION}","footer":"Documentation for \u003ca href=\"https://github.com/{REPOSITORY}\"\u003e{REPOSITORY}\u003c/a\u003e made with \u003ca href=\"https://aka.ms/AL-Go\"\u003eAL-Go for GitHub\u003c/a\u003e, \u003ca href=\"https://go.microsoft.com/fwlink/?linkid=2247728\"\u003eALDoc\u003c/a\u003e and \u003ca href=\"https://dotnet.github.io/docfx\"\u003eDocFx\u003c/a\u003e","defaultIndexMD":"## Reference documentation\\n\\nThis is the generated reference documentation for [{REPOSITORY}](https://github.com/{REPOSITORY}).\\n\\nYou can use the navigation bar at the top and the table of contents to the left to navigate your documentation.\\n\\nYou can change this content by creating/editing the **{INDEXTEMPLATERELATIVEPATH}** file in your repository or use the alDoc:defaultIndexMD setting in your repository settings file (.github/AL-Go-Settings.json)\\n\\n{RELEASENOTES}","defaultReleaseMD":"## Release reference documentation\\n\\nThis is the generated reference documentation for [{REPOSITORY}](https://github.com/{REPOSITORY}).\\n\\nYou can use the navigation bar at the top and the table of contents to the left to navigate your documentation.\\n\\nYou can change this content by creating/editing the **{INDEXTEMPLATERELATIVEPATH}** file in your repository or use the alDoc:defaultReleaseMD setting in your repository settings file (.github/AL-Go-Settings.json)\\n\\n{RELEASENOTES}"},"templateSha":"a6b2e468[5](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:5)79e02a31a9cc9a2ae178a1e6beadf00","partnerTelemetryConnectionString":"","doNotRunTests":false,"enableCodeAnalyzersOnTestApps":false,"runs-on":"windows-latest","generateDependencyArtifact":false,"excludeEnvironments":[],"keyVaultCertificatePasswordSecretName":"","rulesetFile":"","licenseFileUrlSecretName":"licenseFileUrl","enableExternalRulesets":false,"memoryLimit":"","keyVaultClientIdSecretName":"","testFolders":[],"githubRunner":"windows-latest","doNotBuildTests":false,"environments":[],"companyName":"","assignPremiumPlan":false,"artifact":"","ghTokenWorkflowSecretName":"ghTokenWorkflow","enableTaskScheduler":false,"enableCodeCop":false,"repoVersion":"1.2","doNotPublishApps":true,"unusedALGoSystemFiles":[],"githubRunnerShell":"powershell","appFolders":["base","MUR CRM"],"cacheKeepDays":3,"bcptTestFolders":[],"updateDependencies":false,"cacheImageName":"my","powerPlatformSolutionFolder":"","treatTestFailuresAsWarnings":false,"additionalCountries":[],"enableUICop":false,"customCodeCops":[],"appDependencies":[],"doNotRunBcptTests":false,"skipUpgrade":false,"appDependencyProbingPaths":[],"useCompilerFolder":true,"installTestFramework":false,"keyVaultCodesignCertificateName":"","keyVaultName":"","obsoleteTagMinAllowedMajorMinor":"","applicationDependency":"<IP_ADDRESS>","applicationInsightsConnectionStringSecretName":"applicationInsightsConnectionString","shell":"powershell","deliverToAppSource":{"mainAppFolder":"","productId":"","includeDependencies":[],"continuousDelivery":false},"failOn":"error","templateUrl":"https://github.com/microsoft/AL-Go-PTE@main","projects":[],"projectName":".","testDependencies":[],"appRevision":0,"codeSignCertificateUrlSecretName":"codeSignCertificateUrl","configPackages":[],"useProjectDependencies":false,"appSourceCopMandatoryAffixes":[],"buildModes":[],"templateBranch":"","installPerformanceToolkit":false,"pullRequestTrigger":"pull_request_target","doNotSignApps":false,"repoName":"MUR-Business-Central","fullBuildPatterns":[],"alwaysBuildAllProjects":false,"installOnlyReferencedApps":true,"installTestRunner":false,"adminCenterApiCredentialsSecretName":"adminCenterApiCredentials"}
    Secrets: {"AuthContext":"***","QA-AuthContext":"","QA_AuthContext":"","QA-EnvironmentName":"","QA_EnvironmentName":"","EnvironmentName":"","projects":""}
Run $errorActionPreference = "Stop"; $ProgressPreference = "SilentlyContinue"; Set-StrictMode -Version 2.0
  $errorActionPreference = "Stop"; $ProgressPreference = "SilentlyContinue"; Set-StrictMode -Version 2.0
  try {
    D:\a\_actions\microsoft\AL-Go-Actions\v5.2\Deploy/Deploy.ps1 -token $ENV:_token -environmentName $ENV:_environmentName -artifactsFolder $ENV:_artifactsFolder -type $ENV:_type -deploymentEnvironmentsJson $ENV:_deploymentEnvironmentsJson
  }
  catch {
    Write-Host "::ERROR::Unexpected error when running action. Error Message: $($_.Exception.Message.Replace("`r",'').Replace("`n",' ')), StackTrace: $($_.ScriptStackTrace.Replace("`r",'').Replace("`n",' <- '))";
    exit 1
  }
  shell: C:\Windows\System32\WindowsPowerShell\v1.0\powershell.EXE -command ". '{0}'"
  env:
    workflowDepth: 1
    ALGoOrgSettings: {
      "useCompilerFolder": true,
      "doNotPublishApps": true
  }
    ALGoRepoSettings:
    type: PTE
    powerPlatformSolutionFolder:
    Settings: {"keyVaultCertificateUrlSecretName":"","microsoftTelemetryConnectionString":"InstrumentationKey=84bd9223-[6](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:6)7d4-4378-8590-9e4a46023be2;IngestionEndpoint=https://westeurope-1.in.applicationinsights.azure.com/","type":"PTE","sendExtendedTelemetryToMicrosoft":false,"appBuild":49,"installTestApps":[],"versioningStrategy":0,"installApps":[],"installTestLibraries":false,"runNumberOffset":0,"codeSignCertificatePasswordSecretName":"codeSignCertificatePassword","vsixFile":"","country":"w1","alDoc":{"continuousDeployment":false,"deployToGitHubPages":true,"maxReleases":3,"groupByProject":true,"includeProjects":[],"excludeProjects":[],"header":"Documentation for {REPOSITORY} {VERSION}","footer":"Documentation for \u003ca href=\"https://github.com/{REPOSITORY}\"\u003e{REPOSITORY}\u003c/a\u003e made with \u003ca href=\"https://aka.ms/AL-Go\"\u003eAL-Go for GitHub\u003c/a\u003e, \u003ca href=\"https://go.microsoft.com/fwlink/?linkid=224[7](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:7)728\"\u003eALDoc\u003c/a\u003e and \u003ca href=\"https://dotnet.github.io/docfx\"\u003eDocFx\u003c/a\u003e","defaultIndexMD":"## Reference documentation\\n\\nThis is the generated reference documentation for [{REPOSITORY}](https://github.com/{REPOSITORY}).\\n\\nYou can use the navigation bar at the top and the table of contents to the left to navigate your documentation.\\n\\nYou can change this content by creating/editing the **{INDEXTEMPLATERELATIVEPATH}** file in your repository or use the alDoc:defaultIndexMD setting in your repository settings file (.github/AL-Go-Settings.json)\\n\\n{RELEASENOTES}","defaultReleaseMD":"## Release reference documentation\\n\\nThis is the generated reference documentation for [{REPOSITORY}](https://github.com/{REPOSITORY}).\\n\\nYou can use the navigation bar at the top and the table of contents to the left to navigate your documentation.\\n\\nYou can change this content by creating/editing the **{INDEXTEMPLATERELATIVEPATH}** file in your repository or use the alDoc:defaultReleaseMD setting in your repository settings file (.github/AL-Go-Settings.json)\\n\\n{RELEASENOTES}"},"templateSha":"a6b2e46[8](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:8)579e02a31a9cc[9](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:9)a2ae178a1e6beadf00","partnerTelemetryConnectionString":"","doNotRunTests":false,"enableCodeAnalyzersOnTestApps":false,"runs-on":"windows-latest","generateDependencyArtifact":false,"excludeEnvironments":[],"keyVaultCertificatePasswordSecretName":"","rulesetFile":"","licenseFileUrlSecretName":"licenseFileUrl","enableExternalRulesets":false,"memoryLimit":"","keyVaultClientIdSecretName":"","testFolders":[],"githubRunner":"windows-latest","doNotBuildTests":false,"environments":[],"companyName":"","assignPremiumPlan":false,"artifact":"","ghTokenWorkflowSecretName":"ghTokenWorkflow","enableTaskScheduler":false,"enableCodeCop":false,"repoVersion":"1.2","doNotPublishApps":true,"unusedALGoSystemFiles":[],"githubRunnerShell":"powershell","appFolders":["base","MUR CRM"],"cacheKeepDays":3,"bcptTestFolders":[],"updateDependencies":false,"cacheImageName":"my","powerPlatformSolutionFolder":"","treatTestFailuresAsWarnings":false,"additionalCountries":[],"enableUICop":false,"customCodeCops":[],"appDependencies":[],"doNotRunBcptTests":false,"skipUpgrade":false,"appDependencyProbingPaths":[],"useCompilerFolder":true,"installTestFramework":false,"keyVaultCodesignCertificateName":"","keyVaultName":"","obsoleteTagMinAllowedMajorMinor":"","applicationDependency":"<IP_ADDRESS>","applicationInsightsConnectionStringSecretName":"applicationInsightsConnectionString","shell":"powershell","deliverToAppSource":{"mainAppFolder":"","productId":"","includeDependencies":[],"continuousDelivery":false},"failOn":"error","templateUrl":"https://github.com/microsoft/AL-Go-PTE@main","projects":[],"projectName":".","testDependencies":[],"appRevision":0,"codeSignCertificateUrlSecretName":"codeSignCertificateUrl","configPackages":[],"useProjectDependencies":false,"appSourceCopMandatoryAffixes":[],"buildModes":[],"templateBranch":"","installPerformanceToolkit":false,"pullRequestTrigger":"pull_request_target","doNotSignApps":false,"repoName":"MUR-Business-Central","fullBuildPatterns":[],"alwaysBuildAllProjects":false,"installOnlyReferencedApps":true,"installTestRunner":false,"adminCenterApiCredentialsSecretName":"adminCenterApiCredentials"}
    Secrets: {"AuthContext":"***","QA-AuthContext":"","QA_AuthContext":"","QA-EnvironmentName":"","QA_EnvironmentName":"","EnvironmentName":"","projects":""}
    _token: ***
    _environmentName: QA
    _artifactsFolder: .artifacts
    _type: CD
    _deploymentEnvironmentsJson: {"QA":{"companyId":"","EnvironmentType":"SaaS","ppEnvironmentUrl":"","Branches":[],"EnvironmentName":"QA","runs-on":["windows-latest"],"Projects":"*","continuousDeployment":null,"shell":"powershell","BranchesFromPolicy":[],"SyncMode":null}}
Downloading BcContainerHelper latest version from Blob Storage
Import from C:\ProgramData\BcContainerHelper\6.0.19\BcContainerHelper\BcContainerHelper.ps1
BcContainerHelper version 6.0.19
BC.HelperFunctions emits usage statistics telemetry to Microsoft
Running on Windows, PowerShell 5.1.20348.2400
project '*'
Apps to deploy
D:\a\MUR-Business-Central\MUR-Business-Central\.artifacts\MUR-Business-Central-main-Apps-<IP_ADDRESS>
Attempting authentication to https://api.businesscentral.dynamics.com/user_impersonation offline_access using refresh token...
Authenticated using refresh token as user
EnvironmentUrl:
Publishing apps using development endpoint
InstalledApps:
- a190e87b-2f59-4e14-a727-421877802768 API - Cross Environment Intercompany 24.1.18927.19633 'Global' True Microsoft
- a2cc2ef8-949f-43d4-45b8-[10](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:10)bd6f8bc62c API Reports - Finance 24.1.18927.19633 'Global' True Microsoft
- c1335042-3002-4257-bf8a-75c898ccb1b8 Application 24.1.18927.19633 'Global' True Microsoft
- a41b0c3e-bf1c-4c97-ad1b-b430a3933ada Audit File Export 24.1.18927.19633 'Global' True Microsoft
- 63c9fbe6-d4f3-458c-8c25-644c90a0874a Bank Account Reconciliation With AI 24.1.18927.19633 'Global' True Microsoft
- 437dbf0e-84ff-417a-965d-ed2bb9650972 Base Application 24.1.18927.21045 'Global' True Microsoft
- 6992416f-3f39-4d3c-8242-3fff61350bea Business Central Cloud Migration - Previous Release 24.1.18927.19633 'Global' True Microsoft
- 57623bfa-0559-4bc2-ae1c-0979c29fc8d1 Business Central Cloud Migration API 24.1.18927.19633 'Global' True Microsoft
- 334ef79e-547e-4631-8ba1-7a7f18e14de6 Business Central Intelligent Cloud 24.1.18927.19633 'Global' True Microsoft
- f3552374-a1f2-4356-848e-196002525837 Business Foundation 24.1.18927.21045 'Global' True Microsoft
- 5a0b41e9-7a42-4123-d521-2265186cfb31 Contoso Coffee Demo Dataset 24.1.18927.19633 'Global' True Microsoft
- 7819d79d-feea-4f09-bbed-5bbaca4bf323 Data Archive 24.1.18927.19633 'Global' True Microsoft
- ac14293f-1eb7-4a7b-9936-b280da31970b Data Search 24.1.18927.19633 'Global' True Microsoft
- cc[11](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:11)c22e-5ca3-423f-8804-88cac6d91983 Dynamics BC Excel Reports 24.1.18927.19633 'Global' True Microsoft
- e1d97edc-c239-46b4-8d84-6368bdf67c8b E-Document Core 24.1.18927.19633 'Global' True Microsoft
- de0dddf3-9917-430d-8d20-6e7679a08500 E-Document Core Demo Data 24.1.18927.19633 'Global' True Microsoft
- d852a468-263e-49e5-bfda-f09e33342b89 E-Documents Connector with External Endpoints 24.1.18927.19633 'Global' True Microsoft
- 08d69832-9231-429e-be2c-8bab2c96905b Email - Current User Connector 24.1.18927.19633 'Global' True Microsoft
- aceb66c8-472e-437c-81d3-27e6c07d0f14 Email - Microsoft 365 Connector 24.1.18927.19633 'Global' True Microsoft
- e6328152-bb29-4664-9dae-3bc7eaae1fd8 Email - Outlook REST API 24.1.18927.21045 'Global' True Microsoft
- 8fc50dfb-d338-4fd9-9499-5e44cc8cbf50 Email - SMTP API 24.1.18927.19633 'Global' True Microsoft
- 68e13fa3-217a-4be0-9141-99e5bf0ca818 Email - SMTP Connector 24.1.18927.19633 'Global' True Microsoft
- e2ae191d-8829-44c3-a373-3749a2742d4e Enforced Digital Vouchers 24.1.18927.19633 'Global' True Microsoft
- 64c9d5e2-7744-4866-bc0e-5ebc2898e651 Error Messages with Recommendations 24.1.18927.19633 'Global' True Microsoft
- 2a89f298-7ffd-44a5-a7ce-e08dac98abce Essential Business Headlines 24.1.18927.19633 'Global' True Microsoft
- 0a9a9ce1-6f98-4cf0-82e2-0b3e7cabb32a EU 3-Party Trade Purchase 24.1.18927.19633 'Global' True Microsoft
- 58623bfa-0559-4bc2-ae1c-0979c29fd9e0 Intelligent Cloud Base 24.1.18927.19633 'Global' True Microsoft
- 709[12](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:12)191-3c4c-49fc-a1de-bc6ea1ac9da6 Intrastat Core 24.1.18927.19633 'Global' True Microsoft
- f5a24f0f-0e9d-41b6-a407-b3c83e4ca460 Jet Analytics for Business Central <IP_ADDRESS>01 'Global' True Jet Global Data Technologies
- 4aadc1a9-c361-4b86-a749-[13](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:13)9a492026a0 Jet Library for Business Central <IP_ADDRESS>1 'Global' True Jet Global Data Technologies
- bec4ca36-c7fb-4110-9db5-29559cc1f84c Jet Reports for Business Central <IP_ADDRESS>1 'Global' True Jet Global Data Technologies
- 862605d7-34e3-4efc-be90-225cd3bbed3c Konsolidator Financial Consolidation and Reporting 1.0.20230823.8 'Global' True Konsolidator A/S
- 3d5b2137-efeb-40[14](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:14)-8489-41d37f8fd4c3 Late Payment Prediction 24.1.18927.19633 'Global' True Microsoft
- 56368753-db13-4133-8bf0-6f246bba7a4a MUR Base Application <IP_ADDRESS> ' Dev' True MUR Shipping
- f7df6111-b187-4725-9cf9-bde0e4e949c4 MUR CRM <IP_ADDRESS> ' PTE' True MUR Shipping
- 64977288-facd-4b48-aaaa-bb0e288edfb3 Payment Practices 24.1.18927.19633 'Global' True Microsoft
- a53a4bb0-aa53-8ff8-77d6-fe3388db0eb8 Recommended Apps 24.1.18927.19633 'Global' True Microsoft
- 87990[15](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:15)3-0e35-4e5d-ba61-2e93077d[16](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:16)99 Review General Ledger Entries 24.1.18927.19633 'Global' True Microsoft
- 4ce93371-6bd6-4027-a78f-021064ad250e SAF-T 24.1.18927.19633 'Global' True Microsoft
- c526b3e9-b8ca-4683-81ba-fcd5f6b1472a Sales and Inventory Forecast 24.1.18927.19633 'Global' True Microsoft
- dd3f226b-40bf-4b3c-9988-9b1e0f74edd8 Sales Lines Suggestions 24.1.18927.19633 'Global' True Microsoft
- e97bbbc7-16b6-470b-9428-376baa778970 Send remittance advice by email 24.1.18927.19633 'Global' True Microsoft
- 8c972578-fe72-4aa5-ae51-cc5575fef2ea Send To Email Printer 24.1.18927.19633 'Global' True Microsoft
- e2ae191d-8829-44c3-a373-3749a2742d4d Service Declaration 24.1.18927.19633 'Global' True Microsoft
- 79b1a79a-2f66-4736-bc1b-8abb3537eb51 Simplified Bank Statement Import 24.1.18927.19633 'Global' True Microsoft
- ea130081-c669-460f-a5f4-5dde14f03131 Statistical Accounts 24.1.18927.19633 'Global' True Microsoft
- b3780cd9-f8f8-4a83-a4d5-0c2ad87b28af Sustainability 24.1.18927.19633 'Global' True Microsoft
- a0673989-48a4-48a0-95[17](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:17)-499c9f4037d3 Sustainability Contoso Coffee Demo Dataset 24.1.[18](https://github.com/MURShippingDevelopment/MUR-Business-Central/actions/runs/9708858294/job/26796939168#step:7:18)927.19633 'Global' True Microsoft
- 63ca2fa4-4f03-4f2b-a480-172fef340d3f System Application 24.1.18927.20170 'Global' True Microsoft
- 7961e9dc-a8e5-49b1-839b-3a78803a4cb8 Troubleshoot FA Ledger Entries 24.1.18927.19633 'Global' True Microsoft
- 2654d7e7-9afd-4947-9e02-6bb8f3e0cd04 Universal Print Integration 24.1.18927.19633 'Global' True Microsoft
- c50a4bf0-db51-4ad2-88d5-fe2287da0eb8 VAT Group Management 24.1.18927.19681 'Global' True Microsoft
Checking dependencies in C:\Users\runneradmin\AppData\Local\Temp\8ad4f676-5bf1-4c12-88a1-26a8a23624a2\MUR Shipping_MUR Base Application_<IP_ADDRESS>.app
Replacing Package ID with new GUID
Publishing MUR Shipping_MUR Base Application_<IP_ADDRESS>.app to https://api.businesscentral.dynamics.com/v2.0/QA/dev/apps?SchemaUpdateMode=synchronize
Exception calling "GetResult" with "0" argument(s): "An error occurred while sending the request."
An error occurred while sending the request.
The underlying connection was closed: An unexpected error occurred on a receive.
Publish-BcContainerApp Telemetry Correlation Id: 09f93993-a897-4114-9dd5-e476667fc986
Error: Deploying to QA failed.  Exception calling "GetResult" with "0" argument(s): "An error occurred while sending the request."
Error: Process completed with exit code 1.
0s

Thanks very much...

Is this a very large app?
How much time does it take before it throws this error? (show timestamps)

It is quite large... about 1.5mb.
Looks like the deploy step takes 5 minutes and 8 seconds.

Or rather - it fails after 5 minutes and 8 seconds :-)
5 minutes = 300 seconds is a default timeout in many places.
But in this case, it should use an infiniteTimeOut during publish to dev endpoint (https://github.com/microsoft/navcontainerhelper/blob/b2410696c2c9ce68b63f3ef1a65c0c09d0c58ed1/AppHandling/Publish-NavContainerApp.ps1#L211)
If I can get the app and try this myself, I can troubleshoot and see where the timeout is - I haven't been able to repro this myself.

Yes :)
I just noticed that the app installed on the QA environment has scope of DEV.
I think this might be the issue... I am going to try to uninstall it and replace it manually with the PTE app and then run the pipeline again.  If this doesn't work, we can look at sending the app.

In the preview version of AL-Go, you can specify "scope": "PTE" in the deployment settings (released yesterday)
If it works with PTE, then we know we have a bug when deploying to dev endpoint - I might not be able to fix it though.

Ok... I'll see now if it works... on another note...  Does the CICD always re-install all apps or will it only install apps that were modified?  So if I do dev on another app in the repo that has a dependency on this large app, but I haven't modified the large app, will it re-install all apps in the repo, or just the app that I have modified?

When doing PTE install - it should check the version numbers before installing.
But - if the app is re-built - it gets re-installed.
If the app comes as a dependency from another repo (same version) - it should not be re-installed.
Hope that makes sense.

I tried to create a new QA DB and rerun the pipeline but it still has the same issue...    Can I mail you the app?

You can mail a download link to freddyk at microsoft dot com
I will contact you on email if I have further questions.
thanks

Any suggestions on where I can upload it?

An attachment will probably be blocked.
A Onedrive link or maybe create a new private github repo, invite me (freddydk) and upload the binary (haven't tried that)

Ok thanks

Ok... I have shared two apps.... the one we are struggling with is the "Base Application".  The "CRM" application is dependent on the Base.  The CICD should publish both.

Thanks - what localization is your sandbox environment?

Everything's W1.

Your QA environment must be some kind of country right? you cannot install W1 in an online environment?

It runs in Ireland but is w1.

From: Freddy Kristiansen @.>
Sent: Tuesday, July 2, 2024 6:43:44 AM
To: microsoft/AL-Go @.>
Cc: Sarel du Plessis @.>; Author @.>
Subject: Re: [microsoft/AL-Go] Error on deploy stage of CICD Run (Issue #1124)
Your QA environment must be some kind of country right? you cannot install W1 in an online environment?
—
Reply to this email directly, view it on GitHubhttps://github.com/microsoft/AL-Go/issues/1124#issuecomment-2201902150, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BDA5V3QEKHHIRVICQMAMD2DZKIVYBAVCNFSM6AAAAABKBKUTYCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMBRHEYDEMJVGA.
You are receiving this because you authored the thread.Message ID: @.***>

It runs in Ireland but is W1.

My question is really - what do I need to select here:

W1 is not a country code.
I guess it is not GB - is it ZA?

You can select IE

Tried this - I am unable to reproduce this problem.
Furthermore - my publishing only takes 1-2 minutes and not 5 - have no idea why that can take so much time for you.
Do you have a very slow internet connection?

@MUR-SDP - FYI, I will be out on vacation for the next 15 days and won't be as responsive on this topic - I was unable to repro the problem, but will continue to look for reasons why this fails when back.

Thanks very much Freddy.  I will check our internet speeds.   We have a very fast connecrion but there has been many undersea cable issues between South Africa and the rest of the world lately that may still affect this.
I will also try different connections and let you know.
Our publish from VS Code to cloud sandbox also takes very long.
We are able to upload manually so please enjoy your holiday and thanks once again.

Hi Freddy, I don't expect replies until you are back but will post findings here in the meantime.
I have run the CICD from an Azure VM which would take all internet speed issues out of the picture, but the time was still over 5 minutes.  I then created a new QA Sandbox with Cronus data and it ran through instantly.... it seems using a copy of Production as a Sandbox contains too much data and lengthens the publishing process which then times out at 5 minutes.  I suppose there's no way to increase the timeout so the only option is to scale down the database....
I'll have a look if I publish to a production environment if that changes things...  anyway... I will close this one...
Thanks again for your awesome support...

@freddydk Just an update... it seems the issue was due to permissions on my App Registration.  The permission sets assigned to the Entra App in BC was only for one company and this caused the pipelines to fail.  All running fine now.
Thanks

Thanks for the info


[BUG] Repository Plugins Broken after XContent Base Clase Refactor

Describe the bug
Looks like Refactor XContent base classes from xcontent to core library  broke the installation of the repository plugins.
To Reproduce
Steps to reproduce the behavior:

Start with snapshot 2.7.0 based on after commit cb402cb867d05dc6e33a7b19f8d95548cfb3d445
Try to install a repo plugin opensearch-plugin install file:repository-s3-2.7.0.zip or opensearch-plugin install file:repository-azure-2.7.0.zip
You'll get an exception on installation:

Exception in thread "main" java.lang.NoClassDefFoundError: org/opensearch/core/xcontent/ToXContentFragment
	at java.base/java.lang.ClassLoader.defineClass1(Native Method)
	at java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1012)
	at java.base/java.security.SecureClassLoader.defineClass(SecureClassLoader.java:150)
	at java.base/jdk.internal.loader.BuiltinClassLoader.defineClass(BuiltinClassLoader.java:862)
	at java.base/jdk.internal.loader.BuiltinClassLoader.findClassOnClassPathOrNull(BuiltinClassLoader.java:760)
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClassOrNull(BuiltinClassLoader.java:681)
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:639)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:520)
	at org.opensearch.cli.CommandLoggingConfigurator.configureLoggingWithoutConfig(CommandLoggingConfigurator.java:54)
	at org.opensearch.cli.Command.main(Command.java:98)
	at org.opensearch.common.settings.KeyStoreCli.main(KeyStoreCli.java:56)
Caused by: java.lang.ClassNotFoundException: org.opensearch.core.xcontent.ToXContentFragment
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:520)

Expected behavior
A clear and concise description of what you expected to happen.
Plugins
Please list all plugins currently enabled.
Screenshots
If applicable, add screenshots to help explain your problem.
Host/Environment (please complete the following information):

OS: [e.g. iOS]
Version [e.g. 22]

Additional context
Add any other context about the problem here.

@dgilling Is the plugin built locally as well?
Tagging @nknize as well.

Yes, this was built locally using opensearchstaging/ci-runner:ci-runner-centos7-opensearch-build-v2. I could also be doing something as well wrong. However, the flow worked fine up until [this commit](cb402cb867d05dc6e33a7b19f8d95548cfb3d445](https://github.com/opensearch-project/OpenSearch/commit/cb402cb867d05dc6e33a7b19f8d95548cfb3d445). Reverting to previous one fixes the issue.

I attempted to build OpenSearch and the 2 plugins from 2.x branch directly with Gradle command, and the native plugins can be installed properly, although I didn't use the docker image you mentioned.
./gradlew :distribution:archives:linux-tar:assemble
./gradlew :plugins:repository-s3:assemble
./gradlew :plugins:repository-azure:assemble

bin/opensearch-plugin install file:///home/user/Downloads/opensearch/2.7.0/repository-s3-2.7.0-SNAPSHOT.zip
-> Installing file:///home/user/Downloads/opensearch/2.7.0/repository-s3-2.7.0-SNAPSHOT.zip
-> Downloading file:///home/user/Downloads/opensearch/2.7.0/repository-s3-2.7.0-SNAPSHOT.zip
[=================================================] 100%
...

Continue with installation? [y/N]y
-> Installed repository-s3 with folder name repository-s3

My fault, after looking at it, my Dockerfile missed including the updated opensearch-cli jar


Implement try/except with keyboard interrupt on demo notebooks?

I would consider using the kill switch function I created on the kill-switch branch instead since I think this may have a few advantages, although the tradeoffs must be weighed before settling on a solution.
A potential disadvantage of this could be that if defined as a single key the experiment could be inadvertently stopped by unrelated keyboard use (I haven't tested implementing hotkey combinations, though it seems like a straightforward way of mitigating this).
The advantages of using the kill switch I made are that:

It can be set to any key(s) in an intuitive way.
It appears simpler/more professional and perhaps is more straightforward for those unfamiliar with coding.
It is not dependent on using ctrl+c which is a hotkey that has other potentially unwanted interactions with other programs.
It is convenient and can be easily used with or without plotting to stop experiments at a moment's notice.
It offers clear assurance to experimenters that they can stop their experiment at any time.

Example of an experiment set up and stopped using custom pyscan kill-switch:

Both solutions work more or less in the same way, but with different tradeoffs.

If not plotting simply use expt.run() instead of try: except keyboardinterrupt: statements. Ensure that this does kill the experiment, and document this better to help users understand how to stop their experiments mid run. This is important for experimenters to feel safe running their experiments and to know that their instruments will be protected.


[Bug]: Copyright declaration doesn't work with Babel translation

Describe the bug
When upgrading to 72.1.0, I updated the copyrightDeclaration to have a text parameter as required. When doing so, the copyright section doesn't look to be rendering the Copyright symbol or the break.

It looks as though the copyright declaration doesn't work correctly with the Babel translation function when it's surrounding text e.g 'copyright': _('Crown copyright and database rights 2020 OS 100019153.').  We need to keep this function in to keep the Welsh translations on the page. The page gets translated correctly but those symbols and break aren't rendered still.

Expected behaviour / outcome
Expected behavoiour is for the copyright declaration to work as expected with the Babel translation and render both the copyright symbol and break.
List the steps necessary to reproduce the bug
Pass the copyright declaration string using gettext translation system and you should be able to replicate it.
Additional context
From looking into the _macro.njk for the Footer, it looks like the string concatenation used is not working correctly when its got the _() passed into it.
{% set copyrightDeclaration = '© ' + params.copyrightDeclaration.copyright + '
 ' + params.copyrightDeclaration.text %}

I've had a play around with the code and managed to get it working in a couple of ways. The first was by replacing the + with the ~ operator. In Jinja, this is the recommended way to string concatenation. https://jinja.palletsprojects.com/en/stable/templates/#math I'm not sure if this is the correct way for Nunjucks, so this might not be the best solution.
{% set copyrightDeclaration = '© ' ~ params.copyrightDeclaration.copyright ~ '
 ' ~ params.copyrightDeclaration.text %}

Another way to do it would be passing all the values in as a list and doing a join on it then. I found this way online when looking into Nunjucks' string concatenation.
{% set copyrightDeclaration = ['© ', params.copyrightDeclaration.copyright,'
 ', params.copyrightDeclaration.text] | join %}

What version of the ONS Design System are you using?
72.1.0
What device(s) are you using?
Desktop
What operating system(s) are you using?
macOS
What browser(s) are you using?
Chrome

hello @ryangrundy7 , Thank you for raising this issue. We will contact you shortly once we resolve it.


docker ps -s is way too slow

I'm just sitting here on a server with a full disk, and I have trouble doing anything about it since docker ps -s is already running since ~20 minutes. (50GB HDD, so not that much it could reasonably take forever) I have 6 actively running containers, so not THAT many.
This is way too slow to make it useful in any sort of non-trivial environment.
Edit: it doesn't even give a progress indication or output the info for the containers it has already crawled..

Hi!
Please read this important information about creating issues.
If you are reporting a new issue, make sure that we do not have any duplicates already open. You can ensure this by searching the issue list for this repository. If there is a duplicate, please close your issue and add a comment to the existing issue instead.
If you suspect your issue is a bug, please edit your issue description to include the BUG REPORT INFORMATION shown below. If you fail to provide this information within 7 days, we cannot debug your issue and will close it. We will, however, reopen it if you later provide the information.
This is an automated, informational response.
Thank you.
For more information about reporting issues, see https://github.com/docker/docker/blob/master/CONTRIBUTING.md#reporting-other-issues

BUG REPORT INFORMATION
Use the commands below to provide key information from your environment:
docker version:
docker info:
uname -a:
Provide additional environment details (AWS, VirtualBox, physical, etc.):
List the steps to reproduce the issue:
1.
2.
3.
Describe the results you received:
Describe the results you expected:
Provide additional info you think is important:
----------END REPORT ---------
#ENEEDMOREINFO

Docker version: Docker version 1.8.3, build f4bf5c7
uname -a: Linux cyberman 4.2.3-200.fc22.x86_64+debug #1 SMP Thu Oct 8 03:09:19 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

Hi JonasT, can you provide output of docker info?

Here it is. Interestingly, the image count seems wrong by a lot and I'm right now having issues with the containers barely using up 7gb in docker ps -s but a 50gb disk being full. Is this some gross deleted-but-not-really-deleted docker bug?
root@Ubuntu-1404-trusty-64-minimal ~ # docker info
Containers: 7
Images: 139
Storage Driver: btrfs
Execution Driver: native-0.2
Logging Driver: json-file
Kernel Version: 3.13.0-65-generic
Operating System: Ubuntu 14.04.3 LTS
CPUs: 2
Total Memory: 1.955 GiB
Name: Ubuntu-1404-trusty-64-minimal
ID: ERML:VEZB:Z3JD:IPJW:BNMM:NYIS:VLGE:TEDW:46AI:EYDU:AGB3:W7E2
WARNING: No swap limit support
root@Ubuntu-1404-trusty-64-minimal ~ # docker images
REPOSITORY              TAG                 IMAGE ID            CREATED             VIRTUAL SIZE
ipv6test_test           latest              28ebe28eb002        5 days ago          210.6 MB
icecast2_icecast2       latest              1f88080f67b8        2 weeks ago         394.2 MB
informationnode_nginx   latest              2d5db40ec5f0        3 weeks ago         295.5 MB
chat_irssi              latest              1d50ad411bd8        3 weeks ago         296.5 MB
nginx_nginx             latest              918ea4c7d1b0        5 weeks ago         274.4 MB
my_nginx_test           latest              a66f93e71af5        6 weeks ago         274.4 MB
blah_nginx_test         latest              a66f93e71af5        6 weeks ago         274.4 MB
deleteme                latest              1b38ca017ea1        9 weeks ago         274.4 MB
ircdatheme_atheme       latest              c80492cbacac        4 months ago        474.4 MB
ircdcharybdis_ircd      latest              3c561d9db790        4 months ago        431 MB
mumble_mumble           latest              1327b6af6afa        4 months ago        291.7 MB
ubuntu                  latest              07f8e8c5e660        6 months ago        188.3 MB
root@Ubuntu-1404-trusty-64-minimal ~ #```

@JonasT to see all the images you would have to use the -a flag. You might have a whole lot of dangling images (you can see that with the dangling filter).

Doesn't seem like it, and the -a image count somewhat seems to line up with 139 so I guess everything is alright there. Sorry for the distraction, we should probably keep this bug report focussed on the issue of docker ps -s being horribly slow.
Anyway, here's the output (without and with dangling filter):
root@Ubuntu-1404-trusty-64-minimal /var # docker images -a
REPOSITORY              TAG                 IMAGE ID            CREATED             VIRTUAL SIZE
ipv6test_test           latest              28ebe28eb002        5 days ago          210.6 MB
<none>                  <none>              769dec746921        5 days ago          210.6 MB
<none>                  <none>              47e23980116b        5 days ago          210.6 MB
<none>                  <none>              92adbec91db3        5 days ago          209.5 MB
icecast2_icecast2       latest              1f88080f67b8        2 weeks ago         394.2 MB
<none>                  <none>              c78ca26cf6bf        2 weeks ago         394.2 MB
<none>                  <none>              79ec86c56796        2 weeks ago         394.2 MB
<none>                  <none>              84b6cf37be8b        2 weeks ago         394.2 MB
<none>                  <none>              c41e1bb834e4        2 weeks ago         394.2 MB
<none>                  <none>              ff766991760b        2 weeks ago         390.7 MB
informationnode_nginx   latest              2d5db40ec5f0        3 weeks ago         295.5 MB
<none>                  <none>              d0ed41396a6b        3 weeks ago         295.5 MB
<none>                  <none>              56374c7b4a15        3 weeks ago         295.5 MB
<none>                  <none>              c6a13818c7a4        3 weeks ago         295.5 MB
<none>                  <none>              a28489bdb7a3        3 weeks ago         295.5 MB
<none>                  <none>              67ff22b84b75        3 weeks ago         295.5 MB
<none>                  <none>              ef244f0eb0cb        3 weeks ago         295.5 MB
<none>                  <none>              c9606ecd1b9b        3 weeks ago         295.5 MB
<none>                  <none>              1f031448dd8c        3 weeks ago         295.5 MB
<none>                  <none>              ebfb3b8b2cb8        3 weeks ago         295.5 MB
<none>                  <none>              fded1f6ba026        3 weeks ago         295.5 MB
<none>                  <none>              99b985a1de33        3 weeks ago         287.7 MB
<none>                  <none>              c0d654983791        3 weeks ago         280 MB
<none>                  <none>              97f3c17dd359        3 weeks ago         272.2 MB
<none>                  <none>              8e0edca5f1a6        3 weeks ago         272.2 MB
chat_irssi              latest              1d50ad411bd8        3 weeks ago         296.5 MB
<none>                  <none>              6bdf6191791e        3 weeks ago         296.5 MB
<none>                  <none>              ea274d1b1d53        3 weeks ago         296.5 MB
<none>                  <none>              2d0124258fb5        3 weeks ago         296.5 MB
<none>                  <none>              2fc647e0ddfe        3 weeks ago         296.5 MB
<none>                  <none>              edc4078e0ee6        3 weeks ago         296.5 MB
<none>                  <none>              0419edf35cd6        3 weeks ago         296.5 MB
<none>                  <none>              97777f62215f        3 weeks ago         296.5 MB
<none>                  <none>              ab937899b311        3 weeks ago         296.5 MB
<none>                  <none>              1b49ee8b3f50        3 weeks ago         296.5 MB
<none>                  <none>              82389f350a9e        3 weeks ago         296.5 MB
<none>                  <none>              7c9132ba0325        3 weeks ago         254.1 MB
<none>                  <none>              5fb776012525        3 weeks ago         254.1 MB
<none>                  <none>              f08a54766bc6        3 weeks ago         254.1 MB
<none>                  <none>              c224f21a2bd4        3 weeks ago         254.1 MB
<none>                  <none>              50beaa782d18        3 weeks ago         253.8 MB
<none>                  <none>              20d71c4228a2        3 weeks ago         239.9 MB
<none>                  <none>              5950fcba817e        3 weeks ago         269.8 MB
nginx_nginx             latest              918ea4c7d1b0        5 weeks ago         274.4 MB
<none>                  <none>              ebf874efbb9c        5 weeks ago         274.4 MB
<none>                  <none>              fb97aa2e2efa        5 weeks ago         274.4 MB
<none>                  <none>              5f5fa4b2af05        5 weeks ago         274.4 MB
<none>                  <none>              14bf43f6c5d9        5 weeks ago         274.4 MB
<none>                  <none>              bd8a3eee82ab        5 weeks ago         274.1 MB
blah_nginx_test         latest              a66f93e71af5        6 weeks ago         274.4 MB
my_nginx_test           latest              a66f93e71af5        6 weeks ago         274.4 MB
<none>                  <none>              98d4b39dfb32        9 weeks ago         269.5 MB
<none>                  <none>              2c0ebaa2ff0f        9 weeks ago         269.5 MB
<none>                  <none>              ec50003b48ba        9 weeks ago         269.5 MB
deleteme                latest              1b38ca017ea1        9 weeks ago         274.4 MB
ircdatheme_atheme       latest              c80492cbacac        4 months ago        474.4 MB
<none>                  <none>              a48da368dd02        4 months ago        474.4 MB
<none>                  <none>              0b1e43d1c9b5        4 months ago        474.4 MB
<none>                  <none>              2b3dab94b389        4 months ago        474.4 MB
<none>                  <none>              bdb950e8cd92        4 months ago        474.4 MB
<none>                  <none>              93eccfc2bcad        4 months ago        474.4 MB
<none>                  <none>              c8b157e282ed        4 months ago        474.4 MB
<none>                  <none>              ed723287ff14        4 months ago        474.4 MB
<none>                  <none>              30a311f4fd45        4 months ago        474.4 MB
<none>                  <none>              b09fd5f73d74        4 months ago        474.4 MB
<none>                  <none>              323c2c3fe125        4 months ago        474.4 MB
<none>                  <none>              cbdfce6fdd08        4 months ago        474.4 MB
ircdcharybdis_ircd      latest              3c561d9db790        4 months ago        431 MB
<none>                  <none>              d652afe28ab2        4 months ago        431 MB
<none>                  <none>              2ad3e97e6234        4 months ago        431 MB
<none>                  <none>              8d77a398dfe7        4 months ago        431 MB
<none>                  <none>              8eeb0347e519        4 months ago        431 MB
<none>                  <none>              d4c545796f03        4 months ago        431 MB
<none>                  <none>              942a08142d5e        4 months ago        431 MB
<none>                  <none>              004f97b3bac1        4 months ago        431 MB
<none>                  <none>              513608ddabd7        4 months ago        431 MB
<none>                  <none>              d1fe829d91fb        4 months ago        431 MB
<none>                  <none>              7450fa66fa70        4 months ago        431 MB
<none>                  <none>              405261652cbb        4 months ago        431 MB
<none>                  <none>              bd900ef25093        4 months ago        431 MB
<none>                  <none>              77c27d31a243        4 months ago        431 MB
<none>                  <none>              07233890e503        4 months ago        431 MB
<none>                  <none>              323335be7de4        4 months ago        431 MB
<none>                  <none>              a4671060f758        4 months ago        431 MB
<none>                  <none>              714525fbefdd        4 months ago        431 MB
<none>                  <none>              6619212fec09        4 months ago        431 MB
<none>                  <none>              caa1dfd3cff8        4 months ago        431 MB
<none>                  <none>              65264c3e7c52        4 months ago        431 MB
<none>                  <none>              5f6a8ff6e875        4 months ago        431 MB
<none>                  <none>              fde3e4177d86        4 months ago        431 MB
<none>                  <none>              69c0dc209336        4 months ago        435.9 MB
<none>                  <none>              21c9a5bfaf74        4 months ago        431 MB
<none>                  <none>              751514db795b        4 months ago        411.9 MB
<none>                  <none>              0b7348439a3b        4 months ago        431 MB
<none>                  <none>              a247104bc1e3        4 months ago        431 MB
<none>                  <none>              6df5098cd905        4 months ago        408 MB
<none>                  <none>              68efd2ed4035        4 months ago        405 MB
<none>                  <none>              553c5caf9201        4 months ago        384.8 MB
<none>                  <none>              a5cff538dc24        4 months ago        384.8 MB
<none>                  <none>              c829ae64e3d4        4 months ago        384.5 MB
<none>                  <none>              0843a9ce8866        4 months ago        400.4 MB
<none>                  <none>              28436df9cc92        4 months ago        384.3 MB
<none>                  <none>              85b4947cf531        4 months ago        380.6 MB
<none>                  <none>              ee393379517c        4 months ago        256.7 MB
<none>                  <none>              59da6e9d03c5        4 months ago        364.4 MB
<none>                  <none>              b32498122fb1        4 months ago        364.4 MB
<none>                  <none>              bcafa8d1e7ff        4 months ago        364.1 MB
<none>                  <none>              be07601a56e3        4 months ago        199.9 MB
<none>                  <none>              0be94e739464        4 months ago        199.9 MB
mumble_mumble           latest              1327b6af6afa        4 months ago        291.7 MB
<none>                  <none>              f8b57b87ed32        4 months ago        291.7 MB
<none>                  <none>              50f2bb0b2033        4 months ago        291.7 MB
<none>                  <none><PHONE_NUMBER>a6        4 months ago        291.7 MB
<none>                  <none>              361dbe3ba526        4 months ago        291.4 MB
<none>                  <none>              858bba0540b3        4 months ago        239.6 MB
<none>                  <none>              9bdef6bad030        5 months ago        237.3 MB
<none>                  <none>              48a0dca633c2        5 months ago        274.4 MB
<none>                  <none>              05d59cdfb346        5 months ago        274.4 MB
<none>                  <none>              b2c8c5999dd1        5 months ago        274.4 MB
<none>                  <none>              70e3051ed995        5 months ago        274.4 MB
<none>                  <none>              62db8844aba9        5 months ago        274.1 MB
<none>                  <none>              598a56d7089b        5 months ago        273.8 MB
<none>                  <none>              4650414f1b25        5 months ago        273.8 MB
<none>                  <none>              6214c1d9dc43        5 months ago        273.8 MB
<none>                  <none>              c177cd71013f        5 months ago        273.8 MB
<none>                  <none>              7fa31b054c82        5 months ago        273.8 MB
<none>                  <none>              29abf98f5dbd        5 months ago        273.8 MB
<none>                  <none>              ee5f69865c5a        5 months ago        273.4 MB
<none>                  <none>              15a449a8b2cd        5 months ago        273.4 MB
<none>                  <none>              27d642e6c29f        5 months ago        269.1 MB
<none>                  <none>              1c282b982e71        5 months ago        390.7 MB
<none>                  <none>              6e8a918758d0        5 months ago        390.7 MB
<none>                  <none>              b482198cc1d0        5 months ago        371.5 MB
<none>                  <none>              7c2861e8908d        5 months ago        230.3 MB
<none>                  <none>              e58376068a09        5 months ago        229.9 MB
<none>                  <none>              670f5fc73c72        5 months ago        228.4 MB
<none>                  <none>              37bea4ee0c81        6 months ago        188.3 MB
ubuntu                  latest              07f8e8c5e660        6 months ago        188.3 MB
<none>                  <none>              a82efea989f9        6 months ago        188.3 MB
<none>                  <none>              e9e06b06e14c        6 months ago        188.1 MB
root@Ubuntu-1404-trusty-64-minimal /var # docker images --filter "dangling=true"
REPOSITORY          TAG                 IMAGE ID            CREATED             VIRTUAL SIZE
root@Ubuntu-1404-trusty-64-minimal /var #

Symptoms are similar to Issue #17720

docker ps with -s flag will show the size of the container and calculate the size of a container would take a long time, it will walk all the file of the container filesystem to get the total size.

Yes docker ps was quick. So I opened this bug report mainly because the size calculation takes really long. It would be nice if there was found some way to speed this up, e.g. by caching various parts of it or something.

The size calculation of docker ps -s needs to be faster so that monitoring against containers on hosts can be run. It would be nice if some optimization could be done here.
I use the API to get SizeRw but the result takes longer than the maximum timeout allowed by our monitoring tools.

There was remote call to registry in docker ps -s codepath. We've fixed it and now it's fast.

[ec2 ~]$ time docker ps -as
CONTAINER ID        IMAGE                            CREATED             STATUS                        PORTS                            SIZE
4068b9f3478b        application:2da8152              11 minutes ago      Up 9 minutes                  4400/tcp                         176.8 kB (virtual 397.8 MB)
470ec6ac4681        application:2da8152              14 minutes ago      Exited (143) 10 minutes ago                                    328 kB (virtual 398 MB)
efad214289d5        application:ff6cac5              17 minutes ago      Exited (0) 16 minutes ago                                      4.448 kB (virtual 1.314 GB)
bcc17908d05c        application:f11a6ef              18 minutes ago      Exited (0) 16 minutes ago                                      3.911 kB (virtual 862.7 MB)
2a89e36275e3        application:2da8152              23 minutes ago      Exited (1) 22 minutes ago                                      425 B (virtual 397.6 MB)
77153c48d4d0        application:ff6cac5              23 minutes ago      Exited (0) 21 minutes ago                                      4.801 kB (virtual 1.314 GB)
03320b0a31f3        application:2da8152              23 minutes ago      Exited (1) 22 minutes ago                                      425 B (virtual 397.6 MB)
254039a675c5        application:ff6cac5              27 minutes ago      Exited (0) 25 minutes ago                                      0 B (virtual 1.314 GB)
78af58136db4        application:ff6cac5              27 minutes ago      Exited (0) 26 minutes ago                                      4.79 kB (virtual 1.314 GB)
35fdbb9b0882        application:ff6cac5              27 minutes ago      Exited (0) 25 minutes ago                                      4.303 kB (virtual 1.314 GB)
8b914525f0f8        application:ff6cac5              33 minutes ago      Exited (0) 32 minutes ago                                      0 B (virtual 1.314 GB)
4e41e8865ee5        application:ff6cac5              33 minutes ago      Exited (0) 32 minutes ago                                      4.508 kB (virtual 1.314 GB)
a223e147e86d        application:f11a6ef              34 minutes ago      Exited (0) 33 minutes ago                                      3.963 kB (virtual 862.7 MB)
95f9167844d8        application:fd6ef2e              42 minutes ago      Up 42 minutes                                                  0 B (virtual 1.37 GB)
9c46d23a832c        gliderlabs/logspout              45 minutes ago      Up 45 minutes                 80/tcp, <IP_ADDRESS>:7273->7273/tcp   0 B (virtual 15.24 MB)
2603e2b75129        titpetric/netdata                45 minutes ago      Up 45 minutes                 <IP_ADDRESS>:19999->19999/tcp         26.76 MB (virtual 284 MB)
cb7cd4cbeed9        amazon/amazon-ecs-agent:latest   46 minutes ago      Up 46 minutes                                                  0 B (virtual 10.75 MB)

real	1m17.379s
user	0m0.012s
sys	0m0.004s

@LK4D4  If it's resolved can you locate the commit so I can track it?

@blaines sorry, it was resolved just for ps. I'm reopening an issue. Pls provide your docker info. Thanks!
It's probably super fast for me because I'm on SSD disk and using overlay2. I tried to run ~30 containers from "heavy" images and created ~20k files in some of them. docker ps -as was less than a millisecond.

@LK4D4 ah okay thanks! I'm using AWS so here's some instance details as well:
AMI ID
amzn-ami-2016.03.i-amazon-ecs-optimized (ami-1ccd1f7c)

Instance type
r3.xlarge

Also I'm using the SSD instance store attached as the docker data volume.
Docker Info:
[ec2 ~]$ docker info
Containers: 4
 Running: 4
 Paused: 0
 Stopped: 0
Images: 7
Server Version: 1.11.2
Storage Driver: devicemapper
 Pool Name: docker-docker--pool
 Pool Blocksize: 524.3 kB
 Base Device Size: 21.47 GB
 Backing Filesystem: ext4
 Data file:
 Metadata file:
 Data Space Used: 5.532 GB
 Data Space Total: 79.64 GB
 Data Space Available: 74.1 GB
 Metadata Space Used: 2.163 MB
 Metadata Space Total: 83.89 MB
 Metadata Space Available: 81.72 MB
 Udev Sync Supported: true
 Deferred Removal Enabled: true
 Deferred Deletion Enabled: true
 Deferred Deleted Device Count: 0
 Library Version: 1.02.93-RHEL7 (2015-01-28)
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: bridge null host
Kernel Version: 4.4.19-29.55.amzn1.x86_64
Operating System: Amazon Linux AMI 2016.03
OSType: linux
Architecture: x86_64
CPUs: 4
Total Memory: 29.96 GiB
Name: ip-172-31-14-182
ID: 2WPR:DIJG:DAEO:3O6L:ONQV:JUKM:I7Y3:HPM4:QYY3:VGST:5SM3:GLTT
Docker Root Dir: /var/lib/docker
Debug mode (client): false
Debug mode (server): true
 File Descriptors: 61
 Goroutines: 91
 System Time: 2016-10-18T22:56:31.198975034Z
 EventsListeners: 2
Registry: https://index.docker.io/v1/

I'm not sure there is a way we can speed this up.
For everything but aufs and overlay2, in order to get the size the entire container fs tree must be walked.

A speedup will most likely not happen. Faster storage if someone wishes to speed up docker ps -s.

FWIW, we're using du to get volume sizes. It's faster than the --size flag:
sudo bash -c 'du -hs /var/lib/docker/volumes/*'

Let me close this ticket for now, as it looks like it went stale.


How to download PEM key from keyvault in usable format

I have a PEM key stored in the Azure Keyvault that I need to be able to download and use as a pem key as part of a build process (it requires the use of a decryption tool that requires the cert be a local file, it doesn't support getting it from Azure) and the download secret commands just create a backup file that isn't in a usable format.

@sshorkey Thank you very much for your interest in Azure cloud services. You should be able to use the Get-Certificate and Get-Key operations form the Azure Key Vault REST API. See: Keys, secrets, certificates, and storage accounts

How do I do this from the command line?

Is the information here what you are looking for?  https://github.com/MicrosoftDocs/azure-docs/issues/14761

^ I tried following the solution described in there:

az keyvault secret download --file <mySecretCert.pem> --encoding base64 --name --vault-name
which can be converted to proper format using openssl:
openssl pkcs12 -in <mySecretCert.pem> -out <mycert.pem> -nodes

However it didn't work. It failed with:

139798825731328:error:0D0680A8:asn1 encoding routines:asn1_check_tlen:wrong tag:../crypto/asn1/tasn_dec.c:1129:
139798825731328:error:0D07803A:asn1 encoding routines:asn1_item_embed_d2i:nested asn1 error:../crypto/asn1/tasn_dec.c:289:Type=PKCS12

The error you are getting generally occurs when you have an invalid certificate format. Make sure your file has no trailing or leading spaces within the certificate file.
Example of a good file:
-----BEGIN CERTIFICATE----- MIICuTCCAiKgAwIBAgIDbuoZMA0GCSqGSIb3DQEBBAUAMIGHMQswCQYDVQQGEwJa QTEiMCAGA1UECBMZRk9SIFRFU1RJTkcgUFVSUE9TRVMgT05MWTEdMBsGA1UEChMU VGhhd3RlIENlcnRpZmljYXRpb24xFzAVBgNVBAsTDlRFU1QgVEVTVCBURVNUMRww GgYDVQQDExNUaGF3dGUgVGVzdCBDQSBSb290MB4XDTAyMDkyNDE5NTUwNloXDTAy MTAxNTE5NTUwNlowgZMxCzAJBgNVBAYTAlpBMRkwFwYDVQQIExBXZXN0ZXJuIFBy b3ZpbmNlMRIwEAYDVQQHEwlDYXBlIFRvd24xITAfBgNVBAoTGFRoYXd0ZSBUZWNo bmljYWwgU3VwcG9ydDEUMBIGA1UECxMLVGVjaFN1cHBvcnQxHDAaBgNVBAMUE3d3 dy5hYmNfdGVzdGluZy5jb20wgZ8wDQYJKoZIhvcNAQEBBQADgY0AMIGJAoGBAMuN /mLi6PEFx6P3dibCBJJ6Nq4FA48ixFkyIWXDuFTfZhmO0n0KQLEzDX1tPOIurl5V +LEDaBCEpDqujlsguyThE4xohcsxZaETfJmcvF5VeO7nCGqipD5/3m5tOVdBKgci BDSWPv2RSTNZyMJv3D7VcJdLxS6noQQSr34ErtchAgMBAAGjJTAjMBMGA1UdJQQM MAoGCCsGAQUFBwMBMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQEEBQADgYEAH+WV TAmzN9R62oTkfKSaByHYd4wZzMwWul/upElyW49GHcEKOB+QnoMj3iWmN01BCeVQ b5OI7uvf+MH/slU/RvwqB10eBeeZF6mCXgejNu+M9qaEqVEE+8yk2Grdl6H0IH8S Sd1WBGXaVUwWMQmjniZyP4mJDkJu+zcA9pts1BA= -----END CERTIFICATE-----
Also, make sure that you have proper .pem file extensions.
https://knowledge.digicert.com/solution/SO20401.html

We will now proceed to close this thread. Since this is a troubleshooting question and not a document feedback, please move any additional questions to MSDN and I will gladly continue the discussion. https://social.msdn.microsoft.com/Forums/en-US/home?forum=WindowsAzureAD

For those running into this from a web search, two notes:

Looks like the formatting on line endings were corrupted in the reply above; a proper certificate should have newlines between the -----DELIMITERS-----, i.e.:
-----BEGIN CERTIFICATE-----
MIICuTCCAiKgAwIBAgIDbuoZMA0GCSqGSIb3DQEBBAUAMIGHMQswCQYDVQQGEwJa
...
Sd1WBGXaVUwWMQmjniZyP4mJDkJu+zcA9pts1BA=
-----END CERTIFICATE-----

The format of the file downloaded using az keyvault secret download will vary depending on if you uploaded a certificate, or requested the creation of one within keyvault itself. The former downloads as PFX (which can downloaded as base64 encoding on the AzCLI, and the latter downloads as PEM natively with ascii encoding from the AzCLI.


Add CAN-bus commands support

Hello Oscar,
In our project we needed the Odrive with 500Kb CAN-bus support. So for the test purpose I added a simple interface to handle ODrive commands coming over the CAN-bus. It supports position/velocity and current set commands, nothing else (see README for details). I thing it should be enough for the most of the cases. Debug printfs still can be done via USB/UART.
Should you have any questions, you can post them either here or address me via Skype: fancer.lancer

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Hi fancer,
Thanks so much for your contribution, implementing basic CAN support is very valuable.
I will do a more in depth review within a few days, but in the mean time, can you please do the following?

[ ] Please target the madcowswe:devel branch
[ ] I would suggest that you make your PR from a branch which isn't your master branch. The reason is that if you end up making other unrelated changes to your master branch , these would get sucked into the PR. So making a dedicated branch for the PR is recommended.
[ ] Please resolve any new merge conflicts when you retarget to madcowswe:devel.

Again, thanks so much!

Alright, I'll switch the target branch then. Alas I can't change the source branch without recreating the PR. The fork was created for just CAN interface development anyway, so I didn't need a separate branch in the first place. I merged all the changes with master yesterday, the new conflicts are related with last day commits. Ok, I'll fix them.

Done.
Regarding the new alterations. I ported my changes in accordance with your USB-event-handler pattern IRQ->DisableIRQ->ReleaseSem->UnblockTask->HandleData->EnableIRQ. In future I'd suggest to move from such pattern either to IRQ->RecvData->PutToQueue->UnblockTask->HandleData, or IRQ-less pattern like RecvData->HandleData. It would let us to get free of IRQ-Enable/Disable calls, which in case of heavy traffic may lead to USB/CAN blocks Fifo overflow. And use just one structure for all incoming commands.
Additionally you added two new semaphores usage to synchronize access to the USB OTG. I don't know the whole reason of it, but according to my experience if one getting to use too many semaphores, it means something isn't right. I suppose we can use just one mutex to protect some critical section, so the write operation would be free of deadlock. I may be mistaken though...
-Sergey

@fancer Re the USB handling / semaphores / IRQ stuff - we had a long discussion about this while developing it.  Hop on our Discord and we'll be happy to explain our reasoning.  I'd also like to hear how you'd make it better!  I'm not exactly a USB expert, and it's my first time programming on a multithreaded system of any sort, so if you have suggestions that would be very helpful!
https://discord.gg/QKftWVc
I have a module I can use for injecting CAN messages and testing your PR, but it'll take me probably a week or so.  I assume it's been working well for you?

@Wetmelon
Yeh, the CAN interface is working well. I've used 8devices usb2can adapter together with Linux SocketCAN+canutils to test it out.


[Feature Request] option rightClosed for component date-picker with type datetimerange

Existing Component
是
Component Name
date-picker
Description
Hi, when we use date-picker with type datetimerange to choose a time range, it always confuses users in this way: they select date 01-01 to 01-02, and they got a range from 01-01 00:00 to 01-02 00:00.
The component implies that I've selected two days, while I got only one day long range. In most times, we want 01-01 00:00 to 01-02 23:59 when we select 01-01 to 01-02.
I suggest we add a option (for example, rightClosed, defaults to false) for date-picker to let it behaves as I described above. If you agree, I will create a pull request for that.

@wacky6 What do you think?

@wacky6 It's not about the use case to choose 01-01 00:00 - 01-02 23:59, but the default behavior on date-select for datetimerange.
We want to select a date-time range, while it's more reasonable to use the end (instead of the beginning) of the end date as default for end-users. You may not agree with the more reasonable part, but it will be better for developers being able to control this default behavior.

Add an option to control left and right panel's default time to pickerOptions?

@Leopoldthecoder
May also consider https://github.com/ElemeFE/element/issues/7618 , it's possible to not reset time to 00:00:00 when a date is picked (use modifyDate in handleRangePick)

@wacky6 I agree not to reset time on date-select. It's also how antd behaves.
Then it will be possible to control the time with initial time value.

I prefer to use a separate pickerOption (maybe default-time ?) for daterange panel to set the time after date pick:

If this option is not set, do not reset time
If this option is set, reset time to this value.
Should be an array, for left and right panels respectively (User may want 01-01 06:00 - 01-02 18:00 ?)

@Leopoldthecoder What do you think?

Any ideas? @Leopoldthecoder

Has any plan to solve this issue?

@Leopoldthecoder @wacky6 Any ideas about this? If we reach an agreement about the solution, I'll provide a PR for it.

Thanks for contributing.
I think you can PR a default-time in pickerOption for now.

Remember to write tests.
There should be a few edge cases.

May have to do fallbacks if used with a weird selectableRange combination.
Work properly/reasonably in daytime saving? (On the day of switching to/from DST)

Should have a default value that is consistent with current picker behavior. ['00:00:00', '00:00:00'] perhaps?
Do not reset time if set to null/undefined
May need to further discuss the property name of this feature.

There are helper functions in date-picker's util, try to reuse them.
These are what I can thought of at the moment, please comment below for more ideas.

@wacky6 Sure, thx.


couldn't wrap context-bound function or method (babel 6.* is used)

Hi,
Here I have a problem.
I try to wrap a class method inside a constructor, but my code is ES6+, I use async/await etc. I'm trying to wrap a method in that way:
Tick.wrap(this.method);

But then I have a problem - my this is undefined inside the method.
But even more: when I try
Tick.wrap(this.method.bind(this));

It doesn't wrap it at ll - console.log(t.timers) doesn't show me my method as wrapped, but an empty object.
Thanks in advance.

Sorry for the late reply! Holiday season here :)
Does your method accept a callback? Wrapping expects your method to call the first parameter as a callback when it is done.


Change default display mode

Hi,
is it possible to change the default mode for display settings of the alignment track?
Many thanks!

I'm not sure which settings you are referring to, but you can use the --track-config option and use any settings available in igv.js.    See the readme and  https://github.com/igvteam/igv.js/wiki for more information.


Add unit tests support

Now test are handled with NUnit, launched through dotnet-test-nunit.
Add this step to launcher.bat

It seems that at the moment breakpoints, which we set inside of NUnit test methods are not firing when launching debug from Visual Studio Code (more info https://github.com/nunit/dotnet-test-nunit/issues/73).
[9d87a17afa50abd9de75dc554850edb5ba8001f2] We switching to NUnitLite AutoRun, launched by '-debug' console argument (VSCode launch option provided for that). I suppose that we should rollback  when this matter is solved. Until then I'm gonna keep this issue open.


Add method isBetween(Instant, Instant) to AbstractDateAssert

Summary
I think it will be convenient to have in AbstractDateAssert method isBetween(start: Instant, end: Instant) because Data and Instant are the same in meaning (unix time moment). But it's more comfortable to calculate times as Instant and don't use Date.from() to convert.
Example
assertThat(validatingDate).isBetween(Instant.now().minusSeconds(2),  Instant.now().plusSeconds(2))

Would it be acceptable for you to convert your date to an instant and use: isBetween(java.time.Instant,java.time.Instant)?

Yes, I can convert validatingDate to Instant and use isBetween for Instant but then there's no need to have AbstractDateAssert in test framework because each Date could be converted to Instant and saved to variable.  :)  I think that the main reason to use assertj and to have AbstractDateAssert insight it is to help programmer to write code easier without his own boilerplate or thinking about such natural conversions. One more reason to have such methods (having Instant as parameter) in AbstractDateAssert is that Instant is an official replacement for Data and we must provide the ability to use new better API.

Fair enough.

I think, for completeness, I can contribute all such methods:
isEqualTo(Instant instant)
isEqualToIgnoringHours(Instant instant)
isEqualToIgnoringMinutes(Instant instant)
isEqualToIgnoringSeconds(Instant instant)
isEqualToIgnoringMillis(Instant instant)
isNotEqualTo(Instant instant)
isIn(Instant... instants)
isNotIn(Instant... instants)
isBefore(Instant other)
isBeforeOrEqualTo(Instant other)
isAfter(Instant instant)
isAfterOrEqualTo(Instant instant)
isBetween(Instant start, Instant end)
isBetween(Instant start, Instant end, boolean inclusiveStart, boolean inclusiveEnd)
isBetween(Instant start, Instant end, boolean inclusiveStart, boolean inclusiveEnd)
isNotBetween(Instant start, Instant end)
isInSameYearAs(Instant instant)
isInSameMonthAs(Instant instant)
isInSameDayAs(Instant instant)
isInSameHourWindowAs(Instant instant)
isInSameHourAs(Instant instant)
isInSameMinuteWindowAs(Instant instant)
isInSameMinuteAs(Instant instant)
isInSameSecondWindowAs(Instant instant)
isInSameSecondAs(Instant instant)
isCloseTo(Instant instant, long deltaInMilliseconds)
hasSameTimeAs(Instant instant)
usingInstantComparator(Comparator<? super Instant> customComparator)
usingInstantComparator(Comparator<? super Instant> customComparator, String customComparatorDescription)

Cool but let's do one thing at a time, let's start with isBetween and then we can move to do the other progressively, big PR are really hard to review as you often have the same issues being replicated.
I'm not sure what the usage for usingInstantComparator would be, the comparator is for actual (thus Date)

OK, I'm going to do isBetween

@ars-java I'm finishing this one

@joel-costigliola I think it's correct to integrate my implementation into main because I took this issue to resolve, the code already have been done and pull requests already have been created before you integrate your implementation.

Sorry @ars-java, I integrated some of your work and since you did not seem active on the issue I took over and informed you about it but then you raised new PRs the thing I had already quite advanced the work so integrated your PRs was more work than finishing the issue.
Don't worry I'll give you full credit for the issue in the release notes.


NumberFormatter options "decimalSeparator" and "orderSeparator" are ignored

Hi,
since 1.10, we are experiencing a nusiance while displaying integers in NumberFilters: they are always shown in groups separated by a default orderSeparator. Trying to overwrite this formatter option doesn't work, and I think the reason are the 3 added lines in the number-formatter.js, which reset any given parameter for both decimalSeparator and orderSeparator to the language default.
Perhaps moving those lines before the _.extend call could fix this issue.
Best regards,
@cawolf

Hi @cawolf
Thank you for reporting the issue! We greatly appreciate all contributions to Oro projects. We will do our best to fix the issue as soon as possible!