WARNING: No connection string, account key or sas token found

az feedback auto-generates most of the information requested below, as of CLI version 2.0.62

Describe the bug
I have old and new release pipelines failing on a Terraform CLI task for Command init.
deployment of state resources task YAML:
variables:
environment: 'test'
steps:

task: AzureResourceGroupDeployment@2
displayName: 'Release deployment state resources'
inputs:
azureSubscription: 'subscriptiondetials removed'
resourceGroupName: '$(names.prefix)-$(names.project)-deploy-rg'
location: '$(locations.primary)'
csmFile: '$(System.DefaultWorkingDirectory)\Resources$(paths.targets.publish.resources)\storage_account.template.json'
csmParametersFile: '$(System.DefaultWorkingDirectory)\Resources$(paths.targets.publish.resources)\storage_account.parameters.json'
overrideParameters: '-storage_account_name "deploymentstate"   -storage_account_location "$(locations.primary)"   -storage_account_tag_department "$(tags.department)"   -storage_account_tag_environment "$(environment)"   -storage_account_tag_project "$(tags.project) Deployment"   -storage_account_tag_owner "$(tags.owner)"   -storage_account_tag_resource "Storage Account"'

Terraform initialise task YAML:
variables:
environment: 'test'
steps:

task: charleszipp.azure-pipelines-tasks-terraform.azure-pipelines-tasks-terraform-cli.TerraformCLI@0
displayName: 'Terraform : initialize'
inputs:
command: init
workingDirectory: '$(System.DefaultWorkingDirectory)\Resources\publish\resources'
backendType: azurerm
backendServiceArm: 'subscription'
ensureBackend: true
backendAzureRmResourceGroupName: 'project-description-deploy-resource-group'
backendAzureRmResourceGroupLocation: '$(locations.primary)'
backendAzureRmStorageAccountName: 'deploystorageaccount'
backendAzureRmContainerName: deploymentstate
backendAzureRmKey: 'teststate'

here is the log for the failed task
2020-02-18T09:17:31.8884457Z ##[section]Starting: Terraform : initialize
2020-02-18T09:17:31.8972618Z ==============================================================================
2020-02-18T09:17:31.8972744Z Task         : Terraform CLI
2020-02-18T09:17:31.8972798Z Description  : Execute terraform cli commands
2020-02-18T09:17:31.8972868Z Version      : 0.4.19
2020-02-18T09:17:31.8972914Z Author       : Charles Zipp
2020-02-18T09:17:31.8972980Z Help         :
2020-02-18T09:17:31.8973040Z ==============================================================================
2020-02-18T09:17:32.5471249Z [command]C:\hostedtoolcache\windows\terraform\0.12.20\x64\terraform.exe version
2020-02-18T09:17:33.1308681Z Terraform v0.12.20
2020-02-18T09:17:33.1529307Z [command]C:\windows\system32\cmd.exe /D /S /C ""C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\wbin\az.cmd" login --service-principal -t *** -u *** -p "
2020-02-18T09:18:02.1665395Z [
2020-02-18T09:18:02.1665916Z   {
2020-02-18T09:18:02.1666106Z     "cloudName": "AzureCloud",
2020-02-18T09:18:02.1666354Z     "id": "removes id",
2020-02-18T09:18:02.1666541Z     "isDefault": true,
2020-02-18T09:18:02.1666728Z     "name": "removed subscribername",
2020-02-18T09:18:02.1666880Z     "state": "Enabled",
2020-02-18T09:18:02.1667160Z     "tenantId": "",
2020-02-18T09:18:02.1667321Z     "user": {
2020-02-18T09:18:02.1667502Z       "name": "***",
2020-02-18T09:18:02.1667659Z       "type": "servicePrincipal"
2020-02-18T09:18:02.1667825Z     }
2020-02-18T09:18:02.1667968Z   }
2020-02-18T09:18:02.1668126Z ]
2020-02-18T09:18:02.1896913Z [command]C:\windows\system32\cmd.exe /D /S /C ""C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\wbin\az.cmd" account set -s **"
2020-02-18T09:18:03.5257527Z [command]C:\windows\system32\cmd.exe /D /S /C ""C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\wbin\az.cmd" group create --name -content-deploy-rg --location northeurope"
2020-02-18T09:18:06.1804023Z {
2020-02-18T09:18:06.1804643Z   "id": "//resourceGroups/-content-deploy-rg",
2020-02-18T09:18:06.1804919Z   "location": "northeurope",
2020-02-18T09:18:06.1805902Z   "managedBy": null,
2020-02-18T09:18:06.1806101Z   "name": "-content-deploy-rg",
2020-02-18T09:18:06.1806271Z   "properties": {
2020-02-18T09:18:06.1806450Z     "provisioningState": "Succeeded"
2020-02-18T09:18:06.1806613Z   },
2020-02-18T09:18:06.1806787Z   "tags": null,
2020-02-18T09:18:06.1806953Z   "type": "Microsoft.Resources/resourceGroups"
2020-02-18T09:18:06.1807130Z }
2020-02-18T09:18:06.1994065Z [command]C:\windows\system32\cmd.exe /D /S /C ""C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\wbin\az.cmd" storage account show --name contentdeploysa --resource-group ****-****content-deploy-rg"
2020-02-18T09:18:09.6260977Z {
2020-02-18T09:18:09.6261175Z   "accessTier": "Hot",
2020-02-18T09:18:09.6261243Z   "azureFilesIdentityBasedAuthentication": null,
2020-02-18T09:18:09.6261331Z   "creationTime": "2020-02-18T09:16:53.240309+00:00",
2020-02-18T09:18:09.6261431Z   "customDomain": null,
2020-02-18T09:18:09.6261488Z   "enableHttpsTrafficOnly": true,
2020-02-18T09:18:09.6261584Z   "encryption": {
2020-02-18T09:18:09.6261643Z     "keySource": "Microsoft.Storage",
2020-02-18T09:18:09.6261722Z     "keyVaultProperties": null,
2020-02-18T09:18:09.6261784Z     "services": {
2020-02-18T09:18:09.6261852Z       "blob": {
2020-02-18T09:18:09.6261908Z         "enabled": true,
2020-02-18T09:18:09.6261979Z         "keyType": "Account",
2020-02-18T09:18:09.6262048Z         "lastEnabledTime": "2020-02-18T09:16:53.318413+00:00"
2020-02-18T09:18:09.6262130Z       },
2020-02-18T09:18:09.6262184Z       "file": {
2020-02-18T09:18:09.6262240Z         "enabled": true,
2020-02-18T09:18:09.6262311Z         "keyType": "Account",
2020-02-18T09:18:09.6262380Z         "lastEnabledTime": "2020-02-18T09:16:53.318413+00:00"
2020-02-18T09:18:09.6262459Z       },
2020-02-18T09:18:09.6262512Z       "queue": null,
2020-02-18T09:18:09.6264556Z       "table": null
2020-02-18T09:18:09.6264611Z     }
2020-02-18T09:18:09.6264677Z   },
2020-02-18T09:18:09.6264746Z   "failoverInProgress": null,
2020-02-18T09:18:09.6264821Z   "geoReplicationStats": null,
2020-02-18T09:18:09.6265090Z   "id": "/***8/resourceGroups/-****content-deploy-rg/providers/Microsoft.Storage/storageAccounts/",
2020-02-18T09:18:09.6265201Z   "identity": null,
2020-02-18T09:18:09.6265258Z   "isHnsEnabled": null,
2020-02-18T09:18:09.6265314Z   "kind": "StorageV2",
2020-02-18T09:18:09.6265387Z   "largeFileSharesState": null,
2020-02-18T09:18:09.6265449Z   "lastGeoFailoverTime": null,
2020-02-18T09:18:09.6265523Z   "location": "northeurope",
2020-02-18T09:18:09.6265585Z   "name": "********contentdeploysa",
2020-02-18T09:18:09.6265668Z   "networkRuleSet": {
2020-02-18T09:18:09.6265725Z     "bypass": "AzureServices",
2020-02-18T09:18:09.6265799Z     "defaultAction": "Allow",
2020-02-18T09:18:09.6265866Z     "ipRules": [],
2020-02-18T09:18:09.6265936Z     "virtualNetworkRules": []
2020-02-18T09:18:09.6266003Z   },
2020-02-18T09:18:09.6266057Z   "primaryEndpoints": {
2020-02-18T09:18:09.6266140Z     "blob": "https://********contentdeploysa.blob.core.windows.net/",
2020-02-18T09:18:09.6266224Z     "dfs": "https://********contentdeploysa.dfs.core.windows.net/",
2020-02-18T09:18:09.6266320Z     "file": "https://********contentdeploysa.file.core.windows.net/",
2020-02-18T09:18:09.6266389Z     "internetEndpoints": null,
2020-02-18T09:18:09.6266465Z     "microsoftEndpoints": null,
2020-02-18T09:18:09.6266540Z     "queue": "https://********contentdeploysa.queue.core.windows.net/",
2020-02-18T09:18:09.6266637Z     "table": "https://********contentdeploysa.table.core.windows.net/",
2020-02-18T09:18:09.6266721Z     "web": "https://********contentdeploysa.z16.web.core.windows.net/"
2020-02-18T09:18:09.6266800Z   },
2020-02-18T09:18:09.6266857Z   "primaryLocation": "northeurope",
2020-02-18T09:18:09.6266944Z   "privateEndpointConnections": [],
2020-02-18T09:18:09.6267008Z   "provisioningState": "Succeeded",
2020-02-18T09:18:09.6267230Z   "resourceGroup": "-****content-deploy-rg",
2020-02-18T09:18:09.6267299Z   "routingPreference": null,
2020-02-18T09:18:09.6267372Z   "secondaryEndpoints": {
2020-02-18T09:18:09.6267447Z     "blob": "https://********contentdeploysa-secondary.blob.core.windows.net/",
2020-02-18T09:18:09.6267538Z     "dfs": "https://********contentdeploysa-secondary.dfs.core.windows.net/",
2020-02-18T09:18:09.6267623Z     "file": null,
2020-02-18T09:18:09.6267679Z     "internetEndpoints": null,
2020-02-18T09:18:09.6267755Z     "microsoftEndpoints": null,
2020-02-18T09:18:09.6267835Z     "queue": "https://********contentdeploysa-secondary.queue.core.windows.net/",
2020-02-18T09:18:09.6267939Z     "table": "https://********contentdeploysa-secondary.table.core.windows.net/",
2020-02-18T09:18:09.6268029Z     "web": "https://**contentdeploysa-secondary.z16.web.core.windows.net/"
2020-02-18T09:18:09.6268119Z   },
2020-02-18T09:18:09.6268177Z   "secondaryLocation": "westeurope",
2020-02-18T09:18:09.6268260Z   "sku": {
2020-02-18T09:18:09.6268318Z     "name": "Standard_RAGRS",
2020-02-18T09:18:09.6268393Z     "tier": "Standard"
2020-02-18T09:18:09.6268448Z   },
2020-02-18T09:18:09.6268517Z   "statusOfPrimary": "available",
2020-02-18T09:18:09.6268582Z   "statusOfSecondary": "available",
2020-02-18T09:18:09.6268644Z   "tags": {
2020-02-18T09:18:09.6268713Z     "Department": "Umkhosi",
2020-02-18T09:18:09.6268774Z     "Environment": "test",
2020-02-18T09:18:09.6268845Z     "Owner": "",
2020-02-18T09:18:09.6268909Z     "Project": "****content Deployment",
2020-02-18T09:18:09.6268989Z     "Resource": "Storage Account"
2020-02-18T09:18:09.6269048Z   },
2020-02-18T09:18:09.6269119Z   "type": "Microsoft.Storage/storageAccounts"
2020-02-18T09:18:09.6269181Z }
2020-02-18T09:18:09.6433516Z [command]C:\windows\system32\cmd.exe /D /S /C ""C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\wbin\az.cmd" storage container create --name contentapideploymentstate --account-name ********contentdeploysa"
2020-02-18T09:18:12.5041524Z {
2020-02-18T09:18:12.5042073Z   "created": true
2020-02-18T09:18:12.5042261Z }
2020-02-18T09:18:12.5043052Z WARNING: No connection string, account key or sas token found, we will query account keys for your storage account. Please try to use --auth-mode login or provide one of the following parameters: connection string, account key or sas token for your storage account.
2020-02-18T09:18:12.5113066Z ##[error]Error: WARNING: No connection string, account key or sas token found, we will query account keys for your storage account. Please try to use --auth-mode login or provide one of the following parameters: connection string, account key or sas token for your storage account.
2020-02-18T09:18:12.8541515Z ##[section]Finishing: Terraform : initialize
To Reproduce
Create terraform release pipeline. after a task to deploy state resource follow procedure to create normal terraform release pipeline
Expected behavior
Expect terraform to create all resources in Azure
Environment summary
Create terraform release pipeline. after a task to deploy state resource follow procedure to create normal terraform release pipeline. YAML files show above
Additional context
can this be related to this https://github.com/Azure/azure-cli/issues/12193 ?

I have the same error today. The last successful deployment was on Friday 14/02/2020, and today it failed with an error message:

[command]C:\windows\system32\cmd.exe /D /S /C ""C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\wbin\az.cmd" storage container create --name *** --account-name ***"
WARNING: No connection string, account key or sas token found, we will query account keys for your storage account. Please try to use --auth-mode login or provide one of the following parameters: connection string, account key or sas token for your storage account.

Hi @Demeleo and @honeykatrina, the warning information is by design, because the credentials for such command should be provided by users. Although CLI can query the credentials for users but when there are very large calls it will break storage resource provider. In this way, we show up such kind of warning message and will make credentials required in the future.
To solve your problem, you need to provide one of the following credentials for such command: account key, sas token, connetion-string or auth-mode.
For more information, you can take a look at https://github.com/Juliehzl/azure-cli/blob/user/doc/use_cli_effectively.md#using-storage-commands.
For example,
C:\windows\system32\cmd.exe /D /S /C ""C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\wbin\az.cmd" storage container create --name *** --account-name ***  --account-key ***
If the storage account is widely used in your task, you can store your credentials in environment variables and don't need to provide it in your command.

The Terraform CLI task in Azure DevOps pipelines that we are using doesn't propose to specify any credentials except a key. So it is not possible to pass sas token, connetion-string or auth-mode that causes the pipeline to fail.

I do not think this is an issue with the Azure CLI necessarily but, more how the TerraformCLI task interprets failure. The azure cli writes warnings to stderr but still returns exit code 0. The task interprets the existence of text in std err as a failure regardless of the exit code. This will be resolved in the task itself by factoring in the exit code returned by the azure cli to determine if the command was successful or not.
If its by design that warnings are represented in stderr while maintaining zero exit code, then i think this can be closed.

FYI, the TerraformCLI extension will no longer fail under the condition above as of 0.4.21.

The Terraform CLI task in Azure DevOps pipelines that we are using doesn't propose to specify any credentials except a key. So it is not possible to pass sas token, connetion-string or auth-mode that causes the pipeline to fail.

In this way, you can use account key in your commands. Please let me know if your problem can be solved with account key provided.

Please don't write warnings to stderr (at least unless that's in a major version increment as it should be considered a breaking change).

I have an Azure CLI task used to generate the SAS token and infrequent steps using the SAS token, I used to access my private storage accounts. Now, this warning message is breaking my Azure CLI task.

If you pass --auth-mode key it still presents this warning (WARNING: No connection string, account key or sas token found, we will query account keys for your storage account. Please try to use --auth-mode login or provide one of the following parameters: connection string, account key or sas token for your storage account.). I feel like the warning shouldn't show if that is passed in given you are expressly asking for that mode of operation?

If you pass --auth-mode key it still presents this warning (WARNING: No connection string, account key or sas token found, we will query account keys for your storage account. Please try to use --auth-mode login or provide one of the following parameters: connection string, account key or sas token for your storage account.). I feel like the warning shouldn't show if that is passed in given you are expressly asking for that mode of operation?

Please provide your account key or use --auth-mode login.

Hi @Juliehzl,
I guess my point is that the --auth-mode key option is designed for the existing behaviour. From the docs: The mode in which to run the command. "login" mode will directly use your login credentials for the authentication. The legacy "key" mode will attempt to query for an account key if no authentication parameters for the account are provided.
You commented above with this:

... the warning information is by design, because the credentials for such command should be provided by users. Although CLI can query the credentials for users but when there are very large calls it will break storage resource provider. In this way, we show up such kind of warning message and will make credentials required in the future.

But, that's not what the warning says (that --auth-mode key will be deprecated in the future) so it's confusing. Furthermore, the documentation doesn't indicate that --auth-mode key will be deprecated.
I deliberately didn't want to add an account key in this instance because I'm using it in a script to teach people how to use the Azure CLI so I'm trying to keep things simple and not introduce more concepts than needed.
If I use --auth-mode login I actually get an error when trying to access the blob storage because the user doesn't have access, even though it's a subscription admin. Although on reflection, maybe that's because it's a co-admin rather than assigned as an admin using IAM, hmmm. Either way, in my opinion, the current warning shouldn't show when you add --auth-mode key, or possibly a different warning should show indicating that option will be deprecated in the future (if it is indeed slated for that).

@robdmoore You're definitely right!!
--auth-mode key is a legacy authentication, which will query keys for users. Your suggestion is very good to us, and I will refine the warning message according to your suggestion.
For --auth-mode login, what you need is storage related RBAC roles, which will control some data related permissions. For more information you can refer to https://docs.microsoft.com/en-us/azure/storage/common/storage-auth-aad-rbac-portal#rbac-roles-for-blobs-and-queues.

Awesome! Thanks. That sounds great.

Getting the same busted message and its nothing to do with Terraform. Its an Azure CLI task running Azure CLI commands in a Powershell script...
            - task: AzureCLI@2
              displayName: 'Azure CLI : Provision Storage Account'
              inputs:
                azureSubscription: 'MyAzureServiceConnection'
                scriptType: ps
                scriptPath: '$(System.ArtifactsDirectory)/AZDO_Pipeline_Scripts/scripts/AzureCLI/StorageAccount/Provision_StorageAccount_Env.ps1'
                arguments: '-saname $(azsaname1) -resourcegroup $(azresourcegroup1) -location $(azlocation) -sku $(azsasku1)'

Returns back with...
az : No connection string, account key or sas token found, we will query account keys for your storage account. Please
try to use --auth-mode login or provide one of the following parameters: connection string, account key or sas token
for your storage account.
At D:\a\1\a\AZDO_Pipeline_Scripts\scripts\AzureCLI\StorageAccount\Provision_StorageAccount_Env.ps1:26 char:1
+ az storage blob service-properties delete-policy update --days-retain ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (No connection s...torage account.:String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError

##[error]Script failed with exit code: 1

This is my script...its been working for months. Using the vmimage 'windows-latest'....
param (
    [Parameter(Mandatory=$true)]
    [string]$saname,
    [Parameter(Mandatory=$true)]
    [string]$resourcegroup,
    [Parameter(Mandatory=$true)]
    [string]$location,
    [Parameter(Mandatory=$true)]
    [string]$sku
)
#
az storage account create --name $saname --resource-group $resourcegroup --location $location --sku $sku
# set soft delete on for 30 days
az storage blob service-properties delete-policy update --days-retained 30  --account-name $saname --enable true
az storage blob service-properties delete-policy show --account-name $saname

Is a fix or workaround coming please?

I'm seeing this issue with the az cli, except it throws the error, then it just goes through and works like it did before and uses the MSI.  BUT, if I add --auth-mode login, then it just fails with:
You do not have the required permissions needed to perform this operation. Depending on your operation, you may need to be assigned one of the following roles:     "Storage Blob Data Contributor"     "Storage Blob Data Reader"     "Storage Queue Data Contributor"     "Storage Queue Data Reader"
There's no --auth-mode msi or something similar to provide the old behavior?  This just seems broken...

I'm seeing this issue with the az cli (2.5.1), except it throws the error, then it just goes through and works like it did before (v 2.0 of the cli) and uses the MSI. BUT, if I add --auth-mode login, then it just fails with:
You do not have the required permissions needed to perform this operation. Depending on your operation, you may need to be assigned one of the following roles: "Storage Blob Data Contributor" "Storage Blob Data Reader" "Storage Queue Data Contributor" "Storage Queue Data Reader"
There's no --auth-mode msi or something similar to provide the old behavior? This just seems broken...

--auth-mode login will require users to have Storage related RBAC roles as shown here: https://docs.microsoft.com/en-us/azure/storage/common/storage-auth-aad#assign-rbac-roles-for-access-rights.

To block the warning message, you can add --only-show-errors in your command.

In addition, warning message is refined in PR https://github.com/Azure/azure-cli/pull/13963

this is nowhere near resolved.
in a pipeline, one can no longer do

az storage account create
az storage share create

simply put, the contributor role that allows #1 to succeed does not allow #2 to succeed (because  it needs the special SA role) and there is no way in a pipeline to assign the IAM permissions for the SA role without giving the pipeline OWNER access over the subscription.
what did I miss?

@charleszipp with reference to: https://github.com/Azure/azure-cli/issues/12242#issuecomment-588500949
I get this in version 0.5.12
2020-07-22T10:19:13.1063859Z ##[section]Starting: Terraform Init 2020-07-22T10:19:13.1073835Z ============================================================================== 2020-07-22T10:19:13.1074207Z Task         : Terraform CLI 2020-07-22T10:19:13.1074486Z Description  : Execute terraform cli commands 2020-07-22T10:19:13.1074754Z Version      : 0.5.12 2020-07-22T10:19:13.1074990Z Author       : Charles Zipp 2020-07-22T10:19:13.1075240Z Help         :  2020-07-22T10:19:13.1075524Z ============================================================================== 2020-07-22T10:19:13.5399513Z [command]/opt/hostedtoolcache/terraform/0.12.25/x64/terraform version 2020-07-22T10:19:13.5768637Z Terraform v0.12.25 2020-07-22T10:19:13.5769336Z  2020-07-22T10:19:13.5769871Z Your version of Terraform is out of date! The latest version 2020-07-22T10:19:13.5770518Z is 0.12.28. You can update by downloading from https://www.terraform.io/downloads.html 2020-07-22T10:19:13.5785297Z  2020-07-22T10:19:13.5905267Z [command]/opt/hostedtoolcache/terraform/0.12.25/x64/terraform init 2020-07-22T10:19:13.6208551Z Initializing modules... 2020-07-22T10:19:13.6230838Z - az_drift_hub_test01 in modules/nhn-hub-expressroute 2020-07-22T10:19:13.6274407Z  2020-07-22T10:19:13.6275510Z Initializing the backend... 2020-07-22T10:19:13.6282005Z  2020-07-22T10:19:13.6283414Z Error: Error building ARM Config: Azure CLI Authorization Profile was not found. Please ensure the Azure CLI is installed and then log-in with az login. 2020-07-22T10:19:13.6284318Z  2020-07-22T10:19:13.6285139Z  2020-07-22T10:19:13.6303580Z  2020-07-22T10:19:13.6429582Z ##[error]Terraform command 'init' failed with exit code '1'.:  Error building ARM Config: Azure CLI Authorization Profile was not found. Please ensure the Azure CLI is installed and then log-in with az login. 2020-07-22T10:19:14.1792417Z ##[section]Finishing: Terraform Init
What to do?
Br. Rune Myrhaug


Bring out the Includes facade from service container

All methods are static, and bringing it out would allow it to be used in config files.

Actually, the Includes facade is not in the container, but depends on features that are.


Suggestion:  Toggle to ban/unban all other players

Is your feature request related to a problem? Please describe.
The Foundry license allows mutliple instances to be run only in the case where only one of those instances is accessible to people other than the license holder.  One way to enforce this, and prevent player access while you've got multiple instnaces spun up is to ban all accounts in a world other than the license holder during prep (e.g. in the case where the license is used by A, the license holder, and B, their friend who also GMs, A and B can only prep games at the same time if all other accounts on A's world are inaccessible the players - as otherwise both A's world and B's world are open to "users other than the license holder").
Describe the solution you'd like
A quick toggle button to ban/unban all accounts other than those which are currently logged in. And ideally an obvious UI feature when this is active, as a reminder to unban and let the players back in.
Describe alternatives you've considered
Could be done via a macro.  Can also be done with a lot of clicking through the menu.  Either runs the risk of not noticing that you've left it in "Developer only" mode.
Additional context
N/A

I'm not much sure this is in Dev-Mode's wheelhouse. It's often enough that while developing a dev needs both a GM and a Player account active at the same time (or multiple players even). I think this is firmly on the license holder's end to police.


iox-#2011 Remove gcc 5.4 and std_header_check.sh from CI

Pre-Review Checklist for the PR Author

[x] Code follows the coding style of CONTRIBUTING.md
[x] Tests follow the best practice for testing
[x] Changelog updated in the unreleased section including API breaking changes
[x] Branch follows the naming format (iox-123-this-is-a-branch)
[x] Commits messages are according to this guideline

[x] Commit messages have the issue ID (iox-#123 commit text)
[x] Commit author matches Eclipse Contributor Agreement (and ECA is signed)

[x] Update the PR title

Follow the same conventions as for commit messages
Link to the relevant issue

[x] Relevant issues are linked
[x] Add sensible notes for the reviewer
[x] All checks have passed (except task-list-completed)
[x] All touched (C/C++) source code files from iceoryx_hoofs are added to ./clang-tidy-diff-scans.txt
[x] Assign PR to reviewer

Notes for Reviewer

This PR removes the GCC 5.4 CI check and std_header_check.sh
Checklist for the PR Reviewer

[ ] Commits are properly organized and messages are according to the guideline
[ ] Code according to our coding style and naming conventions
[ ] Unit tests have been written for new behavior
[ ] Public API changes are documented via doxygen
[ ] Copyright owner are updated in the changed files
[ ] All touched (C/C++) source code files from iceoryx_hoofs have been added to ./clang-tidy-diff-scans.txt
[ ] PR title describes the changes

Post-review Checklist for the PR Author

[ ] All open points are addressed and tracked via issues

References

Relates to #2011

@dkroenke @mossmaurice There are still toolchain files for QNX 7.0. I can't update them to QNX 7.1 since I don't have access but also don't want to remove them since it might help someone else at porting.

There are still toolchain files for QNX 7.0. I can't update them to QNX 7.1 since I don't have access but also don't want to remove them since it might help someone else at porting.

@elBoberido Could you create a issue for that and maybe add a @todo to the toolchain file?


[ci] Upload googletest-generated logs as artifacts

Is it possible to obtain googletest-generated logs from Azure Pipelines when tests fails in CI?
I'm adding a new test in PR #14343. I'm not surprised the test failed, but I don't know how to obtain the test log.
//sw/device/examples/sram_program:sram_program_fpga_cw310_test           FAILED in 0.1s
  /home/vsts/.cache/bazel/_bazel_vsts/5c27df7f718ab35828b0e0cfe0993663/execroot/lowrisc_opentitan/bazel-out/k8-fastbuild-ST-97f470ee3b14/testlogs/sw/device/examples/sram_program/sram_program_fpga_cw310_test/test.log

Based on azure-pipelines.yml, I determined that the "Earl Grey SW Build & Test" > "Build and test SW" job is named sw_build. I found sw_build in the artifacts list, but didn't find test.log there.
Would it make sense to add an include_pattern that will match logs under the bazel-out/k8-fastbuild-*/testlogs/ directory? We currently only specify /sw/***.
CC @milesdai

Ooh, I had an idea: what if we just add --test_output=errors to the Bazel test invocation? Then we wouldn't need to hunt down the correct artifacts tarball, we'd just see it in the default Azure Pipelines log.


Send data entered in dialog (native name/phone number)to API

The puzzle 21-7735e21e from #21 has to be resolved:
https://github.com/ammaratef45/Attendance/blob/9f6a8fd62dbe74ab63635d65df334098944ad00c/attendance/lib/ProfilePage/profile_page_view.dart#L193-L193
The puzzle was created by @Bahaaib on 06-Apr-19.
If you have any technical questions, don't ask me, submit new tickets instead. The task will be "done" when the problem is fixed and the text of the puzzle is removed from the source code. Here is more about PDD and about me.

@ammaratef45/z please, pay attention to this issue

Job #25 is now in scope, role is DEV

The job #25 assigned to @ammaratef45/z, here is why; the budget is 30 minutes, see §4; please, read §8 and §9; if the task is not clear, read this and this; there will be no monetary reward for this job

The puzzle 21-7735e21e has disappeared from the source code, that's why I closed this issue.

@0pdd the puzzle #26 is still not solved.

Job was finished in 35 hours, bonus for fast delivery is possible (see §36)

The job #25 is now out of scope

Order was finished: +35 point(s) just awarded to @ammaratef45/z

@0pdd 5 puzzles #37, #38, #39, #40, #41 are still not solved; solved: #26.

@0pdd 4 puzzles #38, #39, #40, #41 are still not solved; solved: #26, #37.

@0pdd 2 puzzles #40, #41 are still not solved; solved: #26, #37, #38, #39.

@0pdd 2 puzzles #40, #54 are still not solved; solved: #26, #37, #38, #39, #41.

@0pdd the puzzle #40 is still not solved; solved: #26, #37, #38, #39, #41, #54.


Add reporting set tags

Current dependencies on/for this PR:

main

PR #1283

PR #1288

PR #1289   👈

This comment was auto-generated by Graphite.

This change is


Redesign Cryptocurrency section

Redesign Cryptocurrency section

          2 Warnings

:warning:
Too many changes (when adding, please keep it to one project per Pull Request)

:warning:
Found 1 link issue, a project collaborator will take care of these, thanks :)

Link issue by awesome_bot

Line
Status
Link

154
301
https://cl.ly/453225333E0u/balance-open.png redirects tohttps://my.cl.ly/content/453225333E0u

  Generated by :no_entry_sign: Danger


Feature: pypi wheels for macOS arm64

Is your feature request related to a problem? Please describe.
Installing on macOS arm64 (M1, M2) doesn't work, because there are no wheels on pypi and no up-to-date conda-forge package.
Describe the solution you'd like
use cibuildwheel to also build macOS arm64 wheels to upload to pypi.
Update conda-forge by merging: https://github.com/conda-forge/napari-nd-annotator-feedstock/pulls
And then have the bot make an arm64 PR.
Describe alternatives you've considered
I tried building from source but get an error:
src/napari_nd_annotator/minimal_contour/_eikonal_wrapper.cpp:1273:10: fatal error: 'omp.h' file not found
Maybe some build-from-source documentation could be provided if wheels are not feasible?

Thanks for raising this issue! I included macOS to be built with cibuildwheel, but I don't know how to add arm64 to the list. I'll check it soon.
Regarding the error, unfortunately I don't have access to a mac, so I can't test what setup is required on macOS. If you could help me with that, it would be super useful.

Looking at your workflow and the error it's likely due to my not having or having a differently configed libomp.
I won't have time in the near future to try to sort it out locally.
However, I think it should be simple to get your workflow to build arm64, so I will give that a shot!


Feature/add js

Added functions and codes to execute the functions including math functions.

Added functions and codes to execute functions.


Use OpenShift Go client

Currently the auto-heal service uses the Kubernetes Go client in order to retrieve secrets. It should use the OpenShift Go client instead.

@jhernand why not stay with Kubernetes Go client?

The reasoning is that the Kubernetes Go client may eventually have some incompatibility (or limitation) with the OpenShift cluster where the auto-heal service is intended to run. For example, if we wanted to use the OpenShift templating API from the auto-heal service (very unlikely) we wound't be able with the Kubernetes client, because there is no such API in Kubernetes.
Note that the Kubernetes and OpenShift go clients are almost exactly the same, just different package names (in theory), so this isn't a big change (again in theory, as dependencies are always tricky).

I am assigning this to myself because I can't assign @zeari, but he is the real assignee.

As far as I can tell https://github.com/openshift/client-go doesnt have the option to get secrets.
getting k8s entities is done with the same k8s code that we use and the openshift go client only has code that has to do with openshift specific entities(builds, routes, etc).
I could be wrong though. Im still new at golang and the only example there is https://github.com/openshift/client-go/blob/master/examples/build/main.go

Thanks for clarifying this @zeari, I was completely wrong. I am closing this issue.


bump actions/setup-go to v5.0.0

This resolves the node.js 16 deprecation warning when running.

Sorry, missed seeing this PR, so we went ahead an updated on main.  But thanks for the patch!


Make sure Bluetooth meets regulations

The regulations require that we seal the battery box during the race. This also includes a requirement that we cannot alter firmware or settings once the battery box has been sealed. However, the current BPS design plans to make the CLI accessible over Bluetooth. We need to either:

Verify that we cannot use the CLI to modify any firmware or settings
Limit the user interface we expose over Bluetooth, so it cannot be used to alter firmware or settings

Per Steve's email, sealing the battery box is to prevent changing out cells during the race. Communication is fine as long as it does not affect firmware or settings


Remote RTL gain setting undocumented

Trying out the remote RTL setup I found the gain was way too low by default, and the rtl_tcp server gain had very little effect.
The parameter "remote_rtl_gain_idx" is not documented but appears to work, but I'm not sure what the units are for this?

It uses the same gain index that rtl_tcp uses which you can pass there at start up. So basically the index in this list for a regular RTLSDR V3:
#valid tuner gains r82xx_gains[] = { 0, 9, 14, 27, 37, 77, 87, 125, 144, 157, 166, 197, 207, 229, 254, 280, 297, 328, 338, 364, 372, 386, 402, 421, 434, 439, 445, 480, 496 };
To select the highest gain the index would be 28. Thanks for pointing this, I have updated the readme.

Closing this one


Check the API version for every request

In order to make sure the dashboard is using the correct API version, we'd better add the APISIX version in every api response.
Please

Add the dashboard api version variable in the config file.
Check every api response in the request.ts file, show a alert when the dashboard version is not compatible with the APISIX version.

Hi @juzhiyuan  shall I give it a try?

Of course you can, but I'm not sure if the APISIX has added the version on admin apis.
@moonming have we manipulated this?

Oh, it seems, the issue is still pending, I'll try to pick on another task for a while.


Request for bridge.json resource to use file source names when specifying multiple files by wildcard

When embedding multiple resource files in my bridge.json using a wildcard in the file name of the source files, it seems that it's only possible to output the 'combined' result of these files, which in my case produces undesirable results.
As the resources in question are .less files, some of which have @import statements within them, so the output file will be attempting to import files that won't exist in the output directory.
Here's the bridge.json configuration that I'm using to do this:
{
	"resources": [
		{
			"name": "Output.less"
			"output": "Styles",
			"files": [ "Content/Styles/*.less" ]
		}
	]
}

This configuration produces a concatenated string of less to be output to Output.less, which due to the missing files in the @import calls, will fail during less compilation.
I thought if I removed the name property it would default to outputting the less files separately into the Styles directory using their source file names, although this just appeared to create an empty Styles folder.
Apologies if this option already exist, I couldn't find a reference to it in the documentation, but if not would it possible to add an extra option to allow wildcard files to be output separately by their source file name?
See Also

https://forums.bridge.net/forum/bridge-net-pro/bugs/4163-is-it-possible-to-provide-hints-for-assembly-ordering-with-combinescripts-true

Hi @Porl91, thanks for a nice feature request, it makes sense.
This is one of the two options we discuss with @ProductiveRage here.
We will try to implement this in the next releases.

Good to hear that it's being considered - certainly makes life a lot easier. :) Thanks @LeonidVeriga

I'm not sure if it makes much difference but I think that @Porl91 is talking about using wild cards to include resources in library projects (projects that will be referenced by others and that will bring in resources with them) while I was talking about using wild cards to specify which of the resources that come from referenced projects that I want to include (well, actually, in what order.. but I don't think that's important).
So Porl's interest is in building resources into a library for someone to consume and my interest was in the application and how it consumes to resources from the libraries it references.


New feature: copy screens from one clientspace / workspace to another

Fixes #12
Checklist

[x] I have read the Contribution Guide ;
[x] I have read the Contributor License Agreement (CLA) and understand that the submission of this PR will constitute an  electronic signature of my agreement of the terms and conditions of DataGalaxy's CLA ;
[x] There is an approved issue describing the change when contributing a new feature ;
[x] I have added tests that prove my fix is effective or that my feature works ;
[x] I have added necessary documentation (if appropriate) ;

Short description of what this resolves:
Changes proposed in this pull request:

Add new copy-screens command to the toolbox
It allows to copy screens from a clientspace or workspace to another clientspace or workspace
Is close to all other features of the toolbox

Please release v0.4.0 after successful merge

I guess this branch is based on https://github.com/datagalaxy-lab/datagalaxy-toolbox/pull/11 so we should probably merge https://github.com/datagalaxy-lab/datagalaxy-toolbox/pull/11 first.

[x] have added necessary documentation (if appropriate) => README.md was not updated for recent PRs, could you make sure everything is up-to-date? (feel free to open a new "documentation" pr if that's more convenient). Thanks!

@drscholly could you please rebase on main branch?


Please publish an npm update to @ionic/vue to bump the @ionic/core dependency version.

Bug Report
Ionic version:
[x] 4.x
Current behavior:
When installing @ionic/vue version 0.0.1, the typescript build complains about multiple inheritance issues (typescript version 3.2.4).
Expected behavior:
Typescript should compile. Updating the @ionic/core dependency from 4.0.0-beta.12 to 4.0.0-rc.3 fixes this.
Steps to reproduce:
Initialize a typescript vue application with vue-cli and install @ionic/vue as a dependency.
Ionic info:
Ionic:

   ionic (Ionic CLI) : 4.8.0 (/usr/local/lib/node_modules/ionic)

Cordova:

   cordova (Cordova CLI) : 8.1.2<EMAIL_ADDRESS>   Cordova Platforms     : android 7.1.4, browser 5.0.4, ios 4.5.5
   Cordova Plugins       : no whitelisted plugins (1 plugins total)

System:

   Android SDK Tools : 26.1.1 (/Users/developer/Library/Android/sdk)
   NodeJS            : v10.15.0 (/usr/local/bin/node)
   npm               : 6.4.1
   OS                : macOS Mojave
   Xcode             : Xcode 10.1 Build version 10B61

Is it correct for @modus/ionic-vue (recently updated) to send everyone to to @ionic/vue (updated months ago?)

I think not, the @modus/ionic-vue package is working better (but not perfect) than the @ionic/vue version. Can we get some help here, maybe some documentation or something.
What I have at the moment is not working too well, every tutorial I have found seems to be outdated.

This should be fixed now with @ionic/vue.


In the game summary the winning submissions should be shown on a Google Maps Simple Map as markers

https://github.com/sopra-fs24-group-12/PeekSeek-client/commit/a1e806f14dbf7edd008e1b6e37e7f27d37205b08


Conversion with tf.keras not working

Traceback (most recent call last):
  File "test.py", line 82, in <module>
    linear_regression()
  File "test.py", line 79, in linear_regression
    onnx_model = keras2onnx.convert_keras(model)
  File "/home/.../miniconda3/lib/python3.7/site-packages/keras2onnx/main.py", line 103, in convert_keras
    return convert_topology(topology, name, doc_string, target_opset, channel_first_inputs)
  File "/home/.../miniconda3/lib/python3.7/site-packages/keras2onnx/topology.py", line 225, in convert_topology
    get_converter(operator.type)(scope, operator, container)
  File "/home/.../miniconda3/lib/python3.7/site-packages/keras2onnx/ke2onnx/dense.py", line 39, in convert_keras_dense
    apply_activation_function = activation_map[operator.raw_operator.activation]
KeyError: <function relu at 0x7f3f000da6a8>

The script is the tutorial from https://www.tensorflow.org/tutorials/keras/basic_regression.
Tested with:
tensorflow 1.13.1 and 1.14.0
keras2onnx 1.5.1
onnx==1.5.0
onnxconverter-common==1.5.3
I also tried with TF_KERAS=1 but that didn't make a difference.

Replacing  activation=tf.nn.relu with activation='relu' fixes it, but this should not be required.

Just checked in the fix and it should work. Please pull keras2onnx master and try again.


wranglerjs is too rigid in what version of webpack it uses to build projects

from @1000hz : the parser webpack 4 uses (acorn) doesn't support optional chaining / nullish coalescing operators. wranglerjs uses its own version of webpack (4.x). TypeScript target ES2020/ESNext doesn't transpile these operators
webpack 5 (which has been in beta forever) uses a newer version of acorn with support for these operators
but there's no way to override what version of webpack wrangler will use

I think the long-term solution to this problem is to have wrangler defer building to project scripts, i.e.
if there's a package.json file
npm run wrangler:build
npm run build

or if there's a cargo.toml file
cargo run wrangler:build
cargo build

and only fallback to using a bundled version of webpack if none of these exist.

Supporting arbitrary scripts seems like a really good idea actually, and would allow people to choose their own JS bundling tools (e.g. rollup, etc). If nobody else is working on this i'm going to poke around and see if it's something that's within the scope of my rust knowledge to work on. No promises!!

It turns out that wrangler installation comes with wrangler-js which has webpack 4.33.0 built-in.
I can build my project successfully with webpack 5.x. But wrangler dev or wrangler build invokes its internal old version regardless. Is there any way to let wrangler use my manually built output?

It turns out that wrangler installation comes with wrangler-js which has webpack 4.33.0 built-in.
I can build my project successfully with webpack 5.x. But wrangler dev or wrangler build invokes its internal old version regardless. Is there any way to let wrangler use my manually built output?

Once https://github.com/cloudflare/wrangler/pull/1677 is merged, we plan to support any version of webpack

Once https://github.com/cloudflare/wrangler/pull/1677 is merged, we plan to support any version of webpack

closing since this is addressed by #1677, which will be going out as part of an RC in the near future


Mapping error

Here's a problem I'm having and the error resulting.  In command line I enter
csv2ofx Discover-RecentActivity-20221004.csv output.ofx
...here's the error that's returned....
Field 'Account' is missing from file. Check mapping option.
I have no idea how to fix this.  Any ideas?

If you check the output from the command you can find a -m option to specify a mapping.  I ran it with the parameter abc and it spit back an error showing me the valid mapping types.  Unfortunately I don't see one for my bank so I'll need to use the custom option.  I didn't see a discover option so likely you'll need custom as well.


Adding word boundary to lower FPs

This fixes #2075.

@azurit I think you have forgotten to put also the compiled new version also in REQUEST-942-APPLICATION-ATTACK-SQLI.conf 🙈

Also in my opinion ideally a \b could be added in front of the other keywords (select, union etc) as well.

@azurit I think you have forgotten to put also the compiled new version in REQUEST-942-APPLICATION-ATTACK-SQLI.conf see_no_evil

I didn't forget, I just thought this is going to compile while doing a new release. Will fix it, thank you.

@lifeforms These tests won't pass:
data: "FROM+INFORMATION_SCHEMA.%0A"
data: "%27%3BSELECT+P%0A"
data: "UnIon+seleCt%0A"

I'm not MSSQL expert so i'm not sure if using + instead of a space is correct syntax. Also, we missed %3B i.e. semicolon (;) for at least SELECT command (i will add it).

We have a ton of test failures after the changes of @azurit here. Anybody see why this is the case? I'm a bit at a loss here.

@azurit You forgot to add the (?i:...) flag (explicitly stated in the rule comment). I can't push to this branch, so you'll have to fix it yourself. With that change, the tests are green on my end.

@theseion Thanks!
Ready to be merged.

Meeting decision June (https://github.com/coreruleset/coreruleset/issues/2074#issuecomment-856173925):
@theseion will review this PR.

I'm not MSSQL expert so i'm not sure if using + instead of a space is correct syntax. Also, we missed %3B i.e. semicolon (;) for at least SELECT command (i will add it).

@azurit are you planning to make these changes? I don't see how they are relevant to the PR.

@theseion Done.

There is a conflict that awaits resolution. Other than that, we're done, are not we?

There were no conflicts when i was doing my last commit. What happened?

942190 was updated in the meantime: https://github.com/coreruleset/coreruleset/commit/a37e0308571df500b538a9d122f5bd9ae3b4f129
Sorry for the inconvenience, but this happens from time to time.
Can you resolve it?

I don't understand how am i supposed to resolve it - it's already resolved from my point of view.

I see your point, but then I think you need to rebase on the v3.4/dev after the said merge.

Meeting decision July: https://github.com/coreruleset/coreruleset/issues/2141#issuecomment-874288876
@theseion and @azurit will make this PR ready to be merged. Unfortunately some tests are failing.

@azurit All you need to do is to regenerate the regular expression (the change from the previous PR got lost when you merged, that's why the two tests for that PR fail).

@theseion Thanks! Should be ok now.

Apparently merging this is long overdue. Merging now.
Thank you for the PR @azurit and the reviews / support @theseion and @franbuehler.


registration of a new user & roles

registration of a new user authenticated via gmail
introduce roles: ROLE_USER/ROLE_ADMIN
access to language and user api reserved to admin

fighting with this issue:
Access to fetch at 'https://accounts.google.com/o/oauth2/v2/auth?response_type=code&client_id=504150563060-see66kg8jnp5e52752j415284km72bho.apps.googleusercontent.com&scope=profile%20email&state=R0zGVRBP43lHAIhbw7BN0CWY_bcNktPwSYfK-I6yt2Q%3D&redirect_uri=http://localhost:9090/login/oauth2/code/google' (redirected from 'http://localhost:9090/api/v1/vocabulary/word?page=0&size=20&sort=sentence%2CASC&filter.k.operator=containsIgnoreCase') from origin 'http://localhost:9090' has been blocked by CORS policy: No 'Access-Control-Allow-Origin' header is present on the requested resource. If an opaque response serves your needs, set the request's mode to 'no-cors' to fetch the resource with CORS disabled.

Check this possible workaround : https://stackoverflow.com/a/73376127/379173


Update surfacehub-csp.md

Document new ExchangeModernAuthEnabled setting

Please note that I have made a direct PR to the file in your own PR branch, https://github.com/DanPandre/windows-itpro-docs/pull/1
If you find the whitespace clean-up acceptable, please merge the PR to add the changes to your own PR. 🙂

#sign-off

Anything else that needs to happen to publish this?

merged PR with DanPandre's approval.


Pane.addItem is deprecated.

Pane::addItem(item, 0) is deprecated in favor of Pane::addItem(item, {index: 0})
Pane.addItem (/usr/share/atom-git/resources/app.asar/src/pane.js:447:14)
Object.toggleView (/home/marcus/.atom/packages/git-control/lib/git-control.coffee:50:21)
atom-workspace.<anonymous> (/home/marcus/.atom/packages/git-control/lib/git-control.coffee:27:24)
CommandRegistry.handleCommandEvent (/usr/share/atom-git/resources/app.asar/src/command-registry.js:259:29)
handleCommandEvent (/usr/share/atom-git/resources/app.asar/src/command-registry.js:3:59)
CommandRegistry.dispatch (/usr/share/atom-git/resources/app.asar/src/command-registry.js:160:19)

Was attempting to repair a conflict (Bitbucket) when I encountered this error.


error update device status & reconnect frequently

Describe the bug
In HA log, updating device status error and reconnect repeatedly.
Expected behavior
Normal operation without updating errors
Screenshots

Environment details:

Environment (HASSIO, Raspbian, etc): HA OS on Synology VMM
Home Assistant version installed: 2022.3.0
Component version installed:  0.12.10 (same issue on 0.12.8, not tested other version)
Last know working version: -
LG device type and model with issue:  ac / refrigerator / washer / dryer / styler
LG devices connected (list): ac / refrigerator / washer / dryer / styler

Output of HA logs
Paste the relavant output of the HA log here.
이 오류는 사용자 통합 구성요소에서 발생했습니다.

Logger: custom_components.smartthinq_sensors.wideq.device
Source: custom_components/smartthinq_sensors/wideq/core_v2.py:221
Integration: SmartThinQ LGE Sensors (documentation, issues)
First occurred: 20:01:15 (21 occurrences)
Last logged: 21:11:26

Unexpected error while updating device status
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 910, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/simplejson/__init__.py", line 525, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/site-packages/simplejson/decoder.py", line 370, in decode
    obj, end = self.raw_decode(s)
  File "/usr/local/lib/python3.9/site-packages/simplejson/decoder.py", line 400, in raw_decode
    return self.scan_once(s, idx=_w(s, idx).end())
simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/config/custom_components/smartthinq_sensors/wideq/device.py", line 221, in refresh
    if not self._restart_monitor():
  File "/config/custom_components/smartthinq_sensors/wideq/device.py", line 300, in _restart_monitor
    self.start()
  File "/config/custom_components/smartthinq_sensors/wideq/device.py", line 308, in start
    self._work_id = self._client.session.monitor_start(self._device_id)
  File "/config/custom_components/smartthinq_sensors/wideq/core_v2.py", line 777, in monitor_start
    res = self.post(
  File "/config/custom_components/smartthinq_sensors/wideq/core_v2.py", line 709, in post
    return lgedm2_post(
  File "/config/custom_components/smartthinq_sensors/wideq/core_v2.py", line 221, in lgedm2_post
    out = res.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 917, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: [Errno Expecting value] <lgedmRoot><returnCd>9999</returnCd><returnMsg>기타오류</returnMsg></lgedmRoot>: 0

이 오류는 사용자 통합 구성요소에서 발생했습니다.

Logger: custom_components.smartthinq_sensors.wideq.device
Source: custom_components/smartthinq_sensors/wideq/device.py:203
Integration: SmartThinQ LGE Sensors (documentation, issues)
First occurred: 20:01:16 (21 occurrences)
Last logged: 21:11:45

ThinQ client successfully reconnected

Additional context
I attached the related log file and all diagnostic information.
halog_220310.txt
ac_smartthinq_sensors-4d74505453f4a2df3d862bbd7cc63a21-aircon-55ad8c027eb2fc445acba60e5a3ba20f.json.txt
DRYER_smartthinq_sensors-4d74505453f4a2df3d862bbd7cc63a21-의류건조기-b3f90380b5eddb85ce82ae6736015e0f.json.txt
REFRIGERATOR_smartthinq_sensors-4d74505453f4a2df3d862bbd7cc63a21-냉장고-29c5cee43ef2477a7875a09a21679a2c.json.txt
STYLER_smartthinq_sensors-4d74505453f4a2df3d862bbd7cc63a21-스타일러-9a28a44e3c07328786c08cfc9496c43c.json.txt
WASHER_smartthinq_sensors-4d74505453f4a2df3d862bbd7cc63a21-세탁기-46ff7af95d6fa8a66f3e544c642e478e.json.txt

This is new, response coming in XML format instead of JSON!
If I well understand, problem is related to the WASHER device. Does the issue occurs also if washer is turned on?

Thank you for your reply.
same issue after washer is on.

I attatch the full log file again. (smartthinq_sensors debug)
log_smartthinq_sensors_debug_220312.txt
and another problem here.
wash complate sensor never go to 'off' after 'on'

Wash complete sensor go to off when you start a new cycle, this is not an issue.
I just released a new version to try to handle this XML error, try it and let me know if fix the issue.

I deleted my integration, reinstalled new version.(via redirect url auth)
But same error occurred.
이 오류는 사용자 통합 구성요소에서 발생했습니다.

Logger: custom_components.smartthinq_sensors.wideq.device
Source: custom_components/smartthinq_sensors/wideq/core_v2.py:117
Integration: SmartThinQ LGE Sensors (documentation, issues)
First occurred: 12:13:39 (12 occurrences)
Last logged: 12:49:40

Unexpected error while updating device status (device: d27dfde0-7149-11d3-80be-7440be2c47ed (AC))
Unexpected error while updating device status (device: 701b6da0-3782-11ec-b452-0051ed794b04 (WASHER))
Unexpected error while updating device status (device: be690140-7c24-11e9-b214-0051ed43543e (REFRIGERATOR))
Unexpected error while updating device status (device: 8b89a0e0-7c24-11e9-b406-0051ed6c76d5 (STYLER))
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 910, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/simplejson/__init__.py", line 525, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/site-packages/simplejson/decoder.py", line 370, in decode
    obj, end = self.raw_decode(s)
  File "/usr/local/lib/python3.9/site-packages/simplejson/decoder.py", line 400, in raw_decode
    return self.scan_once(s, idx=_w(s, idx).end())
simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/config/custom_components/smartthinq_sensors/wideq/device.py", line 229, in refresh
    state = self.poll(query_device)
  File "/config/custom_components/smartthinq_sensors/wideq/device.py", line 325, in poll
    return self._poll_v1()
  File "/config/custom_components/smartthinq_sensors/wideq/device.py", line 337, in _poll_v1
    return self._client.session.monitor_poll(self._device_id, self._work_id)
  File "/config/custom_components/smartthinq_sensors/wideq/core_v2.py", line 818, in monitor_poll
    res = self.post("rti/rtiResult", {"workList": work_list})["workList"]
  File "/config/custom_components/smartthinq_sensors/wideq/core_v2.py", line 727, in post
    return lgedm2_post(
  File "/config/custom_components/smartthinq_sensors/wideq/core_v2.py", line 239, in lgedm2_post
    out = _get_json_resp(res)
  File "/config/custom_components/smartthinq_sensors/wideq/core_v2.py", line 117, in _get_json_resp
    return response.json()
  File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 917, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: [Errno Expecting value] <lgedmRoot><returnCd>9999</returnCd><returnMsg>기타오류</returnMsg></lgedmRoot>: 0

이 오류는 사용자 통합 구성요소에서 발생했습니다.

Logger: custom_components.smartthinq_sensors.wideq.device
Source: custom_components/smartthinq_sensors/wideq/device.py:206
Integration: SmartThinQ LGE Sensors (documentation, issues)
First occurred: 12:14:08 (12 occurrences)
Last logged: 12:50:08

ThinQ client successfully reconnected

ha log is here:
log_smartthinq_sensors_debug_220313.txt

I realize just now that you have installed the module simplejson that break the exception handling as reported in some threads that you can simply find on internet. I suppose that this was installed by some others custom integrations, could you try to remove these and check what happen?

Anyway I just released a new version that should catch also the exception generated by module simplejson. Please try it and let me know if this fix the issue.

Thank you ollo69,
In 0.12.11.
As you said, I deactivated some custom integration&components, but the error occurred the same.
I don't know how to find it comfortably, I can't find using 'simplejson' custom components folder.
(all .py and .json file, search 'simplejson' with notepad++)
I'm just using the following integrations except for the ones that are default provided:
(I don't know if it will help you.)
[via HACS]
https://github.com/hacs/integration
https://github.com/staiji/citywaste_korea
https://github.com/GuGu927/damda_awair
https://github.com/ollo69/ha-smartthinq-sensors
[via integrations]
https://www.home-assistant.io/integrations/broadlink
(https://github.com/home-assistant/core/tree/dev/homeassistant/components/broadlink)
https://www.home-assistant.io/integrations/smartthings
(https://github.com/home-assistant/core/tree/dev/homeassistant/components/smartthings)
https://www.home-assistant.io/integrations/withings
(https://github.com/home-assistant/core/tree/dev/homeassistant/components/withings)
https://www.home-assistant.io/integrations/xiaomi_aqara
(https://github.com/home-assistant/core/tree/dev/homeassistant/components/xiaomi_aqara)
https://www.home-assistant.io/integrations/xiaomi_miio
(https://github.com/home-assistant/core/tree/dev/homeassistant/components/xiaomi_miio)
https://www.home-assistant.io/integrations/mobile_app
(https://github.com/home-assistant/core/tree/dev/homeassistant/components/mobile_app)
[in custom_components folder manually]
https://github.com/fison67/HA-Edge-Connector
So, I just updated version 0.12.12.
No more error in "Logs" now.
In the full log, 'error decoding json response' still appears. But 'reconnected' log disappeared.
I will have to wait and see if there is any problem with actual use.
Do I  have to something?
log_smartthinq_sensors_debug_220313_0.12.12.txt

Well, now this is just a debug message that is managed, so you can just disable debug log and you will not see it anymore. What is important is that everything works properly and status are correctly updated for all devices. So let's wait some time for testing, if everything will be fine we can close the issue, otherwise report here any new problems.
About disabling other integrations, does not make any difference now because module simplejson is installed (in the folder /usr/local/lib/python3.9/site-packages/simplejson/ as reported in your log) and so is used by requests. You could try to uninstall it using pip  at command prompt, but I suggest to avoid this, at the end this is a module supported by requests itself so is should work well as default json python library. The only problem was to manage related exception, but with last release this seems be solved.

Thank you for your support.
I wait and see about 2~3 days.

everything works fine. thank you.


use last fileGrp as default

https://github.com/hnesk/browse-ocrd/blob/14cee74566ce1d94995d69eaa0baf658ec7d31fa/ocrd_browser/view/base.py#L84-L85
This often does not exist in real life (DFG profile has DEFAULT or MAX or ORIGINAL), and has empty PAGE XML anyway. So IMO it would make more sense to pick the last fileGrp with PAGE-XML mimetype by default.
(Or even better, make this configurable as well, like the default image fileGrp.)

The method use_file_goup() is just the fallback, if not overridden in subclasses. For nearly all subclasses there is a property file_group that will be used instead. I changed the configurator to always select the last entry now.
Keeping the ticket open for making file_group selection also configurable.

For nearly all subclasses there is a property file_group that will be used instead.

Oh right! Sry, forgot all about that.

I changed the configurator to always select the last entry now.

Thank you!

I changed the configurator to always select the last entry now.

Thank you!

Which did of course solve the issue.


Sender onboarding research w/Agile 6

Collaboration with Data Automation and Agile 6.

Proposal doc from Hayley:
https://docs.google.com/document/d/1f5a1ZqLaNLOQyBypaE92fCg42xUwCTnIPmrkxn3mqQI/edit?usp=sharing


Fix test target

#227 - comments to the Unit tests issue
I converted the Test target to logic test, to speed up the test runs and get a better view of code coverage. Also moved the performance tests to different target.

Thanks for this! Will review soon 😄

@barijaona oh i hadn't merged this because it uses an old version of cocoapods :S - you'll need to update the project back to cocoapods 1.x instead of 0.39.x.

@barijaona I suggest we back this change out as it has broken our builds if we try to upgrade to cocoapods 1.0.1.


Erase scala.runtime.BoxedUnit to java.lang.Void.

This removes one more dependency of the IR specification on the Scala namespace, in the handling of primitives, which is pretty core.
java.lang.Void makes sense as the boxed class of Unit because

scala.Unit is to void as scala.Int is to int
Other boxed classes have a TYPE static field that represent the classOf of their corresponding primitive, and java.lang.Void precisely has a TYPE field that represents classOf[Unit].

java.lang.Void is safe enough to reuse as it cannot have any instance in the JVM spec (barring evil uses of reflection). Now we're giving it exactly one instance: undefined.
Since java.lang.Void does not extend java.io.Serializable, this introduces a weird discrepancy wrt. Scala/JVM: a boxed () will not answer true to .isInstanceOf[Serializable]. However, it does not seem like something would ever do. An alternative would be to alter java.lang.Void and make it extend java.io.Serializable anyway. This is a binary compatible extension so we could do it later if necessary.
Another semantic difference introduced by this change is that ((): Any).getClass().getName() will now return java.lang.Void instead of scala.runtime.BoxedUnit.

Will this change affect the output of e.g.: println(Seq((), (), ()))?

No, it won't. The change in this PR does not change the string representation of (). It only changes the string representation of ((): Any).getClass.


New version: GLMakie v0.1.7

Registering package: GLMakie
Repository: https://github.com/JuliaPlots/GLMakie.jl
Created by: @SimonDanisch
Version: v0.1.7
Commit: 05d9591530b71d1ab136d639ed6fea9dc8d50be0
Reviewed by: @SimonDanisch
Reference: https://github.com/JuliaPlots/GLMakie.jl/commit/05d9591530b71d1ab136d639ed6fea9dc8d50be0#commitcomment-40393618

@SimonDanisch how did this happen? 0.1.6 is tagged https://github.com/JuliaPlots/GLMakie.jl/releases/tag/v0.1.6
Perhaps this PR just needs to be rebased? @DilumAluthge

@SimonDanisch Can you retrigger Registrator? This will rebase the PR and fix the merge conflicts.
[noblock]

Does this need to be merged before #17924 ?
[noblock]


Proxy configuration

I have tried to put this behind an apache2 proxy/vhonst, but have failed with everything I know how to try.  Is this possible?  Are the loopback calls based on the config or based on the URL?  Please tell me if I missed something obvious.  All works awesome if I go directly to port 8081, but when I proxy/vhost, the logs, status and other things stop working.
Sample vhost I was using:
<VirtualHost <IP_ADDRESS>:80>
ServerName homebridge.wiesalani.com
ServerAdmin<EMAIL_ADDRESS>DocumentRoot /var/www/html
ErrorLog ${APACHE_LOG_DIR}/error.log
CustomLog ${APACHE_LOG_DIR}/access.log combined
ProxyPass / http://localhost:8081/ nocanon
ProxyPassReverse / http://localhost:8081/

Thanks and great job.

Hi @theOrakle,
You'll need to add support for WebSockets to your apache vhost config. I'm not how to do this on apache, but for nginx I posted the config here: https://github.com/oznu/homebridge-config-ui-x/issues/35#issuecomment-366680023 which you might be able to translate.
Otherwise doing a google search for "how to proxy websockets in apache" should help.
The web socket path is /.

Awesome - thank you.
Here is what I came up with that works for apache after some googling...
<VirtualHost <IP_ADDRESS>:80>
ServerName homebridge.wiesalani.com
ServerAdmin<EMAIL_ADDRESS>DocumentRoot /var/www/html
    ErrorLog ${APACHE_LOG_DIR}/error.log
    CustomLog ${APACHE_LOG_DIR}/access.log combined

    <Location />
            ProxyPass http://localhost:8081/
            ProxyPassReverse http://localhost:8081/
            RewriteEngine on
            RewriteCond %{HTTP:UPGRADE} ^WebSocket$ [NC]
            RewriteCond %{HTTP:CONNECTION} Upgrade$ [NC]
            RewriteRule .* ws://localhost:8081%{REQUEST_URI} [P]
    </Location>

~

See https://github.com/oznu/homebridge-config-ui-x/wiki/Reverse-Proxy:-Apache for latest template.


Allow VS to Precompile Razor

Good morning Microsoft!
Right now I have a few challenges with Razor:

CSHTML files are not compiled at compile time.

This causes a performance hit the first time the page is accessed.
If I have a typo in my code, I have to wait till runtime to discover that.  For example, if I had:

@Model.FirstNane @* <-- FirstName is misspelled*@

I have to wait until runtime to test this out and discover that I have an error.

Refactoring a model's member does not refactor into the CSHTML file.  For example, renaming Model.Name to Model.FullName leaves me with a lot of broken views that I have to Find/Replace/Pray I got them all.

There are a number of times when I've wanted to use Razor for different kinds of non-web content generation.  Email templates are an example.  To do this, I have to use a third-party tool like RazorEngine and deal with a lot of RazorEngine Overhead.  I have to do things like managing embedded resources, etc and it basically creates a lot of mess I have to work with.

I would like to be able to do something like this instead:

@class MyApp.Templates.HelloTemplate
@model MyApp.Templates.HelloModel

Hello @Model.FirstName!

and then in my code do something like this:
var Template = new MyApp.Templates.HelloTemplate();
var Model = new MyApp.Templates.HelloModel { FirstName = "Robert" };
var Output = Template.Execute(Model);

and I believe that if Razor supposed precompilation / compile time compilation, that all three would be taken care of at once.
Thanks!

I needs somethings like RazorEngine do.Specially:
Rendering an in memory View string, not finding for a file in a certain location.

https://github.com/aspnet/Razor/issues/642

It seems to be a good UX improvement if errors and warnings are thrown on project been built.
It's very inconvenient to check all the views after a class been renamed or smth like.

Rendering Razor to a string is tracked here: https://github.com/aspnet/Mvc/issues/3091
As far as pre-compilation goes, there's already support for that today, but we're looking at making improvements and changes in that area. Here's a post I found that shows how to do this: https://mjomaa.com/computer-science/frameworks/asp-net-mvc/158-how-to-enable-precompiled-razor-views-cshtml-in-asp-net-5


License

Any chance you can dual license this under a license allowing closed source usage? We need to embed a simple build system in a commercial application, and this is a good candidate. But we need to do some additional work on a fork (highly proprietary changes, not relevant for upstream inclusion)
Unfortunately, GPL prevents us from using Bob. I understand if you want to stick with GPL, just figured asking wouldn't hurt.

Honestly when choosing a license the only thing I wanted was getting improvements back, but in the past day many people have told me they rather have a more permisive license.
bob will be under the MIT license from now on.

Great news


Add exported encoder/decoder opts for zstd

Fixes: https://github.com/mholt/archiver/issues/183
Allows setting of any encoder or decoder options when imported.
In the referenced issue zstd.WithDecoderLowmem(false) could be set for example.

Makes perfect sense to me. Thanks.


Fix back-button history for turbo-frames

There is an issue with turbo-frame elements where you can target them to be updated while preserving the overall page state, but the URL does not change to reflect this and the browse back button does not work. This may be intended behavior or it may be a bug with Turbo, I can't tell. I have an open issue with them here: https://github.com/hotwired/turbo/issues/1156
But regardless, we want it to work because clicking a conversation in the left sidebar refreshes the turbo-frame id="conversation" in the right side. We do the frame refreshing because we want the scroll position of the left side to remain preserved.
This works by manually updating the browser's pushState and manually handling the back button for these cases. Demo here: https://share.zight.com/jku8YrZLj

this is awesome. it would be good to write a rails system test for this, I don't think it would be hard at all to represent this in there.

Good call, I'll start a new PR with tests. I want to add tests for a few of these stimulus things I've done recently.


Build fails when using aws-sdk and webpack

We've enabled webpack for our project as specified in the NS documentation, but the bundling fails with the following error:
ERROR in ../node_modules/xml2js/lib/xml2js.js
Module not found: Error: Can't resolve 'timers' in '/Users/nicolae.surdu/work/theproject/node_modules/xml2js/lib'

 @ ../node_modules/xml2js/lib/xml2js.js 19:17-34
 @ ../node_modules/aws-sdk/lib/xml/node_parser.js
 @ ../node_modules/aws-sdk/lib/node_loader.js
 @ ../node_modules/aws-sdk/lib/aws.js
 @ ./services/aws/loginService.js
 @ ./services/aws/aws.js
 @ ./app.js

I didn't manage to find anythong about this issue on Google, but I have a fuzzy feeling it fails because nodescript-nodeify didn't get to do it's magic.
Am I worng assuming this ?

Dupe of #35


Text Editor: Copying without selection (Ctrl+C) erases the clipboard contents

Tested versions

Reproducible in: 4.3stable

System information
Debian GNU/Linux 12.7
Issue description
Copying without having some text selected (Ctrl+C) in the text editor erases the clipboard contents. It's annoying because pressing accidentally Ctrl+C instead of Ctrl+V erases what was going to be copied.
Pressing Ctrl+X does the same and also removes the current line. This is even more surprising.
What these commands do when there's no selection is auto-select the current line, even if it's empty. I think this isn't documented anywhere and it isn't intuitive. I haven't seen this behavior in any other text editor. It's totally unexpected and becomes very annoying when doing mistakes while using the clipboard shortcuts.
Could we have a more agnostic behavior and maybe add a setting for the current one?
Steps to reproduce

Select some text in the text editor and press Ctrl+C.
Move the cursor to another place without selecting text.
Press Ctrl+C, nothing seems to happen.
Press Ctrl+V, the text copied previously doesn't get pasted.

Minimal reproduction project (MRP)
Not needed.

There is already a setting available to turn off this behavior. Go to Editor Settings -> Text Editor -> Behaviour and turn off Empty Selection Clipboard.

I had missed that that was implemented already
Closing as already solved, thank you for your bug report nonetheless!

Thanks. That's good. Waiting for the final release.


Split parsing into phases

Right now, we've got a single build_from.py script, which

parses the initial XML file to generate an initial tree
reads and parses all notice XML files
writes the initial tree
generates and writes layers based on that initial XML
incrementally builds revisions
writes those out, along with their layers
calculates diffs between layers and writes those out

This pipeline works well when there's no parsing errors, but when there are, it can be a very long time before developers find them (as they wait for the other phases to end). While each of these steps is relatively self contained in terms of code, there aren't entry points to run each individually.
One could imagine one of the above phases fails, the developer figures out why, provides a fix, and then retests from that point.

Do we have an example of one that fails?  would be helpful for someone new getting started on this

I believe every regulation in 11 CFR other than 110 will fail, currently. I
can't remember exactly, though.
On Wed, Mar 25, 2015 at 3:10 PM, Sarah Allen<EMAIL_ADDRESS>wrote:

Do we have an example of one that fails? would be helpful for someone new
getting started on this
—
Reply to this email directly or view it on GitHub
https://github.com/18F/regulations-parser/issues/6#issuecomment-86233342
.

This was resolved with the pipeline / eregs command


Support --skip-crds flag

Support the --skip-crds flag that was added in Helm 3.1.2

New property skipCrds on HelmInstall, HelmUpgrade and HelmTemplate tasks
New property skipCrds on HelmRelease
New Gradle project property helm.skipCrds for global default

fixes #171


Copy and Search on Selection

I love the copy-on-selection super-power you just added to VSCode: https://code.visualstudio.com/updates/v1_20#_copy-on-selection
Feature Request
Please can you add a copy-and-search-on-selection super-power to VSCode?
I find that 99% of the time that I copy text from the console it's to do a Ctrl+Shift+F (global find) in the code base.
This would enable those of us who work like this to skip the Ctrl+Shift+F step and hit enter right away to search.
Those that don't work in this way would not enable this option. (i.e. it would be off by default - same as copy-on-selection)

@roblourens to implement this would a new command that's active for ctrl+shift+f when terminalFocus be the best approach?

@guyellis so you wan to do a global search using the selection in the terminal? I think it makes sense to transfer the selection to global find when ctrl+shift+f is pressed but to launch a search when any selection happens is very specific and likely also be detrimental to performance.

@Tyriar do you say that it will be detrimental to performance because search is not a faster operation? If so, then I would agree with that statement.
My feeling is that when a developer selects something in the console (with copy-on-select enabled) most of the time it is then to do a global search. So if there was an option to copy-and-search-on-select that the global search box would be opened, populated with the selected text and given the focus. All that would be left to do would hit enter which I would imagine would still be a manual final operation so that in those cases when a search was not needed you wouldn't hit enter.
Does that make sense?

My feeling is that when a developer selects something in the console (with copy-on-select enabled) most of the time it is then to do a global search

I disagree, I'm normally copying file names or command output to paste elsewhere. I don't think we'd want to support the flow you're proposing as so few people would discover/use it, could be bad for perf (unnecessary searches could be costly) and it does weird things with focus when you select.
I definitely want to auto fill when ctrl+shift+f happens though which should the needed actions to ctrl+shift+f and enter as you would do in the editor. Let's track that in this issue :+1:

It looks like the search viewlet pulls in the text from the active editor, I was expecting this to be done at the level of the command. @roblourens any suggestions on how to seed the search string from the terminal when it was focused? I was thinking of adding a separate command when: "terminalFocus" but that's not how the editor does it.

I tried to clean this up once and ended up reverting it. A couple cases that I think were tricky

Selecting text in the editor then invoking search from the menu, the editor is not focused in this case
Clicking the activity bar icon, editor loses focus

We could add a command for the terminal with the 'when' like you suggest and have all the commands set the text instead of having the search viewlet do it. Just need to make sure it works for clicking the activity bar icon which I think is a generic "show viewlet" command.


Give this plugin a proper folder structure

This plugin was developed directly on the browser.
That makes maintaining it and updating it a pain. Investing some time splitting it in several files and adapting it to the node.js workflow is definitively a must go.

Yes please do so, I wish I could easily use it with nodejs without dragndrop!
Thanks
-Felix

This have been resolved on 6ce36817b2b9482544bd7ef9ef6445abd0f67259

Yes! Many thanks @danielo515 for taking care of this!

Should I expect some pull request @felixhayashi  ? :tongue:

Should I expect some pull request

Well I didn't plan any at the moment but you never know ;)

But now with your new repo structure and name, we can better promote your plugin!

Indeed! Promotion is as important as developing!


Use go embed to store files and write test cases

Issues
Part of - https://github.com/OpsLevel/team-platform/issues/278
Changelog

[x] Use //go:embed to store config, test files in the testdata/ directory
[x] Re-write tests to use these embedded values (this is more accurate than the previous tests because every single element in a list is examined, not just the length of a list.)

[x] Generated the *_expectation.json files by outputting the marshal output from the main branch before testing anything

[x] Fix tests that are failing

[x] Add repositories: [] and tools: [] in *_expecatation.json - this is necessary because otherwise the expectation will contain nil for those 2 fiels whereas in the actual application those 2 are always initialized to an array.
[x] Add a sort function to when tags keys are extracted from a hashmap - this approach is bad but this will be fixed in a later PR.

Overall these are good changes.
I really like the huge yaml + json formatted vars being moved into files and using go embed to read them in. Good test improvements too.
These two items could have been a quick and easy PR to review on their own since neither of these changes introduce any change in behavior.
The json struct tag change seems innocent, but I do wonder if there was a reason for those not being there before.
The slice sorting seems like a code smell to me. Since this repo aims to be a lightweight "opslevel-go data structs + native jq" wrapper, I'm leaning very much toward using the blazingly fast 🐎💨 native jq to do the sorting


Update LICENSE

Closes #12

Codecov Report

Merging #89 (699eaed) into main (2414593) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #89   +/-   ##
=======================================
  Coverage   18.71%   18.71%
=======================================
  Files          23       23
  Lines        7187     7187
=======================================
  Hits         1345     1345
  Misses       5842     5842

:mega: Codecov can now indicate which changes are the most critical in Pull Requests. Learn more


fix(meta): fix  meta-service crash down because of unwrap error

Signed-off-by: Little-Wallace<EMAIL_ADDRESS>I hereby agree to the terms of the Singularity Data, Inc. Contributor License Agreement.
What's changed and what's your intention?
Fix bug which barrier-manager does not hold error of meta-storage.
Checklist

[x] I have written necessary rustdoc comments
[x] I have added necessary unit tests and integration tests
[x] All checks passed in ./risedev check (or alias, ./risedev c)

Documentation
If your pull request contains user-facing changes, please specify the types of the changes, and create a release note. Otherwise, please feel free to remove this section.
Types of user-facing changes
Please keep the types that apply to your changes, and remove those that do not apply.

Installation and deployment
Connector (sources & sinks)
SQL commands, functions, and operators
RisingWave cluster configuration changes
Other (please specify in the release note below)

Release note
Please create a release note for your changes. In the release note, focus on the impact on users, and mention the environment or conditions where the impact may occur.
Refer to a related PR or issue link (optional)
#4919

Any updates?

I think this is unnecessary after #5056. 🤔

I think this is unnecessary after #5056. 🤔

@Little-Wallace Please help to confirm 😋


Download a BAK or BACPAC file from a SQL Backup in recovery vault

Hi,
I have a SQL Server database installed on a Azure VM and I use Recovery vault for the database backup.  Is there a way to download a database backup from Recovery vault? If not, is this feature planned? for recovery vault?
Thanks

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 142ddb2b-65ef-10f4-0e68-f9af6f0e3d52
Version Independent ID: 74e33ef9-9a43-8ae6-abbd-a84f1cf91a25
Content: Azure Backup: Recover files and folders from an Azure VM backup
Content Source: articles/backup/backup-azure-restore-files-from-vm.md
Service: backup
GitHub Login: @dcurwin
Microsoft Alias: dacurwin

Thanks for your comment. We are actively investigating and will get back to you shortly. Thanks for your patience.

@dcurwin - Fyi

@jjghali  AFAIK, you can't directly download the bak file . I could suggest a workaround where you could restore DB to an alternate server and take a DB backup from there. In this way , you will be able to get back file. Kindly refer this documentation on how to restore DB to an alternate location.
@dcurwin Can you please provide your insights on the same?

@jjghali  AFAIK, you can't directly download the bak file . I could suggest a workaround where you could restore DB to an alternate server and take a DB backup from there. In this way , you will be able to get bak file. Kindly refer this documentation on how to restore DB to an alternate location.
@dcurwin Can you please provide your insights on the same?

I agree with your conclusions here.

@dcurwin Thanks for your input.
@jjghali  I would recommend you to navigate here and share your feedback or suggestions directly with the responsible Azure feature team.
We will now close this issue for now. If there are further questions regarding this matter, please respond and we will gladly continue the discussion.

@SwathiDhanwada-MSFT Ok, i did it. Thanks.


[Discussion] : Distribution via Bioconda

Continuing from #22

The problem is, that doesn’t work with this code. We immediately get an illegal instruction error. You can see this, e.g. if you pull down the latest piscem from bioconda.
One question I had is, what compiler flags do we actually need? For example, rosetta 2 handles many intrinsics fine (e.g. SSE4.2), but not others (e.g. AVX512). I am not certain if it handles BMI2 or not.
My thought is, if we figured out what instructions it can handle — we could perhaps add a “CONDA_BUILD” flag to the CMake scripts that would skip march=native, but would still pass the most essential performance flags to the compiler. This would produce (ideally) an x86_64 executable that may not be quite as optimized, but which would run on both x86_64 and M1/2 Macs. Let me know if you have any questions or thoughts on this.
Yeah, we should get an idea of what instructions are not permitted there...but anyway I do not think a x86 binary would execute well on ARM.

Ok, we are mixing two separate (although related) things in this thread:

support SSHash on ARM (which, now, it should be done!);
distribute SSHash via bioconda.
For point 2. I do not know since I haven't used bioconda and I'm not familiar with that. But if they do not have any M1/M2 build hosts...then it's not SSHash's (hence, nor our) fault :D Eventually they should get some building environment, I suppose, no?
For the moment, we could just warn the users about this bioconda's limitation and ask them to download SSHash directly from GitHub and compile it manually (which is trivial).

The discussion here is in regard to 2.  I have two thoughts here.

I absolutely agree that, until native M1/2 builds are available from bioconda, it would be better for folks to compile themselves, and for that to be made as easy as possible (could we provide pre-compiled binaries?)

Regarding performance, actually, rosetta 2 is pretty amazing in my experience.  Even through translation, the M1 (Pro/Max) often outperforms the previous top-end MacBook Pros running i9.  My understanding is that rosetta 2 directly translates many of the x86 intrinsics to native Neon intrinsics (or whatever special instructions the M architecture has).  While I agree that compilation isn't difficult, I also have a lot of prior experience telling me that my making that statement is very different than the experience a biologist who doesn't focus on software/methods trying to build my tool will have.

Of course, I absolutely understand if you think supporting bioconda builds that run on M1/2 isn't of sufficient priority to warrant effort at this point — we could ask the bioconda people what their path forward and intended timeline is.  On the other hand, it would be nice to know what is the delta between what march=native offers and what instructions are actually useful / necessary.  It may be that we can remove that flag in Conda builds, explicitly specify the instructions we want, and get little-to-no performance degradation and the ability to distribute something via Conda that works on all platforms (which makes it trivial for people to use both locally and on a cluster).

Hi @rob-p and sorry for the late reply to this.
I'm interested in distributing SSHash via Bioconda (but I first have to learn how to do it).
If distribution currently fails because of some compiler flags, a reasonable thing to try is to remove them and see if compilation goes well on bioconda.
Do you know if there is a better way of checking or we have to proceed by trial and error?

Hi @jermp,
No worries — things are busy on this end as well ;P.
So, the issues that I can see are the following (btw, currently the compilation of pisces-cpp that is done when distributing via bioconda works, it's just that the resulting executable may use instructions that are not available on all client machines):

march=native refers to the machine that the CI is running on, and so using march=native in a bioconda build gives up strict control over what instructions will be used.

The -bmi2 flag uses some instructions that are likely either unavailable or untranslatable on M1/M2 hardware.

So both of these have the following implications. Bioconda builds will likely work on most client machines, but would fail on machines that lack either instructions included because of march=native or machines not supporting bmi2 instructions.  Further, a bioconda build built with these flags won't run on an M1/M2 machine, since the current bioconda CI infrastructure is x86-64 and, while rosetta2 can translate most intrinsics, I think it, perhaps, can't translate the bmi2 stuff.
If you just want the bioconda build to work on x86-64, it will probably already work on most machines, but we might want to explicitly list out the useful instructions and remove march=native when building is being done via bioconda (which is easy because you can pass arbitrary variables in the call to cmake).  If, in addition, you'd want the current bioconda build to run on M1/M2 under rosetta2 you'd have to get rid of any instruction that rosetta2 can't translate.  Of course, since there are not many platforms that one has to support with M1/M2, you could instead just provide your own pre-compiled binaries for those until bioconda gets apple silicon CI instances.

Alright, let's dig into -march=native then! I'll do some research that update this thread.

Following from here: https://wiki.gentoo.org/wiki/Safe_CFLAGS#Find_CPU-specific_options, by doing
giulio@xor:~$ gcc -v -E -x c /dev/null -o /dev/null -march=native 2>&1 | grep /cc1 | grep mtune

I get
 /usr/lib/gcc/x86_64-linux-gnu/11/cc1 -E -quiet -v -imultiarch x86_64-linux-gnu /dev/null -o /dev/null -march=skylake -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -mno-sse4a -mno-fma4 -mno-xop -mfma -mno-avx512f -mbmi -mbmi2 -maes -mpclmul -mno-avx512vl -mno-avx512bw -mno-avx512dq -mno-avx512cd -mno-avx512er -mno-avx512pf -mno-avx512vbmi -mno-avx512ifma -mno-avx5124vnniw -mno-avx5124fmaps -mno-avx512vpopcntdq -mno-avx512vbmi2 -mno-gfni -mno-vpclmulqdq -mno-avx512vnni -mno-avx512bitalg -mno-avx512bf16 -mno-avx512vp2intersect -mno-3dnow -madx -mabm -mno-cldemote -mclflushopt -mno-clwb -mno-clzero -mcx16 -mno-enqcmd -mf16c -mfsgsbase -mfxsr -mno-hle -msahf -mno-lwp -mlzcnt -mmovbe -mno-movdir64b -mno-movdiri -mno-mwaitx -mno-pconfig -mno-pku -mno-prefetchwt1 -mprfchw -mno-ptwrite -mno-rdpid -mrdrnd -mrdseed -mno-rtm -mno-serialize -msgx -mno-sha -mno-shstk -mno-tbm -mno-tsxldtrk -mno-vaes -mno-waitpkg -mno-wbnoinvd -mxsave -mxsavec -mxsaveopt -mxsaves -mno-amx-tile -mno-amx-int8 -mno-amx-bf16 -mno-uintr -mno-hreset -mno-kl -mno-widekl -mno-avxvnni --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=16384 -mtune=skylake -fasynchronous-unwind-tables -fstack-protector-strong -Wformat -Wformat-security -fstack-clash-protection -fcf-protection -dumpdir /dev/ -dumpbase null

on a server, from which we see that arch=skylake there. But I'm still not sure which optimizations it brings.

lol, there are a lot there!  So it looks like it does explicitly pull in all of the relevant SSEs up to 4.1 (which I've read before is actually necessary; i.e. telling the compiler SSE4.2 doesn't imply it will also use 4.1 and earlier intrinsics too). It also has the bmi and bmi2 instructions, popcount, mmx, (avx and avx2 — which we probably don't want to require?). There's also aes which may be important depending on which hashing functions are being used; though I am not sure of hardware support for that more broadly (I think it's on all modern x86 chips).  Many of these are -mnoX (so turning off support), but the others that are included, I am not familiar with.

I think all that is required in the end can be understood from here https://github.com/jermp/pthash/blob/master/include/encoders/util.hpp -- from some special instructions PTHash uses: popcount and parallel-bit-deposit (or pdep). For popcount: _mm_popcnt_u64 requires SSE4 (and #include <immintrin.h>), but can just use __builtin_popcountll on gcc. For pdep, we actually need BMI2 for best performance but can also run if that flag is not specified.
SSHash by itself does not introduce any further special instruction.

And it would be instructive to compare the performance of both tools, PTHash and SSHash, with and without those compiler flags to see how much they impact. I did it in the past for other libraries and I can confirm both builtin_popcount and pdep were much better than other approaches for rank and select (see also the benchmarks in this paper https://doi.org/10.1016/j.is.2021.101756).

So, I think pdep may be the only critical one there.  For popcnt we could try and rely on SIMDE (but, honestly, I don't think there are any machines that don't support SSE4 that we would want to bother running on — the Apple silicon can emulate this with ARM intrinsics I believe).
For pdep — it looks like Intel introduced BMI and BMI2 support at the same time (Haswell and later), while AMD Excavator and newer support BMI2. At this point, we are talking about decade old hardware, so I don't think we should worry about requiring it on the x86 side.  I don't know if Apple silicon will translate those instruction or what the effect of trying to compile with -bmi2 on those machines is. I have to imagine there is an ARM/Neon equivalent — perhaps we could just specialize those specific parts of the code to make sure there is always a pdep enabled hot path.

Ok, so it looks we have reduced the problem to

inspect the impact of BMI2 on x86 machines;
and see what are the options for ARM.
Will do it soon.

A small update on this matter: PTHash benchmark with and without options -march=native -mbmi2 -msse4.2.

It does not change much expect for Elias-Fano, as I expected because its code is the one relying on PDEP for faster selection in a 64-bit word. With the compiler options, Elias-Fano is almost 2X faster.
So I would expect to see a similar effect for SSHash as well because it is using Elias-Fano in a couple of places (but hopefully, not a ~2X slowdown...).

 Elias-Fano went from 45 ns/key to 80 ns/key.

Thanks @jermp!
I wonder if there is a simde equivalent library for the pdep instruction.  That is, would it be possible to compile without the flag, but to have a library that provides runtime dispatch using this instruction if available but not otherwise?

 This is consistent with the output here
/usr/lib/gcc/x86_64-linux-gnu/11/cc1 -E -quiet -v -imultiarch x86_64-linux-gnu /dev/null -o /dev/null -march=skylake -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -mno-sse4a -mno-fma4 -mno-xop -mfma -mno-avx512f -mbmi -mbmi2 -maes -mpclmul -mno-avx512vl -mno-avx512bw -mno-avx512dq -mno-avx512cd -mno-avx512er -mno-avx512pf -mno-avx512vbmi -mno-avx512ifma -mno-avx5124vnniw -mno-avx5124fmaps -mno-avx512vpopcntdq -mno-avx512vbmi2 -mno-gfni -mno-vpclmulqdq -mno-avx512vnni -mno-avx512bitalg -mno-avx512bf16 -mno-avx512vp2intersect -mno-3dnow -madx -mabm -mno-cldemote -mclflushopt -mno-clwb -mno-clzero -mcx16 -mno-enqcmd -mf16c -mfsgsbase -mfxsr -mno-hle -msahf -mno-lwp -mlzcnt -mmovbe -mno-movdir64b -mno-movdiri -mno-mwaitx -mno-pconfig -mno-pku -mno-prefetchwt1 -mprfchw -mno-ptwrite -mno-rdpid -mrdrnd -mrdseed -mno-rtm -mno-serialize -msgx -mno-sha -mno-shstk -mno-tbm -mno-tsxldtrk -mno-vaes -mno-waitpkg -mno-wbnoinvd -mxsave -mxsavec -mxsaveopt -mxsaves -mno-amx-tile -mno-amx-int8 -mno-amx-bf16 -mno-uintr -mno-hreset -mno-kl -mno-widekl -mno-avxvnni --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=16384 -mtune=skylake -fasynchronous-unwind-tables -fstack-protector-strong -Wformat -Wformat-security -fstack-clash-protection -fcf-protection -dumpdir /dev/ -dumpbase null

which also includes bmi2.

That is, would it be possible to compile without the flag, but to have a library that provides runtime dispatch using this instruction if available but not otherwise?

Would it be possible to detect it via CMake?

Yes. One can have cmake compile arbitrary code and see if it runs. There may even be a cmake module to check for this. For bioconda though, the fear is the host used to compile has this, but runtimte doesn't. In that case one can compile both and dispatch the correct one at runtime.  I do this with ksw2 in salmon.

Hi @jermp and @rob-p, I just would like to reopen this discussion about adding SSHash to Bioconda. The impossibility to install it from there is quite a limiting factor on our side, both for benchmarking purposes and also for its practical use (think of an old-school centos cluster where even zlib is not standardly available and compiling anything manually is a nightmare).


empty files generated during preprocess

Hi, I encountered the same issue as #1. Specifically, during the preprocessing,  *.parse are empty files.
However, I fail to solve this issue with jq installed and setting LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8.
Is there any other suggestion or possible solution here?

Hi @sysu-zjw
Since you have jq installed and habe correctly set LC_ALL, your error could be due to the java based parser, CoreNLP.
Can you verify that you can run the parser on it’s own? You can see scripts/parse.sh to see how it is currently called.

Hi @dojoteef I figured out that I should set LC_ALL=  instead of LC_ALL=en_US.UTF-8. Now I am able to generate non-empty results by executing:
LANG=en_US.UTF-8 LC_ALL= CLASSPATH=./stanford-corenlp-full-2018-10-05/* python main.py \
  --dataset wmt_en_de_parsed --span 6 -d raw/wmt -p preprocessed/wmt -v pass

I will close the issue. Thank you for the quick reply :D


生成的icon alpha通道默认打开了

same issue

Can you provide an example? What input image are you using? How does it affect the outcome?

source with no alpha

result with alpha

Thanks! Will look into this asap 👍

Should be resolved with v2.6.1

@raphaelhanneken @fenglee594  Are you guys sure this alpha channel issue applies to ios App icons as well? I just submitted an update 2 days ago with an App icon I generated using an older version - which includes alpha. The only thing iTunes rejects is alpha in the store icon (Marketing image). They allow alpha in app icons. Version 2.6.1 removes alpha from all icon sizes which is not required.


Re-export hyper_rustls from yup

Just a suggestion but you could re-export rustls from yup instead of depending on it directly

I will publish a new version later this week. Thanks for this suggestion and PR.


Minor spec bug: options.signal might not exist

Section 10.5.14 in spec.emu, step 4.c requires the options dictionary to have a signal property.  It's thus not really an option.  We need to allow options.signal to be undefined / not present.
This is intended for forwards compatibility, to allow other features to be added later.

https://github.com/ajvincent/proposal-mass-proxy-revocation/pull/17
Branch name: options-signal-optional
This was my fault.  I forgot the "?" character, and the spec matches the TypeScript definition.  Sorry about that!