Allow non-numeric issue identifier characters

For the git-start command, allow issue identifiers for non-numeric issues to be used, in order to support issues from systems other than Github.

Coverage increased (+0.002%) to 99.607% when pulling fa93e35723adb08c30131b7a471c267021fbd6b9 on f1sherman:allow-additional-issue-characters into a421a505de263f47698d24a498c7410710596333 on wireframe:master.

@f1sherman I've resolved the rubocop lint issues and you should be good to update (or rebase) this branch to master and get a green build!

Coverage increased (+0.002%) to 99.607% when pulling 6129cf8b3c354046583e322b7ad696e1b1ed0396 on f1sherman:allow-additional-issue-characters into 11800199e4f0173f18bcf86017290a015935c1e0 on wireframe:master.

@wireframe thanks! Build is passing now!


crash after reimport spark nodes

Hi,
the nodered crash after reimport sript with spark nodes and the message is:
Can't read from server.  It may not have the appropriate access-control-origin settings.
Regards,

Try v2.0.4. You may have to remove the previous flows and recreate. Also be sure your settings.js file is not setting httpNodeRoot to false.

I don't have the issue anymore, I upgraded to v2.0.5 and recreated the nodes
Thank you


The training script

Hello, when will you release the training script?

Hi, we just released the training script.

Thank you so much!


fixed sticker add

Fixed access to sticker URL to work with discord.js.
The way I check that the user actually supplied an attachment is probably not the most elegant, but testing seems to indicate that it works.

Sounds good


expected behavior of getExecutionResult() with RunAll stategy  ?

I have a main command with several nested sub commands.
I use :
CommandLine command = new CommandLine(mainCommand) .setExecutionStrategy(new RunAll());
int exitCode = command.execute(args);
Object executionResult = command.getExecutionResult(); // contain only result of the main command.

Is it the expected behavior ?
I expected to get a List<?> containing result of each executed command.
I'm able to have this behavior with :
new RunAll() {
    @Override
    protected java.util.List<Object> handle(picocli.CommandLine.ParseResult parseResult)
            throws picocli.CommandLine.ExecutionException {
        List<Object> result = super.handle(parseResult);
        parseResult.commandSpec().commandLine().setExecutionResult(result);
        return result;
    };

}

I open this issue just in case I face a bug.
If this is the expected behavior feel free to close the issue.

This is the expected behaviour.
An alternative to your solution is to use CommandLine.getParseResult to get a ParseResult object.
This object allows you to query whether a subcommand was detected, and get the ParseResult for the subcommand.
Same for sub-subcommands.

(Thx on my side this issue can be closed)


Add domain and range to some relations #973

Part of #973:
Add domains and ranges to has bearer, bearer of, is defined by and process attribute of#973

This PR catches now everything we agreed on so far in #973. There are more relations to cover in this issue, but it would be good to merge already these changes. So @stap-m  @jannahastings, could you please review this PR.


Locking Schedule Error

https://docs.google.com/document/d/1UU3129aPAsJYcmAS81K0ZFNos9WQVDhIjwVpd40DYII/edit#heading=h.1nvnn9e2o3zb

Testnet checks
When checking the test network, two policies were created
0x7bdd69ea7acd516deb3941696c658f82b6ceb5b9

0xffe81592bba9b67294720d84740ccf317f77a06a

The settings were set:
Invalid =<PHONE_NUMBER>, Valid =<PHONE_NUMBER>
Invalid =<PHONE_NUMBER>, Valid =<PHONE_NUMBER>

How to add a firewall?
The testnet firewall has been deployed here - https://testnet.bscscan.com/address/0x549Cdd962502111b7C28Fc43CC6BD27De0AD36B8#code
In order to finish the setup, for whichever consumer contracts you want to use the firewall/policies need to

Call setFirewall('0x549Cdd962502111b7C28Fc43CC6BD27De0AD36B8') on the consumer (LockProvider contract) with the account that deployed it (the deployer is the consumer admin by default)

Call addPolicy(consumerAddress, sighash, policyAddress) on the firewall contract with the same account used in (1)

Reproduce

set firewall tx: https://testnet.bscscan.com/tx/0x7541ec034660f455b4fa5393a3979b1f90f985ec07c441a8a9ea2e0c23fb5d67
added the first policy tx:
https://testnet.bscscan.com/tx/0x80bbbed4791d5143d621ea67e01c2439c82c8ea5c8f765d81608dabab85f138e
added second policy tx:
https://testnet.bscscan.com/tx/0x7fcb83be613afe8c20b323a47a7bd7264dd76ea65d2056125665db102def0aac

Results

The first policy is expected to fail: https://testnet.bscscan.com/tx/0x3054c630cd66a5e1205647a3623f9c5396b6fc8906690049c4d4a32d8b657b72

After valid time tx: https://testnet.bscscan.com/tx/0x9e342c3b4e3474c54c8b683ffcaca81d983f475096b4cf7a1a55b4ef0278df0e

The second policy is expected to fail: https://testnet.bscscan.com/tx/0x89144f6039e2f4ac10c7399ce305c303727366e83f96e5dda8860f5d6fe0bbe7

Mainnet policy integration

set firewall tx: https://bscscan.com/tx/0x8262c6cc209ead19f03fad5c1c18fe7d562c8e68d83f4afbde5914eb2399204b
Added policies:

first policy tx:
https://bscscan.com/tx/0xe08f035d5cd4b24823492d59d7dc20054dc3267306b409840f5063fc78abea32
second policy tx:
https://bscscan.com/tx/0xe3c8127591b035886bdfa3667c0ac952d3ddd65d4452721ab10a2590108a1f3b
third policy tx:
https://bscscan.com/tx/0xa2735e084d20f32d099b01e501c03937f3fb00f8f645d86ceb8c557f84072213

https://bscscan.com/address/0x1Ea5c59fd9F4f1095DF3a894e91c3B14cA3A1bb4


Feature: Implement CustomHeaders handling

When writing provider tests in pact-net 3.x.x  (that used the Ruby Implementation) we had the option to define CustomHeader manipulation. That was a useful feature, because in that way we could easily handle authentication token being invalid without having to use middleware to change requests on the fly.
Such implementation would then be called in other implementations that uses this one as the base for.
Thanks in advance

Thanks!

@mefellows just adding these to the HTTP client as default headers. This means that the headers will also be included on any state change call. I assume this is the same with the Ruby implementation.

Pact FFI 0.2.3 released


I225-V

Hello
i tried your new  method with the sddt-i225v.aml and the AppleIntell210Ethernet.kext, but it don't work. I still don't get aconnction. The ssdt should change the subsystem-vendor-id to 1043, but it don't change anything. I don't dare to flash the i225-v, so tried this method for Monterey and Ventura. I've also opened a issue in @SchmockLord, because i've a Vision D, but the path for the i225-v is the same.

All I know on the matter documented on my repo. I can't help you further.

But what could be the reason, that for example the subsystem-vendor-id don't chage to 1043 whe the ssdt is used. Does it change it on your side?

Verify the location of the I225 controller and adjust the ACPI path if necessary. On the Z490 Vison G it's: _SB_.PCI0.RP02.D066
My suggestion would be to discuss the issue with other users here: https://www.insanelymac.com/forum/topic/352281-intel-i225-v-on-ventura/

On the Vision D it's the same path. Can you say if the ssdt changes the subsystem-vendor-id in your setup?

I have flashed the custom firmware months ago, so I can't tell.

Regardless of this (flashed), the ssdt should change the value in your case, too. Would you please try and report?

I can't do that because the values which this SSDT changes are already fixed in the ROM so there's no chance for me to detect if it's working or not.

I thought that flashing would change the system vendor-id to 1458, but the content of the ssdt says subsystem-vendor-id 1043, so if the ssdt works, it should change this value in your case, too.

And why don't you just change the ID to 1458 in SSDT then?

Of course I've already tried this, too, but it doesn't change anything. It seems that the ssdt has no effect. That's the reason I ask you to try if the ssdt changes anything on your system.

Did you try?

Thanks for your help!

Patched ROM:

SSDT:

Thank you! I've controlled erverything again after your last post but it didn't work for me. Then i put the ssdt from the last at the first place of the order in acpi of the config.plist and the values changed. I thought that the order of the acpi files don't matter but in this case it do so. But my problem with no connection is still persisting. Tried in Monterey and Ventura. I think ther's no way around flashing now.

Well, there can be dependencies in the sequences SSDTs are loaded, but the injected values shouldn't change. No Idea why this is happening. Maybe it's related to the DTGP method it is using. Anyway, it's weird.

Whe i say that the values changed i mean f. e. that the subsystem-vendor-id changed from 0x0000 to 0x1043 like it is on your second screenshot after applying the ssdt. I will the next days flash the i225-v, because it just don't connect with the ssdt.

Okay. Did you try delete the Network Prefs already?
sudo rm /Library/Preferences/SystemConfiguration/NetworkInterfaces.plist
sudo rm /Library/Preferences/SystemConfiguration/preferences.plist

No i didn't but i tried after you wrote that with the same result. No connection.

I've read some more and now have activated AppleVTD with custom DMAR and dropping rule but still no succes with the ssdt. So i will flash when i come back from a short trip next monday.

Are you telling me you didn't read these instructions: https://github.com/5T33Z0/Gigabyte-Z490-Vision-G-Hackintosh-OpenCore/blob/main/I225_stock_vs_cstmfw.md#settings-combinations-stock-firmware before creating the issue?

Surely i have, but tried without AppleVTD first but now i know that with or without AppleVTD it don't work for me with the ssdt method.

And what about DisbaleIOMapper?

I put the ssdt-dmar.aml into acpi folder and in the config.plist. Then created the delete rule in acpi and disabled the quirk. AppleVTD is in ioregistryexplorer now.

Again: did you unselect DisableIOMapper
Using a modified DMAR table (did you modify it?) is only necessary in cases where you want to use the I225-V together with third party LAN/Wifi/BT cards because of some memory regions which are defined in the DMAR table which have to be removed.
But it's not a requirement in regards to getting AppleVTD to work. It should be present even without dropping/replacing the DMAR table but just by enabling VT-D it in the BIOS.

I wrote that i disabled the quirk in my last answer and without custom created dmar and delete rule, my thunderbolt devices and my fenvi didn't work. I read about this before.

Well then there's nothing more I can do for you. Like I said in the beginning: all I know about the issue is documented in the files on my repo. There's nothing more for me to suggest or do.
Please discuss the issue in the forum I mentioned with other users having this problem!

I will flash the i225v on monday and i will report then.

Sorry for the late response. Now i've flashed the i225-v with the mod an everything is working in Monterey and Ventura. So the ssdt-method didn't do the trick for me only flashing with activated applevtd did it.

Hi and sorry for the late response. Now i have flashed the i225-v withe the mod and everything is working fine now with activated applevtd and dropping dmar rule. So i don't have any problems with wifi and thunderbolt devices. Unfortunately I have to say in conclusion that the ssdt-method don't work. Thanks for your work and time.


python39Packages.manticore: relax crytic-compile constraint

Description of changes
Fix build (https://hydra.nixos.org/build/174532039)
ZHF: #172160

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 174143 run on x86_64-linux 1

1 package built:

python39Packages.manticore

Tests fail to import on macos 10.15, so you might just like to mark it broken for that here & now:
__________________ ERROR collecting tests/other/test_fork.py ___________________
ImportError while importing test module '/private/tmp/nix-build-python3.9-manticore-0.3.7.drv-0/source/tests/other/test_fork.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
/nix/store/lfayq1vz3szk4ji0s53v0x1ijcdn3qnx-python3-3.9.12/lib/python3.9/importlib/__init__.py:127: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
tests/other/test_fork.py:3: in <module>
    from manticore.native import Manticore
manticore/native/__init__.py:3: in <module>
    install_helper.ensure_native_deps()
manticore/utils/install_helper.py:8: in ensure_native_deps
    raise ImportError(
E   ImportError: Missing some packages for native binary analysis. Please install them with pip3 install manticore[native].
------------------------------- Captured stdout --------------------------------
2022-05-23 19:52:56,918: [4886] m.c.manticore:WARNING: Manticore is only supported on Linux. Proceed at your own risk!
=============================== warnings summary ===============================
../../../../nix/store/srdbc3mvjr89y2gw7hf3jxmm07naajmr-python3.9-wasm-1.2/lib/python3.9/site-packages/wasm/types.py:264
  /nix/store/srdbc3mvjr89y2gw7hf3jxmm07naajmr-python3.9-wasm-1.2/lib/python3.9/site-packages/wasm/types.py:264: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3, and in 3.10 it will stop working
    isinstance(cur_field, collections.Callable) or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
ERROR tests/other/test_fork.py
!!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!
================== 13 deselected, 1 warning, 1 error in 1.42s ==================


increased level of RNA-DNA hybrids at tRNA genes

requested by Paul Russell via helpdesk (ticket 265108)
I infer it's for PMID:29622660

increased level of RNA-DNA hybrids at tRNA genes FYPO:0006495
edit file: 2f8787a8770b2fa489d8178934f8034caecbbbf2
release: 1ade332e5bb74ad892829d0866bf42cf7bf48de2


Add block-size & inline-size to search keywords

These properties are defined by the spec: https://drafts.csswg.org/css-logical-props/#index-defined-here
Refs #3051

Thanks!


fix: ignore finalized when processing downloaded unknown block

Motivation

Got this error in unknown block sync

Error processing block from unknown parent sync root=0xca6db5ca09e886a9747e9401febd1fba11d8bad96af011992c48d8012a3b8821, slot=6661056 code=BLOCK_ERROR_WOULD_REVERT_FINALIZED_SLOT, blockSlot=6661056, finalizedSlot=6661056

If block is before finalized, we only need to ignore it instead of remove all descendant blocks and penalize all related peers
Description

Add ignoreIfFinalized flag
Add more logs

Closes #5650

Please can you add some test so we don't have a regression latter?

I stopped a test mainnet for 3h and node is synced very quickly with this PR

Please can you add some test so we don't have a regression latter?

@dapplion added unit test to reproduce and fix the issue

:tada: This PR is included in v1.9.0 :tada:


Consolidate configuration to a single file

Currently, fresh.py reads from three separate configuration files: .config.ini, credentials.json, and praw.ini.
To make initialization easier for new users, I propose we expect a single configuration file, config.ini (no longer hidden), with the following structure:
[spotify]
username = <username>
client_id = <client_id>
client_secret = <client_secret>
redirect_uri = <redirect_uri>

[reddit]
username = <username>
client_id = <client_id>
client_secret = <client_secret>

Note that we request the reddit username as well. This allows us to create a user-agent string that better follows the reddit API rules. (Better user-agent strings will be requested in a separate issue.)

I've created a branch which implements the above proposal, but it does so at the cost of trampling over other contributors' code. A more community-friendly approach should be taken before creating a pull request. I'll leave a link as a resource for future work on this issue.
https://github.com/pricebenjamin/fresh_script/tree/consolidate-config

Maybe there's something that can be used from my Spotify project? I've made a PR on this project in regards to the config, but since then I've improved it:

Config variables are consolidated into one file and loaded using configparser
The config file is generated using a Makefile making it standardized for new contributors/users to create a config file skeleton
There is documentation with images on how to obtain Spotify credentials

Maybe these features can be added to the project?

@dtcrout, your project is a great reference. Thank you for the input!
Having a tool, like a Makefile, generate a skeleton config file is also a good idea. This could perhaps be addressed in a separate issue.
We would still need to address the problem of consolidating all configuration parameters into one file.


error in sockexec builder

error while trying to build sockexec builder

Branch: development
Commit_ID:  23d753f738abbc7add99b98b6c23619ab20671d2

Branch: development
Commit_ID:  23d753f738abbc7add99b98b6c23619ab20671d2

fixed in f17fc1e495049a3706e3d3dbfb39d2de5b1ba237

verified.


[#2812] Add support for the new python distro.

Scope
This updated brink to work with the new python distro.
Changes
Replace paver.sh with venv.sh which now has python-package as upstream.
Update for the latest pip version.
This code is already used to support the build system of the new pyton-distribution... but not the build-process itself.
For now we will keep version 0.55.X for old python-package
All changes support the new python-distro will be done as 0.56.X
To have a single buildmaster builder running old and new style python distributions, a paver.sh is created to redirect to venv.
How to test
reviewers: @dumol
check that the new venv and brink system works in latest commit
Thanks!

plan cancelled... instead of moving to a new python-distro the plan is to slowly update python-package to be what we want from python-distro


revise feathered beams

This PR fixes the mixed up descriptions of feathered beams.

thanks for spotting this!

@kepper could you please double check and merge

@kepper gentle reminder ;-)


[$500] [Wave 6: Workspace Chat] Scheduled Submit set to Manually creates blank report header

Slack conversation: https://expensify.slack.com/archives/C02MW39LT9N/p1703188880908729?thread_ts=1703187017.215259&cid=C02MW39LT9N
Action Performed:
Pre-testing requirement: Collect workspace type with the isPolicyExpenseChatEnabled NVP set (SO).

As the admin, go to OldDot and change the scheduled submit frequency to manually for a workspace
Make sure the workspace has at least two members (who's NewDot accounts you'll use)
Log back into NewDot as the Member (or refresh if you already are in another window)
Create a Request Money to Admin
As the Admin > Verify that the LHN row for the workspace chat includes a GBR green dot for the draft report awaiting submission :white_check_mark:
As the Member > Tap the workspace chat row to navigate to the workspace chat view
• Verify that the draft report preview component appears in the workspace chat  :white_check_mark:
• Verify that the draft report preview component in the chat:
• Verify the IOU includes a green Submit button :white_check_mark:
Tap the report preview component of the second draft report to navigate to the expense report view
• Verify that a banner is in the page header with the label Next steps :x:
• Verify that the next steps text matches the manual submission cadence you set on the paid policy. E.g “Waiting for %displayName% to submit expenses.” :x:
• Verify that a green Submit button is in the page header beneath the “Next steps” banner :x:

NOTE: This does eventually update - it's just not immediate

Expected Result:
Next Steps should reflect the Manually frequency "waiting for [employee] to submit expenses"
There should be a Submit button
Actual Result:
The "next steps" wording doesn't reflect a Manually frequency
There's no Submit button
Screenshots/Videos
https://github.com/Expensify/App/assets/51066321/376df7e9-6074-4a0b-b749-db8718b5218d

View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~01c51092024bd72e04
Upwork Job ID:<PHONE_NUMBER>004784128
Last Price Increase: 2024-01-03

I can reproduce this - the issue is that the settings on the Request Money Draft do not match the "Manual" frequency, they still match the "weekly" frequency.

I think this might need to be internal  and I think this probably should be a high priority - waiting for a buddy check from @greg-schroeder

sorry I was ooo - I think this can be external

the issue is that the settings on the Request Money Draft do not match the "Manual" frequency, they still match the "weekly" frequency.

@Christinadobrzyn @fedirjh
I just checked with Manual frequency and the message in OD still shows the Weekly message (notice attached screenshot)
I think this needs to be addressed in BE. And, if there is any follow-up work required in FE, we can do it.
Alternatively, if BE sends the Scheduled Submit setting to FE, we can do this in FE too.

okay! let's add an Internal label and get engineering to review this

I am going to close this one in favour of more general optimistic next steps https://github.com/Expensify/App/issues/28771 issue


Script Fails

When I attempt to run the below command  with the location etc set - any ideas appreciated
azbb -s <subscription_id> -g ra-onprem-sp2016-rg -l <location> -p onprem.json --deploy
I get this error
"contentVersion": "<IP_ADDRESS>",
"uri": "https://raw.githubusercontent.com/mspnp/template-building-blocks/v2.1.0/templates/buildingBlocks/virtualNetworks/virtualNetworks.json"
},
"timestamp": "2019-05-24T15:42:29.234931+00:00"
},
"resourceGroup": "********************",
"type": null
}
Deployment failed. Correlation ID: b5d1703f-767e-476b-95c8-29e5709236fc. {
"status": "Failed",
"error": {
"code": "ResourceDeploymentFailure",
"message": "The resource operation completed with terminal provisioning state 'Failed'.",
"details": [
{
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-debug for usage details.",
"details": [
{
"code": "Conflict",
"message": "{\r\n  "status": "Failed",\r\n  "error": {\r\n    "code": "ResourceDeploymentFailure",\r\n    "message": "The resource operation completed with terminal provisioning state 'Failed'.",\r\n    "details": [\r\n      {\r\n        "code": "DeploymentFailed",\r\n        "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-debug for usage details.",\r\n        "details": [\r\n          {\r\n            "code": "BadRequest",\r\n            "message": "{\r\n  \"error\": {\r\n    \"code\": \"InvalidTemplateDeployment\",\r\n    \"message\": \"The template deployment failed because of policy violation. Please see details for more information.\",\r\n    \"details\": [\r\n      {\r\n        \"code\": \"RequestDisallowedByPolicy\",\r\n        \"target\": \"vmek7a2habde37cdiag1\",\r\n        \"message\": \"Resource 'vmek7a2habde37cdiag1' was disallowed by policy. Policy identifiers: '[{\\\"policyAssignment\\\":{\\\"name\\\":\\\"Ensure https traffic for the existing storage accounts\\\",\\\"id\\\":\\\"/providers/Microsoft.Management/managementGroups/HPiAzureSecurityPolicy/providers/Microsoft.Authorization/policyAssignments/a8a37bd066974aa08e7971ee\\\"},\\\"policyDefinition\\\":{\\\"name\\\":\\\"Ensure https traffic for the existing storage accounts\\\",\\\"id\\\":\\\"/providers/Microsoft.Management/managementGroups/HPiAzureSecurityPolicy/providers/Microsoft.Authorization/policyDefinitions/edd42c27-a5cf-458c-9484-5acdcd83b948\\\"}}]'.\",\r\n        \"additionalInfo\": [\r\n          {\r\n            \"type\": \"PolicyViolation\",\r\n            \"info\": {\r\n              \"policyDefinitionDisplayName\": \"Ensure https traffic for the existing storage accounts\",\r\n              \"evaluationDetails\": {\r\n                \"evaluatedExpressions\": [\r\n                  {\r\n                    \"result\": \"True\",\r\n                    \"expression\": \"type\",\r\n                    \"path\": \"type\",\r\n                    \"expressionValue\": \"Microsoft.Storage/storageAccounts\",\r\n                    \"targetValue\": \"Microsoft.Storage/storageAccounts\",\r\n                    \"operator\": \"Equals\"\r\n                  },\r\n                  {\r\n                    \"result\": \"False\",\r\n                    \"expression\": \"Microsoft.Storage/storageAccounts/supportsHttpsTrafficOnly\",\r\n                    \"path\": \"properties.supportsHttpsTrafficOnly\",\r\n                    \"targetValue\": \"true\",\r\n                    \"operator\": \"Equals\"\r\n                  }\r\n                ]\r\n              },\r\n              \"policyDefinitionId\": \"/providers/Microsoft.Management/managementGroups/HPiAzureSecurityPolicy/providers/Microsoft.Authorization/policyDefinitions/edd42c27-a5cf-458c-9484-5acdcd83b948\",\r\n              \"policyDefinitionName\": \"edd42c27-a5cf-458c-9484-5acdcd83b948\",\r\n              \"policyDefinitionEffect\": \"deny\",\r\n              \"policyAssignmentId\": \"/providers/Microsoft.Management/managementGroups/HPiAzureSecurityPolicy/providers/Microsoft.Authorization/policyAssignments/a8a37bd066974aa08e7971ee\",\r\n              \"policyAssignmentName\": \"a8a37bd066974aa08e7971ee\",\r\n              \"policyAssignmentDisplayName\": \"Ensure https traffic for the existing storage accounts\",\r\n              \"policyAssignmentScope\": \"/providers/Microsoft.Management/managementGroups/HPiAzureSecurityPolicy\",\r\n              \"policyAssignmentParameters\": {}\r\n            }\r\n          }\r\n        ]\r\n      }\r\n    ]\r\n  }\r\n}"\r\n          }\r\n        ]\r\n      }\r\n    ]\r\n  }\r\n}"
}
]
}
]
}
}

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 6d93eb87-54cb-cf38-dfae-0ebe7579d608
Version Independent ID: c7ac665e-d194-ab07-c1bb-5d5a3049c5ec
Content: Run a highly available SharePoint Server 2016 farm in Azure - Azure Reference Architectures
Content Source: docs/reference-architectures/sharepoint/index.md
Service: architecture-center
Sub-service: reference-architecture
GitHub Login: @njray
Microsoft Alias: pnp

Hi @MezeiJ Thank you for your feedback! We will review and update as appropriate.

Looks like it's failing because your organization has an Azure Policy in place that forces HTTPS for storage accounts.  Here is a fix:

Create a directory somewhere on the machine that has AZBB installed.

Create a file named 'virtualMachineSettings.json'

Put the following JSON in it
{
    "diagnosticStorageAccounts": {
    "supportsHttpsTrafficOnly": true
     }
}

Save the file

Add the following parameter to the azbb command: "-d <path_to_directory_from_step_1>"

@MezeiJ Closing this issue now. Please re-open if you are still getting an error.


Fix keystore no std compilation

This PR attaches the std to testing mod, makes the sp-keystore compilable in no-std.

This is not making the keystore no_std compatible. The entire crate is written in a way that it is requires std. There is also no need to compile this for no_std.


upgrading the program

Hi, trying to upgrade the program but the readme link is 404
https://github.com/will-in-wi/letsencrypt-webfaction/blob/master/docs/README.md#Upgrading
Please assist.

This is correct:
https://github.com/will-in-wi/letsencrypt-webfaction/blob/master/README.md#upgrading

@ElectricFeet that works, thanks a bunch!


[Toolkit feature]: Use Symbolic links instead of Junctions when creating projects.

Contact Details (Optional)
I'm in the Remix Discord, Username: steven_oconnell
What is the context of the feature/improvement?
The current project linking system only works with local directories, using a NAS or Server is not possible with Junctions as they only work with local storage devices.
Please describe the feature/improvement?
For the sort of use case that the Creator Toolkit requires Symbolic links will achieve the same results with the additional benefit of working with remote storage devices that support SMB.
This is a huge thing for anyone who works off a NAS or Server.
If Junctions continue to be used users will be FORCED to create project directories on their local storage device, it’s a very unusual behaviour for a modern application to not support the use of network locations.
The main difference between Junctions and Symbolic links that are the following;

What would be your solution? (optional)
In order to change this all that would need to be done is expose network locations to the apps file explorer (as it currently will not show network locations) and change the command that is executed when a new project is created.
ie;
To create a junction: mklink /J linkName target
To create a symbolic link: mklink /D linkName target
Version
2024.1.1

Will be tracked under REMIX-2751
However it is possible we close this task without changing it because of the requirements for Symlinks.
Requiring admin privileges to create any symlink could be an issue. We will need to investigate that and make sure it doesn't break existing flows.

Closing since fix was confirmed internally with 2024.3.0. Thank you for your suggestion!


Make types available in tests

I made this PR in a hurry. I found that I didn't have access to the types module in my tests, while I do have in development. It fixes the issue, but I'm not sure if there is a better way to integrate it.

You can just put this require SPEC_ROOT.join("../lib/types") in spec files where you need the types.

Don't you think it is better having it available by default? Like the container, it is a global aspect of the application. At least in development it is available by default. But, anyway, it's not  big deal...

All dry stuff, in general, tries to require only the needed resources in the place where it is used. This is the opposite of what Rails do, that requires all the stack before running any test.

I completely agree with that. But don't you think there is an inconsistency here? I mean, we do are requiring types in the application globally, on container initialization:
https://github.com/dry-rb/dry-web-roda/blob/master/lib/dry/web/roda/templates/settings.rb.tt#L3

Hi @waiting-for-dev, appreciate you contributing this PR and opening up this discussion.
Like @alejandrobabio and @musaffa mentioned, the general philosophy we try to follow for these sorts of apps is "require what you require," which explains why the types module isn't required in spec_helper or some other similar place.
My recommendation would be to add require "types" or similar to the top of whatever spec files where you need to directly work with some of your types.
As for
https://github.com/dry-rb/dry-web-roda/blob/master/lib/dry/web/roda/templates/settings.rb.tt#L3, the types module is being required in the init block there because it's going to be used by the settings definitions in the settings block below. This isn't a case of requiring types globally for the sake of it, it's a dry-system bootable component "requiring what it requires".

Thanks for your feedback.
I agree with the philosophy of "require what you require". I just thought that it made sense to require globally types because I misunderstood dry-types behaviour. I though that the the idea of dry-types was more like an actual type system in a static language, so they should be always provided in function calls, etc. But the idea here is more to be consumed internally by a class definition. It is something more related to the callee than the caller.
So, effectively, it makes no sense to require it globally :smile:
Didn't realize it was used just lines later in settings.rb Thanks @timriley for pointing it.


318 forward matched pairs

Summary
Added functions to flags forwards and backwards pairs and to count valid forward and backwards matched pairs.
Functions flag a forward or backward matched pair if target variable has valid entries for period and predictive period
Checklists

This pull/merge request meets the following requirements:

[x] code runs
[x] developments are ethical and secure
[x] you have made proportionate checks that the code works correctly
[x] test suite passes
[ ] developments adhere to AQA plan (see docs/aqa/aqa_plan.md)
[x] data log updated (see docs/aqa/data_log.md), if necessary
[x] assumptions, and caveats log updated (see docs/aqa/assumptions_caveats.md), if
necessary
[x] minimum usable documentation written in the docs folder

Comments have been added below around the incomplete checks.

Hi Jordan.
I went through the code and it looks great!
I also ran the tests and 6 of the 18 failed due to attribute mismatch. Here's the error code:
AssertionError: Attributes are different
E       Attribute "dtype" are different
E       [left]:  float64
E       [right]: int64
It should be a simple fix, and everything else looks great. :)

Code is ready for review after making changes to test data file paths.
There are currently two methods developed which produced identical results, flag_matched_pair_shift and flag_matched_pair_merge.
These have been developed in parallel and need to be tested on production size datasets to determine which is more efficient in terms of runtime and resource requirements.
Will add this to the sprint backlog for further testing


Xamarin.Forms lottie animation with fonts not working

I have download the HelloWorld json sample from
lottie-android/LottieSample/src/main/assets/Hello World.json
This example does not work on Xamarin.Forms.
Other animations samples without fonts works properly.

Look at the samples in this repo. They are working.

I made some tests with Example.Forms.iOS project from this repo.
The animation work properly using LottieLogo1.json, but if I replace it with this animation
lottie-android/LottieSample/src/main/assets/Hello World.json
the animation seems not to work.
Maybe it need some additional code to load fonts?
I can't find any documentation about.
Thanks for help


generated files import github.com/tabbed/pqtype instead of github.com/sqlc-dev/pqtype

Version
1.20.0
What happened?
I just generated a new sql.go file. The file ref. a PSQL tabe that has a nullable JSON column.
In the exported file the import is:
import "github.com/tabbed/pqtype"
i work around by manually changing to:
import github.com/sqlc-dev/pqtype
Relevant log output
go mod tidy
go: finding module for package github.com/tabbed/pqtype
go: found github.com/tabbed/pqtype in github.com/tabbed/pqtype v0.2.0
go: github.com/xxxx/rbac/db imports
        github.com/tabbed/pqtype<EMAIL_ADDRESS>parsing go.mod:
        module declares its path as: github.com/sqlc-dev/pqtype
                but was required as: github.com/tabbed/pqtype

Database schema
CREATE TABLE "tenant" (
  "config_private" json
);

SQL queries
-- name: GetPublicConfig :one
SELECT
    config_public
FROM
    tenant
WHERE
    tag = $1;

Configuration
version: "2"
sql:
  - engine: "postgresql"
    queries: "db/sqlc"
    schema: "db/migrations"

    # https://github.com/gobuffalo/nulls

    gen:
      go:
        package: "db"
        out: "db"
        emit_json_tags: true
        emit_result_struct_pointers: true
        emit_empty_slices: true
        emit_prepared_queries: false
        emit_interface: true
        json_tags_case_style: "none"
        #emit_exact_table_names: true
        overrides:
          - db_type: "pg_catalog.int4"
            go_type: "github.com/gobuffalo/nulls.Int"
            nullable: true
          - db_type: "pg_catalog.int8"
            go_type: "github.com/gobuffalo/nulls.Int"
            nullable: true
          - db_type: "string"
            go_type: "github.com/gobuffalo/nulls.String"
            nullable: true
          - db_type: "pg_catalog.varchar"
            go_type: "github.com/gobuffalo/nulls.String"
            nullable: true
          - db_type: "text"
            go_type: "github.com/gobuffalo/nulls.String"
            nullable: true
          - db_type: "timestamptz"
            go_type: "github.com/gobuffalo/nulls.Time"
            nullable: true
          - db_type: "pg_catalog.timestamp"
            go_type: "github.com/gobuffalo/nulls.Time"
            nullable: true
          - db_type: "pg_catalog.timestamptz"
            go_type: "github.com/gobuffalo/nulls.Time"
            nullable: true
          - db_type: "date"
            go_type: "github.com/gobuffalo/nulls.Time"
            nullable: true
          - db_type: "pg_catalog.bool"
            go_type: "github.com/gobuffalo/nulls.Bool"
            nullable: true
          - db_type: "uuid"
            go_type: "github.com/gobuffalo/nulls.UUID"
            nullable: true
          - db_type: "pgtype.UUID"
            go_type: "github.com/gobuffalo/nulls.UUID"
            nullable: true

Playground URL
No response
What operating system are you using?
Windows
What database engines are you using?
PostgreSQL
What type of code are you generating?
Go

Apologies the workaround i listed above does not compile:
when i try and go get github.com/tabbed/pqtype
i get
go<EMAIL_ADDRESS>parsing go.mod:
module declares its path as: github.com/sqlc-dev/pqtype
but was required as: github.com/tabbed/pqtype

Aologies nce again I had a remaining ref to github.com/tabbed/pqtype in one of my files. I CAN compile if I manually change the references to github.com/sqlc-dev/pqtype.

I can't reproduce this on the playground using 1.20.0. Can you ensure that you've upgrade to 1.20.0 and aren't still running 1.19.0?


Keyboard command reference

I think we should maybe let the tweak bar be enabled upon launch to show new users more info. What do you think?

I disagree - but in my view we could add a debugg option that enables it by default.

22 maj 2016 kl. 11:46 skrev Isakwiberg<EMAIL_ADDRESS>I think we should maybe let the tweak bar be enabled upon launch to show new users more info. What do you think?
—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub https://github.com/lragnarsson/Emerald-Engine/pull/64#issuecomment-220823422

Ok let's leave it the way it is. Would you like to add anything @lragnarsson ?

Looks good!


The random access performance of macOS runners is incredibly slow

As the title says. However, this does not always happen, and it seems to be a random problem with some runners. This makes everything incredibly slow if you build on the problem runner.
According to the GitHub documentation, it says "GitHub hosts macOS runners in GitHub's own macOS Cloud" but somehow it seems that there are runners managed on 54112 and 36459, are slow on either of them? (Sorry, I don't have time to spend investigating this and you probably have more information.)

Sequential Read
Ubuntu
macOS

File operations - reads/s
269254.15
312796.42

Throughput - read (MiB/s)
4207.10
4887.44

Latency - min (ms)
0.00
0.00

Latency - avg (ms)
0.00
0.00

Latency - max (ms)
6.64
9.22

Latency - 95th percentile (ms)
0.00
0.00

Latency - min (ms)
9388.44
9117.90

Sequential Write
Ubuntu
macOS

File operations - writes/s
4258.20
6345.27

Throughput - written (MiB/s)
66.53
99.14

Latency - min (ms)
0.00
0.00

Latency - avg (ms)
0.00
0.07

Latency - max (ms)
84.80
44.82

Latency - 95th percentile (ms)
0.00
0.01

Latency - min (ms)
10012.84
9948.61

Combined Random Read/Write
Ubuntu
macOS

File operations - reads/s
5092.69
375.47

File operations - writes/s
3395.13
250.31

File operations - fsyncs/s
10857.02
810.84

Throughput - read (MiB/s)
79.57
5.87

Throughput - written (MiB/s)
53.05
3.91

Latency - min (ms)
0.00
0.00

Latency - avg (ms)
0.05
0.70

Latency - max (ms)
29.27
25.96

Latency - 95th percentile (ms)
0.00
5.88

Latency - min (ms)
9902.59
9989.68

Hi @smorimoto!
Indeed, the Mac cloud consists of many environments and probably the issue affected only some of them.
Could you please provide a few examples of "slow" and "normal" builds, it should help us find out particular environments that affected by the issue? And it would be even better if you can provide a benchmark to use.

Here are the hardware and software informations for the slow machine. This is probably helpful for identifying one by serial number.
2021-02-15T17:14:20.9697180Z Hardware:
2021-02-15T17:14:20.9697400Z
2021-02-15T17:14:20.9697710Z     Hardware Overview:
2021-02-15T17:14:20.9697960Z
2021-02-15T17:14:20.9698290Z       Model Name: Apple device
2021-02-15T17:14:20.9698710Z       Model Identifier: VMware7,1
2021-02-15T17:14:20.9699150Z       Processor Speed: 3.33 GHz
2021-02-15T17:14:20.9699560Z       Number of Processors: 1
2021-02-15T17:14:20.9699950Z       Total Number of Cores: 3
2021-02-15T17:14:20.9700340Z       L2 Cache (per Core): 256 KB
2021-02-15T17:14:20.9700670Z       L3 Cache: 12 MB
2021-02-15T17:14:20.9700990Z       Memory: 14 GB
2021-02-15T17:14:20.9701410Z       Boot ROM Version: VMW71.00V.13989454.B64.1906190538
2021-02-15T17:14:20.9702180Z       Apple ROM Info: [MS_VM_CERT/SHA1/27d66596a61c48dd3dc7216fd715126e33f59ae7]Welcome to the Virtual Machine
2021-02-15T17:14:20.9702850Z       SMC Version (system): 2.8f0
2021-02-15T17:14:20.9703290Z       Serial Number (system): VMcwz4J2GHCN
2021-02-15T17:14:20.9704310Z       Hardware UUID: 4203018E-580F-C1B5-9525-B745CECA79EB

2021-02-15T17:14:26.6539330Z Software:
2021-02-15T17:14:26.6539540Z
2021-02-15T17:14:26.6539860Z     System Software Overview:
2021-02-15T17:14:26.6540130Z
2021-02-15T17:14:26.6540450Z       System Version: macOS 10.15.7 (19H512)
2021-02-15T17:14:26.6540860Z       Kernel Version: Darwin 19.6.0
2021-02-15T17:14:26.6541260Z       Boot Volume: Macintosh HD
2021-02-15T17:14:26.6541630Z       Boot Mode: Normal
2021-02-15T17:14:26.6542420Z       Computer Name: Mac-1613409099589.local
2021-02-15T17:14:26.6542880Z       User Name: runner (runner)
2021-02-15T17:14:26.6543290Z       Secure Virtual Memory: Enabled
2021-02-15T17:14:26.6543760Z       System Integrity Protection: Enabled
2021-02-15T17:14:26.6544230Z       Time since boot: 3 minutes

2021-02-15T17:14:26.6544740Z Storage:
2021-02-15T17:14:26.6544940Z
2021-02-15T17:14:26.6545560Z     Macintosh HD - Data:
2021-02-15T17:14:26.6545820Z
2021-02-15T17:14:26.6546120Z       Free: 81.78 GB (81,784,434,688 bytes)
2021-02-15T17:14:26.6546490Z       Capacity: 407.81 GB (407,812,136,960 bytes)
2021-02-15T17:14:26.6546910Z       Mount Point: /System/Volumes/Data
2021-02-15T17:14:26.6547320Z       File System: APFS
2021-02-15T17:14:26.6547650Z       Writable: Yes
2021-02-15T17:14:26.6548000Z       Ignore Ownership: No
2021-02-15T17:14:26.6548360Z       BSD Name: disk1s1
2021-02-15T17:14:26.6549210Z       Volume UUID: 2A30A6B7-DA7B-3585-83F7-DB9932BBA018
2021-02-15T17:14:26.6549720Z       Physical Drive:
2021-02-15T17:14:26.6550140Z           Device Name: VMware Virtual SATA Hard Drive
2021-02-15T17:14:26.6550770Z           Media Name: AppleAPFSMedia
2021-02-15T17:14:26.6551180Z           Medium Type: SSD
2021-02-15T17:14:26.6551710Z           Protocol: PCI
2021-02-15T17:14:26.6552050Z           Internal: Yes
2021-02-15T17:14:26.6552420Z           Partition Map Type: Unknown
2021-02-15T17:14:26.6552700Z
2021-02-15T17:14:26.6552980Z     Macintosh HD:
2021-02-15T17:14:26.6553200Z
2021-02-15T17:14:26.6553500Z       Free: 81.78 GB (81,784,434,688 bytes)
2021-02-15T17:14:26.6553870Z       Capacity: 407.81 GB (407,812,136,960 bytes)
2021-02-15T17:14:26.6554210Z       Mount Point: /
2021-02-15T17:14:26.6554560Z       File System: APFS
2021-02-15T17:14:26.6554890Z       Writable: No
2021-02-15T17:14:26.6555240Z       Ignore Ownership: No
2021-02-15T17:14:26.6555600Z       BSD Name: disk1s5
2021-02-15T17:14:26.6556460Z       Volume UUID: 7108BDC1-B808-49E6-9443-A70B1CFFC639
2021-02-15T17:14:26.6556930Z       Physical Drive:
2021-02-15T17:14:26.6557360Z           Device Name: VMware Virtual SATA Hard Drive
2021-02-15T17:14:26.6557850Z           Media Name: AppleAPFSMedia
2021-02-15T17:14:26.6558400Z           Medium Type: SSD
2021-02-15T17:14:26.6558770Z           Protocol: PCI
2021-02-15T17:14:26.6559110Z           Internal: Yes
2021-02-15T17:14:26.6559500Z           Partition Map Type: Unknown

I ran a simple benchmark with sysbench. If you're not familiar with how to do that, here's how:
https://github.com/smorimoto/actions-ve-repro-2707/blob/main/.github/workflows/workflow.yml

In my experience, the slowdown on some machines seems to have started suddenly several months ago. MacStadium sometimes uses fairly old machines as hosts, so consider that possibility.

@smorimoto I'm afraid the serial number is the same across all the VMs, so it won't help us. We can identify a particular machine by a link to the run.

Slow one:
https://github.com/smorimoto/actions-ve-repro-2707/runs/1905124520
Normal one:
https://github.com/smorimoto/actions-ve-repro-2707/runs/1905124540

@smorimoto thanks, I see some of them are about 1-2min and some 4+. We'll take a look more carefully.

Are you referring to the system profiler? I'm not familiar with macOS, so I don't know, but the time it takes doesn't seem to have much to do with the storage performance of the machine.

Sorry, I should have checked carefully. By the way, you provided the same link both for the slow and normal ones.

Hmm? I think I've provided the 8th and 10th jobs.

@smorimoto I've checked your run and there are 2 slow examples — 7&8, both were run in the data center, which is currently being deprecated. It'll take 2-3 more months to finish infrastructure migration, so I suggest bringing up the issue again if it persists after this time.
I'm going to close the issue for now, but please feel free to contact us if you have any concerns.
Thank you!

Got it, thanks for the investigation. I hope all slow instances won't be used as soon as possible.

@miketimofeev shouldn't this issue remain open until the infrastructure migration has completed?

@miketimofeev Many VMs still seem to have the issue. Especially, the write performance is often terrible: https://github.com/smorimoto/actions-ve-repro-2707/actions/runs/752151426

@miketimofeev Don't know if you'd prefer a new issue, but now it's months after, and I'm seeing the same/similar. It's random, but often: 10-25% of the runs are slow.
A good run can "uninstall homebrew" (i.e. mostly disk i/o) in 184 seconds https://github.com/rokmoln/support-firecloud/runs/3295490478?check_suite_focus=true#step:3:190
A slow run can "uninstall homebrew" 2.5 times slower, in 483 seconds
https://github.com/rokmoln/support-firecloud/runs/3295490501?check_suite_focus=true#step:3:190
Similarly, reinstalling homebrew (disk, network and cpu bound) happens 1.8 times slower, in 593 seconds https://github.com/rokmoln/support-firecloud/runs/3295490501?check_suite_focus=true#step:3:447 instead of 333 seconds https://github.com/rokmoln/support-firecloud/runs/3295490478?check_suite_focus=true#step:3:456
Overall, my builds time out even with a 2x-than-normal timeout (normally 23minutes, timeout 45 minutes).

@andreineculau yes, create a new issue, please. It would be great if you can provide the minimal repro steps so we will be able to make a few runs and gather data that can be escalated to the engineering team.


Complete project got wiped out

Describe the bug
Hello!
I was building a chess platform since many days on bolt using stackblitz. Today i logged in to continue working on it. After giving one prompt that didnt give me the desired results, i clicked on the rollback to checkpoint option before the prompt. It rolled back but ended up encountering some errors and showing a blank white screen instead of the platform in the preview section. When i prompted it to fix this issue, it ended up completely wiping out my project and resetting it.
I request you to please restore my project if possible to the version it was before all this mishap. For reference, please restore it to what it was before Tuesday 12am Indian Standard Time. I had put in a lot of effort and time into making the project. Please help me.
Best regards,
Maanav Sharma
Link to the Bolt URL that caused the error
https://bolt.new/~/sb1-zqwpgy
Steps to reproduce
the entire project components have been wiped out. the project has been reset to scratch. the preview section is now displaying Node.js project starter.
Expected behavior
I expected it to undo my last prompt and rollback to checkpoint. I didnt expect it to wipe out my entire project.
Screen Recording / Screenshot
No response
Platform
Browser name = Chrome
Full version = <IP_ADDRESS>
Major version = 130
navigator.appName = Netscape
navigator.userAgent = Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/<IP_ADDRESS> Safari/537.36
performance.memory = {
  "totalJSHeapSize": 58762219,
  "usedJSHeapSize": 54455771,
  "jsHeapSizeLimit":<PHONE_NUMBER>
}
Username = Maanav-gambit
Chat ID = fb356cfc4f44

Additional context
No response

@Maanav-gambit It sounds like you’ve been affected by a bug we identified and fixed earlier today in the rollback feature. Apologies for the frustrating experience! Please follow the instructions in #1104 to reach out, and we’ll work with you to attempt restoring your project. Thanks for your patience as we get this sorted out for you.

🎉 Backups Have Landed on Production!
Open your affected project and in the lower left hand corner of the screen navigate to Settings > Backups to restore your project to any previous state!
Please let us know in #1104 if you have any issues using this brand new feature.

The new backups feature didn't help. The oldest backup is still after the project files got deleted. The target timestamp is around 2 hours before the oldest backup. I'll be needing some personal help if possible. I have reached out on #1104 and emailed the required details on<EMAIL_ADDRESS>Really appreciate you guys trying to help out. Thanks in advance!


Various issues

Fresh install in Laravel 10 project.

create_translations_table wasn't published. had to copy it manually
pages/translations/index uses the wrong data type for props.translations. The translations are not paginated, so the type is simply Record<string, Translation>.

Not sure if it's just a problem in my environment, but running npm run dev in the package folder only works for a couple of minutes, then the process crashes with an out of memory error:
FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory```

On a side note, it would be great if you could opt out of the custom Contributor auth system and just use the app's own User. It probably makes the package development easier, but it's annoying to have to create separate users in order to manage translations.

This should be fixed in the latest release.


Create the final PR branch

Create the branch that will be send as a PR in the original repo

Note: we also have to update the README to include our algorithms

I will create this branch when all other issues are closed.

Pr branch now ready. Closing.


⚠ Bofrost.fr has degraded performance

In d8689c8, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 843 ms

Resolved: Bofrost.fr performance has improved in 408408c after 7 minutes.


Installing Powershell Core prevents Windows Powershell to be launched from the address bar of Windows Explorer

Steps to reproduce
Install Powershell Core 6.2.0-preview.3 on a Windows Machine,
open an arbitraty folder in Windows Explorer and type powershell in the address bar

Expected behavior
run powershell with the pwd sets to the folder opened in Windows Explorer

Actual behavior
Open the $Home\Documents\Powershell folder in Windows Explorer

Environment data

Name                           Value
----                           -----
PSVersion                      6.2.0-preview.3
PSEdition                      Core
GitCommitId                    6.2.0-preview.3
OS                             Microsoft Windows 10.0.18305
Platform                       Win32NT
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>
WSManStackVersion              3.0

@leoniDEV,
Just an FYI
If you type "pwsh", it work!
If you type PowerShell, and you have a PowerShell folder name, then it goes to the PowerShell folder.
If you want to open a Windows PowerShell Console, then you'll need to type "PowerShell.exe".
I don't think is a bug as typing powershell won't open PowerShell Core.
:)

The bug isn't that typing powershell in the address bar won't open Powershell Core, but to me the bug was that if Powershell Core is installed you can't run Windows Powershell typing powershell in the address bar of Windows Explorer.
Anyway this issue can be closed as now I know that need to add the .exe extension to run powershell

Thanks for documenting these work-arounds.  Whether it's technically considered a bug or not, I'm kind of annoyed that installing PowerShell Core changed the default behavior of my OS......


Fixed failed to build C langauge version.

the position of -lpcre2-8 have to use after source files. reference to https://stackoverflow.com/a/20731299/5354202

Thank you, but why did you add time.h?

@mariomka
Because the CLOCK_MONOTONIC definition cannot be found in /usr/include/x86_64-linux-gnu/sys/time.h, but /usr/include/time.h.

Ok. Thank you. I'll update run-benchmarks.php script.


Home and Search Buttons converting to Texts

I have my left panel compressed to icons only, and every time I open the Library the icons convert to text.

Thanks for the bug report, I think I know what is causing this. I will take a look later this week when I have more time.


FR: select key and edit in a type of val or just merely in string

further explains:

by the type I mean like a float or int or just barely string.
by the select and edit I mean compared to the original optional-keyVal way, just select the key and then manually input the value.
which can improve the liberty

Just want to add in it would be nice to the ability to handle boolean values as well.

Just want to add in it would be nice to have the ability to handle boolean values as well.

I agree. Currently, it's all character types, so I'd like to see that improved.


gzip can't decode concatenated gzip streams

SDK: 2.14.1
final data = [
  ...gzip.encode([0, 0, 0, 0]),
  ...gzip.encode([1, 1, 1, 1]),
];
final decoded = gzip.decode(data); // only [0, 0, 0, 0], expected: [0, 0, 0, 0, 1, 1, 1, 1]

In comparison, the command-line gzip is just fine with decoding the concatenated stream.

It does seem that detecting multiple data streams and extracting them as one is the default behavior.
We may want to copy that, so after decoding one gzip stream, we check whether it's followed by another.

It has many practical use cases, e.g. .tar.gz and .warc.gz files compressed by file segments - it makes the overall file seekable to a certain file position (with an outside index), while keeping the overall compression. We could probably use the segmented .tar.gz approach in pub.dev's backend to store dartdoc content too.
I think the implementation may need to change only a little bit: don't close the processing on the end of the gzip frame during chunked encoding, rather close it only at the end of the input stream.

Duplicate of https://github.com/dart-lang/sdk/issues/55469


refactor: className

Overview
secretly support className
a) Fixes to the core, and
b) Framework functionality that can only be achieved by the core.
If your functionality can be delivered as a 3rd-Party Community Add-On, we encourage that route as it will likely provide a faster path to adoption.
If you feel your functionality is of high value to everybody in the Qwik Community, we encourage socializing it in the Qwik Discord channels as the core team may take this up for inclusion in the core.
— Build primitives is our mantra
-->
What is it?

[x] Feature / enhancement
[ ] Bug
[ ] Docs / tests / types / typos

Description
Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.
Use cases and why

One use case

Another use case

Checklist:

[x] My code follows the developer guidelines of this project
[ ] I have performed a self-review of my own code
[x] I have made corresponding changes to the documentation
[ ] Added new tests to cover the fix / functionality

@PatrickJS is it still valid or is it abandoned? Thanks

@gioboa abandoned


[BUG] - Failed in cdk publishAsset during env deployment

Describe the bug
A clear and concise description of what the bug is.
We are busy doing the deployment of Orbit workbench into a high secure cloud account that will be used by a bank. Because of the nature of the business, this account is hardened.
During the deployment of step 9"env" the deployment fails with below error. We are trying to figure out what the installation is trying to do that fails with access denied so we can know what requirements are needed in order to get that resource created.

To Reproduce
Steps to reproduce the behavior:
Deploy Orbit following "https://awslabs.github.io/aws-orbit-workbench/installation" until you get to step 9. The deployment of environment.
Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):

OS:Linux

Additional context
Add any other context about the problem here.

the AWS CDK publishes assets to a toolkit bucket. assets are things like files for S3 or zip files containing Lambda source code. I can't tell from the log snippet where in the cdk deploy it is failing. I suspect permissions on the cdk-toolkit bucket or the Role publishing to it have been scoped down for your hardened account.
if the failure is occurring orbit's cdk deployment, you can try updating the cli/aws_orbit/cdk.py file, line 44 and adding cdk verbose logging and debugging. this might give you some additional info on the bucket, key, etc.
        "cdk deploy --require-approval never --progress events -vvvvv --debug "

but it's also possible the cdk call is being made by another library orbit uses. I might be able to tell from more of the log if you want to provide here.

I am not sure why it fails to find the stack ('CDKToolkit') when is there when I view via the console

The toolkit stack deployed successfully.
Error message
[2022-09-13 00:13:58,181][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:53,320][sh.py        : 30] Successfully built f7ab86b0af51
[2022-09-13 00:13:58,181][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:53,320][sh.py        : 30] Successfully tagged cdk-a51e0d345fa2155b309c20166217ef6a61809a1ac8bed99a4675c06393e8b32c:latest
[2022-09-13 00:13:58,181][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:53,761][sh.py        : 30] orbit-orbit: deploying...
[2022-09-13 00:13:58,181][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:53,769][sh.py        : 30] Waiting for stack CDKToolkit to finish creating or updating...
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:53,853][sh.py        : 30] [AWS cloudformation 400 0.085s 0 retries] describeStacks({ StackName: 'CDKToolkit' })
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:53,854][sh.py        : 30] Call failed: describeStacks({"StackName":"CDKToolkit"}) => Stack with id CDKToolkit does not exist (code=ValidationError)
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:53,854][sh.py        : 30] Stack CDKToolkit does not exist
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:53,854][sh.py        : 30] The environment aws://352133749271/eu-central-1 doesn't have the CDK toolkit stack (CDKToolkit) installed. Use cdk bootstrap "aws://352133749271/eu-central-1" to setup your environment for use with the toolkit.
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:53,967][sh.py        : 30] [AWS cloudformation 400 0.111s 0 retries] describeStacks({ StackName: 'orbit-orbit' })
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:53,967][sh.py        : 30] Call failed: describeStacks({"StackName":"orbit-orbit"}) => Stack with id orbit-orbit does not exist (code=ValidationError)
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30]
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30]  ❌  orbit-orbit failed: Error: This stack uses assets, so the toolkit stack must be deployed to the environment (Run "cdk bootstrap aws://352133749271/eu-central-1")
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30]     at Object.addMetadataAssetsToManifest (/usr/lib/node_modules/aws-cdk/lib/assets.ts:27:11)
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30]     at Object.deployStack (/usr/lib/node_modules/aws-cdk/lib/api/deploy-stack.ts:211:29)
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30]     at processTicksAndRejections (internal/process/task_queues.js:97:5)
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30]     at CdkToolkit.deploy (/usr/lib/node_modules/aws-cdk/lib/cdk-toolkit.ts:180:24)
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30]     at initCommandLine (/usr/lib/node_modules/aws-cdk/bin/cdk.ts:208:9)
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30] This stack uses assets, so the toolkit stack must be deployed to the environment (Run "cdk bootstrap aws://352133749271/eu-central-1")
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30] Error: This stack uses assets, so the toolkit stack must be deployed to the environment (Run "cdk bootstrap aws://352133749271/eu-central-1")
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30]     at Object.addMetadataAssetsToManifest (/usr/lib/node_modules/aws-cdk/lib/assets.ts:27:11)
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30]     at Object.deployStack (/usr/lib/node_modules/aws-cdk/lib/api/deploy-stack.ts:211:29)
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30]     at processTicksAndRejections (internal/process/task_queues.js:97:5)
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30]     at CdkToolkit.deploy (/usr/lib/node_modules/aws-cdk/lib/cdk-toolkit.ts:180:24)
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,019][sh.py        : 30]     at initCommandLine (/usr/lib/node_modules/aws-cdk/bin/cdk.ts:208:9)
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] [2022-09-12 22:13:54,024][sh.py        : 30]
[2022-09-13 00:13:58,182][_remote.py   : 30] [CODEBUILD] Traceback (most recent call last):
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/bin/codeseeder", line 8, in
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]     sys.exit(main())
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/aws_codeseeder/main.py", line 161, in main
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]     cli()
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/click/core.py", line 829, in call
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]     return self.main(*args, **kwargs)
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/click/core.py", line 782, in main
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]     rv = self.invoke(ctx)
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]     return _process_result(sub_ctx.command.invoke(sub_ctx))
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/click/core.py", line 1066, in invoke
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]     return ctx.invoke(self.callback, **ctx.params)
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/click/core.py", line 610, in invoke
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]     return callback(*args, **kwargs)
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/aws_codeseeder/main.py", line 153, in execute
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]     func(*fn_args["args"], **fn_args["kwargs"])
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/aws_orbit/remote_files/deploy.py", line 398, in deploy_env
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]     deploy_env(env_name=env_name, manifest_dir=manifest_dir)
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/aws_codeseeder/codeseeder.py", line 229, in wrapper
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]     return func(*args, **kwargs)
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/aws_orbit/remote_files/deploy.py", line 376, in deploy_env
[2022-09-13 00:13:58,183][_remote.py   : 30] [CODEBUILD]     eks_system_masters_roles_changes=changeset.eks_system_masters_roles_changeset if changeset else None,
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/aws_orbit/remote_files/env.py", line 80, in deploy
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD]     args=args,
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/aws_orbit/cdk.py", line 49, in deploy
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD]     sh.run(cmd=cmd)
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/aws_orbit/sh.py", line 29, in run
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD]     for line in _run_iterating(cmd=cmd, cwd=cwd):
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD]   File "/root/.venv/lib/python3.7/site-packages/aws_orbit/sh.py", line 23, in _run_iterating
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD]     raise FailedShellCommand(f"Exit code: {p.returncode}")
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD] aws_orbit.exceptions.FailedShellCommand: Exit code: 1
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD]
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD] [Container] 2022/09/12 22:13:54 Command did not exit successfully codeseeder execute --args-file fn_args.json --debug exit status 1
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD] [Container] 2022/09/12 22:13:54 Phase complete: BUILD State: FAILED
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD] [Container] 2022/09/12 22:13:54 Phase context status code: COMMAND_EXECUTION_ERROR Message: Error while executing command: codeseeder execute --args-file fn_args.json --debug. Reason: exit status 1
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD] [Container] 2022/09/12 22:13:54 Entering phase POST_BUILD
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD] [Container] 2022/09/12 22:13:54 Running command . ~/.venv/bin/activate
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD]
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD] [Container] 2022/09/12 22:13:54 Running command cd ${CODEBUILD_SRC_DIR}/bundle
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD]
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD] [Container] 2022/09/12 22:13:54 Phase complete: POST_BUILD State: SUCCEEDED
[2022-09-13 00:13:58,184][_remote.py   : 30] [CODEBUILD] [Container] 2022/09/12 22:13:54 Phase context status code:  Message:
[2022-09-13 00:14:04,559][codebuild.py :241] phase: COMPLETED (FAILED)
[ Error ] RuntimeError: CodeBuild build (codeseeder-orbit:24a37b42-c569-474e-a979-a169d33db649) is FAILED
Error Traceback:
Traceback (most recent call last):
File "/Users/qxz1iu6/HSDAP/orbit/aws-orbit-workbench/cli/.venv/bin/orbit", line 33, in
sys.exit(load_entry_point('aws-orbit', 'console_scripts', 'orbit')())
File "/Users/qxz1iu6/HSDAP/orbit-public/aws-orbit-workbench-main/cli/aws_orbit/main.py", line 849, in main
cli()
File "/Users/qxz1iu6/HSDAP/orbit/aws-orbit-workbench/cli/.venv/lib/python3.8/site-packages/click/core.py", line 829, in call
return self.main(*args, **kwargs)
File "/Users/qxz1iu6/HSDAP/orbit/aws-orbit-workbench/cli/.venv/lib/python3.8/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/Users/qxz1iu6/HSDAP/orbit/aws-orbit-workbench/cli/.venv/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/Users/qxz1iu6/HSDAP/orbit/aws-orbit-workbench/cli/.venv/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/Users/qxz1iu6/HSDAP/orbit/aws-orbit-workbench/cli/.venv/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/Users/qxz1iu6/HSDAP/orbit/aws-orbit-workbench/cli/.venv/lib/python3.8/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/Users/qxz1iu6/HSDAP/orbit-public/aws-orbit-workbench-main/cli/aws_orbit/main.py", line 221, in deploy_env
deploy_commands.deploy_env(
File "/Users/qxz1iu6/HSDAP/orbit-public/aws-orbit-workbench-main/cli/aws_orbit/commands/deploy.py", line 215, in deploy_env
deploy.deploy_env(
File "/Users/qxz1iu6/HSDAP/orbit-public/aws-orbit-workbench-main/cli/aws_orbit/remote_files/deploy.py", line 398, in deploy_env
deploy_env(env_name=env_name, manifest_dir=manifest_dir)
File "/Users/qxz1iu6/HSDAP/orbit/aws-orbit-workbench/cli/.venv/lib/python3.8/site-packages/aws_codeseeder/codeseeder.py", line 294, in wrapper
_remote.run(
File "/Users/qxz1iu6/HSDAP/orbit/aws-orbit-workbench/cli/.venv/lib/python3.8/site-packages/aws_codeseeder/_remote.py", line 100, in run
_execute_codebuild(
File "/Users/qxz1iu6/HSDAP/orbit/aws-orbit-workbench/cli/.venv/lib/python3.8/site-packages/aws_codeseeder/_remote.py", line 80, in _execute_codebuild
_wait_execution(
File "/Users/qxz1iu6/HSDAP/orbit/aws-orbit-workbench/cli/.venv/lib/python3.8/site-packages/aws_codeseeder/_remote.py", line 42, in _wait_execution
for status in codebuild.wait(build_id=build_id):
File "/Users/qxz1iu6/HSDAP/orbit/aws-orbit-workbench/cli/.venv/lib/python3.8/site-packages/aws_codeseeder/services/codebuild.py", line 246, in wait
raise RuntimeError(f"CodeBuild build ({build_id}) is {build.status.value}")
RuntimeError: CodeBuild build (codeseeder-orbit:24a37b42-c569-474e-a979-a169d33db649) is FAILED
╭─ ~/HSDAP/orbit-public/aws-orbit-workbench-main/cli/conf
╰─

Without seeing all the assets, my first estimate is that your CDK deployment is incomplete.
[2022-09-13 00:13:58,182][_remote.py : 30] [CODEBUILD] [2022-09-12 22:13:53,853][sh.py : 30] [AWS cloudformation 400 0.085s 0 retries] describeStacks({ StackName: 'CDKToolkit' })
[2022-09-13 00:13:58,182][_remote.py : 30] [CODEBUILD] [2022-09-12 22:13:53,854][sh.py : 30] Call failed: describeStacks({"StackName":"CDKToolkit"}) => Stack with id CDKToolkit does not exist (code=ValidationError)

Check to make sure the stack "CDKToolkit" is in CloudFormation in that region.  If so, look at the resources created.  You should see the follwing resources (at least):
CdkBootstrapVersion - an SSM parameter
ContainerAssetsRepository - an ECR repo
Make sure those assets exist.  If they do not, you need to rebootstrap (cdk bootstrap aws://352133749271/eu-central-1).

Hi @dgraeber,
I can confirm that the toolkit is in the right region.

orbit-orbit-toolkit

orbit-orbit-cdk-toolkit

The toolkit, credentials and images stack applied successfully. the problem raises when I apply env stack.

@bozethe Though I agree that the orbit toolkits deployed, I am referring to the cdk toolkit (literally named CDKToolkit).  This stack ('CDKToolkit`) deploys the resources necessary for you to use the CDK (regardless of the application being deployed).  As the stack trace indicated in my previous post, it did not seem to be found (which is concerning).

Please see my previous post and confirm that the CDKToolkit is deployed and the resources exist.

I checked both ssm parameter store and ecr and there is orbit resources created.
I also tried several time to delete everything and redeploy but I keep on hitting the same error.

@bozethe  Looking at the image you attached, the SSM parameters are unfiltered and I do not see a/cdk-bootstrap/ parameter in SSM, which would have been deployed with a valid CDKToolkit.   In that stack, there is also a resource for the cdk repos for ECR .... check if you have those?
Please confirm the resources for the CDKToolkit (unrelated to orbit) are deployed.  What version of CDK are you bootstrapped for?

@bozethe, from your original logs are you able to locate the cdk deploy command that is being executed when this failure occurs? your original logs don't include enough info before the error is thrown. it will be somewhere above the "Step 1/9" in the logs and should look something like this (i have updated mine to appear as i would expect yours to look):
cdk deploy --require-approval never --progress events --toolkit-stack-name orbit-orbit-cdk-toolkit --app "python /root/.venv/lib/python3.7/site-packages/aws_orbit/remote_files/cdk/env.py issue" --output .orbit.out/issue/cdk/orbit-orbit

you'll notice that the name of the toolkit stack to use is included in the command (--toolkit-stack-name).
i'd like to confirm that the correct toolkit stack is being passed to the cdk. from the second set of logs you sent, i see this line:
 Call failed: describeStacks({"StackName":"orbit-orbit"}) => Stack with id orbit-orbit does not exist (code=ValidationError)

which leads me to wonder if the wrong toolkit stack name is being supplied upstream.

also, can you check the value of the CdkToolkit stored in the /orbit/orbit/context and the /orbit/orbit/manifest ParameterStore parameters? there may not be an entry in the /manifest one.

Below is the contents of "/orbit/orbit/context" for value CdkToolkit
{
"AccountId":"3520000009271",
"CdkToolkit":{
"S3Bucket":"orbit-orbit-cdk-toolkit-3520000009271-lreido",
"StackName":"orbit-orbit-cdk-toolkit"
},
There is no CdkToolkit in /orbit/orbit/manifest parameter.
I believe the correct toolkit stack is passed. see below.

       Use cdk bootstrap "aws://552000000073/eu-central-1" to setup your environment for use with the toolkit.
[2022-09-14 09:38:03,357][sh.py        : 30] [AWS cloudformation 400 0.108s 0 retries] describeStacks({ StackName: 'orbit-orbit' })
[2022-09-14 09:38:03,357][sh.py        : 30] Call failed: describeStacks({"StackName":"orbit-orbit"}) => Stack with id orbit-orbit does not exist (code=ValidationError)
[2022-09-14 09:38:03,403][sh.py        : 30]
[2022-09-14 09:38:03,404][sh.py        : 30]  ❌  orbit-orbit failed: Error: This stack uses assets, so the toolkit stack must be deployed to the environment (Run "cdk bootstrap aws://552000000073/eu-central-1")
[2022-09-14 09:38:03,404][sh.py        : 30]     at Object.addMetadataAssetsToManifest (/usr/lib/node_modules/aws-cdk/lib/assets.ts:27:11)
[2022-09-14 09:38:03,404][sh.py        : 30]     at Object.deployStack (/usr/lib/node_modules/aws-cdk/lib/api/deploy-stack.ts:211:29)
[2022-09-14 09:38:03,404][sh.py        : 30]     at processTicksAndRejections (internal/process/task_queues.js:97:5)
[2022-09-14 09:38:03,404][sh.py        : 30]     at CdkToolkit.deploy (/usr/lib/node_modules/aws-cdk/lib/cdk-toolkit.ts:180:24)
[2022-09-14 09:38:03,404][sh.py        : 30]     at initCommandLine (/usr/lib/node_modules/aws-cdk/bin/cdk.ts:208:9)
[2022-09-14 09:38:03,404][sh.py        : 30] This stack uses assets, so the toolkit stack must be deployed to the environment (Run "cdk bootstrap aws://552000000073/eu-central-1")
[2022-09-14 09:38:03,404][sh.py        : 30] Error: This stack uses assets, so the toolkit stack must be deployed to the environment (Run "cdk bootstrap aws://552000000073/eu-central-1")
[2022-09-14 09:38:03,404][sh.py        : 30]     at Object.addMetadataAssetsToManifest (/usr/lib/node_modules/aws-cdk/lib/assets.ts:27:11)
[2022-09-14 09:38:03,404][sh.py        : 30]     at Object.deployStack (/usr/lib/node_modules/aws-cdk/lib/api/deploy-stack.ts:211:29)
[2022-09-14 09:38:03,404][sh.py        : 30]     at processTicksAndRejections (internal/process/task_queues.js:97:5)
[2022-09-14 09:38:03,404][sh.py        : 30]     at CdkToolkit.deploy (/usr/lib/node_modules/aws-cdk/lib/cdk-toolkit.ts:180:24)
[2022-09-14 09:38:03,404][sh.py        : 30]     at initCommandLine (/usr/lib/node_modules/aws-cdk/bin/cdk.ts:208:9)
[2022-09-14 09:38:03,410][sh.py        : 30]
Traceback (most recent call last):
File "/root/.venv/bin/codeseeder", line 8, in
sys.exit(main())
File "/root/.venv/lib/python3.7/site-packages/aws_codeseeder/main.py", line 161, in main
cli()
File "/root/.venv/lib/python3.7/site-packages/click/core.py", line 829, in call
return self.main(*args, **kwargs)
File "/root/.venv/lib/python3.7/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/root/.venv/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/root/.venv/lib/python3.7/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/root/.venv/lib/python3.7/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/root/.venv/lib/python3.7/site-packages/aws_codeseeder/main.py", line 153, in execute
func(*fn_args["args"], **fn_args["kwargs"])
File "/root/.venv/lib/python3.7/site-packages/aws_orbit/remote_files/deploy.py", line 398, in deploy_env
deploy_env(env_name=env_name, manifest_dir=manifest_dir)
File "/root/.venv/lib/python3.7/site-packages/aws_codeseeder/codeseeder.py", line 229, in wrapper
return func(*args, **kwargs)
File "/root/.venv/lib/python3.7/site-packages/aws_orbit/remote_files/deploy.py", line 376, in deploy_env
eks_system_masters_roles_changes=changeset.eks_system_masters_roles_changeset if changeset else None,
File "/root/.venv/lib/python3.7/site-packages/aws_orbit/remote_files/env.py", line 80, in deploy
args=args,
File "/root/.venv/lib/python3.7/site-packages/aws_orbit/cdk.py", line 49, in deploy
sh.run(cmd=cmd)
File "/root/.venv/lib/python3.7/site-packages/aws_orbit/sh.py", line 29, in run
for line in _run_iterating(cmd=cmd, cwd=cwd):
File "/root/.venv/lib/python3.7/site-packages/aws_orbit/sh.py", line 23, in _run_iterating
raise FailedShellCommand(f"Exit code: {p.returncode}")
aws_orbit.exceptions.FailedShellCommand: Exit code: 1
[Container] 2022/09/14 09:38:03 Command did not exit successfully codeseeder execute --args-file fn_args.json --debug exit status 1
[Container] 2022/09/14 09:38:03 Phase complete: BUILD State: FAILED
[Container] 2022/09/14 09:38:03 Phase context status code: COMMAND_EXECUTION_ERROR Message: Error while executing command: codeseeder execute --args-file fn_args.json --debug. Reason: exit status 1
[Container] 2022/09/14 09:38:03 Entering phase POST_BUILD
[Container] 2022/09/14 09:38:03 Running command . ~/.venv/bin/activate
[Container] 2022/09/14 09:38:03 Running command cd ${CODEBUILD_SRC_DIR}/bundle
[Container] 2022/09/14 09:38:03 Phase complete: POST_BUILD State: SUCCEEDED
[Container] 2022/09/14 09:38:03 Phase context status code:  Message:

ok. i see one problem that we caused by trying to add debugging for your original problem. in the image there is no space between the --debug parameter and the --toolkit-stack-name parameter, i see:
-vvvvv --debug--toolkit-stack-name orbit-orbit-cdk-toolkit

i'm pretty certain this is causing the problem with the toolkit stack not being found. just need to go back to that cli/aws_orbit/cdk.py file and ensure there is a space after the --debug parameter.
this should get us back to your original problem which was the ACCESS_DENIED. hopefully with the added -vvvvv and --debug we'll have more info to figure that out.

Hi @chamcca, Putting a space after debug helped. I see now that the stack tries to upload file into s3 bucket. The reason why it fails with access denied is because we are only allowed to upload to s3 if we pass server encryption option when uploading. Could you please help with identifying the file I need to update with Server Encryption option?
Below are some changes I made that got me started. before making this changes, I couldn't run even the toolkit stack
cli/aws_orbit/services/s3.py

LOGS

807d89.zip
[2022-09-16 09:08:30,591][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:24,217][sh.py        : 30] orbit-orbit: checking if we can skip deploy
[2022-09-16 09:08:30,591][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:24,217][sh.py        : 30] orbit-orbit: no existing stack
[2022-09-16 09:08:30,591][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:24,217][sh.py        : 30] orbit-orbit: deploying...
[2022-09-16 09:08:30,591][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:24,241][sh.py        : 30] [0%] start: Publishing bfa1f46d035e17a921b45e305aa6ba969a2216112b92e6c33f576c3d3ac2ed25:current
[2022-09-16 09:08:30,591][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:24,250][sh.py        : 30] [0%] check: Check s3://orbit-orbit-cdk-toolkit-352133749271-lreido/assets/bfa1f46d035e17a921b45e305aa6ba969a2216112b92e6c33f576c3d3ac2ed25.zip
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:24,403][sh.py        : 30] [AWS s3 200 0.153s 0 retries] getBucketLocation({ Bucket: 'orbit-orbit-cdk-toolkit-352133749271-lreido' })
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:24,535][sh.py        : 30] [AWS s3 200 0.132s 0 retries] listObjectsV2({
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:24,536][sh.py        : 30]   Bucket: 'orbit-orbit-cdk-toolkit-352133749271-lreido',
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:24,536][sh.py        : 30]   Prefix: 'assets/bfa1f46d035e17a921b45e305aa6ba969a2216112b92e6c33f576c3d3ac2ed25.zip',
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:24,536][sh.py        : 30]   MaxKeys: 1
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:24,536][sh.py        : 30] })
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:24,536][sh.py        : 30] [0%] build: Zip /codebuild/output/src343788118/src/bundle/.orbit.out/orbit/cdk/orbit-orbit/asset.bfa1f46d035e17a921b45e305aa6ba969a2216112b92e6c33f576c3d3ac2ed25 -> [object Object]
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,366][sh.py        : 30] [0%] upload: Upload s3://orbit-orbit-cdk-toolkit-352133749271-lreido/assets/bfa1f46d035e17a921b45e305aa6ba969a2216112b92e6c33f576c3d3ac2ed25.zip
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,426][sh.py        : 30] [AWS s3 403 0.054s 0 retries] putObject({
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,426][sh.py        : 30]   Body: <Buffer 50 4b 03 04 14 00 08 00 08 00 00 00 21 00 00 00 00 00 00 00 00 00 00 00 00 00 0b 00 00 00 5f 5f 69 6e 69 74 5f 5f 2e 70 79 5d 52 cb 6e db 30 10 bc e7 ... 1656837 more bytes>,
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,426][sh.py        : 30]   Bucket: 'orbit-orbit-cdk-toolkit-352133749271-lreido',
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,426][sh.py        : 30]   Key: 'assets/bfa1f46d035e17a921b45e305aa6ba969a2216112b92e6c33f576c3d3ac2ed25.zip',
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,426][sh.py        : 30]   ContentType: 'application/zip'
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,426][sh.py        : 30] })
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,426][sh.py        : 30] [33%] fail: Access Denied
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,426][sh.py        : 30] [33%] start: Publishing d0a91ce4cd1c8c65657431d94a5571d6b756c595542d0ca50c1514619f008fae:current
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,427][sh.py        : 30] [33%] check: Check s3://orbit-orbit-cdk-toolkit-352133749271-lreido/assets/d0a91ce4cd1c8c65657431d94a5571d6b756c595542d0ca50c1514619f008fae.zip
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,469][sh.py        : 30] [AWS s3 200 0.042s 0 retries] getBucketLocation({ Bucket: 'orbit-orbit-cdk-toolkit-352133749271-lreido' })
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,493][sh.py        : 30] [AWS s3 200 0.024s 0 retries] listObjectsV2({
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,493][sh.py        : 30]   Bucket: 'orbit-orbit-cdk-toolkit-352133749271-lreido',
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,493][sh.py        : 30]   Prefix: 'assets/d0a91ce4cd1c8c65657431d94a5571d6b756c595542d0ca50c1514619f008fae.zip',
[2022-09-16 09:08:30,592][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,494][sh.py        : 30]   MaxKeys: 1
[2022-09-16 09:08:30,593][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,494][sh.py        : 30] })
[2022-09-16 09:08:30,593][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,494][sh.py        : 30] [33%] build: Zip /codebuild/output/src343788118/src/bundle/.orbit.out/orbit/cdk/orbit-orbit/asset.d0a91ce4cd1c8c65657431d94a5571d6b756c595542d0ca50c1514619f008fae -> [object Object]
[2022-09-16 09:08:30,593][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,501][sh.py        : 30] [33%] upload: Upload s3://orbit-orbit-cdk-toolkit-352133749271-lreido/assets/d0a91ce4cd1c8c65657431d94a5571d6b756c595542d0ca50c1514619f008fae.zip
[2022-09-16 09:08:30,593][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,547][sh.py        : 30] [AWS s3 403 0.045s 0 retries] putObject({
[2022-09-16 09:08:30,593][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,547][sh.py        : 30]   Body: <Buffer 50 4b 03 04 14 00 08 00 08 00 00 00 21 00 00 00 00 00 00 00 00 00 00 00 00 00 0b 00 00 00 5f 5f 69 6e 69 74 5f 5f 2e 70 79 5d 52 cb 6e db 30 10 bc e7 ... 3170 more bytes>,
[2022-09-16 09:08:30,593][_remote.py   : 30] [CODEBUILD] [2022-09-16 07:08:25,547][sh.py        : 30]   Bucket: 'orbit-orbit-cdk-toolkit-352133749271-lreido',

unfortunately there isn't a simple fix for this. the orbit CLI is not managing these uploads, they are being managed by the CDK CLI.
the orbit build is currently using CDK v1.100.0. there was issue opened to the CDK team (https://github.com/aws/aws-cdk/issues/11265) to address this very problem and a PR was issued (https://github.com/aws/aws-cdk/issues/17668). i dug into the CDK releases and found this PR was released with CDK v1.135.0 (https://github.com/aws/aws-cdk/releases/tag/v1.135.0)
as i understand this fix, on cdk deploy the CDK CLI will read the default encryption settings for the bucket and if encryption is set, will update the put requests (including the x-amz-server-side-encryption header).
it should be possible to upgrade the version of the CDK used in the deployment, but this is untested. i am running some preliminary tests to document the steps necessary, and check the S3 API calls to ensure the encryption header is added. i will update here with results.

so, i've been able to confirm that updating the version of the CDK used for the deployment seems to work. i updated the remote configuration to install CDK v1.135.0 (the minimum with the new functionality) then let it upload assets. i then verified in the CloudTrail logs that the assets are uploaded with the x-amz-server-side-encryption header.
to attempt this is actually pretty easy, you just need to modify the cli/aws_orbit/remote_files/__init__.py file, adding a new install command to the configure function:
configuration.install_commands = ["npm install -g<EMAIL_ADDRESS>

Thank you @chamcca, That solved the problem with access denied on s3 upload.

@chamcca  I hope you will be able to advice on how I can fix below error. As I said, our account is highly hardened. this is banks requirement.
arn:aws:sts::00000001344:assumed-role/orbit-orbit-eu-central-1-admin/AWSCodeBuild-cc3021c7-8779-47c4-8c91-2e9b8a5f4a16  is not authorized to perform: serverlessrepo:CreateCloudFormationTemplate on resource: arn:aws:serverlessrepo:us-east-1:903779448426:applications/lambda-layer-kubectl with an explicit deny

the cloudformation stack for the orbit environment deploys a Lambda function that fires as a post authentication event. this Lambda makes use of a Lambda Layer provided by AWS that enables the kubectl CLI inside the Lambda function. the ARN of this layer is shown above as arn:aws:serverlessrepo:us-east-1:903779448426:applications/lambda-layer-kubectl.
the CDK uses the AWS SAM to create this Lambda Layer. as the error states, there is an explicit DENY preventing the orbit-orbit-eu-central-1-admin Role from calling the serverlessrepo:CreateCloudFormationTemplate and possibly explicitly DENYing cross-account access to the arn:aws:serverlessrepo:us-east-1:903779448426:applications/lambda-layer-kubectl.
are you using a Permissions Boundary Policy attached to the orbit-orbit-eu-central-1-admin Role? it could also be an Organization level DENY that is prohibiting this. with an explicit DENY in place, even updating the orbit-orbit-eu-central-1-admin Role and explicitly Allowing access to the Action and Resource will fail. explicit DENYs trump all other ALLOWs.


[Automation] Generate Fluent Lite from cognitiveservices#package-2022-12

[Automation] Generate Fluent Lite from cognitiveservices#package-2022-12

API change check
API changes are not detected in this pull request.


Curl timeout too long

I think 30s is too long for a server.
Maybe we can add a param into constructer?

I make a fork and change the timeout to be a param.


[Bug]: Archetype contracts not compiling

What happened?

File "contracts/escrowBasic.arl", line 34, characters 10-11: Error (parsing)
  Error while analyzing a transition or a transition.

File "contracts/auctionZilliqa.arl", line 30, characters 0-6: Error (parsing)
  Error while analyzing a specification declaration.

┌───────────────────────┬──────────────┐
│ Contract                                                                       │ Artifact
├───────────────────────┼──────────────┤
│ auctionZilliqa.arl                                                           │ Not compiled │
├───────────────────────┼──────────────┤
│ escrowBasic.arl                                                            │ Not compiled │
├───────────────────────┼──────────────┤
│ escrowWithPenalty.arl                                                 │ Not compiled │
└───────────────────────┴──────────────┘
Reproduced using escrow site from https://docs.archetype-lang.org/contract-library/
archetype escrow_basic

variable buyer : role  = @tz1KmuhR6P52hw6xs5P69BXJYAURaznhvN1k

variable seller : role = @tz1XJYAURaznhvN1khR6P52hw6xs5P691Kmu

variable oracle : role = @tz15P69BXJYAURaznhvN1k1KmuhR6P52hw6x

variable price : tez = 10tz

(* action deadline *)
variable deadline : date = 2019-06-01T00:00:00

(* state machine *)
states =
 | Created initial
 | Aborted   with { i1 : balance = 0tz; }
 | Confirmed with { i2 : balance = price; }
 | Canceled  with { i3 : balance = 0tz; }
 | Completed with { i4 : balance = 0tz; }

transition abort () {
  called by buyer or seller

  from Created
  to Aborted
}

transition confirm () {
  from Created
  to Confirmed when { balance = price }
}

transition[%onlyonce%] complete () {
  called by oracle

  from Confirmed
  to Completed when { now < deadline }
  with effect {
    transfer price to seller
  }
}

transition[%onlyonce%] cancel () {
  called by oracle

  from Confirmed
  to Canceled
  with effect {
    transfer price to buyer
  }
}

security {
  s1 : only_by_role (transfers, oracle)
}

❯ taq compile

File "contracts/escrow-basic.arl", line 34, characters 10-11: Error (parsing)
  Error while analyzing a transition or a transition.
┌──────────────────┬──────────────┐
│ Contract         │ Artifact     │
├──────────────────┼──────────────┤
│ escrow-basic.arl │ Not compiled │
└──────────────────┴──────────────┘```

### What should have happened?

All Archetype contracts should compile

### Steps to reproduce the bug

1. Install Taqueria
2. Initiate taq project
3. Install Arechetype plugin
5. Add contract to contracts folder
6. Run ```taq compile```

### Relevant log output

_No response_

### Screenshots and images

Screenshot and images

### Code of Conduct

- [X] I agree to follow this project's Code of Conduct

After some investigation, I found that this problem exists when using the completium-cli directly to compile the escrow contract. As such, this doesn't appear to be a problem with the plugin but rather the contract or the completium-cli.
I've assigned this to you @russellmorton as I believe you were going to reach back out to their team and get their feedback. Feel free to assign back to me if there's any work necessary on my part. Thanks!

Thanks, @mweichert, I have raised this with Benoit from Archetype.

Hi @russellmorton ,
indeed this version of escrow is outdated and we will soon update the entire doc site; sorry for the inconvenience.
Here is a working version:
https://github.com/edukera/completium-dapp-escrow/blob/technical-guide/contract/escrow.arl
and a presentation
https://completium.com/docs/dapp-escrow
(the dapp is plugged to the old testnet and would need a fresh up)
don't hesitate if question.


tsdb Scan command: continue working on the PR from the legacy project

Proposal
Use case. Why is this important?
I would like to get this PR https://github.com/prometheus-junkyard/tsdb/pull/320 finishes if it's possible as we will have a tool to fix data corruption / missing data due to a non graceful shutdown or whatever it is the main root cause.
It would help us to deal with issues like:
opening storage failed: block dir: \“/prometheus/01E465JQDCJQ4VTJHHXY1DY0CJ\“: open /prometheus/01E465JQDCJQ4VTJHHXY1DY0CJ/meta.json: no such file or directory

or
"opening storage failed: invalid block sequence: block time ranges overlap: [mint:<PHONE_NUMBER>000, maxt:<PHONE_NUMBER>000, range: 2h0m0s, blocks: 3]: <ulid: 01E44NBXZPE2DK62Y1DQZ924XM, mint:<PHONE_NUMBER>000, maxt:<PHONE_NUMBER>000, range: 2h0m0s>, <ulid: 01E44S5SCY6TF6ZT4D3GRMC9HT, mint:<PHONE_NUMBER>000, maxt:<PHONE_NUMBER>000, range: 2h0m0s>, <ulid: 01E457SSGHANP2MMJX5FC1A1T1, mint:<PHONE_NUMBER>000, maxt:<PHONE_NUMBER>000, range: 2h0m0s>"

I know @krasi-georgiev was already working on that PR as I've followed his comments, and I really appreciate your work! In case you need any help and I can help you, feel free to ping me and give me details about how I can help. Thanks!

Are you saying that there are issues reported by people still with these errors?
both of these errors were fixed a long time ago. And will not happen in the recent Prometheus versions.

yes, we had that issue yesterday and it never happened to us during more than 1 year that we have prometheus running - we are running prometheus version v2.12.0 - do you think that the issue should not happen again if we upgrade it to the latest stable one? thanks!

yep, just upgrade to the latest and it will be fine.
Closing this as don't think we need to invest any more time in the scan tool, but feel free to reopen if needed.

sounds good, and thanks for the help!!!


Can’t make it work with OAuth credentials, need an API Key-only method

The Google authentication URL displayed by the script makes Google issue an error message like:

Error 400: invalid_request
You can't sign in to this app because it doesn't comply with Google's OAuth 2.0 policy for keeping apps secure.

I tried many types of credentials from Google Console. I think things have changed and this is why it's not working anymore. You can see this by trying to follow the credentials instruction on the project page, which are completely different nowadays from what you'll find in Google API Console.
Skimming Google documentation, it says you don't need OAuth for an app that will simply browse public YouTube data. OAuth is needed when the app needs to go to places where only the authenticated user is allowed.

You will use an OAuth 2.0 client ID to submit an authorized request that retrieves information about your own YouTube channel.

Is there any way to make it work with an API key only, no OAuth?

Hey! It humbles me that this project is still being used by people! Sadly, I haven't been using it myself for multiple years now and thus can't investigate any issues or test fixes. If someone else wants to take over the project, I'll gladly transfer it.