1559&2930 audit fix

Description

[x] The TxAccessListGadget under constrains the RW delta counter
[x] The EcPairingGadget under constrains the input_mod_192_is_zero
variable
[x] The tx_l1_fee gadget might be under constrained, adding constrain l1_fee_word zero if it is l1 msg tx
[ ] tx gas price as effective gas for eip1559

Issue Link
[link issue here]
Type of change

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Contents

[item]

Rationale
[design decisions and extended information]
How Has This Been Tested?
[explanation]

How to fill a PR description
Please give a concise description of your PR.
The target readers could be future developers, reviewers, and auditors. By reading your description, they should easily understand the changes proposed in this pull request.
MUST: Reference the issue to resolve
Single responsability
Is RECOMMENDED to create single responsibility commits, but not mandatory.
Anyway, you MUST enumerate the changes in a unitary way, e.g.
This PR contains:
- Cleanup of xxxx, yyyy
- Changed xxxx to yyyy in order to bla bla
- Added xxxx function to ...
- Refactored ....

Design choices
RECOMMENDED to:

What types of design choices did you face?
What decisions you have made?
Any valuable information that could help reviewers to think critically

@DreamWuGit Could you make 1 fix pr per finding?

@DreamWuGit Could you make 1 fix pr per finding?

@icemelon OK !

split done & last one is PR #1152 ,


uri.PathAndQuery.ToLower()  is not working and return "Bad mac"

Hawk.cs:
the code in CalculateMac method, when i remove ToLower() ,and work well
var normalized = "hawk.1." + type + "\n" +
ts + "\n" +
nonce + "\n" +
method.ToUpper() + "\n" +
uri.PathAndQuery.ToLower() + "\n" +
sanitizedHost.ToLower() + "\n" +
uri.Port.ToString() + "\n" +
((!string.IsNullOrEmpty(payloadHash)) ? payloadHash : "") + "\n" +
((!string.IsNullOrEmpty(ext)) ? ext : "") + "\n";

Yes, the ".ToLower()" statement was introduced when fixing issule https://github.com/pcibraro/hawknet/issues/24 with commit https://github.com/pcibraro/hawknet/commit/827736735fa9c4e1562021156031f627ace423c6
The issue is NOT in the current nuget version 1.4.4, apparently no new nuget package was build.


Feature/gfw overflow menu on user areas

Overview
Add pop-up message to the MyGFW page letting users know that they can access dashboards for their area by clicking on the thumbnail image
This includes changes in 3 places:

map -> AREAS OF INTEREST new overflow menu
area dashboard new overflow menu
myGFW tooltip to indicate that you can open dashboard when clicking on an saved area.

Demo
--
Notes
Notion: https://www.notion.so/9dd860f5dfd64475b92f4a3f79f0ff37?v=2098a476c4fa407981718cb4eafad507&p=5808bedc1fb844c0935e8e647496ed3c
Testing

Make sure all links go to dashboard, edit area, share area works as expected. from map -> mygfw -> areas menu
MyGFW page, should show tooltip Open dashboard when interacting with it
Make sure active dashboard has new overflow menu, containing download data, open map, edit area, and if location type is country save_area. Make sure these buttons perform the correct actions when pressed.

I notice on the designs there is a grey hover state for the my gfw table rows: https://projects.invisionapp.com/share/R5RXP8JYK9P#/screens/424972072_GFW_-AOIs-_My_GFW_Hover_2. Could you add this in?

I notice on the designs there is a grey hover state for the my gfw table rows: https://projects.invisionapp.com/share/R5RXP8JYK9P#/screens/424972072_GFW_-AOIs-_My_GFW_Hover_2. Could you add this in?

good catch will do it!

@edbrett Pr updated with hover state on areas table

Fixed issue noted on basecamp where AOI title was overflowing the overflow menu

Merging this, approved by client 👍


[#675] fix: filter no space exception in checkStorageReadAndWrite

What changes were proposed in this pull request?
Filter no space exception in checkStorageReadAndWrite
Why are the changes needed?
Fix: #675
Does this PR introduce any user-facing change?
No.
How was this patch tested?
UT

Could you test this patch by hand? Could you modify the description of What changes were proposed in this pull request??

Nice catch. I found the same problems. 👍


Refactor platform resource

Remove name on spec. Use resource name instead
Watch secret and use fieldSelector instead to set platform owners on secret. It needed to track secret change and so recreate client.
Remove endpoint concept. Use template conecpt instead.

Codecov Report

Merging #13 (c60228b) into main (6f9b3d8) will decrease coverage by 0.81%.
The diff coverage is 86.95%.

@@            Coverage Diff             @@
##             main      #13      +/-   ##
==========================================
- Coverage   57.94%   57.12%   -0.82%
==========================================
  Files          20       19       -1
  Lines        1781     1663     -118
==========================================
- Hits         1032      950      -82
+ Misses        651      619      -32
+ Partials       98       94       -4

Flag
Coverage Δ

unittests
57.12% <86.95%> (-0.82%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

api/v1alpha1/platform_types.go
100.00% <ø> (ø)

api/v1alpha1/zz_generated.deepcopy.go
0.00% <0.00%> (ø)

controllers/platform_controller.go
57.14% <90.90%> (+2.46%)
:arrow_up:

controllers/centreonservice_controller.go
62.08% <0.00%> (-6.60%)
:arrow_down:

controllers/centreonservice_helpers.go

controllers/controller_centreon.go
76.83% <0.00%> (+1.69%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Allow drag selection inside nodes

Please describe the feature that you want to propose
Currently, it is not possible to start a drag selection box inside a node. May I suggest a new property like enableDragSelect?
I'm aware this behavior means that you cannot drag the node itself anymore. But in that case, we can make it so that drag selection is only enabled inside node when it has a specified dragHandle. Then both dragging node by its drag handle and drag selection inside node is possible.

You might wanna read this section of the docs.
TL;DR: add the nodrag class name to elements that should not initiate a drag action inside a node.

But that only prevents dragging the node, and you still cannot start drag selection from inside the node.

Well, add some css to the element user-select: text; or all and you're good.

I did and it still doesn't work.
https://github.com/xyflow/xyflow/assets/139328005/80090cee-bace-43c4-9e83-627abc063eee

Mh... not quite sure what the video is supposed to tell me? What exactly are you trying to achieve with "dragging" here?

In the video I start dragging outside of the box it triggers drag selection but when I do it from inside the box nothing happens.

Aha! Well that's quite different from the original issue I assumed you had (thought you were trying to use some input text selection or whatever inside of a node, which the above class name + css would've allowed).
So the problem is using the RF built-in selection box while having the mouse on a node, is that correct?

If that's the case, I don't think that works out of the box sadly - so your initial request might make sense although that's for the maintainers to decide and not me 😄
At least we were able to clarify what the exact issue here is ^^

That's a good question @hiepnguyen3001. Unfortunately this is only possible with a workaround. You could listen to the selection key and set nodesDraggable={false} for example. Would that work?

That's a good question @hiepnguyen3001. Unfortunately this is only possible with a workaround. You could listen to the selection key and set nodesDraggable={false} for example. Would that work?

I don't think so @moklick. Even when I set nodesDraggable={false}, it's still not possible to start a selection box from inside a node.

Damn.. The only way I see then is to add a class or set a style directly that prevents all pointer events.

pointer-events: none; on the node that you want to start the drag selection in worked for me.

We needed this as well and found the same workaround with pointer-events: none;
You can still have other elements inside your Group node that do have pointer events.
Basically we wanted the inner part of a Group node to act more like the Pane.
Additionaly, we wanted the Group node itself to be not selectable by default when using the selection rectangle.
Our hacky solution for that was;
  useEffect(() => {
    // Selectable group nodes only when spacekey is pressed
     if (spaceKeyPressed) {
      updateNode(props.id, { selectable: true });
    } else {
      updateNode(props.id, { selectable: false });
    }
  }, [updateNode, props.id, spaceKeyPressed]);

// note: we use a custom store for the nodes, so the reactflow way looks a bit different
There are more things that could still be improved with Group nodes, but the recent update was already nice to see.


Tabs component not working

We have an issue with the tab block
https://main--sunstar-foundation--sunstar-foundation.hlx.page/grants/received-list

@bosschaert @meejain @sdmcraft

Many Thanks @JiangLong2019 for taking this.
cc @ehrro

Hi @ehrro , the issue has been fixed by authoring, you can have a check.
For details:
You can see the tabs in "hero-horizontal-tabs" block which need to set to each Section Metadata with the same name. Program use this id to separate different tab contents.

Thank you @JiangLong2019 but what exactly did you change? I checked and it looked properly implemented. I compared it with the implementation on sunstar.com and saw nothing wrong. I also changed the - (because in Word sometimes it adds different - in some cases).

Thank you @JiangLong2019


add long options

fix issue #13

You'll want to update the manpage and the shell completion scripts as well.

But with the new change --arch=i686 doesn't work now, and you can also do stuff like -f-arch i686  or -f -arch i686 (an issue with anything that tries to use getopts for longopts).

well, regarding the first point, at first, --arch=i686 was enabled and I was told to disable it, so that's that. regarding the second point, hmm, well that's a inherent problem with getopts as you say, it would be nice to have something better available

I didn't mean to suggest that --arch=i686 was invalid. Quite the opposite. It should be identical to --arch i686.
I'm really not seeing the point in doing this. I think the simpler solution is to:

Remove -f. It's used in only one place only (export), and it's usage is inconsistent, i.e. it could be used elsewhere but isn't. The value seems limited
Add explicit handling of --version and --help.
Tell people to suck it up about -a which is almost never needed.

let's see:

ok, I could do that if you want, on a different pull probably. it looks like a 5min task.
when you say explicit, you mean out of the getopts and treated as another 'command'?
that makes sense, however, reading the issue, it looks like he is explicitly wanting that. ofc, it's your call.

oh, and originally, --arch=i686 was identical to --arch i686. maybe I didnt quite understand your original request about removing it.

@ThePiGrepper I think he meant you need to fail when --arch= alone was passed, not --arch=anything.

that was already the case before I deleted that section.


SQL Error on re-process

SQL Error mentions val column with v22 alias but doesn't join meta_val at all
set up a stream filter f Feed = X and Fatal Error Count > 0
Tried to re-process the data
clicking OK on the final screen gives SQL error

sql_TASK.txt

Related to this, searching the meta store on a dash and querying on a meta key gives a similar error


Add test coverage for Dockerfile

Add test coverage for Dockerfile and the docker-entrypoint.py script.
Run a variety of tests against entrypoint to verify the command which should have been launched by execve. Verifying available files of the image, and the data directory creation.
I hope it can be a good base to test the image, something with meaningful log & understandable enough to be extendable + debuggable.
Need some modification to work appropriately, I will PR it right after:

Rename docker-entrypoint.py to entrypoint.py (for import) #26
Create main function to facilitate entrypoint call for tests https://github.com/dogecoin/docker/pull/26
Fix https://github.com/dogecoin/docker/pull/10 which have been removed right after by https://github.com/dogecoin/docker/pull/11 =>  https://github.com/dogecoin/docker/pull/27

Launch tests
For now, it's not plugged appropriately with the code and will crash because there is caught error to fix, but for when it will be ok:
Install pip & python packages for the container
apt update && apt install -y python3-pip
python3 -m pip install pytest pytest-testinfra

Add tests files in the container & run pytest in their directory.
Let me know what you think about these tests. And if you have any suggestion of things to tests !

All necessary updates are done to make it functional.
Steps to try tests
Install the following packages, for example by adding to the Dockerfile:
RUN apt update && apt install -y python3-pip && \
python3 -m pip install pytest pytest-testinfra

Then add the content of the tests directory inside the container and run pytest, for example:
docker run -it -v $(pwd)/tests:/tests --workdir /tests [image] pytest

You may have some warning, sometime they come, sometime they disappear depending on your configuration. Read/write error of a cache, I didn't investigate further for now.

I'm testing with this Dockerfile, created as ./test/Dockerfile.test:
FROM 4b3c1078692b
RUN apt update && apt install -y python3-pip
RUN python3 -m pip install pytest pytest-testinfra
COPY . .
RUN pytest

That works.

You may have some warning, sometime they come, sometime they disappear depending on your configuration. Read/write error of a cache, I didn't investigate further for now.

Maybe some issue because of setuid and setgid in entrypoint.py, user change during the call. The first step start as root and finish as dogecoin, all other tests start as dogecoin and finish as dogecoin.
Need to handle some rights for the test.

I enabled a hook for setgid/setuid. I'm thinking about integration with GA on pull requests.
Do you think we should create a subdirectory (I was thinking of tests/entrypoint), and eventually break all tests from test_dockerfile.py in multiple files ?
To integrate with GA, I was thinking about using a Dockerfile for tests, or to use __init__.py with installation instruction of dependencies, I'm exploring different designs. I will try to find a nice way which enable also caching, it would be great. If you have any idea/suggestion.

Do you think we should create a subdirectory (I was thinking of tests/entrypoint), and eventually break all tests from test_dockerfile.py in multiple files ?

I would recommend to create a tests/unit, so that the resulting structure would be:
root
+-- .github/workflows (Automation scripts)
+-- <x>.<y>.<z>/ (one for each Dogecoin Core version)
+-- tests/
|   +-- integration/ (all integration tests under this)
|   +-- unit/ (all unit tests under this)
+-- tools/ (generic tools for test and build processes)
+-- <generic files for the project & product> (license, readme, security, generic manifest)

To integrate with GA, I was thinking about using a Dockerfile for tests, or to use init.py with installation instruction of dependencies, I'm exploring different designs.

Ideally, the unit tests for the entrypoint.py can be ran platform independent, outside of the Dockerfile, so that you can just pytest <dir> while you develop locally. Then it's simply a matter of implementation choices. Note that the default ubuntu image on GH Actions ships with python3 so for starters we can just pip install the deps and run it. I also played with the idea of encapsulating the integration test inside a docker container and do docker-within-docker but in the end I thought it better to just keep that execution path simple. Open to other ideas.

I will try to find a nice way which enable also caching, it would be great.

What do you want to cache?

The issue I see to do it outside a container is that entrypoint need for now the man pages to retrieve executables options, and will even launch an executable when https://github.com/dogecoin/docker/issues/28 will be implemented.
That's for me the main problem, testable from outside but require man pages replaced by executables in a near future. Maybe the easiest way is to run it inside a container.
About caching, with my download bandwidth:
$ time apt install -y python3-pip
real    4m59.898s

Annoying between tests if it always needs to be reinstalled.

The issue I see to do it outside a container is that entrypoint need for now the man pages to retrieve executables options

Good point, that is a dependency outside of the entrypoint, so in this case we'll want to mock that - basically do something similar to how you mock execution right now. It makes the test of entrypoint.py more generic and not dependent on the Dogecoin Core version used.

Annoying between tests if it always needs to be reinstalled.

Yes. That's why unit tests are better to be executed on the host where you do development. pip3 is also pre-installed on the GA image together with python.

P.S.: Current tests do not perform unit test of each entrypoint function, but an overall test of the entrypoint behavior through the main.

I don't want to go all purist on this, because I think it serves no purpose to do so at this point. If something is covered in unit tests, it's covered. If we miss coverage of some important cases, we can add the test for it. I think we shouldn't worry too much about whether it's called atomically or not right now, maybe something to work on later. In terms of things being tested:

This test validates that entrypoint.py does what it advertises
The build part of the CI validates that there are no errors in the Dockerfile
The integration test part of the CI tests the functionality of the resulting images

That covers all components, except dependencies.

To mock man pages/executables, you would like to generate a fake help menu to parse with a limited list of option ? It's an important component to detect which environment variables are valid or not, I'm not sure how we could hook it to reproduce the behavior.
For example it may be something to test, try 2 different executable with specific argument from each, if entrypoint doesn't confuse between differents help menus.

you would like to generate a fake help menu to parse with a limited list of option

let's look inside def executable_options, currently that does 3 things:

read the man file
search it
clean it up

As it is right now, that would need to be mocked completely by a function that just returns a list of options for a given executable. Possible, but that excludes that entire function from testing.
It could be an idea to put the man page reading in its own function and then mock that to just return a couple of fixtures to read instead. Then we can test everything else in that function, including test if the function itself does everything we want it to do and doesn't mess up.

Created https://github.com/dogecoin/docker/pull/34 to use executables help menu instead of man pages to get options. To create hook on top of it.

Still a bit messy, but it's functional now and can run from the host. I had to add some extra hook and change some behavior. Not friendly to test while it's not in his own folder.
Do we call its folder unit (tests) or entrypoint ? unit isn't really intuitive to me because I do not really see it as unit tests, but if you really want to go for it.

Still a bit messy, but it's functional now and can run from the host. I had to add some extra hook and change some behavior. Not friendly to test while it's not in his own folder.
Do we call its folder unit (tests) or entrypoint ? unit isn't really intuitive to me because I do not really see it as unit tests, but if you really want to go for it.

so following @patricklodder directions to run these tests as of a day or so ago:
mkdir unit
mv entrypoint_hook.py test_dockerfile.py Dockerfile.test unit/
cd unit
docker build -f Dockerfile.test .

i moved your test files from tests/ to unit/ and created a basic Dockerfile.test identical to @patricklodder's above:
FROM 4c27963a2c8e
RUN apt update && apt install -y python3-pip
RUN python3 -m pip install pytest pytest-testinfra
COPY . .
RUN pytest -v

from the outputted image hash after building 1.14.5/bullseye/Dockerfile:
...
Step 34/34 : CMD ["dogecoind"]
 ---> Using cache
 ---> 4c27963a2c8e
Successfully built 4c27963a2c8e
Successfully tagged xanimo/1.14.5-dogecoin:test-coverage

which resulted in:
docker build -f Dockerfile.test .
Sending build context to Docker daemon  26.11kB
Step 1/5 : FROM 4c27963a2c8e
 ---> 4c27963a2c8e
Step 2/5 : RUN apt update && apt install -y python3-pip
 ---> Using cache
 ---> 09e555c5e61c
Step 3/5 : RUN python3 -m pip install pytest pytest-testinfra
 ---> Using cache
 ---> 05489e6b374c
Step 4/5 : COPY . .
 ---> acb504e88c79
Step 5/5 : RUN pytest --verbose
 ---> Running in 68b3c08af652
============================= test session starts ==============================
platform linux -- Python 3.9.2, pytest-6.2.5, py-1.11.0, pluggy-1.0.0 -- /usr/bin/python3
cachedir: .pytest_cache
rootdir: /dogecoin
plugins: testinfra-6.5.0
collecting ... collected 8 items

test_dockerfile.py::test_entrypoint_executables PASSED                   [ 12%]
test_dockerfile.py::test_environ PASSED                                  [ 25%]
test_dockerfile.py::test_arguments PASSED                                [ 37%]
test_dockerfile.py::test_arguments_double_dash PASSED                    [ 50%]
test_dockerfile.py::test_mixing_argument_and_env PASSED                  [ 62%]
test_dockerfile.py::test_equal_argv_and_env PASSED                       [ 75%]
test_dockerfile.py::test_help_debug PASSED                               [ 87%]
test_dockerfile.py::test_datadir[local] PASSED                           [100%]

============================== 8 passed in 0.09s ===============================
Removing intermediate container 68b3c08af652
 ---> 5bbfd0934846
Successfully built 5bbfd0934846

:fireworks: :partying_face: woohoo!
so with that said it's almost there. am wondering how we're going to 'plug' this in? will it be ran as part of CI? not sure the grand vision but we could potentially use ONBUILD within our existing Dockerfile (at the bottom) to pass the image hash as it executes after our main Dockerfile is built and run tests and then delete/clean up after execution? outside of that i'd say a squash + rebase is needed and then ACK from me. :+1:
i also pushed this as reference in case needed but in no way is 'the correct' way, just how i understood testing this PR.

I will add some fixes about global variables, and try to enable only hooks partially when tests are launched inside containers, to be closer to the real behavior.

try to enable only hooks partially when tests are launched inside containers, to be closer to the real behavior.

Recommend against that, it will make tests non-deterministic.
I can propose an integration test for the chmod results for you if you want.

I will do something in a separate commit, it looks interesting to me to just add a way to disable some hook of EntrypointHook, just to see what it can look like.
Having 2 mode may enable us to tests some functions when inside the container, like entrypoint.get_help.

Not inside unit tests, I coded us an integration test framework for that.

Some fun with pylint:
************* Module test_dockerfile
test_dockerfile.py:10:24: E1101: Module 'pytest' has no 'executables_folder' member (no-member)
test_dockerfile.py:19:20: E1101: Module 'pytest' has no 'datadir' member (no-member)
test_dockerfile.py:20:17: E1101: Module 'pytest' has no 'user' member (no-member)
test_dockerfile.py:21:17: E1101: Module 'pytest' has no 'PATH' member (no-member)
test_dockerfile.py:25:17: E1101: Module 'pytest' has no 'user' member (no-member)
test_dockerfile.py:26:17: E1101: Module 'pytest' has no 'PATH' member (no-member)
test_dockerfile.py:34:24: E1101: Module 'pytest' has no 'datadir' member (no-member)
test_dockerfile.py:45:24: E1101: Module 'pytest' has no 'datadir' member (no-member)
[lol]
[...]
************* Module conftest
conftest.py:19:23: R1732: Consider using 'with' for resource-allocating operations (consider-using-with) [How do I get a file for the entire test ?..]

Pylint does have some trouble to work with pytest, it raises some false positive.
There is some alternative python linter for pytest like pytest-pylint (maybe not well maintained...), I saw a Stack Overflow comment suggesting the following:

use another unittest framework, less dynamic than py.test
silence the warnings / errors on your test code manually
use another linter which is happier than pylint on py.test (I'm interested to know how pychecker / pyflakes fare on that code)
write the astng plugin which will help astng grok the pylib tricks and submit it as a patch to the astng maintainers (and get extra credit from that)

A solution I found for now is to hide those errors, thought it could be acceptable here:
[entrypoint-tests]
disable = consider-using-with,
    no-member

Pylint need some adjustment in any case, CI tests crashes without pytest installed, see GA results.

Pylint does have some trouble to work with pytest, it raises some false positive.

Ideally, our pylint check should not lint pytest, but limit scope only our code. I'm trying to figure out what happens if we inline ignore the pytest import and if that still yields meaningful results, or, import pytest with the linting run and then exclude that module's errors rather than the ones inherited under the module we wrote... but ignores are needed.
Once we introduce ignores, it is probably prudent to explicitly list the allowed linter ignores and document why they are allowed.

@xanimo am wondering how we're going to 'plug' this in? will it be ran as part of CI?

Yes, more tests to automate :)
Ready for a new round of review. Recent changes allow tests to run both from host and inside a container. I implemented 2 modes for tests (introduced by https://github.com/dogecoin/docker/pull/25/commits/174640a0ab2824f0efcc02d1c43a43adc2bd8c34), it detects if it runs inside a container to avoid the hook of entrypoint.get_help, to get more accurate tests of the entrypoint. Final CI tests would run inside a container to be more strict.
May enable some specifics tests to runs inside a container which is not permitted by, for example verify the behavior of entrypoint for non-dogecoin commands.

@xanimo am wondering how we're going to 'plug' this in? will it be ran as part of CI?

Yes, more tests to automate :)
Ready for a new round of review. Recent changes allow tests to run both from host and inside a container. I implemented 2 modes for tests (introduced by 174640a), it detects if it runs inside a container to avoid the hook of entrypoint.get_help, to get more in real conditions tests of the entrypoint. Final CI tests would run inside a container to be more strict.
May enable some specifics tests to runs inside a container which is not permitted by, for example verify the behavior of entrypoint for non-dogecoin commands.
Pass pylint tests with exception from pylintrc.
PS: Some files may need a renaming (any suggestions ?). test_dockerfile.py for example. The tree structure should probably be more organized, tests factorized. Maybe we should think the relation with integration tests to facilitate the launch of both tests, providing a single interface.

awesome! will dig into this later this afternoon when i can checkout your changes and address your comments/concerns properly, have to run some errands rq. :heart:

New changes related to previous comments.
I will need to update comments, at least for pylint but I want to reread it globally. I will do it later today or tomorrow.
For now, functionally I think it's good, I organized the tree structure (pylintrc to move away probably), dividing all tests in separate files, creating a hook directory for tools needed. I also enabled some default environment variables (PATH & USER) in EntrypointHook to avoid repetition in tests.
Possibly not far from being ready :)

I moved tests about datadir creation into CI (see https://github.com/dogecoin/docker/issues/50) + I added some tests for https://github.com/dogecoin/docker/pull/34 to test if -help-debug options are converted properly into environment variables.

Integration to GitHub Action added :)

I removed the container mode.
About sorting, I removed it. But I wasn't sure actually how it was managed by entrypoint.py. Environment variables, when given by docker run as -e options, do not preserve an order (I don't even know how shell manage it internally, perhaps it's the responsible).
Completing https://github.com/dogecoin/docker/issues/46, the current behavior is:
[environment variables sorted by help menu appearance] [argv]

As you can see in entrypoint.convert_env:
https://github.com/dogecoin/docker/blob/9dcc1697ea6c94992192b3079d53f28d4ebe4130/1.14.5/bullseye/entrypoint.py#L109
It finds all options through help menu, iterate through those options and try to find if it's available in the environment.


Disabling "Windows Test Signing Mode" once the program is installed will cause every USB device to stop working

I had to access with remote controll because I couldn't move my mouse/keyboard (directly connected to the computer)...
Steps to reproduce

Follow the install setup
Run bcdedit.exe /set testsigning off
Restart the PC

Solved after uninstalling the program; I assume re-enabling testsigning will also work.

Obviously it cannot work if test signing is disabled. You can disable it for some reasons without uninstalling usbip. It will work if disable test signing again.

it cannot work if test signing is disabled
Special emphasis on the "directly connected to the computer". By disabling that, it almost caused my computer to brick. None of the (directed) connected USBs were recognised, so I couldn't login.

I think this part is worth mentioning, at least...

Disable Windows Test Signing Mode without removing USB/IP
usbip2_filter driver must be disabled, otherwise all USB controller
What is wrong? Everything is described.

I updated README to emphasize do not set testsigning off when USBip is installed.


RoadToKosmos-core Support

Added manually a  NetKAN for my RtK core files mod

You have an extra comma on the comment line in the install stanza.

Why did you closed? The automatic version is bad and doesn't have all the requirements. Fixed the typo.

#rebuild

#rebuild


--keep-awake flag doesn't seem to work on some phones, even when wired

[x] I have read the FAQ.
[x] I have searched in existing issues.

Environment

OS: Arch Linux
scrcpy version: 2.4
installation method: pacman, official extra repository
device model: realme 12+ 5G (RMX3867)
Android version: 14 (realme UI 5.0)

Describe the bug
When trying to connect to my phone over USB with the --keep-awake flag, an error occurs when scrcpy tries to change the setting, making the flag useless. Log output:
[artyif@artyif-desktop ~]$ scrcpy --select-usb --no-audio --turn-screen-off --stay-awake
scrcpy 2.4 <https://github.com/Genymobile/scrcpy>
INFO: ADB device found:
INFO:     -->   (usb)  <serial number>                device  RMX3867
/usr/share/scrcpy/scrcpy-server: 1 file pushed, 0 skipped. 119.3 MB/s (69007 bytes in 0.001s)
[server] INFO: Device: [realme] realme RMX3867 (Android 14)
[server] ERROR: Could not change "stay_on_while_plugged_in"
com.genymobile.scrcpy.SettingsException: Could not access settings: put global stay_on_while_plugged_in 7
        at com.genymobile.scrcpy.Settings.execSettingsPut(Settings.java:24)
        at com.genymobile.scrcpy.Settings.putValue(Settings.java:59)
        at com.genymobile.scrcpy.Settings.getAndPutValue(Settings.java:78)
        at com.genymobile.scrcpy.Server.initAndCleanUp(Server.java:75)
        at com.genymobile.scrcpy.Server.lambda$startInitThread$2(Server.java:206)
        at com.genymobile.scrcpy.Server$$ExternalSyntheticLambda0.run(Unknown Source:4)
        at java.lang.Thread.run(Thread.java:1012)
Caused by: java.io.IOException: Command [settings, put, global, stay_on_while_plugged_in, 7] returned with value 255
        at com.genymobile.scrcpy.Command.exec(Command.java:16)
        at com.genymobile.scrcpy.Settings.execSettingsPut(Settings.java:22)
        ... 6 more
INFO: Renderer: opengl
INFO: OpenGL version: 4.6 (Compatibility Profile) Mesa 24.1.1-arch1.1
INFO: Trilinear filtering enabled
INFO: Texture: 1080x2400
[server] INFO: Device screen turned off

The phone doesn't have a caffeine QS tile, as someone has suggested in a different issue, only the "Keep screen on while charging" setting in the developer options.

Duplicate of #4021.


Pr options control page

Updated Options Control Panel page to scroll box with a number of images

Hopefully scrollboxes still work on touchscreen!

I don't have time to review this 😅 if it's all good I'll trust your fantastic work and you can merge it


How can I download RIMES data?

I am wondering how can I download RIMES data such as training_2011_gray.tar.
I cannot visit the web domain www.a2ialab.com.
Can anybody give me any hints?
Thank you.

Same issue here but seems like A2IA do not share the dataset further unfortunately.


TagBot trigger issue

This issue is used to trigger TagBot; feel free to unsubscribe.
If you haven't already, you should update your TagBot.yml to include issue comment triggers.
Please see this post on Discourse for instructions and more details.
If you'd like for me to do this for you, comment TagBot fix on this issue.
I'll open a PR within a few hours, please be patient!

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/40105

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/40429

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/40494

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/40632

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/40726

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/40731

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/64451

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/64773

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/65084


Notification support for RLMObject

Goals
Add support for Notifications on RLMObject, or a "version" type property in RLMObjectBase automatically maintained by Realm.
Expected Results
Notifications are great and make all kinds of things like table/collection views easier to maintain. But if you have a UI wired to a single object, it's a little harder. KVO works well, and combined with ReactiveCocoa can make auto-updating interfaces not a big deal. But if you have, say, 12 fields to update, it can be a lot of boilerplate wiring observers to every field in an RLMObject.
Currently it is not possible to wire a single observer to the entire object, to redraw all fields related to that object. One must observe every field independently. This feature request is to do one of two things:

Add support for adding a notification block on a single RLMObject. It is already possible to listen for notifications on an RLMResult * with only one result, and this has been my workaround - set up an objectsWhere call against the primary key, so you get just the one record but in an RLMResults * wrapper. Notifications then work properly against the entire object, but this is obviously pretty ugly.
Add a read-only version property to RLMObject itself, incremented or otherwise mutated (last-changed?) on every update. This would allow KVO against the entire object by simply observing this one field.

In short, it would be REALLY nice to convert this:
    _user = [User myUser]; // Single RLMObject returned here
    [[RACObserve(_user, shareBadgeCount) takeUntil:self.rac_willDeallocSignal] subscribeNext:^(NSNumber *count) {
        User *user = [User myUser]; // Realm is so fast this is easier than doing RAC deliverOn:...
        [self setBadge:weakSelf.tabBar.items[NRDrawerMenuShare] value:([user.shareBadgeCount integerValue] + [user.rushBadgeCount integerValue])];
    }];

    [[RACObserve(_user, chatBadgeCount) takeUntil:self.rac_willDeallocSignal] subscribeNext:^(NSNumber *count) {
        User *user = [User myUser];
        [self setBadge:weakSelf.tabBar.items[NRDrawerMenuChat] value:[user.chatBadgeCount integerValue]];
    }];

    [[RACObserve(_user, rushBadgeCount) takeUntil:self.rac_willDeallocSignal] subscribeNext:^(NSNumber *count) {
        User *user = [User myUser];
        [self setBadge:weakSelf.tabBar.items[NRDrawerMenuPoints] value:([user.rushBadgeCount integerValue] + [user.rushBadgeCount integerValue])];
    }];

    [[RACObserve(_user, inboxBadgeCount) takeUntil:self.rac_willDeallocSignal] subscribeNext:^(NSNumber *count) {
        User *user = [User myUser];
        [self setBadge:weakSelf.tabBar.items[NRDrawerMenuInbox] value:[user.inboxBadgeCount integerValue]];
    }];

to this:
    _user = [User myUser];
    [[RACObserve(self, user.__realmVersion) takeUntil:self.rac_willDeallocSignal] subscribeNext:^(NSNumber *realmVersion) {
        user = [User myUser];
        [self setBadge:weakSelf.tabBar.items[NRDrawerMenuShare] value:([user.shareBadgeCount integerValue] + [user.rushBadgeCount integerValue])];
        [self setBadge:weakSelf.tabBar.items[NRDrawerMenuPoints] value:([user.shareBadgeCount integerValue] + [user.rushBadgeCount integerValue])];
        [self setBadge:weakSelf.tabBar.items[NRDrawerMenuChat] value:[user.chatBadgeCount integerValue]];
        [self setBadge:weakSelf.tabBar.items[NRDrawerMenuInbox] value:[user.inboxBadgeCount integerValue]];
    }];

or this:
    _user = [User myUser];
    _notificationToken = [self.user addNotificationBlock:^(RLMObject *record, NSError *error) {
        User *user = record;
        [self setBadge:weakSelf.tabBar.items[NRDrawerMenuShare] value:([user.shareBadgeCount integerValue] + [user.rushBadgeCount integerValue])];
        [self setBadge:weakSelf.tabBar.items[NRDrawerMenuPoints] value:([user.shareBadgeCount integerValue] + [user.rushBadgeCount integerValue])];
        [self setBadge:weakSelf.tabBar.items[NRDrawerMenuChat] value:[user.chatBadgeCount integerValue]];
        [self setBadge:weakSelf.tabBar.items[NRDrawerMenuInbox] value:[user.inboxBadgeCount integerValue]];
    }];

I'd also like this feature. It is possible for us to do this though. Without further developments from Realm's team.
We can add a public readonly property and make it readwrite at class level.
Then whenever you update your record don't forget to increment the "version property".
Using ReactiveCocoa observe that property and do your magic.
I've actually done something similar to this on a project of mine.
Also, beware of your current observer implementation, if a transaction updates all the fields you are observing it will provoke as many UI updates as properties that you are observing. That can slow down you app significantly.

Yes, what you noted about doing this via per-field-RAC leading to UI flickers is absolutely true and one of the things I hate about doing it field-by-field. That said, if you have a big object with a bunch of fields, and a view that only renders a few of them, it's not terrible. It's just a lot of judgment-call making by the developer, which increases the defect rate.
 You need to either swizzle or proxy the Realm "createOrUpdateInDefaultRealmWith..." method(s) (or however you update objects) and add a version to every object, or include this from whatever server/source is the originator of the objects in the first place. It's a super messy, high-touch way to do something so simple.
As you noted, it still doesn't address a number of use-cases. You can't tell when an object has been deleted, because once an object is invalidated you can't read fields from it anymore without throwing an exception. And when you do get a legitimate update, you can't tell what fields have been changed so you have the same too-many-updates issue as noted above.
With a self-maintained field, the developer has a responsibility to namespace or otherwise protect that field from conflicts by origination-source schema changes. If you call it "version", suppose the upstream source of the data adds a "version" field? It's easy to chuck something like __mine__version in from of the field name, but adding an extra "best practice" step that requires this makes the system more brittle - it's one more thing to keep in mind to avoid breakage, one more opportunity for defects. If this was done in a Realm-enforced namespace like _realmVersion, this chance would be reduced.

I would think the cleanest option would be right here - this is what I've considered swizzling myself:
https://github.com/realm/realm-cocoa/blob/master/Realm/RLMObjectBase.mm#L180-L195
This is where object values are set. It would be pretty straightforward to maintain a mutable set or other collection that tracked value-sets. During the commit, right where collection notifications are built and fired, this mutable set could be checked for individual object mutations. If you want to honor ObjC/Swift concepts you could even just make it a delegate call back from the object. How hot would that be? "myObject.delegate = self" then just define the methods you want callbacks on like "objectWasUpdated". Not that blocks are BAD, but you do end up with pretty long viewDidLoads or wherever you put them...
This option is easy enough that I could probably do it myself and submit a PR, but I wanted to file this for review by the core devs before I went that far. They weren't in love with my last one. :)
If you want a second option, the code to build RLMCollection change notification sets could be enhanced to also fire events on individual objects - it has all the data at hand to know the objects that have changed because it uses it to figure out which collections need a modified notification. But this code was more complex and I've only just started looking at it. It's not clear to me whether this could be done efficiently if the bulk of the cases did NOT require a notification. (That is: would it have to do a lot of wasted work just to find out it had nothing to do?)

NOTE: I ended up going with a self-written delegate myself. I've added my own proxy createOrOptionallyUpdate function to every one of my objects because I receive server updates some times for records that haven't actually changed, or that have fields updated the app doesn't care about. I was getting a lot of collection-change notifications indicating modifications, when values weren't actually being changed.
Since I already had this proxy that checks whether field updates are actually required, I just added a delegate to all my objects, and when this is happening, I fire the delegate.  You have to keep track of what thread you're on (I do my DB updates in a serialized queue in a background thread, so I have to dispatch to the main queue) and you can't do anything in the delegate that would require creating another transaction. It's a super useful pattern for UI updates. It's not so useful for other patterns like trigger->cascade updates unless you're SUPER careful about tracking whether you're in that transaction.

Update: Tried the delegate option, doesn't work. Silly me, since the objects on different threads are not the same (they're all just proxies to the base data) a delegate on an object in one thread isn't the same as on another thread, if you add the delegate to your own class. So it seems the only workaround for now is a version number added to every object, making sure EVERY pathway that you have that can update an object also updates that value, and just doing KVO on that.

We're tracking adding a nicer API alternative to KVO on RLMObject/Object in #3431. @crrobinson14 do you think this issue can be closed as a duplicate, or is there more that you'd like to see that isn't covered in #3431?

Sorry @jpsim, I searched the open issues before filing this but somehow missed that one. Long weekend I guess. This is clearly a duplicate. #3431 (and #4075) would 100% solve my use-case.


[Feature] - Use postgres as database

I'd like to see wizarr have an option to use postgres as its database. For users using kubernetes this is a crucial feature.

Why is this a crucial feature when using kubernetes?
SQLite should work without problems with as little data as wizarr saves.

Cuz then I don't really need to have a persistent volume, I can just edit the config directly on my gitops solution and use Postgres as database.

There are some things that cannot be saved in the database, such as uploaded files. They need to be saved on a persistent volume.

That would be the case for people who actually use this feature. But then again they could make a persistent volume for that folder only, and also if we want to go a step further there are ways to save files in databases. Just need to enconde/decode it.


Gym reset must be called before step or "AssertionError: Cannot call …

…env.step() before calling reset()" will be throw.

I would do it in agent.play_random() instead, similar to agent.train() and agent.test().

good idea.


Baseline mocks: galaxy catalogues with sources at fixed redshift planes

Since we're developing simultaneously CCL predictions, NaMaster measurements and mock data, it is difficult to isolate the problem when these don't match. If needed, we can back track a little and use simplified mocks in which the galaxies are placed at a fixed redshift. I have made 5 mocks that way, which you can find here:
/global/homes/j/jharno/IA-infusion/SkySim5000/IA-infusion/SkySim5000/GalCat/zs_plane/
The redshift of the planes are contained in the names of the file:
0.3035GalCat_%sGpAM_nside%s_X_Y_g1_g2_w.asc
0.5022GalCat_%sGpAM_nside%s_X_Y_g1_g2_w.asc
0.6557GalCat_%sGpAM_nside%s_X_Y_g1_g2_w.asc
0.8240GalCat_%sGpAM_nside%s_X_Y_g1_g2_w.asc
1.0060GalCat_%sGpAM_nside%s_X_Y_g1_g2_w.asc
I have run treecorr on these and matched these to nicaea predictions.
I have also run the healpix map2cl routine on the matching kappa maps and produced Cell's that are also in excellent agreement with nicaea predictions. So maybe we could use these to make sure our TreeCorr and Namaster tools are properly configured. I had to use the flip_e2 flag in these to match the predictions

These mocks are still there in case anyone needs these, but I'll close the issue as this is not the main product of this project.


Cyber Engine UI is invisible, only showing mouse cursor. Can't click anything in game UI

v1.10.2:
Launching cyberpunk 2077 will bring me a mouse cursor that cannot be used to click anything in the game UI. Cyber Engine UI is not visible at all on screen.
I assume its waiting for me to set up the key binding.
If i manually set the hotkey thru the config file, i can play the game just fine. But pressing the hotkey will simply show a mouse cursor, cyber engine UI still invisible.

Are you using overlays such as RivaTunrer?

I had the exact same problem. And as @yamashi says it's due to an overlay. I'm using the standalone version of RivaTuner Statistics Server. It will work if you disable it.

Are you using overlays such as RivaTunrer?
Thank you
I do have RTSS running in background but with overlays disabled.
Completely exiting RTSS makes Cyber Engine UI visible.

@orangpelupa - but if restarted it works? does '=' mapped to anything?

@orangpelupa did you save that bind? if you bind, it should turn yellow.
pressing save should save those changes.
that issue seems odd, first time hearing it... would imagine it is this...
we should add some popup cause user accidentally closing overlay or switching tabs can will invalidate unsaved changes as of right now, which may lead to this situation.

I will close this issue for now. If you require some further assistance, feel free to reopen.

@orangpelupa did you save that bind? if you bind, it should turn yellow.
pressing save should save those changes and color should change to white.
that issue seems odd, first time hearing it... would imagine it is this...
we should add some popup cause user accidentally closing overlay or switching tabs will invalidate unsaved changes as of right now, which may lead to this situation.

Yeah the key binding is saved as I no longer need to rebind after cyberpunk relaunch.
Maybe related to a bug where sometimes alt tabbing (or cyberpunk automatically goes minimized at launch) will make the game got "frozen frame"?
Anyway the Workaround of disabling RTSS and not pressing alt tab does work

Ok so this is not yet resolved.
I hopes as you were not answering that maybe you found out how to make it work.
That is not ideal still tbh, would like to debug it... Are you on our community Discord by a chance? would be faster to solve it from there.

Ok so this is not yet resolved.
I hoped as you were not answering that maybe you found out how to make it work.
That is not ideal still tbh, would like to debug it... Are you on our community Discord by a chance? would be faster to solve it from there.
We would add some write-up here later.

Thank you. Sorry these past few days I've been overwhelmed with extra work. I'm not in the discord (actually I don't know this project have a discord haha)
Anyway, let me know if you need me to do something. I hope I could get some free time this weekend.


knack.util.CLIError: Can't find token from MSAL cache.

Describe the bug
When creating a new Azure Key Vault Key using az cli, i get the following error:
Traceback (most recent call last):
  File "/opt/azure-cli/lib/python3.9/site-packages/knack/cli.py", line 231, in invoke
    cmd_result = self.invocation.execute(args)
  File "/opt/azure-cli/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 658, in execute
    raise ex
  File "/opt/azure-cli/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 721, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
  File "/opt/azure-cli/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 692, in _run_job
    result = cmd_copy(params)
  File "/opt/azure-cli/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 328, in __call__
    return self.handler(*args, **kwargs)
  File "/opt/azure-cli/lib/python3.9/site-packages/azure/cli/command_modules/keyvault/_command_type.py", line 138, in keyvault_command_handler
    return keyvault_exception_handler(self.command_loader, ex)
  File "/opt/azure-cli/lib/python3.9/site-packages/azure/cli/command_modules/keyvault/_command_type.py", line 51, in keyvault_exception_handler
    raise CLIError(ex)
knack.util.CLIError: Can't find token from MSAL cache.

To Reproduce

Create a key vault
use the following command to create a key:

az keyvault key create --name "test" \
  --protection software \
  --ops encrypt decrypt \
  --expires "$date_in_two_years" \
  --vault-name "test-vault" > /dev/null

Expected behavior
A key gets created.
Environment summary
Linux-5.10.84-1-MANJARO-x86_64-with-glibc2.33, Manjaro Linux
Python 3.9.9
azure-cli 2.31.0
Installation method: interactive script
Additional context
Works before version 2.30.0 (before the Azure CLI migration from ADAL to MSAL)
Workaround
For anyone from the interwebz having the same problem, i use a workaround as of now.
Start a container and mount files inside:
docker run -ti mcr.microsoft.com/azure-cli:2.29.2 bash
(Any version before 2.30.0 works.)

az login
Set appropiate subscription
run the command above
works

KeyVault

Running the command with --debug gives more info:
> az keyvault key create --name "key1" --protection software --ops encrypt decrypt --vault-name "jlkv1"

msal.application: Refresh token failed
Traceback (most recent call last):
  File "/root/azcli/lib/python3.10/site-packages/msal/application.py", line 1203, in _acquire_token_silent_from_cache_and_possibly_refresh_it
    result = _clean_up(self._acquire_token_silent_by_finding_rt_belongs_to_me_or_my_family(
  File "/root/azcli/lib/python3.10/site-packages/msal/application.py", line 1240, in _acquire_token_silent_by_finding_rt_belongs_to_me_or_my_family
    last_resp = at = self._acquire_token_silent_by_finding_specific_refresh_token(
  File "/root/azcli/lib/python3.10/site-packages/msal/application.py", line 1287, in _acquire_token_silent_by_finding_specific_refresh_token
    response = client.obtain_token_by_refresh_token(
  File "/root/azcli/lib/python3.10/site-packages/msal/oauth2cli/oauth2.py", line 831, in obtain_token_by_refresh_token
    resp = super(Client, self).obtain_token_by_refresh_token(
  File "/root/azcli/lib/python3.10/site-packages/msal/oauth2cli/oauth2.py", line 263, in obtain_token_by_refresh_token
    return self._obtain_token("refresh_token", data=data, **kwargs)
  File "/root/azcli/lib/python3.10/site-packages/msal/oauth2cli/oidc.py", line 115, in _obtain_token
    ret = super(Client, self)._obtain_token(grant_type, *args, **kwargs)
  File "/root/azcli/lib/python3.10/site-packages/msal/oauth2cli/oauth2.py", line 772, in _obtain_token
    resp = super(Client, self)._obtain_token(
  File "/root/azcli/lib/python3.10/site-packages/msal/oauth2cli/oauth2.py", line 235, in _obtain_token
    resp = (post or self._http_client.post)(
  File "/root/azcli/lib/python3.10/site-packages/msal/individual_cache.py", line 269, in wrapper
    value = function(*args, **kwargs)
  File "/root/azcli/lib/python3.10/site-packages/msal/individual_cache.py", line 269, in wrapper
    value = function(*args, **kwargs)
  File "/root/azcli/lib/python3.10/site-packages/requests/sessions.py", line 590, in post
    return self.request('POST', url, data=data, json=json, **kwargs)
TypeError: Session.request() got an unexpected keyword argument 'tenant_id'

...
  File "/root/azcli/lib/python3.10/site-packages/azure/cli/core/auth/util.py", line 125, in check_result
    raise AuthenticationError("Can't find token from MSAL cache.",
azure.cli.core.azclierror.AuthenticationError: Can't find token from MSAL cache.

During handling of the above exception, another exception occurred:
...
  File "/root/azcli/lib/python3.10/site-packages/azure/cli/command_modules/keyvault/_command_type.py", line 51, in keyvault_exception_handler
    raise CLIError(ex)
knack.util.CLIError: Can't find token from MSAL cache.

The inner exception is
TypeError: Session.request() got an unexpected keyword argument 'tenant_id'

but MSAL hides it with
msal.application: Refresh token failed

This is another instance showing MSAL should expose the inner exception:

https://github.com/AzureAD/microsoft-authentication-library-for-python/issues/431
https://github.com/AzureAD/microsoft-authentication-library-for-python/pull/434

Any idea when we will release a new MSAL with the above PR? @rayluo

As for the original issue, --debug log also shows
urllib3.connectionpool: https://jlkv1.vault.azure.net:443 "POST /keys/key1/create?api-version=7.3-preview HTTP/1.1" 401 97
cli.azure.cli.core.auth.credential_adaptor: CredentialAdaptor.get_token: scopes=('https://vault.azure.net/.default',), kwargs={'tenant_id': '54826b22-38d6-4fb2-bad9-b7b93a3e9c5a'}
cli.azure.cli.core.auth.msal_authentication: UserCredential.get_token: scopes=('https://vault.azure.net/.default',), kwargs={'tenant_id': '54826b22-38d6-4fb2-bad9-b7b93a3e9c5a'}

Apparently, the extra tenant_id field is corrupting UserCredential and MSAL, because azure-keyvault-keys==4.5.0b5 calls get_token with tenant_id which is not supported by UserCredential and MSAL.
https://github.com/Azure/azure-sdk-for-python/blob/azure-keyvault-keys_4.5.0b5/sdk/keyvault/azure-keyvault-keys/azure/keyvault/keys/_shared/challenge_auth_policy.py#L76
                self._token = self._credential.get_token(scope, tenant_id=challenge.tenant_id)

requirements.txt contains:
https://github.com/Azure/azure-cli/blob/1c11174622b1cb2427b7e2417ab5e80b46b4f9ed/src/azure-cli/requirements.py3.windows.txt#L17
but Azure CLI doesn't pin the version of azure-keyvault-keys in setup.py:
https://github.com/Azure/azure-cli/blob/1c11174622b1cb2427b7e2417ab5e80b46b4f9ed/src/azure-cli/setup.py#L63
This causes azure-keyvault-keys==4.5.0b5 being installed.
See https://www.python.org/dev/peps/pep-0440/#compatible-release

If a pre-release, post-release or developmental release is named in a compatible release clause as V.N.suffix, then the suffix is ignored when determining the required prefix match.


(error) - When checking the version

The application in the store is in version 0.6
Inside package.json version 0.8 is set
It turns out that the version of the app being greater than the version that is in the store it informs that it needs updating.

update added image

Hi! Thanks for using the library.
We don't use the version inside of package.json, but instead look at the version of the native app. Can you confirm the native app version is really newer than the app store version?

Hi! Thanks for using the library.
We don't use the version inside of package.json, but instead look at the version of the native app. Can you confirm the native app version is really newer than the app store version?

@tschoffelen Thanks for your response.
Yes, the app version is bigger than the store version

@tschoffelen Thanks for your response.
Yes, the app version is bigger than the store version

Ah, thanks for the screenshot, that helps. The library is optimized for version numbers that follow the semantic versioning (semver) scheme.
0.8 is technically not a valid semantic version (0.8.0 would be), which is why it gives that error in the notice field.
However, I personally would expect it to be able to deal with this type of version numbers, so I will see what can be done to make the back-end work with <major>.<minor> version numbers.

Ah, thanks for the screenshot, that helps. The library is optimized for version numbers that follow the semantic versioning (semver) scheme.
0.8 is technically not a valid semantic version (0.8.0 would be), which is why it gives that error in the notice field.
However, I personally would expect it to be able to deal with this type of version numbers, so I will see what can be done to make the back-end work with <major>.<minor> version numbers.

I've released an update that now should report the correct value for the needsUpdate field. Note that it can take up to an hour for this change to start showing up due to caching.
And of course let me know if this still is a problem.

I've released an update that now should report the correct value for the needsUpdate field. Note that it can take up to an hour for this change to start showing up due to caching.
And of course let me know if this still is a problem.


[Small Bug] Status window shows a single character with no data on webchats

https://irc.dns.live enter a name/pass and connect
status window shows dozens of:
17:21 []
17:21 []
17:22 []
17:22 []
17:23 []
17:23 []
17:24 []
17:24 []
17:25 []
17:25 []
17:26 []
17:26 []
17:27 []
17:27 []

This has been fixed! Thank you!


topic reflection not working as expected in aws bridge.

Describe the bug
aws bridge topic reflection is not working as expected, subscription still works in the previous way.
Expected behavior
aws bridge topic reflection works as expected.
Actual Behavior
aws bridge will forward msg from remote_topic to itself instead of local_topic
** Environment Details **

NanoMQ version latest main branch
Operating system and version Ubuntu 22.04

I think I have just fixed it, gonna be a PR tmr.

I think I have just fixed it, gonna be a PR tmr.

fixed --> https://github.com/emqx/nanomq/pull/1479

cool


Re-positioned Menu bar, Color Palette and Drawing Canvas for better visibility.

Issue Title:  Improve UI by re-positioning the drawing canvas.
resolve issue: #168

Repositioned the menu bar, Color-palette and Drawing Canvas for a better UI. Now, Users don't have to scroll down for a full visibility of the drawing canvas and color palette. It is organized a bit more tidy now.
Repositioned the clearAll button along with the darkmodeToggle and MenuVisible button.
Repositioned the button "Buy me a coffee" to the footer .

Files Modified:

Used vanilla CSS by modifying index.css file.
Modified App.jsx for reordering the elements.

Type of change ☑
What sort of change have you made:

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[x] Code style update (formatting, local variables)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Checklist: ☑

[x ] My code follows the guidelines of this project.
[x] I have performed a self-review of my own code.
[x] I have commented my code, particularly wherever it was hard to understand.
[x] I have made corresponding changes to the documentation.
[x] My changes generate no new warnings.
[x] I have added things that prove my fix is effective or that my feature works.
[x] Any dependent changes have been merged and published in downstream modules.

How Has This Been Tested? ⚙
Started the vite server after all the enhancements and all the features are working without any conflicts.

@AnandK-pm This UI doesn't look appealing and also It's not good for UX, You were supposed to just get rid of the scrolling not to change the UI completely, Kindly do the same only.

Sure .let me work on this. Shall i open a new pull request ?
Also would you like me to place the "Buy me coffee" button below the canvas inorder to remove the necessity of scrolling.

@AnandK-pm Yes, you can create a new PR after closing this one and don't put the "Buy me coffee" button below the canvas, it won't look good.


Username is displayed incorrectly

I don't think that this hash belongs there.

Sorry, wrong repo


[NimBLEServer] Modern Apple devices require READ_ENC and WRITE_ENC

I noticed while evaluating the ESP32-NimBLE-Keyboard that I ported.
I'm having trouble pairing from iOS, or I can't receive data even if pairing is successful.
As a result of various attempts, the end result is that modern Apple devices may refuse to communicate in clear text.
Specifically, in HID-Keyboard (ServiceUUID: 0x1812), it was found that READ_ENC must be specified in Report Input (CharacteristicUUID: 0x2a4d).
Furthermore, Apple devices did not receive data unless *_ENC was specified during createDescriptor().
If adding *_ENC to the default value of createDescriptor() does not cause another problem, I think it would be more convenient to add it on the NimBLE-Arduino side, so instead of NimHIDDevice.cpp, Fixed the NimBLECharacteristic.h side.
Please let me know your opinions !

I understood.
For the createDescriptor() attribute, BLEHIDDevice.cpp handled it !

I understood.
For the createDescriptor() attribute, BLEHIDDevice.cpp handled it !


Refresh Token using public client with out client secret key is not working

Describe the bug
A clear and concise description of what the bug is.
When we hit the new token request using refresh_token grant type getting the invalid client error.
Error Stacks
put error stacks here

To Reproduce
A minimal example to reproduce the behavior:
Expected behavior
when we hit token endpoint using the refresh_token grant type it should return the access token
Environment:

OS:
Python Version:
Authlib Version:

Additional context
Add any other context about the problem here.
When i go through the code BaseGrant class, There is constant TOKEN_ENDPOINT_AUTH_METHODS, which is allow only client_secret_basic  can we update the none options also which will support for public clients

A public client without client secret SHOULD not obtain tokens with refresh token.

Ok fine i will close this issue

@Arokiasamy-tec look at PKCE for public clients https://auth0.com/docs/get-started/authentication-and-authorization-flow/authorization-code-flow-with-proof-key-for-code-exchange-pkce

What authorization server are you using? The details are very implementation specfic

Authorization servers MAY issue refresh tokens to web application
clients and native application clients.
...
The authorization server MUST verify the binding between the refresh
token and client identity whenever the client identity can be
authenticated.  When client authentication is not possible, the
authorization server SHOULD deploy other means to detect refresh
token abuse.

So it likely depends what your authorization server requires in terms of client authentication. PKCE (linked previously) is one example.


Initial Azure.ResourceManager.TrafficCollector

dup with https://github.com/Azure/azure-sdk-for-net/issues/29240


Update set-up.md

Microsoft365.com/setup

Set up Microsoft 365 Business Basic
Set up Microsoft Business Standard
Set up Microsoft 365 Business Premium
Set up Microsoft 365 Apps for business

@JohanFreelancer9 - kindly do the copy editor review for this PR. Thanks

no way. this Microsoft365.com/setup link actually links to a phishing site

no way. this Microsoft365.com/setup link actually links to a phishing site

He managed to actually get a change in here #4175 which is now live on https://docs.microsoft.com/en-us/microsoft-365/admin/setup/setup?view=o365-worldwide
I've followed through and it is a fake "office licence keydownloader" and when I call their support line he asked me to setup a log me in download on my windows PC.
@pebaum I've seen @JohanFreelancer9 and @yogkumgit both request and approve the other PRs for this Neil user inserting the spammy/phishing links such as in #4175 - how are they approving this phishing crap?!
I will report the Github account and domains to their registrars.
I've put in #4531 to reverse the now live phishing link on the /docs.microsoft.com

The phishing link was removed. @lantrix thank you for your awareness.


[DEVOPS-1359] added exclude method

build in excluding mechanism

Coverage decreased (-0.6%) to 99.446% when pulling cbff1361962b80612c6c5fc46a411b8cdaa1db4a on vonq:DEVOPS-1359 into 518879dfe36542b8bb1fbd37281ba4a862a920e4 on dtan4:master.

Coverage decreased (-0.6%) to 99.446% when pulling cbff1361962b80612c6c5fc46a411b8cdaa1db4a on vonq:DEVOPS-1359 into 518879dfe36542b8bb1fbd37281ba4a862a920e4 on dtan4:master.


[mpg123] Update portfile.cmake to accomodate OpenSUSE 15.x /lib versus /lib64 when port is built

[mpg123] Update portfile.cmake to accomodate OpenSUSE 15.x /lib versus /lib64 when port is built

Some port builds on OpenSUSE 15.x put the resulting libraries in <vcpkg-root>/buildtrees/<port>/src/<some-directory>/<debug or release>/lib64 instead of <vcpkg-root>/buildtrees/<port>/src/<some-directory>/<debug or release>/lib

Changes made to portfile.cmake to check where the libraries exist (either in <vcpkg-root>/buildtrees/<port>/src/<some-directory>/<debug or release>/lib or <vcpkg-root>/buildtrees/<port>/src/<some-directory>/<debug or release>/lib64) before trying to install them into the <vcpkg-root>/installed/x64-linux/lib or <vcpkg-root>/installed/x64-linux/debug/lib directory

Reformatted location where the new lines where added for readability.

Describe the pull request

What does your PR fix? Fixes #10920

Which triplets are supported/not supported? Have you updated the CI baseline?
No Changes

Does your PR follow the maintainer guide? It should, if not please advise/correct me.

Thanks for your PR! Can you please correct the Version field in the CONTROL file?

I could not find documentation on github or google search on how to add a new file to be changed - especially since github has changed to this new interface and I can not find things. So I just delete pull request as I can not figure out how to change requested.


CVE-2007-4559 Patch

Patching CVE-2007-4559
Hi, we are security researchers from the Advanced Research Center at Trellix. We have began a campaign to patch a widespread bug named CVE-2007-4559. CVE-2007-4559 is a 15 year old bug in the Python tarfile package. By using extract() or extractall() on a tarfile object without sanitizing input, a maliciously crafted .tar file could perform a directory path traversal attack. We found at least one unsantized extractall() in your codebase and are providing a patch for you via pull request. The patch essentially checks to see if all tarfile members will be extracted safely and throws an exception otherwise. We encourage you to use this patch or your own solution to secure against CVE-2007-4559. Further technical information about the vulnerability can be found in this blog.
If you have further questions you may contact us through this projects lead researcher Kasimir Schulz.

Thank you @TrellixVulnTeam for bringing this to our attention. It looks like some of your changes are not passing our CI tools.

Closing PR since there has been no activity on this for a while. Please feel free to reopen if you wish to continue working on this. Thanks!


Fix recording rules based on up metrics

What this PR does / why we need it:
When there is no metric, sum() returns stale data instead of zero and it breaks some assertions in alert rules like x == 0. Therefore, we should add "or vector(0)" into the recording rules which are supposed to be zero when there is no data.
Fixes #5383
Special notes for your reviewer:
Here is how to review the unit tests. Now, our inputs for up metrics as below:
- series: 'up{namespace="ci", pod="virt-api-1"}'
  values: "stale stale stale stale stale stale 0 0 0 0 0 0 1"

It means,

the metric doesn't return anything at 0m, 1m, 2m, 3m, 4m, 5m
it returns 0 at 6m, 7m, 8m, 9m, 10m, 11m
it returns 1 at 12m

The alerts are supposed to be fired after 5minutes when the endpoint is not healthy. Therefore,

Those are not supposed to be fired at 3m
Those are supposed to be fired at 5m even when there is no data thanks to my fix
Those are supposed to be fired at 11m when up==0
Those are not supposed to be fired at 12m since up==1

Release note:
Fix recording rules based on up metrics

/test pull-kubevirt-unit-test


[Bug]: Navbar logo fix faq page

Is there an existing issue for this?

[X] I have searched the existing issues

Describe the bug
faq.html page  at Navbar logo img is showing error
Expected behavior
error img fix
Add ScreenShots/Videos

On which device are you experiencing this bug?
No response
Record

[X] I have read the Contributing Guidelines
[ ] I'm a  IEEE-IGDTUW Open Source Week 2024 contributor
[X] I have starred the repository

@apu52 please assign this issue to me

@biswajit-sarkar-007 as u have already raised 2 issues , so sorry i have to close this issue for now

@neeraj10122004 welcome to the repo , As this issue will be closed , so please try to make new issues on which u want to work on so that it will be easier for me to assign u


Google Offline Access Requested

Hello,
Every time I clear my cookies or visit the sign_in page(clears the cookies) I get a notice from Google that the app is requesting offline access next time I try to log in.  I don't see this with any of the other services I sign into with Google apps, is there a way to set it up so this does not happen?

Some services perpetually accept email or authentication data (oauth2_proxy used to do this too!), but there are two things that drove this change that required offline access:

oauth2_proxy gained the ability to pass an access token for the authenticated session to it's upstream. This means offline access with transparent renewing of the access token via refresh tokens.
There are typically competing desires between long lived sessions (not forcing users to re-auth every hour, etc) and short sessions (ensuring that revoking permissions takes effect as quickly as possible). By using offline access, credentials are able to be revalidated frequently separate from the session life to quickly detect and revoke authorization changes (think for example, a google apps domain and you remove an email address/account, if there was an existing session to oauth2_proxy w/ that email address, you want to end it as quickly as possible and not wait for a week long session timeout).

#131 will change this behavior slightly by eliminating most cases where you see a re-login page.
Does that answer your question?


Out of order message processing and parallelism

Version I'm using is 0.3.1. I see there were quite some changes in master since then, so please let me know this is not an issue anymore.
Context:
I'm trying to implement an LSP server using this library. My server supports incremental text sync, which means that fast typing leads to many textChangeEvent notifications being sent to the server.
Problem:
I'm noticing that text change notifications are processed out of order, e.g.
Change(v=234)
Change(v=232)
Change(v=233)
This messes up the state.
IIUC here each async notification handler is forked into a task, which leads to the issue.
Describe the solution you'd like
Having control over the parallelism of message processing would be great.
Describe alternatives you've considered
Unlike with requests, notifications don't have any id so I don't see a way to buffer things on the side of LspServer implementation.

Are you using code from master or 0.3.1 from nuget?
This commit  in master moves processing of json rpc to StreamJsonRpc and I am using this in csharp-ls.
I believe we have sequencing working properly in csharp-ls which uses incremental sync too. There are still some weird out-of-sync issues in emacs, but not sure what is causing them -- anyway it should be better with the latest commit, as it adds cancellation support too.

Oh man, we still need to release that work, don't we @razzmatazz? I'll try to get on that soon.

Oh man, we still need to release that work, don't we @razzmatazz? I'll try to get on that soon.

I think so, we're using it with csharp-ls for some time, but FYI that thing still needs love:

Ionide.LSP.Server is NOT yet converted (leaving this to you :) ) -- as I don't have harnesses to test it;
there are problems with how cancellation is reported and I probably don't understand TaskCancelledException / vs AggregateException / vs OperationCanceledException where we need to set RPC errorCode to 32800 for timeouts:

reported here https://github.com/razzmatazz/csharp-language-server/issues/32

Are you using code from master or 0.3.1 from nuget?

0.3.1 from nuget. I tried setting up the one from master but there were some changes around defaultHandlings and it doesn't quite fit what Server.start wants from handlings parameter; so I put it off.

do you remember what it was? I probably broke defaultHandlings when trying to convert to StreamJsonRpc and fsac will hit the same issue

requestHandlings : Map<string,Delegate> vs defaultRequestHandlings () : Map<string, ServerRequestHandling<'server>>

I've now rebased all the stuff on top of main and with #16 the server compiles fine. Going to look at the message ordering now.

Here's a link to how F# async's don't handle exception propogation from Tasks the same way as C# task awaiting does: https://github.com/fsharp/fslang-suggestions/issues/840

Probably the same problem with exception propagation, but I see that exceptions in my server's handlers are swallowed (only found this out by hooking into a running process with a debugger).

Going to look at the message ordering now.

I did some light manual testing against Emacs LSP and text sync worked OK: messages were delivered and processed in a proper order.

Going to close this with the move to streamjsonrpc.


Swap Page Review Step follow up

surcharge is missing
if the amount of tokens being swapped is large the bottom part gets hidden, maybe we can make it sticky

hmm, yup
lets wrap in container and remove drop shadow from the buttons
like this:

will create amount card that will have the same size as the nft card and it will represent the surcharge amount

okay, second part are funds

updated in figma:
https://www.figma.com/design/JXNtryaNYhY0XJNArzvPQx/Handoff?node-id=9007-36740&node-type=canvas&t=VEZq2N3rCwP7Lq4x-11


Pylint output differs from the commandline

Environment data

VS Code version: 1.55.0
Extension version (available under the Extensions sidebar): v2021.3.680753044
OS and version: GNU/Linux x86_64
Python version (& distribution if applicable, e.g. Anaconda): cpython 3.9.2
Type of virtual environment used (N/A | venv | virtualenv | conda | ...): venv
Relevant/affected Python packages and their versions: pylint==2.7.4
Relevant/affected Python-related VS Code extensions and their versions: ``
Value of the python.languageServer setting: Jedi

Expected behaviour
I want the same output as when running pylint on the commandline.
Actual behaviour
I get import errors.
Steps to reproduce:
Clone and enter https://gitlab.com/petoknm/pycrc.git
Create venv
Activate venv
pip install -e .
Run commands from below that I took from the Python output from VSCode. One uses pyvsc-run-isolated.py and the second one doesn't. The second one is correct. Therefore, something is wrong with the pyvsc-run-isolated.py script.
Logs
(.venv) [peter@ux305 pycrc]$ ~/Programming/pycrc/.venv/bin/python ~/.vscode/extensions/ms-python.python-2021.3.680753044/pythonFiles/pyvsc-run-isolated.py pylint --disable=all --enable=F,unreachable,duplicate-key,unnecessary-semicolon,global-variable-not-assigned,unused-variable,unused-wildcard-import,binary-op-exception,bad-format-string,anomalous-backslash-in-string,bad-open-mode,E0001,E0011,E0012,E0100,E0101,E0102,E0103,E0104,E0105,E0107,E0108,E0110,E0111,E0112,E0113,E0114,E0115,E0116,E0117,E0118,E0202,E0203,E0211,E0213,E0236,E0237,E0238,E0239,E0240,E0241,E0301,E0302,E0303,E0401,E0402,E0601,E0602,E0603,E0604,E0611,E0632,E0633,E0701,E0702,E0703,E0704,E0710,E0711,E0712,E1003,E1101,E1102,E1111,E1120,E1121,E1123,E1124,E1125,E1126,E1127,E1128,E1129,E1130,E1131,E1132,E1133,E1134,E1135,E1136,E1137,E1138,E1139,E1200,E1201,E1205,E1206,E1300,E1301,E1302,E1303,E1304,E1305,E1306,E1310,E1700,E1701 --msg-template='{line},{column},{category},{symbol}:{msg}' --reports=n --output-format=text ~/Programming/pycrc/tests/test_digestors.py
************* Module test_digestors
3,0,error,import-error:Unable to import 'pycrc'

------------------------------------------------------------------
Your code has been rated at 5.00/10 (previous run: 5.00/10, +0.00)

(.venv) [peter@ux305 pycrc]$ pylint --disable=all --enable=F,unreachable,duplicate-key,unnecessary-semicolon,global-variable-not-assigned,unused-variable,unused-wildcard-import,binary-op-exception,bad-format-string,anomalous-backslash-in-string,bad-open-mode,E0001,E0011,E0012,E0100,E0101,E0102,E0103,E0104,E0105,E0107,E0108,E0110,E0111,E0112,E0113,E0114,E0115,E0116,E0117,E0118,E0202,E0203,E0211,E0213,E0236,E0237,E0238,E0239,E0240,E0241,E0301,E0302,E0303,E0401,E0402,E0601,E0602,E0603,E0604,E0611,E0632,E0633,E0701,E0702,E0703,E0704,E0710,E0711,E0712,E1003,E1101,E1102,E1111,E1120,E1121,E1123,E1124,E1125,E1126,E1127,E1128,E1129,E1130,E1131,E1132,E1133,E1134,E1135,E1136,E1137,E1138,E1139,E1200,E1201,E1205,E1206,E1300,E1301,E1302,E1303,E1304,E1305,E1306,E1310,E1700,E1701 --msg-template='{line},{column},{category},{symbol}:{msg}' --reports=n --output-format=text ~/Programming/pycrc/tests/test_digestors.py

-------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 5.00/10, +5.00)

I was able to narrow down the issue to this line in pyvsc-run-isolated.py:
sys.path[:] = (p for p in sys.path if p != "" and normalize(p) != cwd)

Commenting it out fixes the issue. What is the reason for excluding the cwd? Because it seems that python -m and pylint run with cwd in sys.path when run on the cmdline. Doesn't this just introduce a disparity between vscode tooling and cmdline?

Duplicate of #14570.


azd init -t is not compatible with Aspire templates w/o azure.yaml on the root

Issue:
running azd init -t repo-url clones the repo with an empty azure.yaml file at the root.
When:
When a repository has an AppHost project which contains azure.yaml inside the AppHost (instead of the root of the project)
Expected:
azd should detect if there is an app host with azure.yaml and skip creating azure.yaml on the root.

@vhvb1989
Actually the AppHost doesnt have an azure.yaml file after running azd init -t repo-url. The azure.yaml file is only created in the root, and it is empty. And there is no next-steps.md created.
If I now delete all files in the root, and then clone the repo using VS, (and not running azd init -t repo-url), it clones the repo, and then I run azd init from the root, I then select 'Current Directory' and hit 'Confirm', and give in an Environment name. It then creates the azure.yaml file in the root successfully'. It also creates the next-steps.md file.
This is the confirmation I get when running the above commands:
Detected services:

  .NET (Aspire)
  Detected in: C:\ORG\APPNAME\APPNAME.AppHost\APPNAME.AppHost.csproj

azd will generate the files necessary to host your app on Azure using Azure Container Apps.
. Contents:

This is now the contents of the azure.yaml (which is now correct):
# yaml-language-server: $schema=https://raw.githubusercontent.com/Azure/azure-dev/main/schemas/v1.0/azure.yaml.json

name: APPNAME
services:
  app:
    language: dotnet
    project: .\APPNAME.AppHost\APPNAME.AppHost.csproj
    host: containerapp

azd infra synth works.
azd up works.
I then run into problems from my first comment in issue 3037 where I say the issue still exists under https when I run azd pipeline config -e dev
So I just cannot get the azd pipeline config -e dev to run successfully, no matter which direction I take.
Thanks

@pbusfield , there is an issue with azd init -t repo-url for Aspire projects.  azd is creating an empty azure.yaml instead of detecting the AppHost.
The workaround for you case is:

If you ran azd init -t repo-url and got an empty azure.yaml. Then you have to:

manually delete azure.yaml file and .azure folder.
run azd init

If you used VS to clone the repo (or you ran git clone repo-url. Then you have to:

run git remote remove origin

After that, you can run azd pipeline config

@vhvb1989
Thanks Victor.
I tried the method of cloning the repo via VS, then running git remote remove origin
I then run:
azd init   = Success (giving it an environment name of 'test' when prompted)
azd infra synth = success (Infra folders created)
azd up = Error:
ERROR: error executing step command 'deploy --all': getting resource group name: getting default resource groups for environment: test: resource not found: 0 resource groups with prefix or suffix with value: 'test'
PS C:\YourITTeam\Eq
Do I have to create the Resource Group named 'rg-test' manually? before runningh azd up ?

Can you share the generated content from the infra folders?
I was under the idea that you wanted to run azd pipeline config. Are you running infra synth to make some changes to your infrastructure before deploying?

My ultimate goal is the run azd pipeline config, after I run azd up  .
I actually thought that the whole process included running azd infra synth ? Which created the infra folder in the root, which contains the main.bicep file used for the azd up process? I tried running azd up last week without running the azd infra synth command, and it errored saying it couldn't find the infra/main.bicep file.
There are 6 generated tmpl.yaml files in the infra folder inside the AppHost holder. The first one, which causes the error, its content is:
api-version: 2024-02-02-preview
location: {{ .Env.AZURE_LOCATION }}
identity:
  type: UserAssigned
  userAssignedIdentities:
    ? "{{ .Env.AZURE_CONTAINER_REGISTRY_MANAGED_IDENTITY_ID }}"
    : {}
properties:
  environmentId: {{ .Env.AZURE_CONTAINER_APPS_ENVIRONMENT_ID }}
  configuration:
    activeRevisionsMode: single
    runtime:
      dotnet:
        autoConfigureDataProtection: true
    ingress:
      external: true
      targetPort: {{ targetPortOrDefault 8080 }}
      transport: http
      allowInsecure: false
    registries:
      - server: {{ .Env.AZURE_CONTAINER_REGISTRY_ENDPOINT }}
        identity: {{ .Env.AZURE_CONTAINER_REGISTRY_MANAGED_IDENTITY_ID }}
  template:
    containers:
      - image: {{ .Image }}
        name: invoice-api
        env:
          - name: AZURE_CLIENT_ID
            value: {{ .Env.MANAGED_IDENTITY_CLIENT_ID }}
          - name: ASPNETCORE_FORWARDEDHEADERS_ENABLED
            value: "true"
          - name: Invitation--BaseUrl
            value: http://localhost:3000
          - name: KeyVault--Name
            value: inflow-kv-dev
          - name: OTEL_DOTNET_EXPERIMENTAL_OTLP_EMIT_EVENT_LOG_ATTRIBUTES
            value: "true"
          - name: OTEL_DOTNET_EXPERIMENTAL_OTLP_EMIT_EXCEPTION_LOG_ATTRIBUTES
            value: "true"
          - name: OTEL_DOTNET_EXPERIMENTAL_OTLP_RETRY
            value: in_memory
    scale:
      minReplicas: 1
tags:
  azd-service-name: invoice-api
  aspire-resource-name: invoice-api

Hope that helps?

@pbusfield could be that your previous runs weren't successfully deleted properly. How did you delete resources?
Does your azd up report something like this?

(-) Skipped: Didn't find new changes.
SUCCESS: There are no changes to provision for your application.

Refer to these issues https://github.com/Azure/azure-dev/issues/3771 https://github.com/Azure/azure-dev/issues/3559 which had similar error.

ERROR: error executing step command 'deploy --all': getting resource group name: getting default resource groups for environment: test: resource not found: 0 resource groups with prefix or suffix with value: 'test'

azd should detect if there is an app host with azure.yaml and skip creating azure.yaml on the root.

I wonder if we should provide user recommendation for template authors to move azure.yaml to the root before publishing templates? If so, we can make documentation improvements here. I would love to get user feedback on how well this system works, and if this is also a workable solution long-term.
azd supports both azure.yaml at the root and at the app host level. In Visual Studio, we default to the app host directory. However, it still works equally at the root except when you have multiple Visual Studio projects within a solution.

ERROR: error executing step command 'deploy --all': getting resource group name: getting default resource groups for environment: test: resource not found: 0 resource groups with prefix or suffix with value: 'test'

@pbusfield Thank you for reporting this issue. My apologies that we're behind on catching up with you on this conversation. If you are still experiencing issues, would you be able to create a new issue with the repro steps? It would make it easier to have a dedicated conversation -- and we'll see to it that you get the help you need.

@weikanglim Yes I am still experiencing this same issue:

ERROR: error executing step command 'deploy --all': getting resource group name: getting default resource groups for environment: test: resource not found: 0 resource groups with prefix or suffix with value: 'test'

I will start a new thread and give you steps to reproduce and tag you in it.
Thanks


Work around statistics(run_queue) returning incorrect data

Description
In the /_system endpoint, particularly in the chttpd_node:get_stats/0 function, one of the data points returned is an integer reflecting the total sum of the length of all run queues [1]. With the introduction of dirty schedulers in Erlang, the statistics(run_queue) statistic now includes information about the depth of the dirty CPU and IO queues, however, the documentation indicates it should not be including those values. At least that's how it appears to me, I've filed a bug on the matter [2] and I'll keep an eye on that.
In the meantime, we can isolate the scheduler run queues from the dirty scheduler run queues, and report those values separately which will ensure we have an accurate value for run_queue and also allow us to introduce a new value for the dirty CPU queue.
For more context, CouchDB uses several NIFs, but none of them are dirty NIFs.  If you're using something like HAProxy for SSL termination, you won't normally encounter this, however, we can still end up making dirty NIF calls for a push replication to a remote instance over https. The end result is that the run_queue statistic in the /_system endpoint will reflect the amount of crypto work going through the dirty cpu queue and will give false positives on run_queue overload, as elevated run_queues are usually indicative of the Erlang VM having more work to handle that resources available.
Steps to Reproduce
See the bug report in [2] for more details.
Expected Behaviour
Your Environment

CouchDB version used:
Browser name and version:
Operating system and version:

Additional Context
[1] https://github.com/apache/couchdb/blob/master/src/chttpd/src/chttpd_node.erl#L216
[2] https://bugs.erlang.org/browse/ERL-1355
[3] https://github.com/erlang/otp/blob/db6059a9217767a6e42e93cec05089c0ec977d20/lib/crypto/c_src/crypto.c#L3016-L3018

I've got a proof of concept implementation separating out the scheduler and dirty scheduler run_queues in [1].
That PR uses the relatively new statistic call statistics(run_queue_lengths) which was introduced in OTP-18.3. This statistic returns a list of length N + 1 where N is the number of regular schedulers, and +1 is the currently fixed value of the number of dirty CPU schedulers in Erlang. You can see in the PR [1] that I'm using that data to also construct a new stat entry for the dirty CPU queue. We could use the even newer statistics(run_queue_lengths_all) statistic which returns a list of N + 2 for the N schedulers and the 2 dirty scheduler queues, however, Erlang does not yet use dirty IO NIFs for file IO, so that value will always be zero, and that function was introduced in OTP-20, and we still kinda sorta maybe tolerate OTP-19.
Btw, the PR is against 3.x, we'll want to have a separate PR for 4.x, which is why I'm adding the details here in the issue.
[1] https://github.com/apache/couchdb/pull/3161
[2] https://erlang.org/doc/man/erlang.html#statistics_run_queue_lengths
[3] https://erlang.org/doc/man/erlang.html#statistics_run_queue_lengths_all

I got confirmation in the Erlang bug report [1] that there is in fact a discrepancy between the documentation of statistics(run_queue) and the output, however, Rickard Green is of the opinion that it all the CPU run_queues should be aggregated together, which certainly has merits. This morning he merged a change to the maintenance branch updating the documentation to indicate statistics(run_queue) does not exclude the dirty CPU queue.
That said, I don't think that's appropriate for our use case. I've replied to the ticket demonstrating a scenario where aggregating the normal and dirty CPU queues can obscure the meaning of statistics(run_queue), especially for CouchDB where the scenarios of elevated normal run_queues are fundamentally different than that of an elevated dirty CPU queue (assuming you use a proxy for SSL termination).
Therefore I remain of the opinion that it's important to separate the regular run_queue values from the dirty cpu run_queue. In the PR I linked above, I've already started going down that path using the statistics(run_queue_lengths) value, which is also much more efficient than what we've been doing, as statistics(run_queue) performs a lock on all run_queues to read from them, whereas the newer APIs do not lock. So we can switch to the new version that doesn't lock and isolate these two data points as separate metrics.
[1] https://bugs.erlang.org/browse/ERL-1355

Alright, I've got two PRs out for the 3.x line and the main line:
main: https://github.com/apache/couchdb/pull/3168
3.x: https://github.com/apache/couchdb/pull/3161

I've merged both PRs, and now the CouchDB run_queues statistic represents the same values as before, along with a new statistic for the dirty cpu queue. Closing this out.


Default hide column doesn't work

Hi,
I have a datatable and I'd like to hide one of the columns. I've used "bVisible : false" but it doesn't seem to work.
Below is my code:
var validatedActivitiesTable = $('#validatedActivitiesTable')
				.DataTable(
						{
							"sDom" : "<'dt-toolbar'<'pull-left'f><'pull-right'C><'pull-right margin-right-5'l>r>"
									+ "t"
									+ "<'dt-toolbar-footer'<'col-sm-6 col-xs-12 hidden-xs'i><'col-sm-6 col-xs-12'p>>",
							"autoWidth" : true,
							"bStateSave" : true,
							"preDrawCallback" : function() {
								// Initialize the responsive datatables helper once.
								if (!responsiveHelper_validatedActivitiesTable_col_reorder) {
									responsiveHelper_validatedActivitiesTable_col_reorder = new ResponsiveDatatablesHelper(
											$('#validatedActivitiesTable'),
											breakpointDefinition);
								}
							},
							"rowCallback" : function(nRow) {
								responsiveHelper_validatedActivitiesTable_col_reorder
										.createExpandIcon(nRow);
							},
							"drawCallback" : function(
									oSettings) {
								responsiveHelper_validatedActivitiesTable_col_reorder
										.respond();
							},
							"aoColumns" : [ null, null, null, null, null, null, null, null, null, { "bVisible" : false} , null, null, null, null ],
							"order" : [ [ 0, "asc" ] ],
				            "fnInitComplete": function() {
				                var oSettings = $('#validatedActivitiesTable').dataTable().fnSettings();
				                for ( var i=0 ; i<oSettings.aoPreSearchCols.length ; i++ ){
				                	oSettings.aoPreSearchCols[i].sSearch = '';
				                }
				            }
						}).search("").draw(false);

I'm not sure why it doesn't work because I'm pretty sure the syntax is correct. Did I do anything wrong in the code? Please kindly help.
Thank you in advance.

Update: I tried fiddling with the code and added another null column in "aoColumns" and somehow it works when it's not supposed to be. Of course a pop up warning appears, but it did give the result I wanted.
Any ideas please?

What is responsiveHelper? That isn't software that I'm familiar with. Does the column hiding work without it?
Can you link to the page please.

You're right. The column hiding works without it. Thanks for your help! :+1:

Sounds like an issue with whatever software that is in that case. I'll close this issue.


Issue on docs

Path: /components/section.mdx

What's happening with that page? It's rendering correctly over here:
https://react.email/docs/components/section
Can you send me the steps to reproduce?


Last rankings were generated partially (Nov 26, 2017 )

Last rankings were generated partially:

Usually the number of changed files is  122:

Something gone wrong in the last rankings generation. 😅

The build is taking a lot of time... and Travis should be doing weird things.
I will check.
Thanks.

@iblancasa Can I help you with something?

I am checking what caused the issue. I am not sure about what was the problem.
Also, I will never again use Travis to generate the rankings. It is causing more problems than benefits

Can you tell me what project is launching the Travis CI build?
If you are using Travis CI for free the job will close if it takes longer than 50 minutes. Also if the job produces no log output for 10 minutes, it will be closed too.
https://docs.travis-ci.com/user/customizing-the-build/#Build-Timeouts

I already knew that. Some builds failed due to timing issues.
The project GitHubSpanishRankingGenerator is the one which generates the rankings. It was auto-launched using a Travis cron job: https://docs.travis-ci.com/user/cron-jobs/


Evaluation of transfer learning capabilities compared to MS COCO pre-training?

Hi, thanks for the great work! 😊
I am interested in how well weights pre-trained with AlignDet transfer to downstream tasks, which I consider to be an important reason for self-supervised detection pre-training. A standard procedure when transfer learning to downstream tasks is to pre-train a detector on MS COCO, OpenImagesv7, or Objects365 and use these weights to initialize all modules except for the classification head.
Have you tried out how AlignDet matches up against supervised pre-training on small to medium sized datasets? In your transfer learning experiment on Pascal VOC, do you compare AlignDet against a detector with supervised pre-training for all modules (except the classification head) or does the baseline train all modules but the backbone from scratch?

Hi, Thanks for your interest.
The baseline in the transfer learning experiment in the paper denotes training neck and head modules from scratch, and the backbone is pre-trained. We made a comparison with a fully pre-trained detector as you mentioned, but the results are much worse.
I agree with you that the transfer learning results may be the most important metric for pre-training methods. However, since AlignDet only pre-trains small parameters (neck & head) on small-size data (instead of ImageNet, etc), it can not learn enough prior knowledge for good transfer learning as strong as fully-supervised pre-trained methods.
As for scaling AlignDet on larger parameters (instead of neck and head) on large datasets, I'm not sure how this works.

Hi, thanks for the insightful response! 😊
Have you evaluated a pipeline along the lines of AlignDet pre-training > COCO supervised finetuning > Downstream task?
I wonder if self supervised pre-training achieves any gains in such a setting, as with self-supervised pre-training, we could use more diverse datasets jointly (e.g., openimages, objects364, coco) with disjunct label spaces that might transfer better to downstream tasks due to a lower domain gap.


removed fake candle data

Describe your changes
Describe the purpose + content of these changes
Link the related issue
Closes #0000
Checklist before requesting a review

[ ] Is this PR ready for merge? (Please convert to a draft PR otherwise)
[ ] I have performed a self-review of my code.
[ ] Did I request feedback from a team member prior to the merge?
[ ] Does my code following the style guide at docs/CODING-STYLE.md?

Instructions for Reviewers
Functionalities or workflows that should specifically be tested.

Environmental conditions that may result in expected but differential behavior.

If relevant, list additional work to complete pre-merge (delete logging, code abstraction, etc)

For current price information, the chart uses the closing price of the last candle as long as it is the last candle, otherwise it uses the pool price.