Are there limitations on filesystems for photo hosting?

Mine are on NTFS and when running librephotos under docker-desktop with ubuntu / wsl 2 engine and pointing "/data" to the wsl-windows-mount it does not seem to get picked up. When I go to admin area and try to assign user directory there is no directory listed to choose from
config snippet ;
backend:
    image: reallibrephotos/librephotos:dev
    volumes:
      - /mnt/g/auto-backedup/camera/:/data:ro

One user had the same problem, because his adblocker blocked the directories. Do you have an adblocker installed?

One user had the same problem, because his adblocker blocked the directories. Do you have an adblocker installed?

I do, but now I tried also the clean Edge browser and it is the same.
Additionally I tried these workarounds;

Create a cifs volume and bind that to "/data" - also nothing listed to choose from
Bind "/data" against a 'normal' path in $HOME + put a symlink in that path to the /mnt/g/.. folder

this gives me a directory to choose, but it is empty - the symlink'ed content is not picked up

On same docker I also run jellyfin and photoprism and those work OK both with the direct-bind and the volume-bind methods.

I do, but now I tried also the clean Edge browser and it is the same.
Additionally I tried these workarounds;

Create a cifs volume and bind that to "/data" - also nothing listed to choose from
Bind "/data" against a 'normal' path in $HOME + put a symlink in that path to the /mnt/g/.. folder

this gives me a directory to choose, but it is empty - the symlink'ed content is not picked up

On same docker I also run jellyfin and photoprism and those work OK both with the direct-bind and the volume-bind methods.

Some more diagnostics, there are some timeout errors, is that a clue ?

The bind of "/data" is apparently OK in the container (?);

Some more diagnostics, there are some timeout errors, is that a clue ?

The bind of "/data" is apparently OK in the container (?);

That definitely looks like a different error. Could you look into your /logs folder? There should be an ownphotos.log file. Are there any errors in these log files?

That definitely looks like a different error. Could you look into your /logs folder? There should be an ownphotos.log file. Are there any errors in these log files?

It looks like some permission issue ; if I setup "/data" to point to "/home/me/test" and then launch with "sudo docker-compose ..." it works OK. Folder "test" is created in "home/me" as root:root and if I put pictures there (root:root) the folder is visible and pictures gets picked up by the scan.
However ; if I chown (recursive) the "test" folder to me:me and check in the container I can see owner 1000:1000 just as in previous screenshot and now it no longer works, I get same problem. The shell can still access the files under "/data" but not the app it seems?
Here is the logs from starting fresh with "/data" mapped as in OP
log.zip

It looks like some permission issue ; if I setup "/data" to point to "/home/me/test" and then launch with "sudo docker-compose ..." it works OK. Folder "test" is created in "home/me" as root:root and if I put pictures there (root:root) the folder is visible and pictures gets picked up by the scan.
However ; if I chown (recursive) the "test" folder to me:me and check in the container I can see owner 1000:1000 just as in previous screenshot and now it no longer works, I get same problem. The shell can still access the files under "/data" but not the app it seems?
Here is the logs from starting fresh with "/data" mapped as in OP
log.zip

rqworker.log:
17:14:55 Subscribing to channel rq:pubsub:e9a47a779b9d47bdb94c5325130f0e4a
17:14:55 *** Listening on default...
17:14:55 Cleaning registries for queue: default
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/miniconda/lib/python3.8/threading.py", line 932, in _bootstrap_inner
    self.run()
  File "/miniconda/lib/python3.8/site-packages/redis/client.py", line 3718, in run
    pubsub.get_message(ignore_subscribe_messages=True,
17:21:38 Worker rq:worker:e9a47a779b9d47bdb94c5325130f0e4a: found an unhandled exception, quitting...
Traceback (most recent call last):
  File "/miniconda/lib/python3.8/site-packages/rq/worker.py", line 572, in work
    result = self.dequeue_job_and_maintain_ttl(timeout)
  File "/miniconda/lib/python3.8/site-packages/rq/worker.py", line 639, in dequeue_job_and_maintain_ttl
    result = self.queue_class.dequeue_any(self.queues, timeout,
  File "/miniconda/lib/python3.8/site-packages/rq/queue.py", line 598, in dequeue_any
    result = cls.lpop(queue_keys, timeout, connection=connection)
  File "/miniconda/lib/python3.8/site-packages/rq/queue.py", line 570, in lpop
    result = connection.blpop(queue_keys, timeout)
  File "/miniconda/lib/python3.8/site-packages/redis/client.py", line 1900, in blpop
    return self.execute_command('BLPOP', *keys)
  File "/miniconda/lib/python3.8/site-packages/redis/client.py", line 901, in execute_command
    return self.parse_response(conn, command_name, **options)
  File "/miniconda/lib/python3.8/site-packages/redis/client.py", line 915, in parse_response
    response = connection.read_response()
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 739, in read_response
    response = self._parser.read_response()
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 324, in read_response
    raw = self._buffer.readline()
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 256, in readline
    self._read_from_socket()
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 201, in _read_from_socket
    raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
redis.exceptions.ConnectionError: Connection closed by server.
  File "/miniconda/lib/python3.8/site-packages/redis/client.py", line 3617, in get_message
    response = self.parse_response(block=False, timeout=timeout)
  File "/miniconda/lib/python3.8/site-packages/redis/client.py", line 3503, in parse_response
    if not block and not conn.can_read(timeout=timeout):
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 734, in can_read
    Error 111 connecting to librephotos-redis:6379. Connection refused.
return self._parser.can_read(timeout)
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 321, in can_read
    return self._buffer and self._buffer.can_read(timeout)
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 230, in can_read
    self._read_from_socket(timeout=timeout,
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 201, in _read_from_socket
    raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
redis.exceptions.ConnectionError: Connection closed by server.

 What are your settings?

rqworker.log:
17:14:55 Subscribing to channel rq:pubsub:e9a47a779b9d47bdb94c5325130f0e4a
17:14:55 *** Listening on default...
17:14:55 Cleaning registries for queue: default
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/miniconda/lib/python3.8/threading.py", line 932, in _bootstrap_inner
    self.run()
  File "/miniconda/lib/python3.8/site-packages/redis/client.py", line 3718, in run
    pubsub.get_message(ignore_subscribe_messages=True,
17:21:38 Worker rq:worker:e9a47a779b9d47bdb94c5325130f0e4a: found an unhandled exception, quitting...
Traceback (most recent call last):
  File "/miniconda/lib/python3.8/site-packages/rq/worker.py", line 572, in work
    result = self.dequeue_job_and_maintain_ttl(timeout)
  File "/miniconda/lib/python3.8/site-packages/rq/worker.py", line 639, in dequeue_job_and_maintain_ttl
    result = self.queue_class.dequeue_any(self.queues, timeout,
  File "/miniconda/lib/python3.8/site-packages/rq/queue.py", line 598, in dequeue_any
    result = cls.lpop(queue_keys, timeout, connection=connection)
  File "/miniconda/lib/python3.8/site-packages/rq/queue.py", line 570, in lpop
    result = connection.blpop(queue_keys, timeout)
  File "/miniconda/lib/python3.8/site-packages/redis/client.py", line 1900, in blpop
    return self.execute_command('BLPOP', *keys)
  File "/miniconda/lib/python3.8/site-packages/redis/client.py", line 901, in execute_command
    return self.parse_response(conn, command_name, **options)
  File "/miniconda/lib/python3.8/site-packages/redis/client.py", line 915, in parse_response
    response = connection.read_response()
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 739, in read_response
    response = self._parser.read_response()
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 324, in read_response
    raw = self._buffer.readline()
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 256, in readline
    self._read_from_socket()
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 201, in _read_from_socket
    raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
redis.exceptions.ConnectionError: Connection closed by server.
  File "/miniconda/lib/python3.8/site-packages/redis/client.py", line 3617, in get_message
    response = self.parse_response(block=False, timeout=timeout)
  File "/miniconda/lib/python3.8/site-packages/redis/client.py", line 3503, in parse_response
    if not block and not conn.can_read(timeout=timeout):
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 734, in can_read
    Error 111 connecting to librephotos-redis:6379. Connection refused.
return self._parser.can_read(timeout)
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 321, in can_read
    return self._buffer and self._buffer.can_read(timeout)
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 230, in can_read
    self._read_from_socket(timeout=timeout,
  File "/miniconda/lib/python3.8/site-packages/redis/connection.py", line 201, in _read_from_socket
    raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
redis.exceptions.ConnectionError: Connection closed by server.

 What are your settings?

This is my docker-compose.wsl.yml.txt
It is based on your docker-compose.yml.template as it was a few days ago, adapted #change me sections and added custom network - but I have no changes at all to postgres/redis setup. And ; it works OK as soon as I change the "/data" bind to another folder and let "sudo docker-compose ..." create that folder - so my guess is that these redis-errors are artefacts/symptoms of something else that fails (silently?) first.
Maybe it is possible to replicate with the 'chown' step I mentioned above(?)

This is my docker-compose.wsl.yml.txt
It is based on your docker-compose.yml.template as it was a few days ago, adapted #change me sections and added custom network - but I have no changes at all to postgres/redis setup. And ; it works OK as soon as I change the "/data" bind to another folder and let "sudo docker-compose ..." create that folder - so my guess is that these redis-errors are artefacts/symptoms of something else that fails (silently?) first.
Maybe it is possible to replicate with the 'chown' step I mentioned above(?)

Yeah looks fine to me, except this one line:
- librephotos:/data:ro
Why the :ro at the end?
Will try to reproduce the chown step👍

Yeah looks fine to me, except this one line:
- librephotos:/data:ro
Why the :ro at the end?
Will try to reproduce the chown step👍

Thanks ;-)
The :ro is to keep my originals safe, I point librephotos to a master-collection and need to make sure that a mistake cannot wipe the originals. Is that unexpected as seen from the application?
I used the same :ro with local-folder-test and things appeared to operate nicely so I assumed this is OK

Thanks ;-)
The :ro is to keep my originals safe, I point librephotos to a master-collection and need to make sure that a mistake cannot wipe the originals. Is that unexpected as seen from the application?
I used the same :ro with local-folder-test and things appeared to operate nicely so I assumed this is OK

Tested read only, and it worked just fine on my manjaro machine. Chown to a test folder to my mail program and after that to myself, and both worked. Did you chown within the docker container or outside it?
At the moment I think it is a windows / docker desktop specific issue. I will ask on the discord if somebody who runs LibrePhotos on Docker Desktop is willing to try to reproduce the error 😅

Tested read only, and it worked just fine on my manjaro machine. Chown to a test folder to my mail program and after that to myself, and both worked. Did you chown within the docker container or outside it?
At the moment I think it is a windows / docker desktop specific issue. I will ask on the discord if somebody who runs LibrePhotos on Docker Desktop is willing to try to reproduce the error 😅

chown in wsl/ubuntu-console outside of the container. In container-console afterwards the files in /data shows up as 1000:1000 and is accessible, only the python-app seem to be unhappy. Might very well be windows-specific yes 👍

chown in wsl/ubuntu-console outside of the container. In container-console afterwards the files in /data shows up as 1000:1000 and is accessible, only the python-app seem to be unhappy. Might very well be windows-specific yes 👍

I must have mixed up something with the chown-test, I can no longer provoke the problem that way either.
So the problem only occurs when binding /data to the NTFS-storage - either via /mnt/ or via samba/cifs-share pointing to same storage. I will try with a native linux-box too and see how that works (only option that way is the cifs-mount of course)

I must have mixed up something with the chown-test, I can no longer provoke the problem that way either.
So the problem only occurs when binding /data to the NTFS-storage - either via /mnt/ or via samba/cifs-share pointing to same storage. I will try with a native linux-box too and see how that works (only option that way is the cifs-mount of course)

I tried to launch same docker-compose.yml on different docker-hosts.
The docker-compose binds /data to a cifs-share and the results .. vary ;

Docker Host
Version
Result

wsl 2
20.10.0
👎 the original problem

catalina (on mac mini)
20.10.0
👎 similar to wsl

debian 10.2 (in hyper-v)
18.09.1
👎 100% cpu-usage

20.10.2
👎 100% cpu-usage

ubuntu 20.04 (in hyper-v)
19.03.13
👍 working !

fedora 33 (in hyper-v)
20.10.2
👍 working !

Since some are working OK there seems to be no fundamental bug in LibrePhotos ; still there is something strange since also in the non-working hosts the cifs-share is accessible from the 'backend' container shell. Yet the python app struggles to read them for some reason so perhaps there is something that could be done(?)

I tried to launch same docker-compose.yml on different docker-hosts.
The docker-compose binds /data to a cifs-share and the results .. vary ;

Docker Host
Version
Result

wsl 2
20.10.0
👎 the original problem

catalina (on mac mini)
20.10.0
👎 similar to wsl

debian 10.2 (in hyper-v)
18.09.1
👎 100% cpu-usage

20.10.2
👎 100% cpu-usage

ubuntu 20.04 (in hyper-v)
19.03.13
👍 working !

fedora 33 (in hyper-v)
20.10.2
👍 working !

Since some are working OK there seems to be no fundamental bug in LibrePhotos ; still there is something strange since also in the non-working hosts the cifs-share is accessible from the 'backend' container shell. Yet the python app struggles to read them for some reason so perhaps there is something that could be done(?)

My library is large too so the link to #108 makes sense.
Meanwhile I was able to workaround and make it run on wsl via sshfs access to the library

My library is large too so the link to #108 makes sense.
Meanwhile I was able to workaround and make it run on wsl via sshfs access to the library

Created a new image. Would be great if you could test if your issue still persists or if it is solved 👍

Created a new image. Would be great if you could test if your issue still persists or if it is solved 👍

Excellent support 👍 , but I am sorry to report no cigar yet. It behaves the same still I'm afraid.

Excellent support 👍 , but I am sorry to report no cigar yet. It behaves the same still I'm afraid.

Since large libraries is an issue I tried with smaller by just pointing /data to a deep subfolder ;
volumes:
      - /mnt/g/long/path/to/a/few/photos/:/data:ro

This works OK so large library is my problem too it seems. Windows NTFS mount is not to blame

Since large libraries is an issue I tried with smaller by just pointing /data to a deep subfolder ;
volumes:
      - /mnt/g/long/path/to/a/few/photos/:/data:ro

This works OK so large library is my problem too it seems. Windows NTFS mount is not to blame


text is not defined

in line with text.join(...), text is not defined, so when i search for a card in discord, the bot replies with the help message instead

More info needed.


Enforce MCNP number limits

MCNP has some (rather infuriating) limitations on the numbers allowed for objects. These limits should be enforced.

Redundant with #31 .


[subject][action] vs [action][subject] standard for commands?

there is an inconsistency in the repo with regards to how generic command order is approached across the repo, specifically with the order of [subject][action] vs [action][subject]. The most obvious example is earlier in this review you recommended using the file save, which follows the [subject][action] order. However, with the generic tab commands they all support the [action][subject] order. I also mix up the order situationally within the vim grammars, but it's making me wonder if we should try to standardize on one over the other, since I know you don't want to have duplicate ways of saying commands in your own repo.

I personally prefer [subject][action] in general because I can speak the subject that I want to interact with and then say what I want to do with it and it helps me think about what commands I actually going to give. I also think it correlates well to command-line stuff, where we say the number of the command first, and then the sub command. That said I guess it will rely depend on the user as to what order seems most intuitive though. I can move this discussion into a separate issue if you prefer.

I will make a personal vote for object-verb ordering, which is how I have things set up in my personal fork. They should definitely be made consistent either way.

I'm going to close this to declutter; this is included in the 'Guidelines for contributions' these days, too.


decent-sampler: init at 1.9.4

Description of changes
Add package decent-sampler version 1.9.4
Resolving Issue: https://github.com/NixOS/nixpkgs/issues/238499

This is my first contribution to nixpkgs.
I have read as much as I can about how to do this correctly but if I missed something please let me know.
I have included all the suggestions from closed PR https://github.com/NixOS/nixpkgs/pull/273059
Thank you to @eclairevoyant @PowerUser64 @tobiasBora and @IogaMaster for your reviews and testing.

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

I finally learnt how to rebase and FORCE push to a Pull Request. That's why I've been closing PRs instead of just updating them. Sorry about that everyone I know it is messy closing and reopening.

Had to fix bad commit message maintainers: add adam248 ..........

@eclairevoyant @PowerUser64 do you think anything else is left todo? I would merge after that otherwise.

refactor done...

Result of nixpkgs-review pr 275535 run on x86_64-linux 1

1 package built:

decent-sampler


feat: Add required reflection/resource metadata for native image generation

I hope the title is self-explanatory. Providing reflection metadata to Graal's native image generation would be a nice addition to the library. The Akka counterparts of the artifacts already had these in place, so the contents were trivial.

The Akka counterparts of the artifacts already had these in place, so the contents were trivial.

Does that mean you derived these artifacts from the Akka artifacts? What license were those Akka artifacts under? If they were BSL-licensed we cannot accept them in Pekko.
I'm a little concerned how we're going to keep those maintained as the library evolves. I remember there was an initiative to maintain such configurations outside of the main Akka tree, https://github.com/vmencik/akka-graal-config . If we could adapt such an approach, the Graal definitions could evolve independently from Pekko 'itself'. Would that be a feasible approach?

I guess the idea is that Graal users want these files included in our jars. And an outside group can still repackage the Pekko jars and add these files independently.
I haven't done a full review (currently using a mobile phone) but I didn't notice anything to continuously test these config s so that our CI could police changes.
And to reiterate @raboof 's point that we only accept PRs when the work is the submitter's original work. We will not accept code that is taken from Akka unless the submitter to Pekko is the original submitter to Akka. The code writer retains the copyright on the code and can choose to submit it Pekko.

About the contents of the changes, they are simply JSON files that were generated via the native image agent running on the tests, that are in a schema that the native image executable accepts. Correct me if I'm wrong, but I am not sure if this could be considered copyright material or "original work" as it merely contains class paths, field types, etc. which reference the classes in the Pekko org. TBH, I did not double check if all the classes mentioned in the JSON files exist in the artifacts. But we can do due diligence if it is still a concern.
I didn't include the full workflow to keep these configurations updated because firstly, I wanted gauge what everyone thinks about it, and secondly, it would be a lot of work and I thought it could be done in parts.
I would also be fine with having these in a separate project, but I think having them in Pekko itself can help with the release process.

Fair enough about adding regression tests in a 2nd pass.
Could you write up how to generate these JSON files? Ideally someone else would be able to generate them too. We may even need to regenerate if we make certain changes in Pekko. If we know how the generate them that removes any lingering worries that these files were copied directly from Akka.

the file is generated with tools,  but it's hard to cover every code paths, i think this better be a plug in for automatic generating instead of a static file


The bdi (bidi isolate) element, added in HTML5 to ease inserting RTL text into an LTR page or vice-v...

The bdi (bidi isolate) element, added in HTML5 to ease inserting RTL text into an LTR page or vice-versa. I do not know if it will be supported in IE10, and I am not sure how far back its current support in WebKit and Firefox goes.

This issue was imported from Google Moderator
Moderator votes: +14
Issue added by Aharon Lanin on 2012-04-03
To vote this issue up or down, simply include +1 or -1 in your comment.

+1

+1

+1
W3C's testing: http://www.w3.org/International/tests/repository/html5/the-dir-attribute/results-dir-auto#bdi

A much wider question is whether there is support for bidi isolation at all.
Also reletad: dir="auto" [#1479] and unicode-bidi: isolate / isolate-override [#996].
Spec: http://www.w3.org/TR/html5/dom.html#the-dir-attribute
Comprehensive doc: http://www.w3.org/International/articles/inline-bidi-markup/
As a developer I'd want answers to 2 "big" questions:

In which browsers dir=auto autodetecs base direction and layout (by flipping CSS start<->end)?

Which browsers support bidi isolation?

I'm aware of 4 ways that are supposed to trigger bidi isolation:

HTML5 redefined that any element with dir="rtl"/"ltr"/"auto" should be bidi-isolated.
<bdi> element.  AFAICT, it's specced to be exactly equivalent to <span dir="auto">.
unicode-bidi: isolate / isolate-override CSS.
Unicode 6.3 RLI..PDI / LRI..PDI / FSI..PDI control characters.

It seems that (1) and (2) have roughly same support [basically everyone except IE] and I'd expect to see them on same page; any differences can be covered by footnotes.
[According to http://www.w3.org/International/wiki/Html-bidi-isolation#Internet_Explorer_behaviour,
IE<=7 had one non-standard behavior and IE>=8 has a different non-standard behaviour, both somewhere between old embedding and isolation]
(3) probably deserves a separate page.  While currently all but usual IE/Edge suspects have [prefixed only!] support, it might have landed in different versions than dir=... and bdi triggering isolation?
There is a relation though: given (3) it's easy to force support for (1) and (2).
[W3C's tests: http://www.w3.org/International/tests/repo/results/writing-modes-bidi]
(4) Is discouraged, doesn't interact well with markup and CSS.  Quick testing suggests it only works on Firefox.  I also suspect support will depend on OS and not just browser.  IMHO it's fine to omit.

＋1

Now, only Edge/IE10 doesn't support this element: I would be conducive to reconsider the exclusion of bdi tag

Now available at https://caniuse.com/#feat=mdn-html_elements_bdi


INTERNAL Error: Vector::Reference used on vector of different type

I received an internal error regarding "Vector::Reference used on vector of different type" when trying to query a table in Databricks via the uc_catalog and delta_scan extensions.
INSTALL uc_catalog from core_nightly;
INSTALL delta from core_nightly;
LOAD delta;
LOAD uc_catalog;
CREATE SECRET (
TYPE UC,
TOKEN ‘XXXXX',
ENDPOINT 'https://adb-4772174085251619.19.azuredatabricks.net'
);
CREATE SECRET (
TYPE AZURE,
PROVIDER CREDENTIAL_CHAIN,
CHAIN 'cli'
);
ATTACH 'workspace_XXXX' AS workspace_XXXX (TYPE UC_CATALOG);
select * from workspace_XXXX.schema.table limit 10;
As an aside I also always get this message on first query issues: "Not implemented Error: Tried to fallback to unknown type for 'timestamp_ntz'"

Thanks for reporting @eichert12, however this is an issue with the uc_catalog extension. Since that extension is experimental and its type support is pretty minimal in its current state, im closing this issue.


Best k value to use

Hi, I have a question about the parameter k, the number of nearest neighbors to use, is there a way to choose the best k value? like comparing the modularity for each k and choose based on some criteria. Thanks.

i saw some guides concerning dat problem. https://github.com/dpeerlab/PhenoGraph/blob/master/examples/tutorial_pbmc3k.ipynb

i saw some guides concerning dat problem. https://github.com/dpeerlab/PhenoGraph/blob/master/examples/tutorial_pbmc3k.ipynb

Thanks a lot, this is very helpful.


Day76: LeetCode-1002. Find Common Characters - HashTable

Find Common Characters
https://leetcode.com/problems/find-common-characters/
Given a string array words, return an array of all characters that show up in all strings within the words (including duplicates). You may return the answer in any order.

Example 1:
Input: words = ["bella","label","roller"]
Output: ["e","l","l"]
Example 2:
Input: words = ["cool","lock","cook"]
Output: ["c","o"]


Version file %s is not found when try to access migration in subdir

If create migration file with artisan command ./artisan create:migration plugin.code --name "SomeMigration" --table some_table -u then created migration in subdir with dirname as version number.
On the builder plugin if try to open this migration from the list - catching appliaction error about unable to find migration file

Simple fix there: https://github.com/dimti/wn-builder-plugin/commit/e323ec72

@bennothommo are you able to take 15 minutes to look at this? It should be a simple fix

May be is not fully correctly fix, because after create migrations from wn-builder - migration file path prefixed with current dir ./

Fixed as of https://github.com/wintercms/wn-builder-plugin/commit/ea214a225a53f5e631e57231cdf8efa1e62596b8.


Feature: SSH/curve transport support

For some use cases it is important to protect data on the wire. TLS is already supported by mangos, but managing a CA, issuing certificates and deploying them takes some effort and is cumbersome especially in ad-hoc deployments. It would be nice to have a slimmer approach like a transport over SSH or the ability to protect available transports with something like curvezmq to fill this gap.
Go has support for SSH built in, so I assume the SSH transport may be easier to implement.
As far as I can see there were plans in the past / mangos v1  to introduce such a thing but I'm not sure if this was dropped, so I would like to express interest in such capabilities.
Thanks for your great work!

i am interested in these transport options.
it does come down to what i have time to do. having commercial sponsorship
helps for this. absent that its as i find time to do stuff or as others do
and send pull requests.

Garrett

On Sat, Dec 8, 2018, 12:22 PM Michael Eder<EMAIL_ADDRESS>wrote:

For some use cases it is important to protect data on the wire. TLS is
already supported by mangos, but managing a CA, issuing certificates and
deploying them takes some effort and is cumbersome especially in ad-hoc
deployments. It would be nice to have a slimmer approach like a transport
over SSH or the ability to protect available transports with something like
curvezmq http://curvezmq.org/ to fill this gap.
Go has support for SSH built in
https://godoc.org/golang.org/x/crypto/ssh, so I assume the SSH
transport may be easier to implement.
As far as I can see there were plans in the past / mangos v1
https://github.com/nanomsg/mangos/blob/master/PLANS.md#new-transports
to introduce such a thing but I'm not sure if this was dropped, so I would
like to express interest in such capabilities.
Thanks for your great work!
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/nanomsg/mangos-v2/issues/80, or mute the thread
https://github.com/notifications/unsubscribe-auth/ABPDfbtiLGFsCSoQUwdgP4Ax0Frfkd_qks5u3B-ggaJpZM4ZJzVV
.

Hi Michael @edermi You can easily tunnel TCP over SSH, so just use NNG with TCP.
https://github.com/glycerine/sshego is a Go library I wrote for keeping the tunnel setup in process as well--but programming to it may be overkill when a shell script or autossh can have you working in minutes.

Thanks @glycerine, I will have a look. Nevertheless, keeping the number of 3rd-parties low is almost always a good idea, so having this integrated into mangos would still be nicer than relying on another library


getUrlParts() returns null.

Hi
I'm using Angular 6.
I've configured formio by implementing FormioAppConfig , it seems correct because the path URL that I've traced is "https://api.form.io/form" but below line:
var hostparts = this.getUrlParts(path);
returns null.
var hostName = hostparts[1] + hostparts[2];

AppComponent.html:16 ERROR TypeError: Cannot read property '1' of null
at new Formio (Formio.js:139)
at FormBuilder.setForm (Form.js:74)
at FormBuilder.render (Form.js:109)
at Function.push../node_modules/formiojs/FormBuilder.js._Formio2.default.builder (FormBuilder.js:102)
at FormBuilderComponent.push../node_modules/angular-formio/components/formbuilder/formbuilder.component.js.FormBuilderComponent.ngAfterViewInit (formbuilder.component.js:32)
at callProviderLifecycles (core.js:9567)
at callElementProvidersLifecycles (core.js:9541)
at callLifecycleHooksChildrenFirst (core.js:9531)
at checkAndUpdateView (core.js:10467)
at callViewAction (core.js:10699)

Thanks.

this.getUrlParts(path) || []
does the job

Any news on this?
I'm using my own backend - not using the formio backend.
It worked perfectly for some days - and suddenly I get the 'getUrlParts() returns null.' error
Any idea?

We have not made a change to this code in over 2 years so I am not sure what could be causing the problem other than maybe the browsers behave differently now and do not return values expected by this function. What browsers are you using to reproduce this issue?

Hi Travis,
first of all great thx for your fantastic framework.
It’s one of the rare frameworks which just works!
it only fails if you do totally crazy things with it - I tried to include the Renderer as a custom component in the Builder :-)
This messed up everything :-)
Sorry the disturbance !
Thx again
Andreas

On 9 Oct 2020, at 16:53, Travis Tidwell<EMAIL_ADDRESS>wrote:
We have not made a change to this code in over 2 years so I am not sure what could be causing the problem other than maybe the browsers behave differently now and do not return values expected by this function. What browsers are you using to reproduce this issue?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub https://github.com/formio/angular-formio/issues/194#issuecomment-706227994, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADIADQZEUGU5CQYRNPAC3O3SJ4PYNANCNFSM4FQPN3ZQ.

Currently I have the same problem with Angular 11. But I don't think this is causing the issue.
When I add a url to a form on form.io it renders correctly
When I change to a local url, like http://localhost:3100/formname it breaks with the error as shown above


AAD-POD-Identity: Validate that RBAC i restricted for group namespaces

Validate that AAD-POD-Identity CRDs can't be created by the group role edit.

User member of contributor AAD group (resource group).
Able to delete pod in ns:
k delete pod helm-operator-59884754bd-fvkdh
pod "helm-operator-59884754bd-fvkdh" deleted

Can't create azureidentities:
Error from server (Forbidden): error when retrieving current configuration of:
Resource: "aadpodidentity.k8s.io/v1, Resource=azureidentities", GroupVersionKind: "aadpodidentity.k8s.io/v1, Kind=AzureIdentity"
Name: "test", Namespace: "team1"
from server for: "/tmp/test.yaml": azureidentities.aadpodidentity.k8s.io "test" is forbidden: User "akstest@***" cannot get resource "azureidentities" in API group "aadpodidentity.k8s.io" in the namespace "team1"

Can't create azureidentitybindings:
Error from server (Forbidden): error when retrieving current configuration of:
Resource: "aadpodidentity.k8s.io/v1, Resource=azureidentitybindings", GroupVersionKind: "aadpodidentity.k8s.io/v1, Kind=AzureIdentityBinding"
Name: "${IDENTITY_NAME}-binding", Namespace: "team1"
from server for: "/tmp/test.yaml": azureidentitybindings.aadpodidentity.k8s.io "${IDENTITY_NAME}-binding" is forbidden: User "akstest@***" cannot get resource "azureidentitybindings" in API group "aadpodidentity.k8s.io" in the namespace "team1"


fix: Firestore Invalid DS Test Success

Description

The following PR fixes the issue where the firestore test data source was returning success even after providing an invalid project id.
The PR address the invalid project id only not the db URL as it is fetched from the auth json If the URL is invalid in user provided entry. Also, the value is mutable at runtime from the firestore side.
For more detailed description of the following can be found in the notion doc here: https://www.notion.so/Firestore-c3f5c816a68a45b18395da74be97d666

Fixes #21373
Type of change

Bug fix (non-breaking change which fixes an issue)

How Has This Been Tested?

Manual
JUnit

Checklist:
Dev activity

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] PR is being merged under a feature flag

QA activity:

[ ] Test plan has been approved by relevant developers
[ ] Test plan has been peer reviewed by QA
[ ] Cypress test cases have been added and approved by either SDET or manual QA
[ ] Organized project review call with relevant stakeholders after Round 1/2 of QA
[ ] Added Test Plan Approved label after reveiwing all Cypress test

/ok-to-test sha=7de5869

/ok-to-test

/ok-to-test

/ok-to-test sha=7de5869


Electric Power Savings

I am in Oregon with Portland General Electric Time of Use plan. I have cheap electric rates nights and weekends. During mid-peak, I change the temperature lower, and even lower during peak rates. Here is what my graph looks like:

You can see the middle of the graph is the weekend, but the left side is last Friday and on the right is Monday. Now that it's getting cold, I am really seeing the temperature changes. If anyone is also doing power price arbitrage, please do post here!

More graphics!


update optional labels

Update the PR after revert https://github.com/buildkite/agent-stack-k8s/pull/173#pullrequestreview-1494395250

@triarius maybe https://github.com/buildkite/agent-stack-k8s/compare/main...jiaquan1:agent-stack-k8s:jiaquan1/add_optional_labels is needed to fix the error https://buildkite.com/buildkite-kubernetes-stack/kubernetes-agent-stack/builds/745


chore: setup cypress e2e testing

Setup Cypress e2e test runner to not conflict with Jest types in the same project (both test runners use globals like expect). See https://github.com/cypress-io/cypress-and-jest-typescript-example for the high-level idea.

👍🏻


FIX-#4409: fix eval_insert utility and fixes for insert function

What do these changes do?

[ ] commit message follows format outlined here
[ ] passes flake8 modin/ asv_bench/benchmarks scripts/doc_checker.py
[ ] passes black --check modin/ asv_bench/benchmarks scripts/doc_checker.py
[ ] signed commit with git commit -s
[x] Resolves #4409
[ ] tests added and passing
[ ] module layout described at docs/development/architecture.rst is up-to-date
[ ] added (Issue Number: PR title (PR Number)) and github username to release notes for next major release

Blocked by #4408

I believe this should be unblocked now, right?


Document script parameters to run / server / train

The parameters of these scripts should be documented as part of the docs. Right now, they have assigned help messages when running the scripts, but an overview over all the available parameters and what they are used for would be great.

done


[Mobile Cards] Update tutorials that were previously in Starter Scenario.

The update includes moving them the development from Admin Cockpit to Application Studio

Closing this PR to re-create the fork as mentioned in Daniel's email.


CXF-7843: JAX-RS Headers Should Be Split by Default

There was a reason I was doing it, I don't recall the details though. It may related to the TCK tests, may be some other user query...

Like #445, I'll try to see if this change breaks the TCK next week. The functional change look correct, but if it breaks the TCK, then we should discuss this with the JAX-RS spec community before merging.

@sberyozkin @jwcarman It does indeed look like this change will break the JAX-RS TCK... here are the tests that fail as a result of this change (plus #445):
[javatest.batch] Finished Test:  FAILED........com/sun/ts/tests/jaxrs/api/rs/core/link/JAXRSClient.java#fromResourceMethodLinkUsedInInvocationTest_from_standalone
[javatest.batch] Finished Test:  FAILED........com/sun/ts/tests/jaxrs/ee/rs/container/requestcontext/JAXRSClient.java#getHeadersIsMutableTest_from_standalone
[javatest.batch] Finished Test:  FAILED........com/sun/ts/tests/jaxrs/spec/provider/standardnotnull/JAXRSClient.java#clientBigDecimalProviderTest_from_standalone
[javatest.batch] Finished Test:  FAILED........com/sun/ts/tests/jaxrs/spec/provider/standardnotnull/JAXRSClient.java#clientBooleanProviderTest_from_standalone
[javatest.batch] Finished Test:  FAILED........com/sun/ts/tests/jaxrs/spec/provider/standardnotnull/JAXRSClient.java#clientCharProviderTest_from_standalone
[javatest.batch] Finished Test:  FAILED........com/sun/ts/tests/jaxrs/spec/provider/standardnotnull/JAXRSClient.java#clientIntegerProviderTest_from_standalone

I will continue to look into these failures - my guess is that we are either missing something (i.e. handling of null values, etc.) or that the TCK is making some assumptions.  If it is the latter, we can challenge the TCK tests.

That’s unfortunate.  Let me know if there is something we can improve with null handling or something.  I can dig in and fix it for sure


RCTNetworking - didReceiveNetworkIncrementalData error w/ RN 0.31

Greetings,
I am getting redbox using NetInfo on RN 0.31. I do not get this error when I downgrade to RN 0.30. I am using code very similar to the NetInfo example in the RN documentation to check connectivity status. Let me know if you need any additional details.

Here's the code I am using to check connectivity status:
NetInfo.isConnected.addEventListener(
      'change',
      this.handleConnectivityChange.bind(this)
    );

handleConnectivityChange(isConnected) {
    switch (isConnected) {
    case true:
      this.setState({
        connectivity: true
      });
      break;
    case false:
      this.setState({
        connectivity: false
      });
      break;
    }
  }

componentWillUnmount() {
    NetInfo.isConnected.removeEventListener(
      'change',
      this.handleConnectivityChange.bind(this)
    );

System info

OSX 10.11.3
RN 0.31
iOS 9.3, running on simulator and device

if you use react-native run-ios report this error.
try use xcode  to run.

+1
After removed fetch method in my code, the redbox disappeared.
But apparently I can't send any request with it.
(It runs well with android)

Updates:
I spent a few days wrestling with RN and the upgrade from 0.30 to 0.31. I created a new sample project with RN 0.31 and used the same NetInfo code as above, and I could not reproduce the error.
I switched back to the original project, reset my content and settings on the simulator, and ran the same code with RN 0.31. I didn't get a redbox this time around.
Seems to me like clearing the device and resetting had some positive effect. There also seems to be a difference in behavior between an upgraded vs new 0.31 project.
I still don't have a clear answer or failure mechanism. It would be great to understand what is happening with this bug to a deeper level.
Also @Richard-Cao: in my case, it would always be preferred to run builds outside of xcode. I don't want a version upgrade on RN break my testing and CI flow.

@TGPSKI waiting solution……

Started with Xcode and all worked.

I had come across same issue two hours ago and then found this page, and just resolved it by below few steps.
1\ Shutdown iPhone simulator that run by react-native run-ios
2\ Open Xcode
3\ Set the active schema as simulator (e.g. iPhone 6 simulator)

4\ Wait for Xcode to build
5\ Run iPhone simulator by react-native run-ios again
In my case, I hit the problem after connecting and running the app on my own device.
After running on my own device (via Xcode), the active schema become "Generic iOS device".
Hope above can help.

Doing Simulator > Reset Content and Settings... fixed it for me.

I am getting this error on every fetch call with 0.31 and higher. I am on a hybrid app, so I thought it might have to do with Cocoapods not updating properly, but I put some breakpoints in RCTNetworking, and confirmed it was using the updated files. Resetting simulator and clean building didn't make any difference for me.

It seems like a number of people have found these workarounds valid so I am going to close this issue. Thanks folks for reporting this!


Follow up on 142

commit.validate now checks if the votes are valid i.e for the current header
added skipping test for validator set of 4

[ ] Referenced an issue explaining the need for the change
[ ] Updated all relevant documentation in docs
[x] Updated all code comments where relevant
[x] Wrote tests
[ ] Updated CHANGES.md

Codecov Report

Merging #162 into master will increase coverage by 0.64%.
The diff coverage is 86.84%.

@@            Coverage Diff            @@
##           master    #162      +/-   ##
=========================================
+ Coverage   38.95%   39.6%   +0.64%
=========================================
  Files          91      91
  Lines        3237    3275      +38
  Branches      495     500       +5
=========================================
+ Hits         1261    1297      +36
+ Misses       1694    1692       -2
- Partials      282     286       +4

Impacted Files
Coverage Δ

tendermint/src/lite/verifier.rs
80.05% <100%> (+1.42%)
:arrow_up:

tendermint/src/vote.rs
35.59% <60%> (+2.25%)
:arrow_up:

tendermint/src/lite_impl/signed_header.rs
77.04% <66.66%> (-1.8%)
:arrow_down:

tendermint/src/block/commit.rs
60% <0%> (+15%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update afcf99a...bbd0dc0. Read the comment docs.


feat (Add tailwind): Redesign dashboard with tailwind css

Remove antd react package and related icons package.
Include tailwind css, also include custom icons

Please note: The icons are different from the given design, we will replace it later.

@sanathkr Renamed Pages/Index to Pages/Program 👍

I have extracted out some of the lengthy classnames as .module.css, the UI needs bit of polishing, would get to it, once this base is ready.

Making good progress!

Why is this PR closed?

Why is this PR closed?

There is another P.R which is an extension of this P.R
On Tue, Jan 5, 2021 at 9:28 PM Sanath Kumar Ramesh<EMAIL_ADDRESS>wrote:

Why is this PR closed?
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/RareCamp/RareCamp/pull/13#issuecomment-754725444, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ALYZMMN4CG3NY23L53YCSH3SYMZJVANCNFSM4VG6DZVQ
.

There is another P.R which is an extension of this P.R
On Tue, Jan 5, 2021 at 9:28 PM Sanath Kumar Ramesh<EMAIL_ADDRESS>wrote:

Why is this PR closed?
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/RareCamp/RareCamp/pull/13#issuecomment-754725444, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ALYZMMN4CG3NY23L53YCSH3SYMZJVANCNFSM4VG6DZVQ
.


Calculator

Wrong folder, also try to make one program not such trivial ones . These are actually spams.


mongoDB

Add mongoDB for some data

I think we should use mongdb to store the usercredentials to sepparate that from other data for security reasons


⚠ Bofrost.be has degraded performance

In 3a3f3bc, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 2621 ms

Resolved: Bofrost.be performance has improved in da4a7fe.


make EthTransactionValidator generic over Validator instead to allow any validator

Describe the feature
ref https://github.com/paradigmxyz/reth/blob/0bcd388a2058f86ca8f560ce79b3a83ddb84fb68/crates/transaction-pool/src/validate/eth.rs#L21-L25
TODO

rename and make generic over V

#[derive(Debug, Clone)]
pub struct TransactionValidationTaskExecutor<V> {
    /// The validator that will validate transactions on a separate task.
    validator: V,
    /// The sender half to validation tasks that perform the actual validation.
    to_validation_task: Arc<Mutex<ValidationJobSender>>,
}

so any validator is supported

move to task.rs
update all helpers
add new struct EthTransactionValidator {inner: Arc<EthTransactionValidatorInner>} type

Additional context
No response

Hey i would like to know if it's possible to fix this issue without having to run a node ? I don't have the specs for it

@BrazilRaw @tcoratger was faster :)
lmk if you want to take on something but none of the open issues is interesting

lmk

i'm definetly interested yes


Events

Are there any plans to support docker events? Thanks.

@sayarg Closing as this is a duplicate of https://github.com/spotify/docker-client/issues/114. We at spotify don't plan on implementing this anytime soon. But we'd be open to external PRs :)


[Linux] Curl and multi interface

Making curl transfers seemed easy at first:

create a multi handle
create curl easy using curl_easy_init
add those easy handle to the multi handle
The issue I got is how to know when the transfer is complete. Reading official doc and samples, it looks like you have to poll, get messages and check created easy handles.
Other way to do is to monitor the sockets using multi_socket but it appears to be polling as well.
Do you remember anything about that @syntheticmagus  ?

I'll try to create a thread (from the pool?) and do the polling from there.


Feature/update color range

Fixes # .

Changes proposed in this Pull Request:

Update color range as per MD3
Moved branding folder in colors package
Remove dependency blui-types package and moved type definitions in colors package

Screenshots / Screen Recording (if applicable)

To Test:

I have tested the new colours package in the showcase demo (colour values are not correct, I have taken values randomly) but it is working fine.

Any specific feedback you are looking for?

For Manoj's theme story this PR needs to be published with alpha package.
Few things are remaining like fixed readme, changelog, and migration docs. Will raise a different PR.

I find the file structure strange, and the readme is not updated (although the second point might get addressed with a future story / PR? Is that planned?)

Yes, since Manoj's Theme story needs to be an alpha package. I raised a PR with only colour changes. I am working on followup stories.


Native rag support by simple Google search on basic queries

Can we practically enable basic rag feature so that we can do the following system prompt to call for an online search?
SYSTEM """
When a user asks about the weather, do a rag search with the following document #https://www.google.com/search?q=weather.

When a user asks about the date (or what day is today, what day is it, etc), do a rag search with the following document #https://www.google.com/search?q=date+today."""

This would be neat but I don't think easily implemented. What would be required is some ability for the UI to do semantic reasoning on inputs, without resorting to using a full LLM model as this would be monstrously inefficient. I've done a bit of research into the subject and have found a project that purports to be able to do this: Semantic Router.


Switching to battle state before full configuration done

**Game Version **
Game: latest
Describe the bug
by pressing "z" correct moment before the player pokemon health is set causes the switch to Battle state to be triggered

Done in  Fix github issue https://github.com/master172/pokemon-project/pull/2


Manage app and lib Gradle dependencies

refactor: manage app and lib gradle dependencies using external gradle file (dependencies.gradle)

Updated


Add Bubble Sort in C

For short term contributors: we understand that getting your commits well
defined like we require is a hard task and takes some learning. If you
look to help without wanting to contribute long term there's no need
for you to learn this. Just drop us a message and we'll take care of brushing
up your stuff for merge!
Closes https://github.com/NITSkmOS/Algorithms/issues/19
By submitting this pull request I confirm I've read and complied with the
below declarations.

[x] I have read the Contribution guidelines and I am confident that my PR reflects them.
[x] I have followed the commit guidelines for this project.
[x] My code follows the standard code structure.
[x] This pull request has a descriptive title. For example, {Tag}: Add {Algorithm/DS name} [{Language}], not Update README.md or Added new code.
[x] This pull request will be closed if I fail to update it even once in a continuous time span of 7 days.
[x] This pull request shall only be reviewed and merged once all the checks passes. No maintainer or supporter shall be obliged to review it before this condition is met.
[x] I have mentioned the issue number correctly (with hyperlink) in this pull request description.

After you submit your pull request, DO NOT click the 'Update Branch' button.

Comment on 5d3041f1279fade890c985b055688764b0e927f6, file euclidean_gcd/C/euclidean_gcd.c, line 6.
Missing space before ( in while(  [whitespace/parens] [5]
Origin: CPPLintBear, Section: all.cpp.

ack 257c37e


Question about Functions

Hello,
I hope this message finds you well. I'm reaching out to inquire about the possibility of using the SemanticKernel plugin in my C# project. Specifically, I'd like to know if it's possible to use the functions and classes described at   https://learn.microsoft.com/en-us/semantic-kernel/concepts/plugins/?pivots=programming-language-csharp
Thank you for your time and assistance.
Best regards,
Ivandro Jao

Hello,
I hope this message finds you well. I'm reaching out to inquire about the possibility of using the SemanticKernel plugin in my C# project. Specifically, I'd like to know if it's possible to use the functions and classes described at https://learn.microsoft.com/en-us/semantic-kernel/concepts/plugins/?pivots=programming-language-csharp
Thank you for your time and assistance.
Best regards, Ivandro Jao

Hi, sure, SK is an easy tool to use!
Can you share details about your project?
Best


Improve tests

This PR adds pytest-catchlog for reviewing errors sent to logs, e.g. from background threads.
It also adds a rather unique frontier name for each test case so that test case ordering doesn't affect the vcrpy cassettes.

Sweet, I like them, merged your changes into my branch right away :)

Thanks again @immerrr! :+1:


Fix TestCafe SwitchTo

Testcafe tests were failing sometimes due to a promise being passed to this.t.switchToIframe. By adding the await, we make sure that the promise is resolved before passing it.

Thanks @KadoBOT
You are battle testing TestCafe helper, that's nice. All feedback and pull requests on using this helper are welcome.


Exclude deleted projections

Coverage remained the same at 58.924% when pulling c1e8c633d38e8269366aacb984144d049170297a on fix/exclude-deleted-projections into 10435511b30058211f89a9fe8b96b5f7bc62abeb on main.


fix pep8 error

It should rebase to this merged commit, https://github.com/openmainframeproject/python-zvm-sdk/pull/66

this PR fixed all pep8 error except UT


HTTP Interface

Implement an http request handler in spring boot. It should accept a jsonPath expression as a query parameter and a json object to work on via the request body. It is draft and the logic is added later so return 501 for now.

I will look into that.


Documentation website on mobile fails on transitions.

The docs page fails to transition on mobile:

Enter https://reacttraining.com/react-router/core/
Pick any topic
Nothing changes

In console
Uncaught TypeError: Cannot read property '_debugID' of undefined
    at Object.setValueForStyles (CSSPropertyOperations.js:225)
    at Object.i [as current] (react-dom.js:37)
    at e.r [as _callback] (createAnimatedComponent.js:52)
    at e.update (AnimatedProps.js:76)
    at AnimatedValue.js:58
...

The error comes from the react-css-property-operations library, which was extracted from react-dom and is in an archived state.
Code that calls the failing method.
https://github.com/ReactTraining/react-router/blob/02e6da9a791ac90fac5838e7e4943233af7bf118/website/modules/animated/targets/react-dom.js#L33-L45

This appears to be an issue with the Animated library, which is used in the <EnvironmentSmall component.
The Animated package was copied directly to the website instead of being used as a dependency, but I don't know why (I vaguely remember reading a reason before, but I don't recall what it was). This issue might be related, which implies that the problem has been fixed. Unfortunately, I cannot tell which version of Animated is in the website directory.
If someone wants to take a look at what it takes to fix this, it would be appreciated. It probably either requires a) copying updated Animated files or b) just importing the Animated package and removing the copied files (this would be ideal, but I'm not sure why this wasn't done in the first place, so I'm not sure if it will cause issues).

@pshrmn See #6058. I think it may just be an issue with us not setting the correct NODE_ENV in the build. That code shouldn't even be trying to access the _debugID property in production.

Hmm, the Webpack config uses DefinePlugin and calling npm run build sets process.env.NODE_ENV to production, so that code should be transformed.

I did some digging in #6058. Let's follow up there.


Build failure: akkuPackages.chez-srfi on darwin

https://github.com/NixOS/nixpkgs/blob/4aa36568d413aca0ea84a1684d2d46f55dbabad7/pkgs/tools/package-management/akku/deps.toml#L2509-L2517
I think this is fixed upstream, in arcfide/chez-srfi#91
Log output:

Preamble
Running phase: unpackPhase
@nix { "action": "setPhase", "phase": "unpackPhase" }
Running phase: patchPhase
@nix { "action": "setPhase", "phase": "patchPhase" }
Running phase: updateAutotoolsGnuConfigScriptsPhase
@nix { "action": "setPhase", "phase": "updateAutotoolsGnuConfigScriptsPhase" }
Running phase: configurePhase
@nix { "action": "setPhase", "phase": "configurePhase" }
no configure script, doing nothing
Running phase: buildPhase
@nix { "action": "setPhase", "phase": "buildPhase" }
[info] Solving dependencies...
[info] Wrote Akku.lock
[info] Installing the current project
[info] Writing .akku/list
[info] Installing .akku/bin/activate
[info] Installing .akku/bin/activate.fish
[info] Installing .akku/env
Running phase: checkPhase
@nix { "action": "setPhase", "phase": "checkPhase" }
Running test: tests/lazy.sps
Running test: tests/vectors.sps
Done.
Running test: tests/regexp.sps

'("ababc" "abab")
=>
("ababc" "abab")
;; correct

'("ababc" "abab")
=>
("ababc" "abab")
;; correct

'("y")
=>
("y")
;; correct

'("ababc" "abab")
=>
("ababc" "abab")
;; correct

#f
=>
#f
;; correct

'("fooxbarfbar" "fooxbarf" "bar")
=>
("fooxbarfbar" "fooxbarf" "bar")
;; correct

'("abcd" "abcd")
=>
("abcd" "abcd")
;; correct

'("abcdc" (("ab") ("cd")) "cd")
=>
("abcdc" (("ab") ("cd")) "cd")
;; correct

"ab"
=>
"ab"
;; correct

"cd"
=>
"cd"
;; correct

'("1:45:02-2:06:13")
=>
("1:45:02-2:06:13")
;; correct

'("ababc" "abab")
=>
("ababc" "abab")
;; correct

'("ababc" "abab")
=>
("ababc" "abab")
;; correct

'("ababc" "abab")
=>
("ababc" "abab")
;; correct

#f
=>
#f
;; correct

#f
=>
#f
;; correct

'("ababc" "abab")
=>
("ababc" "abab")
;; correct

'("ababc" "abab")
=>
("ababc" "abab")
;; correct

'("ababc" "abab")
=>
("ababc" "abab")
;; correct

#f
=>
#f
;; correct

#f
=>
#f
;; correct

'("\nabc\n" "abc")
=>
("\nabc\n" "abc")
;; correct

#f
=>
#f
;; correct

#f
=>
#f
;; correct

'("ababc" "abab")
=>
("ababc" "abab")
;; correct

'("ababc" "abab")
=>
("ababc" "abab")
;; correct

'("ababc" "abab")
=>
("ababc" "abab")
;; correct

#f
=>
#f
;; correct

#f
=>
#f
;; correct

'("  abc  " "abc")
=>
("  abc  " "abc")
;; correct

#f
=>
#f
;; correct

#f
=>
#f
;; correct

'("abc  " "abc")
=>
("abc  " "abc")
;; correct

'("abc  " "")
=>
("abc  " "")
;; correct

'("Hello World" "em>Hello World
("Hello World" "em>Hello World</em")
;; correct

'("Hello World" "em")
=>
("Hello World" "em")
;; correct

'("foo")
=>
("foo")
;; correct

#f
=>
#f
;; correct

'("foo")
=>
("foo")
;; correct

'("beef")
=>
("beef")
;; correct

'("12345beef" "beef")
=>
("12345beef" "beef")
;; correct

'("555" "867" "5309")
=>
("555" "867" "5309")
;; correct

'("555" "5309")
=>
("555" "5309")
;; correct

'("12345BeeF" "BeeF")
=>
("12345BeeF" "BeeF")
;; correct

#f
=>
#f
;; correct

'("abcD")
=>
("abcD")
;; correct

'("σζ")
=>
("σζ")
;; correct

'("Σ")
=>
("Σ")
;; correct

'("ǅ")
=>
("ǅ")
;; correct

'("σζǅ")
=>
("σζǅ")
;; correct

'("кириллица")
=>
("кириллица")
;; correct

#f
=>
#f
;; correct

'("кириллица")
=>
("кириллица")
;; correct

'("１２３４５")
=>
("１２３４５")
;; correct

#f
=>
#f
;; correct

'("한")
=>
("한")
;; correct

'("글")
=>
("글")
;; correct

'("한")
=>
("한")
;; correct

#f
=>
#f
;; correct

'("123" "456" "789")
=>
("123" "456" "789")
;; correct

'("123" "456" "789")
=>
("123" "456" "789")
;; correct

'("abc" "def" "ghi" "")
=>
("abc" "def" "ghi" "")
;; correct

'("abc" "def" "ghi" "")
=>
("abc" "def" "ghi" "")
;; correct

'("a" "b")
=>
("a" "b")
;; correct

'("a" "" "b")
=>
("a" "" "b")
;; correct

'("a" "" "b" "")
=>
("a" "" "b" "")
;; correct

'("")
=>
("")
;; correct

'("abc" "123" "def" "456" "ghi")
=>
("abc" "123" "def" "456" "ghi")
;; correct

'("abc" "123" "def" "456" "ghi" "789")
=>
("abc" "123" "def" "456" "ghi" "789")
;; correct

'("한" "글")
=>
("한" "글")
;; correct

"abc def"
=>
"abc def"
;; correct

"  abc-abc"
=>
"  abc-abc"
;; correct

"  abc-  abc"
=>
"  abc-  abc"
;; correct

"-abc \t\n d ef  "
=>
"-abc \t\n d ef  "
;; correct

"-abc \t\n d ef  "
=>
"-abc \t\n d ef  "
;; correct

"  abc-d ef  "
=>
"  abc-d ef  "
;; correct

"  abc \t\n d-ef  "
=>
"  abc \t\n d-ef  "
;; correct

"  abc \t\n d ef-"
=>
"  abc \t\n d ef-"
;; correct

"  abc \t\n d ef  "
=>
"  abc \t\n d ef  "
;; correct

" abc d ef "
=>
" abc d ef "
;; correct
Running test: tests/rec.sps
3628800
Running test: tests/fixnums.sps
%%%% Starting test fixnums
# of expected passes      141

Running test: tests/os-environment-variables.sps
Exception in get-environment-variables: currently unsupoorted on ~s with irritant tarm64osx

I've commented on the upstream PR to ask about a new release. The upstream repository is about two years and 25 commits ahead of the source used by nixpkgs; if there's no release, would it be possible to switch to the github source?
(I assume @konst-aa is the best person to tag.)

Oh thanks, this is big. We can probably add it as an override, but we'd also need to figure out how to 'akkufy' the repo. I'll take a shot at it in the next few days

There's no rush on my part: it's blocking scheme-langserver on darwin, but I can work around it. I'm happy to wait for upstream to make a new release, if they choose to do that.


Rosetta: Adds nonce to the /account/balance response

Explain your changes:

Adds nonce to the /account/balance response via archive DB query change

Explain how you tested your changes:

Manually connected to mainnet nodes and tried queries -- the correct nonce is retrieved on non-historical queries and what looks to be correct nonces are returned on historical ones.

Per earlier conversation:

a comment explaining the strategy, including the use of NULLs and MIN, would help future readers
handle case where there are no user commands for a key
distinguish two pending_chain blocks, for example, pending_chain_balance and pending_chain_nonce

For the pending query, I think you may be able to compute the pending_chain, and then the full_chain just once, and then SELECT what you need from that.

For the pending query, I think you may be able to compute the pending_chain, and then the full_chain just once, and then SELECT what you need from that.

I'll make an issue for this and TODO in the a comment and we can follow up with it. I played around a bit, but couldn't get it to work and it's not necessary for now I think

Closed as nonce is already being retrieved in some other way in the current main branches.


TRAN-29653 - fix(worker#close): Handling channels clean & connection close errors

Purpose of this PR
This PR fixes an issue where some workers that lost the connection to the RabbitMQ server did not exit properly because it threw errors when attempting to clean up resources gracefully before exiting the process.
As such, we handled the statement that could throw errors at that point by wrapping them in try ... catch ... & logging the error properly, while letting the process exit.

Codecov Report

Merging #20 into master will not change coverage.
The diff coverage is 100%.

@@          Coverage Diff          @@
##           master    #20   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files           4      4
  Lines         157    161    +4
=====================================
+ Hits          157    161    +4

Impacted Files
Coverage Δ

lib/createWorkers.js
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 48caab9...006d0ed. Read the comment docs.


Kernel getting crashed in specific code blocks

Environment data

VS Code version: 1.88.1
Jupyter Extension version (available under the Extensions sidebar):  v2024.3.1
Python Extension version (available under the Extensions sidebar): 3.11.7
OS (Windows | Mac | Linux distro) and version: Ubuntu 20.04.6 LTS
Python and/or Anaconda version: 3.11.7
Type of virtual environment used (N/A | venv | virtualenv | conda | ...): venv
Jupyter server running: Local (python environment kernel)

Hello,
I am working on vs code jupyter notebook, with a python environment kernel.
It was all working fine till last week, and now when I run specific code blocks (related to training of a model), the kernel is getting crashed producing error like this:

Also when I check the log it is like this:

I also tried reducing the model complexity but still the same issue is coming up. I was able to run these code block without any issues with the same complexity till last week and it was not throwing any error at that time. Now I really don't know what is the reason behind this.Can anyone support me to solve this issue?
Some extra information, this is the kernel that I am using:

this is the exact code block which is throwing the error:

Thank you for filing this issue.
Given the fact that it doesn't crash other times but only when running a specific block of code,
its due to the code itself or a package thats incorrectly installed.
We've found that incorrectly installed tensorflow or similar packages causes kernels to crash.
Given the fact that this isn't an issue with VS Code, I'm closing this issue.
If you run the exact same code in Jupyter Lab/Notebook and run against the same Python environment the code will exhibit the same behaviour.
As this is specific to some code (& not VS Code itself), I'd suggest reaching out the owners of the package or others in the Stack Overflow community for this.
I'm sorry I cannot provide further assistance in this space.


ANDROID_LITE

where did this come from?
https://github.com/tombulled/innertube/blob/e25abdd9fe0bfec41ff7d45ac7b25c343b4ea10e/innertube/config.py#L174-L179

found it:
https://play.google.com/store/apps/details?id=com.google.android.apps.youtube.mango

Yep, I believe that's the one


Add DNSService to ClusterDeployer Docker demo containers

I have Service Fabric running within Docker via https://docs.microsoft.com/en-us/azure/service-fabric/service-fabric-get-started-mac
I followed the tutorial at https://docs.microsoft.com/en-us/azure/service-fabric/service-fabric-quickstart-containers-linux to attempt to deploy a SF app via linux containers.
The error I get is:
$ ./install.sh
[1/10] files, ApplicationManifest.xml
[2/10] files, _.dir
[3/10] files, azurevotebackPkg/ServiceManifest.xml
[4/10] files, azurevotebackPkg/_.dir
[5/10] files, azurevotebackPkg/config/Settings.xml
[6/10] files, azurevotebackPkg/config/_.dir
[7/10] files, azurevotefrontPkg/ServiceManifest.xml
[8/10] files, azurevotefrontPkg/_.dir
[9/10] files, azurevotefrontPkg/config/Settings.xml
[10/10] files, azurevotefrontPkg/config/_.dir
Complete
(FABRIC_E_DNS_SERVICE_NOT_FOUND) DnsService is not enabled on the cluster.
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/knack/cli.py", line 125, in invoke
    cmd_result = self.invocation.execute(args)
  File "/usr/local/lib/python3.6/site-packages/knack/invocation.py", line 85, in execute
    cmd_result = parsed_args.func(params)
  File "/usr/local/lib/python3.6/site-packages/knack/commands.py", line 67, in __call__
    return self.handler(*args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/knack/commands.py", line 123, in _command_handler
    result = op(client, **command_args) if client else op(**command_args)
  File "/usr/local/lib/python3.6/site-packages/sfctl/custom_app.py", line 251, in create
    client.create_application(app_desc, timeout)
  File "/usr/local/lib/python3.6/site-packages/azure/servicefabric/service_fabric_client_ap_is.py", line 3171, in create_application
    raise models.FabricErrorException(self._deserialize, response)
azure.servicefabric.models.fabric_error.FabricErrorException: (FABRIC_E_DNS_SERVICE_NOT_FOUND) DnsService is not enabled on the cluster.

What DNS service do I need to add into my https://docs.microsoft.com/en-us/azure/service-fabric/service-fabric-get-started-mac service fabric?

Where is Dockerfile + config files etc used to create https://hub.docker.com/r/microsoft/service-fabric-onebox/ ?

Effort #1 was:
    <Section Name="DNSService">
      <Parameter Name="IsEnabled" Value="True" />
    </Section>

With the DNSService running (afaik) the install.sh now gets a (FABRIC_E_TIMEOUT) Operation timed out error during create_application.
$ ./install.sh
[1/10] files, ApplicationManifest.xml
[2/10] files, _.dir
[3/10] files, azurevotebackPkg/ServiceManifest.xml
[4/10] files, azurevotebackPkg/_.dir
[5/10] files, azurevotebackPkg/config/Settings.xml
[6/10] files, azurevotebackPkg/config/_.dir
[7/10] files, azurevotefrontPkg/ServiceManifest.xml
[8/10] files, azurevotefrontPkg/_.dir
[9/10] files, azurevotefrontPkg/config/Settings.xml
[10/10] files, azurevotefrontPkg/config/_.dir
Complete
(FABRIC_E_TIMEOUT) Operation timed out.
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/knack/cli.py", line 125, in invoke
    cmd_result = self.invocation.execute(args)
  File "/usr/local/lib/python3.6/site-packages/knack/invocation.py", line 85, in execute
    cmd_result = parsed_args.func(params)
  File "/usr/local/lib/python3.6/site-packages/knack/commands.py", line 67, in __call__
    return self.handler(*args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/knack/commands.py", line 123, in _command_handler
    result = op(client, **command_args) if client else op(**command_args)
  File "/usr/local/lib/python3.6/site-packages/sfctl/custom_app.py", line 251, in create
    client.create_application(app_desc, timeout)
  File "/usr/local/lib/python3.6/site-packages/azure/servicefabric/service_fabric_client_ap_is.py", line 3171, in create_application
    raise models.FabricErrorException(self._deserialize, response)
azure.servicefabric.models.fabric_error.FabricErrorException: (FABRIC_E_TIMEOUT) Operation timed out.

To reproduce, my XML and Dockerfile are at https://gist.github.com/drnic/9b9538966b8a087de3a9be17d1e448af
cd /tmp
git clone https://gist.github.com/9b9538966b8a087de3a9be17d1e448af.git mysfcluster
cd mysfcluster
docker build -t mysfcluster .
docker run --name sftestcluster -d -p 19080:19080 -p 19000:19000 -p 25100-25200:25100-25200 -p 80:80 mysfcluster

Pop inside:
docker exec -ti sftestcluster bash

Wait for SF + DNS to wake up:
watch ps axwwf

Eventually DNS etc will be running:
   19 ?        S      0:00 /bin/bash ./run.sh
   20 ?        S      0:00  \_ /bin/bash ./ClusterDeployer.sh
  317 ?        Sl     0:00      \_ ./FabricHost -c -skipfabricsetup
  374 pts/1    SLsl+   0:01          \_ dotnet FabricDCA.dll
  390 pts/2    Ssl+   0:07          \_ /home/ClusterDeployer/ClusterData/Data/N0010/Fabric/Fabric.Code/Fabric
  403 pts/3    Ssl+   0:07          \_ /home/ClusterDeployer/ClusterData/Data/N0020/Fabric/Fabric.Code/Fabric
  412 pts/4    Ssl+   0:05          \_ /home/ClusterDeployer/ClusterData/Data/N0030/Fabric/Fabric.Code/Fabric
  871 pts/5    Ssl+   0:00          \_ /home/ClusterDeployer/ClusterData/Data/N0030/Fabric/Fabric.Code/FabricGateway.exe localhost:37857
 1489 pts/6    Ssl+   0:00          \_ /home/ClusterDeployer/ClusterData/Data/N0020/Fabric/Fabric.Code/FabricGateway.exe localhost:43097
 1511 pts/7    Ssl+   0:00          \_ /home/ClusterDeployer/ClusterData/Data/N0010/Fabric/Fabric.Code/FabricGateway.exe localhost:38739
 4860 pts/8    Ssl+   0:01          \_ /home/ClusterDeployer/ClusterData/Data/N0020/Fabric/work/Applications/__FabricSystem_App4294967295/FileStoreService.Cod
e.Current/FileStoreService.exe
15653 pts/9    Ssl+   0:00          \_ /home/ClusterDeployer/ClusterData/Data/N0030/Fabric/work/Applications/__FabricSystem_App4294967295/DnsService.Code.Curr
ent/FabricDnsService.exe
15783 pts/10   Ssl+   0:01          \_ /home/ClusterDeployer/ClusterData/Data/N0030/Fabric/work/Applications/__FabricSystem_App4294967295/FileStoreService.Cod
e.Current/FileStoreService.exe
15799 pts/11   Ssl+   0:01          \_ /home/ClusterDeployer/ClusterData/Data/N0010/Fabric/work/Applications/__FabricSystem_App4294967295/FileStoreService.Cod
e.Current/FileStoreService.exe

Download and attempt to deploy the Voting app:
cd /tmp
git clone https://github.com/Azure-Samples/service-fabric-containers.git
cd service-fabric-containers/Linux/container-tutorial/Voting

sfctl cluster select --endpoint http://localhost:19080
./install.sh

And the original problem - why is it that the sample app demanded the DnsService? I can see ServiceDnsName="redisbackend.testapp" in the following in ApplicationManifest.xml
    <Service Name="azurevoteback" ServiceDnsName="redisbackend.testapp">
      <StatelessService ServiceTypeName="azurevotebackType" InstanceCount="1">
        <SingletonPartition/>
      </StatelessService>
    </Service>

But searching for ServiceDnsName in service-fabric code base only finds some sample ApplicationManifest.xml files.
How does the sample above trigger service fabric to look for & fail when DnsService is missing?

DNSService is not supported currently for the onebox scenario on a Mac. We are going to add support for it soon

Can I ask what is the nature of the “not currently supported” within Docker/Mac? That is, where else might DNSService work/not work? Many environments will already have some notion of dns/networking in existence; eg BOSH.

From: Sudhanva Huruli<EMAIL_ADDRESS>Sent: Friday, May 4, 2018 2:45:00 AM
To: Microsoft/service-fabric
Cc: Dr Nic Williams; Author
Subject: Re: [Microsoft/service-fabric] Add DNSService to ClusterDeployer Docker demo containers (#113)
DNSService is not supported currently for the onebox scenario on a Mac. We are going to add support for it soon
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/Microsoft/service-fabric/issues/113#issuecomment-386360049, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AAAAbMhidTZnxm_hSzkOOSic6x86owi0ks5tuzQMgaJpZM4TtXtX.

The DNSService does not work when turned on for Service Fabric running inside a container as it does on Mac's. The developer cluster's on Windows and Ubuntu dev machines will come up just fine with the DNSService on.

@suhuruli, unfortunately, I have the same error on Windows with Docker Desktop.
I'm following this https://learn.microsoft.com/en-us/azure/service-fabric/service-fabric-quickstart-containers-linux but I'm deploying to a local dev cluster of Linux instead of Azure. I followed this https://learn.microsoft.com/en-us/azure/service-fabric/service-fabric-local-linux-cluster-windows to setup my local dev cluster in Docker. This is what I did and got (in Cygwin):
robert@robert-surface ~/code/service-fabric-containers/Linux/container-tutorial/Voting master
$ sfctl cluster select --endpoint http://localhost:19080/

robert@robert-surface ~/code/service-fabric-containers/Linux/container-tutorial/Voting master
$ ./install.sh
Uploading Application Files
Uploading path: .: 100%|▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒| 2/2 [00:02<00:00,  1.34s/it]
[3/13] files, _.dir
Time left: 297 seconds
Uploading path: azurevotebackPkg: 100%|▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒| 2/2 [00:01<00:00,  1.21it/s]
[6/13] files, azurevotebackPkg\_.dir
Time left: 295 seconds
Uploading path: azurevotebackPkg\config: 100%|▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒| 1/1 [00:00<00:00,  3.46it/s]
[8/13] files, azurevotebackPkg\config\_.dir
Time left: 294 seconds
Uploading path: azurevotefrontPkg: 100%|▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒| 2/2 [00:00<00:00,  4.40it/s]
[11/13] files, azurevotefrontPkg\_.dir
Time left: 294 seconds
Uploading path: azurevotefrontPkg\config: 100%|▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒▒| 1/1 [00:00<00:00,  3.55it/s]
[13/13] files, azurevotefrontPkg\config\_.dir
Complete
Time left: 293 seconds
Provisioning Application Type
Creating Application
ERROR: (FABRIC_E_DNS_SERVICE_NOT_FOUND) DnsService is not enabled on the cluster.
Traceback (most recent call last):
  File "C:\Users\robert\AppData\Local\Programs\Python\Python310\lib\site-packages\knack\cli.py", line 206, in invoke
    cmd_result = self.invocation.execute(args)
  File "C:\Users\robert\AppData\Local\Programs\Python\Python310\lib\site-packages\sfctl\entry.py", line 81, in execute
    return super(SFInvoker, self).execute(args)
  File "C:\Users\robert\AppData\Local\Programs\Python\Python310\lib\site-packages\knack\invocation.py", line 208, in execute
    cmd_result = parsed_args.func(params)
  File "C:\Users\robert\AppData\Local\Programs\Python\Python310\lib\site-packages\knack\commands.py", line 139, in __call__
    return self.handler(*args, **kwargs)
  File "C:\Users\robert\AppData\Local\Programs\Python\Python310\lib\site-packages\knack\commands.py", line 246, in _command_handler
    result = op(client, **command_args) if client else op(**command_args)
  File "C:\Users\robert\AppData\Local\Programs\Python\Python310\lib\site-packages\sfctl\custom_app.py", line 707, in create
    client.create_application(app_desc, timeout)
  File "C:\Users\robert\AppData\Local\Programs\Python\Python310\lib\site-packages\azure\servicefabric\operations\_service_fabric_client_ap_is_operations.py", line 3729, in create_application
    raise models.FabricErrorException(self._deserialize, response)
azure.servicefabric.models._models_py3.FabricErrorException: (FABRIC_E_DNS_SERVICE_NOT_FOUND) DnsService is not enabled on the cluster.

And, this is the container image I use for the SF Linux cluter:
PS C:\Users\robert> docker images
REPOSITORY                                TAG       IMAGE ID       CREATED         SIZE
mcr.microsoft.com/service-fabric/onebox   u18       dffdac13e6ad   16 months ago   2.14GB

Adding @peterpogorski who can help with this now!

Hi @peterpogorski , any idea on this?
BTW, I'm also trying to use the Ubuntu 20 image as the document says but it's not found at all!
PS C:\Users\robert> docker run --name sftestcluster -d -v /var/run/docker.sock:/var/run/docker.sock -p 19080:19080 -p 19000:19000 -p 25100-25200:25100-25200 mcr.microsoft.com/service-fabric/onebox:u20
Unable to find image 'mcr.microsoft.com/service-fabric/onebox:u20' locally
docker: Error response from daemon: manifest for mcr.microsoft.com/service-fabric/onebox:u20 not found: manifest unknown: manifest tagged by "u20" is not found.

I have just been following the Linux container voting tutorial here: https://learn.microsoft.com/en-us/azure/service-fabric/service-fabric-quickstart-containers-linux
Creating Application
/opt/homebrew/lib/python3.11/site-packages/urllib3/connectionpool.py:1056: InsecureRequestWarning: Unverified HTTPS request is being made to host 'XXXX.XXXX.cloudapp.azure.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings
  warnings.warn(
**(FABRIC_E_DNS_SERVICE_NOT_FOUND) DnsService is not enabled on the cluster.**
Traceback (most recent call last):
  File "/opt/homebrew/lib/python3.11/site-packages/knack/cli.py", line 206, in invoke
    cmd_result = self.invocation.execute(args)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/sfctl/entry.py", line 81, in execute
    return super(SFInvoker, self).execute(args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/knack/invocation.py", line 208, in execute
    cmd_result = parsed_args.func(params)
                 ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/knack/commands.py", line 139, in __call__
    return self.handler(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/knack/commands.py", line 246, in _command_handler
    result = op(client, **command_args) if client else op(**command_args)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/sfctl/custom_app.py", line 707, in create
    client.create_application(app_desc, timeout)
  File "/opt/homebrew/lib/python3.11/site-packages/azure/servicefabric/operations/_service_fabric_client_ap_is_operations.py", line 3729, in create_application
    raise models.FabricErrorException(self._deserialize, response)
**azure.servicefabric.models._models_py3.FabricErrorException: (FABRIC_E_DNS_SERVICE_NOT_FOUND) DnsService is not enabled on the cluster.**

After running ./install.sh to deploy to my SF cluster in Azure I see this error message in the terminal. And no applications or services show within the Explorer view. I am using Ubuntu 18 on the VM.


start adding schema-parsing unit tests

Adds simple unit test for the schema helper's GetCRDS() method using a
simplified SNS-like API fixture.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Awesome!!


Less noisy/repetitive way of specifying integration tests in build system

The current way we're specifying integration tests in the build system is leading to noise and repetition.
I should say upfront, the way we're doing it seems to me very natural in PlatformIO, and I'm not sure how else we should do it.  So this isn't criticism of the authors of the code; it's a problem with PlatformIO.  But having said that, I still think we need to figure out something to do about it.

It's leading to noise because when you run pio test -e native, it prints every environment that it skipped:
$ pio test -e native
checksum        stm32                 IGNORED
checksum        stm32-test            IGNORED
checksum        stm32-dma-test        IGNORED
checksum        int-test-blower       IGNORED
checksum        int-test-solenoid     IGNORED
checksum        int-test-stepper      IGNORED
checksum        int-test-pinch-valve  IGNORED
checksum        native                PASSED    00:00:02.539
circ_buff       stm32                 IGNORED
circ_buff       stm32-test            IGNORED
circ_buff       stm32-dma-test        IGNORED
circ_buff       int-test-blower       IGNORED
circ_buff       int-test-solenoid     IGNORED
circ_buff       int-test-stepper      IGNORED
circ_buff       int-test-pinch-valve  IGNORED
circ_buff       native                IGNORED

[many lines snipped]

As you can see above, we have an n^2 problem of num_integration_tests * num_unit_tests, that's going to become bad very quickly.

It's leading to repetition in the platformio.ini file.  If and when we want to change flags in a way that affects integration tests, there is a high likelihood we're not going to do so in a consistent way, and ultimately that will lead to sadness.

cc @martukas

cc @Miceuz

Yup, this is ugly :( I could not think of how to do it better. The problem is, I do want separate executables. I don't want to bring in the extra baggage of comms and debug libraries for when I'm only testing a couple of low level things. Do you think that's an unnecessary limitation?

I don't want to bring in the extra baggage of comms and debug libraries for when I'm only testing a couple of low level things. Do you think that's an unnecessary limitation?

(Just as a point of order, if you're not using "the whole shebang", then it's confusing to me to call it an "integration test".  In the parlance I am familiar with, integration tests are whole-system tests.  I don't immediately have a name for this, but it's closer to a unit test than an integration test.  "Externally-validated unit test"?  I dunno.)
I am not sure what's the problem with compiling in e.g. the comms code even if you're not testing it.  In platformio we put most of our code into a single "core" library, because in my experience splitting up into many small libraries ends up being one big pan.  You have to avoid circular dependencies, which is painful, and then as soon as you have one you can't avoid you have to merge the libraries anyway.
But I'm also not sure how avoiding compiling in unneeded code relates to the problems from the first comment.

I think we have had this set of definitions outlined by Jerome for a while now:
https://github.com/RespiraWorks/VentilatorSoftware/wiki/Embedded-software-testing
That's the terminology that I have been following. It makes sens to me, but perhaps there is something better? Feel free to propose.
In any case, whatever we call it, sure, it is much closer to unit tests, but with hardware.
My issue is not so much with compiling in the "whole shebang" as being dependent on say

serial communications AND
the debug interface AND
some nested loops AND
something else...
all running correctly when I want to test only the stepper, for example. If only there was a way to pass a single parameter to the controller loop as it starts...

What I am not aware of is maybe all of those systems I have listed above are thoroughly tested already? Then I could discard my concerns and do all this testing via the debug interface. I'm sincerely shopping around for alternatives.

https://github.com/RespiraWorks/VentilatorSoftware/wiki/Embedded-software-testing

Whoa, one of us wrote something down?!
FWIW here's a citation for the definition of "integration test" that I'm familiar with.
https://en.wikipedia.org/wiki/Integration_testing  I wasn't able to find online anyone using the other definition, although I guess it's pretty hard to search for.
(This is a problem I have with the wiki -- since there's no notification or review process, there's no opportunity to get on the same page about things.)
Anyway I guess it's OK if it's written down!

is maybe all of those systems I have listed above are thoroughly tested already?

Definitely not.
I think I understand your problem better, thanks.
A problem with this approach is that it only works inasmuch as the stuff you want to test is broken out into separate libraries (right?).  You got lucky that hal is a separate library, so I guess it works inasmuch as you are only testing hal.  If you are going to want to test stuff that's currently in core, we may need to come up with another approach, because, for the reasons explained in core/README.md, I don't think we should split up core into lots of tiny libraries.
But orthogonal to that, help me understand this: If you only want to depend on hal, how does that affect the issues I raised at the beginning of this bug?  How does "I only want to depend on hal" mean "I need a new PIO build environment for each integration test"? (lol integration test is still hard for me to say here.  I'll get to used to it.)

Maybe I'm misunderstanding "environment". I somehow got the idea into my head that what pio sees as "environment" is what would equal "target" in the CMake-verse? Can I have one "environment" but create multiple executables for it, i.e. separate main() functions?

I somehow got the idea into my head that what pio sees as "environment" is what would equal "target" in the CMake-verse?

I think pio conflates two concepts.  An environment is a target and also it's a set of build flags, a choice of toolchain, etc.
The reason is, they're primarily concerned with uploading stuff to an embedded device, where there really is ultimately only one binary.

Can I have one "environment" but create multiple executables for it, i.e. separate main() functions?

You're not gonna like it, but I think one could hack it...  Basically you can use "advanced scripting" to do whatever you want.  Such as, read an environment variable and then set src accordingly, or set -D flags to the compiler.  Then you'd be able to do
TEST=foo pio run -e integration-test

and the TEST envvar could be interpreted by your script.  If the TEST envvar is not set, the script prints an error or whatever.
Beautiful?  No.  Scalable?  Possibly.

Can't we split the integration test envs to a separate platformion.ini file and place it in a separate directory?

Not a bad idea!  If it gets repetitive we could even write a Python script to generate it.

I think I took care of this with latest PR. There is now only one target. It is the "not pretty" way that @jlebar suggested, but at least I am satisfied with this and it solves the problem as defined here.
Are we satisfied to close this ticket?

Closed by https://github.com/RespiraWorks/VentilatorSoftware/pull/718


Executable errors not showing in the UI

Description
Executable errors are not being displayed in the UI.  Originated from https://github.com/Glavin001/atom-beautify/issues/2145.
Input Before Beautification
This is what the code looked like before:
N/A
Expected Output
The beautified code should have looked like this:
N/A
Actual Output
The beautified code actually looked like this:
N/A
Steps to Reproduce

Add code to Atom editor
Shut down Docker if you have it installed
Configure a beautifier/executable so it will error intentionally (like setting the wrong path)
Run command Atom Beautify: Beautify Editor

Result:  Shows an error "could not find Docker"
Expected:  Should show an error about the executable not being able to run instead or in addition to
Debug
Here is a link to the debug.md Gist:
Checklist
I have:

[X] Tried uninstalling and reinstalling Atom Beautify to ensure it installed properly
[X] Reloaded (or restarted) Atom to ensure it is not a caching issue
[X] Searched through existing Atom Beautify Issues at https://github.com/Glavin001/atom-beautify/issues
so I know this is not a duplicate issue
[X] Filled out the Input, Expected, and Actual sections above or have edited/removed them in a way that fully describes the issue.
[ ] Generated debugging information by executing Atom Beautify: Help Debug Editor command in Atom and added link for debug.md Gist to this issue

The problem is definitely from
https://github.com/Glavin001/atom-beautify/blob/master/src/beautifiers/executable.coffee#L390-L412
@szeck87 I think this error in Promise.reject(error) is what we want: https://github.com/Glavin001/atom-beautify/blob/master/src/beautifiers/executable.coffee#L396
Would you be able to try out the following change:
  init: () ->
    super()
      .then(() =>
        return @
      )
      .catch((error) =>
        return Promise.reject(error) if not @docker?
        return Promise.resolve(error) # <--- CHANGE HERE
      )
      .then((errorOrThis) => # <----- CHANGE HERE
        shouldTryWithDocker = not @isInstalled and @docker?
        @verbose("Executable shouldTryWithDocker", shouldTryWithDocker, @isInstalled, @docker?)
        if shouldTryWithDocker
          return @initDocker().catch(() => Promise.reject(errorOrThis)) # <---- CHANGE HERE
        return @
      )
      .catch((error) =>
        if not @.required
          @verbose("Not required")
          @
        else
          Promise.reject(error)
      )

Please and thank you 😃 . I think this will fix it!


POT calculate 2D vector EMD distance which have different length.

How to calculate 2D vector emd distance using POT? etc. I have these 2 vector:
[(0, 1), (1, 1), (2, 2), (3, 2), (4, 1), (5, 1)],
[(0, 1), (1, 1), (3, 1), (4, 1), (5, 1), (6, 1), (7, 1)]

distance matrix:
5x6

Actually, the 2 vector are words-bag, and distance matrix is the words Euclidean distance, I want using this to calculate Sentence Distance but don't know how to use EMD distance, any help?

Hello,
The followinge example show you how to compute the OT matrix between 2D samples:
https://github.com/rflamary/POT/blob/master/examples/Demo_2D_OT_samples.ipynb
It is not necessary to have a square distance matrix in practice and the code can handle it.
Once you have the OT matrix G the emd distance can be computed by np.sum(G*M).
You can find more information in the documentation and examples.


Blog post for highlighting invalid answers

@ralph-hawkins have resolved your comments. Though this post is slightly premature - I need to draft the one on the Apply integration first (which this links to, but isn't published).


[e2ealerting] Support pass through labels & custom histogram buckets

We're using e2ealerting across our k8s fleet to monitor latency from ingestor to AM and want to be able to break that down by specific tags like cluster name or AZ. We could solve this by generating one rule for each but this becomes harder to manage as our cluster grows automatically. Instead this adds the ability to pass through custom labels from AM to the histogram and improves the timestamp seen logic to track this by the particular facets.
It also provides customization for the histogram buckets for those that want to get more granular on specific details.

Hi @callumj thank you very much for your contribution! This is gladly something we can bake into e2ealerting.
I started to review this but found the changes a bit hard to follow all at once, do you mind if we split this PR into smaller increments so that we can work together?
From what I can see we have three changes:

Configurable Histogram Buckets
Healthcheck endpoint
Support tracking of custom labels

It'd be my preference if we can start with 1/2 and then move into 3. This tool is quite sensitive to changes given it's nature and I want to make sure we get it right from the get go 🙏

Good call @gotjosh, will open some new PRs.


Review deployment architecture according to cloud restrictions

[ ] Research how to deploy eUPF without Multus
[ ] Research how to deploy free5gc without Multus
[ ] Decide what to do with kernel version (eUPF needs >= 5.7) required for ebpf support
[x] Verify all required node-level configuration options
[x] Call to external expertize (post to relevant platform, any examples of deployed 5GC in K8s, routing to internal IPs without NAT/internal IPs announcement)

https://github.com/m4r1k/k8s_5g_lab

Our reddit thread:
https://www.reddit.com/r/kubernetes/comments/14g7w41/question_about_networking_in_kubernetes_cluster/

Research how to deploy eUPF without Multus

2 options:

use host network
use BGP peering between calico and external router

Research how to deploy free5gc without Multus

i could not find alternative charts for free5gs, but we can use our universal chart for try to deploy it

Decide what to do with kernel version (eUPF needs >= 5.7) required for ebpf support

??

Verify all required node-level configuration options

for host nat, we need host network, and sysctl forwarding options


Add safety model eval test for use with LlamaGuard2 and together hosted models

Right now tests have to choose between producing test items that either have TextPrompts or ChatPrompts. It is a SUT's responsibility to handle the different prompt types by implements translate_text_prompt and/or translate_chat_prompt. If a model only accepts chat prompts, then you can you just transform the test's TextPrompt into chat format in translate_text_prompt.

Here's the refactor and proposed design decision so far
Decisions and assumptions

Safety Models are SUTs- decided to keep this paradigm for now. Creating a new runner and new AnnotationTestItem base classes is a viable approach, but one I'm electing to defer for simplicity
Create 2 separate test types - LlamaGuard tests and Chat model tests are just 2 separate tests. They share reusable logic via util functions

Deferred + to address in future

Disentangling lg2 annotator and lg2 SUT, creating a more logical relationship if sharing code
Refactor entire system to use new runner for annotator evals

I guess my concern with this approach is that tests are built/applied to only one type of a safety SUT. So for every new evaluator we want to test, we need to create 1) a new SafetyModelSUT to transform the annotator into a SUT and 2) a new test with custom processing of the model’s response.
This process increases the amount of effort required to actually use the framework. So --and maybe I'm missing something-- I’m not sure what benefits are gained by awkwardly forcing evaluators in SUT classes.
Using a custom runner would allow new evaluators to be tested without any additional work. Setting this up would just require one new test and the custom runner, which only needs a few modifications to the simple_test_runner.

Good points. After refactoring, here are the design decisions
Design decisions

Safety models are Annotators.
Evaluation of annotators uses it's own annotator runner. No longer need to create SUTs that map to Annotator. Thanks to runner separation, we don't need to worry about conflicting with SUT tests, they're completely separate

Tests supported

Safety model test for LlamaGuard2 Annotator

Todo

Add Llama 3 70b chat annotator
Add Mistral 8x22b instruct annotator
Create test for large-param, prompt engineered chat safety models


Update data.json

how to create these image url

@varghesejose2020 when creating an issue and add the image to it, GitHub creates a url for the image