index.html 404 is not found

I built metatron from source using intellij and pom.xml in github. But when i go to my browser it shows :8180/app/v2/index.html 404 is not found and below page. When I look at the 'fat jar' (discovery-server-3.0.7.jar) it is a bit smaller than the one provided insde https://sktmetatronkrsouthshared.blob.core.windows.net/metatron-public/discovery-dist/Discovery/3.0.7/metatron-discovery-3.0.7-bin.tar.gz. When I inspect the 2 jars I notice mine is missing discovery-frontend-3.0.7.jar within the jar. What is the fix?
Default metatron Error Page
Occurred: Tue Nov 27 05:20:27 UTC 2018
Response Status: 404 (Not Found)
Cause: No message available
Note: You would never generate a page that displays a Java exception to an end-user in a real application
You are seeing this error page due to Spring Boot (which returns a view called "error" in response to uncaught exceptions. Since we are using Thymeleaf this corresponds to the template error.html )

@tooptoop4
I'm using intellij too but I cannot reproduce this issue.
Could you add more information about how did you set maven scope?

@alchan-lee I cloned the github repo exactly, no changes to pom. What i noticed is that the discovery-frontend-3.0.7.jar generated is only 3KB and I get popup warnings about access to nodejs denied due to no admin privileges on local machine. Maven logs below mention jar will be empty:
"C:\Program Files\Java\jdk1.8.0_152\bin\java" -Dmaven.multiModuleProjectDirectory=$M2_HOME -Dclassworlds.conf=C:\Users\user\Downloads\apache-maven-3.5.3-bin\apache-maven-3.5.3\bin\m2.conf -Dmaven.home=C:\Users\user\Downloads\apache-maven-3.5.3-bin\apache-maven-3.5.3 -Didea.launcher.port=7534 "-Didea.launcher.bin.path=C:\Program Files (x86)\JetBrains\IntelliJ IDEA Community Edition 12.0.4\bin" -Dfile.encoding=UTF-8 -classpath "C:\Users\user\Downloads\apache-maven-3.5.3-bin\apache-maven-3.5.3\boot\plexus-classworlds-2.5.2.jar;C:\Program Files (x86)\JetBrains\IntelliJ IDEA Community Edition 12.0.4\lib\idea_rt.jar" com.intellij.rt.execution.application.AppMain org.codehaus.classworlds.Launcher --no-plugin-registry --fail-fast --strict-checksums --update-snapshots -DskipTests=true package
[WARNING] Command line option -npr is deprecated and will be removed in future Maven versions.
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for app.metatron.discovery:discovery-frontend:jar:3.0.6
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ app.metatron.discovery:metatron-discovery:3.0.6, C:\Users\user\Downloads\metatron-discovery-3.0.6\pom.xml, line 98, column 21
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO]
[INFO] -------------< app.metatron.discovery:discovery-frontend >--------------
[INFO] Building discovery-frontend 3.0.6
[INFO] --------------------------------[ jar ]---------------------------------
[INFO]
[INFO] --- frontend-maven-plugin:1.4:install-node-and-npm (install node and npm) @ discovery-frontend ---
[INFO] Node  was installed, but we need version v8.1.2
[INFO] Installing node version v8.1.2
[INFO] Copying node binary from C:\Users\user.m2\repository\com\github\eirslett\node\8.1.2\node-8.1.2-win-x64.exe to C:\Users\user\Downloads\metatron-discovery-3.0.6\discovery-frontend\node\node.exe
[INFO] Installed node locally.
[INFO] NPM 5.0.3 is already installed.
[INFO]
[INFO] --- frontend-maven-plugin:1.4:npm (npm install) @ discovery-frontend ---
[INFO] Running 'npm run prebuild' in C:\Users\user\Downloads\metatron-discovery-3.0.6\discovery-frontend
[INFO]
[INFO] --- frontend-maven-plugin:1.4:npm (npm run build) @ discovery-frontend ---
[INFO] Running 'npm run prod' in C:\Users\user\Downloads\metatron-discovery-3.0.6\discovery-frontend
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ discovery-frontend ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory C:\Users\user\Downloads\metatron-discovery-3.0.6\discovery-frontend\src\main\resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ discovery-frontend ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ discovery-frontend ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory C:\Users\user\Downloads\metatron-discovery-3.0.6\discovery-frontend\src\test\resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ discovery-frontend ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ discovery-frontend ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ discovery-frontend ---
[WARNING] JAR will be empty - no content was marked for inclusion!
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 21.996 s
[INFO] Finished at: 2018-11-28T13:51:17+11:00
[INFO] ------------------------------------------------------------------------
Process finished with exit code 0


migrated OnHoldListFragment to kotlin

Description
migrated OnHoldListFragment to kotlin from java.
Issue Resolved
Link to the issue that is resolved by this pull request goes here e.g. 'Fixes #52 '.
Checklist
Please make sure to review the following before submitting your PR:

[x] I have read the contribution guidelines.
[x] I have read the code of conduct.
[x] I have reviewed my submission in detail.

Lgtm gw 🥳


Make an Android port of ObEngine player

ObEngine Player is now a separate project in CMake making it easier to port it https://github.com/Sygmei/ObEngine/commit/b029c06dce19b0bfebf6ca912693c67b2e6682fb

Attempting to resolve...


Question: Does CAF work with GPUs?

[* ] I am not reporting a bug or asking for a new feature
[*] I am asking a general question about, e.g., the internal workings of this software, the direct use of this software, or use cases for this software, etc.
[* ] I have already searched for the answer to my question on Google and Stack Overflow

I've been using the Coarray Fortran Compiler for over a year now, and I love it.  My programs are much faster, and have the potential to be even faster with the use of teams and coarrays.  Now, my biggest bottleneck, is pure hardware.
In order for my programs to be fast enough, it's clear that I need more computing power.  I've looked into expanding a cluster, but that's probably too expensive, and won't give me enough cores.
I've been looking into the idea of using graphics cards, but I'm not completely sure whether or not CAF is capable of using GPUs.
If I expand a cluster, CAF is able to automatically make use of the extra cores.  All I have to do is indicate more images, when I run my program, and cafrun does the rest.  If I install graphics cards in my systems, will CAF automatically make use of those GPUs, in a similar way that it does with CPUs, or do I have to learn something like CUDA in order to take advantage of GPUs?
I recognize that CAF is designed to insulate the programmer from hardware inner-workings, when writing parallel programs.  Does this extend to GPUs?  Could I simply plug in some graphics cards and increase my number of images, when running my program, or is it not that simple?
I'm willing to learn CUDA, if I have to.  However, if CAF is capable of making use of GPUs without me having to learn GPU programming, that'd be great.
Thanks so much for your time.

I remember talking to some PGI/NVIDIA Fortran compiler team members at the SC conference 2018 who said they were working on a GPU implementation of Fortran parallelism syntax. But I have not checked their compilers ever since on the progress they might have made.

Thanks, shahmoradi, that's good to know.
If worse comes to worst, I'll buy a graphics card and see if there's an increase in performance.  Buying one probably won't be a waste, since it's probably the route I'll have to go, either way.  If I see no increase in performance, then I'll have to learn CUDA.
Your comment is helpful.  That fact that you're aware of it being discussed, is certainly a good sign.

First of all please note, that OpenCoarrays is just one implementation for Coarrays. It is closely related to the gfortran compiler. Its current focus is to give support for the major features (of Fortran and Coarrays) and present a stable base. OpenCoarrays is based on MPI to allow development of distributed applications. Note, there are other implementations of Coarrays (in the gfortran compiler) that support different parallelization techniQues (a shared memory approach is currently in the merge). To my knowledge there is no GPU support for Coarrays planned (in OpenCoarrays and gfortran) and you won't get any speed up by inserting a GPU in your computer from OpenCoarrays. This is the current stage of development in the OpenCoarrays library.
Please also note, (Open-)Coarrays are designed to play together with OpenACC/OpenCt, which can be compiled to use the GPU and is supported by gfortran. The approach here is to distribute work packages using OpenCoarrays and do local compute-intensive work on the GPU using OpenACC/Ct. May be you want to have look into this before learning a vendor specific parallelization approach like CUDA.

Thanks so much, vehre.  You've answered my question, and have pointed me in the right direction.
I was skeptical that I would see an increase in performance by merely plugging in a graphics card, and hoping that OpenCoarrays would automatically make use of it.  However, I wasn't sure until reading your response.
I also want to thank you for suggesting OpenACC/OpenCt over CUDA.  During my search, I ran across the name "OpenACC", but didn't know much about it, or whether it would be something that I should look into.  I had heard of CUDA, a long time ago, and was able to find a book about both CUDA and Fortran, which made me consider CUDA.
What you last mentioned about distributing work packages using OpenCoarrays and doing local compute-intensive work on the GPU, is what I had in mind with trying to use CUDA with Fortran.  So I'll definitely be looking into OpenACC.
I was able to find a book on Amazon about OpenACC, so my next step will probably be to get it.
Thanks, again, for your help.

The big difference between CUDA and OpenACC is, that you have to write the CUDA code yourself, i.e. the procedures to run on the GPU, while in OpenACC you, to my knowledge, add special comments (called directives) to Fortran code and the compiler takes care about all the nasty things. Furthermore is OpenACC not bound to specific graphic card brands like CUDA, which only works on Nvidia hardware.

Thanks, vehre, for the helpful comment.
What's most ironic is that I just finished reading about the directives that you mentioned.  It seems as if OpenACC will definitely be the way to go.  I'm all for making the process easier, and not reinventing the wheel.
Thanks for letting me know about OpenACC.

@evansste12432 for insights on mixing parallel Fortran 2018 with GPU programming, check for relevant publications by Alessandro Fanfarillo (@afanfa) on the OpenCoarrays publications page.  The "Hybrid coarrays..." paper talks about GPUs.
GPU programming, however, is mostly orthogonal to the Fortran 2018 parallel feature set so the aforementioned paper proposes a language extension (one that the Fortran committee rejected).  Fortran 2018 parallelism employs the single-program multiple data (SPMD) programming paradigm that maps most directly onto MPI or OpenSHEM or GASNet (each alternatives in OpenCoarrays but only the MPI alternative has seen any recent development or maintenance).
I believe GPU programming most commonly employs the single-instruction, multiple data (SIMD) programming paradigm, which maps most easily onto do concurrent and array statements, each of which compilers might vectorize or offload (although I don't know of any compilers that currently offload do concurrent or array statements to GPUs).
I think widely supported standards are the way to go for any code that one wants to be portable and long-lived.  Just like Fortran has made it over 60 years and the number of Fortran compilers in or near the double digits, OpenMP has lasted for over 20 years and is supported by most of the aforementioned compilers.  In particular, there has been quite a lot of exciting activity on expanding the OpenMP support in gfortran recently by @tob2.  OpenACC and CUDA are younger and are supported by a smaller number of vendors and hardware than OpenMP so I would shy away from them personally unless I had a very strong motivation for choosing OpenACC or CUDA.

@vehre I'm very hopeful that OpenCoarrays will support additional compilers.  I'm hoping we'll start by supporting  LLVM flang.  I only recently discovered that installing LLVM with the -DENABLE_PROJECTS option produces a flang installation uses gfortran as a back end: flang parses the code, then unparses it, and invokes gfortran so it should be trivial to support flang now.  This might in turn also provide support for armflang.

@evansste12432 hopefully the above answers are helpful.  I'll close this issue.  Feel free to reopen it or open a new one if we can be of further help.

rouson, your comments are very helpful.  Believe me, I couldn't agree with you more about the Fortran 2018 standard.  The standard is nothing short of brilliant.  The moment I learned about coarrays and teams, I realized that, theoretically, Fortran would allow me to write my programs in such a way that they would be fast enough.  The only real problem is getting hardware that is capable of implementing the vast parallelization.
Before reluctantly turning to GPUs, I researched CPU hardware capabilities.  I read an article about a Chinese company who built a machine which employs over ten million cores.  Also, a company called Cerebras has built a machine which uses the largest, single, silicon wafer -- about the size of a tablet.  Their philosophy is correct.  They realize how inefficient it is for manufacturers to build all of these separate processors, put them in separate machines, as nodes, and then we try to reconnect them as a cluster.  Their approach has been to build a newer architecture by placing more processors on a single wafer; making the largest microchip in history.
All of that technology is very exciting to read about.  Unfortunately, it means nothing for the average person who will never have access to it.  If I have a design which requires 400,000 cores, it wouldn't be financially feasible to build a cluster of that size.
Fortran has the right standard; allowing people to program a feasible algorithm.  Unfortunately, classical computer architecture must undergo a significant change in order for such programs to be successfully run and realized, on a practical level.
If anyone is interested, here are links to the technology that I previously mentioned.  I recognize that Cerebras has built a machine that is specialized for AI and deep learning, which falls more into the area of GPU cores.  However, their direction of proposing less interconnection between nodes, is on point.
https://www.computerworld.com/article/3085483/china-builds-world-s-fastest-supercomputer-without-u-s-chips.html
https://www.hpcwire.com/2019/08/27/cerebras-debuts-ai-supercomputer-on-a-wafer/
https://www.popularmechanics.com/technology/design/a28816626/worlds-largest-computer-chip/

@evansste12432 as long as you're checking out companies that make innovative hardware targeting AI, take a look at SambaNova.  Two U.S. Department of Energy national laboratories just announced a partnership with SambaNova to deliver systems that accelerate AI and HPC.

Thanks, @rouson, for that article.  What's most encouraging is that the article also mentions the potential use of this technology for general high-performance computing.
It seems as if most of these approaches are geared towards AI.  I'm much more interested in general HPC.  So it's nice to hear that not all of these companies are exclusively AI and deep learning.
I do believe that a standardized change in computer architecture is coming.  We'll know it's here once computer science courses routinely teach parallel programming as basic, and when basic computer diagrams show multiple processors and distributed memory.  Unfortunately, I believe that it will be several years before that ever becomes the case.  HPC is still too much of a niche topic.


-Djib.allowInsecureRegistries=true does not seems to work

Environment: Docker image:  gcr.io/cloud-builders/mvn

Jib version: 1.6.1

*Build tool: Maven

OS: Docker Container

Description of the issue:
I am trying to use the -Djib.allowInsecureRegistries=true option to my tool and I am getting an error of this type when using it :
building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

I am using it while building a sample helloworld application https://github.com/che-samples/console-java-simple
Expected behavior:
Working
Steps to reproduce:

Checkout https://github.com/che-samples/console-java-simple
docker run -v it to /builder/home
Run

    - mvn
    - compile
    - com.google.cloud.tools:jib-maven-plugin:build
    - -Duser.home=/builder/home
    - -Dimage=image-registry.openshift-image-registry.svc:5000/test/image
    - -Djib.allowInsecureRegistries=true

Log output:

Full log output

[INFO] Scanning for projects...
Downloading from central: https://repo.maven.apache.org/maven2/com/google/cloud/tools/jib-maven-plugin/maven-metadata.xml
Progress (1): 1.5 kB
Downloaded from central: https://repo.maven.apache.org/maven2/com/google/cloud/tools/jib-maven-plugin/maven-metadata.xml (1.5 kB at 2.5 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/com/google/cloud/tools/jib-maven-plugin/1.6.1/jib-maven-plugin-1.6.1.pom
Progress (1): 2.2/3.5 kB
Progress (1): 3.5 kB
[...]
[INFO] Containerizing application to image-registry.openshift-image-registry.svc:5000/tekton-pipelines/console-java-simple...
[INFO] Retrieving registry credentials for image-registry.openshift-image-registry.svc:5000...
[INFO] Getting base image gcr.io/distroless/java:8...
[INFO] Building resources layer...
[INFO] Building classes layer...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  16.607 s
[INFO] Finished at: 2019-10-17T14:02:14Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.google.cloud.tools:jib-maven-plugin:1.6.1:build (default-cli) on project console-java-simple: Build image failed: Failed to authenticate with registry image-registry.openshift-image-registry.svc:5000/tekton-pipelines/console-java-simple because: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

Hi @chmouel,
Just for a quick check. Does it work when you put <allowInsecureRegistries>true in pom.xml?
Unrelated, you probably don't need to set -Duser.home=/builder/home (even on Cloud Build). I suggest to take it out.

Off-line @chanseokoh suggested that your image registry (image-registry.openshift-image-registry.svc:5000) likely requires authentication and we don't send passwords in the clear by default.  Please try running with -DsendCredentialsOverHttp=true.

I have tested against and this time against a image registry from the docker registry image and it worked, i am not sure exactly what goes on with the openshift registry that doesn't allow to upload in there,
I am fine to close this,

I suspect something, and I would like to understand why it's failing with insecure OpenShift registry. It may not just be the fault of OpenShift, as currently Jib doesn't honor allowInsecureRegistries when talking to an auth server to get an auth token, which I suspect may well be same as openshift-image-registry.svc:5000. If you are willing to lend us some help in analyzing and diagnosing this issue, we should be able to identify the cause and fix it. Our goal is to make Jib work seamlessly. I heard this is on Tekton, so I'm very interested too. What do you think? At least if you run Jib with -X, Maven will give us a stack trace where in the code it fails to verify the server.

Yes no worries, I can help with that, I have tried again  -DsendCredentialsOverHttp=true and I am still getting the :
[ERROR] Failed to execute goal com.google.cloud.tools:jib-maven-plugin:1.7.0:build (default-cli) on project console-java-simple: Build image failed: Failed to authenticate with registry image-registry.openshift-image-registry.svc:5000/che-console-java-simple because: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target -> [Help 1]

The full debug with -X is here https://gist.github.com/chmouel/3a887ddaa0c437552b252e57a7062dab#file-debugx-txt
This is indeed with tekton.
If you have a tekton (kubectl create -f https://raw.githubusercontent.com/openshift/tektoncd-pipeline/release-v0.7.0/openshift/release/tektoncd-pipeline-v0.7.0.yaml) and a openshift (https://try.openshift.com) installed  you can easily test the task with :
https://gist.github.com/chmouel/3a887ddaa0c437552b252e57a7062dab
which would push to the internal openshfit registry

I can reproduce also this error @chmouel

@chmouel @cmoulliard this should work now with Jib 1.8.0.
Unrelated, but you probably won't need -Duser.home=/builder/home as I said before.


[BUG] Editable Installation with src-layout Fails Due to Hidden '.venv'

setuptools version
setuptools==65.5.0
Python version
Python 3.11
OS
macOS
Additional environment information
a venv name '.venv'
pip 24.2
Description
When using pip install -e . with a src-layout, an entry is typically added to sys.path via a file named __editable__.pakagename.pth. However, the loading of this .pth file fails if the virtual environment is hidden, which is the case for the default .venv name used by many tools.
To be precise, cpython/Lib/site.py uses os.lstat on the .pth file and skips it.
It is likely the same on other Unix-like systems.
Expected behavior
Since src-layout and editable installs are frequently used, they should be supported regardless of the virtual environment's naming convention or visibility status.
How to Reproduce
create a venv with a name starting by a dot, typically .venv
use a src-layout
python3 -v -m packagename
Output
Skipping hidden .pth file: '/project_folder/.venv/lib/python3.11/site-packages/__editable__.packagename.pth'

Please also note that users are advised to try the last version available of setuptools before reporting problems. Setuptools development model only releases monotonically increasing versions, so if any change is necessary to solve the problem it is only done on top of the main branch.

I am not sure why you are getting this message. The file that setuptools itself produces is not a hidden file itself, it does not start with a . and we do not add any special attribute to it when creating the wheel used by pip, so there is nothing we can really change about it.
The problem description also mentions "likely the same on other Unix-like systems", but I cannot reproduce this in a different POSIX environment:
# docker run --rm -it python:3.11-bookworm /bin/bash
mkdir -p /tmp/proj/src
cd /tmp/proj

cat <<EOF > pyproject.toml
[build-system]
requires = ["setuptools==73.0.1"]
build-backend = "setuptools.build_meta"
EOF

cat <<EOF > src/pkg.py
print("hello world")
EOF

python -m venv .venv
.venv/bin/python -m pip install -U "pip==24.2"
.venv/bin/python -m pip install -e .
# ...
# Successfully built pkg
# Installing collected packages: pkg
# Successfully installed pkg-0.0.0

ls -la .venv/lib/python3.11/site-packages/__editable__.pkg-0.0.0.pth
# -rw-r--r-- 1 root root 14 Aug 26 10:35 .venv/lib/python3.11/site-packages/__editable__.pkg-0.0.0.pth

.venv/bin/python -m pkg
# hello world

In Linux I cannot see any Skipping hidden .pth file message.
Based on this code (from  https://github.com/python/cpython/commit/21ab20b3a794ab5f64963706088af21574068f4c), we can also check inside of the container for any attributes: https://github.com/python/cpython/blob/v3.11.9/Lib/site.py#L172-L180
# .venv/bin/python
Python 3.11.9 (main, Apr  3 2024, 23:59:48) [GCC 12.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import os, stat
>>> st = os.lstat('.venv/lib/python3.11/site-packages/__editable__.pkg-0.0.0.pth')
>>> st
os.stat_result(st_mode=33188, st_ino=200282, st_dev=230, st_nlink=1, st_uid=0, st_gid=0, st_size=14, st_atime=1724668626, st_mtime=1724668530, st_ctime=1724668530)
>>> getattr(st, 'st_flags', 0) & stat.UF_HIDDEN
0
>>> getattr(st, 'st_file_attributes', 0) & stat.FILE_ATTRIBUTE_HIDDEN
0

That said, this is the furthest I can go with this investigation, because I don't have access to a macOS machine. If anyone would like to take the investigation further and find out the origin of the problem that would be very nice, but for now the problem sounds very weird.
There is nothing in the setuptools code adding any kind of flag or file attribute to make the file hidden.

Your comment leads me to a specific macOS stuff. My folder is under Documents and this one is synchronized with iCloud. The side effect of that is that the hidden flag is set by that machinery. So now we know it’s not as wide as Unix-like but narrowed to macOS with iCloud sync. A better situation as fewer people are concerned, but still annoying.

To reproduce the macOS iCloud behavior, I have setup a test folder with both dot and not dot folder and move that test folder under Documents that is synched: see the result on hidden flag.
find test_hidden -exec ls -ldO \{\} \;
drwxr-xr-x  5 franck  staff  - 160 26 aoû 16:30 test_hidden
drwxr-xr-x  3 franck  staff  - 96 26 aoû 16:16 test_hidden/.dot_folder
drwxr-xr-x  3 franck  staff  - 96 26 aoû 16:16 test_hidden/.dot_folder/inner_folder
-rw-r--r--  1 franck  staff  - 0 26 aoû 14:36 test_hidden/.dot_folder/inner_folder/a_file
-rw-r--r--  1 franck  staff  - 618 26 aoû 14:52 test_hidden/pyproject.toml
drwxr-xr-x  3 franck  staff  - 96 26 aoû 16:16 test_hidden/nodot_folder
drwxr-xr-x  3 franck  staff  - 96 26 aoû 16:16 test_hidden/nodot_folder/inner_folder
-rw-r--r--  1 franck  staff  - 0 26 aoû 14:37 test_hidden/nodot_folder/inner_folder/a_file

mv test_hidden Documents
find Documents/test_hidden -exec ls -ldO \{\} \;
drwxr-xr-x  5 franck  staff  - 160 26 aoû 16:30 Documents/test_hidden
drwxr-xr-x  3 franck  staff  hidden 96 26 aoû 16:30 Documents/test_hidden/.dot_folder
drwxr-xr-x  3 franck  staff  hidden 96 26 aoû 16:30 Documents/test_hidden/.dot_folder/inner_folder
-rw-r--r--  1 franck  staff  hidden 0 26 aoû 14:36 Documents/test_hidden/.dot_folder/inner_folder/a_file
-rw-r--r--  1 franck  staff  - 618 26 aoû 14:52 Documents/test_hidden/pyproject.toml
drwxr-xr-x  3 franck  staff  - 96 26 aoû 16:30 Documents/test_hidden/nodot_folder
drwxr-xr-x  3 franck  staff  - 96 26 aoû 16:30 Documents/test_hidden/nodot_folder/inner_folder
-rw-r--r--  1 franck  staff  - 0 26 aoû 14:37 Documents/test_hidden/nodot_folder/inner_folder/a_file

With that in mind, it is a macOS or python subject more than a setuptools one. I guess that there is other contexts where the hidden flag might be set and trigger the same trouble. If setuptools might help either on the hidden python policy for pth file, or to warn users. That was quite difficult to isolate.

If setuptools might help either on the hidden python policy for pth file, or to warn users. That was quite difficult to isolate.

I am afraid setuptools cannot help with that, because the development of Python happens very separated from setuptools and vice versa... Python policy for .pth files is something that has to be discussed with the Python core devs either in https://discuss.python.org or via an issue/discussion in the https://github.com/python/cpython repository.
We are not in a very good position to warn the users either, because setuptools only builds a wheel file and does not know where it is going to be installed... That information is under the control of installers like pip. Moreover, installers usually hide all output from setuptools, even warnings. Users don't see any of the messages we have in editable installations. For example I don't think any user ever saw the following warnings.warn message for non-src-layout editable installations: https://github.com/pypa/setuptools/blob/v73.0.1/setuptools/command/editable_wheel.py#L535; or the following logging.warning message for src-layouts: https://github.com/pypa/setuptools/blob/v73.0.1/setuptools/command/editable_wheel.py#L399-L403.

Thank you very much @fkhn for the investigation and finding out what is the root of the problem.
Since we identified that there is not much setuptools can do for this case (everything seems to be outside of the control of setuptools, probably the best next step would be asking for the advice of the Python core devs about this situation.
The checks for hidden files seem to be a new "feature" in Python (merged at the beginning of this year): https://github.com/python/cpython/pull/113660.
I am not sure if the core developers where already notified of this edge case where it is not the user (legitimate or malicious) that marks the .pth file as hidden, but iCloud itself (and not because of the name of the .pth file, but because of the name of a parent folder -- which is even worse). It may be worth discussing with them.
It is also important to point out 2 things:

The behaviour that you observed does not seem to be restricted to editable installs or more specifically a setuptools editable installs. ANY .pth file on a .venv environment would be affected and skipped.
.pth files are currently at the core of any implementation of editable installs. In the current state of Python's packaging ecosystem, it cannot be done consistently with them. So if there is some external factor making Python skip .venv/**/*.pth files, there is no way to implement editable installs.

I will go ahead and close this issue because I don't think we can do anything in setuptools code base to get around this problem.

Thank you very much @abravalheri for your reactivity and constructive comments that help to discover the root cause. I have appreciated your pointers to cpython. I am fine with the closure of the current issue. For your information I have added a comment on cpython/issues/113659 to make the link to the current discussion.


Fat Flask container serving both the API and UI static resources deploys and works E2E

TLDR

Bundled the API and UI into one fat container deployed to ACA
The UI static pages are built in a first Dockerfile and copied over to the final Python Flask container
Flask serves static UI resources

Details

Revert "Deploying web frontend to ACA"
Revert "Renamed aca module variable to apiContainerApp in preparation for web module"
Python app can now also serve UI static files
Dockerfiles for ui and web+ui
Commented Keyvault infra for now since we don't use it
Using fat Dockerfile with web+api

LGTM!! Thank you!


Quickfix: Toolbar fixed on mobile not overlaying anymore

Also reduced font size of md-toolbar tools

Codecov Report

Merging #568 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #568   +/-   ##
=======================================
  Coverage   98.58%   98.58%
=======================================
  Files         239      239
  Lines        3749     3749
=======================================
  Hits         3696     3696
  Misses         53       53

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0f6d76a...7d06019. Read the comment docs.


Failed to launch turtlebot telex using a launch file

ISSUE TEMPLATE ver. 0.4.0

Which TurtleBot3 platform do you use?

[ ] Burger
[ ] Waffle
[ ] Waffle Pi
Trying to run it on Mac OS

Which ROS is working with TurtleBot3?

[ ] ROS 1 Kinetic Kame
[ ] ROS 1 Melodic Morenia
[ ] ROS 1 Noetic Ninjemys
[ ] ROS 2 Dashing Diademata
[ ] ROS 2 Eloquent Elusor
[x ] ROS 2 Foxy Fitzroy
[ ] etc (Please specify your ROS Version here)

Which SBC(Single Board Computer) is working on TurtleBot3?

[ ] Intel Joule 570x
[ ] Raspberry Pi 3B+
[ ] Raspberry Pi 4
[ ] etc (Please specify your SBC here)

On my Mac OS

Which OS you installed on SBC?

[ ] Raspbian distributed by ROBOTIS
[ ] Ubuntu MATE (16.04/18.04/20.04)
[ ] Ubuntu preinstalled server (18.04/20.04)
[ ] etc (Please specify your OS here)

Which OS you installed on Remote PC?

[ ] Ubuntu 16.04 LTS (Xenial Xerus)
[ ] Ubuntu 18.04 LTS (Bionic Beaver)
[ ] Ubuntu 20.04 LTS (Focal Fossa)
[ ] Windows 10
[x ] MAC OS X (Specify version)
[ ] etc (Please specify your OS here)

Specify the software and firmware version(Can be found from Bringup messages)

Software version: [x.x.x]
Firmware version: [x.x.x]

Specify the commands or instructions to reproduce the issue.
ros2 launch <path-to-the-launch-file

Copy and Paste the error messages on terminal.

INFO] [launch]: All log files can be found below /Users/vidur.vij/.ros/log/2021-03-22-03-27-28-647794-vidur.vij-0SZM-78566
[INFO] [launch]: Default logging verbosity is set to INFO
[INFO] [teleop_keyboard-1]: process started with pid [78568]
[teleop_keyboard-1] Traceback (most recent call last):
[teleop_keyboard-1]   File "/Users/vidur.vij/dev_ws/install/turtlebot3_teleop/lib/turtlebot3_teleop/teleop_keyboard", line 33, in
[teleop_keyboard-1]     sys.exit(load_entry_point('turtlebot3-teleop==2.1.1', 'console_scripts', 'teleop_keyboard')())
[teleop_keyboard-1]   File "/Users/vidur.vij/dev_ws/install/turtlebot3_teleop/lib/python3.8/site-packages/turtlebot3_teleop/script/teleop_keyboard.py", line 142, in main
[teleop_keyboard-1]     settings = termios.tcgetattr(sys.stdin)
[teleop_keyboard-1] termios.error: (102, 'Operation not supported on socket')
[ERROR] [teleop_keyboard-1]: process has died [pid 78568, exit code 1, cmd '/Users/vidur.vij/dev_ws/install/turtlebot3_teleop/lib/turtlebot3_teleop/teleop_keyboard --ros-args -r __node:=teleop_keyboard'].

Please describe the issue in detail.
Modified the package to add a launch file in the package. The launch file can be found here. It produces the error pasted above.

`
<set_env name="TURTLEBOT3_MODEL" value="waffle"/>

`

@vidurvij-Unity
I cannot find the modified launch file.
Could you update your posting?

@vidurvij-Unity
I cannot find the modified launch file.
Could you update your posting?

<set_env name="TURTLEBOT3_MODEL" value="waffle"/>

`
<set_env name="TURTLEBOT3_MODEL" value="waffle"/>

`

<launch>
  <set_env name="TURTLEBOT3_MODEL" value="waffle"/>

  <node pkg="turtlebot3_teleop" exec="teleop_keyboard" name="teleop_keyboard"  output="screen">
  </node>

</launch>

Please see below manual for creating the XML style launch file.
You should use the param tag in order to define a parameter.
https://design.ros2.org/articles/roslaunch_xml.html

I don't get how this is the solution to the above problem. I need to set an environment variable not a parameter for the teleop_keyboard. Moreover python seems to be giving a socket error.

I think there are more useful resources from ROS Answers.
I'd recommend to search for a similar case you have.
Thanks.
https://answers.ros.org/questions/

This issue will be closed due to prolonged inactivity.


Move docstring for xr.set_options to numpy style

While trying to figure out which types are allowed in  #5678 I felt that the set_options docstring was rather hard to read. Moving it to typical numpy docstring style helped at least for me.

Very nice! Thanks @Illviljan . As before re whatsnew!


ci: Add build tests for RNTester

Summary
Add 4 new jobs to CI in order to test RNTester builds on both Android and iOS using Hermes and JSC
Closes #32676
Changelog
[General] [Added] - Add build tests for RNTester to CircleCI
Test Plan
Make sure builds are working as expected and CI is green

This is a great change! Thank you so much for adding it, I'm wondering if there's a way we can leverage the same logic used by our test-manual-e2e.sh script? I realize it's nice to have these steps in the CircleCI job though. I bring it up only because if we needed to change something here, it'd be good that both the test-manual-e2e script is also updated. But this might be an pre-mature concern -- I don't think it should block this!
Thank you again @gabrieldonadel!

Yeah I agree @lunaleaps, trying to use test-manual-e2e was actually my first attempt but there are some key differences in the way we interact with the test-manual-e2e.sh script, especially with iOS.
The main thing is that when selecting iOS on test-manual-e2e.sh we don't actually build the app, we just open the RNTesterPods.xcworkspace file and the user has to manually select the desired simulator and build it. Maybe we should change that?
There is also the fact that on Android the script uses install (e.g ./gradlew :packages:rn-tester:android:app:installHermesDebug) and on the CI are using assemble (e.g. ./gradlew :packages:rn-tester:android:app:assembleJscDebug), the former tries to install the app in the emulator and will fail if no emulators are available

The main thing is that when selecting iOS on test-manual-e2e.sh we don't actually build the app, we just open the RNTesterPods.xcworkspace file and the user has to manually select the desired simulator and build it. Maybe we should change that?

Oh yes that's a good point. Yea I can see that'd be worthy to change but I don't think it's high priority; feel free to create an issue for it in the project board with your context. Again, thank you for your help!


Updates to Version Tagging

Hello,
I wanted to give an update on a tagging change that will take place on the next release, scheduled at some point in May. Without realizing that Ansible Galaxy needs version numbers in the Semantic format that excludes the preceding “v”, for example 1.2.1 vs v1.2., we have been using tags with the preceding v. This has caused our galaxy space to not update with our latest releases.
The plan going forward we plan to adjust the version number formatting on the first release for each repo in May. Please make note that if you are relying on release tags to keep up with latest versions, the numbering format will change. The cadence of the version numbers will continue and progress through as they have been, however the preceding “v” will be dropped from the tag.
George

@georgenalen @uk-bolly When will the new version land? :-)

@Thulium-Drake
We are hoping this week, unfortunately other work has taken priority.
This will be mainly linting, few fixes incorporated so not a major release.
Now CIS has released new versions, we do plan to release the new content over the coming weeks.
Thanks UK-bolly

Apologies for the delay, there has been a lot of moving parts to align. We are hoping we are now alot closer to where we want to be across all of the repositories.
The latest release should now be in dev, aiming to move to main in the next couple of weeks.
Thank you for your continued feedback and support.
uk-bolly


Give 'www-data' access to /var/lib/php5

from pull request 3

pulled in merge request by @smeier00


Ionic 2 - Slow DOM manipulation

First, I would like to thank you guys for the great job you have done with this plugin, no doubts very useful for cordova developers.
My problem:
The plugin is taking too long every time a new Element is added to the page, for example this simple example I'm sharing, where I have 3 Tabs (Home, About and Contact).

Home: The Map (working perfectly).
About: I have a list of 100 Items, if you go to this Tab, you can't scroll the list at all, but if you destroy the map before going to that page (Clicking the button in the Home page), the list will scroll fine.
Contact: Just another page.

My question:
Is it necessary to destroy The Map every time I'm going to another page?

I could live with this, but will be better if I don't have to re-create The Map every time I'm going to this page.

Plugin Version: 2.0.0-beta2-20170625-1805
Testing Device:
Samsung SM-C115
Android Version: 4.4.2

cordova plugin list
cordova-plugin-console 1.0.5 "Console"
cordova-plugin-device 1.1.4 "Device"
cordova-plugin-googlemaps 2.0.0-beta2-20170625-1805 "cordova-plugin-googlemaps"
cordova-plugin-splashscreen 4.0.3 "Splashscreen"
cordova-plugin-statusbar 2.2.2 "StatusBar"
cordova-plugin-whitelist 1.3.1 "Whitelist"
ionic-plugin-keyboard 2.2.1 "Keyboard"

ionic info
global packages:
@ionic/cli-utils : 1.4.0
Cordova CLI      : 6.5.0
Ionic CLI        : 3.4.0

local packages:
@ionic/app-scripts              : 1.3.12
@ionic/cli-plugin-cordova       : 1.4.0
@ionic/cli-plugin-ionic-angular : 1.3.1
Cordova Platforms               : android 6.1.2
Ionic Framework                 : ionic-angular 3.5.0
System:
Node       : v6.9.4
OS         : Windows 10
Xcode      : not installed
ios-deploy : not installed
ios-sim    : not installed
npm        : 4.1.2
I have shared the code with you in bitbucket.
Thanks in advance.

Thank you for reporting. Could you tell me your repository name?

Thanks for look into this. The name of the repository is gmaps. Here is the link:
https://bitbucket.org/walfridosp/gmaps

I have the same issue. Destroying the map works well and I don't mind doing it.
The real problem for me is that I have some buttons on the same page as the map (in the header and over the map as well), and the click response is slow (1-2sec).

@antonie92190 Please share your project, and if you take a video, that would be nice for me.

@wf9a5m75 Unfortunately I cannot share my project.
I know it might help you understand the issue better but that is not an option, sorry.
However, I tried to reproduce the issue with a brand new ionic project and I cannot reproduce it.
I guess the map slows the DOM only when the app has already lot of elements to display.
I shared a video below:
map.zip
You can see there is a slow feeling when I switch between the buttons at the top.
This latency also exists when I click buttons in the header and when I click on any bottom tab.
For the purpose of the video, I removed all logic behind the buttons' click, just to make sure it is actually a DOM issue.

OK. Thanks for sharing the video. I haven't checked it yet, but I understand you guys situation.
The reason of this is the plugin has to know all HTML element positions and Z-indexes.
That's why.
Especially, the ionic framework uses lots of HTML elements. So I can imagine the situation.
I will check the @walfridosp's project later.

I can give you another info.
On the video you can see that the first page is a list.
As Ionic is doing a lot of caching, even when I go to the map, the DOM of the list still exists.
Maybe the map should only consider the visible DOM (and not what is cached).
Right now, the plugin seems to also consider the DOM of my list, even when I don't see it.
=> When I empty my list, the map latency issue is much better.

@walfridosp Could you tell me how to build your project?

@wf9a5m75 I added the steps in the README. Let me know if you need anything else.

@walfridosp Thank you for the update.
I confirmed your issue. The list page scrolling is very slow.
But it seems the polyfills.js takes long time.

I noticed one thing.
The list page on Android 4.4 device is really slow, but running on Android 6.0.1 device is faster.

I haven't try it in other android device, in iOS is also faster, anyway I would like to support that version of android and above.
I was wondering is it really necessary for the plugin to set a z-index for each element?, maybe adding it to the 'page' is enough, just an idea

@wf9a5m75 I did not have this issue with the 1.4.1 version of your plugin, maybe you can check what is different about how you handle z-index since then?

I was wondering is it really necessary for the plugin to set a z-index for each element?, maybe adding it to the 'page' is enough, just an idea

Yes, it is really necessary.
For example, when you show up a popup dialog on the map, then tap on the dialog, the plugin has to  detect the tap is for HTML or map.

@antoine92190 The version 1.4.1 monitors only the child elements under the map div. The version 2.0 monitors all HTML elements.

Right, I got that from your last comment.
But can't you do anything about non visible HTML that ionic is caching?

I'm testing about that.

I updated the plugin code. Please try to reinstall the plugin.
Actually I haven't tested it on Android 4.4 because I don't have the device  right now, but it should be fine.

That's great!!! will test it right now and will let you know. Thanks!

@wf9a5m75 I have tested it in Android 4.4 and its working smoothly now, no need to destroy The Map, I really appreciate the great work your are doing. Thanks

Sounds good

Will keep testing but so far so good. You can close the issue. Thanks again

@antoine92190 How about you?

I just tested, it is much smother now! Thanks a lot!
However, when I click on the map, the map disappears :sweat_smile:
It becomes blank and when I click again, the map reappears...
Can you also experience that?

@antoine92190 I'm not presenting that issue.

@antoine92190 Thanks for the update. Actually I fixed it after posting my previous comment.
The issue causes by ionic

 element.
The reason of @walfridosp does not face this issue is he might insert CSS with this line.
ion-app._gmaps_cdv_ .nav-decor{
  background-color: transparent!important;
  display:none!important;
}

@antoine92190  I already fixed the plugin 2.0.0-beta2-20170705-1400.
Please reinstall the plugin. The issue should be gone.

Yes, that's part of my CSS

I also have those lines in my CSS.
But I still have the issue with your last update.
As the map become white on clicks, I'm not sure that it is related to those CSS lines.
I uploaded a video below.
map.zip

Do you know what may cause that?
If not, I will try to remove some HTML elements until I do not have the issue anymore.

Could you make an simple project that reproduce your issue, and share it with me?

ionic-map.zip
Installation:

npm install
ionic cordova platform add ios
open the xcodeproj file in platforms/ios

Click quickly and several times on the map, the issue should appear.

Thanks. If you share it on git repository (like github or bitbucket) next time, I appreciate for that.

Sure, I'll share it on github next time

@antoine92190 I'm not able to reproduce this issue in android, with the shared project.

Oh, I see. I reproduced @antoine92190 's issue on the iOS device.

Yes, I guessed it was specific to iOS. Quiet annoying as you can see :smile:

I finally figured out. It is my mistake. Please reinstall the plugin.

All good, you're awesome!

Sounds good :)

Since the last updates, the DOM became slow again.
@walfridosp Do you also experience the issue in your project with version 2.0.0-beta2-20170716-1535 or over?

Please show me the evidence.

Can two videos, one before and one after some of your updates might help you?

Not just videos, and also chrome dev tools are apparently.
By the way, which one is preferred, faster but not perfect (such as can not click some elements for some reasons), or kind of slow but you can click all HTML elements?

As the issue seems more noticeable on iOS, I cannot use chrome dev tools.
But I guess I can use safari.
What section of the safari debugging tool would you need to see?
Considering my specific use of this plugin, the faster is better.
I did not have any problem to click on any HTML elements with previous versions, and the slowness is impacting the user experience a lot.

I did not have any problem to click on any HTML elements with previous versions

Ok, you can stay at 2.0.0-beta2-20170716-1535. But other people have problem. I can not choose it.

What section of the safari debugging tool would you need to see?

Please take screen picture of the timing section.

You can find two folders:

Fast DOM with version 2.0.0-beta2-20170716-1535
Slow DOM with version 2.0.0-beta2-20170717-1045

I hope you can see what you need on the screenshots, if not please let me know.
fast - 20170716-1535.zip
slow - 20170717-1045.zip

Thank you for taking video, but I'm really busy.
I hope you inspect more deeply by yourself.

Open your text editor (such as ATOM)
open the file "platforms/ios/platform_www/plugins/cordova-plugin-googlemaps/www/googlemaps-cdv-plugin.js" for example
modify the code
Executes$> cordova prepare command. This copies the plugin files to platform/ios/www/
Run your app.

I will try my best, but unfortunately I am not an experienced developer such as yourself.
If you need me to build an ionic app, no problem. Other than that...
But no harm in trying :smile:

Try the version 2.0.0-beta2-20170718-1155. You should feel good.

Unfortunately, it is not better.
I could find that everything works well until 5dcd3f2.
Is there any other info I can give you that might help?

Please share your REAL project files. Otherwise, there is nothing I can help you.

The 2.0.0-beta2-20170718-1155 stops the DOM parsing when the map is not displayed.
It means the plugin does not execute anything. Only checking the map divs are visible or invisible.

Sorry but I cannot share my real project files.
It is a company core business and I cannot afford to share it to anyone, even though I trust you.
Plus, I am not the only one to decide about that. I hope you understand.
I can try and reproduce my issue in a new project and share it with you.
As you can see on the video, I have some interactions with the DOM even when the map is visible.
I guess the fix helps with the original issue of walfridosp.
But not when the DOM is visible at the same time as the map.

(Btw, I bought you some beers for all your help :wink:)

I understand your situation, but I can not help you anymore at this time.
I can not go back to the old version, because it's going to be much trouble for me.
You need to choose:

stay at old version
debug the issue by your self
make a project that reproduce your issue 100%
give up this plugin

I think you choose 3), so let me know if you create it.

By the way, thank you for offering some beers :beers:

Sure, I'll try 3) and let your know.

@wf9a5m75 @antoine92190 Hi guys, I haven't test with the latest version but will check tomorrow and will let you know how is it going for android and iOS. Thanks

You can try this: https://github.com/antoine92190/ionic-map
The app will open on a list with lots of elements.
When you go to Home and click on the segment buttons, you will be able to feel the issue.
Try removing the map and feel the difference.

Thank you for the updating your repo.
Well, I tested your demo app, but I don't feel the app that the maps plugin does not contain is very smooth.
with the google maps plugin

google maps plugin**

I didn't feel so much different with or without the google maps plugin.
Both are heavy.
without the google maps

Yes I made the app heavy on purpose so you can see the difference better.
The list is just there to emphasise the issue, but what I'm trying to show you is not the feeling with the list, but the feeling with the buttons above the map "I - am - slow".
You should definitely see a difference there.

As you said, the feeling with the list is the same with or without the plugin as you already fixed the issue when not map is not visible.

I tried to improve the DOM parsing speed up last night until 2:30am, but omitting the process causes another apps are affected. (Your's one is simple)

Is it maybe possible to add an option where we could choose to inspect all HTML or not?
In my case, I could not see any drawback up to 5dcd3f2.
My usage of the map is simple, but I guess it is the usage of lots of people.
=> Display a map, add/remove some markers dynamically.
It's a pity that we should sacrifice general performance of the app to fix issues that lots of people will not have anyway.

As you can see on my real project, I have quiet a few HTML elements on the map.
I can click on the bottom strip, scroll horizontally to see other strips, close them, etc.
I had no problem whatsoever to click on any of those, and everything was super smooth.

My usage of the map is simple, but I guess it is the usage of lots of people.

Do you understand what case is simple and what case is difficult?

I am not sure what you mean?

I asked do you understand why this plugin need to parse all HTML elements even DOM depth (z-index, and order of anteroposterior relationship of each elements).
And if you understand the reason, can you establish the most people use this plugin for the simple case?
At least, using the Ionic framework, it's already complicated (but even still simple), but displaying alert dialog of ionic, it's already complicated.
But the most of users of this plugin do not read the documents deeply, and the people who read the internal code are really rare.
So I don't believe the most of developers use this plugin is for simple cases, and I can not accept giving an option.

At least, I understand your point. I'm still working. Please stay at the old version 2.0.0-beta2-20170716-1535 if you don't have any problem.

Ok I understand and I get your point.
I wish I could help debugging the issue, but unfortunately it is beyond my competence.
I'll stay with the old version for now as it is stable for my case.

Sorry, I was too strong words. But I recognized your issue, and I have been working on for it. Please wait for a while.

Fixed. Please reinstall the plugin 2.0.0-beta2-20170719-1400

Perfect :ok_hand:
Once again, thank you so much.


#3371 - Merge ring bond count, degree and atomic mass atom properties

How the feature works? / How did you fix the issue?
(Screenshots, videos, or GIFs, if applicable)
Check list

[ ] unit-tests written
[ ] e2e-tests written
[x] documentation updated
[x] PR name follows the pattern #1234 – issue name
[x] branch name doesn't contain '#'
[x] PR is linked with the issue
[x] base branch (master or release/xx) is correct
[x] task status changed to "Code review"
[x] reviewers are notified about the pull request

The "H count" indicator in the "Query specific" section was increased only to 8, but it needs to be increased to 9 (as specified in the Solution section)


Adding connection kwargs to SQL Datasets engine creation

Description
We use SQLQueryDataSet and SQLTableDataSet to load data from databases. Sometimes we need to pass some args to the underlying engine at creation time.
Context
We want to use duckdb to load some parquet data from s3 using the SQLQueryDataSet.  However, we need to pass some connect_args to the sqlalchemy engine, so it can point to the right s3 with the right config. Currently, only the connection url is passed to the create_engine

This could be also valuable when doing multiple pipeline runs. For example, in a web service scenarios, a user will probably need to configure among other the connection pooling.
Possible Implementation
Adding an args entry to the credentials, and passing this args as a kwargs to the create_engine.
Knowing that the connection object is a singleton, that is unique to the connection uri, introducing a connection args raise some questions about what we should consider as a condition of a connection unicity. Is it the connection uri or the connection uri + connection args ?

Hi @takikadiri, thanks for bringing this to our attention. For reference, here's the code:
https://github.com/kedro-org/kedro-plugins/blob/94019fd6e724af9cbacfc7b7fb9678e897a435d2/kedro-datasets/kedro_datasets/pandas/sql_dataset.py#L493C1-L494
And here's the relevant sqlalchemy docs https://docs.sqlalchemy.org/en/20/core/engines.html#use-the-connect-args-dictionary-parameter

@takikadiri is this solved by https://github.com/kedro-org/kedro-plugins/pull/564/files#diff-de532a447f03c94163b260b67c40673ddf58d8b23a038cb09669c0931c549a0f already?

@noklam yes this is exactly what i needed 😄 thank you for bringing this to my attention and thanks @mjspier for this contribution.
I didn't test it yet, but it looks good for me. We can close this issue


Middleware called repeatedly

I have one middleware class with three methods. Two off these are app middleware and the third is route middleware. The start and end of each is being logged and a single resource request is generating the following log result:
[2016-03-15 16:35:07] slim-app.DEBUG: Start authenticate [] {"uid":"373b0da"}
[2016-03-15 16:35:07] slim-app.DEBUG: Start authApp [] {"uid":"373b0da"}
[2016-03-15 16:35:07] slim-app.DEBUG: Start authRoute [] {"uid":"373b0da"}
[2016-03-15 16:35:07] slim-app.DEBUG: End authApp [] {"uid":"373b0da"}
[2016-03-15 16:35:07] slim-app.DEBUG: End authenticate [] {"uid":"373b0da"}
[2016-03-15 16:35:07] slim-app.DEBUG: Start authenticate [] {"uid":"1aa31cb"}
[2016-03-15 16:35:07] slim-app.DEBUG: Start authApp [] {"uid":"1aa31cb"}
[2016-03-15 16:35:07] slim-app.DEBUG: End authenticate [] {"uid":"1aa31cb"}

In this particular instance authRoute calls return $response prior to next(..), which is why there's no "End authRoute" but the last three entries occur even when next(..) is called before return. Note the change in "uid".
Is this expected behaviour? Although I'm getting the results I expect it does concern me that some of the code is being called twice.
The second time around it is either skipping the routes or not matching any routes.

I've discovered why it's happening. I have two route groups. If I remove an entire group the repetition disappears. I suspect when I add more groups the repetitions will increase accordingly.
So it appears the entire middleware process is called for each route group. Is that what it is meant to do?

I'm closing this as it's stopped happening. Unfortunately I have no idea what's changed as I don't believe I did anything in particular other than observe it. Then, as they say...

We'd need code sample to replicate and understand I think.


order form confirmation message styling

mock parity, then warning needs to be in red. see mocks

changed - closing


Added register access functions

Ability to observe CPU registers during execution, and to control their initial states.

I've added register access functions because they are useful here:
https://github.com/amb5l/mos6502-trace


The results in the paper cannot be reproduced

Thank you for sharing your code！When I reproduced BUDDY's results using the parameter Settings provided, I got a lower result than reported in the paper. There is a 3%-5% decline in almost every dataset. Whether some additional setup is required?
Sincerely

So do I.

Hi both, this is a result of us losing access to the real hyperparameters when Elon Musk took over at Twitter and lacking the resources to rerun the same hyperparamerter sweeps again. I've updated some of the run instructions so that the OGB results should be exactly reproducible.


[proxima-tools] #141 fix flaky test

cc @LesTR
The problem was that when timestamp was generated at millisecond 998 or 999 it would fail.

This closes O2-Czech-Republic#141


Add callback on notification click

Lots of help from https://gist.github.com/Devligue/8dd974ecabf79508a5ec741d88099e77 for this, and various MSDN docs.

Creates minor issue #7


Data History | Uploaded files are not populating data source field

Uploaded filed are not populating the data source field in the Data History.
STR
Log onto Meridian
Upload kml, csv and geojsn test files
***Verify in http://localhost:9200/_plugin/head/ data source field is populated with "upload"
Go to Data History
RESULTS - Source field is blank.
EXPECTED RESULTS - probably should display what is populated in elasticsearch.

FAILED on local branch

Verified and this works on branch.  Passing and merging in.

Passed in develop


[python] Use 32-bit-friendly default shape for ingest

Issue and/or context: As discussed this week and last week. The room-for-growth is good. Two billion room-for-growth in each dimension is a quite roomy default, and works better for R interop.
Changes: The default domain in Python is room for plenty of growth after creation. Here we retain that -- still plenty of room for growth -- just 32-bit friendly for better ability for R code to read Python-created SOMA data.
Notes for Reviewer:  This is a non-breaking change.

Codecov Report
Patch coverage: 100.00% and project coverage change: +27.63 :tada:

Comparison is base (58f528c) 63.75% compared to head (019ba8a) 91.39%.

:exclamation: Current head 019ba8a differs from pull request most recent head f32e95e. Consider uploading reports for the commit f32e95e to get more accurate results

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
Additional details and impacted files
@@             Coverage Diff             @@
##             main    #1440       +/-   ##
===========================================
+ Coverage   63.75%   91.39%   +27.63%
===========================================
  Files         103       30       -73
  Lines        8189     2486     -5703
===========================================
- Hits         5221     2272     -2949
+ Misses       2968      214     -2754

Flag
Coverage Δ

python
91.39% <100.00%> (-0.01%)
:arrow_down:

r
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

apis/python/src/tiledbsoma/_common_nd_array.py
97.82% <ø> (ø)

apis/python/src/tiledbsoma/_sparse_nd_array.py
91.08% <100.00%> (-0.09%)
:arrow_down:

... and 73 files with indirect coverage changes

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

Other related issues to be proposed by @mojaveazure , as we discussed today.
I'm happy to wait on merging this PR until then, if folks prefer.

@pablo-gar two points about passing user-specified shape all the way from top level (see also #1445):
(1) I want to do that on a separate PR -- not this one
(2) You point to a diff for passing the desired shape to a single array. But tiledbsoma.io does not deal with single arrays -- it deals with all the arrays in an experiment, and we would need to offer specification for different shapes for all of them. Here for example is pbmc3k_processed:
pbmc3k_processed/obs
pbmc3k_processed/ms/RNA/var
pbmc3k_processed/ms/RNA/X/data
pbmc3k_processed/ms/RNA/obsm/X_umap
pbmc3k_processed/ms/RNA/obsm/X_tsne
pbmc3k_processed/ms/RNA/obsm/X_pca
pbmc3k_processed/ms/RNA/obsm/X_draw_graph_fr
pbmc3k_processed/ms/RNA/obsp/distances
pbmc3k_processed/ms/RNA/obsp/connectivities
pbmc3k_processed/ms/RNA/varm/PCs
pbmc3k_processed/ms/raw/X/data
pbmc3k_processed/ms/raw/var

There are 12 different arrays here, with varying shapes.
What parameterization do you propose?
tiledbsoma.io.from_anndata(
  'pbmc3k_processed',
  'pbmc3k_processed.h5ad',
  'RNA',
  shapes={
    'obs': (2638,)
    'ms/RNA/var': (1838,),
    'ms/RNA/X/data': (2638, 1838),
    'ms/RNA/obsm/X_umap': (2638, 2),
    'ms/RNA/obsm/X_tsne': (2638, 2),
    'ms/RNA/obsm/X_pca': (2638, 50),
    'ms/RNA/obsm/X_draw_graph_fr': (2638, 2),
    'ms/RNA/obsp/distances': (2638, 2638),
    'ms/RNA/obsp/connectivities': (2638, 2638),
    'ms/RNA/varm/PCs': (1838, 1838),
    'ms/raw/X/data': (2638, 13714),
    'ms/raw/var': (13714,),
  }
)

Something like the above? Or something else?

@johnkerl Thanks! Important details on the many different arrays. As I think about it, there two main use cases we want to fulfill with this:

Future addition of data to the tiledbsoma object -- here it makes sense to have the shapes as the maximum 32-bit capacity.
Read-only tiledbsoma object. For this there are two options:

tiledbsoma object from one h5ad -- here it would make sense to have defaults as the original matrix shapes
tiledbsoma object from multiple h5ads (like we do in the Census) -- here it would make sense to be able to specify individual shapes for each matrix, like you have in your example.

Not sure I have the right answer since non-defaults add ux complexity.

Interop CI is failing with Error: Process completed with exit code 143 which, Google suggests to me, may be indicative of our running out of memory/CPU/time resources within the CI run ...

Interop CI is failing with Error: Process completed with exit code 143 which, Google suggests to me, may be indicative of our running out of memory/CPU/time resources within the CI run ...

It passes on my laptop with this branch checked out, so, it needs to be a CI-resource-config problem to be solved ... 🤔

Not sure I have the right answer since non-defaults add ux complexity.

My position is that the above
tiledbsoma.io.from_anndata(
  'pbmc3k_processed',
  'pbmc3k_processed.h5ad',
  'RNA',
  shapes={
    'obs': (2638,)
    'ms/RNA/var': (1838,),
    'ms/RNA/X/data': (2638, 1838),
    'ms/RNA/obsm/X_umap': (2638, 2),
    'ms/RNA/obsm/X_tsne': (2638, 2),
    'ms/RNA/obsm/X_pca': (2638, 50),
    'ms/RNA/obsm/X_draw_graph_fr': (2638, 2),
    'ms/RNA/obsp/distances': (2638, 2638),
    'ms/RNA/obsp/connectivities': (2638, 2638),
    'ms/RNA/varm/PCs': (1838, 1838),
    'ms/raw/X/data': (2638, 13714),
    'ms/raw/var': (13714,),
  }
)

is prohibitively complex to require people to type. Just not OK.
Another option is we require them to do
tiledbsoma.io.from_anndata(
  'pbmc3k_processed',
  'pbmc3k_processed.h5ad',
  'RNA',
  nobs=2638, nvar, 1838, nrawvar = 13714,
)

or some such -- let the num-PCAs axes etc be tight.
The best option, I believe, is:

If not appendable: use tight shapes
If appendable (see also https://github.com/single-cell-data/TileDB-SOMA/issues/1278) then use 2^31-1 defaults
Let them specify nobs nvar nrawvar as above if they want to

Re the CI fail:

Interop CI is failing with Error: Process completed with exit code 143 which, Google suggests to me, may be indicative of our running out of memory/CPU/time resources within the CI run ...

This is due to increased runtime and a combination of several factors:

On this PR from Python's from_h5ad/from_anndata we replace 63-bit shape with 31-bit shape
Both cause problems with R reading that, but at different points
Muffle-warning logic in tiledbsoma-r hides this
With 31-bit shape, it runs longer (in particular, too long for CI) when the Python-written shapes are 31-bit

Data:

Here is a branch: https://github.com/single-cell-data/TileDB-SOMA/compare/kerl/r-alloc-trace

That's a branch off main
What I vary in my experiment is whether a SOMA experiment was ingested with 63-bit shape (../python/pre) or 31-bit shape (../python/post)
Then in my experiment I used the above branch -- today's main but with some print statements added

Output for the pre case:
ℹ Loading tiledbsoma
Warning: argument must be coercible to non-negative integer
Warning: argument must be coercible to non-negative integer
Warning: argument must be coercible to non-negative integer
Warning: argument must be coercible to non-negative integer
SEAQ SPARSE_MATRIX PRE
Warning: Array dimensions must not exceed '.Machine$integer.max'
SEAQ SPARSE_MATRIX PRE
Warning: Array dimensions must not exceed '.Machine$integer.max'
An object of class Seurat
1838 features across 2638 samples within 1 assay
Active assay: RNA (1838 features, 0 variable features)
Warning messages:
1: In as.integer.integer64(embed$shape()[2L]) :
  NAs produced by integer overflow
2: In as.integer.integer64(embed$shape()[2L]) :
  NAs produced by integer overflow
3: In as.integer.integer64(embed$shape()[2L]) :
  NAs produced by integer overflow
4: In as.integer.integer64(embed$shape()[2L]) :
  NAs produced by integer overflow

Output for the post case:
ℹ Loading tiledbsoma
Warning: vector memory exhausted (limit reached?)
Warning: vector memory exhausted (limit reached?)
Warning: vector memory exhausted (limit reached?)
Warning: vector memory exhausted (limit reached?)
SEAQ SPARSE_MATRIX PRE
SEAQ SPARSE_MATRIX POST
SEAQ MAT IDX IDX PRE
Warning: Cholmod error 'problem too large' at file ../Core/cholmod_memory.c, line 135
SEAQ SPARSE_MATRIX PRE
SEAQ SPARSE_MATRIX POST
SEAQ MAT IDX IDX PRE
Warning: Cholmod error 'problem too large' at file ../Core/cholmod_memory.c, line 135
An object of class Seurat
1838 features across 2638 samples within 1 assay
Active assay: RNA (1838 features, 0 variable features)

In the pre case:

This line is reached https://github.com/single-cell-data/TileDB-SOMA/blob/kerl/r-alloc-trace/apis/r/R/SOMAExperimentAxisQuery.R#L719
This line is not https://github.com/single-cell-data/TileDB-SOMA/blob/kerl/r-alloc-trace/apis/r/R/SOMAExperimentAxisQuery.R#L721
The muffleWarning here means that even though line 721 isn't reached, the test fails to fail: https://github.com/single-cell-data/TileDB-SOMA/blob/kerl/r-alloc-trace/apis/r/R/SOMAExperimentAxisQuery.R#L368

In the post case:

This line is reached https://github.com/single-cell-data/TileDB-SOMA/blob/kerl/r-alloc-trace/apis/r/R/SOMAExperimentAxisQuery.R#L728
This line is not https://github.com/single-cell-data/TileDB-SOMA/blob/kerl/r-alloc-trace/apis/r/R/SOMAExperimentAxisQuery.R#L739
The muffleWarning here means that even though line 721 isn't reached, the test fails to fail: https://github.com/single-cell-data/TileDB-SOMA/blob/kerl/r-alloc-trace/apis/r/R/SOMAExperimentAxisQuery.R#L368
Yet the code runs a bit longer than in the pre case, hence the timeout
This is why it fails to fail on my laptop -- no CI artificial resource limits -- although execution times goes up significantly, and still, we have the issue noted above of failure to reach line 739, and hence, incomplete data processing

Action items:

Due to R idiosyncracies (tiledbsoma-py has zero problems reading or writing 63-bit shapes, or 31-bit shapes) we are encountering either failures or extreme slowness trying to write even 31-bit shapes

Therefore we need to delay this until @mojaveazure 's bounding-box logic on #1445

I don't like the muffleWarning at all -- this makes previously failing cases appear to succeed

I'd like to get rid of our use of muffleWarning
Failing that, I think we should use options(warn=2) in our unit-test cases -- as we've just seen, we had incomplete I/O even before this PR, and the R/Python interop tests weren't catching them

cc @mojaveazure @ebezzi @pablo-gar @aaronwolen

Can you isolate where the cholmod error comes from?  That is from inside package Matrix and indicative that we masy still do something wrong.

Can you isolate where the cholmod error comes from? That is from inside package Matrix and indicative that we masy still do something wrong.

@eddelbuettel it's at this line:
https://github.com/single-cell-data/TileDB-SOMA/blob/kerl/r-alloc-trace/apis/r/R/SOMAExperimentAxisQuery.R#L729
where mat is of type dgCMatrix

Good.  If you put a line with   browser()    there we can evaluate idx. Is it outside the matrix dims? For "normal" requests it behaves:
> set.seed(123); N <- 100; M <- as(rsparsematrix(N, N, 0.2), "dgCMatrix"); M[N,N]
[1] 0
> set.seed(123); N <- 100; M <- as(rsparsematrix(N, N, 0.2), "dgCMatrix"); M[N+1,N+1]
Error in intI(i, n = d[1L], dn[[1L]], give.dn = FALSE) :
  index larger than maximal 100
>
> for (i in 4:7) { set.seed(123); N <- 10^i; M <- as(rsparsematrix(N, N, 1000/(N*N)), "dgCMatrix"); print(M[N,N]) }
[1] 0
[1] 0
[1] 0
[1] 0
>

@eddelbuettel https://gist.github.com/johnkerl/567bdfc1a6c750be1b7fec8792605eb3
I believe the 31-bit shape, not the idx itself, is to blame ...

Browse[1]> mat
2147483646 x<PHONE_NUMBER> sparse Matrix of class "dgCMatrix"
Error in subCsp_cols(x, j, drop = drop) :
  Cholmod error 'problem too large' at file ../Core/cholmod_memory.c, line 135

I just rebased on nw-merged #1504

I just rebased on now-merged https://github.com/single-cell-data/TileDB-SOMA/pull/1504

@aaronwolen @mojaveazure

Before that rebase, as narrated in thorough detail above

The test pytest apis/system/tests/test_write_anndata_read_seurat.py was passing (with warnings) on my laptop with very long runtime
It was 143'ing in CI (out of resources) -- which I (mistakenly) attributed to the high runtime

After that rebase:

The test pytest apis/system/tests/test_write_anndata_read_seurat.py is passing (with warnings) on my laptop with very good runtime (just a few seconds)
But still 143'ing in CI -- which I am now hypothesizing is due to RAM needs within the CI container

Not sure where to go next from here.
I'm not willing to merge a PR which turns interop CI (or any CI for that matter) from green to red.

@aaronwolen @pablo-gar after rebase on #1504 #1508 #1521 this is now a simple, green-CI PR


Struct sigaction incomplete type(Intellisense problem)

VSCode Version: 1.32.3
OS Version: Windows 10 17134 / Ubuntu 18.04

Hey guys, I am currently in a school projet in C and I encounter a problem when I want to use the struct sigaction. It seems that VSCode can't find properly some functions and struct itself (type incomplete, and sigaction doesn't show up).  I have this problem on both my Windows using a sub system Ubuntu, and my other computer using Ubuntu. I can compile without any problem but it is very frustrating without autocompletion.
Here are the c_cpp_properties :
Windows :
{
    "configurations": [
        {
            "name": "WSL",
            "intelliSenseMode": "gcc-x64",
            "compilerPath": "/usr/bin/gcc",
            "includePath": [
                "${workspaceFolder}/**"
            ],
            "defines": [],
            "cStandard": "c11",
            "cppStandard": "c++17"
        }
    ],
    "version": 4
}

Ubuntu :
{
    "configurations": [
        {
            "name": "Linux",
            "includePath": [
                "${workspaceFolder}/**"
            ],
            "defines": [],
            "compilerPath": "/usr/bin/gcc",
            "cStandard": "c11",
            "cppStandard": "c++17",
            "intelliSenseMode": "gcc-x64"
        }
    ],
    "version": 4
}

The code :
    struct sigaction act;
    act.sa_handler = handler;
    act.sa_flags = SA_RESTART;
    sigaction(SIGTSTP,&act,&old);

and the errors :
incomplete type is not allowed
incomplete type is not allowed
incomplete type is not allowed
identifier "SA_RESTART" is undefined

I only found one thread talking about this issue, but no solution was given at the time.
Thanks in advance.

After reading the signal header, you just need to add #define _GNU_SOURCE ,case closed.


ValueError for remote_name when using Windows AD account with the form 'DOMAIN\username'

Hi,
First of all - thanks for a great project!
We are running a mixed environment with both Linux and Windows and the user management is centralized in the Windows AD.  In the production environment we have to include the domain together with the username for the authentication to work properly, for example:

ssh 'DOMAIN\user'@host

OR

ssh user@DOMAIN@host

However this results in the following exception when running Ansible together with Mitogen:
The full traceback is:
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 138, in run
    res = self._execute()
  File "/usr/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 576, in _execute
    result = self._handler.run(task_vars=variables)
  File "/usr/lib/python2.7/site-packages/ansible_mitogen/mixins.py", line 115, in run
    return super(ActionModuleMixin, self).run(tmp, task_vars)
  File "/usr/lib/python2.7/site-packages/ansible/plugins/action/shell.py", line 27, in run
    result = command_action.run(task_vars=task_vars)
  File "/usr/lib/python2.7/site-packages/ansible_mitogen/mixins.py", line 115, in run
    return super(ActionModuleMixin, self).run(tmp, task_vars)
  File "/usr/lib/python2.7/site-packages/ansible/plugins/action/command.py", line 24, in run
    results = merge_hash(results, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))
  File "/usr/lib/python2.7/site-packages/ansible_mitogen/mixins.py", line 334, in _execute_module
    self._connection._connect()
  File "/usr/lib/python2.7/site-packages/ansible_mitogen/connection.py", line 527, in _connect
    stack=mitogen.utils.cast(list(stack)),
  File "/usr/lib/python2.7/site-packages/mitogen/core.py", line 1126, in call_service
    return recv.get().unpickle()
  File "/usr/lib/python2.7/site-packages/mitogen/core.py", line 487, in unpickle
    raise obj
CallError: exceptions.ValueError: remote_name= cannot contain slashes
  File "<stdin>", line 2049, in _dispatch_calls
  File "<stdin>", line 2041, in _dispatch_one
  File "master:/usr/lib/python2.7/site-packages/ansible_mitogen/target.py", line 233, in init_child
    _fork_parent = econtext.router.fork()
  File "master:/usr/lib/python2.7/site-packages/mitogen/parent.py", line 1280, in fork
    return self.connect(u'fork', **kwargs)
  File "master:/usr/lib/python2.7/site-packages/mitogen/parent.py", line 1256, in connect
    return self._connect(klass, name=name, **kwargs)
  File "master:/usr/lib/python2.7/site-packages/mitogen/parent.py", line 1235, in _connect
    stream = klass(self, context_id, **kwargs)
  File "master:/usr/lib/python2.7/site-packages/mitogen/parent.py", line 750, in __init__
    super(Stream, self).__init__(*args, **kwargs)
  File "<stdin>", line 951, in __init__
  File "master:/usr/lib/python2.7/site-packages/mitogen/fork.py", line 107, in construct
    unidirectional=False)
  File "master:/usr/lib/python2.7/site-packages/mitogen/parent.py", line 771, in construct
    raise ValueError('remote_name= cannot contain slashes')

Running Ansible without Mitogen works as expected.
Ansible version: 2.6.1
Mitogen version: 0.2.2
Host OS: CentOS 7.5
Host Python: 2.7.5
Target OS: RHEL 7.5
Target Pyton: 2.7.5

Hi there,
A fix for this is on dmw branch and will reach master hopefully over the coming weekend. For now, please feel free to install from https://github.com/dw/mitogen/archive/dmw.zip. Thanks for reporting this!

Hi,
I have tested the code in the dmw  branch and can confirm that it is working - thanks for the quick fix!


🧹 Resolve build warning: C4035 Truncation

Is there an existing issue for this?

[X] I have searched the existing issues

Suggestion
Resolve C4305 error surrounding truncation.
These can be seen in this example run under windows-2019-gcc-9.2.0 or windows-2019-msvc-latest.
Example:

warning C4305: 'return': truncation from 'eg_electionguard_status_e' to 'bool' [D:\a\electionguard-cpp\electionguard-cpp\build\libs\msvc\Win32\src\electionguard.vcxproj]

Possible Implementation
No response
Anything else?
MSDocs:
https://docs.microsoft.com/en-us/cpp/error-messages/compiler-warnings/compiler-warning-level-1-c4305?view=msvc-160

Matt already fixed this code.


When I log into MyHbarWallet account, it auto-populates "0.0." before my account ID, but when I try to send hbars, it does not.

Thanks for noticing that. We should definitely fix that inconsistency.
More than that I think we should further just allow "1001" to be submitted as well.
This is probably a good time to generalize those areas to a "IdInput" component.


Fix linting errors; add more linters

This should net us an almost perfect A+ on goreportcard |o/
Also clean up makefile a bit.

So the Jenkins package has died on Arch because of course it did. Thinking about other solutions..

It's fixed in 2.57-1 apparently. Update yo system, g.

thiderman@dragonisle ~ > pacaur -S jenkins
[sudo] password for thiderman:
warning: jenkins-2.57-1 is up to date -- reinstalling
[...]

🐍


Panseg to Instance Segmentation Script Produces Inaccurate Annotations when objects overlap

I'm using the script to transform the panseg annotations to instance segmentation and am seeing undesirable annotations.
https://github.com/bytedance/coconut_cvpr2024/blob/main/tutorials/kmaxdeeplab_instance/create_instance_by_panseg.py
Here is example image<PHONE_NUMBER>34.jpg from the val2017 dataset, specifically  the dining table class overlapping the person.
.
Here is another example image<PHONE_NUMBER>39.jpg from the val2017 dataset where the zebra segmentation appear off.

It looks like the script was recently updated, do you know what could be causing this?

For example, here are the masks for the zebra instance, So i expected them to align more closely.
Please ignore my class labels, as I purposefully didn't provide these

I'm using the script to transform the panseg annotations to instance segmentation and am seeing undesirable annotations.
https://github.com/bytedance/coconut_cvpr2024/blob/main/tutorials/kmaxdeeplab_instance/create_instance_by_panseg.py
Here is example image<PHONE_NUMBER>34.jpg from the val2017 dataset, specifically the dining table class overlapping the person.
.
Here is another example image<PHONE_NUMBER>39.jpg from the val2017 dataset where the zebra segmentation appear off.
It looks like the script was recently updated, do you know what could be causing this?

hi, thanks for the question. I believe this could be the problem of how you open the instance mask. I used pycocotools api, it looks good on my side. You can check my recent commit on the visualization:  https://github.com/bytedance/coconut_cvpr2024/blob/main/tutorials/kmaxdeeplab_instance/vis_converted_instance.ipynb
attach my visualization results below:

For example, here are the masks for the zebra instance, So i expected them to align more closely. Please ignore my class labels, as I purposefully didn't provide these

for the zebra, the instance mask should be good as in my visualization.

Thank you, I also recreated this with CV2 and just drawing the polygon segments.
I appreciate you looking at this. Closing now.


Link with Chmy?

It would be great if JustPIC can be made compatible with Chmy.jl as well. Or is it too tightly integrated with ParallelStencil and ImplicitGlobalGrid?

JP uses ParallelStencil internally to abstract the backend. I could switch to Chmy (or KernelAbstractions for a lighter dependency) but that would mean a full rewrite with no performance gains; there may even be regressions since Chmy doesnt seem to be very battle tested in CPUs. Perhaps the only place where it could be useful is on the MPI comm but thats a small
Nonetheless, all the particle objects are independent of ParallelStencil, so they could be used in any code written by Chmy. If there's any incompatibility, should (magic words here) be easy to fix :)

thanks for the clarification - it would be great to have an example that illustrates how to use the particle objects along with Chmy