Intsall failed

I tried to install with this pip install mythril and got this result:
@./mythril:jrush>$ pip install mythril
Collecting mythril
Downloading mythril-0.1.6.tar.gz
Collecting ethereum==2.0.4 (from mythril)
Downloading ethereum-2.0.4.tar.gz (139kB)
100% |████████████████████████████████| 143kB 2.5MB/s
Collecting repoze.lru (from ethereum==2.0.4->mythril)
Downloading repoze.lru-0.7.tar.gz
Requirement already satisfied: PyYAML in /usr/local/lib/python2.7/site-packages (from ethereum==2.0.4->mythril)
Collecting pbkdf2 (from ethereum==2.0.4->mythril)
Downloading pbkdf2-1.3.tar.gz
Collecting bitcoin (from ethereum==2.0.4->mythril)
Downloading bitcoin-1.1.42.tar.gz
Collecting pycryptodome>=3.3.1 (from ethereum==2.0.4->mythril)
Downloading pycryptodome-3.4.7.tar.gz (6.5MB)
100% |████████████████████████████████| 6.5MB 194kB/s
Collecting scrypt (from ethereum==2.0.4->mythril)
Downloading scrypt-0.8.0-cp27-cp27m-macosx_10_11_x86_64.whl
Collecting pysha3>=1.0.1 (from ethereum==2.0.4->mythril)
Downloading pysha3-1.0.2.tar.gz (829kB)
100% |████████████████████████████████| 829kB 1.4MB/s
Collecting rlp>=0.4.7 (from ethereum==2.0.4->mythril)
Downloading rlp-0.6.0.tar.gz
Collecting pyethash (from ethereum==2.0.4->mythril)
Downloading pyethash-0.1.27.tar.gz
Building wheels for collected packages: mythril, ethereum, repoze.lru, pbkdf2, bitcoin, pycryptodome, pysha3, rlp, pyethash
Running setup.py bdist_wheel for mythril ... error
Complete output from command /usr/local/opt/python/bin/python2.7 -u -c "import setuptools, tokenize;file='/private/var/folders/20/42k6jhsj325_yl419srn69280000gn/T/pip-build-l7NqpX/mythril/setup.py';f=getattr(tokenize, 'open', open)(file);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, file, 'exec'))" bdist_wheel -d /var/folders/20/42k6jhsj325_yl419srn69280000gn/T/tmpPIUqU8pip-wheel- --python-tag cp27:
running bdist_wheel
running build
running build_py
creating build
creating build/lib
creating build/lib/ether
copying ether/init.py -> build/lib/ether
copying ether/asm.py -> build/lib/ether
copying ether/evm.py -> build/lib/ether
copying ether/util.py -> build/lib/ether
creating build/lib/rpc
copying rpc/init.py -> build/lib/rpc
copying rpc/client.py -> build/lib/rpc
copying rpc/constants.py -> build/lib/rpc
copying rpc/exceptions.py -> build/lib/rpc
copying rpc/utils.py -> build/lib/rpc
running build_scripts
creating build/scripts-2.7
copying and adjusting mythril -> build/scripts-2.7
changing mode of build/scripts-2.7/mythril from 644 to 755
installing to build/bdist.macosx-10.12-x86_64/wheel
running install
running install_lib
creating build/bdist.macosx-10.12-x86_64
creating build/bdist.macosx-10.12-x86_64/wheel
creating build/bdist.macosx-10.12-x86_64/wheel/ether
copying build/lib/ether/init.py -> build/bdist.macosx-10.12-x86_64/wheel/ether
copying build/lib/ether/asm.py -> build/bdist.macosx-10.12-x86_64/wheel/ether
copying build/lib/ether/evm.py -> build/bdist.macosx-10.12-x86_64/wheel/ether
copying build/lib/ether/util.py -> build/bdist.macosx-10.12-x86_64/wheel/ether
creating build/bdist.macosx-10.12-x86_64/wheel/rpc
copying build/lib/rpc/init.py -> build/bdist.macosx-10.12-x86_64/wheel/rpc
copying build/lib/rpc/client.py -> build/bdist.macosx-10.12-x86_64/wheel/rpc
copying build/lib/rpc/constants.py -> build/bdist.macosx-10.12-x86_64/wheel/rpc
copying build/lib/rpc/exceptions.py -> build/bdist.macosx-10.12-x86_64/wheel/rpc
copying build/lib/rpc/utils.py -> build/bdist.macosx-10.12-x86_64/wheel/rpc
running install_egg_info
running egg_info
writing requirements to mythril.egg-info/requires.txt
writing mythril.egg-info/PKG-INFO
writing top-level names to mythril.egg-info/top_level.txt
writing dependency_links to mythril.egg-info/dependency_links.txt
reading manifest file 'mythril.egg-info/SOURCES.txt'
writing manifest file 'mythril.egg-info/SOURCES.txt'
Copying mythril.egg-info to build/bdist.macosx-10.12-x86_64/wheel/mythril-0.1.6-py2.7.egg-info
running install_scripts
creating build/bdist.macosx-10.12-x86_64/wheel/mythril-0.1.6.data
creating build/bdist.macosx-10.12-x86_64/wheel/mythril-0.1.6.data/scripts
copying build/scripts-2.7/mythril -> build/bdist.macosx-10.12-x86_64/wheel/mythril-0.1.6.data/scripts
changing mode of build/bdist.macosx-10.12-x86_64/wheel/mythril-0.1.6.data/scripts/mythril to 755
Traceback (most recent call last):
File "", line 1, in
File "/private/var/folders/20/42k6jhsj325_yl419srn69280000gn/T/pip-build-l7NqpX/mythril/setup.py", line 163, in
scripts=['mythril']
File "/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/local/lib/python2.7/site-packages/wheel/bdist_wheel.py", line 232, in run
self.distinfo_dir)
File "/usr/local/lib/python2.7/site-packages/wheel/bdist_wheel.py", line 399, in egg2dist
distribution=self.distribution)
File "/usr/local/lib/python2.7/site-packages/wheel/metadata.py", line 129, in pkginfo_to_dict
payload = payload.decode('utf-8')
File "/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/encodings/utf_8.py", line 16, in decode
return codecs.utf_8_decode(input, errors, True)
UnicodeDecodeError: 'utf8' codec can't decode byte 0x89 in position 1757: invalid start byte

Failed building wheel for mythril
Running setup.py clean for mythril
Running setup.py bdist_wheel for ethereum ... done
Stored in directory: /Users/jrush/Library/Caches/pip/wheels/ff/ee/fd/d155ede9dba88b679720c87975f2eeab21befc43da2b7b075e
Running setup.py bdist_wheel for repoze.lru ... done
Stored in directory: /Users/jrush/Library/Caches/pip/wheels/f2/f9/a7/f5c72abc5a083f4ef4b2e3eb4c4721300cf0735ac06958a2e7
Running setup.py bdist_wheel for pbkdf2 ... done
Stored in directory: /Users/jrush/Library/Caches/pip/wheels/4a/1a/64/4dd31676e41ecf2917a870a96a874c860508d3b5d1b440b52b
Running setup.py bdist_wheel for bitcoin ... done
Stored in directory: /Users/jrush/Library/Caches/pip/wheels/15/d9/46/0029939110ce681cbcb1b94b8952f475eb3562e65cd99d311f
Running setup.py bdist_wheel for pycryptodome ... done
Stored in directory: /Users/jrush/Library/Caches/pip/wheels/f7/cb/16/1ed6dc50b92888af9051bda6f59f335dfd966a1ce5edd8a4af
Running setup.py bdist_wheel for pysha3 ... done
Stored in directory: /Users/jrush/Library/Caches/pip/wheels/00/06/c3/ad27a11d795e4400ebaf0242a5b316820f33b6633e19435ee5
Running setup.py bdist_wheel for rlp ... done
Stored in directory: /Users/jrush/Library/Caches/pip/wheels/00/27/d0/354150ba37723f2469f6eb69b07ccdce983a3cd572584d9e8c
Running setup.py bdist_wheel for pyethash ... done
Stored in directory: /Users/jrush/Library/Caches/pip/wheels/4c/a1/67/af345dfb35e42a2b0f9d0a5d7b5996ac5959a1b05e286664b0
Successfully built ethereum repoze.lru pbkdf2 bitcoin pycryptodome pysha3 rlp pyethash
Failed to build mythril
Installing collected packages: repoze.lru, pbkdf2, bitcoin, pycryptodome, scrypt, pysha3, rlp, pyethash, ethereum, mythril
Exception:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/pip/basecommand.py", line 215, in main
status = self.run(options, args)
File "/usr/local/lib/python2.7/site-packages/pip/commands/install.py", line 342, in run
prefix=options.prefix_path,
File "/usr/local/lib/python2.7/site-packages/pip/req/req_set.py", line 784, in install
**kwargs
File "/usr/local/lib/python2.7/site-packages/pip/req/req_install.py", line 851, in install
self.move_wheel_files(self.source_dir, root=root, prefix=prefix)
File "/usr/local/lib/python2.7/site-packages/pip/req/req_install.py", line 1064, in move_wheel_files
isolated=self.isolated,
File "/usr/local/lib/python2.7/site-packages/pip/wheel.py", line 377, in move_wheel_files
clobber(source, dest, False, fixer=fixer, filter=filter)
File "/usr/local/lib/python2.7/site-packages/pip/wheel.py", line 323, in clobber
shutil.copyfile(srcfile, destfile)
File "/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 83, in copyfile
with open(dst, 'wb') as fdst:
IOError: [Errno 13] Permission denied: '/usr/local/LICENSE'
And the myth command line toold does not install.

Try Python 3.5!

Instructions?

PyEnv


Set up a basic test and CI

I've added a CI definition which install gfortran on all windows, macOS and ubuntu. It's not running, see: https://github.com/USEPA/gflow1/actions/runs/10183578145
With this error:

<EMAIL_ADDRESS>and fortran-lang/setup-fortran@v1 are not allowed to be used in USEPA/gflow1. Actions in this workflow must be: within a repository that belongs to your Enterprise account, created by GitHub, or matching the following: cloud-gov/, docker/, r-lib/actions/, softprops/turnstyle@v1, zaproxy/, pypa/<EMAIL_ADDRESS>psf/black@stable, anchore/, release-drafter/, ruby/, aws-actions/, openjournals/openjournals-draft-action@master, gradle/gradle-build-action@, jamesives/github-pages-deploy-action@, azure/, aquasecurity/, dependabot/, SonarSource/, softprops/action-gh-release@, trufflesecurity/, rbhadti94/apache-jmeter-action@, trufflesecurity/trufflehog@, cypress-io/github-action@, peter-evans/create-or-update-comment@, peter-evans/slash-command-dispatch@, bahmutov/get-branch-name-by-pr@, bahmutov/npm-install@, release-drafter/release-drafter@v5, actions/, s4u/maven-settings-action@, gradle/actions/setu...

The problem here is that the USEPA Github organisation doesn't allow the setup-fortran action or the setup-pixi action.
To circumvent this temporarily, I've made a fork on my own namespace.
It's a bit slow to install gfortran on all operating systems, but it's green!
See: https://github.com/Huite/gflow1/actions/runs/10183402742
It should be straightforward to get these actions allowed, they're not that obscure.

Trying closing and re-opening to see if that triggers the action


fix: Update debian-10 to debian-12

Description

On June 30, debian-10 reached end-of-life. See source.
We will need to update Terraform samples that use debian-10 to use debian-12.

Checklist
Readiness

[x] Yes, merge this PR after it is approved
[ ] No, don't merge this PR after it is approved

Style

[x] My sample follows the rules described for Terraform in the Effective Samples style guide
[x] My sample follows the other requirements and best practices in the Contributing
guide

Testing

[ ] I have performed tests described in the Contributing guide:

[ ] Tests pass: terraform apply
[x] Lint pass: terraform fmt check

Intended location

[x] Yes, this sample will be (or already is) included on cloud.google.com
Location(s):

[ ] No, this sample won't be included on cloud.google.com
Reason:

API enablement

[x] If the sample needs an API enabled to pass testing, I have added the service to the Test setup file

Review

[x] If this sample adds a new directory, I have added codeowners to the CODEOWNERS file

@NimJay Thanks for taking care of this.


Docs for specifying CLI flags for Ansible integration

Description of the change
Describing ability to specify CLI flags for Ansible.
Checklist
Please make sure that the proposed change checks all the boxes below before requesting a review:

[ ] I have reviewed the guidelines for contributing to this repository.
[ ] The preview looks fine.
[ ] The tests pass.
[x] The commit history is clean and meaningful.
[x] The pull request is opened against the main branch.
[x] The pull request is no longer marked as a draft.
[x] You agree to license your contribution under the MIT license to Spacelift (not required for Spacelift employees).
You have updated the navigation files correctly:

[x] No new pages have been added, or;
[ ] Only nav.yaml has been updated because the changes only apply to SaaS, or;
[ ] Only nav.self-hosted.yaml has been updated because the changes only apply to Self-Hosted, or;
[ ] Both nav.yaml and nav.self-hosted.yaml have been updated.

If the proposed change is ready to be merged, please request a review from @spacelift-io/solutions-engineering. Someone will review and merge the pull request.
Spacelift employees should request reviews from the relevant engineers and are allowed to merge pull requests after they got at least one approval.
Thank you for your contribution! 🙇

@michalg9
docker run --rm -it -v $(PWD):/workdir -w /workdir  videah/oxipng docs/assets/screenshots/ansible/ansible_cli_flags.png --opt=4 --preserve --strip=safe

@peterdeme @michalg9 Instead of pushing unoptimized images, having the check fail, manually running the optimizer, and pushing the optimized images, which is annoying and unnecessarily adds to the size of the repository, I would recommend that you use pre-commit so that all of that happens locally and automatically. See the CONTRIBUTING file for details.


UnsatisfiedLinkError libpi4j-pigpio.so

Yeah, I know. This is a beginners problem except I've been using pi4j for several years now.. I have two java apps running on separate Pi's. (pi4b and pi3b) two days ago everything was running fine then all at once I get the old UnsatisfiedLinkError for libpi4j-pigpio. Both apps are developed on MacOS using NetBeans 12.6 so my first suspicion was the common jar files that both use. Not knowing if a file was corrupted, I upgraded to pi4j- 2.7 in NetBeans. That didn't work.. I triple checked my script files that set up the environment to make sure the parameters "-Dpi4j.library.path=$CLASSPATH -Djava.lib.path=$CLASSPATH" are in the command line.That checked.. The only other thing that I did was system upgrades on both Pi's.. I see the java I'm running with now is dated Oct 2024... since it's been a while since I did an upgrade I'm wondering if there is something fishy the latest version. QUESTION:is there a way to get an older version of java and how do I remove the newer and replace with the older version?

It would be very suspicious if the Java update breaks Pi4J. Can you provide the full output of java -version please?

I also forgot to mention that I tried running an earlier version of my code to no avail.
Here's my evidence  :-)
TUNER>java -version
openjdk version "11.0.25" 2024-10-15
OpenJDK Runtime Environment (build 11.0.25+9-post-Raspbian-1deb11u1)
OpenJDK Server VM (build 11.0.25+9-post-Raspbian-1deb11u1, mixed mode)
My command file
! /bin/bash
export CWD=$PROJ/Tune
export DIST="$CWD/dist"
export CLASSPATH=$DIST/lib
cd $CWD
sudo -E java -Dlog4j.ConfigurationFile=$HOME/Tune/log4j2.xml
-Dpi4j.library.path=$CLASSPATH -Djava.lib.path=$CLASSPATH  -jar $DIST/Tune.jar $1
My library directory
All pi4j files are version 2.7
TUNER>pwd
/home/pi/NetBeansProjects/Tune/dist/lib
TUNER>dir
total 2968
-rwxrwxrwx 1 pi pi   68115 Nov 14 15:35 slf4j-api.jar
-rwxrwxrwx 1 pi pi   28051 Nov 14 15:35 pi4j-plugin-raspberrypi.jar
-rwxrwxrwx 1 pi pi   42130 Nov 14 15:35 pi4j-plugin-pigpio.jar
-rwxrwxrwx 1 pi pi  151659 Nov 14 15:35 pi4j-library-pigpio.jar
-rwxrwxrwx 1 pi pi  344441 Nov 14 15:35 pi4j-core.jar
-rwxrwxrwx 1 pi pi 1847550 Nov 14 15:35 log4j-core-2.20.0.jar
-rwxrwxrwx 1 pi pi  313296 Nov 14 15:35 log4j-api-2.20.0.jar
-rwxrwxrwx 1 pi pi   33696 Nov 14 15:35 libpi4j-pigpio.so
-rwxrwxrwx 1 pi pi  125099 Nov 14 15:35 Utilities.jar
-rwxrwxrwx 1 pi pi   60409 Nov 14 15:35 RaspberryPi.jar
The exception printout
CWD=/home/pi/NetBeansProjects/Tune
DIST=/home/pi/NetBeansProjects/Tune/dist
CLASSPATH=/home/pi/NetBeansProjects/Tune/dist/lib
/home/pi/NetBeansProjects/Tune
/home/pi/NetBeansProjects/Tune/dist
/home/pi/NetBeansProjects/Tune/dist/lib
SLF4J(W): No SLF4J providers were found.
SLF4J(W): Defaulting to no-operation (NOP) logger implementation
SLF4J(W): See https://www.slf4j.org/codes.html#noProviders for further details.
Exception in thread "main" java.lang.UnsatisfiedLinkError: Pi4J was unable to extract and load the native library [/home/pi/NetBeansProjects/Tune/dist/lib/libpi4j-pigpio.so] from the embedded resources inside this JAR [/home/pi/NetBeansProjects/Tune/dist/lib/pi4j-library-pigpio.jar]. to a temporary location on this system.  You can alternatively define the 'pi4j.library.path' system property to override this behavior and specify the library path.
UNDERLYING EXCEPTION: [java.lang.UnsatisfiedLinkError]=/home/pi/NetBeansProjects/Tune/dist/lib/libpi4j-pigpio.so: libpigpio.so.1: cannot open shared object file: No such file or directory
at com.pi4j.library.pigpio.util.NativeLibraryLoader.load(NativeLibraryLoader.java:145)
at com.pi4j.library.pigpio.internal.PIGPIO.(PIGPIO.java:74)
at com.pi4j.library.pigpio.impl.PiGpioNativeImpl.gpioInitialise(PiGpioNativeImpl.java:105)
at com.pi4j.library.pigpio.PiGpio.initialize(PiGpio.java:159)
at com.pi4j.plugin.pigpio.provider.i2c.PiGpioI2CProviderImpl.create(PiGpioI2CProviderImpl.java:77)
at com.pi4j.plugin.pigpio.provider.i2c.PiGpioI2CProviderImpl.create(PiGpioI2CProviderImpl.java:46)
at raspberrypi.I2CPi4j.(I2CPi4j.java:63)
at QWIK.ADS1015.(ADS1015.java:107)
at QWIK.ADS1015.getInstance(ADS1015.java:95)
at HATS.StepperHat.(StepperHat.java:45)
at tuner.Controller.TUNE_main(Controller.java:90)
at tuner.Controller.main(Controller.java:63)
This is why I think I got a recent version of java when I did a system upgrade two days ago after which I get the exception
TUNER>pwd
/usr/lib/jvm/java-11-openjdk-armhf/bin
TUNER>dir java
-rwxr-xr-x 1 root root 5548 Oct 21 08:21 java
What ever version was present before that was working. I can't remember when I upgraded last.. probably a couple months  ago
Hope this helps

Just an idea... can you try sdkman and install an earlier 11 version?

I’m not familiar with  sdkman..
How do I determine what earlier versions are available?

On Nov 16, 2024, at 11:26 AM, Frank Delporte @.***> wrote:
Just an idea... can you try sdkman and install an earlier 11 version?
—
Reply to this email directly, view it on GitHub https://github.com/Pi4J/pi4j-v2/issues/411#issuecomment-2480642454, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALR7NUFB6UE3CYO7275ZK6D2A5W2HAVCNFSM6AAAAABR33JNQWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIOBQGY2DENBVGQ.
You are receiving this because you authored the thread.

On my mac it shows:
$ sdk list java
...
               |     | 11.0.25.fx   | zulu    |            | 11.0.25.fx-zulu
               |     | 11.0.25      | zulu    |            | 11.0.25-zulu
               |     | 8.0.432.fx   | zulu    |            | 8.0.432.fx-zulu
               |     | 8.0.432      | zulu    |            | 8.0.432-zulu
               |     | 8.0.362      | zulu    | local only | 8.0.362-zulu

Another solution could be to follow these guidelines https://docs.azul.com/core/install/debian with an earlier version from https://www.azul.com/downloads/?version=java-11-lts&os=debian&package=jdk&show-old-builds=true#zulu

I tried the azul thing but....
522  sudo apt install gnupg ca-certificates curl
523  curl -s https://repos.azul.com/azul-repo.key | sudo gpg --dearmor -o /usr/share/keyrings/azul.gpg
524  echo "deb [signed-by=/usr/share/keyrings/azul.gpg] https://repos.azul.com/zulu/deb stable main" | sudo tee /etc/apt/sources.list.d/zulu.list
525  sudo apt update
526  sudo apt install zulu21-jdk
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
E: Unable to locate package zulu21-jdk
What am I missing?

Are you running on a 32- or 64-bit system? On which type of board did you try this?

Pi3B+I think it will do both. Sent from my iPhoneOn Nov 18, 2024, at 12:02, Frank Delporte @.***> wrote:
Are you running on a 32- or 64-bit system? On which type of board did you try this?
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>

It is several years old. Sent from my iPhoneOn Nov 18, 2024, at 12:02, Frank Delporte @.***> wrote:
Are you running on a 32- or 64-bit system? On which type of board did you try this?
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>

Sorry for the ongoing questions... ;-)
What is the output from this script?
https://github.com/FDelporte/PiJava/blob/master/scripts/pi_checks/check_raspian_version.sh

TUNER>./scp
Checking the Raspian version
Debian version: 11.11
Kernel version: 6.1.21-v7+
Full version info:
Linux tuner 6.1.21-v7+ #1642 SMP Mon Apr  3 17:20:52 BST 2023 armv7l GNU/Linux
Even more version info:
Linux version 6.1.21-v7+ @.***) (arm-linux-gnueabihf-gcc-8 (Ubuntu/Linaro 8.4.0-3ubuntu1) 8.4.0, GNU ld (GNU Binutils for Ubuntu) 2.34) #1642 SMP Mon Apr  3 17:20:52 BST 2023
TUNER>

On Nov 18, 2024, at 12:54 PM, Frank Delporte @.***> wrote:
Sorry for the ongoing questions... ;-)
What is the output from this script?
https://github.com/FDelporte/PiJava/blob/master/scripts/pi_checks/check_raspian_version.sh
—
Reply to this email directly, view it on GitHub https://github.com/Pi4J/pi4j-v2/issues/411#issuecomment-2483736569, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALR7NUBJMIU2G45L66H245L2BISWPAVCNFSM6AAAAABR33JNQWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIOBTG4ZTMNJWHE.
You are receiving this because you authored the thread.

Did the additional version info give any clues?  I'm up against a wall. What worked before doesn't anymore and every variable points to the lib and the file is in the lib.

Just tried pi4j-2.71-SNAPSHOT.. no change


arrow2 0.18.0 release broke against minimal dependencies in the Cargo.toml

Even though #1568 is not merged in, apparently version 0.18.0 has already been released to crates.io. In that release, you are putting a dependency on an API introduced in chrono 0.4.31, but in your Cargo.toml, you only have a dependency on 0.4. In my application, since I am using a Cargo.lock file, the upgrade to arrow2 0.18.0 caused a failure since I have an older version of chrono than 0.4.31. Bumping the actual dependency to 0.4.31 in your Cargo.toml would require a new enough version of chrono to not break builds.

Same here. I could fix it by upgrading my chrono version, but it was bit of a nuisance to debug. I had chrono and polars as dependencies, and not arrow2 directly.
In case someone is googling around, the error was:
error[E0599]: no method named `timestamp_nanos_opt` found for struct `DateTime` in the current scope

maybe we should republish this v18.0 version after https://github.com/jorgecarleitao/arrow2/pull/1584 merged

I am still facing this issue. Maybe it could be reopened until cargo.io is properly updated?


Get-JamTreeSizeFree and Get-VideoLanVlcPlayer return Version as PSObject instead of System.String

Describe the bug
To Reproduce
$evergreen = Get-JamTreeSizeFree
$evergreen.Version
4.42
$evergreen.Version | fl
4.42
$evergreen.Version | fl -force
PSPath       : C:\Users\amensc\AppData\Local\Temp\tmpB35D.tmp
PSParentPath : C:\Users\amensc\AppData\Local\Temp
PSChildName  : tmpB35D.tmp
PSDrive      : C
PSProvider   : Microsoft.PowerShell.Core\FileSystem
ReadCount    : 1
Length       : 4
Expected behavior
Expected to return a .Version attribute of type System.String
Desktop (please complete the following information):

OS: Win10 20H2 fully patched
Evergreen 2101.275

Additional context
I don't know if these are the only two functions behaving like this.

In Invoke-WebRequestWrapper I have an option to use -OutFile when returning data from a URL. This has been required to format specific web request content correctly. This will be the cause of the version type on Get-JamTreeSizeFree.
There's a difference in what Invoke-WebRequest returns from https://update.jam-software.de/functions/getCurrentVersion.php?article=80, for example, with and without -OutFile.
I can likely filter what's returned for the version property before returning it to the pipeline; however, I should probably look into what the difference in the content returned is in the first place.
There are a number of functions that will be affected by this.

In Invoke-WebRequestWrapper I have an option to use -OutFile when returning data from a URL. This has been required to format specific web request content correctly. This will be the cause of the version type on Get-JamTreeSizeFree.
There's a difference in what Invoke-WebRequest returns from https://update.jam-software.de/functions/getCurrentVersion.php?article=80, for example, with and without -OutFile.
I can likely filter what's returned for the version property before returning it to the pipeline; however, I should probably look into what the difference in the content returned is in the first place.
There are a number of functions that will be affected by this.

Some apps return data from their update locations as application/octet-stream. I might be able to fix this with Invoke-RestMethod - this has worked for Get-VideoLanVlcPlayer

Some apps return data from their update locations as application/octet-stream. I might be able to fix this with Invoke-RestMethod - this has worked for Get-VideoLanVlcPlayer

Great!
Before investing a lot of time in this, I can also account for the difference in types in my scripts when I use Evergreen's functions.
So it's more of a 'nice to have' adjustment than a bug really.

Great!
Before investing a lot of time in this, I can also account for the difference in types in my scripts when I use Evergreen's functions.
So it's more of a 'nice to have' adjustment than a bug really.

It's given me the opportunity to move a few functions to Get-RestMethodWrapper which simplifies these functions and should produce the right output format as a result.

Fixed in c517a73a818fbf413875a1cdb8703ca1cce1c7eb


Get gdsfactory PCells working on KLayout

We can now use gdsfactory generic pdk (or any other pdk derived from it), straight in KLayout.
Major stuff:

Combined link_gdsfactory_python and import_generic_pcells.
Added a class to turn gdsfactory Components to Klayout PCells
Progress bar to show component loading progress
Fix bug preventing update of PCells without changing name
- This was an issue on gdsfactory's side, doing gf.clear_cache() fixed it

Things to improve:

Flayout does not support tuple of floats as parameters for the PCells, so such Component arguments cannot be modified
Same as above with CrossSectio, ComponentType and other such types

Nice work @SkandanC ! Out of curiosity, what is required to enable this functionality for a PDK not derived from the generic PDK?
And how do the unsupported arguments get treated now? For example, are they greyed out and somehow shown to exist but not be editable? Or are they dropped from the display entirely?

Nice work @SkandanC ! Out of curiosity, what is required to enable this functionality for a PDK not derived from the generic PDK?
And how do the unsupported arguments get treated now? For example, are they greyed out and somehow shown to exist but not be editable? Or are they dropped from the display entirely?

Hi @tvt173,
As long as your PDK's components are gdsfactory Components, this should work as long as you modify the macro such that the currect active pdk is your pdk of interest. The class in the macro is "universal" aka it should work for any gdsfactory Component, and turn it into a KLayout PCell.
The unsupported arguments are just omitted entirely. I would like to work on this when I get time to add support for these too, that way we can instantiate, for example, an array of mzis through the array PCell (rather than the default way now, where it uses unmodifiable Straights).

great work Skandan! thank you
@lukasc-ubc

It should work on Linux, and MacOS. Currently there is an issue with getting one of our dependencies, gdstk, to be imported in KLayout on Windows. But we are working on it.

Hi @thomasdorch,
I just changed the script to install to salt directory, and I could not see it in the tool bar for some reason.

I changed it back to macros and I see this:

Maybe I am doign something wrong here, if so please let me know.

Is it making a symlink or a junction?

It does not show under "Current Packages". This is on WSL, if that makes any difference. Perhaps the script is creating a junction, even though it says symlink?


Code cleanup

Some refactoring in CommandBox, PersonCard and PersonDetailPanel

Coverage increased (+0.01%) to 92.109% when pulling 8147ab20319505f2bf0673077470d1199acce146 on jo-lyn:code-cleanup into d4d1a0e6b0fe552e2fc4f4bc0dbbae3686429b08 on CS2103AUG2017-W11-B2:master.

Coverage increased (+0.03%) to 92.123% when pulling e9a7c48a9e08eb98d0d69b99c7c1b9fba0ffd98c on jo-lyn:code-cleanup into d4d1a0e6b0fe552e2fc4f4bc0dbbae3686429b08 on CS2103AUG2017-W11-B2:master.

Revert my merging commits. Think I didn't resolve the conflict properly.

Coverage increased (+0.03%) to 91.399% when pulling 9a0bdb5969db5b9ead57fb90579c53f67c563a7e on jo-lyn:code-cleanup into f359967f798b17a8c3eb41f2ddd49e3b0e74584c on CS2103AUG2017-W11-B2:master.


UnicodeEncodeError when export csv on sql lab

I run it on macOS 10.12.1.
Issue comes when I rename the sql tab to Chinese name.
Superset version
0.13.1
Expected results
download a csv file
Actual results
Internal Server Error
And the logs:
[2016-11-14 15:33:44 +0800] [25] [ERROR] Error handling request /superset/csv/BybA_1DWl
Traceback (most recent call last):
  File "/usr/lib/python3.5/site-packages/gunicorn/workers/sync.py", line 135, in handle
    self.handle_request(listener, req, client, addr)
  File "/usr/lib/python3.5/site-packages/gunicorn/workers/sync.py", line 182, in handle_request
    resp.write(item)
  File "/usr/lib/python3.5/site-packages/gunicorn/http/wsgi.py", line 342, in write
    self.send_headers()
  File "/usr/lib/python3.5/site-packages/gunicorn/http/wsgi.py", line 338, in send_headers
    util.write(self.sock, util.to_bytestring(header_str, "ascii"))
  File "/usr/lib/python3.5/site-packages/gunicorn/util.py", line 511, in to_bytestring
    return value.encode(encoding)
UnicodeEncodeError: 'ascii' codec can't encode characters in position 210-211: ordinal not in range(128)

Steps to reproduce

rename the sql tab to Chinese name.
run query
click .csv

Which version of superset? Please use the template issue when filing issue.

Hi, @xrmx. It's 0.13.1, and I've updated the description.

Notice: this issue has been closed because it has been inactive for 523 days. Feel free to comment and request for this issue to be reopened.

The issue is still not fixed though


New version: VMware.WorkstationPlayer version 16.2.1

[X] Have you signed the Contributor License Agreement?
[X] Have you checked that there aren't other open pull requests for the same manifest update/change?

[X] Does your manifest conform to the 1.0 schema?

Microsoft Reviewers: Open in CodeFlow

Gonna wait for https://github.com/microsoft/winget-pkgs/pull/34576#issuecomment-965577095

rerun-pipelines-please

/rerun-pipelines-please

/rerun-pipelines-please
Let me test once.

/rerun-pipelines-please

/rerun-pipelines-please

As mentioned here:

https://github.com/microsoft/winget-cli/issues/229#issuecomment-1013688799

VMWare Workstation, winget upgrade --id VMware.WorkstationPlayer does not work.
winget install --id VMware.WorkstationPlayer over existing version forced a reboot.


Extension Template String Converter not working

The extension unexpectedly stopped working in my vscode editor, when adding ${ to a string it does not make the change.
Visual Studio Code: v1.70.2
MacOS Monterey v12.5.1 (Chip M1)

could you pls provide a gif?

I have the extension installed and have to reinstall and the problem persists.

it expects a properly formed line of code IE a semicolon following that expression

it's hard to repro without your exact code - it's working for me

also what are your settings?

I will close this, for some unknown reason after many days without working it worked again as expected. Thanks.


Can't call createVehicle

create_vehicle has two definitions:
object create_vehicle(const std::string &type_, const vector3 &pos_)
and
object create_vehicle(const std::string &type_, const vector3 &pos_, const std::vector<marker> &markers_ = {}, float placement_ = 0.0f, const std::string &special_ = "NONE")
Because all arguments besides type and pos have defaults the compiler can't decide which one to use if you only give it pos and type. So basically the first definition is inaccessible.
Solution: remove markers_ default? If someone want's to use that he has to specify the markers parameter. And if he doesn't need it he will use {} in his call anyway

Fixed in #133


By 06/22: Add product and tooling ideas for the Mining & Stacking Products Hackathon

So far, the following ideas have been shared:
Stacking

Directory where STX hodlers can self identify and interact with developers
Stacking social network (meet other hodlers, could be enabled by proof of stacking)
Autostacker (automatically mine and stack more STX by forwarding BTC earnings into mining)
Stacking wallet
Kickstarter for Stacking products (Stackers request products from dev community)

Mining

Mining bot
Arbitrage bot
PoX Interactive Diagram
User friendly mining app

Please add any other ideas in the comments below BY JUNE 22ND.

You could have stacking aggregators, to pool STX from multiple people so that as a group they can meet the minimum required.  Ideally, for this to work, a contract should be able to stake its holdings

You could have stacking aggregators, to pool STX from multiple people so that as a group they can meet the minimum required. The protocol supports delegation, but not how this gets organized.

Beautiful idea. Decentralized aggregators matched w/decentralized exchange capacities you’ve shown possible seem huge.
Will the first class support for delegation along w/ said aggregators be sufficient for navigating long term custodial centralization?

Proof of Mining login - Patrick to add details

Proof of Stacking login

Validation Services

A wallet feature that allows stackers to delegate STX tokens to a Blockstack validator from a native non-custodial wallet- pulldown menu of validators

Delegating STX feature from hardware wallet (Ledger)

Automated and instant Payout from validator wallet to delegators script based on earnings minus commission fee

Dashboard to display validator metrics - number of clients, number of delegated tokens, total stacked tokens; percentage of network tokens stacked; self-bonded, commission fee; earning rate, total reward paid, uptime;

So far, the following ideas have been shared:
Stacking

Directory where STX hodlers can self identify and interact with developers
Stacking social network (meet other hodlers, could be enabled by proof of stacking)
Autostacker (automatically mine and stack more STX by forwarding BTC earnings into mining)
Stacking wallet
Kickstarter for Stacking products (Stackers request products from dev community)

Mining

Mining bot
Arbitrage bot
PoX Interactive Diagram
User friendly mining app

Please add any other ideas in the comments below BY JUNE 22ND.

Cooperation Tools
It seems the Balinese water temple cooperation example given in this paper should be applicable for long term chain state sustainability/resilience. Can tools be built that can incentivize cooperation? These cooperation tools & directories mentioned above, alongside the tools made to incentivize competition?
This may maximize potential for sustainable innovations in chain-state maintenance via competition incentives for chain maintenance built into PoX; while also protecting for long term concentration of power in successful competitors-- via cooperation approaches to PoX being able to offer resilience advantages to unpredictable network effects of competition/market incentives. Making good use of said stacking social media tools above.
Fingers crossed that this all follows btw? ha

@HaroldDavis3 @GinaAbrams please note that I've added Validation Services tools to the list. See above.

Stable coin (STXD, Stacks Dollar)
Issuing stable coin using BTC obtained as a stacking reward as collateral


Use jupyterlab instead of jupyter in environment.yml

The README says to make sure that you can launch a jupyter (lab) notebook using the jupyter lab command. The environment.yml does not include jupyterlab, which is required for this to happen (unless relying on jupyter lab in the base environment).
Looking forward to the tutorial!
~/demos/napari-training-course master
(base) ❯ conda env create -f environment.yml
(base) ❯ conda activate napari
(napari) ❯ jupyter lab
Traceback (most recent call last):
  File "/Users/trevormanz/dev/miniconda3/envs/napari/bin/jupyter", line 11, in <module>
    sys.exit(main())
  File "/Users/trevormanz/dev/miniconda3/envs/napari/lib/python3.7/site-packages/jupyter_core/command.py", line 247, in main
    command = _jupyter_abspath(subcommand)
  File "/Users/trevormanz/dev/miniconda3/envs/napari/lib/python3.7/site-packages/jupyter_core/command.py", line 134, in _jupyter_abspath
    'Jupyter command `{}` not found.'.format(jupyter_subcommand)
Exception: Jupyter command `jupyter-lab` not found.

Oddly just seeing #3 now... Closing.


Added predicate to find all highlights, such that it only shows for current user.

where has been included in the search query
🙃

forbiddenHighlightsChannels should probably be added to config.json.example. Also is there a reason as to why in the initial PR there's storageData.db and storageDatas.db? Can one of these be removed?

Adjustment to my previous change request: now I see that storageData.db is being deleted so 👍 but another DB is also there, and databaseFiles contains a 3rd DB file, can we chat in #r&d about how we wanna structure this? Might be helpful.

Yeah, once example config file is fixed I'll approve as well.
On Mon, Feb 10, 2020 at 7:38 AM Daniel Moesgaard Andersen <
<EMAIL_ADDRESS>wrote:

@Moesgaarda requested changes on this pull request.
Actually, I was too quick about that, you forgot to update the example
config file with the newly added forbiddenHighlightChannels array
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/Knights-Of-Academia/horace/pull/124?email_source=notifications&email_token=AD36X52IDJA4QWMNFVR7AF3RCFKEPA5CNFSM4KQMJRT2YY3PNVWWK3TUL52HS4DFWFIHK3DMKJSXC5LFON2FEZLWNFSXPKTDN5WW2ZLOORPWSZGOCU3TSBA#pullrequestreview-355940612,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AD36X545UYFTVG4AIQ2KMWTRCFKEPANCNFSM4KQMJRTQ
.

Guess I forgot to save it or something, was sure I had pushed it.
Sorry again about delaying this further.


Bump the version number

There was one API added: set_contents_scale. This is a backward-compatible change.

Done in https://crates.io/crates/metal-rs/0.4.3


Punishments inconsistent working and not with current_period

I added punishments a few months ago and this was working fine along
    periods = client.periods
    jsondata = {}
    jsondata['punishments'] = []
    for period in periods:
    for punishment in client.current_period.punishments:
        jsondata['punishments'].append({
            'pid': period.id,
            'periodName': period.name,
            'periodStart': period.start.strftime("%Y/%m/%d"),
            'periodEnd': period.end.strftime("%Y/%m/%d"),
            'punid': punishment.id,
            'punishmentDate': punishment.given.strftime("%Y/%m/%d"),
            'punishmentDuringLesson': punishment.during_lesson,
            'punishmentCircumstances': punishment.circumstances,
            'punishmentReasons': punishment.reasons,
            'punishmentNature': punishment.nature,
            'punishmentDuration': str(punishment.duration)[:4],
            'punishmentHomework': punishment.homework,
            'punishmentExclusion': punishment.exclusion,
        })
    punishmentList = jsondata
    print(jsondata)

In this process, the first period is "Trimestre 1", this goes fine for the punishments received
Then it goes into Trimestre2 (since Feb) and it crashes
I tried for Semestre 1 (works() and Semestre 2 (crash) as well
Traceback (most recent call last):
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 206, in __call__
    json_value = json_value[p]
KeyError: 'placeExecution'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 221, in __call__
    json_value = converter(json_value)
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 1821, in <lambda>
    lambda x: [Punishment.ScheduledPunishment(client, i) for i in x],
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 1821, in <listcomp>
    lambda x: [Punishment.ScheduledPunishment(client, i) for i in x],
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 1758, in __init__
    place = self._resolver(int, "placeExecution")
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 216, in __call__
    raise ParsingError("Could not follow path", self.json_dict, path)
pronotepy.exceptions.ParsingError: Could not follow path

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/mnt/3692670A6ACD9016/docker/homeassistant1/python_scripts/pronote_old_attempts/test.py", line 38, in <module>
    for punishment in period.punishments:
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 523, in punishments
    return [Punishment(self._client, a) for a in absences if a["G"] == 41]
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 523, in <listcomp>
    return [Punishment(self._client, a) for a in absences if a["G"] == 41]
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 1820, in __init__
    self.schedule = self._resolver(
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 223, in __call__
    raise ParsingError(
pronotepy.exceptions.ParsingError: Error while converting value: Could not follow path

My assumption is that it crashes because of non-existing punishments assigned to Trimestre2
However, I do see one assigned in pronote-app for semsestre2
I tried to use client.current_period.punishments but this crashes too
My preference would be that it provides the data for 'current_period' at a minimum, it should at least not crash for others.
EDIT:
To make it more clear, I checked individual periods (as per client.periods)

Trimestre 1, contains 4, shows fine
Trimestre 2, contains 1, crash
Trimestre 3, contains 0, shows 0 no crash
Semestre 1, contains 4, shows fine
Semestre 2, contains 1, crash
Année continue, contains 5, crash
Bac blanc, should not apply for my kid,: crash
DNB Blanc, should not apply for my kid,: crash
Hors période: crash
Contrôle en cours de formation: crash

So is it crashing when there shouldn't be any punishments? This just looks like placeExecution could be null / not there. I'll fix that.

btw https://pronotepy.readthedocs.io/en/stable/quickstart.html#json-serialization

So is it crashing when there shouldn't be any punishments? This just looks like placeExecution could be null / not there. I'll fix that.
Not really, it does not crash for future Trimestre 3 which obviously has no punishments yet (I hope that stays that way :) )
But Semestre 2 has already 1 and so does Trimestre 2 ... they crash.
Could also be that the punishment record is making it crash?
Is there an alternative way to get to the object containing the single punishment in Sem/Tim 2?
I forgot to tell , running this on v2.9.0
And, I can of course help testing any proposal you have.

btw https://pronotepy.readthedocs.io/en/stable/quickstart.html#json-serialization

That one returns:
Traceback (most recent call last):
  File "/mnt/3692670A6ACD9016/docker/homeassistant1/python_scripts/pronote_old_attempts/test.py", line 38, in <module>
    serialized = period.to_dict(include_properties=True, exclude={"punishments", })
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 282, in to_dict
    slot = getattr(self, slot_name)
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 420, in averages
    crs = response["donneesSec"]["donnees"]["listeServices"]["V"]
KeyError: 'listeServices'

Got a 2nd punishment in ystdy and error remains.

Better but not yet...

pip uninstall pronotepy
pip install https://github.com/bain3/pronotepy/archive/refs/heads/master.zip
the same script test.py with serializer as above

python3 test.py
{'N': '133496952DB0623', 'G': 53, 'date': {'_T': 7, 'V': '19/10/2022'}, 'placeExecution': 4, 'duree': 60}
{
  "id": "11231A82509A784",
  "start": "2022-09-01 00:00:00",
  "name": "Trimestre 1",
  "end": "2022-11-23 00:00:00",
...
... **kicks back the 4 already retrievable**
...**the below line is new/different than before, followed by error**
{'N': '117393C3679A19A', 'G': 52, 'date': {'_T': 7, 'V': '03/03/2023'}}
Traceback (most recent call last):
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 206, in __call__
    json_value = json_value[p]
KeyError: 'duree'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 221, in __call__
    json_value = converter(json_value)
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 1833, in <lambda>
    lambda x: [Punishment.ScheduledPunishment(client, i) for i in x],
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 1833, in <listcomp>
    lambda x: [Punishment.ScheduledPunishment(client, i) for i in x],
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 1776, in __init__
    self.duration: datetime.timedelta = self._resolver(
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 216, in __call__
    raise ParsingError("Could not follow path", self.json_dict, path)
pronotepy.exceptions.ParsingError: Could not follow path

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/mnt/3692670A6ACD9016/docker/homeassistant1/python_scripts/pronote_old_attempts/test.py", line 39, in <module>
    serialized = period.to_dict(include_properties=True, exclude={"grades", "averages", "overall_average", "evaluations", "absences", "delays" })
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 282, in to_dict
    slot = getattr(self, slot_name)
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 523, in punishments
    return [Punishment(self._client, a) for a in absences if a["G"] == 41]
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 523, in <listcomp>
    return [Punishment(self._client, a) for a in absences if a["G"] == 41]
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 1832, in __init__
    self.schedule = self._resolver(
  File "/home/arjan/.local/lib/python3.10/site-packages/pronotepy/dataClasses.py", line 223, in __call__
    raise ParsingError(
pronotepy.exceptions.ParsingError: Error while converting value: Could not follow path

Hi, sorry, I've only tested it with detentions. It should now be Optional.

Sorry for asking / not understanding. How would you expect me to test this now, the previous (above) script did not work, did you change anything today or how do I get the data out?

OK, I repeated remove/install pronotepy and now it is working with above serilization script
As I am still (!) not the specialist, will this now work with current_period too?

The problem was that some fields were undefined in the response from pronote. Pronotepy assumed they would always be there, and so crashed when they were missing. It should work for all periods, including the current one.

Thanks, as mentioned will further test later this weak and report any other issues if any, for now it looks good :)

Confirming also current_period is working for me as well.
Note that there is still a 'print' statement somewhere, giving out lines like this:
{'N': '117F763D7AC54CE', 'G': 52, 'date': {'_T': 7, 'V': '24/03/2023'}}

Any idea when this will end up in a release?

And: THANKS

I'd like to release right after we close #213. Glad it works!


Update transfer-subscription.md

Update "Understand the impact of transferring a subscription" array. Add Synapse Analytics Workspace.

@rolyon
Can you review the proposed changes?
When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@rolyon, @amycolannino
Can you review this old PR and determine whether it needs to be closed or merged?

emailed assignees

Hi @BenoitNgs
Thanks for taking the time to provide your contribution. Unfortunately, we weren't able to merge your changes because of a merge conflict. We incorporated your updates in a separate pull request.
https://learn.microsoft.com/en-us/azure/role-based-access-control/transfer-subscription#understand-the-impact-of-transferring-a-subscription
Let us know if you have any additional feedback.
thanks

#please-close


Release 1.1.0 not available on pypi

I don't know if there's some delay on pypi's part or if a manual intervention is required but pip install does not work:
$pip install django-configurations==1.1.0
Collecting django-configurations==1.1.0
  Could not find a version that satisfies the requirement django-configurations==1.1.0 (from versions: 0.1, 0.2, 0.2.1, 0.3, 0.3.1, 0.3.2, 0.4, 0.5, 0.5.1, 0.6, 0.7, 0.8, 1.0, 2.0.dev0)
No matching distribution found for django-configurations==1.1.0

Apparently the auto deploy failed.
Uploading distributions to https://pypi.python.org/pypi
Uploading django_configurations-2.0.dev0-py2.py3-none-any.whl
Uploading django-configurations-2.0.dev0.tar.gz
/home/travis/virtualenv/python3.5.0/lib/python3.5/site-packages/setuptools/dist.py:283: UserWarning: The version specified requires normalization, consider using '2.0.dev0' instead of '2.0.dev'.
  self.metadata.version,
running upload_docs
creating build/docs
error: no files found in upload directory 'build/docs'

@codingjoe Just wrote you an email after discovering the wrong 2.0dev release to PyPI myself. This wasn't a failed auto deploy but a mistake on your part not bumping up the version nummer in the __init__.py file correctly.
Sorry all for the kerfuffle, I'll fix this asap.

@codingjoe For the future, since you've discovered the issue with the deploy over a month ago, I want to stress that for such cases in which Jazzband infrastructure doesn't work as intended you need to open a ticket for the Roadies. Thanks!

I just released 2.0 as the replacement for the broken 1.10 release. See the changelog for the details what changed.
In case you're curious, it became 2.0 and not say 1.10.1 since the changes in it also contained a deprecation of main features (e.g. support for Python 2.6 and 3.2) and 1.10 basically should never have happened in the first place.
Thanks all for the patience, sorry again for the trouble.


When will a new version be released?

Alternatively, you can grab the latest nightly from Circle CI by logging into Circle CI or adding #artifacts at the end of URL like such: https://circleci.com/gh/shadowsocks/v2ray-plugin/20#artifacts

e.g., https://circleci.com/gh/shadowsocks/v2ray-plugin/53#artifacts


Load assets in flutter_test without turning event loop.

This makes it possible to load an asset without actually turning the event loop. This is importnat because our FakeAsync zones may cause people to sprinkle in extra pumpAndSettles in when running tests that load assets, which is undesirable.
While I was here I noticed some unnecessary dynamic usage in SynchronousFuture.

I came across this because I'm working on rolling a new version of flutter_svg into Google's monorepo. Tests in there that previously worked because of google-specific magic now are missing assets because the rewrite assumes you can do this kind of thing synchronously in a test.
I'd like to get rid of all flutter_svg specific magic from test harnesses if possible.

I think if we can stick this change, i can delete the fake asset manager entirely and use the real one. Will need to experiment on my own

hah, I was wondering if that ! was safe and now know it wasn't. Cool. I'll fix it.


custom-selector: adds a button to delete the current folder in custom selector

Description (required)
Fixes #5811
What changes did you make and why?
Add functionality to enable folder deletion within the custom selector activity.
Folder Deletion Helper: encapsulates most of folder deletion logic, provides methods to confirm deletion with the user, handle deletion across different Android API levels, and display success or error messages.
CustomSelectorActivity: integrated folder deletion functionality into the custom selector activity, allowing users to select a folder and choose to delete it from the custom selector UI.
In custom selector toolbar, added overflow menu button, moved existing exceeding limit warning button a bit to the left to make space for overflow menu.
Tests performed (required)
Build variant: BetaDebug
Emulators:
Android 12.0 (S) - API 31
Android 10.0 (Q) - API 29
Android 8.0 (Oreo) - API 26
Screenshots (for UI changes only)

Would you mind fixing the conflict? Thanks!


Not working in Background

It's not working when the app goes to background. it doesn't show any count when a new message received from firebase when our app is in background .


Benchmark Stats

Hi,
I successfully installed your package. Thank you for providing convenient face recognition package. I wanted to inquire more about benchmark testing and accuracy. Do you have a paper or any additional references I could use for my research? Any statistical evidence or reference would be much appreciated.
Kind regards,
Almas M.

Since this library depends on the dlib implementation, the best description is this blog post: http://blog.dlib.net/2017/02/high-quality-face-recognition-with-deep.html
Here's where the description starts on that page (text written by Davis King, not me):

Also, the model has an accuracy of 99.38% on the standard Labeled Faces in the Wild benchmark. This is comparable to other state-of-the-art models and means that, given two face images, it correctly predicts if the images are of the same person 99.38% of the time.

For those interested in the model details, this model is a ResNet network with 29 conv layers. It's essentially a version of the ResNet-34 network from the paper Deep Residual Learning for Image Recognition by He, Zhang, Ren, and Sun with a few layers removed and the number of filters per layer reduced by half.

There's some more details on how the model was trained on that page (including a link to the training code).


Network pre-configuration during flash

It seems that Raspbian might already support this, so just adding docs on the process might be enough!

Hi @jareware ,
I started to write some docs regarding how to setup wpa_supplicant.conf in  #54 .


Not able to deploy nested acorn with images that are already present as remote image entries.

Server - acorn version v0.7.0-38-gdc95c02b+dc95c02b
Steps to reproduce the problem:

Deploy app using remote image - acorn run -n mytest1 sangeetha/myfirstacorn:v0.0.3
Deploy nested acorn using the same image.

acorns: {
    "my-acorn2": {
        image: "docker.io/sangeetha/myfirstacorn:v0.0.3"
    }
}

App deployment fails with following error:
  ✗  ERROR:  failed to finalize app image: HEAD http://<IP_ADDRESS>:5000/v2/acorn/acorn/manifests/sha256:c2baaa36aa251802a578c6e47ee1528477e21941e5704bb5c1420c72d2a782e9: unexpected status code 404 Not Found (HEAD responses have no body, use GET for details)

Fix merged to main just now.

Tested with acorn version - v0.7.0-59-gfa7ba122+fa7ba122
Able to deploy nested acorn with images that are already present as remote image entries.


New App Submission- Lead Wallet

App Logo (Required)
(Attach image here)

App Details (Required)
Type: Wallet
Name: Lead Wallet
Description:   Lead Wallet is a multi-blockchain and multi-functional decentralized crypto wallet application with web3 DApp browser feature, NFT and custom fungible token wallet support, fiat-to-crypto swap support, Dex Aggregator feature,  Multisender support, NFT and utility marketplace feature.
Homepage Url: leadwallet.io
Chains supported: BTC, ETH, BSC, Tron, Polygon, RSK, Conflux, Polkadot, Kusama, Celo, Dogecoin, Dash. (more chains in the pipeline)
Versions supported: Mobile and wallet connect
App Url (Required - at least one)
Browser Url: https://leadwallet.io/wallet
iOS Url: https://apps.apple.com/tt/app/lead-wallet/id1578704913
Android Url: https://play.google.com/store/apps/details?id=com.leadWallet
Mac Url:
Windows Url:
Linux Url:
Mobile Linking (Optional)
Deep Link:  leadwallet://wallet-connect/
Universal Link:  https://ws.leadwallet.io/api/api/v1/wallet-connect/
Desktop Linking (Optional)
Deep Link:  leadwallet://wallet-connect/
Universal Link: https://ws.leadwallet.io/api/api/v1/wallet-connect/
Metadata (Optional)
Short Name: Lead
Primary Color:  Pink (F90A88)
Secondary Color: Blue (3E2779)

Hi, could you please follow up on this request? Thank you

Added to the cloud registry.

Great. Thank you


E-Commerce Website

Is your feature request related to a problem? Please describe.
I want to an E-Commerce Website Project on this repo as there is nothing on it .
Describe the solution you'd like.
I will be using HTML,CSS,JS,Bootstrap to make it. And my code will be responsive.
Describe alternatives you've considered.
NA
Add any other context or screenshots about the feature request here.
I haven't made it till now

@Kushal997-das , Kindly assign


Size of sponsor panel doesn't fit to the others

it seems it is a litte bit to wide compared to the other boxes

Done, added additionally css to hide some columns of last results at smaller screen size


[th2-2401] added dependency to cradleapi 3.0.0-TH2-2401-1347174066-SNAPSHOT

This PR is redundant because the 3.0.0 cradle API is experimental


Add Chad holidays

Useful links:

https://en.wikipedia.org/wiki/Public_holidays_in_Chad
https://www.timeanddate.com/holidays/chad/

Implemented in #1279.


Allow option to fill in missing columns with null value

Feature description
For many APIs the records returned have optional keys. Those columns should be included in the schema, but if a batch comes through without those columns, rather than getting a schema mismatch error, it’d be ideal if dlt scaffolded those columns in the dataset with a null value to avoid issue and preserve schema continuity.

Yes, I run dlt in production.
Use case
Ingesting API data with columns that appear on a conditional basis to a database that expects a consistent schema with no columns missing.
Proposed solution
An option on the resource to have dlt add the  missing columns during the normalize stage and populate with a null value. Further customization could be possible with specifying a default value to use instead of null within the schema yaml.
Related issues
No response

You can just supply the columns argument to the @dlt.resource decorator and those should be guaranteed to exist.

You can just supply the columns argument to the @dlt.resource decorator and those should be guaranteed to exist.

Thanks! Would that require explicitly defining the table schemas in advance?
I assume since dlt.current.source_schema() would have nothing to offer on the first run without an explicit schema, dlt would revert to building the schema as it processes the data. Is that right?

dlt.current.source_schema() is not particularly relevant here. I just use it to access the configured normalizer for snake case conversion.
What is relevant is the columns argument my cursor is on. And what I am trying to highlight is the fact you can populate that argument however you want. In this case, I am populating the columns up front by using the SFDC describe API. You can do something similar for a database by querying the information schema. You can also just list out columns manually. Anything there should be created in the source.

Ahh alright, got it. Thanks @z3z1ma! That's slightly different from the functionality I'm requesting.
I'd like dlt to fill in the missing columns without having to supply the columns explicitly. At the moment, when the first run fails without supplying any column information, it seems to be with complete knowledge of the table schema and what columns are missing. I'd like dlt to use that info to standardize the schema across all records for me - no advanced input required.

@hello-world-bfree dlt infers the schema from the data. if optional fields are not present in the actual extract, they will not be added. @z3z1ma is right - if you have any additional columns that you want to add to the schema, you should add them as columns - all other columns will still be inferred btw.
if you have openAPI spec for your endpoint you can generate Pydantic models for the response items and then use them as columns. we are working on automating this process

Thanks @rudolfix! Is it wrong to say that subsequent pipeline runs have knowledge of the existing schema in the destination then?  That's the assumption I'm making given the schema evolution docs.
A common problem with any pipeline is that an upstream source system  removes a column without notice. If I'm understanding it right, dlt would fail the pipeline. To have to update my dlt code and manually add the removed column to columns whenever this happens to preserve my destination table and keep the pipeline running is functional, for sure, but less desirable than if the missing columns were handled without failure or user intervention.
Something akin to inserting incomplete data into most RDBMS; i.e., for a table employees that has the columns name, position, hire_date, and pay, I can still insert an incomplete record:
INSERT INTO employees (name, position)
VALUES ('John Doe', 'Software Engineer');

Thanks for bearing with me. I think I've got a better understanding now.
The issue seems to be on the initial pipeline run. If I try to run a complete backfill, it fails. However, if I only run a subset of the data that has a consistent schema (either no missing columns or only records with missing columns) for the initial run, it'll work just fine and I'll be able to backfill the rest of the subsequent data successfully.
I think it'd be helpful to have an additional step before load for an initial pipeline run that standardizes the schema across the entire dataset.

I think it'd be helpful to have an additional step before load for an initial pipeline run that standardizes the schema across the entire dataset.

Can you try specifying the columns kwarg like I mentioned. That standardizes it up front. I think it even takes a pydantic model. If you set it, the columns are guaranteed to exist. That bit has nothing to do with initial or subsequent run per-say. dlt just creates an initial schema from that argument and then schema inference/discovery takes it the rest of the way. Which means you would end up with a superset of the explicitly passed columns and discovered columns. A schema contract or pydantic model could probably lock that.
If your contention is that you don't want to specify the schema up front but you want the schema to be standardized, then you have a chicken and egg problem. dlt doesn't "know" the schema ahead of time. it only does if the source is able to discover the columns in some way and inform dlt via the columns kwarg or the dlt mark module. The former is exactly what I was doing in my screenshot.
If you believe it knows the schema ahead of time, then it is probably the state tables _dlt_<table> which are providing that continuity on subsequent run. But on a new dataset, those _dlt prefixed tables dont exist.
Let me know if any of this is useful.

Can you try specifying the columns kwarg like I mentioned. That standardizes it up front. I think it even takes a pydantic model. If you set it, the columns are guaranteed to exist.

Apologies for not being more clear @z3z1ma. That method 100% works and obtains the correct functional outcome, no doubt. My feature request looks to solve for the problem of missing columns by default, though, without explicit user intervention. The premise being that the superset of all columns in a dataset is the column set of the destination table schema, therefore the data should be loaded as such.

If your contention is that you don't want to specify the schema up front but you want the schema to be standardized, then you have a chicken and egg problem. dlt doesn't "know" the schema ahead of time.

While dlt may not know the schema ahead of time, it infers the schema during the normalization step, building the stored schema as it goes, right? Once all chunks of the dataset have been normalized, the stored schema has the superset of all columns. It has to in order to create the destination table. That's why I suggest that a means of using the stored schema to pad missing columns where they might exist to ensure all data to-be loaded with a standardized schema for a new dataset. It seems beyond the initial run, intermittent columns are not an issue.
Am I missing anything about the schema inference and storage process? And, definitely useful, thanks again!


swagger generate client panics

Problem statement
swagger generate client panics
Swagger specification
https://gist.github.com/arekkas/9b3c57b185c58b762a5211b26f641e96
Steps to reproduce
$ go get -u github.com/go-swagger/go-swagger/cmd/swagger
$ swagger generate client -f ./api.swagger.json -A hydrasdk
2017/09/26 14:07:45 building a plan for generation
2017/09/26 14:07:45 planning definitions
2017/09/26 14:07:46 planning operations
panic: runtime error: invalid memory address or nil pointer dereference
[signal 0xc0000005 code=0x0 addr=0x9 pc=0x957751]

goroutine 1 [running]:
github.com/go-swagger/go-swagger/generator.(*schemaGenContext).NewSliceBranch(0xc043d62000, 0xc043fccfc0, 0xc042720001)
        C:/workspace/go/src/github.com/go-swagger/go-swagger/generator/model.go:391 +0x131
github.com/go-swagger/go-swagger/generator.(*schemaGenContext).buildArray(0xc043d62000, 0x182d9a0, 0xc042daa3c0)
        C:/workspace/go/src/github.com/go-swagger/go-swagger/generator/model.go:1068 +0x14a
github.com/go-swagger/go-swagger/generator.(*schemaGenContext).buildItems(0xc043d62000, 0x0, 0x0)
        C:/workspace/go/src/github.com/go-swagger/go-swagger/generator/model.go:1104 +0xbfc
github.com/go-swagger/go-swagger/generator.(*schemaGenContext).makeGenSchema(0xc043d62000, 0xc043708c60, 0xf)
        C:/workspace/go/src/github.com/go-swagger/go-swagger/generator/model.go:1445 +0xab2
github.com/go-swagger/go-swagger/generator.(*codeGenOpBuilder).MakeResponse(0xc04249d600, 0xb9b13a, 0x1, 0xc043708c60, 0xf, 0xb9b301, 0xc04321aab0, 0xc8, 0x0, 0x0, ...)

Environment
swagger version: master
go version: 1.9
OS: Win10 x64

Tried it with 0.12.0 and 0.11.0 with the same result.

Same problem here

The reason is because in the swagger spec, the schema of clientsList response is defined as type: object. It should be type: array

Why does swagger validate work?

because it mostly uses a json schema for validation provided by upstream swagger.

This commit on go-open/validate
https://github.com/go-openapi/validate/commit/e8b25c4c6cccee94c578fa3bd0d3f5d459290d08
should fix this problem. We should close this issue if there are no further requirements


tech review for HAXM issues

There was an error while validating job 1bd53261-294f-4e64-9649-f7b46b195892 Message:Error clonning repositoryDetails:System.ArgumentException: Error clonning repository ---> System.Exception: Error when trying to initialize shared repository ---> LibGit2Sharp.NotFoundException: Branch 539 not found. Available branches:
at Microsoft.DPS.Services.LibGit2SharpSourceControlProvider.GetBranch(Repository repo, String name)
at Microsoft.DPS.Services.LibGit2SharpSourceControlProvider.<>c__DisplayClass3e.b__3d()
at Microsoft.Practices.EnterpriseLibrary.TransientFaultHandling.RetryPolicy.<>c__DisplayClass1.b__0()
at Microsoft.Practices.EnterpriseLibrary.TransientFaultHandling.RetryPolicy.ExecuteAction[TResult](Func1 func)    at Microsoft.Practices.EnterpriseLibrary.TransientFaultHandling.RetryPolicy.ExecuteAction(Action action)    at Microsoft.DPS.Services.LibGit2SharpSourceControlProvider.InitializeSharedRepository(String url, IDictionary2 branches, String sharedRepoPath)
at Microsoft.DPS.Services.LibGit2SharpSourceControlProvider.VerifySharedRepository(String url, IDictionary2 branches, String tempPath)    --- End of inner exception stack trace ---    at Microsoft.DPS.Services.LibGit2SharpSourceControlProvider.VerifySharedRepository(String url, IDictionary2 branches, String tempPath)
at Microsoft.DPS.Services.LibGit2SharpSourceControlProvider.CloneRepository(String url, IDictionary2 branches)    --- End of inner exception stack trace ---    at Microsoft.DPS.Services.LibGit2SharpSourceControlProvider.CloneRepository(String url, IDictionary2 branches)
at Microsoft.DPS.Services.LibGit2SharpSourceControlProvider.CloneRepository()
at Microsoft.DPS.Services.LibGit2SharpSourceControlProvider.GetTreeAsync(String path, Boolean includeSubDirectories, String excludePath, IList1 extensionWhiteList)    at Microsoft.DPS.Commands.IdentifyDocumentsToPublish.ListSourceControlFilesCommand.Do(IDictionary2 context)
at Microsoft.LightweightJobEngine.Core.Language.JobWorkflow1.RunCommands(Guid jobId, IDictionary2 context, CancellationTokenSource cancelSignal)


Tests crash for the shape inference

Hello all,
When I tried to run some scripts after updating to the latest version of Theano and Keras I had some errors.
I maybe didn't notice a change on my side but I tried to run the tests and it seems the shape inference is not behaving nicely:
Using gpu device 0: GeForce GTX 980 (CNMeM is disabled)
......FF.........
======================================================================
FAIL: test_shape_inference.test_Convolution1D
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/thomas/anaconda3/envs/anapy27/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
    self.test(*self.arg)
  File "/home/thomas/libraries/forks/keras/tests/test_shape_inference.py", line 75, in test_Convolution1D
    check_layer_output_shape(layer, input_data)
  File "/home/thomas/libraries/forks/keras/tests/test_shape_inference.py", line 18, in check_layer_output_shape
    assert output.shape[1:] == expected_output_shape, "output shape: {} expected output shape: {}".format(output.shape[1:], ex
pected_output_shape)
AssertionError: output shape: (2, 1) expected output shape: (3, 1)

======================================================================
FAIL: test_shape_inference.test_Convolution2D
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/thomas/anaconda3/envs/anapy27/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
    self.test(*self.arg)
  File "/home/thomas/libraries/forks/keras/tests/test_shape_inference.py", line 91, in test_Convolution2D
    check_layer_output_shape(layer, input_data)
  File "/home/thomas/libraries/forks/keras/tests/test_shape_inference.py", line 18, in check_layer_output_shape
    assert output.shape[1:] == expected_output_shape, "output shape: {} expected output shape: {}".format(output.shape[1:], ex
pected_output_shape)
AssertionError: output shape: (1, 2, 2) expected output shape: (1, 3, 3)

----------------------------------------------------------------------
Ran 17 tests in 7.296s

FAILED (failures=2)

I tried to digg in and I made my example work but the tests are still failing.
This is my reproductible example:
from sklearn.feature_extraction.image import extract_patches_2d
import theano
import keras

import numpy as np
np.random.seed(1337)

from keras.models import Graph
from keras.layers.core import Dense, Flatten
from keras.layers.convolutional import Convolution1D, MaxPooling1D

len_ts_y = 60
sample = 1000
Fs = 8000
f = 5
x_bug = np.arange(sample)

y_test = np.sin(2 * np.pi * f * x_bug / Fs)
y_test = y_test+np.random.normal(0, 0.2, sample)

data_patched = extract_patches_2d(y_test[:,None], (len_ts_y+1,1))
y_train = data_patched[:,:,-1]
endog_train = data_patched[:,-len_ts_y-1:-1,-1]

model = Graph()
model.add_input(name='endog', input_shape=(len_ts_y,1))

model.add_node(Convolution1D(nb_filter=4,
                            filter_length=2,
                            border_mode="same",
                            activation="relu",
                            subsample_length=1,
                            ),
                            name='conv_1', input='endog')
model.add_node(Flatten(), name="flat", input='conv_1')
model.add_node(Dense(32, activation="sigmoid"), name="Dense", input='flat')
model.add_node(Dense(1, activation="softplus"), name='last_dense', input='Dense')
model.add_output(name='output', input='last_dense')
model.compile(optimizer='sgd', loss={'output':'mse'})

model.fit({'endog': endog_train[:-100,:, None], 'output': y_train[:-100,-1]},
          validation_data={'endog':endog_train[-100:,:, None], 'output': y_train[-100:,-1]},
          batch_size=128,
          nb_epoch=4)

I changed the size of the output_shape in the conv_output_length function of convolutionnal.py to make the above example work :
def conv_output_length(input_length, filter_size, border_mode, stride):
    if input_length is None:
        return None
    assert border_mode in {'same', 'valid'}
    if border_mode == 'same':
        output_length = input_length
    elif border_mode == 'valid':
        output_length = input_length - filter_size + 1
    return ((output_length + stride - 1) // stride) - 1

Does anyone is having the same errors?
Thank you!

I can't reproduce, tests pass here and on Travis. And your script runs perfectly normally on my laptop.

AssertionError: output shape: (1, 2, 2) expected output shape: (1, 3, 3)

My best guess is that your version of Theano has a conv2d op that behaves abnormally. Just upgrade Theano to latest master branch and you should be fine.

I just checked theano version inside the test and it outputs the right one (0.7.0.dev-24ace59).
I just cleared the compile directory in my .theano folder to make sure I have a clean version but the two tests still fail.
I'm using CUDA 7.0 and cuDNN v2, could it be related?

Do you have the same issue on CPU?
It might be a bug of Theano's conv2d on GPU with a specific version of cuDNN. Who knows...

@fchollet Can you look into #1274

It's working on CPU. Because I have CUDA 6.5 and CUDA 7.0 installed to test tensorflow, I'll try to reinstall cuDNN v3 in the 6.5 folder and rerun the tests.
Right after the release off Keras supporting Tensorflow and Theano, I was able to run both backends.
Tx for the tips, I'll keep you posted!

No luck, I tried the four combinations of CUDA/cuDNN and it still fails. I also tried to checkout older versions of the 2 repos back to 2 weeks from now without success. If someone has a working config for both Theano and Tensorflow working on gpu on Ubuntu 14.04, I would be interested to have some advices :smile: (versions and environment vars). I will try to build a new config from scratch in Docker tomorow.
I'm still able to run my scripts and the tests using border_mode='valid' though...
@farizrahman4u sorry to open another issue, I'm not sure if these 2 are related and I didn't want to mix Windows and Ubuntu. If it turns out it's the same problem don't hesitate to reference this one.

I just finished to test the same scripts with both Theano  (CUDA 7.0 + cuDNN v3) and Tensorflow (CUDA 7.0 + cuDNN v2) in Docker containers and everything works as expected. I don't know what happened but it isn't a Keras related issue.

Really sorry to repoen the issue. I thought it was a config bug but I changed the size of the filters with the new config the last time I used the scripts.
To have a clean environment, I used this container built with CUDA 7.5 and cuDNN v3 and the error arise when the filters have an even size when using 1d convolutions with Graph models (including the example above). The imdb_cnn_lstm example is running fine so I will rewrite it using Graph. The tests also fail and I will digg in the code tomorow.
I'm not sure where to look to point out the bug so if you have any suggestion I will be happy to debug.
Thank you!

Update: the bug happens only when using cuDNN.
When bypassing it in the theano_backend everything work as expected:
    if _on_gpu() and dnn.dnn_available() and False:
        if border_mode == 'same':
            assert(strides == (1, 1))
            np_kernel = kernel.eval()
            pad_x = (np_kernel.shape[2] - strides[0]) // 2
            pad_y = (np_kernel.shape[3] - strides[1]) // 2
            conv_out = dnn.dnn_conv(img=x,
                                    kerns=kernel,
                                    border_mode='full')
        else:
            conv_out = dnn.dnn_conv(img=x,
                                    kerns=kernel,
                                    border_mode=border_mode,
                                    subsample=strides)

With a simple script I tried to higlight the bug:
import numpy as np
import theano
import itertools
from keras.layers.convolutional import Convolution1D, Convolution2D

# Convolution 1D
l_in = (100, 16)
x = np.random.randn(20, 100, 16).astype(theano.config.floatX)

for layer, mode, f_size in itertools.product([Convolution1D],
                                                         ['valid', 'same'],
                                                         [3, 4, 7, 8]):
    try:
        l_1 = layer(input_shape=l_in, nb_filter=10, filter_length=f_size, border_mode=mode)
        out = theano.function([l_1.get_input()], l_1.get_output())
        print("conv1D, {}, {}, {}".format(mode, f_size, out(x).shape))
    except Exception as e:
        print(e)

# Convolution 2d
l_in = (3, 100, 100)
x = np.random.randn(20, 3, 100, 100).astype(theano.config.floatX)

for layer, mode, f_size in itertools.product([Convolution2D],
                                                         ['valid', 'same'],
                                                         [3, 4, 7, 8]):
    try:
        l_1 = layer(10, f_size, f_size, border_mode=mode, input_shape=l_in)
        out = theano.function([l_1.get_input()], l_1.get_output())
        print("conv2D, {}, {}, {}".format(mode, f_size, out(x).shape))
    except Exception as e:
        print(e)

and I have this output when using cuDNN:
Using Theano backend.
conv1D, valid, 3, (20, 98, 10)
conv1D, valid, 4, (20, 97, 10)
conv1D, valid, 7, (20, 94, 10)
conv1D, valid, 8, (20, 93, 10)
conv1D, same, 3, (20, 100, 10)
conv1D, same, 4, (20, 99, 10)
conv1D, same, 7, (20, 100, 10)
conv1D, same, 8, (20, 99, 10)
conv2D, valid, 3, (20, 10, 98, 98)
conv2D, valid, 4, (20, 10, 97, 97)
conv2D, valid, 7, (20, 10, 94, 94)
conv2D, valid, 8, (20, 10, 93, 93)
conv2D, same, 3, (20, 10, 100, 100)
conv2D, same, 4, (20, 10, 99, 99)
conv2D, same, 7, (20, 10, 100, 100)
conv2D, same, 8, (20, 10, 99, 99)

Results without cuDNN:
conv1D, valid, 3, (20, 98, 10)
conv1D, valid, 4, (20, 97, 10)
conv1D, valid, 7, (20, 94, 10)
conv1D, valid, 8, (20, 93, 10)
conv1D, same, 3, (20, 100, 10)
conv1D, same, 4, (20, 100, 10)
conv1D, same, 7, (20, 100, 10)
conv1D, same, 8, (20, 100, 10)
conv2D, valid, 3, (20, 10, 98, 98)
conv2D, valid, 4, (20, 10, 97, 97)
conv2D, valid, 7, (20, 10, 94, 94)
conv2D, valid, 8, (20, 10, 93, 93)
conv2D, same, 3, (20, 10, 100, 100)
conv2D, same, 4, (20, 10, 100, 100)
conv2D, same, 7, (20, 10, 100, 100)
conv2D, same, 8, (20, 10, 100, 100)

@fchollet not sure if you could reproduce the bug with cuDNN?

I don't readily have access to a GPU, so I won't be able to repro.
Does this happen with every cuDNN version? Specifically, does this happen with R4?

This change cause the conv2d with border_mode='same' to be more than twice as slow. Could there be another work around?
Please try to run this code on keras before and after the fix:
from keras.models import Sequential
from keras.layers.core import Flatten
from keras.layers.convolutional import Convolution2D, MaxPooling2D
model = Sequential()
model.add(Convolution2D(64, 5, 5, border_mode='same', input_shape=(1, 1, 1)))
model.add(MaxPooling2D(pool_size=(6, 6)))
model.add(Convolution2D(64, 1, 1))
model.add(Flatten())
model.compile(loss='hinge', optimizer='rmsprop')

X_train = {'input1': numpy.random.rand(64000, 1, 48, 48).astype('float32'),
           'output1': numpy.random.rand(64000, 64, 8, 8).reshape(64000, -1).astype('float32')}
model.fit(X_train['input1'], X_train['output1'], batch_size=64, verbose=True, nb_epoch=3)`

On my machine, each epoch takes 10sec before the change, and 23 secs after.


Update tutorial-lemp-stack.md

"Azure AD" is the old name so I've updated references to "Microsoft Entra ID"

@ju-shim - The GitHub author for this article is no longer valid. Can you review this PR and perhaps update the metadata via the private repo?
IMPORTANT: When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@ju-shim
Can you review this old PR and determine whether it needs to be closed or merged?
IMPORTANT: When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge. If the changes no longer apply, add an explanation and a #please-close comment to close the PR.
@MicrosoftDocs/public-repo-pr-review-team

I sent a Teams message to the author today.

I sent an email to the content owner today.

#sign-off


feat: [WIP] remove sandbox and cli npm pkgs

Removes publishing of sandbox and cli npm packages
Also removes its references from the code
TODO -

Update the aztec-cli update command
Make changes to the bash script

Update the aztec-cli update command

I have done the following changes to aztec-cli update:

It no longer fails if it doesn't detect package.json. So it can now be used to update contracts on their own aztec-cli update --contract path/to/some/folder
Instead of looking for the latest @aztec/aztec-sandbox, it now looks for the latest @aztec/aztec.js.
It checks if sandbox is running. If it is, it logs to the console if the versions don't match. If sandbox is running it prints a reminder to update and links to docker update instructions.
It looks in package.json for @aztec/aztec-sandbox and @aztec/cli and if detected prints a warning. It doesn't prevent the update though.

I'm considering dropping the check in step 3 and always print the docker update instructions. If sandbox isn't running it delays the whole command by ~5-6 seconds while it tries to connect to a server that's not running.

Make changes to the bash script

Not needed anymore as we have an aztec-up command to manage the docker images as of #3617

@alexghr responding to your comment:

1/2 -> makes sense
3 -> makes sense to skip. PS - the docker update insutrctions should simply be aztec-up !!!

I think we should also mark the cli and sandbox packages as deprecated on npmjs.com.
https://docs.npmjs.com/deprecating-and-undeprecating-packages-or-package-versions

@alexghr deprecated on npmjs.com - https://www.npmjs.com/package/@aztec/aztec-sandbox?activeTab=versions

I think a box was refercing one of bash wrappers for the cli 😟

fixed!


Improve browsability of API reference

This PR adopts NumPy-like documentation style

LGTM. Although I like it, I would like the opinion of other members as I greatly changes the style of the document,

LGTM. I feel it improves the browsability of documentation.

@mitmul Thank you for your comment.

LGTM. I have one comment; I feel the font size of the link texts in the tables is a bit small and difficult to look through. Can we enlarge the link texts? It might be rather the problem of CSS design; just changing the style of the links to symbols might be ok.

Thank you for comments.
I fixed the text styles and doc generation of class member methods/attributes.
I did a bit tricky thing to render special methods (e.g. __call__ and __eq__),
as autosummary does not offer such flexibility.

@beam2d Could you check the PR again?

Will check soon

Sorry for being late. Looks great!

Should we backport this PR to v2?


preparations for js-ipfs 0.32

I upgraded ipfs in the devDependencies to 0.32.0-rc.2 and ran the tests - they passed \o/
https://github.com/ipfs/js-ipfs/issues/1497

I believe we can close this, superseded by #183

Yep. Thanks @alanshaw.


operator gitlab-runner-operator (1.18.1)

@ggeorgiev-gitlab you still have failing PRs for previous bundles of this operator. You will have to fix those first.


Does not allow to chain regex

Description
Zod allows for chaining regex, but when used with superforms it gives the error: "Only one regex is allowed per field".
If applicable, a MRE
https://stackblitz.com/edit/sveltekit-superforms-bug-reporting-tphkb6?file=src/routes/+page.server.ts

This is because the constraints only allows one regexp value, so the mapping will fail otherwise, but in 1.0 it will be possible with a warning, that can be turned off.

Closed as a duplicate of #115

Opening again, until 1.0 is released!


Optimization: Signature for Body+ObjectId

Discussed in https://github.com/buckyos/CYFS/discussions/128

Originally posted by streetycat March 17, 2023
I find that, I need to sign Body and Desc separately if I want to prove the authenticity of the object. It consumes a lot of space and efficiency.
If we add the ObjectId into the signature data, we can achieve the same with the signature:
Sign(Hash(Body+ObjectId))

If this problem is to be solved, there are currently two options under consideration.

Modify in the signature section
This seems to be the most direct method, but it feels strange to add a signature type. The current signature is the signature of the desc and body parts. If you need to customize the body part signature and introduce the type, it may increase additional mental burden.

Add the object_id field in the body part
In the current body section, add the following fields:

object_id: Option<ObjectId>

If this field is specified, it means that the body has been bound to the target desc, and the body is signed on this basis, which is the overall signature
When verifying whether the body has a desc.public_key signature, two things need to be done

If body.object_id is not None, then we need to check whether it matches at first
Use desc.public_key to verify whether the signature of the body is valid

The potential risk of this scheme is the codec compatibility problem caused by the introduction of fields

At present, in cyfs system, with mut-body objects unless special needs, is not recommended, in a relatively small number of cases will be used, there are generally the following two situations:

Local use in cyfs-stack
Only in the stack internal use, such as StorageObject, to maintain data consistency is also the simplest, in this case is not the need for signature and other measures

Used through MetaChain
If you need to "expose" the object to the outside, then you need strong consistency, such as the current People, Device objects, these objects are currently published, updated and queried through MetaChain.

If the MetaChain is used, only the owner of the object has the right to update the object, and if others "forge" the object, they cannot update the MetaChain, and it is difficult to proliferate in the cyfs network, so this "attack problem" can be avoided to some extent. So to some extent, this "attack problem" can be avoided, but there is still a potential risk
So in the long term, it is necessary to provide a mechanism to avoid this possible risk from a security and completeness perspective

If this problem is to be solved, there are currently two options under consideration.

Modify in the signature section
This seems to be the most direct method, but it feels strange to add a signature type. The current signature is the signature of the desc and body parts. If you need to customize the body part signature and introduce the type, it may increase additional mental burden.
Add the object_id field in the body part
In the current body section, add the following fields:

object_id: Option<ObjectId>

If this field is specified, it means that the body has been bound to the target desc, and the body is signed on this basis, which is the overall signature
When verifying whether the body has a desc.public_key signature, two things need to be done

If body.object_id is not None, then we need to check whether it matches at first
Use desc.public_key to verify whether the signature of the body is valid

The potential risk of this scheme is the codec compatibility problem caused by the introduction of fields

Currently, we are considering using the solution mentioned in 2, which involves the following changes.

Modify ObjectMutBody
Add an optional field inside the ObjectMutBody

object_id: Option<ObjectId>

Also, add flags for coding compatibility
pub const OBJECT_BODY_FLAG_OBJECT_ID: u8 = 0x01 << 3.

when generating object, someone can choose body.object_id = desc.object_id to achieve the binding of body and desc
Everyone need to check whether body.object_id matches with desc.object_id in the place where check body signature

In the final implementation, the ext field reserved in the last object codec refactoring is enabled, ObjectBodyExt struct is introduced, and the compatibility coding based on protobuf is adopted to deal with the subsequent demand of dynamically expanding fields and avoid the problem of inability to decode due to compatibility.
https://github.com/buckyos/CYFS/blob/b7cca8824ac0b6affc30c2c8076346111d344ca7/src/component/cyfs-base/src/objects/object.rs#L447-L463
The object body adds the corresponding methods

pub fn object_id(&self) -> &Option.
pub fn verify_object_id(&self, object_id: &ObjectId) -> BuckyResult<()>.
pub fn set_object_id(&mut self, object_id: Option).

AnyNamedObject also adds the corresponding methods

pub fn body_object_id(&self) -> &Option.
pub fn verify_body_object_id(&self, object_id: &ObjectId) -> BuckyResult<()>.

Also the signature verification has been improved accordingly, involving the following methods

pub async fn verify_object_body_sign<D, V, N>.
AnyNamedObjectVerifyHelper::verify_body_sign


Add DefaultBodyModelValidator unit test for case where same object is encountered in multiple paths.

// Pop the object so that it can be validated again in a different path
validationContext.Visited.Remove(metadata.Model);

Test needs to be added for the above code path in ValidateNonVisitedNodeAndChildren in DefaultBodyModelValidator.

@harshgMSFT can you verify if we already have a test for this?

I'm not @harshgMSFT - but he did add a testcase for this.