Custom extension scripts executing again

Hi,
We deployed the cluster using the marketplace template (using elastic version 2.4.1) and customised the kibana.yml and elasticsearch.yml to use different ports, storage account keys for backups etc. It has been working fine with those changes. Last week in one cluster we tried to disable the vm diagnostic logs from the azure portal and by doing that the kibana.yml and elastichseach.ymls got reset to the default (with the settings when a fresh cluster is deployed). Last week in another cluster we enabled the azure VM backup agent for a one off VM backup and noticed the same thing happened here as well. Looking into it further we noticed that the custom scripts are being executed again as the custom scripts extension agent was changed from 2.0.2 to 2.0.3.
Are we ok to remove the custom scripts extension or are those scripts (data-node-install.sh, vm-disk-utils-0.1.sh, kibana-install.sh, elasticsearch-ubuntu-install.sh and user-information.sh) required to there on a running cluster?
thanks
Deepak

Custom script extensions can run again when a VM is re-provisioned e.g. if you stop the VM via Azure portal, and start the VM again, the VM will be re-provisioned, so the script will run again. This is part of Azure.
The elasticsearch script has a measure in place to allow it to be run more than once, but the default elasticsearch.yml configuration that it sets up will be different to the one that you have modified it to.
I wouldn't recommend removing the scripts as I expect this would cause an error within Azure if the VM needs to be re-provisioned. I think it may make the most sense to fork this repository, make your changes, then use your fork to deploy a cluster from the command line.
After forking, if you clone locally and run
npm install

to install all the node packages, then
npm run links

All of the resource URIs within the repository will be changed to point to your github clone. Then, when deploying from the command line, use
https://raw.githubusercontent.com/<USER>/<REPOSITORY>/<GITHUB COMMIT/TAG/BRANCH>/src/mainTemplate.json

for the template url and
https://raw.githubusercontent.com/<USER>/<REPOSITORY>/<GITHUB COMMIT/TAG/BRANCH>/src

for the artifactsBaseUrl template parameter value. You'll need to substitute <USER>, <REPOSITORY> and <GITHUB COMMIT/TAG/BRANCH> for the values that make sense for your fork

Thanks for the info russcam.
I understand that if i remove the scripts only then there might be an error in azure when it tries to look for the script that are no longer there. What if we removed the custom script extension itself which would then mean Azure wouldnt check for the scripts and would not try to run them.

After some digging around we noticed that when we deployed the cluster from the template the custom script agent 2.0.2 got installed. After around a month and half when we did the diagnostic log or backup change they installed an agent on the vm and in the process the custom script agent got updated to 2.0.3.
When the custom scripts are run they store the seqnum in the path /var/lib/waagent/custom-script/seqnum. The agent checks this file to see if it has to run the custom scripts already. During the upgrade from 2.0.2 to 2.0.3 the process removed the folder /var/lib/waagent/custom-script and recreated it therefore the seqnum file was empty and as a result of that the scripts ran again.
We have removed the custom script extension from the VMs so the scripts are not run again.


Extend support for passing engine related parameters when adding hosts.

Expose the following fields in UI when adding hosts:
engine-opt
engine-insecure-registry: Specify insecure registries to allow with the created engine
engine-registry-mirror: Specify registry mirrors to use
engine-label: Specify labels for the created engine
engine-storage-driver: Specify a storage driver to use with the engine
engine-env
engineInstallUrl

Tested with rancher-server version - V0.50.0-rc4
When adding host , user is presented with docker engine related options that can be passed.

i know this issue is close - and this is quite unconventional - but great addition!


Metal Processing with Better Beginnings

@Divineaspect, we talked about making BB's smelter take seared bricks to craft and increasing the difficulty of obtaining seared bricks even further. Also, currently, the smelter allows for processing iron, which makes the bloomery less worthwhile. Did you want to disable this route of iron processing? Alternatively, shall I change the iron ore that is found in the Nether to be, say, goethite, hematite, or magnetite instead of "iron ore" to force the requirement of processing it in the bloomery?
It might require an extra step (convert abyssal iron to rockhounding ore, because I don't think that no matter how I change abyssal iron it will go into the bloomery unless I use Rockhounding's API), but this should be manageable.
Finally, the smelter looks like it is made of grey stone. If we use seared stone, I could edit the texture to be closer to the seared brick texture. If we're feeling ambitious, I could do similar to the bloomery.

yeah the smelter needs iron removed from it, but leaving / adding all other metals, except maybe bauxite/aluminum?
The nether iron ore is processable in the bloomery already.


Update _config.yml

ok

It looks like you are attempting to push a change to the template repository, for help with deploying your own website please start a new thread in the discussions.


[doc][elasticsearch-sink] Remove 'compatibilityMode' from the Pulsar 2.10 docs

Motivation
ElasticSearch Sink configuration doc contains a parameter which is not included in Pulsar 2.10.0
The parameter is compatibilityMode.
https://pulsar.apache.org/docs/en/io-elasticsearch-sink/#configuration
https://github.com/apache/pulsar/pull/14805
Modifications
Removed the parameter from 2.10 doc

[x] doc

@Anonymitaet @freeznet PTAL

@freeznet can you review this PR from the technical perspective? Then writers can review it from the technical writing perspective, thanks.
@nicoloboschi are the changes suitable for the docs on master as well? If so, would u like to update it?

for the master branch we have to keep that parameter because the related feature has been merged (https://github.com/apache/pulsar/pull/14805) and it will be shipped in 2.11

cc @momo-jun


Add step to launch Voilà

For consistency with the other UIs mentioned above.

@jtpio any chance you'd be willing to take on one extra thing on this PR, which is to add a sentence at the end of each section like
"To learn more about XXX and how to use it, see "
? I think it could make it easier for people to find their next step. However if you prefer i also think this is fine to just merge as is

Happy to do that in a separate PR yes.
The install page might need some rework anyway based on the discussions on Twitter: https://twitter.com/choldgraf/status/1554469239293202434

Also I opened https://github.com/jupyter/jupyter.github.io/pull/698 to fix the failing CI check.


[SPM] Adds SPM support

@taimoorsuleman Can we merge this PR? I see that it is blocked on the CircleCI configuration issue.

Any one know who has access to this repository's settings to disable the older ci/circleci check and only keep the new one?
I added SPM support and also fixed the CI and the tests in this PR. But am blocked on this deprecated check to merge this change.
Any help would be greatly appreciated! cc @segiddins @mattt 🙇


As a user I want to have data loaded from the server displayed in a datagrid.

mockdata-endpoint: /v1/mockdata


[Community/Meta] IRC, Telegram, Slack channel for WSL community?

Many open source projects have a live chatroom in addition to bug trackers, mailing lists, and wikis. They seem to be part of the community toolkit around open source projects. There seems to be some benefit to the live interaction in addition to more asynchronous communication.  It is also likely that some of WSL's potential target users are already using IRC and Telegram.
I think designating a WSL live chatroom somewhere would be useful, for referencing on the README.md and pointing people to for additional assistance. I am posting this to generate discussion about this idea. Of course there is where to chose from: IRC, Slack, Telegram, Discord. There is already ##windows-wsl on Freenode and it is usually populated by ~30 folks.

Closing out this discussion. If somebody would like to make a channel please submit a PR to the readme with the link.


applicationhost.config documentation & readme enhancements

Based on the discussion from this PR https://github.com/NuGet/NuGetGallery/pull/3335 I added a couple of line to describe the current situation.
Hope this helps.

Thanks @robertmuehsig !


Can only ping hosts on same network on self-hosted on Oracle

Describe the problem
Can only ping other Netbird hosts on the same local network
To Reproduce

Install Netbird self-hosted on Oracle Cloud Infrastructure (2 vCPU/12GB RAM/Ubuntu 22.04).
Complete setup process
Add peers on local and remote networks
run sudo iptables -I INPUT -p udp -m udp --dport 3478 -j ACCEPT as per https://docs.netbird.io/selfhosted/selfhosted-guide#oracle-cloud-infrastructure-oci
try to ping local hosts
try to ping remote hosts

A clear and concise description of what you expected to happen.
Pinging to work between networks
Are you using NetBird Cloud?
No, using selfhosted
NetBird version
0.27.10
Additional context
All hosts are showing as green on the Netbird dashboard.
When running status -dA I note the clients I can't ping are showing as offline in that output despite being online on the dashboard.
NetBird status -dA output
Peers detail:
 pixel8.netbird.selfhosted:
  NetBird IP: <IP_ADDRESS>
  Public key: spdafpxNQ9EeM3tPZq3J59T50P5C3/qnxFD72ZaLbQg=
  Status: Disconnected
  -- detail --
  Connection type: P2P
  Direct: false
  ICE candidate (Local/Remote): host/host
  ICE candidate endpoints (Local/Remote): <IP_ADDRESS>:51820/<IP_ADDRESS>:51820
  Last connection update: 19 hours, 11 minutes ago
  Last WireGuard handshake: 2 minutes, 4 seconds ago
  Transfer status (received/sent) 5.9 KiB/1.8 KiB
  Quantum resistance: false
  Routes: -
  Latency: 0s

 chillblast-edi.netbird.selfhosted:
  NetBird IP: <IP_ADDRESS>
  Public key: VZfY5WgbKibJNCU/WzMqoX8hBn9iyC3YxoTqiizSmwM=
  Status: Disconnected
  -- detail --
  Connection type: P2P
  Direct: false
  ICE candidate (Local/Remote): host/host
  ICE candidate endpoints (Local/Remote): <IP_ADDRESS>:51820/<IP_ADDRESS>:51820
  Last connection update: 19 hours, 28 minutes ago
  Last WireGuard handshake: 2 minutes, 4 seconds ago
  Transfer status (received/sent) 5.9 KiB/1.8 KiB
  Quantum resistance: false
  Routes: -
  Latency: 39.862337ms

 pi4.netbird.selfhosted:
  NetBird IP: <IP_ADDRESS>
  Public key: xoSpZtj5S4NADpy/Ln1L9X7T2KwG3QvEX6h5/04onwQ=
  Status: Connecting
  -- detail --
  Connection type: P2P
  Direct: false
  ICE candidate (Local/Remote): host/host
  ICE candidate endpoints (Local/Remote): <IP_ADDRESS>:51820/<IP_ADDRESS>:51820
  Last connection update: 8 seconds ago
  Last WireGuard handshake: 2 minutes, 4 seconds ago
  Transfer status (received/sent) 5.9 KiB/1.8 KiB
  Quantum resistance: false
  Routes: -
  Latency: 0s

 chillblast-dnd.netbird.selfhosted:
  NetBird IP: <IP_ADDRESS>
  Public key: BgIDgECerz62sgaC4U4dSLW8MvEXGBr0PGu62TH7bwA=
  Status: Connected
  -- detail --
  Connection type: P2P
  Direct: true
  ICE candidate (Local/Remote): host/host
  ICE candidate endpoints (Local/Remote): <IP_ADDRESS>:51820/<IP_ADDRESS>:51820
  Last connection update: 37 minutes, 30 seconds ago
  Last WireGuard handshake: 2 minutes, 4 seconds ago
  Transfer status (received/sent) 5.9 KiB/1.8 KiB
  Quantum resistance: false
  Routes: -
  Latency: 1.614116ms

OS: linux/arm (ARMv)
Daemon version: 0.27.10
CLI version: 0.27.10
Management: Connected to <https://network.anon-aHrXN.domain:443>
Signal: Connected to <https://network.anon-aHrXN.domain:443>
Relays:
  [stun:network.anon-aHrXN.domain:3478] is Unavailable, reason: stun request: context deadline exceeded
  [turn:network.anon-aHrXN.domain:3478?transport=udp] is Unavailable, reason: allocate: all retransmissions failed for xIkecmxLzfjXr1y/
Nameservers:
FQDN: pi400.netbird.selfhosted
NetBird IP: <IP_ADDRESS>/16
Interface type: Kernel
Quantum resistance: false
Routes: -
Peers count: 1/4 Connected```

[Slack Message](https://netbirdio.slack.com/archives/C05T5K65X7U/p1718045885486609)

@EDIflyer it seems like your relay service is not reachable. Can you run the test from this page? https://docs.netbird.io/selfhosted/troubleshooting

Hi @mlsmaycon sorry for the slow reply, been tied up with work.  Have tried it out and I get the following (server name redacted)...
Note: errors from onicecandidateerror above are not necessarily fatal. For example an IPv6 DNS lookup may fail but relay candidates can still be gathered via IPv4.
The server stun:netbird.<MYDOMAIN.COM>:3478 returned an error with code=701:
STUN host lookup received error.
The server turn:netbird.<MYDOMAIN.COM>:3478?transport=udp returned an error with code=701:
TURN host lookup received error.
The server stun:netbird.<MYDOMAIN.COM>:3478 returned an error with code=701:
STUN binding request timed out.
The server turn:netbird.<MYDOMAIN.COM>:3478?transport=udp returned an error with code=701:
TURN allocate request timed out.

Just to update - to be doubly-certain all the required ports were open I've run the following commands:
sudo iptables -A INPUT -p tcp -m multiport --dports 80,443,10000,33073 -j ACCEPT
sudo iptables -A INPUT -p udp -m multiport --dports 3478,49152:65535 -j ACCEPT

However I'm still having the same issue that I can only ping devices on the same local network.

Here's the coturn docker logs too.
I do note that the domain name is set to netbird.relay.selfhosted (which isn't correct) and realm of wiretrustee.com which also doesn't seem relevant?
coturn.txt


[657_download_change] fails to resume syncing after being backgrounded

use branch change_how_blocks_sync of ECC wallet
While syncing a testnet wallet on ECC Wallet go to home and wait for the OS to stop syncing.
Then tap the app on the simulator to bring it to foreground.

@pacu What do you think?

I specifically checked the logs to know it had stopped logging and doing stuff and it had not changed the status of the processor. It's possible that it's hard to reproduce because there are many factors at play that we don't control. I can try to gather more info.

@pacu I was testing this with changes from #691. And I tried everything. And I am not sure if I experienced the case that you described originally but it seems to me that with #691 it's fine.

let's mark that PR then with Closes #678


Allow to skip build by adding [skip ci] to the commit message

Describe the solution you'd like
It would be good to have out of the box a feature that allows you to prevent certain commits from triggering a new build. This is extremely useful when committing eg. a version bump to the project. The tags could be eg.:

[skip ci]
[ci skip]

Describe alternatives you've considered
Create a script that could check the current commit message and try to match the skip-ci tags. Still this script would need to be added to each project separately, what is not convenient.
Additional context
n/a

@hkosacki thanks for this feature request! I can understand how the build script workaround is tedious when working with several projects. I'll keep this feature request open to track total interest.

@nrajpurkar right now we're able to wkorkaround this using following shell script:
if [[ $commit == *"[SKIP CI]"* ]]; then
    curl -i -X PATCH -H "X-API-Token:$APPCENTER_API_TOKEN" -H "Content-Type: application/json" -d "{\"status\":\"cancelling\"}" https://appcenter.ms/api/v0.1/apps/xxx/yyy/builds/$APPCENTER_BUILD_ID
else
    echo "Continue building"
fi

The important part is to allow cancelling the builds, so in the end we won't end up with all builds being red in the end 😉

Hey @nrajpurkar, are there any chances to see this feature live? 😉

Hey @hkosacki, this is not currently in our plans for May, but we'll continue to discuss this item as we prioritize work in the future.

I think between this and #26 there is potential for some more flexible build configuration which would reduce noise, reduce cost/consumption of build time and follow CI practices that are familiar in other platforms.

I am missing this feature. Canceling builds manually is quite tedious.

This is a really important feature. It's limiting the use of App Center for us. Also this is currently available in Azure Pipelines and we use it extensively in our web projects to commit build numbers back to our repo after build succeeds. we would have to fall back to Azure Pipelines in the meantime to build and deploy until this feature is released.

please implement this - such a waste of build time to trigger builds for silly things like updating the README file on github

@nilofer Any updates on this feature request?

@elamalani to provide an update.

MS announced that there will be no feature development on App Center until mid 2021. So hope you don't need it soon 😒

@nrajpurkar right now we're able to wkorkaround this using following shell script:
if [[ $commit == *"[SKIP CI]"* ]]; then
    curl -i -X PATCH -H "X-API-Token:$APPCENTER_API_TOKEN" -H "Content-Type: application/json" -d "{\"status\":\"cancelling\"}" https://appcenter.ms/api/v0.1/apps/xxx/yyy/builds/$APPCENTER_BUILD_ID
else
    echo "Continue building"
fi

The important part is to allow cancelling the builds, so in the end we won't end up with all builds being red in the end 😉

as much I would want this to work, $commit is empty on appcenter builds

@nrajpurkar right now we're able to wkorkaround this using following shell script:
if [[ $commit == *"[SKIP CI]"* ]]; then
    curl -i -X PATCH -H "X-API-Token:$APPCENTER_API_TOKEN" -H "Content-Type: application/json" -d "{\"status\":\"cancelling\"}" https://appcenter.ms/api/v0.1/apps/xxx/yyy/builds/$APPCENTER_BUILD_ID
else
    echo "Continue building"
fi

The important part is to allow cancelling the builds, so in the end we won't end up with all builds being red in the end 😉

as much I would want this to work, $commit is empty on appcenter builds

I ended up with this script. Add it to appcenter-post-clone.sh, dont forget to go in and re-save the configuration on appcenter so the step gets picked up by appcenter.
#!/usr/bin/env bash
COMMIT=$(git show --pretty=format:%s -s HEAD)

# if iOS is empty we asume its Android
if [[ $COMMIT == *"[skip ci]"* ]] && [ -z "$APPCENTER_XCODE_PROJECT" ]; then
    echo "Cancelling android"
    curl -i -X PATCH -H "X-API-Token:$APPCENTER_TOKEN" -H "Content-Type: application/json" -d "{\"status\":\"cancelling\"}" https://appcenter.ms/api/v0.1/apps/{owner}/{app}/builds/$BUILD_BUILDID
fi

# if Android is empty we asume its iOS
if [[ $COMMIT == *"[skip ci]"* ]] && [ -z "$APPCENTER_ANDROID_VARIANT" ]; then
    echo "Cancelling iOS"
    curl -i -X PATCH -H "X-API-Token:$APPCENTER_TOKEN" -H "Content-Type: application/json" -d "{\"status\":\"cancelling\"}" https://appcenter.ms/api/v0.1/apps/{owner}/{app}/builds/$BUILD_BUILDID
fi

I am using BUILD_BUILDID as it always returns the build_id as oposed to $APPCENTER_BUILD_ID which can return timestamp if set so in the configuration, and that does not work with the api.
I made the skip ci lowercase to match what bitrise uses.

I ended up with this script. Add it to appcenter-post-clone.sh, dont forget to go in and re-save the configuration on appcenter so the step gets picked up by appcenter.
#!/usr/bin/env bash
COMMIT=$(git show --pretty=format:%s -s HEAD)

# if iOS is empty we asume its Android
if [[ $COMMIT == *"[skip ci]"* ]] && [ -z "$APPCENTER_XCODE_PROJECT" ]; then
    echo "Cancelling android"
    curl -i -X PATCH -H "X-API-Token:$APPCENTER_TOKEN" -H "Content-Type: application/json" -d "{\"status\":\"cancelling\"}" https://appcenter.ms/api/v0.1/apps/{owner}/{app}/builds/$BUILD_BUILDID
fi

# if Android is empty we asume its iOS
if [[ $COMMIT == *"[skip ci]"* ]] && [ -z "$APPCENTER_ANDROID_VARIANT" ]; then
    echo "Cancelling iOS"
    curl -i -X PATCH -H "X-API-Token:$APPCENTER_TOKEN" -H "Content-Type: application/json" -d "{\"status\":\"cancelling\"}" https://appcenter.ms/api/v0.1/apps/{owner}/{app}/builds/$BUILD_BUILDID
fi

I am using BUILD_BUILDID as it always returns the build_id as oposed to $APPCENTER_BUILD_ID which can return timestamp if set so in the configuration, and that does not work with the api.
I made the skip ci lowercase to match what bitrise uses.

@BoKKeR I followed your approach and its working great. Thanks for this. My only issue at the minute is that the PR checks will tell me that some of them were not successful. Is there any way to trick that?

I dont know as I dont use the appcenter pr checks 😞

I ended up with this script. Add it to appcenter-post-clone.sh, dont forget to go in and re-save the configuration on appcenter so the step gets picked up by appcenter.
#!/usr/bin/env bash
COMMIT=$(git show --pretty=format:%s -s HEAD)

# if iOS is empty we asume its Android
if [[ $COMMIT == *"[skip ci]"* ]] && [ -z "$APPCENTER_XCODE_PROJECT" ]; then
    echo "Cancelling android"
    curl -i -X PATCH -H "X-API-Token:$APPCENTER_TOKEN" -H "Content-Type: application/json" -d "{\"status\":\"cancelling\"}" https://appcenter.ms/api/v0.1/apps/{owner}/{app}/builds/$BUILD_BUILDID
fi

# if Android is empty we asume its iOS
if [[ $COMMIT == *"[skip ci]"* ]] && [ -z "$APPCENTER_ANDROID_VARIANT" ]; then
    echo "Cancelling iOS"
    curl -i -X PATCH -H "X-API-Token:$APPCENTER_TOKEN" -H "Content-Type: application/json" -d "{\"status\":\"cancelling\"}" https://appcenter.ms/api/v0.1/apps/{owner}/{app}/builds/$BUILD_BUILDID
fi

I am using BUILD_BUILDID as it always returns the build_id as oposed to $APPCENTER_BUILD_ID which can return timestamp if set so in the configuration, and that does not work with the api.
I made the skip ci lowercase to match what bitrise uses.

Thanks for the script @BoKKeR
@elamalani any progress on this?


Sharp won't install on Alpine 3.12

Possible install-time or require-time problem

[x] I have read the documentation relating to installation.
[x] I have ensured that the architecture and platform of Node.js used for npm install is the same as the architecture and platform of Node.js used at runtime.

Are you using the latest version of sharp?

[x] I am using the latest version of sharp as reported by npm view sharp dist-tags.latest.

If you cannot confirm this, please upgrade to the latest version and try again before opening an issue.
If you are using another package which depends on a version of sharp that is not the latest, please open an issue against that package instead.
Is this a problem with filesystem permissions?
If you are using npm v6 or earlier and installing as a root or sudo user, have you tried with the npm install --unsafe-perm flag?
If you are using npm v7 or later, does the user running npm install own the directory it is run in?
If you are using the ignore-scripts feature of npm, have you tried with the npm install --ignore-scripts=false flag?
 Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>install script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm verb exit [ 1, true ]
npm timing npm Completed in 13445ms
npm ERR! A complete log of this run can be found in:
npm ERR!     /usr/src/node-red/.npm/_logs/2022-03-21T09_31_11_116Z-debug.log

What is the output of running npx envinfo --binaries --system --npmPackages=sharp --npmGlobalPackages=sharp?

$ npx envinfo --binaries --system --npmPackages=sharp --npmGlobalPackages=sharp
npx: installed 1 in 4.95s

  System:
    OS: Linux 5.10 Alpine Linux
    CPU: (4) arm ARMv7 Processor rev 4 (v7l)
    Memory: 298.20 MB / 972.75 MB
    Container: Yes
    Shell: 1.31.1 - /bin/ash
  Binaries:
    Node: 14.18.2 - /usr/local/bin/node
    Yarn: 1.22.15 - /usr/local/bin/yarn
    npm: 6.14.15 - /usr/local/bin/npm
/data $ apk info musl
WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.12/main: No such file or directory
WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.12/community: No such file or directory
musl-1.1.24-r10 description:
the musl c library (libc) implementation

musl-1.1.24-r10 webpage:
https://musl.libc.org/

musl-1.1.24-r10 installed size:
499712

Just for context all this is running in the nodered/node-red:2.2.2-14 docker container on a Pi 3b. Testing to gather logs and reproduce is done by starting the container then running docker exect -it <container name> /bin/sh. This runs as the node-red user and install is run in the /data directory which is owned by the node-red user.

Seems to be identical to #3149. Also confirmed that the same exact thing happens on MacOS BigSur 11.6. Won't create a separate issue for it.

/cc @bastelbert

The salient part of the installation log is:

sharp: Downloading https://github.com/lovell/sharp-libvips/releases/download/v8.12.2/libvips-8.12.2-linuxmusl-armv7.tar.br
sharp: Installation error: Prebuilt libvips 8.12.2 binaries are not yet available for linuxmusl-armv7
sharp: Please see https://sharp.pixelplumbing.com/install for required dependencies

https://sharp.pixelplumbing.com/install#prebuilt-binaries says

The following platforms require compilation of both libvips and sharp from source:

Linux ARMv7 (glibc <= 2.27, musl)

For musl-based Linux on ARMv7 devices, you'll need to follow the instructions at https://sharp.pixelplumbing.com/install#custom-libvips

Just to be clear (so I can communicate this upstream) the only way to use sharp on a ARMv7 musl (Alpine) based container, is to manually build libvips and install it first?
Also has this changed (I have a user who suggests this used to work with just a npm install)?

Prebuilt libvips binaries for musl-based Linux on ARMv7 have never been provided by sharp, so you'll need to provide libvips globally somehow, which includes compilation from source or via OS package manager.
For Alpine, if you're using Edge, you should be able to take advantage of the latest vips-dev package.
https://pkgs.alpinelinux.org/package/edge/community/armv7/vips-dev

I hope this information helped. Please feel free to re-open with more details if further assistance is required.


v0.19.1 test severity='warn' ignored

Describe the bug
A failing test with the severity set to warn in the config block is treated as an error. Additionally the same model selection syntax in v0.19.1 is missing a test that is executed in v0.19.0
Steps To Reproduce
While validating there would be no issues with bumping from 0.19.0 to 0.19.1 this issue surfaced where a test with severity set to warn will instead return a hard failure.
Expected behavior
Warning in test... is expected instead of Failure in test...
Screenshots and log output
v0.19.0
Running with dbt=0.19.0
Found 330 models, 2503 tests, 196 snapshots, 0 analyses, 419 macros, 0 operations, 0 seed files, 221 sources, 0 exposures

17:56:05 | Concurrency: 4 threads (target='dev')
17:56:05 |
17:56:05 | 1 of 3 START test duplicate_snapshot_rows_LogUserLoginsSnapshot_LogId [RUN]
17:56:05 | 2 of 3 START test logins_without_orgs_factUserLogins_UserLoginUserKey [RUN]
17:56:05 | 3 of 3 START test snapshot_changed_LogUserLoginsSnapshot_............ [RUN]
17:56:07 | 1 of 3 WARN 108811 duplicate_snapshot_rows_LogUserLoginsSnapshot_LogId [WARN 108811 in 2.26s]
17:56:07 | 3 of 3 ERROR snapshot_changed_LogUserLoginsSnapshot_................. [ERROR in 2.40s]
17:57:15 | 2 of 3 PASS logins_without_orgs_factUserLogins_UserLoginUserKey...... [PASS in 70.08s]
17:57:15 |
17:57:15 | Finished running 3 tests in 79.87s.

v0.19.1
Running with dbt=0.19.1
Found 330 models, 2503 tests, 196 snapshots, 0 analyses, 419 macros, 0 operations, 0 seed files, 221 sources, 0 exposures

18:04:58 | Concurrency: 4 threads (target='dev')
18:04:58 |
18:04:58 | 1 of 2 START test duplicate_snapshot_rows_LogUserLoginsSnapshot_LogId [RUN]
18:04:58 | 2 of 2 START test snapshot_changed_LogUserLoginsSnapshot_............ [RUN]
18:05:00 | 2 of 2 ERROR snapshot_changed_LogUserLoginsSnapshot_................. [ERROR in 1.92s]
18:05:00 | 1 of 2 WARN 108811 duplicate_snapshot_rows_LogUserLoginsSnapshot_LogId [WARN 108811 in 1.98s]
18:05:00 |
18:05:00 | Finished running 2 tests in 7.41s.

System information
Which database are you using dbt with?

[ ] postgres
[ ] redshift
[ ] bigquery
[x] snowflake
[ ] other (specify: ____________)

The output of dbt --version:
Running with dbt=0.19.0

Running with dbt=0.19.1

The operating system you're using:  OSX / dbt via Docker (3.8-slim)
The output of python --version: Python 3.8.7
Additional context
Other testing seemed to show that the severity being set to warn in the yml is not respected on out of the box tests as well

Thanks for the quick report @SteveDMurphy! If possible, could you share:

Whether these are data tests or custom schema tests
How you're configuring severity for these tests
The selection criteria you're using to select the tests above (since you're only running 2-3 out of 2503 tests in your project)

From looking at the log output you've shared above, it seems like:

duplicate_snapshot_rows_LogUserLoginsSnapshot_LogId is returning WARN 108811 in both
snapshot_changed_LogUserLoginsSnapshot_ is returning ERROR in both
logins_without_orgs_factUserLogins_UserLoginUserKey is selected and returns PASS in v0.19.0, but it is not selected in v0.19.1

So I can't tell if this is an issue with severity, or with test selection.

Other testing seemed to show that the severity being set to warn in the yml is not respected on out of the box tests as well

Could you say a bit more about this, too, or share an example?

Thanks for the quick response @jtcohen6 !

These are custom schema tests
Set in the config block of the custom schema test
dbt test -m LogUserLoginsSnapshot

🤦 I was moving too fast before having to split for a bit, my apologies! I'll repost the logs below:
Running with dbt=0.19.0
Found 330 models, 2503 tests, 196 snapshots, 0 analyses, 419 macros, 0 operations, 0 seed files, 221 sources, 0 exposures

00:23:15 | Concurrency: 4 threads (target='dev')
00:23:15 |
00:23:15 | 1 of 3 START test duplicate_snapshot_rows_LogUserLoginsSnapshot_LogId [RUN]
00:23:15 | 2 of 3 START test logins_without_orgs_factUserLogins_UserLoginUserKey [RUN]
00:23:15 | 3 of 3 START test snapshot_changed_LogUserLoginsSnapshot_............ [RUN]
00:23:18 | 3 of 3 PASS snapshot_changed_LogUserLoginsSnapshot_.................. [PASS in 2.34s]
00:25:00 | 2 of 3 PASS logins_without_orgs_factUserLogins_UserLoginUserKey...... [PASS in 104.29s]
00:25:54 | 1 of 3 WARN 108811 duplicate_snapshot_rows_LogUserLoginsSnapshot_LogId [WARN 108811 in 159.03s]
00:25:54 |
00:25:54 | Finished running 3 tests in 168.42s.

Running with dbt=0.19.1
Found 330 models, 2503 tests, 196 snapshots, 0 analyses, 419 macros, 0 operations, 0 seed files, 221 sources, 0 exposures

00:09:51 | Concurrency: 4 threads (target='dev')
00:09:51 |
00:09:51 | 1 of 2 START test duplicate_snapshot_rows_LogUserLoginsSnapshot_LogId [RUN]
00:09:51 | 2 of 2 START test snapshot_changed_LogUserLoginsSnapshot_............ [RUN]
00:09:58 | 2 of 2 PASS snapshot_changed_LogUserLoginsSnapshot_.................. [PASS in 6.50s]
00:13:22 | 1 of 2 FAIL 108811 duplicate_snapshot_rows_LogUserLoginsSnapshot_LogId [FAIL 108811 in 210.69s]
00:13:22 |
00:13:22 | Finished running 2 tests in 216.80s.

Also here is the test in question that Warns on 0.19.0 and Errors on 0.19.1:
{% macro test_duplicate_snapshot_rows(model, unique_key='UniqueKey') %}
  {{
      config(
          severity='warn'
      )
  }}
    with duplicate_active_recs as (
        select {{ unique_key }}
        from {{model}}
        where dbt_valid_to is null
        group by {{ unique_key }}
        having count(*) > 1
    )
    select count(*) from duplicate_active_recs

{% endmacro %}

For the third bullet, that was something random I noticed just based on the snapshot I chose to test with today. It is a data test (if that makes a difference) but thought it might be worth mentioning.
In regard to:

Other testing seemed to show that the severity being set to warn in the yml is not respected on out of the box tests as well

I also tested a separate model that I knew to have a failing relationship but was set to warn and mistakenly thought it was a relationship test with the severity set in the schema.yml, however it's also a custom data test set in the config block. It also correctly returns the warn on 0.19.0 but an error on 0.19.1.
Based on my mistake, I went back and specified the severity in the schema.yml like the below for LogUserLoginsSnapshot and it correctly returned the warn instead of the error as shown above:
 - name: LogUserLoginsSnapshot
    tests:
      - duplicate_snapshot_rows:
          unique_key: LogId
          severity: warn # adding this here correctly fires the warn instead of error
      - snapshot_changed

Thanks again for the help! Let me know if I can add anything else. Pumped to unleash the new power of 0.19.1, huge increase in dev quality of life on those compile times 🙌

@SteveDMurphy Thanks for the detailed report back, this is hugely helpful!
Regression
There's a regression from v0.19.0 to v0.19.1 around setting "default" severity within a custom schema test macro. I don't actually think we've documented that this is possible—rather, we document [config() for setting data test severity](https://docs.getdbt.com/reference/data-test-configs—but it's a reasonable thing to want to do, and it makes sense that it previously worked.
We'll investigate this to see if there's an obvious way we can switch back to the previous behavior. In any case, we're planning lots of (good) changes for custom tests in v0.20.0. The ability to configure "default" severity within a generic test wasn't previously on my mind, but it definitely feels possible with the new constructs we're developing, so thanks for raising!
In the meantime, as you say, the right approach is to configure severity within the .yml test definition:
tests
  - duplicate_snapshot_rows:
      severity: warn

Question
I'm still not sure why your first (v0.19.0) invocation includes three tests and your second (v0.19.1) only includes two. The missing test is logins_without_orgs_factUserLogins_UserLoginUserKey; given that your selection logic is -m LogUserLoginsSnapshot, by that test's name/unique_id, it's not clear why it should have been included, since it doesn't seem to depend on LogUserLoginsSnapshot. (If I had to guess, it looks like a custom test, logins_without_orgs, defined on the column UserLoginUserKey of the model factUserLogins.) Do you have a sense of why that would have been included in the first test invocation?

Thanks for the detailed explanation @jtcohen6 ! That all makes sense to me, I think we can go ahead and update severity in the .yml to manage that properly for now - it would definitely be nice to have in the future to keep it DRY for those situations but I understand if it's an edge case 👍
For the missing invocation of logins_without_orgs_factUserLogins_UserLoginUserKey - this is a custom data (regression) test used to validate that we were correct in applying a default/unknown surrogate key.  The test is applied to the model in the schema.yml as well, but consists of joining/validating to a few models as well as the snapshot. Based on what you mentioned earlier, it might be related to how or where we apply things in the models? If I remember correctly, when we got started (on v0.14.0) we either needed or assumed we needed to apply custom tests in the .yml as well - so there might be a common theme behind what we are seeing?
Thanks again!

Appreciate your understanding + flexibility!
Just to clarify: Is logins_without_orgs_factUserLogins_UserLoginUserKey a custom "schema" test, defined in macros/ + models/*.yml, or custom "data" test, defined (as a query / SQL file) in test/?
What's the relationship between logins_without_orgs_factUserLogins_UserLoginUserKey and LogUserLoginsSnapshot?

custom schema test, my bad on the terminology! 😅 we have moved solely towards that setup (defined in macros/ + models/*.yml)
LogUserLoginsSnapshot is ref'd directly in a cte as part of the test (along with another snapshot and a few models) but the test is only defined underneath the fact model in the .yml. I'm not sure if that's exactly what you were looking for but let me know if you were looking for something different

No worries on the terminology—I know it's confusing and, in fact, would like to change it in v0.20.0 to be a bit more intuitive :)
Got it, ok. That sounds like it's a very similar issue to the one over in #3229 (I'm actually surprised you didn't run into that same compilation error), and closely related to parsing config/severity out of the test definition.
Really appreciate the clarification, thank you!

Resolved by #3272
@SteveDMurphy Thanks again for your help getting to the bottom of this one!

@SteveDMurphy We're including a fix for this in v0.19.2, for which we just cut a release candidate. Any chance you could test locally and confirm that it fixes the issue you described above?
pip install --upgrade 0.19.2rc1
# or
brew install<EMAIL_ADDRESS>


Slow image transformation

Hej,
I dont think this is a issue, sorry for posting like this.
But the image that goes through you model is really slow. Do you have a method for speeding it up?
Sorry again for posting it as a issue, but dont know how else to make contact.

Are you using a cuda gpu ?
What is your definition of slow?
I run a rtx2060s which is limited by the cpu (speed and threads).
With 640x480 images I get ~200 ms per inference with ~50 ms file saving (cv2) = ~250 ms per inference
Is that slow ?
When I run https://github.com/ialhashim/DenseDepth I get ~270 ms per inference (matplotlib is 2x slower at saving).
I've never tried to improve the code of Midas (as this was my first reference for speed).
With dense depth I had to tweak it (to make it run like Midas; for me) and to improve the inference (clearing the plot instead of over writing on each iteration) for the method I chose to use (I also struggled to set up my gpu properly for using it -- finding the right cuda conda packages -- cupti? ).
I'm not involved with either project, but use MiDaS consistently because it is flexible on the input image aspect ratio ( Dense depth only likes 4:3).

We have also just released a new version that also includes a smaller and faster model. Give it a try.

Hey thanks for the answers.
@3dsf I use colab, so dont know the specs. The images takes between 1 to 7 seconds or even longer depending on how long I run the code. But this is also the whole proces from putting the image through the model, save it in mathplot and then convert it to JPG file. (Do you know of a faster way?)
@ranftlr thanks, I tried the new model, I guess it is a bit faster:) But it still takes about a whole second for each image.
(I am currently converting a video, so this can take days).
I dont know if you guys are interested but a have linked the github code, but any ideas or hints to make the proces faster will be greatly appresiated, if you have any:)
link --> sorry have not refactored the code yet, so it is a bit messy: https://github.com/nickteim/Reinforcement_Learning-/blob/main/VideoTransform_MiDaS.ipynb

@nickteim According to our experiments, the new, small model runs in real-time even on a mobile phone. Colab has pretty capable GPUs, so even the big model should be quite fast. You might have a problem in your setup or you might be measuring things that are not related to our project.
I ran your code and timed the blocks that are relevant (image reading + transform + MiDaS + upsampling) and can't confirm an execution time of 1-7 seconds for MiDaS. I get 0.04s per image (~25fps per second) even for the big model. Roughly double that when I also count a final memory transfer from GPU to CPU. To make your code faster, you need to find out what is slowing it down most and start from there. MiDaS in this case seems to take <4% percent of the execution time so it doesn't seem like a good candidate.

@ranftlr thanks for the anwer again
I have refactored some of the code, so I dont convert to JPG file or delete anything. So now it is just the model, and saving the mathplot file.
I timed the code (image reading + transform + MiDaS + save mathplot image) and for the first image I get about 0.17 seconds.
But the time seems to grow linear for each image.
Time plot

y axis is the time for each iteration
x axis is for each image
I know the array grows and might slow down the proces? But even without it, it takes longer for every iteration.
Did you also save the images? Maybe I should use a other method to save the images?

I'm closing this issue, since it is not related to MiDaS. There are plenty of ways to write out images. In your specific case, Matplotlib is slowing down with repeated calls to plot. This is well known, see here for a discussion.

hey @nickteim
sorry I didn't comment sooner, but I took a quick peak at what you had yesterday:

You need to clear the plot each time, otherwise you are writing over the plot each time and it will lead to an incremental increase in time (been there)
switch you matplotlib code to cv2 code and you will see good speed increases ( negates point 1 )
try to not open and close files.  Don't let this stop you from saving checkpoints, just don't reopen the same information you just put in a file
clean up your code as much as possible before asking for help,  for example, the redundancies in your imports...

if you want further clarification, find me on reddit at 3dsf

@3dsf Nice, thanks for the tips, I will try it out


I cant find the host when i press the button on the map

Subject: I cant find the host when i press the button on the map
Description:
I cant find the host when i press the button on the map
On the left hand side the hosts are listed but when i find one on the map and press it, it doesnt show who the host is.
Results:
Backend version: develop-84dcfc65
Frontend version: develop-4ac0bb48
User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/<IP_ADDRESS> Safari/537.36
Page: https://couchers.org/search?location=Fatih%2C+İstanbul%2C+Türkiye&lat=41.0091982&lng=28.9662187&hostingStatusOptions=2&hostingStatusOptions=3#loc=12.46/40.98424/28.80111
User: klaxomartin2602 (26518)

can't reproduce

dupe of #3336?


Add Objectives and Configuration for PickNik UR Robots

[sc-13924]
this is slated for 2.2, with an additional PR to the Studio repo that will throw toasts on select point objectives if there are no cameras

In the Gazebo config, the Pick waypoint is still a bit too low to the table. It doesn't collide, but then Pick Object doesn't find cuboids because the camera is too close to the table. I zoomed out a bit and all worked fine.

Cool. I pushed it back even more, and adjusted the GAC params so that I can actually (sometimes) get the cuboid to stick in the gripper. Let me know if that's better for you?

Also I had simplified the Gazebo launch file by removing all the things that were only used for CI.

I reverted everything except for the params we identified as needing to change.

 Error: Failed to execute action: Objective planning failed."

Are you sure? Have you reset the waypoints between deployments? There is not a "Pick" waypoint for the ur site config.

Pick in Gazebo works fine now when I'm testing, but it is a good deal above the actual block. Same with Grab on mock for the site config.

Yes, the intent here is to pose the arm in a reasonable pose to execute the pick objective, rather than actually contact the block in the GZ config. I think we're good to move forward with that.


lb_test_issue01

Steps to Reproduce:
Step 1 [ Pending ]

Open Defect in TestQuality

Test First test in Run Run 001 (linked to Cycle cycle1).


Set up benchmarking with JMH

We have a benchmarking harness now (#105).  We should use JMH to measure overhead more rigorously.

Fixed!


bump slickgrid

The hot fix for the commit hash wasn't working, so I just hard bumped it
fixes #668

@kburtram the commit hash for slickgrid kept getting reverted so it wasn't taking my changes that fixed it.

@anthonydresser weird.  do you know if the issue is fixed now?   I'll merge this now to get into a refreshed Feb. release candidate build.


Switch from TravisCI to GitHub Actions

Switch from TravisCI to GitHub Actions.
Also, deprecate Python 3.4 to get rid of some hacks in the CI script. Python 3.4 EOL has been reached in 2019. The current code should still work on 3.4, but there will be no more CI checks, so it may break in the future.
Coveralls has been replaced with Codecov due to easier integration.

Merging without a review, since this should be fairly uncontroversial.

@francium sorry, I was a bit impatient in order to get #27 merged :slightly_smiling_face:
The config is correct, it will trigger CI on push to master, or on any pull request. The way it looks is just a peculiarity of the YAML file format, see this link for a parsed representation. It will result in pull_request: null but that just means that there's no configuration/constriant for the pull request trigger, but since the key is present it will still run.
The reason why I'm limiting pushes to master is that a push to a branch should not get tested twice (once due to the push and once due to being part of a PR).

No problem. I assumed you knew what you were doing.
Thanks for the explanation. Makes sense now that I look at it that way.


Terminating to support IE11

Hey guys,
Now I think to remove ugly branches that have been implemented in order to support legacy IE 11. I would like to hear your opinions about this change.
I know that most jscu users and developers use Chromium/Safari/Firefox based browsers and there's just few IE users. Further, in order to support IE11, I had added tons of extra ugly codes. So I would like to discontinue the support of IE11, and this yields smaller bundled-js size and simpler codes. When I suspend IE codes, I would also like to bump the jscu version to 1.0.0.
Cheers!

I think it's a good idea.
Size reduction and modernizing the module are more important than sticking to legacy IE.

I agree.
I think it's a very good idea.
Microsoft also says not to use IE.
https://techcommunity.microsoft.com/t5/Windows-IT-Pro-Blog/The-perils-of-using-Internet-Explorer-as-your-default-browser/ba-p/331732

Hey @GenyuSuzuki @quvox,
By #521, I finally terminated to support IE! Thanks for your comments and sorry for taking time...


Error when typing emojies

You can filter non standard characters (chars which aren't in your font) so it won't break.

Thansk @morajabi, fixed.


QUESTION:Doesnt call postAccessTokenRequestWithPIN

I can successfully login and fetch an oauthToken then redirects back to my app.

(void)setOAuthToken:(NSString *)token oauthVerifier:(NSString *)verifier  is being called but doest call

[_twitter postAccessTokenRequestWithPIN:verifier successBlock:^(NSString *oauthToken, NSString *oauthTokenSecret, NSString *userID, NSString *screenName)  which suppose to return the user details

I'm not sure on how to reproduce the issue.
Can you please post the calling code?
Or tell me how to reproduce it, if possible, with the demo OS X app?
Thank you in advance.

Hi, sorry for the late reply. been busy for the past few days.
I've tried copying my code to the demo app and works great but I can't
make it work on my project. Here's how it works.
In my app, I have a twitter button where I can sync twitter with my app.
I used these code for the auth tokens.
self*.twitter = [**STTwitterAPI
twitterAPIWithOAuthConsumerKey:**TWITTER_API_KEY *

consumerSecret**:TWITTER_API_SECRET]; * * [_twitter
postTokenRequest:^(NSURL *url, NSString *oauthToken) { *
*        TwitterWebViewController** twvc =
[[TwitterWebViewControlleralloc*]init];** *
*        [selfpresentViewController**:twvc
animated:YEScompletion**:^{** * *                NSURLRequest**
request = [NSURLRequest requestWithURL:url];* *
*                 [twvc.webView loadRequest:request]; ** *
*         }];**        ** *
} authenticateInsteadOfAuthorize:NO * *
forceLogin*:@(YES) *
*       screenName**:nil *
*       oauthCallback**:**@"mysampleapp://twitter_access_tokens/"  ** *
errorBlock*:^(NSError error) {* *
*       NSLog**(@"-- error: %@", error);** *
}];
Here I created another view controller and added a UIwebview to it. Im
presenting the viewcontroller and loads the webview. I can login to
twitter and successfully redirects back to my app. Here's how the code
in  my appdelegate for the openURL
NSString* token = d[@"oauth_token"];* *
NSString* verifier = d[@"oauth_verifier"];* *
SettingsViewController* svc =
[[SettingsViewControlleralloc*]init];** *
[svc setOAuthToken:token oauthVerifier:verifier];* *
[homeNav pushViewController:svc animated:YES];
It successfully calls the method **shown bellow *in my settings view
controller
*- (void)setOAuthToken:(NSString )token
oauthVerifier:(NSString )verifier { *
}* *
but wont perform the methods inside it *shown bellow even if there's a
verifier return from twitter
*[_twitter postAccessTokenRequestWithPIN:verifier
successBlock:^(NSString *oauthToken, NSString
*oauthTokenSecret, NSString userID, NSString screenName) { *
*     NSLog**(@"-- screenName: %@", screenName);** *
*     NSLog**(@"fetched user details!---");** *
} errorBlock:^(NSError error) { *
*     NSLog**(@"-- %@", [error localizedDescription]);** *
}];
Thanks!

[FIXED]
Found out that self.twitter/_twitter becomes null when it redirects back to the app after signing in with twitter.


Update UX strings for translation

We would like to update certain strings in the app, which will need to be translated.
Please review https://www.figma.com/file/br8IthdXBkiMCATBW7KNE4/Main-Mobile-Screens?node-id=701%3A160 middle column and right column to verify the copy that needs to be changed - yellow sticky notes specify what copy needs to be changed.
The Zeplin screens are also linked below:
Screens to change:

[x]  HOME/Full - BC Card
[x]  ONBOARDING/1-BC
[x]  ONBOARDING/2-BC
[x]  ONBOARDING/3-BC
[x]  ONBOARDING/4-BC
[x] HOME/Questionnaire collapsed
[x] LEARN/Full-BC
[x] SEARCH/Feedback2.0 with button
[x] HELP/Full-BC
[x] SERVICEFEEDBACK/Discard modal
[x] HOME/Full - MB Start Card
[x] HOME/Questionnaire collapse - MB
[ ] LEARN/Full-MB
[x] SEARCH/Feedback 2.0 with button - MB
[x] HELP/Full-MB Option 1 or Option 2 - see issue https://github.com/pg-irc/pathways-frontend/issues/1544

review:

[ ] Onboarding pages 2 and 3 are switched around
[ ]

Onboarding pages in current order is fine!

This change is related to issue #1545, otherwise @rasmus-storjohann-PG  @brandon-PG, new updates to the PR have been pushed.

copy for LEARN/Full-MB and LEARN/Full-BC are blocked/have this issue: https://github.com/pg-irc/pathways-frontend/issues/1565. Everything else is good.

Closing this issue as everything outstanding is captured in #1565


add tunnel id and update tests

[x] Generated random id
[x] Updated tests to cover newly added code

@xwa130saucer Actually wait... there can be multiple of these running for a single account, and if they're seeded using accessKey, than they will all have the same ID. We need to generate a unique ID for every test run


select master program in includes

Language features don't work without one.
Currently fails in some cases, like include... if found in classes

Also, main include selection doesn't work properly with

function groups
namespaced objects
classes ?


Compatibility with wxPython 4.1.1?

Does Gooey now work with wxPython 4.1.1? If so, can we please update the package dependencies so that we can easily install wxPython from pre-built wheels rather than source?

Pull request loosening WX dependency to >= 4.1.0 will be happily (eventually) accepted if you want to cut a PR.
Just as a general FYI regarding the sudden slowness of responses and activity, Gooey development has effectively been on pause for the last few months and will remain as such for another month (or so) due to the day job robbing me of any free time and/or general life (plz halp me *blinks several times under duress*).
Hopefully, it'll be back to regular release and updates soon!


ETA for release ROCm + OpenCL 1.2 on Polaris ?

I don't want to be that guy, but....... any idea on when this stack will be available?
Also, interested in using inline GCN ISA with OpenCL on ROCm .

ROCm runs on Polaris today,   OpenCL Developer Preview also does, what your asking is when is the next release.
greg
On Apr 25, 2017, at 1:56 PM, Aaron Boxer <notifications<EMAIL_ADDRESS>wrote:
I don't want to be that guy, but....... any idea on when this stack will be available?
Also, interested in using inline GCN ISA with OpenCL on ROCm .
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/RadeonOpenCompute/ROCm/issues/108, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AD8DuWXlk9xoaKpmwF1EUcAN05HGStHXks5rzkHugaJpZM4NH6aQ.

Thanks, edited.

Inside a week
Greg
On Apr 25, 2017, at 2:02 PM, Aaron Boxer <notifications<EMAIL_ADDRESS>wrote:
Thanks, edited.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://github.com/RadeonOpenCompute/ROCm/issues/108#issuecomment-297132449, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AD8Duf5SW4_R0x-vDyc8CKoeRUAFpDXYks5rzkM7gaJpZM4NH6aQ.

wow, fabulous!


[security] audit repository tooling

The security SIG is looking to ensure that security tooling is setup consistently across the organization. As a result, we're asking maintainers to ensure the following tools are enabled in each repository:

[x] CodeQL enabled via GitHub Actions
[ ] Static code analysis tool (the collector uses govulncheck [https://pkg.go.dev/golang.org/x/vuln] on every build)
[ ] Repository security settings

[ ] Security Policy ✅
[ ] Security advisories ✅
[x] Private vulnerability reporting ✅
[x] Dependabot alerts ✅
[ ] Code scanning alerts ✅

Parent issue: https://github.com/open-telemetry/sig-security/issues/12

@codeboten  I'm Jarvis, an outreachy candidate. Please assign me to this issue

@codeboten I'm Jarvis an outreachy candidate, Please assign me to this issue.

@codeboten I've checked off what was added in repository settings. But aside from static code analysis (which I know we'd have to add some other way), I'm not sure how to check the remaining items? A security policy is a SECURITY.MD file with some standard text, right? I looked at the go-build-tools repo and noticed this item is checked off, but that file doesn't exist.

@cartermp the items under "Repository security settings" capture whether the following are enabled in the repo's "Security" tab:

For the SECURITY.md, if one isn't present in the repo, it is inherited from the .github repo: https://github.com/open-telemetry/.github/

Gotcha! In that case I updated everything other than the static code analysis tool one. I think we may technically have that with CodeQL turned on for JS?


redirect clicks on relative links (/articles/blah) to Angular router nav events

A couple recent articles have linked back to other articles - the current behavior of links within an article is to open in a new tab, but this is not ideal since it's linking to another page on our site. Once the markdown renderer has completed, we can scrape for relative links (anything prefixed with /) and replace their click handlers with a custom handler.
The handler should instruct Angular's router to smoothly transition to the indicated route, something like
constructor(private router Router) { }

openArticle(path: string): void {
  this.router.navigate('articles', 'article-view');
}

closed in b63658f0de98259dfbbc01329603895dc3167dc0


Concurrent runs of the test suite fail

Some resources seem to have fixed names which can collide if concurrent runs occur, e.g.:
aws:lb:TargetGroup (LBListenerTargetGroupF04FCF6D):
      error: 1 error occurred:
      	* error creating LB Target Group: DuplicateTargetGroupName: A target group with the same name 'LBListenerTargetGroupF04FCF6D' exists, but with different settings
      	status code: 400, request id: 7e4ad2d9-bb3b-4f45-aa1f-507f8355a098

For the time being concurrency has been dropped to 1 here: https://github.com/pulumi/pulumi-cdk/pull/37/commits/ad5922e9530276506d6e90216a6917a3e19441fd.
We should revisit if autonaming can be safely honored on resources corresponding to the L1 CDK constructs to make this moot.

making a test comment to validate that we have fixed #50

This has been fixed in some previous work.


Section "audiobooks and shows" not shown

The section "audiobooks and shows" is not shown on an artist's profiles. The albums in question can still be found and played back by searching for them.
As an example, here's one of the affected artists: https://music.youtube.com/channel/UCkBOK5_V5AcQlye0TV2g0-A (you might not see all the items since most of them are premium-only)

Thanks for the intro! I already played around with the library earlier, I'll definitely give it a try and let you know if it worked out :)


Ctpps diamond dqm 2021

98-99: New variables declarations so more than one detector is seen.
232-234: initializing the above
267-341: multiple updates on histograms so we can see whole image
509-510: Updates on offset (so it is 0 now)
539-555: Removed old calculation of offset
567-579: Updated calculation of the detIDs for booking
906: Updated line to dynamically use detId
1050-1080: Added loop outside to take into account new detID

Changes seem to be inline with the description. But before I can give my "+1", please resolve the conflict.


decreased H4 level

decreased level of histone H4 in cell
PMID:30992049

decreased level of histone H4 in cell FYPO:0007324
edit file: fcc4a28ee1b7ac397b7771f2033686ad97d7daa6
release: c3bdd006d9fd63f160e0f3c85bb7dce32f9bbb4e


Download File with Browserstack

In my tests I download a file by clicking a link. This is the native browser download to the native downloads folder. Works well with local browsers.
But in modern world we use as sample Browserstack. Now with Browserstack the file is downloaded to the virtual machine where the test is running. There have to be a way to get this file to the server who started the test run on Browserstack so it is possible to open the file for further tests inside Testcafe. Currently all tests with Browserstack are broken that expect a file inside the downloads folder.

I cannot say if it is possible to send the downloaded file to your host using the BrowserStack API. It's better to address this question to the BrowserStack team.
From the TestCafe perspective, I can recommend you take a look at the built-in Request Hooks mechanism. Please refer to the following article:  Logging HTTP Requests
You can setup the logger object to log requests to the target file url. After the request is completed, you will be able to check the body of the response, which contains the file.
When you have the file, you can write some custom code and process it as you wish.


Corral allows bad locators and doesn't error

I did an add with an incorrect locator and got:
{
"deps": [
{
"locator": "github.com/ponylang/peg",
"version": "0.1.0"
}
],
"info": {}
}
when I run corral fetch I get:
fetch: fetching from /home/sean/code/ponylang/changelog-tool
fetch: fetching dep: github.com/ponylang/peg @ 0.1.0
No dep bundle for: github.com/ponylang/peg

Which is horribly misleading given that the locator doesn't exist at all.
I propose this is addressed in two parts. Fix the bug of it not indicating the error on fetch.
Enhance to validate a locator on addition.

Closed in favor of #100

So the problem here is that the way that Corral determines the VCS to use work like this.
There's a primitive called VCSType that has the following to pick a VCS:
primitive VCSForType
  """
  This factory returns a VCS instance for any given VCS by name.
  """
  fun apply(env: Env, kind: String): VCS val ? =>
    match kind
    | "git" => GitVCS(env)?
    | "hg"  => HgVCS
    | "bzr" => BzrVCS
    | "svn" => SvnVCS
    else
      NoneVCS
    end

So if the VCS is unknown, you get the NoneVCS which NoOps everything. Thus it appearing to "work" in example I gave when opening this.
The match on string comes from vcs on the Deps class:
  fun vcs(): String => locator.vcs_suffix.trim(1)
So a locator without a suffix will give you the NoneVCS and NoOps everything.
This seems like a design flaw in how Corral is determining the VCS to use and how the factory works.
Reasonably, there should be no NoneVCS outside of perhaps testing. It's existence is a smell.


Add support for challenge based multi-tenant authentication scenario

Similar to: https://github.com/Azure/azure-sdk-for-net/pull/21378

Waiting on https://github.com/AzureAD/microsoft-authentication-library-for-go/issues/296. Public API for this was prematurely implemented in azcore and removed by #17640.

Closing this because it's part of #17159 we don't need to track separately.


Error= isosim: SSL enabled, but certificate/key file unspecified.

I try to run docker edition of ISO WebSim, but get below error:
Failed to start ISO WebSim. Error= isosim: SSL enabled, but certificate/key file unspecified.
any idea?

Getting the same error on running docker run -d -p 8080:8080 rkbalgi/isosim:latest.
Running docker inspect shows "TLS_ENABLED=false".

Getting the same error on running docker run -d -p 8080:8080 rkbalgi/isosim:latest.
Running docker inspect shows "TLS_ENABLED=false".

Hi @ss185427, I will take a look. Thanks

@ss185427 Can you pull up the latest image and try?

@mehrdad2000 FYI ..

@ss185427 Can you pull up the latest image and try?

@rkbalgi error is fixed now, thank you.


fix(core): Update controllers to update CRDs status

Description
This PR improves UX by adding new status fields in CRDs, so that kubectl can print more info.

Fixes #51
Does this PR introduce a breaking change?
No
Checklist

[x] PR title follows the <type>: <description> convention
[x] I use conventional commits in my commit messages
[ ] I have updated the documentation accordingly
[ ] I Keep It Small and Simple: The smaller the PR is, the easier it is to review and have it merged
[ ] I have performed a self-review of my code
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes

Additional information for reviewer
ℹ In a subsequent PR, we'll update the docs, RBACs and adapters to update their policy status.


fix: typo

Description
Kudos to @strassl-snyk's eagles eye 🦅
Checklist

[ ] Tests added and all succeed
[ ] Linted
[ ] README.md updated, if user-facing
[ ] License file updated, if new 3rd-party dependency is introduced

Screenshots / GIFs
Visuals that may help the reviewer. Please add screenshots for any UI change. GIFs are most welcome!

With a PACT Test this would have been avoided :)


what is outcome = 201 and when does it happen ?

Thank you

Hi, 201 happens when the fact or the event was not captured because it did not match any rule. I just added a section on error codes to the docs:
https://github.com/jruizgit/rules/blob/master/docs/py/reference.md#error-codes

Thank you!


Test sample React deployment on RHEL NGINX

Investigate the steps required to deploy the test application to RHEL 7

Don't have access to RHEL 7 but Centos 7 is near identical.

[x] Install OS
[x] Work out how to install web server and enable access
[ ] Transfer copy of site to server and test in known working environment

Some notes on the steps required:
sudo yum install -y openssh-server openssh-clients httpd
sudo systemctl start httpd.service
sudo systemctl enable httpd.service
sudo systemctl start sshd
sudo systemctl enable sshd
sudo firewall-cmd --permanent --add-service ssh
sudo firewall-cmd --permanent --zone=public --add-port=80/tcp
sudo firewall-cmd --reload
Copy files over ssh to
/var/www/html
Waiting for copy of application to confirm.

Using Centos and Apache, easier to install. No access to rhel iso at this time

Need to make a list of things that we want to confirm and check whilst we are there.


yotta AuthTimedOut Exception when mbed.org authentication fails

Hi
I tried to use yotta for the first time on an ubuntu 12.04 machine. The mbed.org authentication failed because it reported I hadnt completed the email verification process. While investigating the problem, yotta timed-out the auth process but experienced and exception, shown below:
simhug01@e102749-lin:/develop/jobs/yr2016/2247/sdh_dev_l1/test$ yt build
info: get versions for linux-native
info: download<EMAIL_ADDRESS>from the public module registry
You need to log in to do this.
Press enter to continue.
Your browser will open to complete login.
waiting for response...
If you are unable to use a browser on this machine, please copy and paste this URL into a browser:
https://yotta.mbed.com/#login/AAAAB3NzaC1yc2EAAAADAQABAAABAQDprvBaY/D69BHDMTMZYQ4HbaPzFjN0f1W8flqvhmAoC/kk9gq1AD/u39tj2W7JgrqkzTVWD97fN7ys2%2BWcLiCDcorPIFlWbBBMAiBALCTRIiTU2XJkp1t3gyXZkVawANqq/IbsxotwB%2B77fJ/mg6PgvuTNZGkGIndaQpyEdtRP8TdQ%2BSt0ZAGZhnRAi8DmSG1HICU7jnm2RMMUojTHRF7G7N6pNXMYb8w5NQVi4Ah0oje7xaqayYgl4YLOi64y7FfEWLoEXYXX3jHBtMiO2%2Bbntw6ZHTXmCUgFZWgsBrqOSTEx2yn0Zo33pwkVAmV8AU%2B2uQMkwtwtz4J/oGbgLxvd
.............
..........................................Fatal Exception, yotta=0.13.1
Traceback (most recent call last):
File "/usr/local/bin/yt", line 4, in
yotta.main()
File "/usr/local/lib/python2.7/dist-packages/yotta/main.py", line 206, in main
status = args.command(args, following_args)
File "/usr/local/lib/python2.7/dist-packages/yotta/build.py", line 46, in execCommand
status = installAndBuild(args, following_args)
File "/usr/local/lib/python2.7/dist-packages/yotta/build.py", line 70, in installAndBuild
target, errors = c.satisfyTarget(args.target, additional_config=args.config)
File "/usr/local/lib/python2.7/dist-packages/yotta/lib/component.py", line 672, in satisfyTarget
additional_config = additional_config
File "/usr/local/lib/python2.7/dist-packages/yotta/lib/target.py", line 143, in getDerivedTarget
type = 'target'
File "/usr/local/lib/python2.7/dist-packages/yotta/lib/access.py", line 371, in satisfyVersion
name, version_required, working_directory, type=type, inherit_shrinkwrap = inherit_shrinkwrap
File "/usr/local/lib/python2.7/dist-packages/yotta/lib/access.py", line 307, in satisfyVersionByInstalling
name, version_required, install_into, v, type=type, inherit_shrinkwrap = inherit_shrinkwrap
File "/usr/local/lib/python2.7/dist-packages/yotta/lib/access.py", line 318, in _satisfyVersionByInstallingVersion
version.unpackInto(working_directory)
File "/usr/local/lib/python2.7/dist-packages/yotta/lib/registry_access.py", line 447, in unpackInto
_getTarball(self.url, directory, self.sha256)
File "/usr/local/lib/python2.7/dist-packages/yotta/lib/registry_access.py", line 100, in wrapped
return fn(*args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/yotta/lib/registry_access.py", line 185, in wrapped
return fn(*args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/yotta/lib/registry_access.py", line 168, in wrapped
return fn(*args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/yotta/lib/registry_access.py", line 154, in wrapped
auth.authorizeUser(provider=None, interactive=interactive)
File "/usr/local/lib/python2.7/dist-packages/yotta/lib/auth.py", line 125, in authorizeUser
raise AuthTimedOut('timed out: please try again.')
Best
Simon

Following offline discussion, this turned out to be due to the "no verified emails found" error page: verifying the email address solved the problem. (closing)


Feedback for “System Requirements”

I get "unknown publicer" when trying to install with .exe in windows 10 enterprise. is it possible to add a publisher in the installer?

https://docs.useanything.com/installation/desktop/windows#install-using-the-installation-file


Cannot read properties of undefined (reading 'set')

Describe the bug
I followed and copied exactly the example here: https://github.com/caching-tools/next-shared-cache/blob/canary/docs/examples/use-with-redis.md
I used the example with the normal redis (not stack).
And I get the following error:
Failed to update prerender cache for 44895796bd01128d010b1b73580f573032b5251b40c1999a9c0798af8e159942 TypeError: Cannot read properties of undefined (reading 'set')
    at _IncrementalCache.set (/Users/.../test-project/node_modules/.pnpm/@neshca+cache-handler@0.4.2/node_modules/@neshca/cache-handler/dist/cache-handler.js:258:35)

To Reproduce
I reproduced it by cloning the NextJS docs example described here:
https://github.com/vercel/next.js/blob/canary/examples/cache-handler-redis/README.md
Steps to reproduce the behavior:

npx create-next-app --example cache-handler-redis cache-handler-redis-app
Edit next.config.js with:

incrementalCacheHandlerPath: require.resolve(
      "./cache-handler-redis.js" // if you're using Redis without JSON support
      // "./cache-handler-redis-stack.js"
    ),

Run npm run dev
Go to http://localhost:3000/WET
See error in logs

Expected behavior
Cache in redis without the error.
Desktop (please complete the following information):

OS: MacOS 14.1
Browser: Arc Version 1.15.2
Version

"@neshca/cache-handler": "latest",
"@neshca/json-replacer-reviver": "latest",

Hey, @AlexisWalravens! Thank you for this issue. I fixed the bug and published a new release. Update the dependency and ensure you are using 0.4.3 version

Thanks @better-salmon it works great now!
Glad you did this helper, because I stumbled upon the new self-hosted docs PR last week and I tried to implement the custom cache handler myself with redis, and your solution is way elegant than mine. :)

Thank you too! Check out this docs section about caching in dev mode. Also, I recommend avoiding the use of Redis in a development environment. Instead, using the built-in LRU cache or a Map as an alternative to Redis is best. You can opt-in to the local LRU cache if you do not call onCreation.
I plan to create documentation to explain this behavior in more detail.
In addition, please feel free to provide feedback and suggestions regarding the API, DX, and the usefulness of existing examples and documentation in the discussion's ideas section.


Import SnabbVMX top

Import Marcel's snabbvmx top command and adapt it to lwaftr branch.
The PR also fixes an error in ingress-packet-monitor timer. When checking whether the ingress-packet-drops counters exists is necessary to append the suffix ".counter" if not present. Otherwise there might be two counters:  "ingress-packet-drops" and "ingress-packet-drops.counter".

 Maybe worth making column 1 a bit larger.
Also on a side node, whenever I hit the Ingress drop monitor, snabb crashes currently on me, even with low packet rates. It doesn't matter if I set it to warn or flush. Just reading seems to trigger it.
I did build it with this pull request, so should have everything in so far.
But great to see this familiar screen again after a long time ;-)
 lwaftr (rx/tx/txdrop in Mpps)   rx      tx      rxGb    txGb    txdrop
 lwaftr_v6                       0.05    0.05    0.16    0.16    0.049979
 lwaftr_v4                       0.05    0.00    0.14    0.00    0.000000

                                               Total           per second
 lwaftr_v6 in-ipv6-packets                   597,946               50,028
 lwaftr_v6 in-ipv6-bytes                 235,035,482           19,665,552
 lwaftr_v6 out-ipv6-packets                  597,948               50,028
 lwaftr_v6 out-ipv6-bytes                235,035,718           19,665,552
 lwaftr_v6 drop-all-ipv6-iface-              597,946               50,028
 lwaftr_v6 in-ipv6-frag-reassem                    0                    0
 lwaftr_v6 drop-ipv6-frag-inval                    0                    0
 lwaftr_v6 out-ipv6-frag                           0                    0
 lwaftr_v6 out-ipv6-frag-not                       0                    0

                                               Total           per second
 nic ifInDiscards                                  0                    0

                                               Total           per second
 lwaftr_v4 in-ipv4-packets                   597,948               50,028
 lwaftr_v4 in-ipv4-bytes                 211,117,798           17,664,432
 lwaftr_v4 out-ipv4-packets                        0                    0
 lwaftr_v4 out-ipv4-bytes                          0                    0
 lwaftr_v4 drop-all-ipv4-iface-                    0                    0
 lwaftr_v4 in-ipv4-frag-reassem                    0                    0
 lwaftr_v4 drop-ipv4-frag-inval                    0                    0
 lwaftr_v4 out-ipv4-frag                           0                    0
 lwaftr_v4 out-ipv4-frag-not                       0                    0

Fixed column adjustment and allow selecting snabb instance per id.

Overall, really nice work. On the nits side, luacheck is a bit loud about top.lua and it would be good to reduce the amount of output it has:
% luacheck top.lua
Checking top.lua                                  Failure

    top.lua:3:7: unused variable S
    top.lua:32:4: accessing undefined variable main
    top.lua:69:28: unused argument code
    top.lua:71:4: accessing undefined variable main
    top.lua:84:10: setting non-standard global variable run
    top.lua:87:21: accessing undefined variable open_counters
    top.lua:88:10: unused variable configs
    top.lua:92:25: accessing undefined variable get_stats
    top.lua:96:10: accessing undefined variable print_lwaftr_metrics
    top.lua:105:10: setting non-standard global variable open_counters
    top.lua:124:10: setting non-standard global variable get_stats
    top.lua:141:10: setting non-standard global variable print_lwaftr_metrics
    top.lua:162:4: accessing undefined variable print_row
    top.lua:165:10: unused variable rx
    top.lua:165:14: unused variable tx
    top.lua:165:18: unused variable rxbytes
    top.lua:165:27: unused variable txbytes
    top.lua:165:36: unused variable drop
    top.lua:166:20: unused loop variable lwaftr
    top.lua:171:16: shadowing definition of variable rx on line 165
    top.lua:171:20: shadowing definition of variable tx on line 165
    top.lua:171:24: shadowing definition of variable rxbytes on line 165
    top.lua:171:33: shadowing definition of variable txbytes on line 165
    top.lua:171:42: shadowing definition of variable drop on line 165
    top.lua:177:10: accessing undefined variable print_row
    top.lua:178:13: accessing undefined variable float_s
    top.lua:179:13: accessing undefined variable float_s
    top.lua:180:13: accessing undefined variable float_s
    top.lua:181:13: accessing undefined variable float_s
    top.lua:182:13: accessing undefined variable float_l
    top.lua:189:20: unused loop variable lwaftr
    top.lua:197:13: accessing undefined variable print_row
    top.lua:198:16: accessing undefined variable int_s
    top.lua:198:32: accessing undefined variable int_s
    top.lua:202:16: accessing undefined variable print_row
    top.lua:203:19: accessing undefined variable int_s
    top.lua:203:35: accessing undefined variable int_s
    top.lua:210:10: setting non-standard global variable pad_str
    top.lua:215:10: setting non-standard global variable print_row
    top.lua:217:31: accessing undefined variable pad_str
    top.lua:222:10: setting non-standard global variable int_s
    top.lua:227:10: setting non-standard global variable float_s
    top.lua:231:10: setting non-standard global variable float_l

Updated top.lua. After clean up:
$ luacheck program/snabbvmx/top/top.lua
Checking program/snabbvmx/top/top.lua             4 warnings

    program/snabbvmx/top/top.lua:1:1: accessing undefined variable module
    program/snabbvmx/top/top.lua:31:4: accessing undefined variable main
    program/snabbvmx/top/top.lua:199:4: accessing undefined variable main
    program/snabbvmx/top/top.lua:212:10: setting non-standard global variable run

LGTM


[UNDERTOW-797] Tests for serving pre-compressed resources

Can one of the admins verify this patch?

This is ok to test


Add a TFLite to  JAX conversion example

Related issue: https://github.com/google/jax/issues/15627
Test=https://colab.sandbox.google.com/github/zehuiw/codelabs/blob/tflite-jax-colab/ODML/jax_to_tflite.ipynb
After this colab is checked in, I will update the tutorials on tensorflow.org and link this colab.

@arfaian  for a review pass. thanks!


Any way of using with .eslintrc.js?

for me it is basically using a eslint default config, but i have many projects with different rules and I wish there is a way to load config from .eslintrc.js

If you have eslint config, it should automatically be using that config. No need to load anything manually, just open Neovim in your project directory (where the eslint config is).

this happens to me too, it does not work


Frontend web development html Entities

Description 📜
added code block for html code which was getting rendered in markdown. added some more information and a useful website for list of entities for reference.
Fixes: #2348

Type of change 📝

[ ] Au#dio (Should be in mp3 format Includes speech clarity, Concise ,Low distortion)
[ ] Vi#deo (Animations, screen-recordings, presentations and regular explanatory films are all possibilties etc)
[x] Documentation (Content Creation in the form of codes or tutorials)
[ ] Other (If you choose other, Please mention changes below)

Domain of Contribution 📊

[ ] Android Dev #(Flutter)
[ ] Android Dev #(Java)
[ ] Android Dev #(Kotlin)
[ ] Backend Dev #(Java)
[ ] Backend Dev #(.NET)
[ ] Backend Dev #(PHP)
[ ] Backend Dev #(Python)
[ ] C/#CPP
[ ] Competitive #Programming
[ ] Cyber #Security
[ ] DS#A
[ ] Data#base
[ ] Datascience with #Python
[ ] Datascience with #R
[x] Frontend Dev HTML/CSS/JS
[ ] Frontend Dev #React/Angular/Vue
[ ] Go#lang
[ ] Interview #Prep
[ ] Java_#Domain
[ ] Java#Script
[ ] ME#RN
[ ] Machine #Learning
[ ] Open #Source
[ ] Python_#Domain
[ ] Ru#st
[ ] Statis#tics
[ ] UI/#UX

Checklist ✅

[x] I follow Contributing Guidelines & Code of conduct of this project.
[x] I have performed a self-review of my own code or work.
[x] I have commented my code, particularly in hard-to-understand areas.
[x] My changes generates no new warnings.
[x] I'm GWOC'21 contributor

Screenshots / Gif (Optional) 📸

@sifa123 @Knighthawk-Leo please review the changes.

I want to contribute

https://colab.research.google.com/drive/1_fpgAlHBlyNM4EHQj7NDH1Ykv76jDiSN?usp=sharing

@sifa123 I have made the changes. Please check.

@sifa123 I have made the changes. Please check.

Awesome..well done 💯


Add function verify_no_packet_any() to check there are no packets on …

…any ports

@antoninbas , please review

I am confused by this PR. It seems to be undoing a lot of recent changes and I cannot see verify_no_packet_any anywhere.

Sorry. My bad. I double check it.


[UnderlineNav]: A11y improvements

Just a few accessibility improvements while preparing UnderlineNav to accessibility review

Move More button into the ul to make it a sibling to other li elements.
Set arrow buttons' tabIndex to -1 when there are not visible.

Take a look at the What we look for in reviews section of the contributing guidelines for more information on how we review PRs.

Closing this, as it is going to be handled in the another PR where it causes an issue.


Auto-export doesn't work.

Zotero Better BibLatex 1.6.2
Desktop Zotero <IP_ADDRESS>
Mac The Capitan

Where do you get this message? I'm not seeing it. Could you upgrade to <IP_ADDRESS> and see if it still happens?

I am using the last zotero version.
Here a screenshot

I thought your message said <IP_ADDRESS> before. But is there any problem beyond that message being present in the addons pane?

My library is not automatically exported.

There are a couple of situations where BBT could be expected to auto-export:

When manually kicked off from the preferences
When auto-export is set to idle, and you've not touched the computer for about 20 seconds
When auto-export is set to "on change", and you've changed an item in a collection that is set up for auto-export

Which of these is failing?

When it is set to idle or on change.

Can you try this version: http://tempsend.com/15CC8978C7

It doesn't  work.

And this one: http://tempsend.com/B71473EC94

Now it is working :+1:
Thanks!

Super, thanks for reporting it and helping me test. Release tests are running, when they go green I'll release 1.6.3.

Please force-upgrade to 1.6.3; an updated library just managed to slip in during that last debug build, 1.6.3 contains a fix for an api change in it.

@retorquere I'm still getting this problem. I'm on El Capitan, latest version of Zotero, BBL 1.6.16. Let me know if you need me to provide some debug traces.

I didn't know you were experiencing problems. A debug trace will be most
helpful.

BTW @phretor could you please open a new issue for the problem you are experiencing? It is hard to track progress on closed issues, I am bound to forget action is still desired. I've just tried on my on Mac (also on ElCap), and I'm not experiencing problems with auto-export.

A new release is out that may incidentally fix your problem as it may be related; if not, please do open a new issue.

@retorquere the new release seems to have fixed the problem. Thanks!

@retorquere I'm currently (since ca. 1 month) experiencing  the same problem's with autoexporting a bibliography "on change". I don't know exactly how to provide you debugging information but if you tell me what you need I will be more than happy to provide you all the logfiles etc.
OS: 10.9.5
Zotero: 4.8.28
Zotero Better BibLatex: 1.6.22

Let's find out whether the log has enough detail:

Go into BBT prefs, "debug" tab, enable extended logging
Trigger a change that should cause an auto-export
From the zotero gear menu, select "send BBT error"
Paste the resulting ID here.

@retorquere Thank you for your help. The id is JKTNV6IX.

Super, that had the info I needed. It looks to be a shamefully stupid mistake on my part for which I honestly don't know how the current test that's supposed to cover it runs green :worried:. Looking into that separately.
I think I have it fixed though; could you give http://tempsend.com/C8DCFEB249a try?

@retorquere Great that you have found the bug! Nothing to shame, I wouldn't even know where to start bughunting! Anyway, this is a good one :) I couldn't give it a try because the temporary url throws a 404. Do you mind reuploading it?

Oops, that closure was accidental. I'll get you a new version when I'm home, about 15 minutes

http://tempsend.com/7CF025465E

@retorquere Thx for the quick response. I'm sorry to say that it does not solve my problem. I have sent you another report XHI6EPAW.
It might be interesting that in the "better bibtex preferences pane" under "automatic export" the status says "done (undefined)". If I remember correctly, there was always a timestamp/date instead of undefined.

Could it be this is a new auto-exported collection? There was indeed a bug where newly added exports did not get a timestamp.
The new log doesn't show any auto export activity, but it also doesn't show any item change activity. If it is true there was no item change, there won't have been a trigger to kick off an auto-export. Could you make a trivial change to a reference (adding a character to a field and then removing it would do it) to kick it off?

Here is the new debug id WIPP6BTD. The auto-export collection has persisted a long time (think half a year) before it stoped working. Since then I've added it various time but had no luck. I've now added a book to the collection and changed some characters, no automatic export ...

I see the activity in the log; it's even scheduling an export, but not performing it. Can you get me a log from http://tempsend.com/E24DC6F202 ?

@retorquere the log id is SNG6KCW2. What I've done was importing a book into the collection and no autoexport happend and status was still undefined. Then I triggered a manual export sucessfully wit status showing a new timestamp.

This is so weird. I don't see any activity indicating a reference import in that log. Not from BBT, but also not from Zotero itself.
Can you try the following:

Install http://tempsend.com/5FB06AAEC9
Go into preferences, BBT, debug, and enable extended debugging if you haven't already
Still in preferences, BBT, debug, check "show reference ID"
In the reference list, at the far right of the column headers, you'll see a blocky icon with a down arrow.
Under "More columns", make sure "call number" is checked.
Go into preferences, advanced, clear the log
Import a new reference
Post the debug ID, the title of the reference you just imported, and the reference ID which is now in the call number column.

@retorquere I hope that I did not mess up anything if this behaviour is so strange. I did all what said, the id is CGE3D44H, the title of the book was "Ecotourism: Principles and Practices", the reference id is 188. I hope this take helps you to find the problem. Thank you so much for spending your time on that issue. Highly appreciated!

Is this item 188 a new or an existing item? Zotero should have fired an itemChanged event (doesn't matter if it's a new item or a change). That event is simply not present in the log. I do see activity around 188, but that's addition to a collection, but that's an addition of an existing item to a collection 56, where you only have collection 39 set up for auto-export.

This is totally crazy. Item 188 is an existing item. My collection structure looks like:

col1 (this is the autoexport collection)

col1.1

item 188 (this is the added item)
item 2
item 3

col1.2

item 4
item 5

col2

I have setup an autoexport for col1, as said half a year ago and it was working. If I add an item to col1.1 the autoexport was triggered and the whole col1 was exported to the specified bibfile. Since short, same procedure nothing happens. Then I tried to create an autoexport for col1.1, add an item directly to this collection and the autoexport is triggered and executed. Has something changed in the latest releases in a matter that changes in a subcollection does not trigger a autoexport event in the parent collection?

Do you have recursive display on or off?

Hell, this was the problem! Setting extensions.zotero.recursiveCollection to true did the trick! I, really, can't remember that I have changed this option (btw, I have never heard about it) ... Anyway, it is good to know that this affects the export. I'm very sorry for all the time you have spend for solving my problem. Autoexport is one of my favourite features! Thanky, you, REALLY!

No worries. In the BBT preferences, "export collections recursively" in fact toggles this setting. BBT always tries to export what the collection actually shows. I'm actually a little ambivalent about the current implementation, I do sometimes want to export recursively but not display recursively, but this was conceptually most clear I thought.
Does this account for all your problems with auto-export?

(don't forget to undo the debugging settings)

It seems that all my problems are gone! Good hint with debugging, was on :-). Please close the ticket and have a nice weekend!

Don't forget the call number thingie.
My pleasure. I've cleaned up some things as I was going through this, so it's never a loss.


[SPARK-35151][BUILD] Add compile arg to suppress symbol literal is deprecated compilation warnings in Scala 2.13

What changes were proposed in this pull request?
There are some compilation warnings in Scala 2.13 as follows:
[WARNING] [Warn] /spark-source/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/EncoderResolutionSuite.scala:88: [deprecation @  | origin= | version=2.13.0] symbol literal is deprecated; use Symbol("arr") instead
[WARNING] [Warn] /spark-source/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/EncoderResolutionSuite.scala:102: [deprecation @  | origin= | version=2.13.0] symbol literal is deprecated; use Symbol("arr") instead

The main change of this pr is add a compile arg to temporarily  suppress these compilation warnings to make compile log look cleaner.
Why are the changes needed?
Temporarily  suppress symbol literal is deprecated compilation warnings to make compile log look cleaner.
Does this PR introduce any user-facing change?
No
How was this patch tested?

Pass the Jenkins or GitHub Action
Manual test：symbol literal is deprecated related warnings are no longer included in the compilation log

cc @cloud-fan

Test build #137694 has started for PR 32261 at commit 4c97fc9.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42221/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42221/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42221/

Test build #137694 has finished for PR 32261 at commit 4c97fc9.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137694/

Test build #138038 has started for PR 32261 at commit 56ba63c.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42557/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42557/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42557/

Test build #138038 has finished for PR 32261 at commit 56ba63c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138038/


[SW-988] Validate transaction before signing

labels in advancedDetails were missed in #2135, used the same approach as in #2158

Lgtm


Package lock.json

okay, last commit was not picked up when I merged. The change in the masters. I'll close this PR.


Better Error Type

The current error type could be better. I think we should basically do something like:
pub enum ErrorKind {
    Api(ApiError),
    Client(ClientError),
}

pub struct ClientError {
    kind: ClientErrorKind
}

enum ClientErrorKind {
    Http(reqwest::Error),
    Json(serde_json::Error)
}

So we have the easy match on ErrorKind::Api, and the rest is a black box.

We should stop re-exporting ParseResponseError from the error module and use the one in client::responses::parse.


Feature Request for quiz inputs on Huggingface courses

INSPIRATION:
I was going through the "Deep RL Course" and for as much as I love huggingface and its courses it seemed ironic that the "free response" questions (https://huggingface.co/deep-rl-course/unit1/quiz?fw=pt#q5-what-is-the-explorationexploitation-tradeoff) didn`t leverage Huggingface and include a gradio input (or something along those lines) that would analyze sentence similarity with the input and the answer.
FEATURE:
Create an input <FreeResponse ...> that takes in the correct answer and user input and returns how correct it is leveraging models already in Huggingface Hub. Similar to (https://github.com/huggingface/deep-rl-class/blob/07008786541ad96e143f95be309f2a89a80ff988/units/en/unit1/quiz.mdx?plain=1#L28)
SEEKING ADVICE:
I really wanted to make the contribution but when researching how the <Question ...> tag worked I realized here https://github.com/huggingface/deep-rl-class/blob/07008786541ad96e143f95be309f2a89a80ff988/units/en/unit1/quiz.mdx?plain=1#L28 that there is some additional processing happening at some other step that does not exist within this repository. Where else should I look to see how the <Question ...> tag works?
Any additional advice on how to create this feature and contribute it back to Hugginface?
Thanks in advance!

Hey there 👋 , that's a good idea to use sentence similarity. For now, we keep the scope of the quiz small as a small check.
But if you're interested I'm going to ask <Question ...> tag works.

Yes, please do, I'd be interested in adding this.

FYI I opened an issue in the tool used to build quizzes about this https://github.com/huggingface/doc-builder/issues/341

Closing this issue for now, we don't plan to update the quizzes for now 🤗


ARROW-17769: [Java] Upgrade adapter/ to Junit 5

Remove usage of junit-4 from adapter submodules
See: ARROW-17769

Filed ARROW-17785 for one CI error (unrelated to this), but it seems the Avro test failures are real? https://github.com/apache/arrow/actions/runs/3079245648/jobs/5000258273#step:5:11465

@lidavidm
Looks like it's an issue with Junit 5 itself. I've disabled these tests for Win.
https://github.com/junit-team/junit5/issues/2811

I don't see any changes related to that, though disabling tests on Windows is not great - is there any workaround? Maybe an @AfterEach annotation to clear the temporary directory explicitly?

@lidavidm Please take a look again, the work around here is not to use @TempDir at all

@github-actions crossbow submit java

Thanks @andreoss, do you mind rebasing to see if we can get past these CI things?

Hmm, the CI failures definitely seem to be related to this PR, but I can't quite figure out how…

Hmm, the hashFiles issue is still there - so there's still temp files being left behind

Closing because it has been untouched for a while, in case it's still relevant feel free to reopen and move it forward 👍


api for asset production

Hi , may i know if there is an API endpoint for asset energy production , if there is none , I would like to add the features  and contribute to the community . Thank you

im able to push random value for energy production for assets using API endpoint for assets consumptions which is this endpoint /api/assets/{id}/consumptions . However , first of all you must set the assets to produce energy and then send random negative value using that API endpoint to visualize the data in real time on the graph chart . Thank you


Chore/upgrade angular

Codecov Report

Merging #35 (e0705d8) into master (16ef260) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##            master       #35   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            2         1    -1
  Lines           26        23    -3
  Branches         9         9
=========================================
- Hits            26        23    -3

Impacted Files
Coverage Δ

...able-lifecycle/src/lib/ngx-observable-lifecycle.ts
100.00% <ø> (ø)

projects/ngx-observable-lifecycle/src/test.ts

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 16ef260...e0705d8. Read the comment docs.


31884 Bus error, how do I create tiles from the files calculating ~ 120 million features ?

Hi,
I am trying to create the tiles from the geojson source(~250 gb) and I have enough of disk space(2T) for these tiles. But Tippecanoe is giving me 31884 Bus error along with the count of 120 million features. And it won't start creating the tiles.
How do I handle this much of data for tile creation? Any suggestions?

Yes, it works correctly with the same chunk of data. I am using following options while running
--maximum-zoom=14 --detect-longitude-wraparound --no-tiny-polygon-reduction --no-tile-size-limit --no-line-simplification --no-tile-compression --include="A" --include="B" --include="C’" --include="D" --include="E" --include="F" --include="G"
Can you assist me with running the tippecanoe under gdb ? How do I run it in background as the process takes nearly a day?

OK, the terminate called after throwing an instance of 'std::bad_alloc' what(): std::bad_alloc clarifies a lot: the Tippecanoe process is running out of memory.
This is probably because you have done --no-tiny-polygon-reduction and --no-line-simplification, so it has to try to represent every polygon, no matter how small, in all of its facets, in the zoom level 0 tile. I would suggest running it again without these options.
If you want to run it under gdb, you would do:
$ gdb tippecanoe
GNU gdb (Ubuntu 7.7.1-0ubuntu5~14.04.2) 7.7.1
…

I don't think there is a way to run a program under gdb in the background. I think it gets foregrounded as soon as you attach the debugger to the process. But you could run it in screen or  tmux so that the entire login session is backgrounded.

Ok so I tried removing those options over a chunk of data but it hampers the precision at higher zoom levels. I can set minimum-zoom to 6 to help to avoid the memory issue to a certain extent here. Is there any other way you can suggest to avoid this memory issue and make it run successfully?

You can use --simplify-only-low-zooms instead of --no-line-simplification to simplify only at the low zoom levels and preserve all the points at the highest zoom level.

@ericfischer Hey Eric, I am facing few problems here. I am using the following command attributes while generating the tiles
--minimum-zoom=10 --maximum-zoom=14 --detect-longitude-wraparound --no-tiny-polygon-reduction --no-tile-size-limit --simplify-only-low-zooms --drop-densest-as-needed --extend-zooms-if-still-dropping --no-tile-compression
During the read phase, it reads ~100 million records and suddenly gives
You will probably run out of disk space.<PHONE_NUMBER>5 bytes used or committed, of<PHONE_NUMBER>2 originally available geom: Write to temporary file failed: No space left on device
error.
I think it uses the root disk(31gb) for writing it temporarily. Is there any other way to change it to some other disk? And what exactly the library does in this "read" phase?

Thanks for answering about the temporary file location, @geeknik!
To answer the other question: there are basically three phases to Tippecanoe processing:

Reading, during which GeoJSON is parsed, reprojected, and converted to an internal format in a temporary file
Sorting, during which all the features in the temporary file are reordered into quadkey order, to facilitate separation into tiles, as well as density calculation and dot-dropping
Tiling, when the internal data format is split into tiles and converted into vector tile format

"Reading" creates the temporary file, "sorting" reorders it, and "tiling" reads through it once for each zoom level and at the same time creates a new one for the following zoom level.