python310Packages.weconnect: 0.36.4 -> 0.37.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for python310Packages.weconnect is: "Python client for the Volkswagen WeConnect Services"
meta.homepage for python310Packages.weconnect is: "https://github.com/tillsteinbach/WeConnect-python"
meta.changelog for python310Packages.weconnect is: ""
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS

Warning: a test defined in passthru.tests did not pass

0 of 0 passed binary check by having a zero exit code.

0 of 0 passed binary check by having the new version present in output.

found 0.37.0 with grep in /nix/store/rl1naq0ryg7jr91n3mmbc0sgz8jp6j90-python3.10-weconnect-0.37.0

found 0.37.0 in filename of file in /nix/store/rl1naq0ryg7jr91n3mmbc0sgz8jp6j90-python3.10-weconnect-0.37.0

Rebuild report (if merged into master) (click to expand)

8 total rebuild path(s)

4 package rebuild(s)

4 x86_64-linux rebuild(s)
4 x86_64-darwin rebuild(s)

First fifty rebuilds by attrpath
python310Packages.weconnect
python310Packages.weconnect-mqtt
python39Packages.weconnect
python39Packages.weconnect-mqtt

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/rl1naq0ryg7jr91n3mmbc0sgz8jp6j90-python3.10-weconnect-0.37.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A python310Packages.weconnect https://github.com/r-ryantm/nixpkgs/archive/be03fce93a02a10da97f5fe1e95ea6f6a5e42529.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/rl1naq0ryg7jr91n3mmbc0sgz8jp6j90-python3.10-weconnect-0.37.0
ls -la /nix/store/rl1naq0ryg7jr91n3mmbc0sgz8jp6j90-python3.10-weconnect-0.37.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

2 packages failed to build:

python310Packages.weconnect-mqtt
python39Packages.weconnect-mqtt

2 packages built:

python310Packages.weconnect
python39Packages.weconnect

Maintainer pings
cc @fabaff for testing.

Superseded by #162065


hide by default

thank you for this component.
is it worth exporting the remaining object so we can set it to done by default?
Or in other words whats a good way to hide the countdown by default?
my usecase:
I want the countdown only to show up when it's not done. At the moment the component shows up when I load the page for a split second with 0 days 0hours... before the script is getting executed after which it hides. So it flashes up on each load but it should be just hidden once the countdown expired.

actually in general i need to wait for it to have mounted / calculated. It always pops 0 days 0 hours before getting executed

@rallisf1 thanks a lot!


Blocksync has a deadlock when receive invalid block response and cause the validator out of sync

https://hackerone.com/reports/2228253
Summary
Blocksync has a deadlock when receive invalid block response and cause the validator out of sync
Steps To Reproduce:
No need to reproduce since the dead lock is obvious.
Proof-of-Concept (PoC)
1.Get the response write lock here, let mut responses = self.responses.write(); https://github.com/AleoHQ/snarkOS/blob/testnet3/node/sync/src/block_sync.rs#L438
2.If  if block != existing_block https://github.com/AleoHQ/snarkOS/blob/testnet3/node/sync/src/block_sync.rs#L442C13-L442C22, will call self.remove_block_requests_to_peer(&peer_ip);
3.And in the self.remove_block_requests_to_peer, we need to get the read lock, https://github.com/AleoHQ/snarkOS/blob/testnet3/node/sync/src/block_sync.rs#L557, since we already held the write lock, we will get dead lock.
Supporting Material/References:
To illustrate the impact of this bug in more detail, a deadlock here triggers a cascade of other deadlocks, such as in self.locators.write() in remove_peer, which also deadlocks, causing the node to block all inbound processes when processing Event::PrimaryPing, which causes the node to cannot be synchronized properly. Additionally, deadlocks can lead to, for example, OOM with message stacking.
Impact
A valid node is likely cause other nodes dead lock according to the report, especially a malicious node will use this bug to make all nodes down.

Please specify snarkOS version.

I think this issue has been fixed: https://github.com/AleoHQ/snarkOS/commit/a2aa93d05ea413d1aee473211f13dc97fe4d4b7f

Closing, as a fix has been merged. Please feel free to reopen if the issue surfaces again.


dev(footer-component): update package version

What:
Update the footer package version
Why:
Relates to: https://app.asana.com/0/1168997577035609/1199684494225753/f
How:
Updating packages locally

@orlando This is just an update from the footer component package, I will merge this PR


ng downloads latest stable cli version from npm instead of using same version which is globally installed

🐞 Bug report
Command (mark with an x)

[ ] new
[ ] build
[ ] serve
[ ] test
[ ] e2e
[ ] generate
[ ] add
[x] update
[ ] lint
[ ] xi18n
[ ] run
[ ] config
[ ] help
[ ] version
[ ] doc

Is this a regression?
No, it was happening before.
Description
Command running: ng update. Local ng version was 10.0.1; and version 10.0.2 was installed globally. And global version was latest stable release.
So first, ng chooses local version, because global is newer.
Second: ng decides to download latest stable version from npm to the temporary folder and run it instead of using global version.
As the result it takes much longer time to run this command. Moreover I usually use ng update and than ng update @angular/cli @angular/core if there is an update. So it downloads same version twice instead of using global version.
🔬 Minimal Reproduction

Install latest stable version globally.
Run ng update in any project what needs to be updated.

🔥 Exception or Error

[user@mnjr driver]$ ng update
Your global Angular CLI version (10.0.2) is greater than your local
version (10.0.1). The local Angular CLI version is used.

To disable this warning use "ng config -g cli.warnings.versionMismatch false".
The installed local Angular CLI version is older than the latest stable version.
Installing a temporary version to perform the update.
Installing packages for tooling via npm.
Installed packages for tooling via npm.
Using package manager: 'npm'
Collecting installed dependencies...
Found 50 dependencies.
    We analyzed your package.json, there are some packages to update:

      Name                                Version                  Command to update
     ---------------------------------------------------------------------------------
      @angular/cli                        10.0.1 -> 10.0.2         ng update @angular/cli
      @angular/core                       10.0.2 -> 10.0.3         ng update @angular/core
[user@mnjr driver]$ ng update @angular/cli @angular/core
Your global Angular CLI version (10.0.2) is greater than your local
version (10.0.1). The local Angular CLI version is used.

To disable this warning use "ng config -g cli.warnings.versionMismatch false".
The installed local Angular CLI version is older than the latest stable version.
Installing a temporary version to perform the update.
Installing packages for tooling via npm.
Installed packages for tooling via npm.

🌍 Your Environment

Your global Angular CLI version (10.0.2) is greater than your local
version (10.0.1). The local Angular CLI version is used.

To disable this warning use "ng config -g cli.warnings.versionMismatch false".

     _                      _                 ____ _     ___
    / \   _ __   __ _ _   _| | __ _ _ __     / ___| |   |_ _|
   / △ \ | '_ \ / _` | | | | |/ _` | '__|   | |   | |    | |
  / ___ \| | | | (_| | |_| | | (_| | |      | |___| |___ | |
 /_/   \_\_| |_|\__, |\__,_|_|\__,_|_|       \____|_____|___|
                |___/

Angular CLI: 10.0.1
Node: 14.5.0
OS: linux x64

Angular: 10.0.2
... common, compiler, compiler-cli, core, forms
... language-service, platform-browser, platform-browser-dynamic
... router
Ivy Workspace:

Package                           Version
-----------------------------------------------------------
@angular-devkit/architect         0.1000.1
@angular-devkit/build-angular     0.1000.1
@angular-devkit/build-optimizer   0.1000.1
@angular-devkit/build-webpack     0.1000.1
@angular-devkit/core              9.1.10
@angular-devkit/schematics        9.1.10
@angular/cli                      10.0.1
@ngtools/webpack                  10.0.1
@schematics/angular               9.1.10
@schematics/update                0.1000.1
rxjs                              6.6.0
typescript                        3.9.6
webpack                           4.43.0

Hi @myemuk,
This is currently working as intended. However, I do agree we should do better by maybe reusing the temporary version. However this will be part of a bigger overhaul of the ng update experience and also reducing the footprint of the global Angular CLI installation.
The global Angular CLI, is used to enable ng in path and acts as a proxy to the local CLI. It is not used for anything else other than ng new.
It's important that ng update always downloads and uses the latest stable version to take advantage of bug fixes and features which effect the update experience.
My recommendation to avoid unnecessary temporary installations for the time being would be to run ng update @angular/cli prior of running ng update.


feat(sources): add Red Hat to Production

Currently doing an existence check of the records in https://security.access.redhat.com/data/osv/all.json
Spot checking the records that were 404'ing in Staging, they are now present there.

@jasinner FYI

Current blockers to merging:

[ ] Versions in Purls (makes API querying by Purl non-functional)
[ ] Architectures in versions (causes incorrect version sorting behaviour)

Individual record existence based on a snapshot of https://security.access.redhat.com/data/osv/all.json from earlier today checked out 100% 👍

https://github.com/ossf/osv-schema/pull/294 addresses both of the blocking issues, so once it has been validated, and the data regenerated and reviewed in Staging, this should be good to merge.


docs: clarify help documentation

It's a bit messy to talk about the source options in the help documentation.
Along with not mentioning them in the main docs, separate them out into a secondary group to highlight more important options.
resolves https://github.com/ionic-team/cordova-res/issues/15

Nice one 👍


Add mabirch.md file

created a branch, made a commit and opened a PR

merge Add new file with line 5 review feedback --> MAB


Vue

Will there be a Vue version? Thanks.

Definitely something I'm interested in doing! I'm currently in the middle of a huge update to another project, but as soon as I have a little breathing room, this could happen. I'll leave this issue open to track.

@arcbjorn Thanks for the kind words and the offer! I'm actually looking into migrating the whole library to https://github.com/BuilderIO/mitosis which would theoretically allow compiling to every major framework, including Vue. So I'd say hold off on that for now. If I take too long, or Mitosis doesn't end up being workable, I'd love for you to spearhead a Vue 3 version.

Any ideas how we could create a React Native lib for this? StyleSheet doesn't support pseudo-elements.
Maybe with Animated?

@ilindaniel I'm no React Native expert, but I think Animated is likely the way to go. Maybe start a new issue about this?

I'm bumping this up regarding Vue, would like to use this! Great project overall 🙏

@kibotrel There's good news on this front actually. I'm 95% finished with a big v2 update that migrates this whole lib over to web components, and adds 12 new loaders to boot. Since the loaders are shipped as custom elements, the new version will be compatible with pretty much everything, including Vue. I'm about to be away from my computer for a week, but the v2 should launch no later than the end of the month.

That's great news ! Keep up the good work man and take your time 😄

@kibotrel Official launched! https://www.producthunt.com/posts/ldrs

Damn, what a new, i'm exited to try it out. Good job man!


Update landing page welcome section with specified illustration

Update landing page welcome section with specified illustration

[x] Replace the current landing page's welcome section illustration with the specified illustration. Ensure it resizes responsively when adjusting in browsers.

Figma

FTU Explorer as of 10.18.2023

Different illustration chosen, added in #295


Bug: 'OmitHostOnPaginationLinks = true' throws exception

Hi Benjamin,
when I set OmitHostOnPaginationLinks = true in Delve configuration, method OmitHost in ResourceUriHelper throws exception NullReferenceException: Object reference not set to an instance of an object.

Thanks for reporting!


Dropped all peers after first stage loop iteration

Describe the bug
After my node's first iteration through the stage loop, it dropped all peers and was unable to establish new connections with peers for a few hours. After around 6-7 hours, peers started connecting again, and the node successfully synced to mainnet tip.

Other information:

reth.toml all default values.
Flags (RPC endpoint is not open to the internet, no logs suggesting malicious use of the admin endpoint to drop peers forcefully):

Steps to reproduce
Steps to reproduce:

Start syncing reth
After the first iteration through the stage loop, all peers drop and new peer connections could not be established for ~6h.

Node logs
n/a - Had full trace verbosity on (-vvvvv) and scanned through the logs, only relevant errors were related to `TooManyPeers` disconnections, which should be pretty standard.

Platform(s)
Linux (x86)
What version/commit are you on?
0.1.0-alpha.4
What database version are you on?
DB Version: 1
If you've built Reth from source, provide the full command you used
n/a - ghcr Docker image
Code of Conduct

[X] I agree to follow the Code of Conduct

Another user in tg reported the same issue. My guess is an issue in the transition from the pipeline sync to the beacon sync which results in lots of incorrect bad_message or similar so the node bans all of its peers.
AFAICT the new get_full_block_range() logic doesn't actually use the count here https://github.com/paradigmxyz/reth/blob/b46101afb5e549d40b7b2537fff9b67e05ad4448/crates/consensus/beacon/src/engine/sync.rs#L152
So it's only requesting a single block, but thinks it's requesting a range. Bug probably follows shortly after that flow but I haven't had time to dig further. I'm sure one of the core guys can quickly pinpoint

thanks @bemevolent
we only use the count when checking the response length, assumption here is that this will never exceed the soft response limit of ~1000 headers
but we were missing proper header validation which could lead to endless penalization cycle

I rebuilt with the latest headers changes and by chance had a node that was finishing syncing tonight. This is actually a different issue. After a first pipeline cycle is complete and it's starting a second run, but still far away from the chain tip (important!). It starts requesting lots of bodies and quickly receives empty body requests and bans peers here:
https://github.com/paradigmxyz/reth/blob/8c70524fc6031dcc268fd771797f35d6229848e7/crates/net/downloaders/src/bodies/request.rs#L90-L93
I'm assuming this is because after the 1st run bodies stage, there are no block requests for at least a day where the node has the time to peer to lots of full nodes that only store 128 historical blocks.
I'm happy to submit a fix but this goes beyond my knowledge of Ethereum p2p protocol. Should we ban full nodes until we reach the chain tip? In which case maybe there is a way to prevent peering to full nodes in the intermediate stage. Or should this just not be a reputation change for an empty response and the idea is one of the peers should have the historical block we're requesting?


feat: access TF using Authorization header

Passing api_key in data object is now deprecated.

[test]

Our tests are using the new Authorization header and passing, so I think it should be safe to merge this PR.

Thanks for this pull request. Some nit-picks. Only. Good work. I would prefer to update also README.md with reference to testing-farm repo in plumbers team, so user know where is API implementation.

I have added a note about testing-farm lib to the README. PTAL


Presets: '.json.mozlz4' or '.json' filename extension at save time

Observation
The file Open dialogue (in response to a click on either Browse … button) is preset to seek .json.mozlz4 or .json files.
Enhancement request
The Save as … button should result in routine that will automatically append the appropriate extension to the name of the file

maybe with the extension apparent in the Save dialogue.

Please, is that possible?

fixed


Add a logo JSON-LD meta information about Kubernetes

https://developers.google.com/search/docs/data-types/logo

@sftim can I get approve here?

I'd like this one to get an /lgtm first.

@remyleone you can find the current PR wrangler from https://github.com/kubernetes/website/wiki/PR-Wranglers

@gochist :)

@sftim @remyleone I'm sorry for the delay. It took me a while to get used to the improved notification feature on GitHub. The wiki page seems to differ from the actual Wrangler. The most accurate seems to be the [Minutes Document] (https://docs.google.com/document/d/1ddHwLK3kUMX1wVFIwlksjTk0MsqitBnWPe1LRa1Rx5A/edit).
/assign @jimangel


window.location.host is empty in webview context

Hi,
I'm using zoid in 3 envs -
web, ios & android.
everything works fine on web.
The problem is in ios & android where a webview is loaded from a template in the app.
In that case, what happens is that window.location.host === '' and I get the following error -

"Uncaught Error: Can not read window host"

I'm looking for a way to override and supply my domain manually (I've seen the mockDomain property).
function P(e) {
var n = (e = e || window).location;
if (!n)
throw new Error("Can not read window location");
var t = n.protocol;
if (!t)
throw new Error("Can not read window protocol");
if (t === w.FILE)
return w.FILE + "//";
if (t === w.ABOUT) {
var r = E(e);
return r && _() ? P(r) : w.ABOUT + "//"
}
var o = n.host;
if (!o)
throw new Error("Can not read window host");
return t + "//" + o
}
function x(e) {
var n = P(e = e || window);
return n && e.mockDomain && 0 === e.mockDomain.indexOf(w.MOCK) ? e.mockDomain : n
}

Do you have a solution by any chance?
I'm looking for a way to override it in the mean time.

That's the actual function that fails -
 function getActualDomain(win) {
            var location = (win = win || window).location;
            if (!location) throw new Error("Can not read window location");
            var protocol = location.protocol;
            if (!protocol) throw new Error("Can not read window protocol");
            if (protocol === PROTOCOL.FILE) return PROTOCOL.FILE + "//";
            if (protocol === PROTOCOL.ABOUT) {
                var parent = getParent(win);
                return parent && canReadFromWindow() ? getActualDomain(parent) : PROTOCOL.ABOUT + "//";
            }
            var host = location.host;
            if (!host) throw new Error("Can not read window host");
            return protocol + "//" + host;
        }

Found the problem -
On Android, You can use loadData & loadDataWithBaseURL when loading the webview, the latter fixes the issues.


obfuscator: obfuscate ip in onicecandidate

this is now shimmed post-adapter.

actually the obfuscator is living on the server...

wait, this should not happen. bug in the edge shim.

this one https://github.com/otalk/rtcpeerconnection-shim/pull/97


Issue #19: update of MaskingConverter (logback)

…to support events with MultiMarkers.

Codecov Report

Merging #20 into master will not change coverage.
The diff coverage is 100%.

@@           Coverage Diff            @@
##             master     #20   +/-   ##
========================================
  Coverage      79.5%   79.5%
  Complexity       76      76
========================================
  Files            16      16
  Lines           283     283
  Branches         43      43
========================================
  Hits            225     225
  Misses           38      38
  Partials         20      20

Impacted Files
Coverage Δ
Complexity Δ

.../owasp/security/logging/mask/MaskingConverter.java
100% <100%> (ø)
6 <0> (ø)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 62b4d09...58470bc. Read the comment docs.

thanks for helping us out


Breaks Copy/Paste with Ace Editor

Was having trouble copy/pasting code in ace editor and realized this had to do with this plugin.
Repo steps:

Go here: https://ace.c9.io/#nav=about
Copy code in editor
Pate it right back

Expected: Code is pasted
Result: Nothing is pasted
Will try to see if I can fix it, but wanted to post the issue first.

This extension works by preventing a site's JavaScript from receiving paste events, this is done in order to prevent the site from blocking the browser's default behavior for those events. There are sites that listen for paste events and do useful things with those events. For those sites you do not want this extension active, which is why you can configure this extension to disable itself on certain sites.
You will want to add an exclusion pattern for https://ace.c9.io/.* (or something similar that):

To add the exclusion pattern:

Go to chrome://extensions/
Click on the "Options" link for this extension


install.sh should have an option --conda-env-file

To allow reproduction of an existing environment.
x-ref #86 #84

Just to be clear, this should be in addition to the existing  --conda-pkgs option?

Either way. I'm not opposed to keeping --conda-pkgs, but I'm also not attached to it.


minecraft@java-edition: hash check failed

Sorry, once more a mismatch of the md5 check...
Best regards,
Werner
Scoop was updated successfully!
Installing 'minecraft' (java-edition) [64bit]
Minecraft.exe (2.1 MB) [================================================================] 100%
Checking hash of Minecraft.exe ... ERROR Hash check failed!
App:         games/minecraft
URL:         https://launcher.mojang.com/download/Minecraft.exe
First bytes: 4D 5A 90 00 03 00 00 00
Expected:    22954f65c6ea85374c7af7ec4cd617b022044a31445b1dc4dede3129fd5d4920
Actual:      a541356a3103201145eac713c3a056674253634d895810b249f87d2d7a654d17
Please try again or create a new issue by using the following link and paste your console output:
https://github.com/Calinou/scoop-games/issues/new?title=minecraft%40java-edition%3A+hash+check+failed

Should be fixed by https://github.com/Calinou/scoop-games/commit/31c42504a17dc0ed3bcce822c11fc3e782e20095.


Updated to supported GKE version

GKE version updated to supported one as suggested in the related issue.
1.9 will request the latest minor version available for 1.9.
I re-opened #6540 for release-1.0 because I think it's important to have a valid GKE value.
Fixes #6520

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: ymesika
To fully approve this pull request, please assign additional approvers.
We suggest the following additional approver: ostromart
Assign the PR to them by writing /assign @ostromart in a comment when ready.
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

install/OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


chore(deps): upgrade dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade-2.x" workflow

⚪ Backport skipped
The pull request was not backported as there were no branches to backport to. If this is a mistake, please apply the desired version labels or run the backport tool manually.
Manual backport
To create the backport manually run:
backport --pr 595

Questions ?
Please refer to the Backport tool documentation


Can't find secret freescout-db

I had en error with external database and password for it in values
Pod cant find secret freescout-db.
He's trying to find it, because there is code in the template of deployment:
- name: DB_PASS             valueFrom:               secretKeyRef:                 name: {{ .Values.externalDatabase.existingSecret.secretName | default (printf "%s-%s" .Release.Name "db") }}                 key: {{ .Values.externalDatabase.existingSecret.passwordKey | default "db-password" }}
Name of the secret is freescout-db
But in the template secret-db.yaml the name of secret is:
name: {{ printf "%s-%s" .Release.Name "mariadb"  }}
freescout-mariadb
That's why pod can't find it

I'm having the same issue, being forced to use k8s secrets to avoid this

@Pickachu1812 @FERNDIO-GITHUB thx both of you on catching this one!


Request for spatial softmax implementation

Spatial softmax is defined in End-to-End Training of Deep Visuomotor Policies. This is a request for an implementation in the TensorFlow API, or if the dimension flag for the regular softmax does this, could the term and an example be explicitly added to the g3doc?
It seems this may already be implemented with tf but not yet incorporated upstream according to Collective Robot Reinforcement Learning with Distributed Asynchronous Guided Policy Search:

This entire system, which we call asynchronous distributed
guided policy search (ADGPS), was implemented in the
distributed machine learning framework TensorFlow [...snip...]
Our architecture resembles prior work, with the visual features
represented by feature points produced via a spatial softmax
applied to the last convolutional
response maps.

The term "spatial softmax" is a bit of a misnomer - it should have probably been called spatial soft-argmax, since it's function is to return the expected pixel locations of each feature map. The softmax with the dim flag is not enough in itself, but is a useful tool in implementing the spatial soft-argmax. This can be achieved using a few lines of code in stock TensorFlow. You can first compute the spatial softmax of the features over the image dimensions with a little reshaping and transposing of the input:
# Assume features is of size [N, H, W, C] (batch_size, height, width, channels).
# Transpose it to [N, C, H, W], then reshape to [N * C, H * W] to compute softmax
# jointly over the image dimensions.
features = tf.reshape(tf.transpose(features, [0, 3, 1, 2]), [N * C, H * W])
softmax = tf.nn.softmax(features)
# Reshape and transpose back to original format.
softmax = tf.transpose(tf.reshape(softmax, [N, C, H, W]), [0, 2, 3, 1])

The above is the spatial softmax, which can be used as weights to compute the mean pixel locations of each channel as follows:
# Assume that image_coords is a tensor of size [H, W, 2] representing the image
# coordinates of each pixel.
# Convert softmax to shape [N, H, W, C, 1]
softmax = tf.expand_dims(softmax, -1)
# Convert image coords to shape [H, W, 1, 2]
image_coords = tf.expand_dims(image_coords, 2)
# Multiply (with broadcasting) and reduce over image dimensions to get the result
# of shape [N, C, 2]
spatial_soft_argmax = tf.reduce_sum(softmax * image_coords, reduction_indices=[1, 2])

Hope this helps.

Thanks Mrinal!  Closing since this is no longer a feature request.

@kalakris Thanks Mrinal! To confirm, the channels are features at that (h,w) coordinate for each problem in the batch, correct?

Yes that's correct - I used the terms 'channels' and 'features' interchangeably in my description above.

spatial_softmax is now directly available in layers.py.

Hi everyone,
I have implemented the spatial softmax as well, in a similar fashion that proposed here.
It works well in the forward pass. However, whenever trying to train a network containing this layer, it appears that after a single pass, it outputs either the center point or one of the corners.
Does anyone have an idea of what might cause this behavior? Any possible fixes?
The function I use is the following:
def spatial_softArgmax(filters, temperature = 1.0):

    shape = tf.shape(filters)
    height, width, num_channels = shape[1], shape[2], shape[3]

    posx, posy = tf.meshgrid(tf.lin_space(-1., 1., num = height),
                             tf.lin_space(-1., 1., num = width))

    posx = tf.reshape(posx, [height * width])
    posy = tf.reshape(posy, [height * width])

    filters = tf.reshape(tf.transpose(filters, [0, 3, 1, 2]), [-1, height * width])

    softmax_attention = tf.nn.softmax(filters / temperature)

    expected_x = tf.reduce_sum(posx * softmax_attention, 1, keep_dims = True)
    expected_y = tf.reduce_sum(posy * softmax_attention, 1, keep_dims = True)

    expected_xy = tf.concat([expected_x, expected_y], axis = 1)

    feature_keypoints = tf.reshape(expected_xy, [-1, num_channels * 2])

    return feature_keypoints

@jorisguerin did you figure it out?

@acrosson Yes I did, first there was an error in my function, one should change the following line:
posx, posy = tf.meshgrid(tf.lin_space(-1., 1., num = height),
                             tf.lin_space(-1., 1., num = width))

to
posx, posy = tf.meshgrid(tf.lin_space(-1., 1., num = height),
                             tf.lin_space(-1., 1., num = width),
                             indexing='ij')

Also, this behavior tends to happen for some reason. I found out two possible ways of avoiding it:

Reduce your learning rate
Add dropouts after your Spacial softArgMax layer

Hope this helps.

FYI spatial softmax has been available directly in tensorflow since 1.3, see:
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/contrib/layers/python/layers/layers.py#L2606

https://github.com/tensorflow/addons/issues/1364

Thanks @kalakris That worked great. But an issue I am facing is, since this involves a product of NC, I am unable to use dynamic batch size since Noneint is forbidden. Is this impossible or any workaround you know about? TIA

Thanks @kalakris That worked great. But an issue I am facing is, since this involves a product of NC, I am unable to use dynamic batch size since Noneint is forbidden. Is this impossible or any workaround you know about? TIA


Changing first to last by editing a node and accepting with Enter is not possible

Discord username
No response
What type of issue is this?
Permanent – Occurring repeatably
Is this issue blocking you from using Enso?

[ ] Yes, I can't use Enso because of this issue.

Is this a regression?

[ ] Yes, previous version of Enso did not have this issue.

What issue are you facing?
https://user-images.githubusercontent.com/12892578/235456361-b0d5905a-15bf-4824-ad94-60b49e2d3bf1.mov

add a vector
add another node and choose .first
edit the second node and type last instead of first
try to accept with Enter

Expected behaviour
Since this is a valid enso function that should be visible and choosable in CB Enter should be enough
How we can reproduce it?
No response
Screenshots or screencasts
No response
Enso Version
develop @ 6b0c682b08b7745368cec3474cc774c51a5b48f5
Browser or standalone distribution
Standalone distribution
Browser Version or standalone distribution
Standalone
Operating System
MacOS
Operating System Version
No response
Hardware you are using
No response

This will be fixed by having support for this argument in CB: https://github.com/enso-org/enso/issues/5232

Closing as sort of duplicate of https://github.com/enso-org/enso/issues/5232


[BUG] Error: Module level directives cause errors when bundled, 'use client' was ignored

Hello! I'm using react-tooltip within my Mendix pluggable widget.
When I upgrade react-tooltip from 5.12.0 to 5.13.0 or 5.13.1 I'm no longer able to build my widget and I'm getting this error:
node_modules\react-tooltip\dist\react-tooltip.min.mjs (7:0) Error: Module level directives cause errors when bundled, 'use client' was ignored.5
I see that 'use client' is added in commit 0ae1c20 to prevent breaking Next.js 13 projects.
Any idea how to fix this issue?

After checking the example repo and checking for the issue at the web, I believe the best way to handle this issue is to remove the 'use client' from our library, and in our troubleshooting section, suggest to the devs to create a Tooltip component in their projects with the 'use client' at the top of it.
Does it make sense @gabrieljablonski?

@danielbarion How do other libraries usually tackle this issue? My guess is they just ignore it and let the user handle it themselves, so removing "use client" and adding a troubleshooting section seems adequate.
Another possibility would be to add a postinstall script that checks whether we're in a next.js project and automatically adding the directive to the build files, but that seems excessive.
For the troubleshooting section, we should definitely add a snippet the user can just copy and paste to get it to work, such as:
// ./ReactTooltip.tsx
"use client"

export * from 'react-tooltip'

Not sure if this exact snippet would work as is, but it should be as simple as possible.

Thanks a lot!


Spotify isn't scrobbling on Chrome 43.0.2357.134 (64-bit), Mac 10.10.4 13 inch Macbook pro

Can you please post version of the extension and details of your issue?
Screen size of your Macbook isn't really relevant :-P

Version 1.54, chrome 46.0.2490.86 (64-bit), mac 10.11.1
Can't reauthenticate on the options page - clicking on the button does nothing
on vk.com the icon is always "ready to scrobble", on youtube it always "searching for the song"
Ready to provide any other useful information

I'm closing this issue because looks like new Spotify player is default for most users; the issue is not related to current web player.


Typo "～TFS 2015 "→"～TFS 2015"

https://docs.microsoft.com/en-us/azure/devops/repos/git/get-started-vs2013?view=azure-devops

@hyoshioka0128 : Thanks for your contribution! The author(s) have been notified to review your proposed change.


[An error occurred in the loading package versions (package:MyPackage)] Unexpected end of JSON input

Packages are hosted in ProGet package Server.
App shows loaded versions and can search for packages in ProGet. However, attempting to run Load Package Versions throws this error.

Figured out the issue. Needed to use the flatfile URL, which returned correct version information.
Their search URL also ends with /search instead of the common /query.

I think your problem is same as #15, this extension only support NuGet standard JSON result.
To see your API result follow the below steps:
VSCode -> Menu -> Help -> Toggle Developer Tools > Console Tab
*compare it with NuGet result https://azuresearch-usnc.nuget.org/query
check out  settings.json too


[Feature request] API for querying shape voxelization state

in progress
done

or similar.

The feature is available in 0.4.0-beta3.


Assertion failure in [UICollectionView _endItemAnimations]

I get an error after incorporate LXReorderableCollectionViewFlowLayout in my application.
My aplication work well and drag and drop cell well, but when I try to drag first view in my collection view, application report:
013-04-16 18:24:35.049 PowerComicReader[5354:c07] will begin drag
2013-04-16 18:24:35.352 PowerComicReader[5354:c07] did begin drag
2013-04-16 18:24:35.881 PowerComicReader[5354:c07] *** Assertion failure in -[UICollectionView _endItemAnimations], /SourceCache/UIKit_Sim/UIKit-2380.17/UICollectionView.m:2801
Always broke in line:
[self.collectionView performBatchUpdates:^{
Of file: LXReorderableCollectionViewFlowLayout.m
Any idea about this problem?
Thanks

Index position has been changed while deleting cells


Copy goes wrong with AzCopy 10.5.0 (works with 10.4.3)

Which version of the AzCopy was used?
Note: The version is visible when running AzCopy without any argument
azcopy version 10.5.0
Which platform are you using? (ex: Windows, Mac, Linux)
Windows
What command did you run?
Note: Please remove the SAS to avoid exposing your credentials. If you cannot remember the exact command, please retrieve it from the beginning of the log file.
azcopy.exe cp "PowerToys" "https://#############we.blob.core.windows.net/$web?sv=2018-03-28&si=################&sr=c&sig=######################################%%3D
What problem was encountered?
INFO: Scanning...

failed to perform copy command due to error: no SAS token or OAuth token is present and the resource is not public

How can we reproduce the problem in the simplest way?

Create storage account
Set as static website
Create SAS token
Upload files with the specified command

Have you found a mitigation/solution?
Yes, using version 10.4.3
Background
We have our click once applications uploaded to a Azure blob storage (static website). We are using the AzCopy tool to upload the click once artifacts to Blob storage:
- download: current
  displayName: Download PowerToys Artifacts
  artifact: PowerToys

- task: PowerShell@2
  displayName: 'Download AzCopy Tool'
  inputs:
    workingDirectory: '$(Pipeline.Workspace)'
    targetType: 'inline'
    script: |
      If(!(Test-Path 'azcopy.exe')){
      Invoke-WebRequest -Uri "https://aka.ms/downloadazcopy-v10-windows" -OutFile AzCopy.zip -UseBasicParsing
      Expand-Archive ./AzCopy.zip ./AzCopy -Force
      Get-ChildItem ./AzCopy/*/azcopy.exe | Move-Item -Destination $env:Pipeline_Workspace}

- task: CmdLine@2
  displayName: 'Update PowerToys to blob storage'
  inputs:
    script: 'azcopy.exe cp "PowerToys" "https://#############we.blob.core.windows.net/$web?sv=2018-03-28&si=################&sr=c&sig=######################################%%3D" --recursive=true'
    workingDirectory: '$(Pipeline.Workspace)'

Due to different (prive) Azure Account we are not able to use build in AzCopy task in Azure DevOps
This was working fine until some time ago, build are now failing.
using the workaround (to download an older version) everything is working as expected.
- task: PowerShell@2
  displayName: 'Download AzCopy Tool'
  inputs:
    workingDirectory: '$(Pipeline.Workspace)'
    targetType: 'inline'
    script: |
      If(!(Test-Path 'azcopy.exe')){
      Invoke-WebRequest -Uri "https://azcopyvnext.azureedge.net/release20190128/azcopy_windows_amd64_10.0.7.zip" -OutFile AzCopy.zip -UseBasicParsing
      Expand-Archive ./AzCopy.zip ./AzCopy -Force
      Get-ChildItem ./AzCopy/*/azcopy.exe | Move-Item -Destination $env:Pipeline_Workspace}

Hi @rneeft, thanks for reaching out!
Please use single quotes instead of double quotes. The dollar sign is affecting the URL. (I've checked in Powershell on Windows)


Please add example support

hi,
can RDL support examples for fields, requests and responses? similar to what Sagger provides http://swagger.io/docs/specification/adding-examples/
Maybe also allow users to provide a short description/comments on the examples.
thx!

The "x_example" annotation is for this. The swagger importer already implements that. I think the generator just needs to preserve it. Also, structured type examples don't apparently work. Will try to fix this.

Hi, @boynton
could you help share if there is any update?
Thanks,
SC

Hi, @boynton
could you help share if there is any update?
Thanks,
SC

The examples will need to be encoded as JSON strings to be compatible with swagger. This is a bigger change than I initially thought, might take some days to get in place. If "x_example" attributes are used in the meantime, I'd recommend encoding as JSON, i.e. "x_example": "{"foo":23}"

Hi, @boynton
could you also help cover "rdl-gen-markdown" for the markdown files generators?
Thanks,
SC

Hi, @boynton
could you help also cover "rdl-gen-markdown" for RDL's markdown files generators?
Thanks,
SC

Hi, @boynton
could you help also cover "rdl-gen-markdown" for RDL's markdown files generators?
Thanks,
SC

Yes, I'll include markdown when adding this feature.

@boynton
great!
thanks for your help

@boynton  any update on this issue ?
can RDL support examples for fields, requests and responses? similar to what Sagger provides http://swagger.io/docs/specification/adding-examples/

No update yet, it hasn't been forgotten, though.

do you have an estimation on when this will be available ?


Refactored to use the save and validate methods for saveAndValidate.

This minor refactoring avoids duplicating logic.
The compile results will likely be inlined.

Codecov Report

Merging #547 (5e6468e) into version_4 (dc128cb) will increase coverage by 0.26%.
The diff coverage is 100.00%.

@@              Coverage Diff              @@
##           version_4     #547      +/-   ##
=============================================
+ Coverage      30.65%   30.91%   +0.26%
=============================================
  Files             37       37
  Lines           1504     1504
=============================================
+ Hits             461      465       +4
+ Misses          1043     1039       -4

Impacted Files
Coverage Δ

lib/src/form_builder.dart
81.63% <100.00%> (+8.16%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update dc128cb...5e6468e. Read the comment docs.

I know it was only 1 or 2 lines of code, but...  By avoiding the code duplication, the code coverage was boosted a little.


Updated package to use omnipay v3 library

This is a PR to make the package compatible with V3 of the Omnipay library, which is required for Symfony 3+ and associated components.

Can you update the Travis build to fix the tests?

Thanks!

Thanks for getting on to that so quickly @barryvdh!
Will you be tagging a V3 release with this? Just conscious that that is a breaking change potentially for people with other Omnipay libs on V2 or Symfony 2 components. This would also be the case with the 2Checkout PR.

yeah doen


Arch arm mpu clean up headers

This pull-request mainly re-organizes the ARM/NXP MPU headers; how they are included in the source files with the MPU driver implementations, and how they include respective CMSIS headers
We organize as follows:

arm_mpu.h and nxp_mpu.h will only be indirectly included in source files (via including kernel.h)
arm_core_mpu.h will include-in only the Memory Protection API
arch.h is clean-ed up from arch-specific definitions (they are all moved into the respective internal headers)

In addition, some changes/additions to the exposed API:

convenience macros for access permissions' attributes, K_MEM_PARTITION_xxxx are, now exposed, if ARM_MPU is defined (i.e. not only for User Mode), allowing us to use the macros for generic attribution of MPU regions)
we extend the list of macros for ARMv7 and ARMv8, to access permissions without Cache.
we expose the k_mem_partition_attr_t field (inside mem_domain), outside the scope of USERSPACE. The reason is simple: extend its use beyond user-space-related access permissions. For example, it maybe be used to request partitions with no-cache attributes, or RO partitions for suprervisor stack guards. For that, the field is defined if the build supports memory protection.

Codecov Report

Merging #11774 into master will decrease coverage by 0.09%.
The diff coverage is n/a.

@@            Coverage Diff            @@
##           master   #11774     +/-   ##
=========================================
- Coverage    48.3%    48.2%   -0.1%
=========================================
  Files         280      280
  Lines       43326    43313     -13
  Branches    10373    10372      -1
=========================================
- Hits        20929    20881     -48
- Misses      18245    18277     +32
- Partials     4152     4155      +3

Impacted Files
Coverage Δ

include/kernel.h
94.44% <ø> (ø)
:arrow_up:

subsys/logging/log_output.c
62.38% <0%> (-10%)
:arrow_down:

subsys/logging/log_core.c
66.36% <0%> (-4.88%)
:arrow_down:

misc/printk.c
81.81% <0%> (-3.13%)
:arrow_down:

include/logging/log_msg.h
89.09% <0%> (-1.82%)
:arrow_down:

include/logging/log_core.h
100% <0%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0754c67...efbffaf. Read the comment docs.


No such file ‘HG002_SVs_Tier1_v0.6.vcf.gz’.

I am getting a file not found error when attempting to install the genomes and aligners:
This is my upgrade command:
bcbio_nextgen.py upgrade -u skip --genomes GRCh37 --genomes hg38 --aligners bwa --aligners star
Seek your help in this matter please. Thank you.
--2021-12-06 23:56:50--  ftp://ftp-trace.ncbi.nlm.nih.gov/giab/ftp/data/AshkenazimTrio/analysis/NIST_SVs_Integration_v0.6/HG002_SVs_Tier1_v0.6.vcf.gz
           => ‘validation/giab-NA24385/truth_sv.vcf.gz’
Resolving ftp-trace.ncbi.nlm.nih.gov (ftp-trace.ncbi.nlm.nih.gov)... <IP_ADDRESS>, <IP_ADDRESS>, 2607:f220:41e:250::13, ...
Connecting to ftp-trace.ncbi.nlm.nih.gov (ftp-trace.ncbi.nlm.nih.gov)|<IP_ADDRESS>|:21... connected.
Logging in as anonymous ...
No such file ‘HG002_SVs_Tier1_v0.6.vcf.gz’.

Traceback (most recent call last):
  File "/apps/bcbio128/anaconda/bin/bcbio_nextgen.py", line 228, in <module>
    install.upgrade_bcbio(kwargs["args"])
  File "/apps/bcbio128/anaconda/lib/python3.7/site-packages/bcbio/install.py", line 107, in upgrade_bcbio
    upgrade_bcbio_data(args, REMOTES)
  File "/apps/bcbio128/anaconda/lib/python3.7/site-packages/bcbio/install.py", line 359, in upgrade_bcbio_data
    args.cores, ["ggd", "s3", "raw"])
  File "/apps/install.bcbio/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 354, in install_data_local
    _prep_genomes(env, genomes, genome_indexes, ready_approaches, data_filedir)
  File "/apps/install.bcbio/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 480, in _prep_genomes
    retrieve_fn(env, manager, gid, idx)
  File "/apps/install.bcbio/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 875, in _install_with_ggd
    ggd.install_recipe(os.getcwd(), env.system_install, recipe_file, gid)
  File "/apps/install.bcbio/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/ggd.py", line 30, in install_recipe
    recipe["recipe"]["full"]["recipe_type"], system_install)
  File "/apps/install.bcbio/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/ggd.py", line 62, in _run_recipe
    subprocess.check_output(["bash", run_file])
  File "/apps/bcbio128/anaconda/lib/python3.7/subprocess.py", line 411, in check_output
    **kwargs).stdout
  File "/apps/bcbio128/anaconda/lib/python3.7/subprocess.py", line 512, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['bash', '/apps/bcbio128/genomes/Hsapiens/GRCh37/txtmp/ggd-run.sh']' returned non-zero exit status 8.

Hi @gis-nlsim !
Thanks for catching this issues! ftp works for me as well, but, yes, we were trying to switch to https everywhere.
Please try again, it should be fixed in https://github.com/chapmanb/cloudbiolinux/commit/92dc23b1aa7420d4f8d5c39f47355be2a43f1ab4
(Make sure you are not using the cached copy of cloudbiolinux with the old recipe).
Sergey

Hi,
Now I’m encountering this issue:
2021-12-09 00:51:07 (51.8 MB/s) - â€˜canonical_cancer.txtâ€™ saved [704/704]
Updating hg38 genome resources configuration
Installing snpEff database GRCh37.75 in /apps/bcbio128/genomes/Hsapiens/GRCh37/snpeff
--2021-12-09 00:51:09--  http://downloads.sourceforge.net/project/snpeff/databases/v5_0/snpEff_v5_0_GRCh37.75.zip
Resolving downloads.sourceforge.net (downloads.sourceforge.net)... <IP_ADDRESS>
Connecting to downloads.sourceforge.net (downloads.sourceforge.net)|<IP_ADDRESS>|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2021-12-09 00:51:09 ERROR 404: Not Found.
Traceback (most recent call last):
File "/apps/bcbio128/anaconda/bin/bcbio_nextgen.py", line 228, in
install.upgrade_bcbio(kwargs["args"])
File "/apps/bcbio128/anaconda/lib/python3.7/site-packages/bcbio/install.py", line 107, in upgrade_bcbio
upgrade_bcbio_data(args, REMOTES)
File "/apps/bcbio128/anaconda/lib/python3.7/site-packages/bcbio/install.py", line 361, in upgrade_bcbio_data
_upgrade_snpeff_data(galaxy_home, args, remotes)
File "/apps/bcbio128/anaconda/lib/python3.7/site-packages/bcbio/install.py", line 439, in _upgrade_snpeff_data
subprocess.check_call(["wget", "--no-check-certificate", "-c", "-O", dl_file, dl_url])
File "/apps/bcbio128/anaconda/lib/python3.7/subprocess.py", line 363, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['wget', '--no-check-certificate', '-c', '-O', 'snpEff_v5_0_GRCh37.75.zip', 'http://downloads.sourceforge.net/project/snpeff/databases/v5_0/snpEff_v5_0_GRCh37.75.zip']' returned non-zero exit status 8.
@.***:/apps/install.bcbio$
I don’t think it has anything to do with cloudbiolinux? Thanks
Regards,
N L Sim
From: Sergey Naumenko @.>
Sent: Tuesday, 7 December 2021 11:10 AM
To: bcbio/bcbio-nextgen @.>
Cc: SIM Ngak Leng @.>; Mention @.>
Subject: Re: [bcbio/bcbio-nextgen] No such file ‘HG002_SVs_Tier1_v0.6.vcf.gz’. (Issue #3572)
Hi @gis-nlsimhttps://github.com/gis-nlsim !
Thanks for catching this issues! ftp works for me as well, but, yes, we were trying to switch to https everywhere.
Please try again, it should be fixed in @.***https://github.com/chapmanb/cloudbiolinux/commit/92dc23b1aa7420d4f8d5c39f47355be2a43f1ab4
(Make sure you are not using the cached copy of cloudbiolinux with the old recipe).
Sergey
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/bcbio/bcbio-nextgen/issues/3572#issuecomment-987526976, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AMRXQUMOD2QVBH6EDVCZW3TUPV3KBANCNFSM5JP5R7CA.
Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
This e-mail and any attachments are only for the use of the intended recipient and may contain material that is confidential, privileged and/or protected by the Official Secrets Act. If you are not the intended recipient, please delete it or notify the sender immediately. Please do not copy or use it for any purpose or disclose the contents to any other person.

yes, here you caught a snpeff update, see https://github.com/bcbio/bcbio-nextgen/issues/3570
you need to update bcbio code as well to fetch snpeff db from the microsoft cloud

Hi,
I'm still getting the following error.

I deleted the entire bcbio installation, and re-installed using
wget https://raw.githubusercontent.com/bcbio/bcbio-nextgen/master/scripts/bcbio_nextgen_install.py
python3 bcbio_nextgen_install.py /apps/bcbio128 --tooldir=/apps/bcbio128 --nodata

For installation of Genomes, I used this command:
bcbio_nextgen.py upgrade -u development --genomes GRCh37 --genomes hg38 --aligners bwa --aligners star
This is the error I get:
2021-12-14 13:12:32 (4.71 MB/s) - ‘validation/giab-NA24695/truth_regions.bed’ saved [26092317/26092317]
Updating GRCh37 genome resources configuration
Updating hg38 genome resources configuration
Installing snpEff database GRCh37.75 in /apps/bcbio128/genomes/Hsapiens/GRCh37/snpeff
--2021-12-14 13:12:34--  http://downloads.sourceforge.net/project/snpeff/databases/v5_0/snpEff_v5_0_GRCh37.75.zip
Resolving downloads.sourceforge.net (downloads.sourceforge.net)... <IP_ADDRESS>
Connecting to downloads.sourceforge.net (downloads.sourceforge.net)|<IP_ADDRESS>|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2021-12-14 13:12:34 ERROR 404: Not Found.
Traceback (most recent call last):
File "/apps/bcbio128/anaconda/bin/bcbio_nextgen.py", line 228, in
install.upgrade_bcbio(kwargs["args"])
File "/apps/bcbio128/anaconda/lib/python3.7/site-packages/bcbio/install.py", line 107, in upgrade_bcbio
with bcbio_tmpdir():
File "/apps/bcbio128/anaconda/lib/python3.7/site-packages/bcbio/install.py", line 361, in upgrade_bcbio_data
args.cores, ["ggd", "s3", "raw"])
File "/apps/bcbio128/anaconda/lib/python3.7/site-packages/bcbio/install.py", line 439, in _upgrade_snpeff_data
with utils.chdir(snpeff_base_dir):
File "/apps/bcbio128/anaconda/lib/python3.7/subprocess.py", line 363, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['wget', '--no-check-certificate', '-c', '-O', 'snpEff_v5_0_GRCh37.75.zip', 'http://downloads.sourceforge.net/project/snpeff/databases/v5_0/snpEff_v5_0_GRCh37.75.zip']' returned non-zero exit stat\us 8.

HI @gis-nlsim !
It seems that somehow you are calling the older bcbio. In bcbio1.2.9 snpeff database URL is different:
https://github.com/bcbio/bcbio-nextgen/blob/master/bcbio/install.py#L38
What is your:
snpEff -version
bcbio_nextgen.py --version
echo $PATH
which -a bcbio_nextgen.py

Thanks, it may be that when I wget the installation script, it was still pointing to the old bcbio? I’ve re-installed with all the steps and it’s installed successfully.
Regards,
N L Sim

No, for the data installation you call bcbio_nextgen.py, not the installation script, i.e. the installed python package, which should point to the Azure cloud for snpeff. Likely, you still have two bcbio in your system and in the PATH.
I've just ran a GRCh37 installation after bcbio1.2.9 installation:
bcbio_nextgen.py upgrade -u skip --genomes GRCh37 --aligners bwa

It finished ok:
2021-12-17 00:47:04 (42.5 MB/s) - ‘validation/giab-NA24695/truth_regions.bed’ saved [14780609/14780609]

Updating GRCh37 genome resources configuration
Installing snpEff database GRCh37.75 in /path/to/install_test/genomes/Hsapiens/GRCh37/snpeff
--2021-12-17 00:47:05--  https://snpeff.blob.core.windows.net/databases/v5_0/snpEff_v5_0_GRCh37.75.zip
Resolving snpeff.blob.core.windows.net (snpeff.blob.core.windows.net)... <IP_ADDRESS>
Connecting to snpeff.blob.core.windows.net (snpeff.blob.core.windows.net)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 563180888 (537M) [application/zip]
Saving to: ‘snpEff_v5_0_GRCh37.75.zip’

snpEff_v5_0_GRCh37.75.zip                                   100%[=========================================================================================================================================>] 537.09M  5.11MB/s    in 2m 24s

2021-12-17 00:49:30 (3.73 MB/s) - ‘snpEff_v5_0_GRCh37.75.zip’ saved [563180888/563180888]

Archive:  snpEff_v5_0_GRCh37.75.zip
  inflating: data/GRCh37.75/pwms.bin
  inflating: data/GRCh37.75/sequence.1.bin
  inflating: data/GRCh37.75/sequence.10.bin
  inflating: data/GRCh37.75/sequence.11.bin
  inflating: data/GRCh37.75/sequence.12.bin
  inflating: data/GRCh37.75/sequence.13.bin
  inflating: data/GRCh37.75/sequence.14.bin
  inflating: data/GRCh37.75/sequence.15.bin
  inflating: data/GRCh37.75/sequence.16.bin
  inflating: data/GRCh37.75/sequence.17.bin
  inflating: data/GRCh37.75/sequence.18.bin
  inflating: data/GRCh37.75/sequence.19.bin
  inflating: data/GRCh37.75/sequence.2.bin
  inflating: data/GRCh37.75/sequence.20.bin
  inflating: data/GRCh37.75/sequence.21.bin
  inflating: data/GRCh37.75/sequence.22.bin
  inflating: data/GRCh37.75/sequence.3.bin
  inflating: data/GRCh37.75/sequence.4.bin
  inflating: data/GRCh37.75/sequence.5.bin
  inflating: data/GRCh37.75/sequence.6.bin
  inflating: data/GRCh37.75/sequence.7.bin
  inflating: data/GRCh37.75/sequence.8.bin
  inflating: data/GRCh37.75/sequence.9.bin
  inflating: data/GRCh37.75/sequence.HG1091_PATCH.bin
  inflating: data/GRCh37.75/sequence.HG1257_PATCH.bin
  inflating: data/GRCh37.75/sequence.HG1287_PATCH.bin
  inflating: data/GRCh37.75/sequence.HG1424_PATCH.bin
  inflating: data/GRCh37.75/sequence.HG1433_PATCH.bin
  inflating: data/GRCh37.75/sequence.HG1436_HG1432_PATCH.bin
  inflating: data/GRCh37.75/sequence.HG1459_PATCH.bin
  inflating: data/GRCh37.75/sequence.HG1497_PATCH.bin
  inflating: data/GRCh37.75/sequence.HG375_PATCH.bin
  inflating: data/GRCh37.75/sequence.HSCHR5_1_CTG1.bin
  inflating: data/GRCh37.75/sequence.HSCHR6_MHC_APD.bin
  inflating: data/GRCh37.75/sequence.HSCHR6_MHC_COX.bin
  inflating: data/GRCh37.75/sequence.HSCHR6_MHC_DBB.bin
  inflating: data/GRCh37.75/sequence.HSCHR6_MHC_MANN.bin
  inflating: data/GRCh37.75/sequence.HSCHR6_MHC_MCF.bin
  inflating: data/GRCh37.75/sequence.HSCHR6_MHC_QBL.bin
  inflating: data/GRCh37.75/sequence.HSCHR6_MHC_SSTO.bin
  inflating: data/GRCh37.75/sequence.X.bin
  inflating: data/GRCh37.75/sequence.Y.bin
  inflating: data/GRCh37.75/sequence.bin
  inflating: data/GRCh37.75/snpEffectPredictor.bin
 extracting: data/GRCh37.75/cytoBand.txt.gz
bcbio-nextgen data upgrade complete.
Upgrade completed successfully.


Removing event subscriptions?

When subscribing to an event (such as  HeapProfiler.reportHeapSnapshotProgress()), it will continue to be called even if multiple callbacks are registered. Is there a way to either remove an old subscription or replace it with a new one?

Since:
client.HeapProfiler.reportHeapSnapshotProgress(foo)

is a shorthand for:
client.on('HeapProfiler.reportHeapSnapshotProgress', foo)

You can use the usual Node.js events API to manage the listeners, specifically:
client.removeAllListeners('HeapProfiler.reportHeapSnapshotProgress')
client.removeListener('HeapProfiler.reportHeapSnapshotProgress', foo)


#2113 Hovered structure gets into the saved molecule

Resolves #2113

@St-Permiakov @yuleicul we might need to get back to this after we introduce a common tool for paste and templates, I will leave it in open state for now, thx!


Panic when mimeapps.list is not writable

It seems that handlr expects mimeapps.list to be writable even handlr doesn't need to write to it.
$ handlr --version
handlr 0.6.4
$ chmod -w ~/.config/mimeapps.list
$ export RUST_BACKTRACE=full
$ handlr --version
thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Io(Os { code: 13, kind: PermissionDenied, message: "Permission denied" })', src/apps/user.rs:12:65
stack backtrace:
   0:     0x5643ea23f4a5 - <unknown>
   1:     0x5643ea1d3c8c - <unknown>
   2:     0x5643ea23e9e4 - <unknown>
   3:     0x5643ea23e7cf - <unknown>
   4:     0x5643ea25e468 - <unknown>
   5:     0x5643ea25e3e6 - <unknown>
   6:     0x5643ea25e3a2 - <unknown>
   7:     0x5643ea15f100 - <unknown>
   8:     0x5643ea15f432 - <unknown>
   9:     0x5643ea16ed9e - <unknown>
  10:     0x5643ea172c1c - <unknown>
  11:     0x5643ea234a43 - <unknown>
  12:     0x5643ea15d18b - <unknown>
  13:     0x5643ea1e9c83 - <unknown>
  14:     0x5643ea1e28e3 - <unknown>
  15:     0x5643ea1e5662 - <unknown>
  16:     0x7efe507f0b25 - __libc_start_main
  17:     0x5643ea16975e - <unknown>
  18:                0x0 - <unknown>

I think handlr should try to write to mimeapps.list only if called with set, unset and add.

That makes it a no-go on declarative distros like NixOS and Guix :(

this was fixed in https://github.com/chmln/handlr/pull/48 however there hasn't been a release since


cannot install 2.5.4 version

when I try to install datacube-explorer v2.5.4 after extract it to a directory, enter the directory, and pip install . I have this error

Closing, as we corresponded on Stack Exchange instead: https://gis.stackexchange.com/questions/408194/cannot-install-datacube-explorer-2-5-4-version/408378#408378


Test Reporter fails on workflow_run

I have two step
...
      - uses: actions/upload-artifact@v4
        if: success() || failure()
        with:
          name: test-results
          path: "**/test-results*.trx"
...

and
name: report
on:
  workflow_run:
    workflows:
      - build
    types:
      - completed
permissions:
  contents: read
  actions: read
  checks: write
jobs:
  report:
    runs-on: ubuntu-latest
    steps:
      - uses: dorny/test-reporter@v1
        with:
          artifact: test-results
          name: dotnet tests
          path: '**/test-results*.trx'
          reporter: dotnet-trx

trx file is successfully uploaded, inspecting the URL of test reporter action, it offers me to download the file, but the action fails
Report fails with error
HTTPError: Response code 400 (Authentication information is not given in the correct format. Check the value of Authorization header.)
Additional info: it worked, but after I bumped the version of the upload-artifacts (among other), somehow stopped working...

I noticed something similar. Here's one of my public repos where it goes wrong (with a similar config as you have): https://github.com/fsprojects/FSharp.Control.TaskSeq/pull/209
I suspect actions/upload-artifact@v3 update to actions/upload-artifact@v4 to be at the root of the issue. I'll try it with reverting that update and will report back.

Yep, this confirms it. The new upload-artifacts@v4 either has bugs, or other changes, that prevents it from working with test-reporter@v1. I tested it here (https://github.com/fsprojects/FSharp.Control.TaskSeq/pull/212) with v3, which "just works", after all PRs with v4 did not work:

Yes, this caused by different behavior in artifacts v4: https://github.blog/changelog/2023-12-14-github-actions-artifacts-v4-is-now-generally-available/

@jozefizso are you aware of any way to fix this? Would it require bumping the major version here as well, or could it be made compatible with either?

FYI I was able to make this work using a similar workflow_run setup by manually invoking the download-artifact action at v4:
on:
  workflow_run:
    workflows: ["test"]
    types:
      - completed

jobs:
  report:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - name: Download artifacts
        uses: actions/download-artifact@v4
        with:
          github-token: ${{ secrets.PERSONAL_ACCESS_TOKEN }}
          pattern: test-result-*
          merge-multiple: true
          run-id: ${{ github.event.workflow_run.id }}
      - name: Generate report
        uses: dorny/test-reporter@v1
        with:
          name: test report
          path: "*.trx"
          reporter: dotnet-trx

You have to generate your own secrets.PERSONAL_ACCESS_TOKEN for the download-artifact action to be able to download artifacts from outside its own workflow. The workflow to download from is specified using ${{ github.event.workflow_run.id }}

The github token @SapiensAnatis mentions needs to have the permission  actions:read on target repo.
@jozefizso @abelbraaksma  Would this mean that the fix for this problem in the action will need a token as well?

@fernandopasik I'm not sure, but it might very well be? If you want me to test a fix (I assume you'd do that in a new version), let me know and I can run a test through https://github.com/fsprojects/FSharp.Control.TaskSeq/issues/245).

@jozefizso said previously:

Yes, this caused by different behavior in artifacts v4: github.blog/changelog/2023-12-14-github-actions-artifacts-v4-is-now-generally-available

So given that it's 4 months on since the above comment, what's the plan to fix this?
How is this action in any way usable given this issue?  I.e. isn't is completely broken at this point now?  Or does this issue only affect certain use cases of this action?  If so, which use cases are still working?

I.e. isn't is completely broken at this point now?

It is actually artifacts@v4 that is broken. They chose to, deliberately, make it backwards incompatible. And the guide to fix it isn't all that useful.

So is simply downgrading the actions/upload-artifact action to v3 not enough to work around this issue?

If, when you upgraded to v4, you made the recommended changes in your actions, you need to undo those changes as well. Unfortunately, the people that published artifacts v4 didn't really bother to create an upgrade guide.
This is what happens when OSS folk makes a few too many assumptions that people are willing to update all their CI/CD flows just for a single version update (nothing against OSS in general, we all do our best, but a warning ahead and a guide would have been great).

TBF, it looks like it was actually resolved? So maybe your issue is related to something else entirely? https://github.com/selenide/selenide/issues/2704

Simply downgrading should be enough.

It is not.  As I previously said, it produces this failure:
Warning: No artifact matches /(Functional on .*) test-results/

when the artifact list clearly has artifacts that match the RE:
Functional on EL 8.8 test-results
Functional on EL 9 test-results

Even if you applied fixes, it looks like any changes you did to accommodate v4, would work with v3. I think the main issue is same-named artifacts, which don't work anymore.

They don't have the same name though.  One has 8.8 in it where the other has 9.

See also #363

I was running into this issue today as well, although I don't have a repository using this action myself. The following configuration seems to work:

Show working example for test-report workflow (according to my tests)
name: Test Report
run-name: >
  Test Report for ${{ github.event.workflow.name }}
  #${{ github.event.workflow_run.run_number }}:
  ${{ github.event.workflow_run.display_title }}
on:
  workflow_run:
    workflows: [Build]
    types: [completed]

# Permissions only have to be specified when set to be restricted by default.
# Otherwise, the workflow will have all necessary permissions by default.
# See https://docs.github.com/en/actions/security-guides/automatic-token-authentication#permissions-for-the-github_token
permissions:
  checks: write
  # The documentation mentions that the following permissions is necessary to access other workflow runs.
  # However, the workflow seems to work even without this permission.
  # Maybe there is a special case which always allows access to the workflow run which triggered this run.
  actions: read

jobs:
  report:
    name: Test Report
    runs-on: ubuntu-latest

    steps:

      # We have to clone the repo as the test-reporter otherwise runs into an error.
      # See https://github.com/dorny/test-reporter/issues/131#issuecomment-2093880211
      - name: Fetch Sources
        uses: actions/checkout@v4

      # We have to manually download the artifact because dorny/test-reporter@v1
      # does not support artifacts uploaded by actions/upload-artifact@v4.
      # See https://github.com/dorny/test-reporter/issues/343
      - name: Download Test Reports
        uses: actions/download-artifact@v4
        with:
          pattern: test-results-*
          run-id: ${{ github.event.workflow_run.id }}
          github-token: ${{ github.token }}

      - name: Publish Test Reports as Annotations
        uses: dorny/test-reporter@v1
        with:
          name: "Unit Tests Report"
          path: "test-results-*/test-results/*/TEST-*.xml"
          reporter: java-junit

You have to generate your own secrets.PERSONAL_ACCESS_TOKEN for the download-artifact action to be able to download artifacts from outside its own workflow.
— https://github.com/dorny/test-reporter/issues/343#issuecomment-1872325556

The github token @SapiensAnatis mentions needs to have the permission actions:read on target repo.
— https://github.com/dorny/test-reporter/issues/343#issuecomment-1918804682

You can use the token provided by GitHub Actions (github.token or secrets.GITHUB_TOKEN). See my example above. The token has all the necessary permissions, actions/download-artifact@v4 just doesn't use the token by default. Interestingly, even if you restrict permissions by default, you don't have to specify the permission actions: read. At least according to my tests. Maybe GitHub has implemented a special case for workflows triggered by workflow_run, so that they can always access the previous run that triggered this run.

FYI, I created a pull request, which I think should fix this issue.

#436

FIY again, I also created a feature request for support of raw_details in annotations created from workflows. I hope that would eventually make the need for a separate workflow obsolete.

community/community#122234

since #363 is resolved, I can't reproduce this problem. can this be closed, or is this still relevant?


THRIFT-3859: Unix Domain Socket Support in Objective-C

Existing behavior for port-based socket transport should be unchanged by this commit. TSocketServer and TSocketTransport have been refactored to support sockets created using either a port or a path.

I have written unit tests for this change, but am not sure where to contribute them. I see no "cocoa" directory under the "test" directory. Is there another place where I can contribute my unit tests?

The diff generated by GitHub makes the change look a little bigger than it actually is. In TSocketServer.m, the initWithSocket method is effectively the same as the old initWithPort method, but with the socket creation code factored out into createSocketWithPort. Additional code has been added to create a socket using a path instead of a port.

Would it be possible to rebase this on master so we can get a clean CI build?  Also enabling unix socket transport in the "make cross" test would be really nice to validate this code.

No problem. Just rebased on master. I will work on adding to the "make cross" test.

To enable "make cross" support you can follow the pattern in test/tests.json to add the "domain" transport to your cocoa test.  Your cocoa test_client needs to understand that transport and create the correct kind of client, etc.

Thanks @jeking3. Sorry for the slow response, a bit busy these days!
Just to clarify, as far as I can tell there isn't a cocoa test client today. Is this correct? So, in order to add these tests to "make cross", we would first need to add a "cocoa" folder to thrift/test, and put together a test server, and test client executable that could participate in these tests?

If there isn't one there yet I would recommend following the pattern for java in there.  Specifically you would need a new test/ subdirectory for cocoa with test_client and test_server scripts, and you would need a stanza in tests.json that the test.py script could run.
You can test your scripts against a single client or server like this, after running a "make" following configure in test/:
./test.py --client cocoa --server java
./test.py --client java --server cocoa
You could substitute cpp for java as well.  Then when those pass, try a "make cross" to see if everything passes.

Hi @clindsay just checking in to see if you had made any progress on adding cross test support for cocoa.   If not that's okay... it would be really nice to have it though.

Hey @jeking3, sorry for going silent there. I've had a lot of other things on my plate, and haven't gotten to this yet, but I still intend to add this support when I have a chance!

Have you used this in a project and know that it works?  Given this is an improvement I'd like to get it in, but if you don't have time right now to add make cross support, I can add a story in Jira to complete the work.

I've been using it in a project since last summer, communicating between a python process and a Swift/Objective-C process. The project has been in beta with a few hundred users, and no reports of any issues attributable to this yet. I've also written a set of unit tests, testing the behavior of a server and client in the same process both using this transport, that are all passing.
So yes, it's definitely at least working in these two scenarios.

Okay, well I'm going to approve and merge, and open a Jira item to add crosstest support for cocoa (if not there, I'll check) and for unix sockets in cocoa.

Who can tell me why the cocoa lib has Swift2.3 codes? Where I can download full Objective-C lib? Or is there a way to make the lib to support Swift 3 +?


[Feature] Make ChatQnA work with vLLM for rerank and embeddings.  Currently only works with HF's TGI

Priority
P1-Stopper
OS type
Ubuntu
Hardware type
GPU-other (Please let us know in description)
Running nodes
Single Node
Description
This is a  high priority item for kubecon india to be able to run docker-compose up with all the images built on ARM.
There is ARM support for vLLM but not for HF's TGI (it uses the intel mkl library), so as long as docker-compose works with vLLM on all platforms (rerank and embedding) we should be good
I was able to bypass the rerank and embedding services but that may not be the best option as I had to change parts of the orchestrator https://github.com/opea-project/GenAIComps/blob/main/comps/cores/mega/orchestrator.py

It is not necessary @raravena80 to have the re-ranker in the ChatQnA pipeline, that just is an optimization in that say N vectors are retrieved from the vector database as matches, the re-ranker is used to further prune the list for best matches. A vLLM solution to serve the LLM is perfectly fine as an alternative to Hugging Face's TGI that works on ARM.

@mkbhanda we still need the embedding model to work on ARM (vLLM) it currently uses HF's TGI.

@feng-intel not that I'm aware of. But it's something we want to showcase at Kubecon India.

@mkbhanda we still need the embedding model to work on ARM (vLLM) it currently uses HF's TGI.

@raravena80 the way I understand the GenAI pipeline is each element needs to meet a functionality, the embedder element deliver a vector, and further this pipeline must run on ARM hardware. Whether the embedder model is served by vLLM or TGI is not relevant, as long as we have a component that works on ARM.
I found a docker file for vLLM for ARM:
https://github.com/vllm-project/vllm/blob/main/Dockerfile.arm
We could pass into it the embedding model that we have been using - "BAAI/bge-base-en-v1.5"
The Oracle cloud has Ampere instances and Hugging Face/Docker Hub claims it has ARM specific images for embedding. See https://github.com/huggingface/text-embeddings-inference/blob/main/docs/source/en/supported_models.md
Ampere 80 (A100, A30)
[ghcr.io/huggingface/text-embeddings-inference:1.5Ampere]
(http://ghcr.io/huggingface/text-embeddings-inference:1.5Ampere)
86 (A10, A40, ...)
ghcr.io/huggingface/text-embeddings-inference:86-1.5
@feng-intel please comment.

FYI. I made it work with this PR on ARM.
https://github.com/opea-project/GenAIExamples/pull/1232/
FYI. 'Ampere' on HF's TGI is completely different from 'Ampere' on Oracle Cloud
HF TGI
Ampere 80 (A100, A30) Nvidia GPU Architecture
86 (A10, A40, ...) -> Nvidia GPU Architecture
https://en.wikipedia.org/wiki/Ampere_(microarchitecture)
https://www.nvidia.com/en-us/data-center/ampere-architecture/
Ampere OCI
ARM CPUs
https://amperecomputing.com/products/processors
https://www.oracle.com/cloud/compute/arm/


Alfran/example updates

added AppConfiguration/config type
updated aks to fix type errors
updated keyvault to fix type errors and add the new "keys" resource type

Codecov Report

Merging #590 into master will decrease coverage by 0.19%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #590      +/-   ##
==========================================
- Coverage   94.95%   94.75%   -0.20%
==========================================
  Files         235      235
  Lines        9051     9011      -40
==========================================
- Hits         8594     8538      -56
- Misses        457      473      +16

Flag
Coverage Δ

#dotnet
94.75% <ø> (-0.20%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

....UnitTests/Completions/SymbolKindTestExtensions.cs
70.00% <0.00%> (-30.00%)
:arrow_down:

...icep.LangServer/Extensions/DiagnosticExtensions.cs
78.57% <0.00%> (-21.43%)
:arrow_down:

...c/Bicep.LangServer/Completions/SymbolExtensions.cs
78.94% <0.00%> (-21.06%)
:arrow_down:

src/Bicep.Cli/Logging/BicepDiagnosticLogger.cs
81.25% <0.00%> (-18.75%)
:arrow_down:

src/Bicep.Cli/Logging/BicepConsoleLogger.cs
65.38% <0.00%> (-12.40%)
:arrow_down:

src/Bicep.Core/Syntax/ObjectPropertySyntax.cs
95.45% <0.00%> (-4.55%)
:arrow_down:

src/Bicep.Core/TypeSystem/TypeAssignmentVisitor.cs
99.47% <0.00%> (-0.18%)
:arrow_down:

...Arm.Expression/Expressions/ExpressionSerializer.cs
91.01% <0.00%> (-0.10%)
:arrow_down:

src/Bicep.Core/TypeSystem/TypeValidator.cs
95.13% <0.00%> (-0.10%)
:arrow_down:

src/Bicep.Core/Text/TextCoordinateConverter.cs
96.87% <0.00%> (-0.10%)
:arrow_down:

... and 8 more


Move bibliopixel.util.colors back to bibliopixel.colors

The move of bibliopixel.colors to bibliopixel.util.colors was a mistake!
It happened when many other utilities got moved to util/ which was generally good, but that one was wrong - there is just too much in color/, it's a natural top-level directory.
This change is backward and forward compatible, even if people are using undocumented features.
Adding @adammhaile just so I can say, "Oops!"  :-D

All right, I'm going to push this because I'm in a clean-up frenzy as we get thisclose to 3.5.  :-D
Back to documentation this afternoon...


Automatically run a SQL script after loading any dataset.

I need to load a table with latitude, longitude, and the corresponding GEOGRAPHY column.
Since DbPop cannot load GEOGRAPHY columns, I need to run an update after that table is loaded.

Files dropped in those directories will be executed after datasets are executed
.../config/extensions/afterPopulate/<dataset>/*.sql
.../config/extensions/afterPopulate/*.sql


Breakdown circuit name

naming convention:: adding the string "sdx" for OXP to check easier.

In general, standardize the structure of the breakdown object, so the OXP provisioning agent (NAPP, or LC plug-in) can have a unified input. Basically, a couple of wrapper filed on top of the current breakdown object.
name: sdx-xxx
id: uuid


refactor: add new exclusions

:tada: This PR is included in version 0.20.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Enhancing information within the incidents channel.

Relevant Issues
Closes #1226
Description
Whenever a staff member would post a message in #incidents channel, it would be searched through a regex and all the message links in it would be extracted.
Then the bot would send this the messages the link point towards in embeds.
The Embed would contain the following information -->
        Author: @Jason Terror ♦<PHONE_NUMBER>45884682)
        Channel: Special/#bot-commands<PHONE_NUMBER>80607493)
        Content: This is a very important message!

These embeds would be sent in groups of 10 using a webhook.
Once the incident is actioned/rejected (using reactions), the bot would delete these webhook messages (NOT send them to #incidents-archive)
Screenshots
Has a link and doesn't has a link message

On putting ✅ reaction on message with link

In Incidents-Archive Channel (the message link embeds are not sent)

Additional Details
Adds a webhook to channel #incidents with id<PHONE_NUMBER>44572212 (Thanks joe)
Did you:

[x] Join the Python Discord Community?
[x] Lint your code (pipenv run lint)?
[x] Set the PR to allow edits from contributors?

You should keep commit titles short. If you want to add more detail you should do it in the commit body.

Additionally, I'm not sure whether sending exceptions to #incidents makes sense. Wouldn't it be better to log the exception and let it be handled by Sentry?

do you think the lines that got broken were too long?

Not exactly sure, if they were too long or if black decided to break them.

New logging is inconsistent in style with both itself and the existing code; some existing logging was changed but not all.

Could you point them out?

None of the documentation, class or function, was updated to mention the new behaviour.

I completely forgot about them, will have them updated.

I'm still not convinced that we need to support more than 10 embeds per report. Such an amount of embeds would flood the channel, and it adds a non-trivial amount of complexity to the solution. But this has to be decided by staff.

I completely agree with you here, I have asked the moderators in dev-contrib (Akarys has passed on the message).

The following changes are mentioned in commit 78333e7 :

Entries from the cache should be deleted after the incident is cleared. We shouldn't keep the cache growing exponentially.
Message edits aren't handled properly, they should. Also I haven't tested it but is it handling message deletion too?
The docstring hasn't been updated to match the new features

Something that bothers me is that it isn't clear which embed relates to which message link, which is exacerbated if any of the messages error out and get skipped. Add the message link in the title (but then the embed is even bulkier)? in the footer? just the message ID?

Something that bothers me is that it isn't clear which embed relates to which message link, which is exacerbated if any of the messages error out and get skipped. Add the message link in the title (but then the embed is even bulkier)? in the footer? just the message ID?

Yeah, I would add the message ID in the footer, I had tried adding the message link as the Title and Footer but then it breaks (half link in line, second half in the next line) due to embed lengths and the embed is bulkier.

I also think that the channel ID should be a channel mention, and the user should also be mentioned.

And a minor nitpick, but can you try a gold color for the embed? :D

It's not a bug with textwrap.shorten. shorten will truncate the "word" which causes the string to pass the set length. If the only word makes it pass the length, that word will be truncated, and an empty string will be left. So that works as expected.
If there's such a long "word", I feel like showing 300 characters of it is unnecessary. In that specific case ~50 should be enough. I also think your usage of and is a bit obscure here.

It's not a bug with textwrap.shorten. shorten will truncate the "word" which causes the string to pass the set length. If the only word makes it pass the length, that word will be truncated, and an empty string will be left. So that works as expected.
If there's such a long "word", I feel like showing 300 characters of it is unnecessary. In that specific case ~50 should be enough. I also think your usage of and is a bit obscure here.
At the same time, there should probably be a line limit (let's say three).

So, if the sentence is three words (say) in the 300 shortened characters, then we reduce it to 50 characters. Otherwise, keep it to 300 characters (normal length).
And on this shortened text, we check and make sure it is not more than 3 lines. (Counting the \n).

So, if the sentence is three words (say) in the 300 shortened characters, then we reduce it to 50 characters. Otherwise, keep it to 300 characters (normal length).

I think just making sure it's not a single word is enough. So if shorten gives you an empty string, take 50 chars.

And on this shortened text, we check and make sure it is not more than 3 lines. (Counting the \n).
yes

@kwzrd Could you give it a review again? I also have a few comments on your previous reviews, Thanks!

ℹ Note to merger: This PR should be squashed to avoid a wildly inflated git history.

I realize that this PR was never approved to go forth with, planning was stated here.
Please wait for approval before going ahead with PRs next time.

Can you elaborate here what was discussed?

Can you elaborate here what was discussed?

@mbaruh We talked about whether the editing things were necessary given that we already have edit logs which not only show edited message but all iterations of edits.
The changes mean that the message will be relayed as-is at time of reporting (which in my mind at least makes more sense), it will still be cleaned up once the incident is actioned.

@Shivansh-007 will you be able to resolve these requests?

Hey @Xithrius,
Unfortunately I haven't been getting enough time to mention the reviews due to my exams going on, if this is PR is on a high priority (or any of my other PRs), someone else can take them up as I won't be able to mention them until 15th October at-least. Otherwise, I would get them mentioned as soon a I am back from the break. And thanks bluenix and zig for the reviews!
You would probably forgot, I had pinged you in #dev-contrib with the same before I went off into a break.
Thanks

Update: Good news! I am almost done with my exams, would be going through the reviews and mentioning the required changes within this week, I would be focusing on this PR over the other 2 first 🙂

Why only for a single word? 😅
The idea is that you might end up with a slice ending at a space. It's best to strip right before checking whether the length of the string changed.


Serde 0.9

Any chance to get the serde feature updated for serde 0.9?

I can provide a pull request if it's ok for you. It might break compatibility with serde <0.9 though, I think quite a lot has changed in that release.

Yes, it would be, and the next breaking change of the mime crate will see the serde feature removed. It should be done in a separate crate.

Ok, fair enough. Also, at least serializing is trivial with this generic function:
fn serialize_to_string<S, T>(val: &T, serializer: S)
        -> Result<S::Ok, S::Error>
        where S: Serializer, T: ToString{
    serializer.serialize_str(&val.to_string())
}

It can be used like this:
#[serde(serialize_with = "serialize_to_string")]
pub mime_type: Mime,


GPSPRINGSECURITYCORE-239: Document how to use the plugin without sessions

Original Reporter: burtbeckwith
Environment: Not Specified
Version: Not Specified
Migrated From: http://jira.grails.org/browse/GPSPRINGSECURITYCORE-239

This may be what this ticket is referring to: https://stackoverflow.com/questions/2504590/how-can-i-use-spring-security-without-sessions


Grafana cloud/agent dashboard 14319 server variable incorrect

Dashboard 14319 doesn't display the node_exporter data when imported into Grafana cloud.
Using Grafana Agent and Grafana Cloud no servers found unless i remove the regex then it finds 'grafana.com'

server_name variable from the data is 'Thinkstation2-P620' not 'grafana.com' so not sure how to fix this

can you query for validator_version_info and give me the full line? The second screenshot implies that it is grafana.com, but the third says differently.

validator_version_info{instance="grafana.com", job="miner_exporter", validator_name="howling-tin-pangolin", version="0.1.73"}
it looks like 'grafana.com' may be coming from the agent.yaml config file. see https://github.com/tedder/miner_exporter/issues/13
and node_exporter is using something else. Node_exporter is built in with grafana integrations and miner_exporter is not being the difference I guess?

yeah, I think it needs a rewrite/relabel to match.


Metrics

Since each update is technically registered as a new article, it seems like metrics for tracking views won't work properly. Should find a fix for this.

Creating exact copies of previous versions should solve this problem.


mkdocs build with alternative link creation

Is there an option that the mkdocs build command generates links like
file:///D:/projekte/my/mkdocs-test/site/about/index.html
instead of
file:///D:/projekte/my/mkdocs-test/site/about/
I'm asking cause I want to use the docs without any web server. Clicking
on file:///D:/projekte/my/mkdocs-test/site/about/ shows "Index von
D:\projekte\my\mkdocs-test\site\about" where I have to click on index.html
in Chrome and Firefox both on Windows 8.

In your config set: use_directory_urls=false

See http://www.mkdocs.org/user-guide/configuration/#preview-controls

Thank you very much!


Implement asynchronous chunk loading

Actually, not sure we should close this yet - we don't actually use it yet (except in PlayerCubeMap, virtue of Forge)

Using it in PlayerCubeMap is the entire reason for it. Players moving around is most of cube/chunk loading.

Alright then


Remove unneeded method

As per #2, removing this method allows the gem to work. I had seen also that someone suggested upgrading oauth2 to > 2. But since our application is also using the omniauth google gem, it's locked to ~> 1.4.

I tried this and it doesn't work for me on omniauth 2.1.0 and omniauth-oauth2 1.8.0. I get a Could not authenticate you from LinkedIn because "Invalid credentials". error.
Additionally, I also dealt with this same issue and ended up creating a PR for zquestz/omniauth-google-oauth2 in the past. It seems they since have added suppor for omniauth 2+ and  omniauth-oauth2 1.8+.

I've added a hard dependency on oauth2 ~> 2.0. We're not going to support older versions since it doesn't currently work and I don't think it's worth trying to sort out.


escape search string from regular expression specific characters

escape search string from regular expression specific characters.
Add function escapeRegExp(string).

This PR seems to be obsolete. Moreover UI.Utils modules was split in individuals repositories. If still valid, please consider re-submitting on the dedicated repository.
See the README for details.


dart is not recognized as internal or external command

I changed some user settings in this IDE to run python programs but unfortunately my current settings does not execute any of my .dart files. I need help regarding this problem asap. I even tried to reset the settings but still IDE does not executes my flutter project .
'dart' is not recognized as an internal or external command,
operable program or batch file.
is the output of any project.

Please start by making sure the dart extension is enabled and file this issue against them


Fixed code for Systemtherapie Protokoll Extension

Fix for the whole ProtocolDict being used as the code for the "Protokoll"-Extension

Thank you!


[SPARK-11329] [SQL] Support star expansion for structs.

Supporting expanding structs in Projections. i.e.
"SELECT s.*" where s is a struct type.
This is fixed by allowing the expand function to handle structs in addition to tables.

Supporting expanding * inside aggregate functions of structs.
"SELECT max(struct(col1, structCol.*))"
This requires recursively expanding the expressions. In this case, it it the aggregate
expression "max(...)" and we need to recursively expand its children inputs.

Can one of the admins verify this patch?

ok to test

Merged build triggered.

Merged build started.

Test build #44549 has started for PR 9343 at commit 54e155e.

Test build #44549 has finished for PR 9343 at commit 54e155e.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * case class UnresolvedStar(target: Option[String]) extends Star with Unevaluable \n

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44549/
Test FAILed.

Merged build triggered.

Merged build started.

Test build #44555 has started for PR 9343 at commit df65944.

Test build #44555 has finished for PR 9343 at commit df65944.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * class HasSolver(Params):\n  * case class UnresolvedStar(target: Option[String]) extends Star with Unevaluable \n

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44555/
Test PASSed.

Merged build triggered.

Merged build started.

Test build #44704 has started for PR 9343 at commit be20b33.

Test build #44704 has finished for PR 9343 at commit be20b33.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * case class UnresolvedStar(target: Option[String]) extends Star with Unevaluable \n

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44704/
Test PASSed.

Merged build triggered.

Merged build started.

Test build #44840 has started for PR 9343 at commit c55a7d2.

Test build #44840 has finished for PR 9343 at commit c55a7d2.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * case class UnresolvedStar(target: Option[Seq[String]]) extends Star with Unevaluable \n

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44840/
Test PASSed.

Merged build finished. Test PASSed.

Merged build triggered.

Merged build started.

Test build #44862 has started for PR 9343 at commit 886acc7.

Test build #44862 has finished for PR 9343 at commit 886acc7.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * case class UnresolvedStar(target: Option[Seq[String]]) extends Star with Unevaluable \n

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44862/
Test PASSed.

Merged build finished. Test PASSed.

Thanks @nongli ! Overall LGTM. I am going to merge it to master. Can you create a follow-up PR to address my comments? Thanks!


Add linker flags in makefile

Previously, linker flags were ignored.
This issue was reported by @SunPodder :heart:

@Biswa96 Thank you for your work.  Just to clarify, is this intended for users who may want to manually specify custom linker flags?

Just to clarify, is this intended for users who may want to manually specify custom linker flags?

Yes. The issue was first seen in termux environment in Android. termux environment sets runtime path to load shared objects from a specific directory i.e. using -Wl,-rpath.


Feature/48 json server setup

Add the json-server to dev dependencies,
add some data to the json server db,
with 3 basic tests.
This is all new to me, I know I still have tones to learn, so any suggestions are welcomed.

I have update the formatting using prettier, I am trying to upload the changes, I get a protected branch error.


Best Way to Stop a User From Navigating Away

I'd like to prompt users before they navigate away from a page if a certain condition is met.
What would you recommend?  I was thinking I could capture all page clicks with some sort of master module that wraps the whole page.  Then use a service to read and update the state which would indicate whether or not a user could proceed.
There's probably a more elegant solution. Any thoughts would be greatly appreciated.
Thanks,
Jonathan

I don't have enough context here to help you make a decision. Why capture all of the page clicks? You can just put something in the onBeforePageUnload event handler that can check the page state and prompt the user before they leave. If you are checking state across multiple modules, I would make this a singleton service that each of the modules will register against in their init() with a callback like isSafeToExit() or something. The isSafeToExit() will simply check the module's state to see if its able to leave the page without prompting. The service will just call all of these callbacks when the page is about to exit.

These are great suggestions.  I'll think I'll give the singleton service with registered callbacks a shot.  We can't do the unload event because it's a SPA with no page unload.
Thanks for the quick feedback.


Polygon.contains? bug

arr = [Geometry::Point.new(1.6, 1.0), Geometry::Point.new(1.6, 2.0),
     Geometry::Point.new(1.2, 2.0), Geometry::Point.new(1.2, 1.0)]
point = Geometry::Point.new(1.5, 1.5)
result = Geometry::Polygon.new(arr).contains?(point)

Result = true. It's ok. But:

arr = [Geometry::Point.new(1.6, 1.0), Geometry::Point.new(1.6, 2.0),
     Geometry::Point.new(1.2, 2.0), Geometry::Point.new(1.2, 1.0)]
point = Geometry::Point.new(1.5, 1.5)
result = Geometry::Polygon.new(arr).contains?(point)
(0..100).each{result &&= Geometry::Polygon.new(arr).contains?(point)}

result = false

Yes, it appears that Point.contains? is nondeterministic. Here's another example:
point = Geometry::Point.new(509, 553)

polygon = Geometry::Polygon.new([
  Geometry::Point.new(297, 581),
  Geometry::Point.new(464, 414),
  Geometry::Point.new(545, 495),
  Geometry::Point.new(383, 662)
])

results = Array.new(10000).map do
  polygon.contains?(point)
end

puts "contains? returned true #{results.count(true)} times"
puts "contains? returned false #{results.count(false)} times"

Running this prints the following output for me:
contains? returned true 515 times
contains? returned false 9485 times

I suspect this has something to do with the randomness introduced in point_in_polygon.rb line 54.
In my application, I've monkey-patched the Point.contains? method with this algorithm: PNPOLY - Point Inclusion in Polygon Test.

Hey @seangransee, can you please form a PR with your patch? This problem is indeed very serious.

Sure! I'll try to take care of it sometime this week.

Thanks in advance!

PR created in #17. It's not perfect yet, but it's a starting point.


Add new syncChunkSize config value

Change description
Allows users to change the size of sync chunks via config. Notable helps to solve problem where users were getting a 413 request too large from the backstage server when attempting to send large entities.
example usage:
# 30 entities at a time
cortex:
  syncWithGzip: true
  syncChunkSize: 30

https://cortex1.atlassian.net/browse/CET-12628?atlOrigin=eyJpIjoiZGU3Y2Q4ZjQzMGE1NDI1Yzg4NTdlM2MxOTg2YWQ4ZmUiLCJwIjoiaiJ9
Type of change
Tested against dev environment with chunk size of 3 and 63 entities, confirmed 21 chunk requests sent
Checklists
Development

[ ] The changelog has been updated as appropriate
[ ] Lint rules pass locally
[ ] Application changes have been tested thoroughly
[ ] Automated tests covering modified code pass

Security

[ ] Security impact of change has been considered
[ ] Code follows company security practices and guidelines

Code review

[ ] Pull request has a descriptive title and context useful to a reviewer. Screenshots or screencasts are attached as necessary
[ ] "Ready for review" label attached and reviewers assigned
[ ] Changes have been reviewed by at least one other contributor
[ ] Pull request linked to task tracker where applicable

When making changes to the plugin @jdhayford , we need to also update the changelog. cc @browniefed