Error: vectordb: failed to load native library

LanceDB version
<EMAIL_ADDRESS>What happened?
I get this error message. I tried the suggested solution: npm install @lancedb/vectordb-darwin-arm64. That ran correctly, but didn't solve the problem. This is the complete error message:
A JavaScript error occurred in the main process
Uncaught Exception:
Error: vectordb: failed to load native library.
You may need to run npm install @lancedb/vectordb-darwin-arm64.
If that does not work, please file a bug report at https://github.com/lancedb/lancedb/issues
Source error: Error: [dlopen(/Applications/Reor.app/Contents/Resources/app.asar.unpacked/node_modules/@lancedb/vectordb-darwin-arm64/index.node,](mailto:dlopen(/Applications/Reor.app/Contents/Resources/app.asar.unpacked/node_modules/@lancedb/vectordb-darwin-arm64/index.node,) 0x0001): Library not loaded: /opt/homebrew/opt/xz/lib/liblzma.5.dylib
Referenced from: <84349C78-366A-35F8-8798-808072CCD3D8><EMAIL_ADDRESS>Reason: tried: '/opt/homebrew/opt/xz/lib/liblzma.5.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/opt/homebrew/opt/xz/lib/liblzma.5.dylib' (no such file), '/opt/homebrew/opt/xz/lib/liblzma.5.dylib' (no such file)
at Object. (/Applications/Reor.app/Contents/Resources/app.asar/node_modules/vectordb/native.js:26:11)
at Module._compile (node:internal/modules/cjs/loader:1271:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1326:10)
at Module.load (node:internal/modules/cjs/loader:1126:32)
at Module._load (node:internal/modules/cjs/loader:967:12)
at c._load (node:electron/js2c/node_init:2:13672)
at Module.require (node:internal/modules/cjs/loader:1150:19)
at require (node:internal/modules/cjs/helpers:119:18)
at Object. (/Applications/Reor.app/Contents/Resources/app.asar/node_modules/vectordb/dist/query.js:19:25)
at Module._compile (node:internal/modules/cjs/loader:1271:14)
Are there known steps to reproduce?
I tried the suggested solution: npm install @lancedb/vectordb-darwin-arm64. That ran correctly, but didn't solve the problem.
Reinstalling reor didn't help.

can you try again on the latest version? https://github.com/lancedb/lancedb/releases/tag/v0.4.10
v0.4.10 should fix the lzma issue

Hi, thanks for your quick response. How can I install that specific version?

ok hang on tight, we had a release job failure. Once that's fixed it should just upload to npm

This should now be fixed in the latest version. Try re-installing https://github.com/lancedb/lancedb/releases/tag/v0.4.10

@TurboTomNL did the new release work for you?

@changhiskhan  hi, I've no idea how to install that specific version. I basically did the same as in my original message but unfortuntely also with the same result...

I experience the same issue with version 0.10.0.


Add MBS 0867 and 0817

What is the context of this PR?
New MBS questionnaires.
How to review
Check against schema definitions in slides

Do not merge until SDX have added the new qcodes.

All changes addressed - merging to feature branch


Lithium-ion parameters

Description
Added lithium-ion parameters and experimental functions (e.g. OCP). Changed the file structure within input to: input/lithium-ion/ with two folders: experimental functions and parameters.  There are modules for each type of experimental function so that it is easier to add new OCPs etc. Still need to change parameters.py
Fixes #8
Type of change

New feature (non-breaking change which adds functionality)

Please fix style issues using black and/or flake8 (https://travis-ci.org/tinosulzer/PyBaMM/jobs/456455035)
Might also be good to have a reference in the documentation for the OCPs? Admittedly I haven't done this either for lead-acid.

Codecov Report

Merging #13 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #13   +/-   ##
=======================================
  Coverage   70.04%   70.04%
=======================================
  Files          10       10
  Lines         444      444
=======================================
  Hits          311      311
  Misses        133      133

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update fef203e...0f36a2e. Read the comment docs.


Fix for merge values

Required for all non-trivial PRs

[ ] Rebased/mergable
[ ] Tests pass

Discovered two cases where Merge would sometimes return values unsorted.  This PR fixes those cases.  Also discovered some heavy lock contention in CreateShardGroup which this PR also fixes.

LGTM 👍  Just that question above over whether you could reduce allocations by waiting until you know if you need to merge in an element before reducing the length of b.


MB-6644 Update go version (to 1.15.8) and docker tag hashes

Description
Update go from 1.15.5 to 1.15.8. Includes release with security fixes.
Following the instructions to update go
Changelog or Releases

golang release log

go1.15.6 (released 2020/12/03) includes fixes to the compiler, linker, runtime, the go command, and the io package. See the Go 1.15.6 milestone on our issue tracker for details.

go1.15.7 (released 2021/01/19) includes security fixes to the go command and the crypto/elliptic package. See the Go 1.15.7 milestone on our issue tracker for details.

go1.15.8 (released 2021/02/04) includes fixes to the compiler, linker, runtime, the go command, and the net/http package. See the Go 1.15.8 milestone on our issue tracker for details.

Reviewer Notes
Step 1 step 1 of the instructions is here.
Please verify the hash in DockerHub matches the one I've updated this repo to use.
Setup
You can look at the instructions for more detailed instructions, but here are the steps:

Update project go version:
asdf install

Update global go version:
asdf global golang 1.15.8

Run formatter to check nothing new has come up:
pre-commit run --all-files circleci-lint

Run local tests that use docker:
make e2e_test_docker

You can see the e2e test running instructions for more info

Code Review Verification Steps

[ ] Request review from a member of a different team.
[ ] Have the Jira acceptance criteria been met for this change?

References

Jira story

Messages

:book:
:link: MB-6644

  Generated by :no_entry_sign: dangerJS against 0c076943a7bc8ad76bda0d3333e5d79f3f42736b

At this point the hashes don't match the latest hashes because there were a few more merges to the circleci repo, but this was the hash that came from my go update merge.


Bug report, feature request or other request

Describe the issue
So I can see that Get-OpenApiDocument.ps1 works fine locally - but in trying to execute the powershell from azdo pipeline (yml) GITHUB_WORKSPACE seems irrelevant - I assume that's for github action integration.  It first fails on the Set-Location  call to "$repositoryRoot/$FunctionAppPath"
It's not clear to me if I'm actually trying to access the github repository OR the build artefact (which is a zip file).
If I point it to the directory that contains the API zip file then it then fails saying that func is an unknown commandlet, etc.. in relation to this line:
$funcCommand = $(Get-Command func).Source
I'm using an ubuntu agent so I'm not sure if I need to include something as a requires in my powershell script to ensure that the Azure function core tools are available.
Is there further documentation on actually using this file in an Azdo ci/cd pipeline?  Am I confused that this powershell script should work in an azdo pipeline?

@jenp-jb Thanks for the issue! Let me take a further look.

@jenp-jb Get-OpenApiDocument.ps1 works locally for you? When I run locally on Windows, variable $repositoryRoot is null, so expression, "$repositoryRoot/$FunctionAppPath", forms either a bad path or a path other than where my Function App lives. Adding this on Line 90 works for me:
if ($repositoryRoot -eq $null) {
    $repositoryRoot = $currentDirectory
}


feat: Support .INCLUDE?

Adds ability to try to include potentially missing files. Introduces .INCLUDE? directive.
docs: Adds docs for new directive
test: Adds tests for conditional includes
test: Adds ability to test against stderr
chore: updates CI Bats version to 1.7.0
chore: Sets bats_require_minimum_version to 1.7.0
chore: Adds 'shellcheck source' doc to all bash-tpl sourcing lines
--
closes #18
cc: @dkebler

@dkebler Please give this PR a test drive if you have time - would love to get some feedback before merging it.

Sorry just saw this comment but will give it a try in the next week.
BTW bash-tpl has turned out to be a critical component for several involved/flexible bash scripts so thanks again!

@dkebler Just checking in to see if you had a chance to try the feature?

Ok, finally got some time to try it out.  Yes .INCLUDE? is working so thx for adding this.  No need for a dummy file now :).


nixos/jitsi-meet: add support for xmpp-websocket

Motivation for this change
instead of BOSH
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[x] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
21.11 Release Notes (or backporting 21.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

What this does is that it enables XMPP over a websocket as an alternative to BOSH.

Could you give an example of the configuration you are using to test this ?

services.jitsi-meet.enable = true; or wdym?


impossible condition in arm.cpp

Hi,
there is an impossible condition line 1672 of the file arm.cpp
//Check if out of range 		if((nbFrame > 15) && (nbFrame < -15)) return ARM_ERR_PARAM_OUT_OF_RANGE;
nbFrame cannot be higher than 15 and lower than -15 at the same time.
I suppose it should be this instead:
//Check if out of range 		if((nbFrame > 15) || (nbFrame < -15)) return ARM_ERR_PARAM_OUT_OF_RANGE;
Thank you anyway for this API

Exactly, Thank for your feedback.


Fix composeClasses order

[x] I have followed (at least) the PR section of the contributing guide.

Resolves #27945
For each slot, composeClasses appends the custom class in classes after the default value instead of prepending it.
This should match how withStyles used to work with v4, where you would pass external classes which would have higher specificity than the default ones.

I can't get any details on the "ci/circleci: test_browser-1" test failling, all other tests seem to pass.
Is this something that maybe requires approval to run?

Closing it, this is not a valid fix, as discussed on the issue.


feature - using rollup name as a measurement name for influxdb sink

For InfluxDB sink, all rollups data will be saved in the same measurement named "kflow".
This makes it less usable in case of usage of multiple rollups.
For example with two rollups:
-rollups sum,src_addr_grouping,in_bytes,src_addr,protocol -rollups sum,dst_addr_grouping,in_bytes,dst_addr -rollup_key_join "|"

> select * from "kflow" order by time desc limit 1000
name: kflow
time                           dst_addr        in_bytes src_addr:protocol
----                           --------        -------- -----------------
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>  100
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>   84
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>  1002
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>   607
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>    119
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>   14276
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>  75
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>    40
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>    40
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>      104
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>      208
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>      260
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>      52
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>      676
2021-06-28T08:18:16.359403447Z <IP_ADDRESS>      208
2021-06-28T08:18:16.357938693Z                 128      <IP_ADDRESS>|TCP
2021-06-28T08:18:16.357938693Z                 112      <IP_ADDRESS>|UDP
2021-06-28T08:18:16.357938693Z                 6305164  <IP_ADDRESS>|UDP
2021-06-28T08:18:16.357938693Z                 76       <IP_ADDRESS>|TCP
2021-06-28T08:18:16.357938693Z                 29600    <IP_ADDRESS>|TCP
2021-06-28T08:18:16.357938693Z                 256      <IP_ADDRESS>|UDP
2021-06-28T08:18:16.357938693Z                 40       <IP_ADDRESS>|TCP
2021-06-28T08:18:16.357938693Z                 28       <IP_ADDRESS>|UDP
2021-06-28T08:18:16.357938693Z                 28       <IP_ADDRESS>|UDP
2021-06-28T08:18:16.357938693Z                 168      <IP_ADDRESS>|TCP
2021-06-28T08:18:16.357938693Z                 608      <IP_ADDRESS>|TCP
2021-06-28T08:18:16.357938693Z                 40       <IP_ADDRESS>|TCP
2021-06-28T08:18:16.357938693Z                 56       <IP_ADDRESS>|UDP

you will have a single measurement with the different tags and the same field. This will be even worse if having multiple rollups with different metrics and different dimensions.
I would suggest that it might be better that the rollup name is used as measurement, so that each rollup is in the different measurement, resulting that each measurement can have consistent DB "schema"

Since JSON format provides field "count", why not adding count as the value in DB?
Is the "in_bytes" value expanded with the sampling rate?

Thanks!

Good idea!
Added with https://github.com/kentik/ktranslate/pull/52
For sample rate, prefix the rollup with s_ to automatically adjust for any sample rate. For example, -rollups s_sum,src_addr_grouping,in_bytes,src_addr,protocol

Can you verify its working now?

Yes I will, hopefully by end of the week, I see there is updated ktranslate container, which makes things easier for me...

Tested and it works, outputs below.
Do you also want to add "count" as the value in the DB? it might be useful as it represents number of flows which are aggregated, so user can get fps values from it.
> show measurements
name: measurements
name
----
dst_addr_grouping
kentik.flow
kflow
src_addr_grouping

> select * from src_addr_grouping order by time desc limit 10
name: src_addr_grouping
time                           in_bytes protocol src_addr
----                           -------- -------- --------
2021-07-15T15:09:12.243060849Z 2530924  UDP      <IP_ADDRESS>
2021-07-15T15:09:12.243060849Z 2340372  TCP      <IP_ADDRESS>
2021-07-15T15:09:12.243060849Z 3921944  UDP      <IP_ADDRESS>
2021-07-15T15:09:12.243060849Z 8527808  UDP      <IP_ADDRESS>
2021-07-15T15:09:12.243060849Z 2229282  UDP      <IP_ADDRESS>
2021-07-15T15:09:12.243060849Z 1077719  TCP      <IP_ADDRESS>
2021-07-15T15:09:12.243060849Z 6760764  UDP      <IP_ADDRESS>
2021-07-15T15:09:12.243060849Z 2125879  TCP      <IP_ADDRESS>
2021-07-15T15:09:12.243060849Z 6900996  UDP      <IP_ADDRESS>
2021-07-15T15:09:12.243060849Z 1188778  UDP      <IP_ADDRESS>

> select * from dst_addr_grouping order by time desc limit 10
name: dst_addr_grouping
time                           dst_addr       in_bytes
----                           --------       --------
2021-07-15T15:09:12.245018979Z <IP_ADDRESS> 111207
2021-07-15T15:09:12.245018979Z <IP_ADDRESS> 195289
2021-07-15T15:09:12.245018979Z <IP_ADDRESS> 29459270
2021-07-15T15:09:12.245018979Z <IP_ADDRESS> 2481053
2021-07-15T15:09:12.245018979Z <IP_ADDRESS> 9318093
2021-07-15T15:09:12.245018979Z <IP_ADDRESS> 9208255
2021-07-15T15:09:12.245018979Z <IP_ADDRESS> 263886
2021-07-15T15:09:12.245018979Z <IP_ADDRESS> 1907169
2021-07-15T15:09:12.245018979Z <IP_ADDRESS> 848308
2021-07-15T15:09:12.245018979Z <IP_ADDRESS> 1156397

Good call. Adding


Low ranking accuracy of the example with MovieLens20M?

Hi,
I've been playing around today with DSSTNE with the goal of running the example with MovieLens20M and compare the NN in the example with some state-of-the-art CF algorithms that I have implemented here. From my evaluation (which is by no means exhaustive or perfect) the example provided by DSSTNE does not seem to be competitive with respect to state of the art CF algorithms.
To summarise, I have downloaded the original MovieLens 20M dataset and I have performed a random 80%-20% partition. I have transformed the training subset to the DSSTNE format, with the only difference that I do not include the timestamps of the dataset, but 1's for all movies (is this actually very important??). I have generated recommendations with my CF algorithms (popularity, user-based and matrix factorisation) and, following the steps in the example, the predictions of DSSTNE. Finally, I have evaluated the performance with the testing subset using precision at cutoff 10.
These are the results, the configuration provided in your example does not seem to work very well:
pop	0.10974162112149495
ub	0.24097987334078072
mf	0.25135912784469483
dsstne	0.056956854920365056
I am no expert in ANN's so I cannot figure out easily whether I should modify the parameters in the config.json provided in the example to make it work better. Have you compared the performance of the example with similar CF algorithms? If so, could you please share some results/insights?
Cheers
Saúl

Hey Saul,
Nice work, I suspect the problem here is one of open sourcing the software
without open sourcing the secret sauce networks actually in use.  The
network supplied is not one (as far as I know) that Amazon uses for
recommendations, but rather a simple demo of a network one can build with
DSSTNE.
One could say similar things of TensorFlow.  Google has open sourced its
very nice framework, but clearly not all their networks nor all their
implementations of its underlying engine.
Scott
On Fri, May 20, 2016 at 8:17 AM, Saúl<EMAIL_ADDRESS>wrote:

Hi,
I've been playing around today with DSSTNE with the goal of running the
example with MovieLens20M and compare the NN in the example with some
state-of-the-art CF algorithms that I have implemented here
https://github.com/RankSys/RankSys. From my evaluation (which is by no
means exhaustive or perfect) the example provided by DSSTNE does not seem
to be competitive with respect to state of the art CF algorithms.
To summarise, I have downloaded the original MovieLens 20M dataset and I
have performed a random 80%-20% partition. I have transformed the training
subset to the DSSTNE format, with the only difference that I do not include
the timestamps of the dataset, but 1's for all movies (is this actually
very important??). I have generated recommendations with my CF algorithms
(popularity, user-based and matrix factorisation) and, following the steps
in the example, the predictions of DSSTNE. Finally, I have evaluated the
performance with the testing subset using precision at cutoff 10.
These are the results, the configuration provided in your example does not
seem to work very well:
pop 0.10974162112149495
ub 0.24097987334078072
mf 0.25135912784469483
dsstne 0.056956854920365056
I am no expert in ANN's so I cannot figure out easily whether I should
modify the parameters in the config.json provided in the example to make it
work better. Have you compared the performance of the example with similar
CF algorithms? If so, could you please share some results/insights?
Cheers
Saúl
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub
https://github.com/amznlabs/amazon-dsstne/issues/24

Hi Scott,
Thanks for your contribution.
Please let me clarify: I am not asking that's the exact configuration Amazon uses for their systems. I believe it would suffice providing one that performs well enough in a public dataset such as MovieLens 20M that uses, for instance, configurations found in papers such as this one.
It is awesome that Amazon releases code like this, I am just kindly requesting a little bit of guidance on how to make the provided example work.
Best wishes
Saúl

So one easy first step would be to add denoising to the example network, no?
Second, if you're willing, that's a very cool paper (I saw something like
it at KDD 2015), and I'd love to help you implement it in DSSTNE if you're
interested in doing so.  And I suspect doing so would either demonstrate
the flexibility of DSSTNE or help provide additional API hooks to provide
such flexibility.  Interested?
Scott
On Fri, May 20, 2016 at 8:39 AM, Saúl<EMAIL_ADDRESS>wrote:

Hi Scott,
Thanks for your contribution.
Please let me clarify: I am not asking that's the exact configuration
Amazon uses for their systems. I believe it would suffice providing one
that performs well enough in a public dataset such as MovieLens 20M that
uses, for instance, configurations found in papers such as this one
http://dl.acm.org/citation.cfm?id=2835837.
It is awesome that Amazon releases code like this, I am just kindly
requesting a little bit of guidance on how to make the provided example
work.
Best wishes
Saúl
—
You are receiving this because you commented.
Reply to this email directly or view it on GitHub
https://github.com/amznlabs/amazon-dsstne/issues/24#issuecomment-220640796

PS here's how to do that first step...
"Denoising" : {
    "p" : 0.3
},

On Fri, May 20, 2016 at 8:45 AM, Scott Le Grand<EMAIL_ADDRESS>wrote:

So one easy first step would be to add denoising to the example network,
no?
Second, if you're willing, that's a very cool paper (I saw something like
it at KDD 2015), and I'd love to help you implement it in DSSTNE if you're
interested in doing so.  And I suspect doing so would either demonstrate
the flexibility of DSSTNE or help provide additional API hooks to provide
such flexibility.  Interested?
Scott
On Fri, May 20, 2016 at 8:39 AM, Saúl<EMAIL_ADDRESS>wrote:

Hi Scott,
Thanks for your contribution.
Please let me clarify: I am not asking that's the exact configuration
Amazon uses for their systems. I believe it would suffice providing one
that performs well enough in a public dataset such as MovieLens 20M that
uses, for instance, configurations found in papers such as this one
http://dl.acm.org/citation.cfm?id=2835837.
It is awesome that Amazon releases code like this, I am just kindly
requesting a little bit of guidance on how to make the provided example
work.
Best wishes
Saúl
—
You are receiving this because you commented.
Reply to this email directly or view it on GitHub
https://github.com/amznlabs/amazon-dsstne/issues/24#issuecomment-220640796

@saulvargas is it possible to get us the scripts which you used to generate your test and train dataset

Hi @rgeorgej ,
Sure! I can prepare a simple repository with all required to reproduce the experiment I performed, although it might take me a couple of days... I'll let you know.
Cheers
Saúl

Hey Saul, I'd love to make a benchmark out of this for both training speed and predictive performance.  Any progress here?

Hi,
I've been working in my spare time in a script and some Java code to fully reproduce the experiment I performed two weeks ago. It is still work in progress as I have to include the steps for DSSTNE, but meanwhile you can take a look here: https://github.com/saulvargas/dsstne-comparison/
Basically, if you execute run.sh, you download the original MovieLens20M dataset, perform a random 80/20 random split for training and test, generate some CF baselines with RankSys and the evaluate the precision@10 of these baselines.
Cheers
Saúl

Hi @rgeorgej
Sorry it took so long, but now I have all the code in https://github.com/saulvargas/dsstne-comparison/ that is required to reproduce the experiments I conducted, now including training DSSTNE with my 80/20% split for MovieLens20M data. I hope it helps. Just execute the steps in run.sh (the ub recommender might take a while to be trained).
Cheers
Saúl

Thanks @saulvargas for all the help and we will take it to our side to get you a decent config with offline performance for the movie lens data

So I was splitting 80/20 on users, you were splitting on movie views.  I'll have that data for you by tomorrow.  Got P@10 to 9.3% for that partitioning on the second try though so I suspect there's lots of headroom for improvement.

With this fix, 32.7% P@10, 48.4% P@1.  Will post to github tonight after work, but here's the first submission, incorporating input denoising and a sparseness penalty in the hidden layer:
{
"Version" : 0.8,
"Name" : "MovieLens Benchmark #1",
"Kind" : "FeedForward",
"SparsenessPenalty" : {
"p" : 0.5,
"beta" : 2.0
},
"ShuffleIndices" : false,

"Denoising" : {
    "p" : 0.4
},

"ScaledMarginalCrossEntropy" : {
    "oneTarget" : 1.0,
    "zeroTarget" : 0.0,
    "oneScale" : 30.0,
    "zeroScale" : 1.0
},
"Layers" : [
    { "Name" : "Input0", "Kind" : "Input", "N" : "auto", "DataSet" : "input", "Sparse" : true },
    { "Name" : "Hidden", "Kind" : "Hidden", "Type" : "FullyConnected", "Source" : [ "Input0" ], "N" : 256, "Activation" : "Sigmoid", "Sparse" : true },
    { "Name" : "Output", "Kind" : "Output", "Type" : "FullyConnected", "Source" : [ "Hidden" ], "DataSet" : "output", "N" : "auto", "Activation" : "Sigmoid", "Sparse" : true }
],

"ErrorFunction" : "ScaledMarginalCrossEntropy"

}

Round 2, MAP@10 of 41.1% and a P@10 of 35.3%.  Network supplied below:
{
"Version" : 0.8,
"Name" : "MovieLens Benchmark #2",
"Kind" : "FeedForward",
"ShuffleIndices" : false,

"ScaledMarginalCrossEntropy" : {
    "oneTarget" : 1.0,
    "zeroTarget" : 0.0,
    "oneScale" : 1.0,
    "zeroScale" : 1.0
},
"Layers" : [
    { "Name" : "Input", "Kind" : "Input", "N" : "auto", "DataSet" : "input", "Sparse" : true },
    { "Name" : "Hidden1", "Kind" : "Hidden", "Type" : "FullyConnected", "Source" : "Input", "N" : 1536, "Activation" : "Relu", "Sparse" : false, "pDropout" : 0.5, "WeightInit" : { "Schem

e" : "Gaussian", "Scale" : 0.01 } },
{ "Name" : "Hidden2", "Kind" : "Hidden", "Type" : "FullyConnected", "Source" : ["Hidden1"], "N" : 1536, "Activation" : "Relu", "Sparse" : false, "pDropout" : 0.5, "WeightInit" : { "S
cheme" : "Gaussian", "Scale" : 0.01 } },
{ "Name" : "Output", "Kind" : "Output", "Type" : "FullyConnected", "DataSet" : "output", "N" : "auto", "Activation" : "Sigmoid", "Sparse" : true , "WeightInit" : { "Scheme" : "Gaussi
an", "Scale" : 0.01, "Bias" : -10.2 }}
],
"ErrorFunction" : "ScaledMarginalCrossEntropy"

}

Hi there,
I have a related issue about MovieLense example and the choice of ErrorFunction.
First, I wonder if during input/output data generation stage (generateNetCDF ...), time stamps (how long users watch a movie) are actually recorded in gl_input.nc file and used as an implicit measure of user-movie affinity, rather than replacing them as a label '1' indicating whether user has watched the movie or not?
If the former is the case, I think a regression type error function such as L2 should be used in this Auto Encoding. 'ScaledMarginalCrossEntropy' is relevant to classification setting (like the alternative scenario I mentioned above).
thanks,

Hi all,
Sorry it took me so long to get back to you with this.
Unfortunately I have not been successful at obtaining a decent ranking accuracy with any of the two last configurations that @scottlegrand kindly provided. They basically perform as bad as the original one for my evaluation methodology. I suspect we may be applying different evaluation protocols and, therefore, the provided configurations may not be adequate for the one I am interested about.
If I find some time, I will try to learn enough about ANNs so that I can understand how to come up with a configuration that results in high ranking accuracy for my setup. Therefore, I think we can close this issue now.
For your reference I am sharing the data I generated: https://www.dropbox.com/s/krk8mkzynn9igqv/dsstne-comparison-data.zip?dl=0
The code is already here: https://github.com/saulvargas/dsstne-comparison/

I was wondering if anyone ran this on the 100K dataset and evaluated its accuracy in terms of MSE? Are these benchmarks from DSSTNE publicly available?


CORE-10383 Create the interfaces for custom query registration

Overview
This PR creates the required interfaces for the custom query registration. These include:

VaultNamedQuery -- a POJO representing a named query with all the properties. It can have a filter, mapper and collector (VaultNamedQueryCollector, VaultNamedQueryFilter, VaultNamedQueryTransformer)
VaultNamedQueryBuilderFactory -- Used to create and build custom queries
VaultNamedQueryFactory -- The main interface that needs to be implemented in CPKs in order to create custom queries
VaultNamedQueryRegistry -- Used to store custom queries

TODOs / known issues
VaultNamedQueryRegistry currently have a function called registerQuery that should NOT be on the public API because it is only used internally. However, I couldn't create an internal interface that can be wired properly because I always got an OSGi exception, will need to investigate further.
Test notes
Please refer to the implementation PR.

Thanks @driessamyn I've added example usages for the classes that needs to be implemented by the user.


Changing Language/Currency in checkout in delivery-mode has an infinite loading issue

Steps to Reproduce

Use dev-17 or dev-19

register/login if you have an account

add a product

proceed to checkout

fill up the shipping address in checkout or proceed to next step if you already have a shipping address

change the language or currency in delivery-mode (this is show the infinite loading).

Observed Results

Infinite loading icon

Expected Results

should show different 'site-context' in delivery-mode

Test successful 🆗 .


Priority for map() function?

Hi,
I was wondering, if let's say I declared the following in the mapping() function:
	// Our web API doesn't return the field properly ("Name" instead of "FullName")
	// So hence we're declaring this twice
	// This should work?
	fullName        <- map["Name"]
	fullName        <- map["FullName"]

And these are my two web API endpoints:
http://www.example.com/GetUserData
(For the user to view their own data)
{ "FullName" : "John Doe" }

http://www.example.com/GetUserProfile
(For other users to view this user)
{ "Name" : "John Doe" }

Is it "safe" to declare it "twice" this way?
Would map["FullName"] have "priority" when calling http://www.example.com/GetUserData, as there is no "FullName" field?

Hi there, yes it is safe to do what you are doing and the last mapping will always have priority.
This is not really an ideal implementation though. For that reason, I am working on a new feature. This feature will allow developers to create a mapping context object that will be passed around during mapping in the Map object. This object will store whatever information you want, so you could use it to decide how to perform your mapping. This work is currently in a branch (mappable) which I am hoping to merge soon. See documentation:
https://github.com/Hearst-DD/ObjectMapper/tree/mappable#mapping-context

Hello,
I gave the latest version a whirl, and it's working fine on my project, resulting in cleaner code. Seems pretty nifty. 😃


Update okcoin futures trades to return the order quantity in TradeableAmount not the working quantity

The limit order tradeable ammount appears to be used for the total quanity of the order,
public OpenOrders getOpenOrders() throws IOException, BitstampException {

    BitstampOrder[] openOrders = getBitstampOpenOrders();

    List<LimitOrder> limitOrders = new ArrayList<LimitOrder>();
    for (BitstampOrder bitstampOrder : openOrders) {
        OrderType orderType = bitstampOrder.getType() == 0 ? OrderType.BID : OrderType.ASK;
        String id = Integer.toString(bitstampOrder.getId());
        BigDecimal price = bitstampOrder.getPrice();
        limitOrders.add(new LimitOrder(orderType, bitstampOrder.getAmount(), CurrencyPair.BTC_USD, id, bitstampOrder.getTime(), price));
    }

Rather than the working quanity that is calculated by the ok coin futures order adapters:
return new LimitOrder(adaptOrderType(order.getType()), order.getAmount().subtract(order.getDealAmount()), adaptSymbol(order.getSymbol()),
    String.valueOf(order.getOrderId()), order.getCreateDate(), order.getPrice());

}
public static LimitOrder adaptOpenOrderFutures(OkCoinFuturesOrder order) {
return new LimitOrder(adaptOrderType(order.getType()), order.getAmount().subtract(order.getDealAmount()), adaptSymbol(order.getSymbol()),
String.valueOf(order.getOrderId()), order.getCreatedDate(), order.getPrice(), order.getAvgPrice(), order.getDealAmount(),
adaptOrderStatus(order.getStatus()));
}
update to :
return new LimitOrder(adaptOrderType(order.getType()), order.getAmount(), adaptSymbol(order.getSymbol()), String.valueOf(order.getOrderId()),
order.getCreateDate(), order.getPrice());
}
public static LimitOrder adaptOpenOrderFutures(OkCoinFuturesOrder order) {
return new LimitOrder(adaptOrderType(order.getType()), order.getAmount(), adaptSymbol(order.getSymbol()), String.valueOf(order.getOrderId()),
order.getCreatedDate(), order.getPrice(), order.getAvgPrice(), order.getDealAmount(), adaptOrderStatus(order.getStatus()));
}

@douggie We'd love to have your bug fix for this. Could you create a PR?

Hi Tim,
It is already in PR https://github.com/timmolter/XChange/pull/1195.
it was just if you don't feel the ASK_EXIT and BID_EXIT is the right
approach, I can reimplment it.
On Sat, Feb 27, 2016 at 10:15 PM, Tim Molter<EMAIL_ADDRESS>wrote:

@douggie https://github.com/douggie We'd love to have your bug fix for
this. Could you create a PR?
—
Reply to this email directly or view it on GitHub
https://github.com/timmolter/XChange/issues/1190#issuecomment-189728233.


create datapipe for resampled format

Pull Request
Description
Creating data pipes to for the resampled format of the Solar farm data
Fixes #
How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce.
Please also list any relevant details for your test configuration

[ ] Yes

If your changes affect data processing, have you plotted any changes? i.e. have you done a quick sanity check?

[ ] Yes

Checklist:

[ ] My code follows OCF's coding style guidelines
[ ] I have performed a self-review of my own code
[ ] I have made corresponding changes to the documentation
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] I have checked my code and corrected any misspellings

I don't see a datapipe or conversion script here for the raw data to netCDF? I see the stuff from the other PR here, but yeah, I'd recommend not requesting a review till the code is ready to go. And maybe split out the common changes between this PR and #5 into a smaller PR of its own, so the changes aren't duplicated, and its easier to tell what the changes are.

Sure, sorry about that, I'll do that right away!

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@c5caf2d). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main       #6   +/-   ##
=======================================
  Coverage        ?   97.22%
=======================================
  Files           ?        3
  Lines           ?       36
  Branches        ?        0
=======================================
  Hits            ?       35
  Misses          ?        1
  Partials        ?        0

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


[FLINK-22991][network] Use Optional in NettyBufferPool

Other cases are handled in other tickets. All the classes you listed will be moved to a new flink-rpc-akka module, either completely or partially.

Ok, thanks for clarification. 👍


kodiPackages.jellyfin: 1.0.3 -> 1.0.4

Description of changes
Fixes missing distutils module. Right now version 1.0.3 doesn't work due to the Python3.12 update.
Moved the zip fix to a patch, because the build.py file moved, and the sed command silently did nothing.
Changelog: https://github.com/jellyfin/jellyfin-kodi/releases/tag/v1.0.4

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Fixes missing distutils module.

i don't see anything related to that :thinking:

Moved the zip fix to a patch, because the build.py file moved, and the sed command silently did nothing.

for future reference: https://nixos.org/manual/nixpkgs/stable/#fun-substitute-replace-fail :tada:

i don't see anything related to that 🤔

It's hidden in there: https://github.com/jellyfin/jellyfin-kodi/commit/f4ffe69ea53d2d843d3d0b2fbc9cf94d7faab18a

Thanks! I wish you a good rest, then


[FEATURE] monobeast baseline implementation

🚀 Feature

current polybeast implementation has most code written in C++, requesting for mnonobeast implementation for more clarity
Motivation

readability/flexibility
Pitch

monobeast implementation will offfer more readability and flexibility
Alternatives

N/A
Additional context

N/A

N/A


Improve SnarkyJS README

From Slack convo:
flesh out the SnarkyJS README with

a marketing-focused overview
bullet points of benefits or key features to impart understanding quickly

In a ‘Ceviche multi-chain world’ where the README becomes a primary entry point for users, rather than the Mina docs, this content and context all become even more important.
Future: We’ll add a brand graphic to the README after the rename is finalized.

We have more work to do, #866 is just a bare-bones starter update.
Future updates to provide:

Marketing-focused overview
Bullet points of benefits and key features to impart understanding quickly

Let's identify and answer these questions so that the updated README can inform the world about the awesome SnarkyJS uses:

who needs to know about SnarkyJS?
what are the top 5 benefits of using SnarkyJS?
what problems does SnarkyJS solve?
what is the call to action for this README?
what is a compelling use case for SnarkyJS?
what is the question you get asked the most about SnarkyJS?

Content inspiration

include some code examples, so people can get a feel for what snarkyjs is like @mitschabaude
call to action IMO is starting a zkapp project with the zkapp cli, or try out snarkyjs in another way @mitschabaude

Some things I'd like to see (based on some of my favorite READMEs like https://github.com/BurntSushi/ripgrep)

Badges (for CI etc.) if we have them
Link to change log
Link to contributing doc
Link to docs (on the MF site)
Bonus: A screen recording converted to a gif that shows how easy it is to download, scaffold a project and start building.

Bonus: A screen recording converted to a gif that shows how easy it is to download, scaffold a project and start building.

Great idea!

SnarkyJS is the best zero-knowledge SDK (gleaned from https://www.notion.so/minaprotocol/SnarkyJS-Feedback-14797844e7144d15bbb35fda7375c5e5
SnarkyJS is the best zero-knowledge SDK

Code is aesthetic and readable
chaining API
Separation of TypeScript and SnarkyJS
Convenient stuff when you need it and out of the way when you don't

Still lots of work to do, iteration in https://github.com/o1-labs/snarkyjs/pull/886 before the next release so that npm is updated https://www.npmjs.com/package/snarkyjs


pipenv update --outdated | TypeError: '>' not supported between instances of '_Version' and 'str'

Issue description
Describe the issue briefly here.
pipenv update --outdated

    return callback(*args, **kwargs)
  File "/home/jimmy/.pyenv/versions/3.7-dev-debug/lib/python3.7/site-packages/pipenv/vendor/click/decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/home/jimmy/.pyenv/versions/3.7-dev-debug/lib/python3.7/site-packages/pipenv/cli/command.py", line 484, in update
    do_outdated(pypi_mirror=state.pypi_mirror)
  File "/home/jimmy/.pyenv/versions/3.7-dev-debug/lib/python3.7/site-packages/pipenv/core.py", line 1653, in do_outdated
    for pkg in project.environment.get_outdated_packages()
  File "/home/jimmy/.pyenv/versions/3.7-dev-debug/lib/python3.7/site-packages/pipenv/environment.py", line 350, in get_outdated_packages
    pkg for pkg in self.get_package_info(pre=pre)
  File "/home/jimmy/.pyenv/versions/3.7-dev-debug/lib/python3.7/site-packages/pipenv/environment.py", line 351, in <listcomp>
    if pkg.latest_version._version > pkg.parsed_version._version
TypeError: '>' not supported between instances of '_Version' and 'str'

I am using a package with special version mark 3.3.0.dev.3a8168,
I think 3.3.0.dev.3a8168 causes this problem.

try to test pipenv update --outdated with the latest commit git master branch.
Traceback (most recent call last):
  File "/home/jimmy/.pyenv/versions/3.7-dev-debug/bin/pipenv", line 11, in <module>
    load_entry_point('pipenv', 'console_scripts', 'pipenv')()
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/vendor/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/vendor/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/vendor/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/vendor/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/vendor/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/vendor/click/decorators.py", line 64, in new_func
    return ctx.invoke(f, obj, *args, **kwargs)
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/vendor/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/vendor/click/decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/cli/command.py", line 483, in update
    do_outdated(pypi_mirror=state.pypi_mirror)
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/core.py", line 1808, in do_outdated
    for pkg in project.environment.get_outdated_packages()
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/environment.py", line 435, in get_outdated_packages
    pkg for pkg in self.get_package_info(pre=pre)
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/environment.py", line 435, in <listcomp>
    pkg for pkg in self.get_package_info(pre=pre)
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/environment.py", line 407, in get_package_info
    with self.get_finder() as finder:
  File "/home/jimmy/.pyenv/versions/3.7-dev-debug/lib/python3.7/contextlib.py", line 112, in __enter__
    return next(self.gen)
  File "/mnt/fedora-home/jimmy/workspace/devel/github/pypa/pipenv/pipenv/environment.py", line 394, in get_finder
    process_dependency_links=pip_options.process_dependency_links,
AttributeError: 'Values' object has no attribute 'process_dependency_links'

Hi,
I've observed a similar error message using the Shapely. The command pipenv run pip search Shapely shows the available version Shapely (1.6.4.post2). If I try to update Shapely calling pipenv update --outdated generates an error.
Steps to reproduce
mkdir test
pipenv shell
pipenv install Shapely==1.6.4
pipenv update --outdated

Error message:
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.6/bin/pipenv", line 10, in <module>
    sys.exit(cli())
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pipenv/vendor/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pipenv/vendor/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pipenv/vendor/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pipenv/vendor/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pipenv/vendor/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pipenv/vendor/click/decorators.py", line 64, in new_func
    return ctx.invoke(f, obj, *args, **kwargs)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pipenv/vendor/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pipenv/vendor/click/decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pipenv/cli/command.py", line 484, in update
    do_outdated(pypi_mirror=state.pypi_mirror)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pipenv/core.py", line 1653, in do_outdated
    for pkg in project.environment.get_outdated_packages()
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pipenv/environment.py", line 350, in get_outdated_packages
    pkg for pkg in self.get_package_info(pre=pre)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pipenv/environment.py", line 351, in <listcomp>
    if pkg.latest_version._version > pkg.parsed_version._version
TypeError: '>' not supported between instances of 'tuple' and 'NoneType'

Workaround
If you rerun pipenv install Shapely==1.6.4.post2 (including the version suffix post2) the command pipenv update --outdated works as expected.
Debugging the problem
The source of the error lies in pipenv/environment.py:
    def get_outdated_packages(self, pre=False):
        return [
            pkg for pkg in self.get_package_info(pre=pre)
            if pkg.latest_version._version > pkg.parsed_version._version
        ]

At this point, two versions are compared (latest_version vs. parsed_version) and the comparison fails for the Shapely package. Running the snippet
[(pkg.latest_version._version, pkg.parsed_version._version) for pkg in self.get_package_info(pre=pre)]

generates the output
[...,
(_Version(epoch=0, release=(1, 6, 4), dev=None, pre=None, post=('post', 2), local=None),
  _Version(epoch=0, release=(1, 6, 4), dev=None, pre=None, post=None, local=None)),
...]

Looking at the file pipenv/patched/notpip/_vendor/packaging/version.py indicates that _Version is just a collections.namedtuple. In my case, one of the elements inside the namedtuple is None and that causes the comparison error. This is easy to reproduce:
import collections
T = collections.namedtuple('T', ['a', 'b'])
t1 = T(a=0, b=0)
t2 = T(a=1, b=1)
t3 = T(a=None, b=2)

# OK --> True
print(t1 < t2)

# Fails with: TypeError: '>' not supported between instances of 'int' and 'NoneType'
print(t2 > t3)

Maybe someone can help to fix the problem. I'm not sure what would be the best approach, e.g.

Guarantee that no element of the namedtuple is None --> this maybe causes error prone comparison results
Use Version instead of _Version for the comparison. Version seems to be a child class of BaseVersion which implements the comparison operators.

Best regards,
Andreas

Thanks for the helpful debugging, this seems like a bug in packaging that I can triage upstream if they haven't caught it


Issue with scaling

Hi,
Thank you for this amazing tutorial and RNN code. I am using your method to predict stock prices, but unfortunately I encounter an error that seems to be coming from normalisation part, but I am unable to find the issue and need to ask for your kind help. Basically I am training network with this years stock prices, and asking it to predict the next prices. After the inverse transform function, the prices don't match with the original ones for the next year data. I made a plot, and there seem to be an offset. I cannot figure out why this is happening.
Attached is my code. I really appreciate your time in advance, solving this minor issue would be extremely valuable to me.
Forecast.zip
Thanks,

Sorry for not replying for so long. I completely forgot about this issue after I took a first look but if you are still searching for answers I think that you should just increase the model size and training epochs. Furthermore you should note that these technique isn't made for predicting long times in the future and should rather be used to predict the next few data-points.
Again I'm sorry for not answering for such a long time. Hope this still was somewhat helpful. If you have any more questions fell free to ask.


Javascript errors shown in the web inspector - Faild to execute 'arc'

Checklist:

[X] I updated to the latest version available
[X] I cleared the cache of my browser

Release with the issue:
Fluid level background card: v0.1.5
HA: 2024.4.3
Last working release (if known):
nothing
Browser and Operating System:
Opera GX and Windows 11
Description of problem:
I noticed that your integration was generating a lot of errors in the java script console. This slows me down during certain modifications.
EDIT : I've just seen that this problem has already been mentioned and is corrected in the beta version. I'll leave you to deal with this issue as you see fit.
Javascript errors shown in the web inspector (if applicable):

duplicate #383
This issue is fixed in the latest beta release


use Google's AFL repo and bump to 2.53b

AFL was recently revived by Google and as a part of this revival, the version was bumped and the repo was moved: https://github.com/google/AFL
Announcement: https://groups.google.com/forum/?utm_medium=email&utm_source=footer#!topic/afl-users/WX8NdcB9GmM

looks good


Merge Libsolv (gsoc15-dependency) branch with master

Merge libsolv branch (from GSoC 2015) with master.
Libsolv is a SAT Solver for dependency calculation and currently supports search, installation and conflict resolution. Libsolv can be used by passing "-l" option to port.
It uses libsolv submodule (fork of upstream to work with Make).
Would like to merge it with master before new season of GSoC begins or there may be merge conflicts or difficulty in updating master while trying to merge multiple projects later on. Also users would be able to contribute and test libsolv from the master copy. Can be in Beta ?
For usage and installation instructions: https://trac.macports.org/wiki/SummerOfCode2015Libsolv

Thank you, I just wanted to ask what the status of your project was and how much was still missing to make it fully functional.
(I wonder if it's possible to make the history of merging somewhat more linear - bearing in mind that making it completely linear is not feasible anyway.)
One option would be to put the code to a branch of macports-base in the short term, at least for the sake of the buildbot checking whether it builds everywhere. It would be slightly suboptimal if this year's students would start with broken code :) :) :)
How many more changes are needed before this code could end up in a release?

@mojca There is a branch in macports-base already, although not updated with latest changes; there were some merge conflicts. I was playing with merge and rebase on my local fork in order to keep the original branch safe from any mishap.
Initially I thought I would finish up uninstall and variant support then open PR with master but as new gsoc is fast approaching I didn't want to risk waiting any longer. Also didn't want to have more merge conflicts, particularly with port migrate project since it will have more hacking on the base.

This has been sitting in the queue for quite a while, which is a shame. What can we do to get it integrated?

I am hoping we could get a beta version of libsolv merged with installation, search and conflict resolution support.
Things pending are uninstallation and variants support. We may also need to add or modify portindex at some point of time later, but we can still use portindex as it is for now.

So if this isn't ready to merge, would it be better to close this and re-open it later when you're feeling ready?

Yes, that was my plan actually. I'll close the PR with this comment and open a new one with recent changes.


Add pop-out button for grid mode and store defaults in settings

🚀 Feature
This would supersede #3007 and #2974 by adding a pop out to the grid button, accessible by right clicking it that would allow the user to set the grid size as a 2-tuple of int (could be two int comboboxes > 0) and the stride could be a int combobox that could be negative or positive (0 should result in no grid). It should look like the pop out dialog for the play button

Clicking the button normally should toggle between grid enabled/ disabled.
The default values of size, stride, and enabled should also be stored in the settings. Changing the values in the popout shouldn't change defaults (like is done with the play button) but changing values in settings should change values in popout.
How does this sound @haesleinhuepf @tlambert03? If agreed on this behaviour we can give to @ppwadhwa for the next sprint.

@liaprins-czi this is also something you could mock up in design before @ppwadhwa implements. Should be fairly quick to do, compared to some of the other work, and I know @haesleinhuepf is pretty eager for this functionality!

i like it

and I know @haesleinhuepf is pretty eager for this functionality!

😃 Yes, especially if stride=-1 was default 🙂

😃 Yes, especially if stride=-1 was default 🙂

After this was added you'd be able to set the default value in the settings to be -1. You'd have to change it once, but then it would persist for all time - literally forever!!!! :-)

Alright, no hurry from my side!

@LCObus new plan for grid button is here

thanks @sofroniewn, excited to see this develop!
Agree on the

It should look like the pop out dialog for the play button
maintaining expectations about when to discover and customize more will be helpful for heuristics (recognition not recall)

@neuromusic @ppwadhwa Here is my mockup for the popout, let me know if this makes sense. Also, what should the default stride be first time user opens the grid mode popout?

And if we want to includ emore explanatory info, it could live in little help icons; here is a little prototype mocking it up:
https://www.figma.com/proto/5yHtWYtZ9KzEuCFRzVMwRI/Grid-mode-settings?page-id=0%3A1&node-id=3%3A116&viewport=172%2C-851%2C1&scaling=min-zoom&starting-point-node-id=3%3A116

Thanks so much for this @liaprins-czi! Great to see it mocked out and I love the little help icon in

Definitely something we might want to use more of!
I'm thinking that we might want to go with Grid stride, Grid height, and Grid width as the three options. I find shape height and shape width a little funny as its not really the height of the shape, it was more the shape of the grid which has a height and width.
Also @ppwadhwa is it possible to make a combobox which skips 0 as then we could use a combobox that goes -1, 1, 2, ... for width/ height. And possibly one that goes ... -2, -1, 1, 2, .... for stride. I think having comboboxes for height and width will probably feel better than having free text though as the values are only integers.
For tooltip help we could have the following for stride
Number of layers to place in each grid square before moving on to
        the next square. The default ordering is to place the most visible
        layer in the top left corner of the grid. A negative stride will
        cause the order in which the layers are placed in the grid to be
        reversed.

and the following for height/ width.
        Number of rows and columns in the grid. A value of -1 for either or
        both of will be used the row and column numbers will trigger an
        auto calculation of the necessary grid shape to appropriately fill
        all the layers at the appropriate stride.

Also, what should the default stride be first time user opens the grid mode popout?

The defaults are -1, -1 for width / height and 1 for stride, see
https://github.com/napari/napari/blob/a8e618a742ef915ea3638a61592981fb17b2bd7f/napari/components/grid.py#L33-L34
Does this all sound good to @jni? Might be good to get one more look over (I'd also be open to rows/ columns instead of height/ width, but don't have a strong feeling).
Maybe @liaprins-czi you can look over my suggestions above and if you agree can make an update mock that @ppwadhwa can then build against. Also happy to discuss more if you disagree with any. Thanks!!

@sofroniewn Yeah that all sounds good to me! I will update soon.
So just to verify, the width and height inputs will now be the same style as the stride (the + and - buttons with int showing in the middle)?
Also, we can have sepaarate "?" icons for the width vs height if that is better, I just put them as one because the initial text you posted in the Slack thread describing each input had width and height with one description. I think that way does make sense since they are very similar, but just checking if we want them to have separate descriptions we can

So just to verify, the width and height inputs will now be the same style as the stride (the + and - buttons with int showing in the middle)?

Yes i think so

Also, we can have sepaarate "?" icons for the width vs height if that is better, I just put them as one because the initial text you posted in the Slack thread describing each input had width and height with one description. I think that way does make sense since they are very similar, but just checking if we want them to have separate descriptions we can

I like how you did one "?" between the two as they are so related to each other

Alreight, here is the updated prototype:
https://www.figma.com/proto/5yHtWYtZ9KzEuCFRzVMwRI/Grid-mode-settings?page-id=0%3A1&node-id=3%3A116&viewport=-167%2C-1050%2C1&scaling=min-zoom&starting-point-node-id=3%3A116

Thanks, @liaprins-czi and @sofroniewn.  I'm going to start putting this in place!  :)

Thanks, @liaprins-czi and @sofroniewn. I'm going to start putting this in place! :)

Love it! Great hand off @liaprins-czi


v.8.4.0

v.8.3.7 - Bugfix if SJ-API has "None" as hoster
v.8.3.7 - Improve Ombi console output

less repitition
include movie/shows count in single line
v.8.3.7 - Do not output missing hoster to INFO log
v.8.4.0 - Ignore Episode if equal or better Season exists


Unable to exclude a table model attribute/column before its being saved. Forexample: column of datatype timestamp

What steps will reproduce the problem

Create table user(id int not null, name varchar(10) not null, email_address varchar(10) not null, timestamp timestamp)
Try inserting values into above table using yii2 method
$model =$connection->createCommand()->insert('user', ['name' => 'xyz', 'email_address' => 'something@gmail.com'])->execute();

What is the expected result?

The expected result should try to insert the value for only those 2 columns whose values are being passed forexample: just insert value for column name and email_address and exclude column timestamp from insert statement.

What do you get instead?
Cannot insert an explicit value into a timestamp column. Use INSERT with a column list to exclude the timestamp column, or insert a DEFAULT into the timestamp column.
Additional info

Q
A

Yii version
2.0.?

PHP version

Operating system

This is because of the DB itself, and not because of Yii. https://stackoverflow.com/questions/10262426/sql-server-cannot-insert-an-explicit-value-into-a-timestamp-column
As I understand you could try to use 'timestamp' => new Expression('DEFAULT').


(core) - Make DocumentNode serialization idempotent

Summary
Fixes #1508
Set of changes
This makes DocumentNode serialization idempotent.
In other words, this makes it so we get the same serial representation (and therefore hash key) for a DocumentNode each time it is computed.

@kitten Suggestion for changeset applied and Just snapshots updated :)


Add with_user_cookie configuration option

Add an optional with_user_cookie config to set a user_id cookie on /signin and clear it on /signout within the sign_in and sign_out helper methods. It defaults to false.
This could be specifically helpful when authenticating ApplicationCable::Connection with current_user using a cookie. Currently the work around I can think of is having a before_action that sets the cookie in ApplicationController and then skipping it for actions that don't require a user.

I am planning on testing this on the PR that is linked. Currently I have that branch pointed towards this branch in the Gemfile.

Works as intended for me. Also moved to using the an encrypted cookie per rails default for finding the user in ActionCable::Connection.


Allow people to have best friends, significant others, etc

I saw this https://top.gg/bot/marriagebot and thought it'd be a pretty cool feature to have and it'd increase engagement with users.

This is an interesting feature implementation, i'll throw this branch onto my testing environment and see what the support team think of it. In the past we have denied features like this as we feel like these aren't the sort of connections we want to promote within the Discord, but maybe that ethos has altered somewhat. I'll keep this open and update with details.

Yeah, the environment in the server has changed from what I can tell at least.
I think the feature like best-friends would be fun. The wife-husband feature might be not favored, I guess.


port location doesn't support '/' separation as used for UHD

instead of location=chassis;card;port  if we give location =chassis/port it throws the below exception of not being able to split with ';'
self = <snappi_ixnetwork.vport.Vport object at 0x7f38b24b1fa0>, port = <snappi.snappi.Port object at 0x7f38b188b900>, imports = []
def _set_aggregation(self, port, imports):
    """ If the card has multiple resource group to control speed within port
    set it according to the speed"""

    resource_group = None
    location = port.location
    if location is None:
        return

  (hostname, cardid, portid) = location.split(';')

E       ValueError: not enough values to unpack (expected 3, got 1)
/usr/lib/python3.8/site-packages/snappi_ixnetwork/vport.py:247: ValueError

fixed per snappi[ixnetwork]==0.3.12


Compute Desmos Expressions from JavaScript

What if you could have JavaScript embedded into a graph that generates Desmos expressions at compile-time? This would be useful for lookup tables, 3D model importing, and a whole host of other common(ish) things.
This would be a huge security issue if not for the fact that we can just use iframes to sandbox everything. It didn't work for Figma because they had to pass around massive amounts of data in thousands of roundtrips per second. However, I don't think we have that issue. If that does ever become a problem, we might be able to try one of their other approaches.

More thoughts: Iframes still have the issue of allowing network requests, thus opening up the possibility of IP grabbers. Another option would be to use something like QuickJS, which is just a JS interpreter that we can run in a sandbox.
There's also the approach outlined in the Figma article of using the Realms shim, a polyfill for a TC39 proposal for "Realms", which appear to be sandboxed JavaScript execution contexts. However, there was a security issue discovered in Realms, so it might be better to just go with the quickjs interpreter if anything:

Update: Seems like Desmos doesn't really care about IP grabbers anyway (since it loads in any image from any site) so an iframe is probably good enough.


Create test types on parser registration instead of first scan import

Description
Automatically generate Test Types for all Scan Types upon Parser Registration.
Currently Test Types are only generated upon using the import scan API.
This introduces problems for us (SecureCodeBox) as we want to create Tests in advance and then use the reimport scan API.
More info can be found here: https://owasp.slack.com/archives/C014H3ZV9U6/p1620734079161800
Test results
manually tested if the test types are created automatically or not. Works as expected
Documentation
Did not update
Checklist
This checklist is for your information.

[x] Features/Changes/Bugfixes should be submitted against the dev branch by default.
[x] Make sure to rebase your PR against the very latest dev.
[x] Hotfixes should be submitted against master (urgent bugfixes requiring a hotfix release).
[x] Give a meaningful name to your PR, as it may end up being used in the release notes.
[x] Your code is flake8 compliant.
[x] Your code is python 3.6 compliant (specific python >3.6 syntax is currently not accepted).
[x] If this is a new feature and not a bug fix, you've included the proper documentation in the docs at https://github.com/DefectDojo/django-DefectDojo/tree/dev/docs as part of this PR.
[x] Model changes must include the necessary migrations in the dojo/db_migrations folder.
[ ] Add applicable tests to the unit tests.
[ ] Add the proper label to categorize your PR.

Are the changes in the initial surveys json necessary or can I undo that commit?

Are the changes in the initial surveys json necessary or can I undo that commit?

those should be ignored :-)

Are the changes in the initial surveys json necessary or can I undo that commit?

those should be ignored :-)

Done :)

On first time docker-compose up after docker-compose build your fix gives me errors because the table test_type does not yet exist

Took a look at the failed unit tests.
It seems that you will need to remove the fixture that manage Test_Type completely to make it work.
uwsgi_1         |
uwsgi_1         | During handling of the above exception, another exception occurred:
uwsgi_1         |
uwsgi_1         | Traceback (most recent call last):
uwsgi_1         |   File "/app/dojo/unittests/test_sample_data.py", line 10, in test_loaddata
uwsgi_1         |     self.assertEqual(False, True, e)
uwsgi_1         | AssertionError: False != True : Problem installing fixture '/app/dojo/fixtures/defect_dojo_sample_data.json': Could not load dojo.Test_Type(pk=4): (1062, "Duplicate entry 'Nessus Scan' for key 'name'")
uwsgi_1         |

The system try to load them

@JohannesZahn can you try to merge (or just mimic) the changes from https://github.com/DefectDojo/django-DefectDojo/pull/4437 ?

@valentijnscholten I merged the changes from #4437 as requested :) I will get back to this next tuesday.

Looks like dojo_testdata.json and dojo_sampledata.json also need to be cleaned up. But this leads to the problem that the fixture cannot load existing findings against know test_types.

@valentijnscholten I agree, our reference should be the id of the parser aka the name, or  scan_type as it is named and managed by the factory.
This identifier need to be consistent across instances and is linked to the code of the parser (the parser return it and the factory use it as a key to store/manage them)
What doesn't make sense for me and could be changed is the fixtures. We should completely get ride of fixtures because:

the factory insert in DB as it discover new parsers on-the-fly
adding and/or removing parsers is dynamic so we can't force the data in DB to be fixed
if we need an up-to-date list of these references for API or the UI, the code should query the factory to have this list

Downside would be that we would get varchar foreign keys. An alternative could be to degine an integer parser_id inside each parser. We could reserve 1-100000 for Defect Dojo, and instruct users to use 999999->downward for their custom non upstream parsers?

We will probably not need this as we are now using the new generic JSON parser. So I will close the PR for now.

@valentijnscholten

Downside would be that we would get varchar foreign keys. An alternative could be to degine an integer parser_id inside each parser. We could reserve 1-100000 for Defect Dojo, and instruct users to use 999999->downward for their custom non upstream parsers?

this key is only in Test and not in Finding so I guess the pb is smaller. Also you proposal is to switch to number instead of id in letter. I need to analyze that. Could be hard to change every parser and assign a number now that we maintain more than 120 parsers :D


Decrypt environment variables

Spring Boot can convert system environment in .properties (or .yml) file.
But Jasypt does not accept nested property convertion.
This commit allow the following configuration:
app.secret: ENV(${MY_VAR})

thanks for the PR but I think this is already supported without the need of any code. But instead of using:
app.secret: ENV(${MY_VAR})

you just do:
app.secret: ${MY_VAR:default_value}

and Spring will already interpolate environment variables

Sorry,
Error in my sample (not ENV but ENC)
The fixed sample:
app.secret: ENC(${MY_VAR})

The goal of this PR is to use encrypted environment variables.
I fix the commit message

I think the right way to do that would be to define your ENV var enclosed within ENC( and ) so you can do:
export MY_VAR="ENC(asdfas32452refsvsva8sd0f9as7df90)"

app.secret: ${MY_VAR}

it would be better than having to manually parse ${} expressions since those are actually customizable in spring and you'd only support that flavor. It could be done properly though if expressions within ENC() such as ENC(${var1:default}) are desired but I'd encourage you to look into class EncryptablePropertySource:
default Object getProperty(EncryptablePropertyResolver resolver, EncryptablePropertyFilter filter, PropertySource<T> source, String name) {
        Object value = source.getProperty(name);
        if (filter.shouldInclude(source, name) && value instanceof String) {
            String stringValue = String.valueOf(value);
            return resolver.resolvePropertyValue(stringValue);
        }
        return value;
    }

That return statement is basically what's unwrapping/decrypting values. If you wanna give it go you can try something like:
default Object getProperty(EncryptablePropertyResolver resolver, EncryptablePropertyFilter filter, PropertySource<T> source, String name) {
        Object value = source.getProperty(name);
        if (filter.shouldInclude(source, name) && value instanceof String) {
            String stringValue = String.valueOf(value);
            Object resolved = resolver.resolvePropertyValue(stringValue);
            String resolvedString = String.valueOf(resolved);
            return getProperty(resolver, filter, name);
        }
        return value;
    }

which would basically re-evaluate the value enclosed in ENC() but the code is incomplete, since  running getProperty again would lookup resolvedString in the actual property source but that resolved value may not be an actual property, so some investigation needs to be done to do that in a way that is compliant with Spring. Basically delegating to some Spring method instead of parsing strings ourselves

I was actually able to get this kind of behavior working modifying the DefaultPropertyResolver to resolve placeholders from the environment:
    @Override
    public String resolvePropertyValue(String value) {
        String actualValue = environment.resolveRequiredPlaceholders(value);
        if (detector.isEncrypted(value)) {
            try {
                String unwrappedProperty = detector.unwrapEncryptedValue(value.trim());
                String resolvedProperty = environment.resolveRequiredPlaceholders(unwrappedProperty);
                actualValue = encryptor.decrypt(resolvedProperty);
            } catch (EncryptionOperationNotPossibleException e) {
                throw new DecryptionException("Decryption of Properties failed,  make sure encryption/decryption " +
                        "passwords match", e);
            }
        }
        return actualValue;
    }

I'll be releasing this soon. Thank you for your support


Support for async membership providers

Proposal for #34 that adds the possibility to add asynchronous membership providers. Two new interfaces have been added:

A new base membership provider that is the base for both (sync and async) membership providers (so that registering it in the IoC container remains basically the same)
A new IAsyncMembershipProvider that offers an async endpoint

The PassCommandHandler checks the type of membership provider and performs either a synchronous or an asynchronous call to validate username and password.

I'm hesitant to add this yet, because I'd just change the IMembershipProvider member to async and bump the major version.


Varnish cache server

Hey,
It's be possible to add varnish cache container between reverse proxy and app containers ?

Hi.
This project (letsencrypt-nginx-proxy-companion) does not handle the actual proxying so you probably won't get the answer you are looking for here. nginx-proxy does and you should ask there instead.
If something is possible at all with nginx, it will probably be possible with nginx-proxy too (using a custom nginx.tmpl for docker-gen).


Plugin download doesn't work

Plugin downloading does not work in the application, as well as on the site.

2023-01-22.log

This issue is fixed now.


Fix UI control interactions on iOS

I was looking at Joy on my iPad and I noticed that some of the UI controls don’t work as intended on a desktop browser. For example, the numeric slider thing doesn’t activate correctly (the keyboard pops up when tapped, though).

The color picker can be clicked on, but not dragged around freely.

The item picking and text entry seems OK, though.

Hope this can be fixed.


Extended Circular Node not listed.

Greetings,
There is a strange little Issue, when I tested your Mod, none of the extra blocks is shown, I only got the other half of the halfstair now listed in the circular saw, but none of the "circular_saw_ext" blocks.

Funny part is, the ability to scroll in the circular saw stays, when you disable "circular_saw_ext" until you replace it.

It is pretty strange. Probably you use the most actual version of moreblocks. Because my addon code is based off older one and all microblocks are shown in the circular saw inventory. I will check out today this thing.
And yes, you need to replace it again if you disable the addon or add/remove some shapes. That happens because of the formspec for the circular saw is set once when it is placed, not after restart.

Yes I use the most up to date version of moreblocks, downloaded through the Minetest Engine itself,
same for the circular_saw_ext Mod.

Fixed: 9b97572501b7e6215dc1bd60e4bd994a0da48b29


Update to EH1.0alpha.8

While wanting to use this nice driver in embassy land, I noticed it's HAL version is slightly outdated. Perhaps we in this issue either update the dependency immediately (minor code changes in the driver as seen in this commit) or wait until E-H 1.0 is completely out, and update the driver then.
Thanks, and let me know what you think :)

Hi there! First of all,  thank you for your interest in the driver! That's really great to know someone would use it, especially within a cool project like Embassy, very happy about it.
At the moment I don't have access to my computer and I would like to test it myself before merging. If there's no rush, maybe a good idea would be to wait for the final version of the EH crate?

We had some fun integrating it with Embassy on an stm32l4s5 nucleo board. It was challenging not only because of the new e-hal traits, but also because the embassy traits didn't like the I2cInterface so much. This has changed in the mean time.
Let's wait until the 1.0 release, and hope the traits don't change too much until then, so that this PR can go in eventually :)
Btw, I think currently the doc tests are failing, topic for another fix, could use something like embedded-hal-mock.

OK, thanks for letting me know,  I also have some small improvements in mind, so that could all be done together. Good to know about the interface, as it's being employed in some other drivers as well. Let's wait for the 1.0 then.


ModuleNotFoundError: No module named 'torchvision.transforms.functional_tensor'

Please solve step by step
Traceback (most recent call last):
File "/content/Real-ESRGAN/inference_realesrgan_video.py", line 10, in
from basicsr.archs.rrdbnet_arch import RRDBNet
File "/usr/local/lib/python3.10/dist-packages/basicsr/init.py", line 4, in
from .data import *
File "/usr/local/lib/python3.10/dist-packages/basicsr/data/init.py", line 22, in
_dataset_modules = [importlib.import_module(f'basicsr.data.{file_name}') for file_name in dataset_filenames]
File "/usr/local/lib/python3.10/dist-packages/basicsr/data/init.py", line 22, in
_dataset_modules = [importlib.import_module(f'basicsr.data.{file_name}') for file_name in dataset_filenames]
File "/usr/lib/python3.10/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "/usr/local/lib/python3.10/dist-packages/basicsr/data/realesrgan_dataset.py", line 11, in
from basicsr.data.degradations import circular_lowpass_kernel, random_mixed_kernels
File "/usr/local/lib/python3.10/dist-packages/basicsr/data/degradations.py", line 8, in
from torchvision.transforms.functional_tensor import rgb_to_grayscale
ModuleNotFoundError: No module named 'torchvision.transforms.functional_tensor'

The torchvision.transforms.functional_tensor module is deprecated in 0.15 and will be removed in 0.17. Please don't rely on it. You probably just need to use APIs in torchvision.transforms.functional or in torchvision.transforms.v2.functional.

you need to install a specific version of pytorch

python -m pip install torch==2.0.1 torchvision==0.15.2 --extra-index-url https://download.pytorch.org/whl/cu118
After that, it should work correctly.

This might be caused by the modification of this module name. I opened the same issue in BasicSR project. In some specific versions of pytorch, for this module name there is a "_" in front of "functional". That‘s why changing the version of pytorch could solve this issue.

Just because BasicSR doesn't get ready for torchvision >= 0.17
I found this and edited the basicsr/data/degradations.py file, then the issue solved.

you need to install a specific version of pytorch

python -m pip install torch==2.0.1 torchvision==0.15.2 --extra-index-url https://download.pytorch.org/whl/cu118

After that, it should work correctly.

ERROR: Could not find a version that satisfies the requirement torch==2.0.1 (from versions: 2.2.0, 2.2.1, 2.2.2)
ERROR: No matching distribution found for torch==2.0.1

@m4ra7h0n you should try older version of python.

C:\Users\ user-name \anaconda3\envs\ envs-name \Lib\site-packages\basicsr\data\degradations.py
line 8:
from torchvision.transforms.functional_tensor import rgb_to_grayscale
to:
from torchvision.transforms._functional_tensor import rgb_to_grayscale

It need to be updated because the AI world is continiously evolving and there are always new versions and solutions for everything. Now xformers requires torch==2.2.2 and it cannot be installed with torch==2.0.1
So the outdated realesrgan is the real problem.

C:\Users\ user-name \anaconda3\envs\ envs-name \Lib\site-packages\basicsr\data\degradations.py
line 8: from torchvision.transforms.functional_tensor import rgb_to_grayscale to: from torchvision.transforms._functional_tensor import rgb_to_grayscale

This worked for me, but with miniconda: /Users/[user-name]/miniconda3/lib/python3.12/site-packages/basicsr/data/degradations.py.

Hi! Modifying the library code, as suggested in the answer by @PhielAi on Apr 9, is not ideal, and locking to specific versions can also introduce limitations. Instead, you can handle the missing function without changing the library code directly.
Here’s an approach that dynamically adds the rgb_to_grayscale function into the torchvision.transforms.functional_tensor module:
import sys
import types
from torchvision.transforms.functional import rgb_to_grayscale

# Create a module for `torchvision.transforms.functional_tensor`
functional_tensor = types.ModuleType("torchvision.transforms.functional_tensor")
functional_tensor.rgb_to_grayscale = rgb_to_grayscale

# Add this module to sys.modules so other imports can access it
sys.modules["torchvision.transforms.functional_tensor"] = functional_tensor

This approach makes the missing function available where it’s expected, without requiring any modifications to the library code itself. It's especially useful for introducing back functions that may have been removed in recent library updates, providing a clean and maintainable solution.


Rustic rustdoc

From https://github.com/brotzeit/rustic/issues/137
This is a first attempt at merging in rustdoc. I have purposefully not changed much so details can be discussed.

The prefix name rustdoc is still used everywhere. Should it be changed to rustic or something else?
In the thread @brotzeit mentions making this optional - how would that work? (This is my first time writing a package so still new to this). The way it is now, rustdoc-mode is available but not automatically enabled at any point when you install rustic, so the user has to activate the minor mode themselves.

Feedback welcome!

Sorry, I forgot to finish this because I've been trying to get remacs working again. I will finish this the next days.

Let's merge this ok ?

@samhedin it would be great if you are motivated to help me as collobarator.

@brotzeit It should be ready to merge now! I still feel new to all of this, but I am motivated to help in any way I can.

@brotzeit It should be ready to merge now! I still feel new to all of this, but I am motivated to help in any way I can.

Thanks!
However most features are provided by lsp. If you are interested in improving your elisp skills and want to help beyond rustic, I would suggest that you join the lsp-mode channel. lsp-mode and lsp-ui are crucial for most rustic users and by now the community around the organization has become quite active and it's really fun to participate. If you want to join the project, just ask yyoncho.


RU: settings descriptions, removal of legacy settings

Not all descriptions are translated yet, but should be safe to merge.
More translations coming soon.
Legacy settings removed and some new settings fixed to clear CI fail on ru.json.

Thank you for the update!


Update RTD config

Replaces #483 to enable testing if the docs are still built successfully by RTD.
How to review

Read the diff and note that the CI checks all pass.
Build the documentation and check that it works as usual (also on RTD).

PR checklist

[x] Continuous integration checks all ✅

The build on RTD is failing with a note that the pytest module is not available. Each module should presumably only appear in pyproject.toml once, so it is not an option to add pytest to [docs]. Simply switching to [tests] is the status quo, adding [tests] to [docs] creates a circular import and seems weird: why do the docs need pytest?
Technically, this happens because in conf.py, ixmp.testing is imported, based on its commit history so that 'autodoc can find code'. I'm wondering what happens when this line is removed.

The build on RTD is successful now and looks good to me: https://docs.messageix.org/projects/ixmp/en/update-rtd-config/

Note what appears in this section in the docs built from main: https://docs.messageix.org/projects/ixmp/en/latest/api.html#module-ixmp.testing —on the current branch, with ixmp.testing not available to Sphinx, the documentation for this part of the API is missing.
I will try to come back to this soon and suggest a fix.

I see, I was wondering if there were special parts like this that needed the import line. So I've tried to take a closer look at this: there are ways to recursively find and document all submodules of a package, primarily through the :recursive: option of the autosummary extension. See also this long answer on how to use it. Unfortunately, it seems to me that you can only use it to detect all modules and them have them all summarized, contrary to our structure in  api.rst of presenting some submodule, adding some text, and presenting the next submodule.
Within api.rst, there are two mentions of ixmp.testing. One as the :currentmodule:, which should not influence the build process. The other is as part of :autodoc:, which does issue a warning that all modules to be documented are imported as well. This leads to our problem since testing/__init__.py includes several pytest hooks that require pytest to be imported.
The cleanest solution, then, seems to be to move these pytest hooks to another location so that import pytest is no longer required in ixmp.testing. For that, it would be useful to understand: why do we have a testing and a tests directory? And what depends on the pytest hooks being in testing (also cf message_ix, where there are no pytest fixtures in testing/__init__.py)?
While this option does seem particularly clean to me, it could also imply scope creep and might take longer than adding some line to the sphinx config.

For that, it would be useful to understand: why do we have a testing and a tests directory? And what depends on the pytest hooks being in testing (also cf message_ix, where there are no pytest fixtures in testing/__init__.py)?

You're on the right track here.

ixmp/tests/ contains the actual tests.
ixmp/testing/ contains, as the docs section implies, utilities for testing. In other words, these are fixtures, functions, hook implementations, other tools, etc. that help with writing tests that are simple and clear. Some of these are used in downstream packages, so must be importable.

Having a .testing submodule is a practice that emulates high-quality upstream packages: numpy, pandas, xarray, etc.
Note that conftest.py names ixmp.testing: https://github.com/iiasa/ixmp/blob/f348a6b35ffff61297970bca6ba5fd63553a019b/conftest.py#L1
…and so do the corresponding files in message_ix, message-ix-models, etc.
These mean that:

All of the pytest hooks defined by those modules are loaded, and
All of the pytest fixtures defined by those modules are available.

In addition, downstream code can import and use the utility functions as it likes.
Anyway, the upshot of all of this is: ixmp.testing and its contents should be documented for reference by users and developers of both ixmp and the downstream packages which depend on it. This is why it has its section in the documentation.
As for a fix, I think the simplest is to keep .readthedocs.yaml as it was, and add a comment:
install:
- method: pip
  path: .
  # NB we use "tests" here, not "docs", so that ixmp.testing can be imported and its
  # contents documented. Users may build the docs with only ``ixmp[docs]`` installed,
  # but that section will appear empty.
  extra_requirements: [tests]

Or, second simplest, change the dependencies in pyproject.toml:
docs = [
  "ixmp[tests]",
  "GitPython",
  "numpydoc",
  "sphinx >= 3.0",
  "sphinx_rtd_theme",
  "sphinxcontrib-bibtex",
]
report = ["genno[compat,graphviz]"]
tutorial = ["jupyter"]
tests = [
  "ixmp[report,tutorial]",
  "memory_profiler",
  "nbclient >= 0.5",
  "pretenders >= 1.4.4",
  "pytest >= 5",
  "pytest-benchmark",
  "pytest-cov",
]

Thanks for the explanation. Of these, the second option seems cleaner to me. I wasn't sure if the tests would still run when only [tests] is installed, but it seems to work (there are two errors, but they don't look related to something missing from [docs]). So I'll push a commit here and we'll see if the tests pass and if the docs can be built on RTD.

All tests fail because in the workflow file, we only install [tests], where I have now removed the dependency on [docs]. But changing the workflow file to install [docs] should fix this and this way might be preferable since the imports on the user-facing side work as expected.

The tests are passing again and RTD also builds the docs without complaint, but the resulting docs still don't show the missing section. I'm not too sure what's going on, especially since for ixmp.utils, the same does work and I can't quickly find a major difference between the two submodules with respect to building the docs, so I don't know why we should have to import ixmp.testing explicitly in conf.py, but not ixmp.utils.

When I delete everything in doc/_build, checkout this branch and run sphinx-build -T -E -d _build/doctrees-readthedocs -D language=en . _build/html, the docs do include the missing section. I'm wondering whether RTD uses some sort of a cached version of the doc pages since the latest commits only change pyproject.toml and the workflow file.

Now they also do on RTD. Maybe when I was checking them out yesterday that was too soon after the prior run so I was still directed to the former version?
Either way, I think this PR is ready to be merged now.

Sounds good, thank you :)


*cdkDragPreview directive is not updating when parent has ChangeDetectionStrategy.OnPush

Bug, feature request, or proposal:
Bug (or proposal)
What is the expected behavior?
*cdkDragPreview should update with OnPush change detection strategy (or there should be a note about this in the docs)
What is the current behavior?
*cdkDragPreview directive is not updating when parent has OnPush change detection strategy.
What are the steps to reproduce?
https://stackblitz.com/edit/angular-pwtsl2?file=app/cdk-drag-drop-custom-preview-example.ts
Which versions of Angular, Material, OS, TypeScript, browsers are affected?
@angular/cdk: 7.0.2
Typescript: 3.1.3
Chrome: Version 70.0.3538.77 (Official Build) (64-bit)
Ubuntu 18.04

Will be fixed by https://github.com/angular/material2/pull/13703.


Wrong pin in library vs documentation for PATCH_SM?

The datasheet for the SM (https://www.electro-smith.com/s/ES_Patch_SM_datasheet_v103.pdf) indicates that the I2C1_SCL pin is PB8 but the define in the library indicates that it is PB7:
https://github.com/electro-smith/DaisyDuino/blob/389ee9540e77e1f3d3294f0a82a6d28bec2f6459/src/daisy_patch_sm.h#L34

@m00dawg Good catch! Thanks for the bug report


allow filtering queries

There's nothing beyond SELECT a, b, c FROM table; + joins yet

So we have:

SELECT a, b, c FROM table; + joins
SELECT a, b, c FROM table WHERE id = ?; + joins

This issue is about:

SELECT a, b, c FROM table WHERE ?

I think we can take prisma as inspiration for what complex queries could look like, as they already have everything required in their typescript API, and use objects (which map nicely to graphql) for a lot of it.
I'm imagining this for example:
{
  users(where: {
    email: {
      contains<EMAIL_ADDRESS>    },
    OR: [
      {
        organization: {
          plan: {
            id: { equals: "123456" }
          }
        }
      },
      {
        team: { plan: {
          id: { equals: "123456" }
        } }
      }
    ]
  }) {
    id
    email
  }
}

For which there could be a lot of syntactic sugar / shortcuts in the future:
{
  users(where: {
    email: { contains<EMAIL_ADDRESS>},
    OR: [ organization_plan_id: { equals: "123456" }, team_plan_id: { equals: "123456" } ]
  }) {
    id
    email
  }
}

For simple cases like "these two fields equal these two values", this could be nice:
{
  users(matching: {
    plan: "123456",
    settings_planIsPublic: true
  }) {
    id
    email
  }
}

These are just some ideas I had, there's probably still a lot of room for improvement here.

...adding onto those thoughts: when combining where and matching, it should use AND. Hence, the first example could be simplified to the following with the _ field accessor syntactic sugar from example 2:
{
  users(
    matching: { organization_plan_id: "123456", team_plan_id: "123456" },
    where: { email: { contains<EMAIL_ADDRESS>} }
  ) {
    id
    email
  }
}


Handling numbers must be culture-independent

This fixed reading and writing double values in RDF, when culture defines a non-standard decimal point. For example Polish uses a comma instead of a period.
Excuse my setting the Thread.CurrentThread.CurrentCulture to some arbitrary value. If there's a proper way to with xUnit please let me know

Closing in favour of #14


Modify the FFI library, apply to loongson platform

Need nan library and node-gyp library to support,before  compilation.
Can you try again,we need to integrate the node-ffi library in out platform.


Question about 1.19.2

Is a 1.19.2 build planned or can it not be done?

Nope, this port is not planned, but anything can be done, the question is how much it is wanted

It Would be cool if a 1.19.2 Port would be made
On Wed, 21 Aug 2024, 8:16 pm Wilyicaro, @.***> wrote:

Closed #556 https://github.com/Wilyicaro/Legacy-Minecraft/issues/556 as
completed.
—
Reply to this email directly, view it on GitHub
https://github.com/Wilyicaro/Legacy-Minecraft/issues/556#event-13964643866,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BKOTDGFOTNG6N6LMTBJLJJLZSTKN7AVCNFSM6AAAAABMKSOQ76VHI2DSMVQWIX3LMV45UABCJFZXG5LFIV3GK3TUJZXXI2LGNFRWC5DJN5XDWMJTHE3DINRUGM4DMNQ
.
You are receiving this because you authored the thread.Message ID:
@.***>

Well im a 1.19.2 so might be cool


Lib not working with Gluu 4.2

I recently updated Gluu from v4.1 to v4.2 : it broke my application because scim-node cannot discover Gluu SCIM config anymore.
After some time, I figured out that Gluu 4.2 does not expose /.well-known/scim-configuration endpoint anymore. I don't know if it is a bug or a feature, but I could not find the endpoint for scim-configuration anywhere in oxauth, oxtrust, scim or nginx container (I use docker version on Debian).
As a workaround I forked this repo and I hardcoded SCIM configuration in the getSCIMConfigurations method but this does not seem to be a proper solution.
Is there a way to solve this properly, by updating this lib or by fixing Gluu ?

I had an answer from Gluu support : it seems like a Gluu related issue.
https://support.gluu.org/identity-management/8971/missing-well-knownscim-configuration-endpoint/


Command 'Transpose words' does not work as expected

a) Launch the demo
b) Input ßeta / δelta__
c) Press Meta-T
Expected δelta__ / ßeta, got ßeta δelta__ /

It appears the readline command behaves as you expect, as well. I was not aware that readline looked for non-symbol words when transposing. I'll work on a fix for this.

Correction: This is not a bug. It's simply that the default set of word break characters (indicated here in GNU Readline documentation) does not include / and therefore considers / to be a word. If one inputs ßeta | δelta__ instead (| being within the default set of word break characters), the behavior is as expected.


Postgis plugin error: Layer fails on Tileoven but works on Tilemill

I have a layer with a Postgis query that works on Tilemill, but fails in Tileoven.
Here's the error:
Postgis Plugin: ERROR:  syntax error at or near "WHERE"
LINE 1: SELECT ST_SRID("way") AS srid FROM   ( WHERE "way" IS NOT NU...
                                               ^
in executeQuery Full sql was: 'SELECT ST_SRID("way") AS srid FROM 		( WHERE "way" IS NOT NULL LIMIT 1;'
  encountered during parsing of layer 'barrier_points' in Layer

Here's the query:
( SELECT way, 'barrier' AS type,
	( select degrees(ST_Azimuth(ST_StartPoint(inter), ST_EndPoint(inter))) from
		( select ST_Intersection(r.way, ST_Buffer(p.way, 100)) as inter
			from planet_osm_line r
			where r.highway in ('motorway', 'trunk', 'primary','secondary', 'tertiary', 'residential', 'service', 'track', 'path', 'cycleway', 'footpath','unknown')
			and r.way && ST_Buffer(p.way, 100) order by ST_Distance(r.way, p.way) limit 1 ) rr )
	as angle
	FROM planet_osm_point p
	WHERE barrier IN ('gate', 'yes') )
AS data

Any ideas why?

It seems the error comes directly from mapnik. The call to
source = new mapnik.Datasource(mml.Layer[0].Datasource);
in Datasource.server.bones fails. This is a native function, so I'm out of ideas here. Maybe create a Postgres View?


Improve filtering for SP Completed dashboard

The Completed cases dashboard for SP should now include referrals which:

have their End of Service Report submitted
or were cancelled with at least feedback submitted for their supplier assessment
or were cancelled with at least an action plan submitted

The other dashboards now filter on concludedAt rather than EOSR to prevent some cancelled referrals being included.
Notes:
This is based on a conversation with Leigh where he provided the following table:

This shows that we should be including some cancelled referrals in the Completed cases. intervention service does the filtering so only the correct cancelled referrals will be returned.

erugh all this stuff is so complicated isn't it. is there somewhere all these rules are presented in a friendly format, like on confluence, or in the readme of this repo?

Once we switch over to pagination, they will be more neatly encapsulated in the ReferralSpecifications class; each rule can be it's own method. We currently have cancelled already defined in this class.