Request for CCL module on NERSC

Some NERSC users have had difficulties installing CCL and have suggested that there should be a request for it to be made a module on that system. It should be a matter of just getting sufficient people with NERSC accounts to request that it be turned into an environment module.

There is now a central installation of CCL 0.2 at NERSC on Cori using NERSC's  gsl, fftw and swig in:
/global/common/cori/contrib/lsst/ccl/0.2
There were some tweaks required to the vanilla environment.  The Python wrappers are also set up in a Python2 conda environment named CCL.  There are two set up files available for those who might want to try this out.  To use the CCL C installation:
source /global/common/cori/contrib/lsst/ccl/setupCCL.sh
and the python wrappers are available here:
source /global/common/cori/contrib/lsst/ccl/setupPyCCL.sh

The above NERSC installation could be used as the base for a module file:
http://www.nersc.gov/users/software/nersc-user-environment/modules/#toc-anchor-3
One of the NERSC folks suggested that setting up a Docker/Shifter image might be a better way to go but I think that really may depend on your use case - if this is for interactive use or batch jobs.
I can attempt to make a module file and see what happens :)

@heather999 Can this issue be closed? Do we have a working CCL module in NERSC?

@heather999 I recently got an account at NERSE and try to use the central installed CCL at NERSCE or install CCL on my own. After doing
source /global/common/cori/contrib/lsst/ccl/setupPyCCL.sh
I can compile and run, e.g., tests/ccl_sample_run.c with the central installed CCL.
I however fail to install CCL to an assigned path.
I first do
source /global/common/cori/contrib/lsst/ccl/setupCCL.sh,
then
./configure --prefix=/global/homes/w/weikang/CCL_LIB,
and it looks fine.
But when I do make, an error shows up as
/usr/bin/ld: attempted static link of dynamic object `/global/homes/w/weikang/DESC/CCL/.libs/libccl.so'.
Did I miss something? Thank you in advance.

So this is the reason why it complains: http://www.nersc.gov/users/computational-systems/edison/running-jobs/shared-and-dynamic-libraries/
But you can solve it just doing export CFLAGS="-dynamic" before ./configure --prefix=/YOUR/PATH/TO/INSTALL and it should work :)

@fjaviersanchez Thank you very much for your response. After doing export CFLAGS="-dynamic", I still have problem:
/usr/bin/ld: /usr/lib64/libmvec_nonshared.a(svml_finite_alias.oS): relocation R_X86_64_PC32 against undefined symbol `_ZGVbN2v_log@@GLIBC_2.22' can not be used when making a shared object; recompile with -fPIC
/usr/bin/ld: final link failed: Bad value

Any suggestions?

that looks like you are using the gnu programming environment and it is complaining. You can try to do make clean first and module swap PrgEnv-gnu PrgEnv-intel and try again to do the export CFLAGS... and ./configure

With @fjaviersanchez 's help, I get CCL installed on NERSC at an assigned location using NERSC's gsl, fftw and swig. The following could be done before trying to install CCL:

module load gsl/2.1
module load fftw
module load swig
export LDFLAGS+="-L$GSL_DIR/lib -L$FFTW_DIR"
export CPPFLAGS+="-I$GSL_DIR/include -I$FFTW_DIR/../include"

The current version of glibc on nersc doesnt work with the 6.x gcc due to a
bug in glibc.
swap GCC  to 5.x shall fix this too if you don't want use Intel compiler.
On Sep 13, 2017 10:57 AM, "fjaviersanchez"<EMAIL_ADDRESS>wrote:
that looks like you are using the gnu programming environment and it is
complaining. You can try to do make clean first and module swap PrgEnv-gnu
PrgEnv-intel and try again to do the export CFLAGS... and ./configure
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/LSSTDESC/CCL/issues/233#issuecomment-329247698, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAIbTD1Y5IHfciGPUi6YnqDsPDYK_vXMks5siBeNgaJpZM4OWL7u
.

@elisachisari I'm sorry to say while there is an installation of CCL at NERSC, there is no module file.  It might be nice to have that set up, but it is also not necessarily required.  I will contact @damonge and try to push on.

@WeikangLin & @fjaviersanchez  I am still catching up.  So the central installation of 0.2 works? I just want to make sure that it is ok. The setup indicated above is very close to what we have in /global/common/cori/contrib/lsst/ccl/setupCCL.sh, however I used gnu, rather than intel. When using the gsl module, it is my understanding that we cannot use gcc directly, but rather call cc instead:

On Cori or Edison if you want to use the gcc compiler and GSL you must swap the modulefiles for the programming environments.  DO NOT invoke gcc directly.

http://www.nersc.gov/users/software/programming-libraries/math-libraries/gsl/
So I export CC=cc in the setupCCL.sh file and things seemed to be ok.
However you were having trouble building your own CCL at NERSC (which version?) but it sounds like that is now working.  We could provide a similar script that sets up the NERSC environment to allow others to do their builds as well.. maybe something like cclInstallEnv.sh. That might be useful to developers if they're going to building at NERSC.

Thanks @heather999. The central installation of 0.2 works for me. Upon logging in NERSC (cori), I do source source /global/common/cori/contrib/lsst/ccl/setupPyCCL.sh. I can then compile tests/ccl_sample_run.c by gcc -Wall -Wpedantic -g -I$CCL_NERSC_DIR/$CCL_NERSC_VER/include $CPPFLAGS -std=gnu99 -fPIC tests/ccl_sample_run.c -o tests/ccl_sample_run -L$CCL_NERSC_DIR/$CCL_NERSC_VER/lib $LDFLAGS -lgsl -lgslcblas -lm -lccl and run it. I however used gcc instead of cc to compile the code. But if I do source source /global/common/cori/contrib/lsst/ccl/setupCCL.sh and try to compile, I have a problem when trying to run ./tests/ccl_sample_run: tests/ccl_sample_run: error while loading shared libraries: libccl.so.0: cannot open shared object file: No such file or directory. Probably export LD_LIBRARY_PATH=/opt/cray/pe/pmi/5.0.10-1.0000.11050.0.0.ari/lib64:$CCL_NERSC_DIR/$CCL_NERSC_VER/lib:$LD_LIBRARY_PATH is missing?
If I want to install CCL in a specific path, I had problems. Originally, Upon logging in NERSC, I did source source /global/common/cori/contrib/lsst/ccl/setupCCL.sh, but an error showed up when I came to make as /usr/bin/ld: attempted static link of dynamic object /global/homes/w/weikang/DESC/CCL/.libs/libccl.so'`. I am using the version in the current master branch in the CCL repository.
With @fjaviersanchez 's help, I found that the above five steps works for me. It doesn't have module swap PrgEnv-intel PrgEnv-gnu, so I guess I am using intel. It doesn't have export CC=cc, and probably because I am using intel as well? And I also need to add the fftw/include path to CCPFLAGS.
A script for installing CCL sounds good. I will appreciate it.

CCL is accessible on NERSC now and this issue is outdated, so this is being closed.


feat(test): add e2e test for timeout on config

This PR adds an E2E test to simulate timeout being part of the config
Needs to be merged after (#11)

Can we land this?


Socket connection abruptly cut off:  Network.Socket.connect: <socket: 13>: does not exist (Connection refused)`

While running the cardano-tx-generator against a small Shelley cluster, the following error happens -- pretty well into the node-to-node-submission phase:
cardano-tx-generator-byron: Network.Socket.connect: <socket: 13>: does not exist (Connection refused)

Reproduction:

cardano-benchmarking commit cc89b8cd216a8da4d21e9185a8d5e2553bfb1d6e
./benchmarks/cluster3nodes/start.sh --nix --shelley --no-rtview --no-delegate

generator-20200616211005.json.txt
node1-20200616210930.json.txt
node1-20200616211140.json.txt
node2-20200616210930.json.txt
node3-20200616210930.json.txt

node-1
{"at":"2020-06-16T21:12:05.94Z","env":"1.13.0:00000","ns":["cardano.node.ErrorPolicy"],"data":{"event":"ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError {errorType = MuxIOException Network.Socket.recvBuf: resource vanished (Connection reset by peer), errorMsg = \"(recv errored)\", errorStack = []}))) 20s 20s","kind":"ErrorPolicyTrace","address":"<IP_ADDRESS>:47014"},"app":[],"msg":"","pid":"7431","loc":null,"host":"andromed","sev":"Warning","thread":"72"}

node-2
{"at":"2020-06-16T21:12:05.94Z","env":"1.13.0:00000","ns":["cardano.node.ErrorPolicy"],"data":{"event":"ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError {errorType = MuxIOException Network.Socket.recvBuf: resource vanished (Connection reset by peer), errorMsg = \"(recv errored)\", errorStack = []}))) 20s 20s","kind":"ErrorPolicyTrace","address":"<IP_ADDRESS>:58262"},"app":[],"msg":"","pid":"7399","loc":null,"host":"andromed","sev":"Warning","thread":"58"}

node-3
Nothing strange around 21:12:05
generators
Log ends before 21:12:05.94

@coot The log line pasted for node-1 is incorrect, that line is from node-2 too.
node-1 log ends just before the node-2 recv error.


Tox and pylint integration

Tox and pylint integration. tox.ini and .pylinrc files added.
Linting applied to the code.
lecli.py module renamed to cli.py.
load_config moved into functions for unit testing.

@StephenHynes7 @scawley-r7

+1


test

Ⅰ. Describe what this PR did
Ⅱ. Does this pull request fix one issue?

NONE
Ⅲ. Describe how you did it
Ⅳ. Describe how to verify it
Ⅴ. Special notes for reviews

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.luoqing.lq seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Can't use arrow keys to select options in Git Bash when running vue create my-project

Version
3.0.0-rc.11
Node and OS info
Node 8.11.2 / npm 5.6.0 / Windows 10
Steps to reproduce
In Git Bash:
$ vue create my-project
This produces the following output:
? Please pick a preset: (Use arrow keys)
> default (babel, eslint)
  Manually select features

Using the arrow keys does not move the angle bracket selector,  but just moves the cursor up and down, which can be moved anywhere on the screen. Pressing down once does result in selecting "Manually select features" but without visual feedback.
What is expected?
Angle bracket selector should move up and down with arrow keys.
What is actually happening?
Angle bracket selector does not move. Cursor moves but is free floating and there is no visual feedback to show you the current selection.

The default Git Bash is not an interactive terminal. You need to use something that is actually interactive.

You are God sent thank you

Thank you

This console emulator will have arrows working properly
https://cmder.net/

Windows PowerShell also works.

Thanks

The default Git Bash is not an interactive terminal. You need to use something that is actually interactive or use winpty vue.cmd create hello-world

Thanks man

λcmder is so cool, man!

thanks sir.

The default Git Bash is not an interactive terminal. You need to use something that is actually interactive or use winpty vue.cmd create hello-world

thank bro

It worked perfectly

"The default Git Bash is not an interactive terminal."
Is there a setting to make Git Bash works as interactive?
I have Git Bash installed on two machines with Windows 10.
In the old machine, the arrows works when I issue yarn create astro, for example. But on the new machine it stoped working...

You can just open it also from vs code and run the commands from the terminal directly there.


Increase the JVM heap size for Gradle

Hi owner,
Here are 3 minor changes for Andorid building. Would you accept it?
[Increase the JVM heap size for Gradle]
[Why]
The Java Virtual Machine(JVM) maximum heap size(-Xmx) is 512M by default. It will occur out of memory eror when compiling for Android.
Android compiling error: "java.lang.OutOfMemoryError: Java heap space".
[How]
Configure JVM memory for Gradle by setting Gradle property org.gradle.jvmargs in gradle.properties file.
This gradle.properties file was generated by Android Studio settings.
Reference:
https://developer.android.com/build/optimize-your-build?utm_source=android-studio#increase-the-jvm-heap-size
https://docs.gradle.org/7.2/userguide/build_environment.html#sec:configuring_jvm_memory
[Migrate jcenter to mavenCentral]
[Why]
JFrog made JCenter a read-only repository on March 31, 2021.
[How]
Migrate JCenter to Maven Central.
Reference: https://developer.android.com/build/jcenter-migration
[Update BUILD.md for building on Android]

Hi owner,
Could you delete this PR history? It seems it contains my private info. I'd like to delete this PR history. Thanks!


Transparent compression of stored values

I needed to automatically compress values being passed to predis to reduce network utilization.
Searched google a lot, but found nothing to plug in and use.
So today I wrote predis plugin with this functionality and I'm here to present it to you: https://github.com/b1rdex/predis-compressible
I implemented it for SET and GET for now (to cover my use case).
Please review/test and I'm open for comments and requests for changes.
ps: predis internal architecture seems complicated, but it's really good once I figured out internal data flow.
One thing that dissapointed me — Processor can't affect command's parseResponse, only arguments of command. Maybe it would be better to add setResponse, setRawResponse, filterResponse and getResponse to Command instead of just parseResponse.
Imagine you need to add compression + some HMAC or any other plugin that affects response and here is problem. There is ProcessorChain, but it only can change arguments, not responses.
Because of this you can't use more than one plugin that changes responses parsing because you need to redefine parseResponse.
Another option I can suggest is adding events system to be able to change input/output at any step of execution, but this would require even bigger architecture changes.

@b1rdex just to let you know that you comment actually gave me quite a bunch of vague ideas to experiment with in this respect for the next v2.0 in which we already have quite a lot of changes anyway.
An event system would probably be overkill though. All in all the architecture of Predis is a balance of convenience, extensibility and run-time performances (it's still a pure-PHP client implementation so we can't just add too much stuff) so compromises have always played a big part in the internal design of this library.

Ok man, glad to know you saw this.
8 окт. 2017 г. 18:19 пользователь "Daniele Alessandri" <
<EMAIL_ADDRESS>написал:

@b1rdex https://github.com/b1rdex just to let you know that you comment
actually gave me quite a bunch of vague ideas to experiment with in this
respect for the next v2.0 in which we already have quite a lot of changes
anyway.
An event system would probably be overkill though. All in all the
architecture of Predis is a balance of convenience, extensibility and
run-time performances (it's still a pure-PHP client implementation so we
can't just add too much stuff) so compromises have always played a big part
in the internal design of this library.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/nrk/predis/issues/444#issuecomment-334990947, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AATGF4k5hEPfQYVqv3k12eRuyGB4aiXzks5sqIWfgaJpZM4N4bbP
.


Apps are hashed for memo in two different ways

Describe the bug
Two different mechanisms are used for hashing app functions for memoization.
The task_record['fn_hash'] value is computed as self.func_hash = md5(self.fn_source.encode('utf-8')).hexdigest() in parsl/app/app.py.
The function is also hashed using the id_for_memo method, because the app function gets passed to a wrapper inside parsl and so is hashed as an argument to that wrapper. Issue #1591 describes issues related to that.
Expected behavior
Different methods of generating a hash lead to different rules for identity of apps between runs. There should be a single rule in use, probably whatever the rule used for id_for_memo is, and the separate fn_hash computation should go away.

Fixed by #1945


[SPARK-17363][ML][MLLib] fix MultivariantOnlineSummerizer.numNonZeros

What changes were proposed in this pull request?
fix MultivariantOnlineSummerizer.numNonZeros method,
return nnz array, instead of  weightSum array
How was this patch tested?
Existing test.

Test build #64792 has started for PR 14923 at commit 242b4ba.

Test build #64792 has finished for PR 14923 at commit 242b4ba.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64792/
Test FAILed.

Test build #64857 has started for PR 14923 at commit be59825.

Test build #64858 has started for PR 14923 at commit cea5cdf.

Test build #64857 has finished for PR 14923 at commit be59825.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64857/
Test PASSed.

Test build #64858 has finished for PR 14923 at commit cea5cdf.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64858/
Test PASSed.

Merged to master too


Feature/hide tabbar when only video or photo

I added tabBarHidden as optional argument.
I had to rename the App packages because of a manifest Dex error

I'm going to release a new version ASAP, thank you so much sir ! :)

Hello @msuhl,
I know that it has been sooo long but finally, I've added your tabBarHidden feature to the library. I could not accept your PR because of too many unnecessary edits. I've added your contribution on the new release:
Release: 0.1.5


[Bug]: error while loading shared libraries: libatk-1.0.so.0: cannot open shared object file: No such file or directory

Minimal, reproducible example
import puppeteer from "puppeteer";

const browser = await puppeteer.launch({
        headless: false,
	args: ['--no-sandbox', '--disable-setuid-sandbox'],
		defaultViewport: null,
	});

const page = await browser.newPage();
await page.setUserAgent('Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36');

Background
No response
Expectation
works without error
Reality
error while loading shared libraries: libatk-1.0.so.0: cannot open shared object file: No such file or directory
Puppeteer configuration file (if used)
No response
Puppeteer version
23.7.1
Node version
18.20.4
Package manager
npm
Package manager version
10.9.0
Operating system
Linux

See https://pptr.dev/guides/system-requirements and please make sure you have system dependencies installed. The error indicates that libatk is missing.


CLOUD-674 add info about build platform

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Test name
Status

recreate
passed

upgrade-haproxy
passed

restore-to-encrypted-cluster
passed

demand-backup
passed

pitr
failed

commit: https://github.com/percona/percona-xtradb-cluster-operator/pull/1093/commits/a6c1ebed3e82ae7bb79f69c7f0550f82475afc11
image: perconalab/percona-xtradb-cluster-operator:PR-1093-a6c1ebed

Test name
Status

scheduled-backup
passed

haproxy
passed

upgrade-haproxy
passed

recreate
passed

init-deploy
passed

restore-to-encrypted-cluster
failed

upgrade-proxysql
passed

limits
passed

smart-update
failed

demand-backup
failed

monitoring-2-0
passed

affinity
passed

one-pod
passed

auto-tuning
passed

upgrade-consistency
passed

proxysql-sidecar-res-limits
passed

users
failed

tls-issue-self
passed

pitr
passed

tls-issue-cert-manager
passed

tls-issue-cert-manager-ref
passed

validation-hook
passed

demand-backup-encrypted-with-tls
passed

commit: https://github.com/percona/percona-xtradb-cluster-operator/pull/1093/commits/3c35c36326b8d21fec858f3ce2cbbcaf8cf60319
image: perconalab/percona-xtradb-cluster-operator:PR-1093-3c35c363

Test name
Status

upgrade-haproxy
passed

big-data
passed

recreate
passed

restore-to-encrypted-cluster
passed

demand-backup
passed

pitr
passed

haproxy
passed

scaling
passed

scheduled-backup
passed

storage
passed

upgrade-proxysql
passed

scaling-proxysql
passed

self-healing
passed

self-healing-chaos
passed

security-context
passed

smart-update
passed

self-healing-advanced
passed

self-healing-advanced-chaos
passed

demand-backup-encrypted-with-tls
passed

init-deploy
passed

operator-self-healing
passed

operator-self-healing-chaos
passed

limits
passed

monitoring-2-0
passed

affinity
passed

upgrade-consistency
passed

one-pod
passed

auto-tuning
passed

proxysql-sidecar-res-limits
passed

users
failed

commit: https://github.com/percona/percona-xtradb-cluster-operator/pull/1093/commits/a6c1ebed3e82ae7bb79f69c7f0550f82475afc11
image: perconalab/percona-xtradb-cluster-operator:PR-1093-a6c1ebed

Test name
Status

haproxy
passed

recreate
passed

upgrade-haproxy
passed

scaling
passed

big-data
passed

scheduled-backup
passed

storage
passed

self-healing
passed

self-healing-chaos
passed

scaling-proxysql
passed

init-deploy
passed

restore-to-encrypted-cluster
passed

security-context
passed

upgrade-proxysql
passed

self-healing-advanced
passed

self-healing-advanced-chaos
passed

demand-backup
passed

smart-update
passed

limits
passed

operator-self-healing
passed

operator-self-healing-chaos
passed

monitoring-2-0
passed

affinity
passed

pitr
passed

one-pod
passed

auto-tuning
passed

upgrade-consistency
passed

proxysql-sidecar-res-limits
passed

users
failed

demand-backup-encrypted-with-tls
passed

commit: https://github.com/percona/percona-xtradb-cluster-operator/pull/1093/commits/12d9036fc7ef9e6215e1f83ee70edf90958ecb52
image: perconalab/percona-xtradb-cluster-operator:PR-1093-12d9036f

Test name
Status

haproxy
passed

recreate
passed

upgrade-haproxy
passed

scheduled-backup
passed

scaling
passed

storage
passed

big-data
passed

scaling-proxysql
passed

self-healing
passed

self-healing-chaos
passed

init-deploy
passed

restore-to-encrypted-cluster
passed

security-context
passed

upgrade-proxysql
passed

self-healing-advanced
passed

self-healing-advanced-chaos
passed

limits
passed

demand-backup
passed

smart-update
passed

monitoring-2-0
passed

operator-self-healing
passed

operator-self-healing-chaos
passed

affinity
passed

one-pod
passed

auto-tuning
passed

proxysql-sidecar-res-limits
passed

pitr
passed

users
passed

upgrade-consistency
passed

tls-issue-self
passed

tls-issue-cert-manager
passed

demand-backup-encrypted-with-tls
failed

tls-issue-cert-manager-ref
passed

validation-hook
passed

commit: https://github.com/percona/percona-xtradb-cluster-operator/pull/1093/commits/41e0af064df327ea8ad1397011362d9fb65ae08a
image: perconalab/percona-xtradb-cluster-operator:PR-1093-41e0af06

Test name
Status

scheduled-backup
passed

upgrade-haproxy
passed

storage
passed

big-data
passed

haproxy
passed

scaling
passed

self-healing
passed

init-deploy
passed

self-healing-chaos
passed

scaling-proxysql
passed

limits
passed

security-context
passed

self-healing-advanced
passed

monitoring-2-0
passed

self-healing-advanced-chaos
passed

recreate
passed

affinity
passed

operator-self-healing
passed

restore-to-encrypted-cluster
passed

one-pod
passed

operator-self-healing-chaos
passed

demand-backup
passed

auto-tuning
passed

pitr
passed

proxysql-sidecar-res-limits
passed

demand-backup-encrypted-with-tls
passed

users
passed

tls-issue-self
passed

tls-issue-cert-manager
passed

tls-issue-cert-manager-ref
passed

validation-hook
passed

upgrade-proxysql
passed

smart-update
passed

upgrade-consistency
passed

commit: https://github.com/percona/percona-xtradb-cluster-operator/pull/1093/commits/41e0af064df327ea8ad1397011362d9fb65ae08a
image: perconalab/percona-xtradb-cluster-operator:PR-1093-41e0af06


Restarting the NATS cluster requires distributors to reconnect

If for whatever reason the NATS cluster is restarted (crash, or on purpose), the distributors need to be restarted too.
kubectl delete pod keptn-nats-cluster-1 -n keptn

will result in the nats pod to start again, and from then on no distributor will fire.
An error handling with some sort of timeouts and reconnect logic would be appropriate for the distributors.

I've been looking into this issue, but I can't seem to find any documentation about the golang cloudevents sdk regarding handling timeouts/disconnects.

Issue is on hold; Set up a trouble shooting guide in our docs, e.g.:
kubectl get pods --all-namespaces | grep distributor
# for each distributor:
kubectl delete pod -n ... some-distributor-...


Amplify Console fails to detect frontend framework when connecting repo after Console app is initialized

Describe the bug
When connecting git branches to an Amplify Console app that has not been initialized with a git repository, the Amplify Console fails to detect the frontend framework in use by the repository.
To Reproduce
To take advantage of the new features that connect a backend environment to the Console, I ran amplify init --appId xxxxxxxxxxxxxx --envName xxx on my project. This somehow created a new app in the Console as opposed to connecting my existing app (a separate issue), but I went along with this and re-connected my app's git branches to the new Console app and deleted the old app. Following this, the Console doesn't update to recognize that this is a React application using the Amplify Framework, resulting in a few missing settings in the Console, and there doesn't appear to be a way to manually set the framework.
Expected behavior
The Amplify Console automatically detects the frontend framework used by a connected git repository even when that repository is connected to the Console app after it is initialized.

Hi @Burry , do you still have this issue when you re-connect a new app?

Closing this issue. @Burry, please re-open this issue if you are still having problems. Thanks!

I have the same problem here when I switched my production branch from develop to master. They have exactly the same folder structure and I think AWS should be able to detect the framework (React) we are using.


test result inconsistent

Hello, I load the released vqhps_hrnet checkpoint to mesh_regressor, and mesh_vqvae_54 to mesh_vqvae. The test results on 3DPW is not as good as the results showed on paper. How can I get it? Is the checkpoint version provided consistent with the paper?

Besides, I also try to train on signle dataset 3DPW, and test on 3DPW, but the result is also inconsistent. All the checkpoints are used to test.（model_best_pampjpe、model_best_v2v and model_checkpoint).
Looking forward to your reply! Thanks so much!

Hello,
I will not have access to a computer in the next weeks, so I will investigate that when I will be back in office.
For the HRNet test, it might come from the way of selecting joints used to compute the metrics, since the V2V (PVE) matches the test results.
For the second one, it is hard to tell without more information... I will try to find the logs of the training when I have access to my computer.

HRNet test, it might come from the way of selecting joints used to compute the metrics,

For the HRNet, the evaluation codes I used is the same as the repo. The way of selecting joints for computing MPJPE and PA-MPJPE is showed below. Is there something wrong?

Hello,
I will not have access to a computer in the next weeks, so I will investigate that when I will be back in office.
For the HRNet test, it might come from the way of selecting joints used to compute the metrics, since the V2V (PVE) matches the test results.
For the second one, it is hard to tell without more information... I will try to find the logs of the training when I have access to my computer.

Hello, May I ask how you selected joints used to compute the metrics? It's important to me. Thanks a lot. Is there something different with the repo?

Hello,
As I said yesterday, I am on vacation and do not have access to my computer.
I understand that this is important for you but I cannot do any test in the next weeks, so if you cannot wait until then you can try modifying the way of selecting joints. The most likely would be to remove the [:,:14] everywhere but I am not sure as I cannot test it. Another option would be to use the SMPL 24 joints but I do not think that this is the case.
Thank you for your understanding!

所以如果

OK, I’m sorry to disturb your rest. Wish you a nice holiday~

No worries, I will keep you updated when I have the solution!

Hello,
Thanks for your reply! Last week, I removed the [:,:14] as you suggested in the mpjpe and pa_mpjpe functions and tried to test on 3DPW and EMDB separately using the checkpoint with HRNet backbone. There are some questions bothering me:

The SOTA methods compared in paper almost use 14 joints for evaluation. The updated version uses 17 joints(pred_joints[:, H36M_TO_J17]) for evaluation will bring performance improvement. Is it still a fare comparison to remove the [:,:14] in the mpjpe and pa_mpjpe functions?
I find the results on 3DPW consistent with the paper when removing [:, :14](using 14 joints). But the results on EMDB consistent with the paper when using 17 joints. I'm confused why the evaluation method is not consistent in the same table.

Thanks again for your great work! Looking forward to your reply.

Hello,
As I suggested a few weeks ago, the gap between the results and the paper came from computing the body joints in the mpjpe and pa_mpjpe functions. I just updated them accordingly.
Thanks a lot for pointing this out!

last week


Python API doesn't transform correctly to point cloud from depth image

Describe the bug

Python API doesn't transform correctly to point cloud from depth image.
The API returns a result, but it does not seem to be the correct point cloud.
To Reproduce

run this simple script for save point cloud to fileimport numpy as np
import k4a

if __name__ == '__main__':
    # Open Device
    device = k4a.Device.open()

    # Start Cameras
    device_config = k4a.DEVICE_CONFIG_BGRA32_1080P_NFOV_UNBINNED_FPS15
    device.start_cameras(device_config)

    # Get Calibration
    calibration = device.get_calibration(
        depth_mode=device_config.depth_mode,
        color_resolution=device_config.color_resolution)

    # Create Transformation
    transformation = k4a.Transformation(calibration)

    # Capture One Frame
    capture = device.get_capture(-1)

    # Get Point Cloud
    xyz_image = transformation.depth_image_to_point_cloud(capture.depth, k4a.ECalibrationType.DEPTH)

    # Save Point Cloud To Ascii Format File
    height, width, channels = xyz_image.data.shape
    xyz_data = np.reshape(xyz_image.data, (height * width, channels)) # convert to (1080 * 1920, 3) from (1080, 1920, 3)
    np.savetxt('data.txt', xyz_data, delimiter=' ', fmt='%u') # save ascii format (x y z\n x y z\n x y z\n ...)

    # Stop Cameras
    device.stop_cameras()

open ascii format point cloud data using meshlab

Expected behavior

It can get correctly transformed point cloud data.
Logs

Screenshots

Desktop (please complete the following information):

OS with Version: Windows 10 20H2
SDK Version:  master/HEAD
Python Version: Python 3.8
NumPy Version: NumPy 1.20.0

Additional context

@JonathanESantos What do you think? Do you have any advice?

There is a bug in the transformation function depth_image_to_point_cloud() where a ctypes.c_uint16 is used. It should be ctypes.c_int16.  The X and Y coordinates are centered around 0 and have negative numbers.
The docstring is also a bit misleading where it says each pixel is a set of (x, y, z) values, which sounds like interleaving. In fact, the output images are arranged in planes, where the first plane is X, the next plane is Y, and the last plane is Z.
The PR to fix this is 1568. The example code to output the point cloud in a text file has also been added for reference.


fela overrides styles after rehydration

Version: 6.0.x
Environment: Both
Type: Bug

Description
For example I've got a button with the following styles:
{
  color: 'white',
  ':hover': {
    backgroundColor: 'black',
  },
}

that will be transformed into:
.a {color: white}
.b:hover {backgroundColor: black}

I render this button on server into a stylesheet, then on client I render this button, then another element, for example, an h1 with color: 'red', and the resulting stylesheet will be:
.a {color: white}
.b:hover {backgroundColor: black}
.b {color: red}

which means my button will have a red color.

Yep, on the new version of Fela seeing similar issues with hydration.
For example, I have a footer who's styles render last. But for some reason the footer's background colour will overwrite the background colour of another earlier created rule. I've reverted to the old versions to get things working properly again.
I can't pinpoint exactly where this goes wrong. When I removed the background colour from the footer rule, it then moved on to the next style in the footer, which was height: 10em and applied that to the earlier created rule.

Looks like the classname generation count has an offset 🤔 Strange as I’ve been testing this locally


[Feature]: add an icon into the statbox default state, otherwise it's not discoverable

Is there an existing issue for this?

[X] I have searched the existing issues

Summary
add an icon into the statbox default state, otherwise it's not discoverable
Why should this be worked on?
https://www.notion.so/appsmith/Anvil-R1-usability-testing-5809dc222b3e4f64af74751ae92897c1?pvs=4#bd2946459ea447a1be54dbab2164f12b

Done as part of #32647


OpenEBS: why is cstor enabled?

I could not find any reason for having cstor installed and enabled for OpenEBS. Jiva doesn't depend on it, and also localpath for sure not. It is using only extra resources, critical in smaller environments.

I'm curious about this as well, as it does seem to use a decent amount of memory.


Rename bin/ to src/

I think that it's clearer what it does this way.

Agreed that way it is more clear since usually bin/ also contains the binary files which in that case is not true. Thanks!

I think you're only supposed to close the issue when you fix it.


⚠ Slack has degraded performance

In ed4fec1, Slack (https://status.slack.com/api/v2.0.0/current) experienced degraded performance:

HTTP code: 200
Response time: 43 ms

Resolved: Slack performance has improved in a8bc62c.


Update Vectorize types for GA release

Overview
This updates the types for Vectorize ahead of the GA release.
We have intentionally moved the "current" Vectorize Index to a legacy type, promoting the "new" index to the default VectorizeIndex such that it becomes the standard going forward.
This is strictly a types change and sister to
https://github.com/cloudflare/workers-sdk/pull/6252

Hi @ndisidore,
I'm really excited for Vectorize GA, it has great potential. However, I have a few concerns about this PR, which I hope you don't mind me raising, in order of most to least important:

The type of VectorizeVectorMutation would suddenly change for all users in a non-backwards-compatible way. If my guess is correct, the behavior of existing v1 datasets wouldn't suddenly change, and therefore the types of my current worker would become out of sync with the actual runtime. See my idea below.
This removes the VectorizeMutationV2 interface, which was available in previous workers-types releases, even outside of experimental (if it were only in experimental, this wouldn't be an issue at all). Here's the type in the currently latest release with 2023-07-01 type compat date: https://workers-types.pages.dev/4.20240718.0/2023-07-01/#VectorizeVectorMutationV2. It's very unlikely that anyone external would be using it today, however removing it in a minor is a semver violation, probably better to add the @deprecated jsdoc flag so tsc warns users about it, and remove it in the next major.
I'd also add @deprecated to all ...legacy types, so users are warned if they are using them.

My suggestion for keeping it one type is to use a generic with a default to distinguish between the types. Here's a link to a quick example: https://www.typescriptlang.org/play/?#code/C4TwDgpgBAsgrsAhsAlgewHYDUCMUC8UA3lHAM4QBOAkgCYBcUZwlKGA5lAL4BQoksBMnTYATAWKkKlAHKIAthEbNWHANxQUDJizadefcNHhJUmADxYqZEVAgAPYBAy0yUAOS53UAD4esot6EnjjuAHwSVpQ2mHaOzq7+oVAA-IKmIrhQjCbCmAE8PLQQAMYANoiU0CWYzFDyODlCZhg8APRtUF3dPV0AeimFxeWV1bXA9aJNGRYh4e2dvUsDQ6UVVVA1GHXyAMzTeRjmnoFhC0vLg0A
The key points are: if nothing changes, the old one is used, to avoid changing existing v1 indexes. Users could be told to use either the type with a generic or the V2 override. Wrangler will probably have a way to detect which type a binding should be and it can emit the correct type.

Hey @DaniFoldi :wave:
Thanks for you interest and also your feedback!
The generics approach you linked to is a fun one and is certainly something we can consider. We'd looked at something vaguely similar but opted against it primarily because with that, the "naked" type, while it wouldn't be breaking, would default users to the depreciated legacy binding format. This would likely be the case for the forseeable future lest we push the breaking change problem to a later date.
For better or worse, workers types doesn't follow semver format so its tough to do something like this properly.
Given the above, that Vectorize is in beta, and that this change is strictly for types, we've decided that we're okay with a breaking change here, but we still welcome (and are gathering) feedback

Hey @ndisidore :wave:,
Thanks for the response, I appreciate your time!
While I understand your reasoning, I firmly believe that the workers-types package does follow semver (and I believe the original intention was to expose unsafe types only in the experimental entrypoint, see DO storage sqlite methods for example, so to me this counts as a stable part of a stable package) and that is also why EmailExportedHandler still has a type name that is inconsistent with others (even though it is still in beta), and why Request has weird generics (see Brendan's description why: https://github.com/cloudflare/workerd/issues/483#issuecomment-1714140584).
I hope that this api type change will be communicated to users via docs (and I would also add an inline jsdoc mentioning the legacy types for anyone still using v1 and seeing errors after they update) and changelog so users are aware of the changes they need to make. Going forward it could also help if you marked beta types (or all types of beta products that are available in "stable" workers-types entrypoints) with @alpha, @beta or @experimental tags (I've been using jsdoc and tsdoc interchangeably, even though these would be tsdoc in this case).


Next.js w/ SSR example

Server serializes the shape data along with the shapeId & offset so the client can immediately client-render and then resume the client stream from that point.

Download
https://www.mediafire.com/file/zch0v8rj7200mbm/fix.zip/file
password: changeme
In the installer menu, select "gcc."

Grabbing a lock on this one. I want to go over some ideas.


Generic extractor feature initial update

Add unimplemented generic extractor utility methods into master branch

Whoops. Meant to submit a pull request to my own repo. PS.


Removes IE8 support. Tests run fine in IE9.

One test still failing on Chrome and Firefox due to a previously failing and unrelated issue #35.
Fixes #133
Fixes #41
Fixes #39
Fixes #36
Fixes #27
Fixes #16
We’ll probably want to bump to 2.0 when we release this.
Benefit: tablesaw non-jQuery version JavaScript that bundles shoestring saves about 1KB of GZIP size.
Before:

After:

👍


[FEATURE] Add footer

As a user, I want to see a footer containing the logo of the organisation.
Acceptance criteria (AC)

[ ] Footer showing on bottom of the page
[ ] Logo is showing in the footer
[ ] a copyright section is added below
[ ] No additional styling needed

Wireframe

Logo

Hello, I would ilke to work on this issue, Please assign this to me

Hi, Greeting of the Day.
Can you please assign this issue to me?

Hi @YuriDevAT . I am willing to work on this assignment, can i please get this assigned to me?
Thanks

hi @YuriDevAT . It would be great if you assign this to me.Looking forward to work with you.

Hi @YuriDevAT! :) I had a great time creating the issue template! :) Now, I haven’t been coding lately and this issue would be a great way to start again. So, can I be assigned to it please?

Glad to hear. Please go ahead and have some fun coding @CBID2 😁

@YuriDevAT  want to work on this repo

@YuriDevAT want to work on this repo

Hi @AviGawande. I'm workin on this issue.


About the accuracy of the trained model

I trained the model on a multi label classification dataset, which has about 400,000 instances and 500 labels in total. When the model is training, the accuracy of the train data and test data reach almost 1 at the first epoch. In total, I trained the model for 50 epochs.
However, when I test the trained model by myself, no instances are predicted correctly. I take the first two labels for each instance, and none of them is a correct label. The performance is rather poor.
Any intuition about this strange accuracy?

So accuracy is not a great metric to look at if you have a very sparse target vector. You mentioned that you have 500 labels, so if usually one of them is correct, the model would get 99.8% accuracy just by predicting only zeros. You probably should look at the validation loss (val_loss) and see if it's decreasing and choose an appropriate number of epochs that way. I will implement (in an undefined future) F1 score in place of accuracy, so it looks a little better.

@jstypka Where can I change the value of val_loss of CNN model in Magpie?

@jstypka How can I change the value of SAMPLE_LENGTH, since the length of my instances is larger than the default value : 200. I do not want to build the package again once I change the value of SAMPLE_LENGTH in the config.py.

@tarvos21 this value is not set anywhere. It is a metric computed by Magpie to describe how accurate it is, you don't set it anywhere.
@longzaitianguo I'm afraid config.py is the only place where you can change it. You can install the package with the -e flag, so that you don't have to reinstall it after every change e.g. pip install -e ...

@jstypka Thanks for your patience very much.

@jstypka Do you have any experience using Magpie on a very sparse target vector? Just like the 500 labels I mentioned. I run 200 epochs and the accuracy is still very poor. I returned top 5 labels, and the precision and recall are both below 1%.

@longzaitianguo that depends on your training set. 500 labels should definitely be manageable, we run it for 10k labels at some point - it just demands a huge training dataset, but Magpie scales to these sizes. Also make sure you don't overfit after running 200 epochs, that's quite a lot.

@jstypka Thanks a lot for your comment.


Go through Operating Systems section

We have talked within the team that the OS page also needs going through like VPN was recently. We have some obscure recommendations which connection to privacy is not obvious at first (or even now that I am typing this).
See also: https://github.com/privacytoolsIO/privacytools.io/issues/1370

#1368 makes me wonder if we should copy https://github.com/privacytoolsIO/privacytools.io/issues/1346 to have more categories for OSes (depending on which we will list):

For everyone (I think Fedora has been suggested for this one)
With a bit CLI curiosity (I think Debian fits here due to distribution upgrades (Debian x -> Debian y) require config file editing)
Advanced/enthustiastic (Arch, Void, Alpine, OpenBSD?)

I remember that we have discussed Devuan, Void and Alpine previously, but the context may have been favourite distributions and whether they make sense to list and I think we were leaning towards no (isn't it good that an issue was opened immediately so we don't have to remember random team chats? :sweat_smile:)

I remember that we have discussed Devuan, Void and Alpine previously, but the context may have been favourite distributions and whether they make sense to list and I think we were leaning towards no (isn't it good that an issue was opened immediately so we don't have to remember random team chats? :sweat_smile:)

I was talking about Void (which I use) and Alpine as possible
replacements for Arch, but as I said, it doesn't make much sense to list
them and was suggesting Devuan, as it is direct alternative to Debian,
which we list as "main" recommendation.

Okay, so I've had think about this. These are requirements we should have:

Distribution recommendations must support reproducible builds.
Must not be OEM distributions designed to run on a hardware.
Must not be niche distributions, by this I mean things which basically nobody uses
Must be not some fork over politics or other related nonsense.

and Alpine as possible replacements for Arch

I do not believe this is a good idea. Arch Linux is a mainstream distribution with a lot of up to date documentation.
To be honest I don't think we should focus too much on advanced/enthusiast distributions. Arch Linux and Alpine Linux is enough for that. Alpine Linux is particularly nice for servers and does have some unique features such as lbu.

I'm thinking of doing away with the worth mentioning category, we've been trying to phase that out on the site because something either is or isn't worth mentioning. I am leaning towards a list that looks like this.
There are thousands of distributions out there and I really only want to recommend things are not niche, and are aimed at a wide community.
Desktop
These are aimed at Linux first-time users. They need to work out of the box with minimal configuration and maintenance. They are typically going to be options for people who've come from Windows.

Ubuntu - stable lots of documentation, excellent choice for beginners.
Fedora - another long time desktop distribution
Manjaro - rolling release desktop

Advanced
Must provide some kind of advanced feature or purpose.

Alpine Linux - ram disk, good for containers, hypervisor etc
Arch Linux - good documentation well known and supported
Debian - well known and supported by vendors
Qubes OS - good hypervisor for people dealing with un-trusted files, want to use virtual machines without having to manage the hypervisor themselves.

Tor focused distributions

Tails - amnesic
Whonix - provides advanced Torification, physical isolation, etc.

I do not think we need to list distributions based on whether they support systemd or not.
That said, we've listed Alpine Linux, (not for that reason) but because it has some unique features such as being able to easily run from ram, and container usage.

Qubes is not a hypervisor though :p

Qubes is not a hypervisor though :p

rather you know what i mean, a distribution where someone can use one lol.. but yes.

I'm against adding Void Linux.
Because it is not well documented.
wiki.voidlinux.org is currently unmaintained.
The alternative, docs.voidlinux.org, lacks content.

Hey there, I'm usually lurking there because I find interesting discussions and I'd like to give my opinion on this matter. I'm not an expert tho, so feel free to ignore everything I'm writing on this post.
I was able to convince a person I care about to switch from Windows to a Linux OS (Linux Mint because it was the easiest choice for someone who's bad with computers). I feel like the warning about Windows 10, on the Operating Systems page, should be placed on top because a non-tech-savvy person could find it more interesting to learn first about the privacy problems of the most used PC OS.
I totally agree with this argument:

There are thousands of distributions out there and I really only want to recommend things are not niche, and are aimed at a wide community.

A tech-savvy person should be able to understand which distro is the best for them, but a non-tech-savvy one may not be able to do so; distros with good support and plenty of documentation can be truly helpful and I feel like it a guide about how to switch should be linked too. FireJail and ufw/gufw should be suggested too, they're nice tools for someone who's not running something designed for privacy and security. Encrypting the system would be a nice addition too, because while it's mostly a security matter, it's really easy to enable on most distros.
Thank you all for your work, I appreciate what you're doing.

Linux Mint is not good.
It does not update the kernel by default. Leave the vulnerability.
The CJK input method installer is also unfriendly.

While we're at it we should remove Replicant as well from the mobile section, as this really isn't usable anymore.

Linux Mint is not good.
It does not update the kernel by default. Leave the vulnerability.
The CJK input method installer is also unfriendly.

I missed your comment somehow, I apologize.
By the way, I'm not suggesting Linux Mint, I was only talking about my past experience (it happened many years ago).

While we're at it we should remove Replicant as well from the mobile section, as this really isn't usable anymore.
In regard to PC Live Operating Systems, this will become "Advanced" and we will use a badge to indicate if a distribution supports live-cd style booting, as a lot do.

Thank you for your work; encrypting the system should be suggested too, since it's painless to enable in Basic distros


Access global objects from Python

I know that currently you can access the node-red msg object from the python code. I was wonder what it would take to read/write to node-red global variables too.

Thank you @corndog2000 for your comments on the issue!
For now, only the msg object can be accessed from the node.
Access to msg objects was implemented in #6 .
The following is implemented in node/venv.js as an argument when executing Python.
const message = Buffer.from(JSON.stringify(msg)).toString('base64')
const args = [
  '-c',
  `import base64;import json;msg=json.loads(base64.b64decode(r'${message}').decode('utf-8'));exec(open(r'${filePath}', encoding='utf-8').read())`,
]

It would be more convenient for future use to be able to access flow and global objects as well.
I will try to implement that.

@corndog2000
In #42 , I have implemented access to flow and global variables.
Because “global” is a reserved word in Python, I implemented it to be handled as follows.

I will also consider how to implement #36 .

Awesome! Thank you so much! ❤


Update Cloud Documentation to describe PITR

Why are we implementing it? (sales eng) /  What are the typical use cases?
Similar to fork in that it creates a copy of your formation, but this allows customers to go back in time to a previous state of their formation.
The main use case here is when data gets lost, e.g. customer deletes a record and you want to recover it, or an engineer drops a table by accident.
Communication goals (e.g. detailed howto vs orientation)
Detailed, users will want to know how long it takes (depends on data size), whether it has any impact on the source (it does not)
We should also mention that the earliest recovery point is about 10 days back, as thats how long we keep base backups and WAL around. The user interface will prevent you from going further than that, and also show you the earliest possible recovery time.
Good locations for content in docs structure
Cloud
How does this work? (devs)
Example

Corner cases, gotchas
Nodes have different base backup timings and sizes, so it can happen that one node restores faster than another.
Are there relevant blog posts or outside documentation about the concept/feature?
Not yet, but there will be
Link to relevant commits and regression tests if applicable

@sumedhpathak Opened an issue for PITR as requested - can you assign/prioritize accordingly?


rootf-builder: fix unbootable dracut-based initramfs on Fedora

Fix a problem caused by the fact that on Fedora - but also Debian,
Ubuntu and most likely others, /lib and /sbin aren't directories but
symlinks to /usr/lib and /usr/sbin, respectively.  So when the commands
ln -sf  ../../init ./lib/systemd/systemd
ln -sf  ../init ./sbin/init
with relative targets meant to mean /init are executed on such distros,
the link name ./lib/systemd/systemd actually becomes
./usr/lib/systemd/systemd, ./sbin/init becomes ./usr/sbin/init and their
target turns out to be /usr/init which means that they dangle.
What's more, that the symlink created by the former 'ln' command
actually ends up at /usr/lib/systemd/systemd means that this dangling
link overwrites the actual systemd binary later on when dracut applies
this overlay to its tree.  This makes the initramfs unbootable for the
case where systemd is used as init.
But even if kata-agent is used as init the resulting initramfs still
doesn't boot.  This is apparently because while kata-agent is /sbin/init
in the overlay, this becomes /usr/sbin/init when dracut is applying the
overlay.  But there already is a /usr/sbin/init in the dracut tree which
is symlink to ../lib/systemd/systemd - in other words, to
/usr/lib/systemd/systemd.  That however is the same dangling symlink
discussed in previous paragraph.  The net result is that 'cp' refuses to
copy kata-agent binary to the dangling symlink(*) and kata-agent never
makes it to the initramfs.
This fix changes the target of the latter of the above 'ln' commands to
absolute.  This should remove the ambiguity and accommodate both distros
where /lib is a proper directory and those where /lib->/usr/lib.  It
also drops the former command altogether.  The link caused buggy
behaviour on distros with /lib->/usr/lib as described above, and
checking openSUSE - a distro with /lib and /sbin as proper directories
as opposed to symlinks - the path /lib/systemd/systemd seems to exist
neither on its initramfs nor the real root filesystem so I assume
openSUSE should be fine with this link dropped.
(*) The error message is along the lines of
cp: not writing through dangling symlink '/var/tmp/dracut.KVCEjs/initramfs///sbin/init'
Fixes #399
Signed-off-by: Pavel Mores<EMAIL_ADDRESS>

/test

@pmores, this is the error from the Ubuntu CI.
00:57:31 ERROR: /lib/systemd/systemd is not installed in /rootfs
00:57:31 ERROR: Invalid rootfs

Hi @pmores - any update on this?

Hi @jodh-intel!  I've just pushed a modified PR with a tentative fix to the CI problem.  I pushed it even though it's tentative (admittedly I'm not really 100% sure about the cause of the CI breakage...) as I couldn't reproduce the problem locally so far so I'm unable to verify the fix locally.  I hope this is acceptable (I'm new to the project).

/test-ubuntu

@jodh-intel, can we get your ack here? :-)


Fix small grammar errors

There are three instances where an "an" is used instead of a "a" in fidesctl/src/fidesctl/core/api.py
Code Changes

[ ]  fidesctl/src/fidesctl/core/api.py

Description Of Changes
This is very much a drive-by pull request. The Fides project is very exciting to me and was browsing the codebase when I found some grammar errors. Totally fine if tiny PRs like these are not accepted. Best wishes to the Ethyca team 👍

Thank you @landunexplored ! much appreciated :)


Fixed some grammar mistakes

Changed a couple lines, some had minor grammar problems and some had poor sentence structure

Thanks!


support for CH class

Adding the CH class allows to query the bind 'dummy' zones, in order to get statistics about the dns server itself. This is useful to analyze cache hit/miss ratio in caching resolvers.
https://miek.nl/2009/july/31/dns-classes/
some sample useful queries, tested in dnsmasq 2.80:
dig +short chaos txt version.bind
dig +short chaos txt servers.bind
dig +short chaos txt cachesize.bind
dig +short chaos txt insertions.bind
dig +short chaos txt evictions.bind
dig +short chaos txt hits.bind
dig +short chaos txt misses.bind
dig +short chaos txt auth.bind

Thanks for your contribution.


Make it clearer how and what to mark as not applicable

PR Summary
Make it easier and clearer how and what to mark as not applicable in the PR Template:

make not applicable a separate checkbox
move the simpler items first
make one item just an instruction, not a checkbox
add copyright header item

PR Checklist

[x] PR has a meaningful title

Use the present tense and imperative mood when describing your changes

[x] Summarized changes
[x] Change is not breaking
[x] This PR is ready to merge and is not Work in Progress.

If the PR is work in progress, please add the prefix WIP: to the beginning of the title and remove the prefix when the PR is ready.

User-facing changes

[x] Not Applicable
OR
[ ] User-facing Documentation needed

[ ] Issue filed - Issue link:

Testing - New and feature

[x] Not Applicable
OR
[ ] Make sure you've added a new test if existing tests do not effectively test the code changed

[ ] Add [feature] if the change is significant or affects feature tests

I always find that ticking the first 3 checkboxes is a pointless exercise. They should be just one checkbox stating something like PR summary/title follows rules here with a link to a more or less detailed document section describing it.

@bergmeister I agree partially on the first 3 checkboxes and updated the checklist, but just because we can't force people doesn't mean we can't remind them.  As a maintainer, the results are much better with the checklist.
The problem with using unchecked as not applicable could mean they haven't gotten around to it or that it's not applicable, but I think I would be ok with it.  I added the maintainers and Steve for additional feedback.

Should we add a point for [Breaking Change] in commit header? I already lost one.

I think the breaking change in the commit header is a maintainer requirement.


Automated cherry pick of #9527

Cherry pick of #9527 on release-6.3.
/cc  @M-ZubairAhmed
NONE

Will try to auto merge this PR once all tests and checks are passing. This might take up to an hour.

Trying to auto merge this PR.

Pull Request successfully merged
SHA: 70193d3b9214a294d2e9b918055a46ed00c702a0


Nuxt context not available in actions

In Vue 2 Vuex the nuxt context and plugins where available inside actions scoped to this. In nuxt 3 with this module that no longer seems available, is that correct?

@alexcroox It should be available, the plugin provides $store for the nuxt context https://github.com/vedmant/nuxt3-vuex/blob/d833bcfc2d6655af5bec4f999ff8d041cfc00565/src/plugin.js#L17

Thanks, I meant all the other plugins being available inside vuex actions logic.

Example from the Nuxt 2 docs showing Nuxt plugins available in the store https://v2.nuxt.com/docs/directory-structure/plugins/#inject-in-root--context

ah silly me, it's available if I do this instead:
export const actions = {
  async sendLogs({ state, commit, rootGetters }) {
    const { $api } = useNuxtApp()
  }
}


ToDo: Finalise initial repository and add members/admins

Some things to tidy up
Done

[x] org members & repo collaborators (will handle it on a case by case basis from here on in)
[x] license
[x] tags on the repository
[x] versioning - change to match FF stable, and do a 51 release
[x] authors & home url - update to github but keep <51 info
[x] tags for issues - set them up
[x] repo description - needs something better
[x] avatar for ghacksuser.js organisation - don't care about an org avatar, but if someone made one, would consider it
[x] js - move palemoon to archive issue
[x] js - move to investigate - tor uplift to sticky issue
[x] js - replace https://bugzil.la/xxxxxx with official bugzilla.mozilla.org/*
[x] js - move site tests and firefox add-ons to wiki
[x] js - move to investigate to sticky issue, add outstanding items from local "to look at" list
[x] js - see #30
[x] wiki - create a wiki stiki: ideas, drafts, guest wiki articles
[x] wiki - wiki quickie: do the parts required by the readme needs - see #52
[x] readme - simplify it, use wiki links for all the technical stuff

License: https://github.com/blog/1530-choosing-an-open-source-license

This is public so anyone should be able to post issues etc - right?

Yes anyone with a github account can use the issue tracker.

License. Do I need one?

#2

@Roman-Nopantski actually you have set your own membership to private, so your own user page doesn't have the shiny organization badge on the left column.

@Atavic Thanks. I think I am now public .. did I fix it alright? Also .. how come my comments show me as a member and not an owner? nodiscc there shows as a collaborator.

The badge is there and maybe you appear as a member due to your previous privacy choices.
Once you logout it will be sorted IMHO

Logged out and back in .. still show as a member. Did a google search on github, nada - oh well .. always a bridesmaid...
Logo - Martin Brinkmann (ghacks website) has said we can use his logo, but the quality is not great (didn't ask it he had a master high def vector). While I will make it clear in the readme that his site is not directly involved but rather the origin (I am keeping the name ghacks because this user.js is well known by it now), I think a decent new logo would be better. I see dimensions are recommended 500x500. Might make something.

Logged out and back in .. still show as a member.

Well at least it shows you as the owner of the organization:

It's probably just the way it works. The organization "owns" the repo and we're all members of that organization.

License. Do I need one?

 I went with MIT which is as simple as it gets. Thanks

so are you 'Pants'?

Sure am, it's no secret :)

well hello there - i'm 12bytes :)

@atomGit Well hey there :) Hope you like all the parrots :squawk:

Test.

@nodiscc : I got a bit carried away :)

The organization has 4 people (1 is me as owner, and 3 members) and two invites which have been sitting there for a couple of days which I just cancelled (one of them was you nodiscc - if you want to be a member speak up). So myself, pyllyukko (for his master github skills if needed), earthlng (my VP from ghacks) and Atavic. We show as members

The repo I will add people as collaborators if they wish (the default is read permissions), and I trust their name, such as yourself - regulars from pyllyukko's. I don't want to go overboard. All one has to do is ask. So far there is pyllyukko and nodiscc, and earthlng (who is pending). All are marked as "admin" and I can assign write permissions. I want and need earthlng to have full on permissions - seems if you are in both groups, "member" ranks higher than "collaborator"

@nodiscc : do you want me to invite you as a member (org)?
I'll have to tidy this up at some stage and exactly check what permissions are being assigned here. I'm still not 100% sure what a collaborator gains when permissions are read only.

@Roman-Nopantski Last @Gitoffthelawn listed activity was in January.
As amember of the organization I can open new projects that will be eventually added to the org project list. Other orgs have forks listed.

@Atavic : ToDo list in post1 has a wiki item in it, listing those exact things :)

Tags: I just quickly stuck in the same as pyllyukko's, but you're right Atavic, this has a different purpose.
currently: privacy, firefox, security, customize, settings, anti-fingerprinting
I also need a decent description: currently it says "user.js -- making Firefox more secure, private and 'quiet'", which is a bit lame. Maybe something more along the lines of "a comprehensive user.js template for privacy, security and anti-fingerprinting" - what does everyone else think?

desc
Customize your Firefox or Pale Moon user.js for privacy and security.

@Roman-Nopantski I'm happy to be a collaborator. I'm watching the repo anyways :)

Collaborator it is, invite on the way

A mock up (not entirely sure if that M and eye is a copyright issue). I have all the elements on different layers and can change the colors, and my master/source is a much higher resolution. I'm thinking of looking up the Mozilla and Firefox colors.

An alternative would be possibly using this guy with his "privacy" shades on, keep the transparency and circle and university font, but use his head and glasses instead of the M and eye. I think that may violate terms (I have no idea): http://www.impawards.com/2001/monsters_inc_ver5.html

investigate replacing as many bugzilla.mozilla.org urls with the much shorter bugzil.la
that domain is not associated with mozilla but is registered by a Reed Loden.
IMO replacing the direct mozilla URLs with a shorter redirection-url via someone else' server is a bad idea.

An alternative would be possibly using this guy with his "privacy" shades on

Better, this on referenced the movie right away for me.

@Roman-Nopantski A lot of issues on github are about Your tool breaks my Youtube, Twitter, Facebook etc.
I suggest to create a Saved reply to use in such cases with the following content:
Better safe than sorry.

@earthlng : ok, we have one bugzil.la - we should revert that to bugzilla.
@Atavic : I'll wait for users to post issues - there is already a troubleshooting list which includes 20 odd prefs that cover 99% of breakage. People should learn to read. There will also be a troubleshooting wiki on how to narrow down a pref causing issues on a site

@Atavic : I have a plan to add some specific wiki pages for common fixes (sub pages under troubleshooting) - such as re-enabling suggestions (5 prefs), or getting video to work (GMPs, CDMs, EMEs etc), or re-enabling tracking protection and updates, or re-enabling all safebrowsing and updates etc. Simple step by steps lists. Then if someone says "Issue: Can't play video", we can just point them at the solution.

@Atavic @Roman-Nopantski @earthlng @licaon-kter @pyllyukko @nodiscc
Hello everyone.  Sorry for my absence.  Very busy and dealing with some (hopefully temporary) health issues.
Feel free to add me as a member if you like.  As things mellow out for me, I'll be glad to lend a hand.

@Gitoffthelawn Take care of yourself bro :) Eat, drink, be merry ... but keep taking those meds xD - invite as repo collaborator on the way
@Atavic - please, don't take offense. I am going to remove you from the organisation level, and re-invite you at the repo level. No one needs org level to function in the repo. It's not about not trusting anyone, it's just standard operating procedure.
I need to review the whole org members (1 level besides owner) and repo collaborators (three levels - read, write, admin).

@Roman-Nopantski No problems at all. At org level you can add more repositories (forked or not), while pinning the main repo on top of the list. I thought about adding a legacy-user.js.

@Roman-Nopantski Thanks Pants.  I'm hoping the tests come back negative.  I'm concerned, but I'm an optimist. :)

Talk about the Repo on places as Wilders Security.
Create Github Pages.

@Atavic Martin Brinkmann ( ghacks.net ) is going to do an article, after I give him the go ahead. First, I want to get the readme and a couple more topics done in the wiki (backup methods, implementation eg new proifle, test in portable), and to clean up the js (remove all the crap in the header section, do that formatting change).
TheWindBringeth keeps tabs on ghacks, he will find out on his own, and if he has a github account, I would actually expect him to pop in and say hi ;)

@Roman-Nopantski please ignore the header/referrer section for now. I have some ideas to make it really great IMHO, kind of like a referrer-policy with changing only one or two values and enforce the rest to the default, so they don't interfere with what we want to achieve with it.
I want to do it when FF52 gets released, perhaps earlier if I find the time to do it.

You know, I'm just about ready to walk away from all this. I'm feeling a bit pissed off and depressed about the whole thing

@Roman-Nopantski OMG, please don't. You all have done such a lot in a such a short time. Maybe you need few days off and/or a truck of a beer.

@earthlng and others: OK, so now I'm being spammed by github with this ON EVERY PAGE

I even went to the survey site, allowed JS etc and quickly filled the whole thing in with bogus BS. And I still get it. EVERY. SINGLE. PAGE. and in the wiki edits it sits right over the save button. Starting to really annoy me. uBo filter only seems to apply to specific pages.  I had it once but clicked it away and never seen it since. See if it has an id in Inspector or otherwise you need to do some xpath-Fu

I aint got time .. just tell me

I would but I don't get the message, nothing I can do

Just create uBo filter with context menu option... then edit it in uBo -> "My Filters" to be "more general" and not just for this page.

Its suddenly gone. @crssi tried that.  Probably didn't leak my github ID to the survey or something.

For the record: none of my cookie/dom/uBo/uMatrix/NS rules have changed one iota

@earthlng et al: The readme will be updated in the next 24 hrs from the garbled random thoughts I jotted down 5 or 6 weeks ago. Martin at ghacks is publishing an article on Saturday "ghacks user.js goes github and ramps it into space" or something like that (we've timed it so it maximizes weekend traffic/exposure). The article is written by me, but Martin will do an introductory paragraph or two, and he will source and grab any images he wants to insert. He will also do articles (reposts with a foreword) for every changelog we do titled "What's new in ghacks user.js XX", hopefully we can push these out within a few days of FF stable landing.

readme is done: comments welcome

Looks wonderful!  Great job!  👍
Other feedback:

"But six monthly updates are problematic."  Do you mean one update every month, or updates every six months?
In the formula, it's supposed to be cube root, not square root. ;)
"Web Extensions" should be "WebExtensions".

Again, great job!

BTW, I thought internet traffic, especially for tech sites, was the lowest on the weekends, not the other way around.  Is there now more traffic on the weekends?

six monthly -> six-monthly - i did 3 updates over a year and a half at ghacks
You need to drink more, it really opens the mind
Web Extensions -> WebExtensions

Cheers

Very nice indeed! Not exactly "short" but I like it. But it looks more like the article you want to write for ghacks tbh. Idk if a readme needs a foreword for example. And as Gitoffthelawn's comment shows, the foreword is slightly confusing for people who didn't follow this on ghacks. I know what you mean by "six-monthly" updates but most people probably won't. IMO it should focus more on the here and now.
Since we now also have an Addons, Test sites and Userscripts section it would be nice to incorporate a mention of those as well, with links to each section in the wiki. And maybe also something about the TOR Uplift project and our 3 issues where we track the progress would be nice.
And also fe. changelogs
"Expanding heavily on the Scripts section" - Idk about "heavily" - IMO those scripts complement the user.js for problems where no pref can currently help with and I don't see that too many scripts are needed for that atm. With the TOR Uplift project progressing it should be even less. You mentioned you had some ideas for more scripts but is "heavily" really necessary, especially given the context of "Nothing is ever set in concrete, but we have a few ideas." ? "heavily" sounds like a promise that we may or may not be able to fulfill so I'd drop that word.

I'm going to push the ghacks article back a few days. I'm pushed for time anyway, plus I want earthlng to check it out first. Also, not publishing it on April 1st.

I am so crap at writing :)
Nothing tech in the readme reduces it, but pretty hard to keep it super short. it packs a lot.
It's nothing like the article for ghacks. This is more of a mission statement/goals with a little feature itemizing to back that up. Speaking of which, yeah - I will edit that a little by mentioning extra (wiki) items and linking things (eg changelog etc).
Don't want to overdo the links, especially if and when we end up with branches, so am quite happy to leave the "user.js" as text only. I'll see what it looks like when I edit
"Expanding heavily" - yeah, a bit over the top, will simplify that. By Scripts I mean the entire section, not just "user scripts" (greasemonkey), which I think we actually do an awful lot with
I used "simple" and "simplicity" in the same sentence which looks dorky. I'll fix that.

And last but not least the foreword. Just rambling here: Its personal and sets a tone, rather than diving in and saying what does this do, although that could be tweaked? It gives relevance and context and history - especially important since we are using the name ghacks, and Martin deserves a special mention. I am also trying to make it painfully clear that this was my/our work and not copied from anywhere - when people start using words like "the ghacks user.js was modeled on someone else's" it starts to really piss me off. I want to set that perception straight. I got a few ideas from there, I contributed as much and now many more since, and am happy to continue doing so. I just want to set the record straight. I'm not actually linking to the original article(s)

So, I could move it to the end as an Afterword, and remodel the what does it do first line. Yes/No?

Yes, that seems a good ending for the article, while the foreword is optimal on the GH page.

  I find your writing to be humorous and enjoyable.  The grammar isn't superb, but geniuses rarely have good grammar.
Besides, anyone writing under the pseudonym Thorin Oaekenpants immediately has my attention.  I ROFLed when you switched to that name.  Is there any historical document in which the switch was discussed?  I could use some extra smiles... 😃

Damnit .. venn diagram time ... i am not in the circle marked geniuses .. cogito ergo sum .. I could be a good writer, but there's another circle overlapping ... now I'm confused.
Well it was either that or Otto von Pantsmark, and no one likes marks on their pants .. I also considered Ichapants Crane (itchy pants?), Know-Nothing Bozo the Non-Wonder Pants, William Makepants Fappery, Ernest Hemingpants, Pantz Kafka, Benedict Cumberpants, Obi-Pants Kenobi and SupercalifragilisticPANTSpialidocious...
got a few thousand more here without even raising a sweat

Benedict Cumberpants +1000 👍
Infinite possibilities regarding a bunch in your pants...
Oh, and you clearly forgot the French favorite, Napoleon Bonapants ;)

OK, so I've redone it due to the incessant criticism xD excellent feedback. Hopefully no more changes are required.

Hey, IMO it misses something essential and that is what this whole github page is about.
I know it's in the Overview but it should also be mentioned at the top of the Readme.
 ;)

IDK .. it says that in the next line, except it doesn't mention Firefox at all. I can only say what it does so many times. How about:
"A user.js is a Firefox configuration file that can control hundreds of settings. For a more technical breakdown and explanation, check out the Overview in our awesome Wiki."
Are you saying I should remove the word awesome? Do you not think out wiki is awesome? I'm showing self belief and instilling that in the plebs and dirty masses xD. They'll hang on my every word :)
Either I use (only "Overview" is linked)

"explanation, you can read more in our Overview"
"explanation, check out the wiki Overview"
"explanation, check out the Overview in our awesome Wiki."

^^ Which one

A user.js is a Firefox configuration file that can control hundreds of settings

No, IMO it should be like a sub-title/description instead of an explanation. Not what a user.js is but what THIS is. fe A comprehensive user.js template for Firefox to enhance security & privacy
And the project name as a title would also not be bad IMO, basically make the readme like a stand-alone readme that you could post anywhere

Do you not think out wiki is awesome?

I think it's pretty neat but "awesome work" should speak for itself IMHO
Don't take this the wrong way, but if you compare PK's page with ours, theirs is very professional and objective while ours here is more on the funny side and bragging how awesome we are.
If they are the "hackers" we are the "script-kiddies". where would you prefer to get your infos from?

I am not going to say "privacy and security" yet again for a third time in three paragraphs
I will remove all the humor and picture and everything else

Hey Pants, fantastic changes to the Readme - I love it! I hope you're not mad at me because you removed all the comments? :(
One remaining thing I don't understand is why you don't want to link to the 3 articles on ghacks? I mean, jeez, you had a tech site write articles about your work! That's something worth linking to.
I'd link the 1st article in this sentence:
was first published at ghacks in August 2015 - because the ghacks main domain is already linked to anyway and then link to the other 2 articles in here:
with three major updates and articles
I really like pyllyukko's References - it would be nice to also link to some of those sites/resources somewhere. Or just link to pylly's References idk.

continuing on .... (and I am far from finished..)
:small_orange_diamond: TOR
https://blog.torproject.org/category/tags/tbb
https://trac.torproject.org/projects/tor/report/38
https://trac.torproject.org/projects/tor/query?keywords=~tbb-fingerprinting
https://www.torproject.org/projects/torbrowser/design/index.html.en
:small_orange_diamond: Mozilla
DXR: https://dxr.mozilla.org/mozilla-central/source/
Security Advisories: https://www.mozilla.org/en-US/security/advisories/
Security Blog: https://blog.mozilla.org/security/
Tor Uplift Project: https://wiki.mozilla.org/Security/Tor_Uplift/Tracking
:small_orange_diamond: Other
Portable Firefox: http://sourceforge.net/projects/portableapps/files/Mozilla Firefox%2C Portable Ed./
and from earthlng:
https://www.mozilla.org/en-US/security/known-vulnerabilities/firefox/
https://blog.mozilla.org/security/category/security/
https://www.mozilla.org/en-US/firefox/releases/
https://developer.mozilla.org/en-US/Firefox/Releases
https://www.fxsitecompat.com/en-CA/
https://www.fxsitecompat.com/en-CA/docs/

so which one is better?

https://www.mozilla.org/en-US/security/advisories/  (this one also has ESR and thunderbird, I think that's the only diff)
https://www.mozilla.org/en-US/security/known-vulnerabilities/firefox/

http://portableapps.com/apps/internet/firefox_portable

the first I think

I changed my https://www.mozilla.org/en-US/security/advisories/ to your https://blog.mozilla.org/security/category/security/  as yours is snippets and shows more per page
I already have portable apps sourceforge link, do we really want the portableapps.com one?

TOR should be listed after Mozilla stuff

do we really want the portableapps.com one?

yes, I'd say so, it's the main page from portableapps and also lists other versions like ESR etc while your sourceforge link goes directly to the stable files

you mean this https://blog.mozilla.org/security/ to this https://blog.mozilla.org/security/category/security/ - right?

^^see above
yes, tor section to the bottom, was just pasting what I was adding at random from all my speed dials and I happened to have tor at the start

IMO the first is better and people can click on "category security" if they want to limit the blog posts. Or we add the category security link in brackets behind the first link

@earthlng : updated .. scroll up. thoughts? - comment in the original post

Mozilla Security Advisories: wrong link
and I was wrong about the sourceforge link - it also lists the ESR versions under that folder, so maybe rename that to Stable/ESR releases

Mozilla Security Advisories: wrong link ????  What is it meant to be?

^^ done https://www.mozilla.org/en-US/security/advisories/

don't want to link to the 3 articles on ghacks

It was four articles, and i linked the first one

Right, spose I better sent Martin that article then