CSI Driver support

Hi @mavimo  i think your last PR GH-258  for issue #256 not fully fix the problem.
We need add feature-gate options to kube-apiserver as well, otherwise CSI plugin failed with messages i described here (https://github.com/hetznercloud/csi-driver/issues/26)

@md2k I'll try to investigate it since I'm able to setup PVC on a new cluster created with the the code submitted in #258, I'll try to investigate the issue you reported ASAP, thx for feedback!

i'll double check again today evening, maybe i'm overlooked something.

Hi @mavimo  maybe you can advice what to do with CSI?
I0312 18:52:55.121932       1 csi_handler.go:524] Can't get CSINodeInfo k8s-dev-worker-04: csinodeinfos.csi.storage.k8s.io "k8s-dev-worker-04" not found
I0312 18:52:55.121981       1 csi_handler.go:388] Saving attach error to "csi-4f85d0c027dcff14997168efbc3674ba47e378f12476131bbd23449ee74359bc"
I0312 18:52:55.138679       1 csi_handler.go:398] Saved attach error to "csi-4f85d0c027dcff14997168efbc3674ba47e378f12476131bbd23449ee74359bc"
I0312 18:52:55.138740       1 csi_handler.go:103] Error processing "csi-4f85d0c027dcff14997168efbc3674ba47e378f12476131bbd23449ee74359bc": failed to attach: node "k8s-dev-worker-04" has no NodeID annotation
I0312 18:52:55.138671       1 controller.go:139] Ignoring VolumeAttachment "csi-4f85d0c027dcff14997168efbc3674ba47e378f12476131bbd23449ee74359bc" change
I0312 18:55:21.106674       1 controller.go:173] Started VA processing "csi-4f85d0c027dcff14997168efbc3674ba47e378f12476131bbd23449ee74359bc"
I0312 18:55:21.106750       1 csi_handler.go:93] CSIHandler: processing VA "csi-4f85d0c027dcff14997168efbc3674ba47e378f12476131bbd23449ee74359bc"
I0312 18:55:21.106766       1 csi_handler.go:120] Attaching "csi-4f85d0c027dcff14997168efbc3674ba47e378f12476131bbd23449ee74359bc"
I0312 18:55:21.106781       1 csi_handler.go:259] Starting attach operation for "csi-4f85d0c027dcff14997168efbc3674ba47e378f12476131bbd23449ee74359bc"
I0312 18:55:21.106975       1 csi_handler.go:214] PV finalizer is already set on "pvc-9d45199b-44f7-11e9-888a-9600001dd99b"
I0312 18:55:21.112911       1 csi_handler.go:524] Can't get CSINodeInfo k8s-dev-worker-04: csinodeinfos.csi.storage.k8s.io "k8s-dev-worker-04" not found
I0312 18:55:21.112978       1 csi_handler.go:388] Saving attach error to "csi-4f85d0c027dcff14997168efbc3674ba47e378f12476131bbd23449ee74359bc"
I0312 18:55:21.124336       1 csi_handler.go:398] Saved attach error to "csi-4f85d0c027dcff14997168efbc3674ba47e378f12476131bbd23449ee74359bc"
I0312 18:55:21.124387       1 csi_handler.go:103] Error processing "csi-4f85d0c027dcff14997168efbc3674ba47e378f12476131bbd23449ee74359bc": failed to attach: node "k8s-dev-worker-04" has no NodeID annotation
I0312 18:55:21.124817       1 controller.go:139] Ignoring VolumeAttachment "csi-4f85d0c027dcff14997168efbc3674ba47e378f12476131bbd23449ee74359bc" change

PVC and PV created... but it won't mount

i found that nodes where csi filed to attach pv i not have such annotation: csi.volume.kubernetes.io/nodeid: {"csi.hetzner.cloud":"xxxxxxx"} , if i understood correctly they set by hcloud-csi-node ?

Ok this one problem solved , template for Hetzner CSI nodes does not have toleration section and i'm use taints.
this one missing from pods spec:
tolerations:
  - operator: Exists
    effect: NoExecute
  - operator: Exists
    effect: NoSchedule

to deploy daemonset to any node

@md2k currently implements it as plugin (I mean do not enable CSI on cluster setup but update it after cluster creation) is a bit tricky, maybe we can keep the current implementation on the "core" and create plugin to setup all needed configs, like:

CRD for CSIDriver
CRD for CSINodeInfo
Secret
Storage class
...

WDYT?

yeah for exactly current moment , true we need add it as plugin because otherwise we need re-create clusters with a tools, but probably after plugin will be in place we can set as flag, to enable plugin during roll-out for new clusters?

i can take a look into, but as with previous PR from me, i'm a bit run-out of time this and next week (main work), after i'm planing back to PR and have few more ideas in mind.

@md2k np, i'm also a bit busy and I have no time to support you on the other PR (sorry), I'll try to find some more time... I need a Tardis to find some more time 🕐

Did anyone find a solution to making the csi driver work?

I guess adding
extraArgs:     feature-gates: CSINodeInfo=true,CSIDriverRegistry=true
in the ClusterConfiguration (v1beta1) would fix it.

@suchwerk thx, I'll try it and after test send a PR (I hope today)

You should also ensure that the iscsid on the node(s) is enabled and started.

@suchwerk after few test I'm unable to find a solution, so need more investigation.
Adding:
extraArgs:
  feature-gates: CSINodeInfo=true,CSIDriverRegistry=true

seems ignore it.
Adding:
featureGates:
  CSINodeInfo: true
  CSIDriverRegistry: true

generate indicate that this feature gate are not supported:
stdout:[featureGates: Invalid value: map[string]bool{"CSIDriverRegistry":true, "CSINodeInfo":true}: CSINodeInfo is not a valid feature name., featureGates: Invalid value: map[string]bool{"CSIDriverRegistry":true, "CSINodeInfo":true}: CSIDriverRegistry is not a valid feature name.]

I'll continue to investigate it on the next days, If you have time to test and do you find a working solution ping me!

I forgot to mention that you should also add to each node:
cat << EOF > /etc/default/kubelet
KUBELET_EXTRA_ARGS="--feature-gates=CSINodeInfo=true,CSIDriverRegistry=true"
EOF
systemctl restart kubelet

and the ClusterConfiguration/KubeletConfiguration:
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
networking:
  ...
apiServer:
  certSANs:
  ...
  extraArgs:
    feature-gates: CSINodeInfo=true,CSIDriverRegistry=true
etcd:
  external:
    endpoints:
...
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
featureGates:
  CSINodeInfo: true
  CSIDriverRegistry: true

I am not sure if the KubletConfiguration is a kind of redundant.

@suchwerk I think it is (redundant), maybe I need to include feature gate using:
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
networking:
  ...
apiServer:
  certSANs:
  ...
  extraArgs:
    - --feature-gates: CSINodeInfo=true,CSIDriverRegistry=true
etcd:
  external:
    endpoints:
...
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
featureGates:
  CSINodeInfo: true
  CSIDriverRegistry: true

syntax, I'll try ASAP and keep you updated.
Thx to point me in the right direction (I hope :P )

For me featureGates in the apiServer section did not work. (kubeadm.k8s.io/v1beta1) but:
extraArgs:
    feature-gates: CSINodeInfo=true,CSIDriverRegistry=true

And also consider: In Kubernetes 1.14 (will be relased on Monday) CSI Topology support is build in.
https://github.com/kubernetes/community/blob/master/contributors/design-proposals/storage/container-storage-interface.md#topology-representation-in-node-objects

I did not experienced any issues with the Hetzner CSI driver. I just ssh'ed into the server, enabled feature gates in kubelet and kube-apiserver and followed the "Getting Started".

I tested this and it worked. Therefore closed by #272


A fatal error has been detected by the Java Runtime Environment:  pid=18320

Please provide a brief summary of the bug
A fatal error has been detected by the Java Runtime Environment:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x0000019d99c61115, pid=18320, tid=26160

JRE version: OpenJDK Runtime Environment Temurin-<IP_ADDRESS>+1 (<IP_ADDRESS>+1) (build <IP_ADDRESS>+1)
Java VM: OpenJDK 64-Bit Server VM Temurin-<IP_ADDRESS>+1 (<IP_ADDRESS>+1, mixed mode, tiered, compressed oops, parallel gc, windows-amd64)
Problematic frame:
v  ~StubRoutines::atomic_add_long

No core dump will be written. Minidumps are not enabled by default on client versions of Windows
hs_err_pid18320.log
Did you test with the latest update version?

[ ] Yes

Please provide steps to reproduce where possible
No response
Expected Results
RUN Successfully
Actual Results
A fatal error has been detected by the Java Runtime Environment
What Java Version are you using?
java_jdk\<IP_ADDRESS>\
What is your operating system and platform?
No response
How did you install Java?
No response
Did it work before?
No response
Did you test with other Java versions?
No response
Relevant log output
No response

@PEIDONGLU Please try 11.0.23 and post the crash log here if it still persists


Fix the type of option reinstall_app in Screengrab tool

Checklist

[x] I've run bundle exec rspec from the root directory to see all new and existing tests pass
[x] I've followed the fastlane code style and run bundle exec rubocop -a to ensure the code style is valid
[x] I've read the Contribution Guidelines
[x] I've updated the documentation if necessary.

Description
Add the property is_string with value false to reinstall_app Screengrab options that need to have it.
Motivation and Context
This Screengrab option is a flag and need to be boolean type. If the property is_string is not set to false, Fastlane doesn't recognize it as boolean and crash with the error:

'reinstall_app' value must be a String! Found TrueClass instead.

@hjanuschka Hey, I open a Pull Request (#7923) that adds reinstall_app flag to Screengrab. In the file options.rb I copied the block of code of the flag exit_on_test_failure and change it to fit my new flag. But now, when I run Fastlane Screengrab, there is an error with this flag.

'reinstall_app' value must be a String! Found TrueClass instead.

So, I open this Pull Request adding is_string with value false. Can you tell me why the option exit_on_test_failure doesn't have it, and why I need to put it on reinstall_app?

@gersonmendes Thanks for putting this together.
Your fix looks correct to me, and my belief is that the other option is incorrect as well. As to the question of why the other is not causing a problem... I'm not sure without investigating more deeply.
I'm going to accept your change, and then we can make a new PR for the other option. 👍

@mfurtak Thanks for the reply.
I will try to investigate exit_on_test_failure flag, but I agree with you, the other option seems to be incorrect as well. I can create a new PR fixing the other option if you want, just let me know :)

i think exit_on_test_failure is faulty too - but it works (seems to) as it has a default_value:true
but a pr to improve it would be nice.

I've adjusted the other option here: https://github.com/fastlane/fastlane/pull/7981


How to predict edges for a Null graph?

I'm working on an information retrieval problem from the tables. Taking all the cells in a table as a node. Now, I want to predict all connections (edges) between cells (nodes).
Is there any way to do it with dlg4nlp?

I'm working on an information retrieval problem from the tables. Taking all the cells in a table as a node. Now, I want to predict all connections (edges) between cells (nodes).
Is there any way to do it with dlg4nlp?

@12seetharaman thanks for your interest to our library! Regarding your use case, you might want to take a look into dynamic graph construction which can jointly learn graph structure and graph representations with respect to the downstream prediction task. You might want to follow this example to learn how to call our dynamic graph construction APIs to suit your need.

Issue resolved and closed.

Thanks, @hugochan, Really helpful!


Fixed indentation, updated example to es6

I'm not sure converting the example to ES6 is really useful. If the user wants to change the ´var´ for a ´const´, he knows he can do it. This will also induce the lib is developed in ES6, which is not.
The indentation is fixed to the left because it's better for reading on small screens.


Only one snapshot is deleted when deleting multiple snapshots for a regular blob

Storage Explorer Version: 1.31.0-dev
Build Number: 20230614.1
Branch: main
Platform/OS: Windows 10/Linux Ubuntu 20.04/MacOS Ventura 13.4 (Apple M1 Pro)
Architecture: x64/arm64
How Found: From running test cases
Regression From: Previous release (1.30.0)
Steps to Reproduce

Expand one storage account -> Blob Containers.
Create a blob container -> Upload one blob.
Create two snapshots for the blob -> Go to the snapshots view.
Select the two snapshots -> Click 'Delete'.
Check whether the two snapshots disappear.

Expected Experience
The two snapshots disappear.
Actual Experience

Only one snapshot disappears.
Show '2 completed' in the delete activity log.

@v-xianya please consider this a by design behavior. We have removed old code that existed only for the purpose of supporting multi-snapshot delete.


correct _utf8Size function  & add exemple

[x] Have you followed the guidelines in our Contributing document?
[x] Have you checked to ensure there aren't other open Pull Requests for the same update/change?

Description
correct _utf8Size  function and add exemple;
_utf8Size('𠜎') return 6 should be 4
AssertionError: expected 'a:3:{s:2:"ü";s:2:"ü";s:3:"四";s:3:"四";s:6:"𠜎";s:6:"𠜎";}' to deeply equal 'a:3:{s:2:"ü";s:2:"ü";s:3:"四";s:3:"四";s:4:"𠜎";s:4:"𠜎";}'

Thanks!


lightos nova changes

This PR is not meant to be merged but just to give a view about what are the changes need to backport the driver to wallaby version.
TBD - extra existing patches should be added. this is just basic driver without further changes like volume states or minor fixes that were added later on.

@yuval-lb the way I would normally do such a change is to add the current yoga upsteream driver, unmodified, and then in follow-on patches make the changes needed to make it work for Wallaby. THis way the review can concentrate on the changes, and not the entire driver. I'ts not a huge deal since this is a pretty small driver, but that's the correct way to do it IMHO.

@yuval-lb the way I would normally do such a change is to add the current yoga upsteream driver, unmodified, and then in follow-on patches make the changes needed to make it work for Wallaby. THis way the review can concentrate on the changes, and not the entire driver. I'ts not a huge deal since this is a pretty small driver, but that's the correct way to do it IMHO.

There are no changes - its the just the commit from yoga.
The only real change happened in os-brick where I added another commit.


Parent mkDir permissions/ownership

I was having issues with home-manager interacting with sops-nix resulting from the defined parent mkDir behavior.
https://github.com/Mic92/sops-nix/blob/912f9ff41fd9353dec1f783170793699789fe9aa/pkgs/sops-install-secrets/main.go#L203
I was setting up storing my GitHub user credentials for gh by setting path to /home/<user>/.config/gh/hosts.yml, as well as setting up the config in home-manager which loads into /home/<user>/.config/gh/config.yml, but based on the systemd service load-order, sops-nix loads first and creates the parent directory with the permissions and ownership of its running process (i.e. root).
This might be fixable by having the parent directory/directories created with the permissions and/or ownership of their respective parents (recursively).

This one is tricky to solve. You could use systemd.tmpfile.rules to create the symlink to some other directory instead in the meantime.

Just ran into the same issue. Maybe adding an option specifying whether path parent directories should be created as root or as owner user would solve this.
I get one cannot generally assume the parent directories should be created as owner, but in my case (setting private ssh keys in the home directory) this is inevitable...


Added provider for Evernote

Evernote provider has been added.
Tested in a Xamarin project for iOS and Android.

@CarteKiwi thank you for the contribution! When I have time (in the next day or two ish) I'll look this over and give some feedback.

You're welcome.

@CarteKiwi sorry I didn't merge sooner. Now I feel bad 😞

@TerribleDev it's ok, don't worry. Better late than never ;)


RuntimeError in crf.py line 247

Hi,
I am trying to run the training demo using python 3.5 and torch 0.40 (with cuda on an NVIDIA 1050 GTX). I get the following error:
THCudaCheck FAIL file=/pytorch/aten/src/THC/generic/THCTensorCopy.c line=70 error=59 : device-side assert triggered /pytorch/aten/src/THC/THCTensorScatterGather.cu:97: void THCudaTensor_gatherKernel(TensorInfo<Real, IndexType>, TensorInfo<Real, IndexType>, TensorInfo<long, IndexType>, int, IndexType) [with IndexType = unsigned int, Real = long, Dims = 2]: block: [0,0,0], thread: [0,0,0] AssertionindexValue >= 0 && indexValue < src.sizes[dim]failed. /pytorch/aten/src/THC/THCTensorScatterGather.cu:97: void THCudaTensor_gatherKernel(TensorInfo<Real, IndexType>, TensorInfo<Real, IndexType>, TensorInfo<long, IndexType>, int, IndexType) [with IndexType = unsigned int, Real = long, Dims = 2]: block: [0,0,0], thread: [1,0,0] AssertionindexValue >= 0 && indexValue < src.sizes[dim]failed. /pytorch/aten/src/THC/THCTensorScatterGather.cu:97: void THCudaTensor_gatherKernel(TensorInfo<Real, IndexType>, TensorInfo<Real, IndexType>, TensorInfo<long, IndexType>, int, IndexType) [with IndexType = unsigned int, Real = long, Dims = 2]: block: [0,0,0], thread: [2,0,0] AssertionindexValue >= 0 && indexValue < src.sizes[dim]failed. /pytorch/aten/src/THC/THCTensorScatterGather.cu:97: void THCudaTensor_gatherKernel(TensorInfo<Real, IndexType>, TensorInfo<Real, IndexType>, TensorInfo<long, IndexType>, int, IndexType) [with IndexType = unsigned int, Real = long, Dims = 2]: block: [0,0,0], thread: [3,0,0] AssertionindexValue >= 0 && indexValue < src.sizes[dim]failed. /pytorch/aten/src/THC/THCTensorScatterGather.cu:97: void THCudaTensor_gatherKernel(TensorInfo<Real, IndexType>, TensorInfo<Real, IndexType>, TensorInfo<long, IndexType>, int, IndexType) [with IndexType = unsigned int, Real = long, Dims = 2]: block: [0,0,0], thread: [4,0,0] AssertionindexValue >= 0 && indexValue < src.sizes[dim]failed. /pytorch/aten/src/THC/THCTensorScatterGather.cu:97: void THCudaTensor_gatherKernel(TensorInfo<Real, IndexType>, TensorInfo<Real, IndexType>, TensorInfo<long, IndexType>, int, IndexType) [with IndexType = unsigned int, Real = long, Dims = 2]: block: [0,0,0], thread: [5,0,0] AssertionindexValue >= 0 && indexValue < src.sizes[dim] failed. Traceback (most recent call last):   File "/home/spike/Software/PyCharm/helpers/pydev/pydevd.py", line 1668, in <module>     main()   File "/home/spike/Software/PyCharm/helpers/pydev/pydevd.py", line 1662, in main     globals = debugger.run(setup['file'], None, None, is_module)   File "/home/spike/Software/PyCharm/helpers/pydev/pydevd.py", line 1072, in run     pydev_imports.execfile(file, globals, locals)  # execute the script   File "/home/spike/Software/PyCharm/helpers/pydev/_pydev_imps/_pydev_execfile.py", line 18, in execfile     exec(compile(contents+"\n", file, 'exec'), glob, loc)   File "/home/spike/Projects/NCRFpp/main.py", line 434, in <module>     train(data)   File "/home/spike/Projects/NCRFpp/main.py", line 326, in train     loss, tag_seq = model.neg_log_likelihood_loss(batch_word,batch_features, batch_wordlen, batch_char, batch_charlen, batch_charrecover, batch_label, mask)   File "/home/spike/Projects/NCRFpp/model/seqmodel.py", line 43, in neg_log_likelihood_loss     total_loss = self.crf.neg_log_likelihood_loss(outs, mask, batch_label)   File "/home/spike/Projects/NCRFpp/model/crf.py", line 262, in neg_log_likelihood_loss     gold_score = self._score_sentence(scores, mask, tags)   File "/home/spike/Projects/NCRFpp/model/crf.py", line 247, in _score_sentence     tg_energy = tg_energy.masked_select(mask.transpose(1,0)) RuntimeError: cuda runtime error (59) : device-side assert triggered at /pytorch/aten/src/THC/generated/../THCReduceAll.cuh:339
Does anyone know what might be causing this error?

PyTorch 0.4 is currently not supported. You may look the readme more carefully. We are currently work on the compatibility of Python 3. You can try Python 2 and PyTorch 0.3 in safe.

Right, my mistake. Thank you for the quick response! It runs now.


Mark tests that use remote data

In Debian, we run the build time and CI tests without access to the internet. This makes some of the poliastro tests fail.
To handle this, there is the "pytest-remotedata" package (and the "pytest-doctestplus" package for doctests) that add a "remotedata" option to pytest. Both packages are already pulled with the "astropy-helpers" package. This patch adds the options on the necessary places.
Would you consider applying this to make my life easier here? Thanks!

Thanks a lot @olebole, sure thing! We do not use astropy-helpers so we'll have to add pytest-doctestplus and pytest-remotedata in the extras_requires[dev] section of setup.cfg.

Also, this will need a rebase.

I rebased the branch to current master, and added the required pytest packages.

"No module named 'astropy.tests.pytest_plugins'"
Hmmm... We'll have to investigate I guess.

Comes from https://github.com/astropy/astroquery/blob/master/astroquery/conftest.py, perhaps we're using an old version?

The fix hasn't been released: https://github.com/astropy/astroquery/commit/27f5c4d05f57b0e5871637ac4d936a64127007b4

In any case, it's weird that it tries to collect the tests twice.

============================= test session starts ==============================
platform linux -- Python 3.7.4, pytest-5.1.0, py-1.8.0, pluggy-0.12.0
Matplotlib: 3.1.1
Freetype: 2.6.1
rootdir: /home/circleci/repo, inifile: setup.cfg
plugins: mpl-0.10, remotedata-0.3.2, mypy-0.3.3, doctestplus-0.3.0, cov-2.5.1
collecting ... collected 0 items / 1 errors

==================================== ERRORS ====================================
________________________ ERROR collecting test session _________________________
venv/lib/python3.7/site-packages/_pytest/config/__init__.py:436: in _importconftest
    return self._conftestpath2mod[conftestpath]
E   KeyError: local('/home/circleci/repo/venv/lib/python3.7/site-packages/pandas/conftest.py')

During handling of the above exception, another exception occurred:
venv/lib/python3.7/site-packages/_pytest/config/__init__.py:442: in _importconftest
    mod = conftestpath.pyimport()
venv/lib/python3.7/site-packages/py/_path/local.py:701: in pyimport
    __import__(modname)
venv/lib/python3.7/site-packages/_pytest/assertion/rewrite.py:143: in exec_module
    exec(co, module.__dict__)
venv/lib/python3.7/site-packages/pandas/conftest.py:7: in <module>
    import hypothesis
E   ModuleNotFoundError: No module named 'hypothesis'

@pllim I suspect this happens because venv is in the same directory, and pytest is scanning everything. I'll try an alternative way in Circle CI.

At least now I can reproduce the issue locally.

Planning to rebase on top of https://github.com/poliastro/poliastro/pull/766.

According to https://github.com/poliastro/poliastro/pull/768:

Just adding pytest.mark.remote_data to the extra tests works OK :heavy_check_mark:
Only adding pytest-doctestplus and marking a test makes the test collection FAIL :red_circle:
Only adding pytest-remotedata works OK :heavy_check_mark:

@olebole unfortunately this prevents us from disabling the doctest for now, but perhaps #768 is better than nothing, while we figure out what's happening?

I am not sure I understand this… both pytest-remotedata and pytest-doctestplus should be added to the dependencies. In my environment, this works (and I already uploaded the package with this patch to Debian unstable). I use version of astroquery 0.3.9, with this patch.

I am not sure I understand this…

Sorry for the noise! Now I managed to understand it myself.
pytest was looking into .tox, venv or similar for tests, finding spurious conftest.py files, and crashing in weird ways. I modified pytest configuration so this doesn't happen, now the tests should pass.

Ready :) Thanks @olebole for opening this can of worms, which ended up in a much nicer poliastro!

Well, thank you for this good cooperation! It is always great when upstream is so responsive to the needs of those who do packaging.


ASN1 decode  mistake

The same code snippet reads the first element of the ASN1Sequence structure in signedValue. der. Since the first element has a large number of bytes, the first 100 bytes are selected to obtain different results ,The result format is hex. When I open the file with HEX editor, the result of Version 1.62 is correct compared to the result of reading, so the version >= Version 1.63 may have a bug in reading some files with ASN1 decoding, The sample file contains the name signedValue.der in the attachment (SignedValue.zip)
[SignedValue.zip](https://github.com/bcgit/bc-java/files/9278029/SignedValue.zip)

import java.io.ByteArrayInputStream;
import java.nio.file.Files;
import java.nio.file.Paths;

import org.bouncycastle.asn1.ASN1InputStream;
import org.bouncycastle.asn1.ASN1Primitive;
import org.bouncycastle.asn1.ASN1Sequence;
import org.bouncycastle.util.encoders.Hex;

public class Diff {

    public static void main(String[] args) throws Exception {
    String path = "replace it with a local .der file  path  ";
    byte[] stream = Files.readAllBytes(Paths.get(path));
    ASN1InputStream din = new ASN1InputStream(new ByteArrayInputStream(stream));
    ASN1Primitive pkcs = din.readObject();
    ASN1Sequence signedData = (ASN1Sequence) pkcs;
    //the first element
    ASN1Sequence tbs_sign = (ASN1Sequence) signedData.getObjectAt(0);
    byte[] tbs_sign_bytes = tbs_sign.getEncoded();
    // get 100 byte
    byte[] hex_bytes = Hex.encode(tbs_sign_bytes, 0, 100);
    // show result as hex
    System.out.println(new String(hex_bytes));
    din.close();
    }
  }

##################################################################
Bouncy Castle version 1.62 and 1.62 below

org.bouncycastle
bcprov-jdk15on
1.62

Result :
308303158402010430830315273083031153301316024553020104160a537577656c6c5f53444b161049434243526563656970743030303031308203ed0201010c39e4b8ade59bbde5b7a5e59586e993b6e8a18ce882a1e4bbbde69c89e99990e585ace5
Bouncy Castle version 1.63 and 1.63 above

org.bouncycastle
bcprov-jdk15on
1.63
Result :
308303158c020104308303152d3083031159301316024553020104160a537577656c6c5f53444b161049434243526563656970743030303031308203f30201010c39e4b8ade59bbde5b7a5e59586e993b6e8a18ce882a1e4bbbde69c89e99990e585ace5

The submission is duplicate


V0.19.0 release

bumped version number
moved changelog to standalone file (it's getting long!)
deleted those pesky __init__.py files bc:

they're  not needed
I don't remember why I added them
now they're gone less clicking in VS Code to open these dirs...

I thought this would be a quick PR, but now our connection tests are failing for no good reason that I can think of...

I thought this would be a quick PR, but now our connection tests are failing for no good reason that I can think of...

Everything works great when running pytest locally, but not when running with tox. I get this weird error:
ERROR: Cannot install dbt-sqlserver 0.19.0 (from /Users/mikaelene/dev/dbt-sqlserver) because these package versions have conflicting dependencies.

The conflict is caused by:
    The user requested dbt-sqlserver 0.19.0 (from /Users/mikaelene/dev/dbt-sqlserver)
    The user requested dbt-sqlserver 0.19.0 (from /Users/mikaelene/dev/dbt-sqlserver)

Everything works great when running pytest locally, but not when running with tox. I get this weird error:
ERROR: Cannot install dbt-sqlserver 0.19.0 (from /Users/mikaelene/dev/dbt-sqlserver) because these package versions have conflicting dependencies.

The conflict is caused by:
    The user requested dbt-sqlserver 0.19.0 (from /Users/mikaelene/dev/dbt-sqlserver)
    The user requested dbt-sqlserver 0.19.0 (from /Users/mikaelene/dev/dbt-sqlserver)


filelog seems to only process the first entry in the "include" list

Version: otelcol-sumo version v0.57.2-sumo-1
OS: Amazon Linux 5.10.135-122.509.amzn2.x86_64
If I use the following config snippet:
  filelog/audit:
    include:
      - /var/log/audit/*.log
      - /var/log/messages
      - /var/log/secure
    include_file_name: false
    include_file_path_resolved: true
    operators:
      - type: move
        from: attributes["log.file.path_resolved"]
        to: resource["log.file.path_resolved"]
    start_at: beginning

Here's what I've observed in the journal output of otelcol-sumo:
Oct 07 15:25:34 <host> otelcol-sumo[23315]: 2022-10-07T15:25:34.317-0700        info        fileconsumer/file.go:164        Started watching file        {"kind": "receiver", "name": "filelog", "pipeline": "logs", "component": "fileconsumer", "path": "/var/log/audit/audit.log"}

Only that one path shows up.
So, I changed the config snippet to the following:
  filelog/audit:
    include:
      - /var/log/audit/*.log
    include_file_name: false
    include_file_path_resolved: true
    operators:
      - type: move
        from: attributes["log.file.path_resolved"]
        to: resource["log.file.path_resolved"]
    start_at: beginning
  filelog/messages:
    include:
      - /var/log/messages
    include_file_name: false
    include_file_path_resolved: true
    operators:
      - type: move
        from: attributes["log.file.path_resolved"]
        to: resource["log.file.path_resolved"]
    start_at: beginning
  filelog/secure:
    include:
      - /var/log/secure
    include_file_name: false
    include_file_path_resolved: true
    operators:
      - type: move
        from: attributes["log.file.path_resolved"]
        to: resource["log.file.path_resolved"]
    start_at: beginning

And now I see the following in the journal:
Oct 07 23:57:41 <host> otelcol-sumo[10970]: 2022-10-07T23:57:41.924-0700        info        fileconsumer/file.go:164        Started watching file        {"kind": "receiver", "name": "filelog/secure", "pipeline": "logs", "component": "fileconsumer", "path": "/var/log/secure"}
Oct 07 23:57:41 <host> otelcol-sumo[10970]: 2022-10-07T23:57:41.929-0700        info        fileconsumer/file.go:164        Started watching file        {"kind": "receiver", "name": "filelog/audit", "pipeline": "logs", "component": "fileconsumer", "path": "/var/log/audit/audit.log"}
Oct 07 23:57:41 <host> otelcol-sumo[10970]: 2022-10-07T23:57:41.933-0700        info        fileconsumer/file.go:164        Started watching file        {"kind": "receiver", "name": "filelog/messages", "pipeline": "logs", "component": "fileconsumer", "path": "/var/log/messages"}

I forgot to mention, I made some changes to the otelcol-sumo.service file:
 [Service]
-ExecStart=/usr/local/bin/otelcol-sumo --config /etc/otelcol-sumo/sumologic.yaml --config "glob:/etc/otelcol-sumo/conf.d/*.yaml"
-User=opentelemetry
+EnvironmentFile=-/etc/default/otelcol-sumo
+ExecStart=/usr/bin/otelcol-sumo --config /etc/otelcol-sumo/config.yaml
+User=root
 Group=opentelemetry
-MemoryHigh=2000M
-MemoryMax=3000M
+MemoryLimit=200M
 TimeoutStopSec=20

The important changes are:

running as root, in order to read those logs files in /var/log.
use MemoryLimit, as the systemd version on Amazon Linux does not support the other two directives.
reduce the memory limit, since our machines are much smaller
and drop the glob for config, because I'm not sure it is supported in v0.52.7

Maybe it did open all the other entries under include, but log only the first entry to systemd journal. Here's the output of lsof on the PID of otelcol-sumo:
[root@host otelcol-sumo]# lsof -p 30010
COMMAND     PID USER   FD      TYPE             DEVICE  SIZE/OFF     NODE NAME
otelcol-s 30010 root  cwd       DIR              202,1       257       96 /
otelcol-s 30010 root  rtd       DIR              202,1       257       96 /
otelcol-s 30010 root  txt       REG              202,1 148656128  8960963 /usr/bin/otelcol-sumo
otelcol-s 30010 root  mem-W     REG              202,1     20480   563664 /var/lib/sumologic/file_storage/receiver_journald_
otelcol-s 30010 root  mem-W     REG              202,1    102400   563662 /var/lib/sumologic/file_storage/receiver_filelog_
otelcol-s 30010 root  mem-W     REG              202,1     20480   563661 /var/lib/sumologic/file_storage/exporter_sumologic__metrics
otelcol-s 30010 root  mem-W     REG              202,1  14577664   563660 /var/lib/sumologic/file_storage/exporter_sumologic__logs
otelcol-s 30010 root  mem-W     REG              202,1     20480   563659 /var/lib/sumologic/file_storage/exporter_sumologic__traces
otelcol-s 30010 root    0r      CHR                1,3       0t0        4 /dev/null
otelcol-s 30010 root    1u     unix 0xffff888007085c00       0t0  4645621 socket
otelcol-s 30010 root    2u     unix 0xffff888007085c00       0t0  4645621 socket
otelcol-s 30010 root    3u     unix 0xffff888007084c00       0t0  4645627 socket
otelcol-s 30010 root    4u  a_inode               0,12         0    10780 [eventpoll]
otelcol-s 30010 root    5r     FIFO               0,11       0t0  4645626 pipe
otelcol-s 30010 root    6w     FIFO               0,11       0t0  4645626 pipe
otelcol-s 30010 root    7u     IPv6            4645639       0t0      TCP *:ddi-tcp-1 (LISTEN)
otelcol-s 30010 root    8u     IPv4            4645655       0t0      TCP xxxx:60084->yyyy:https (ESTABLISHED)
otelcol-s 30010 root    9u     IPv6            4645680       0t0      TCP *:13133 (LISTEN)
otelcol-s 30010 root   10uW     REG              202,1     20480   563659 /var/lib/sumologic/file_storage/exporter_sumologic__traces
otelcol-s 30010 root   11uW     REG              202,1  14577664   563660 /var/lib/sumologic/file_storage/exporter_sumologic__logs
otelcol-s 30010 root   12uW     REG              202,1     20480   563661 /var/lib/sumologic/file_storage/exporter_sumologic__metrics
otelcol-s 30010 root   13u     IPv6            4645681       0t0      TCP *:4317 (LISTEN)
otelcol-s 30010 root   14u     IPv6            4645682       0t0      TCP *:4318 (LISTEN)
otelcol-s 30010 root   15uW     REG              202,1    102400   563662 /var/lib/sumologic/file_storage/receiver_filelog_
otelcol-s 30010 root   16u     IPv4            4645691       0t0      TCP xxxx:60856->yyyy:https (ESTABLISHED)
otelcol-s 30010 root   17uW     REG              202,1     20480   563664 /var/lib/sumologic/file_storage/receiver_journald_
otelcol-s 30010 root   18r     FIFO               0,11       0t0  4645692 pipe
otelcol-s 30010 root   19r      REG              202,1    898342   408107 /var/log/audit/audit.log
otelcol-s 30010 root   20r      REG              202,1   1401117 12595930 /var/log/messages
otelcol-s 30010 root   21r      REG              202,1<PHONE_NUMBER>5931 /var/log/secure
otelcol-s 30010 root   22r      REG              202,1      1839 12583011 /var/log/yum.log
otelcol-s 30010 root   23u     IPv4            4645706       0t0      TCP xxxx:35524->yyyy:https (ESTABLISHED)

It seems despite the journal record (or lack thereof) it is working with multiple entries under include.


Bump dataplane-operator

Depends-On: https://github.com/openstack-k8s-operators/data-plane-adoption/pull/253

/test openstack-operator-build-deploy-kuttl

recheck

recheck

recheck kernel panic

recheck RETRY_LIMIT

recheck kernel panic

/override rdoproject.org/github-check

/lgtm

/approve

recheck

recheck

recheck unrelated failures

recheck

@pablintino proposal: last recheck? the expected job did pass, so imho if the next one is also seeing a CRC crash (that's the issue with the tempest job), we should discard zuul and get the patch in. This will unlock other PRs and, hopefully, alleviate the pressure we have on our team - and give us some more time to properly debug the crc crashes.
@rabi OK for you?

recheck
unwanted crash due to depends-on update

recheck

/override rdoproject.org/github-check


Request for Chinese Version of Your Plugin

I would like to express my admiration for the plugin you have developed. It has brought great convenience and efficiency to my work. I couldn't help but wonder if having a Chinese version of the plugin would make it even more perfect. Since there are many Chinese users who are also using it, adding a Chinese version would greatly improve the user experience for them.
I have also noticed that some Chinese self-media bloggers have recently recommended your software, indicating that your plugin has begun to attract attention in the Chinese market.
I hope you can take my suggestion into consideration and add a Chinese version, which will benefit more Chinese users with your great plugin. Once again, thank you for your work and effort.

Hi @mxtao123, thanks for the suggestion. I will add it to the list for the next version.


Can I scroll up and down? Multiple data

If I understand that correctly, you want to have multiple Marquees on top of each other? That should work if their height is constrained, for example by putting them inside a SizedBox with a specific height.
Or do you want the Marquee to scroll vertically? Then you can always set the scrollDirection.

If I understand that correctly, you want to have multiple Marquees on top of each other? That should work if their height is constrained, for example by putting them inside a SizedBox with a specific height.
Or do you want the Marquee to scroll vertically? Then you can always set the scrollDirection.


spec-number

数字
n -> int
N -> bigint
\d+        -> int(\d+)
\d*.\d+ -> decimal(\d+, \d+)
m -> decimal(16, 2)
M -> decimal(20, 6)


using pi pico instead of pro micro controller possible?

This is a question - not an issue.. Not sure where to ask it. Sorry if it is not the correct forum.
Is it possible to use the pi pico mcu based pro micro form factor controllers instead of the atmega pro micro. I know the mcu operating voltage is different. Has anyone used it with the pcb here?
eg controller here https://www.aliexpress.us/item/3256805943704472.html

Yes- with the use of the QMK converter tools: https://docs.qmk.fm/#/feature_converters?id=supported-converters
The particular board you link falls under "rp2040_ce"

Thank you @keyboard-magpie that was very useful

for anyone who is interested here is the repo for corne+vial using promicro rp2040 from aliexpress
https://github.com/pathnirvana/vial-qmk/tree/vial/keyboards/crkbd/keymaps/vial_rp2040


'/bin/sh' not found in 'alpine:3.17'

'/bin/sh' not found in 'alpine:3.17'
os: CentOS7
install command: sudo yum install kurtosis-cli
kurtosis-cli version: kurtosis-cli-0.89.3-1.x86_64
run command: kurtosis run --enclave l1_eth_testnet github.com/kurtosis-tech/ethereum-package --args-file network_params.yaml

Could you please use an enclave name that has no _ chars in them? As thats not an allowed character.

Are you trying to use a private repository? https://github.com/kurtosis-tech/kurtosis/commit/2f0d638c688828de3eb781b11d696883807357ba Looks like this PR added functionality for you to login to github and access private repos. Did you use this ?

您能否使用_其中不含字符的飞地名称？因为那不是允许的角色。

Could you please use an enclave name that has no _ chars in them? As thats not an allowed character.

sorry, this is my mistake, really can't use '_'

Are you trying to use a private repository? kurtosis-tech/kurtosis@2f0d638 Looks like this PR added functionality for you to login to github and access private repos. Did you use this ?

I am running "kurtosis github login' on the server, because it cannot jump to the browser and an error will be reported.

cc: @tedim52

Are you trying to use a private repository? kurtosis-tech/kurtosis@2f0d638 Looks like this PR added functionality for you to login to github and access private repos. Did you use this ?

I am running "kurtosis github login' on the server, because it cannot jump to the browser and an error will be reported.

this problem also occurs when running "kurtosis web login' on the server.

kurtosis engine start --github-auth-token

i did that, but it still didn't work

I found the problem. There is alpine:3.17 in my docker image list. I deleted it and re-run it and it was successful.

thanks


Creating array of resources that should be cached available to serviceworker

The current implementation to precache resources which we deem necessary is as below

As discussed with @ehmadzubair, since the content on the app is dynamic, we would need to find a way access these resources dynamically. Ehmad suggested an interesting way to action this using a sitemap related implementation.

Related to #67

@ChrisMarsh82 this is done and you can close this.


OpenWhisk Reference typos

Hello there!
I found and fixed a couple of typos in OpenWhisk Reference (available here: https://new-console.ng.bluemix.net/docs/openwhisk/openwhisk_reference.html).

Thanks @marvelousNinja for the corrections. Merging.


Add View in Spelunker integration

Similar to #29, but inside this WOF Editor app add an external link out to "View in Spelunker", which pops people over there so the whole record can be introspected.

Added a "view in spelunker" link:

Working for me!


KQL queries in faviconUrl

testing out the serp preview section i notice that i can't use KQL to use the
"{{ site.url }}"/path/to/favicon.ico
it's not really important just mentioning

Why do you need the site URL for the favicon, isn't the absolute path /path/to/favicon.ico sufficient?

Thanks for the feedback!

Why do you need the site URL for the favicon, isn't the absolute path /path/to/favicon.ico sufficient?

i am only developing locally. and using e.g.
/path/to/favicon.ico

kirby panel does not seem to follow the root path so i would have to hardcode... (it may also just be a misconfiguration from me...)
/localdemo/assets/icon/favicon.ico

which may always change. just thinking it's more handy to have the flexibility for site.url


DOC: Use TypeScript syntax on /v0.2/docs/tutorials/chatbot/ code block

Checklist

[X] I added a very descriptive title to this issue.
[X] I included a link to the documentation page I am referring to (if applicable).

Issue with current documentation:
The code block on this page uses Python syntax rather than TS.
const model = new ChatOpenAI(model="gpt-3.5-turbo");

Idea or request for content:
Update it to:
const model = new ChatOpenAI({ model: "gpt-3.5-turbo" });

Thanks, fixed!


Remove use of type_traits from fixed_point

None of these appear to be necessary.
https://github.com/johnmcfarlane/fixed_point/blob/master/doc/p0037r2.md#required-specializations
While at it, remove sg14::_fixed_point_type from fixed_point.h.

https://github.com/johnmcfarlane/fixed_point/pull/151


tests: untrimmed stdout assertion (fix #1235)

Also fixed issues in cat and join uncovered after removing the
trimming above.

IIRC I noticed this a while ago but got caught up with something and forgot to fix the issue.  Good catch!

Thanks!


Precise wording for Virtual WAN

Original wording sounds like Hubs within one VWAN can't communicate, which would defy the purpose of VWAN.
Please validate this fact with the PG.
Credit: @erjosito

Docs Build status updates of commit edf940f:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

articles/virtual-wan/virtual-wan-about.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

@cherylmc
Can you review the proposed changes? IMPORTANT: When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

FWIW, I fully agree with Tomas' suggestion

Hi, just checking in on the status here :)

Hey @cherylmc , I think @Tbohunek 's proposal is spot on. Can we approve it?

@cherylmc - Can you review this old PR and determine whether it needs to be closed or merged?
IMPORTANT: When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.

#sign-off. I'll make some copy edits to this after we merge in, as Virtual WAN is the name of the service and a "virtual WAN" is the name of the resource etc.


Additional CI maintanence

These are low priority jobs for ci.

[ ] update daily-build badge
[ ] delete outdated daily build
[ ] migrate coverage report to airflow
[ ] migrate to a legit database

:octocat: cibot: Thank you for posting issue #1235. The person in charge will reply soon.

There are some undone work but it's low priority and likely to stale so closing


Added flag to only generate the witness

Faster but may get some tests to pass that shouldn't.

Reopening as it seems it mysteriously disappeared

I'll let you double-check before merging @BGluth


Generalizing LaunchPad WB

What are the issues this pull addresses (issue numbers / links)?
Generalizing LauncPadWB
Did you add tests to cover your changes (yes/no)?
Yes
Did you update the documentation accordingly (yes/no)?
Yes
Did you read the CONTRIBUTING document (yes/no)?
Yes
Summary
Details and comments

I went ahead and modified the variable names and defaults to align to the original ones. This way the user will get the benefit of this PR without disruption.
Note: To obtain the dimensions originally suggested by Figet, the following options have to be used:
pad_width='300um',
pad_gap='150um',
pad_height='300um',
neck_height='200um',
note that I changed the pad_gap math to provide the singel-side gap width number (original proposal required sum of both sides, which was inconsistent with the transmission line)
What is left to do before we can approve:

[ ] restore the lead_length math, which was removed in the proposed PR (variable name was reused for transmission line width). Then test all the notebooks for equivalency.


Deleted Conda-Store environments showing up in kernel selector

Context
It looks like the launchpad kernel selector is picking up environments that have been deleted via conda-store. In the screenshot, below the environments named "mytest*" have been deleted and should no longer be available to select.

Exploring a bit further, This may be an issue in nebari/conda-store not cleaning up old environments on disk when deleted in conda-store. Will file an issue on those repos.
Value and/or benefit
deleted environments showing up cause confusion.
Anything else?
No response

It is still remains, the bug could be in the nb_conda_kernels in the logic for removal of environments here but I do not see anything wrong at a first glance.
We could add an environment list-based rather than time-base cache upstream to solve this. Listing all environments should be relatively cheap, or at least I hope it is.

upstream issue: https://github.com/nebari-dev/nebari/issues/2608
I deleted those environments over a month ago. They can also be see running conda env list from the terminal so I think this is not a kernel issue but that they are not being deleted from disk when deleted in the conda-store UI.


Implement of DOMString type

The DOMString type
To ensure interoperability, the DOM specifies the DOMString type as follows:

A DOMString is a sequence of 16-bit quantities. This may be expressed in IDL terms as:
   typedef sequence<unsigned short> DOMString;

Applications must encode DOMString using UTF-16 (defined in Appendix C.3 of [UNICODE] and Amendment 1 of [ISO-10646]).The UTF-16 encoding was chosen because of its widespread industry practice. Please note that for both HTML and XML, the document character set (and therefore the notation of numeric character references) is based on UCS-4. A single numeric character reference in a source document may therefore in some cases correspond to two array positions in a DOMString (a high surrogate and a low surrogate). Note: Even though the DOM defines the name of the string type to be DOMString, bindings may used different names. For, example for Java, DOMString is bound to the String type because it also uses UTF-16 as its encoding.

Note: As of August 1998, the OMG IDL specification included a wstring type. However, that definition did not meet the interoperability criteria of the DOM API since it relied on encoding negotiation to decide the width of a character.

https://www.w3.org/TR/REC-DOM-Level-1/level-one-core.html#ID-C74D1578

현재는 DOMString을 str의 alias로 사용하고 있다.


KeyError: "Passing list-likes to .loc or [] with any missing labels is no longer supported

Im Running LongQC in my snakemake Nanopore genome pipe as on a cluster with no admin rights.
rule LongQC:
    input:
        'filtered_reads/{sample}.fastq.gz',
    output:
        'QC_results/{sample}',
    threads: t
    shell:
        '''
        python ~/SCRATCH_NOBAK/workplace_5z/LongQC/longQC.py sampleqc -x ont-ligation --ncpu {threads} -o {output} {input}
        '''

It runs fine with no error from minimap until the end.
I attached the output (without subsample.fastq[to big]) i think only the .html report is missing
A22.zip
Strange is it worked twice when testing after make:
python ~/SCRATCH_NOBAK/workplace_5z/LongQC/longQC.py sampleqc -x ont-ligation --ncpu 100 -o ~/SCRATCH_NOBAK/workplace_5z/LongQC/hybrid/A22 ~/SCRATCH_NOBAK/workplace_5z/hybrid/reads/long/A22.fastq.gz

Error
longQC:2021-04-07 12:55:48,036:489:INFO:Genarated the sample read length plot.
longQC:2021-04-07 12:55:48,037:491:INFO:Throughput: 500003168
longQC:2021-04-07 12:55:48,037:492:INFO:Length of longest read: 69248
longQC:2021-04-07 12:55:48,037:493:INFO:The number of reads: 57175
longQC:2021-04-07 12:55:48,038:524:INFO:Calculating overlaps of sampled reads...
longQC:2021-04-07 12:55:58,047:524:INFO:Calculating overlaps of sampled reads...
longQC:2021-04-07 12:56:08,055:524:INFO:Calculating overlaps of sampled reads...
longQC:2021-04-07 12:56:18,063:524:INFO:Calculating overlaps of sampled reads...
longQC:2021-04-07 12:56:28,071:524:INFO:Calculating overlaps of sampled reads...
longQC:2021-04-07 12:56:38,079:524:INFO:Calculating overlaps of sampled reads...
longQC:2021-04-07 12:56:48,087:524:INFO:Calculating overlaps of sampled reads...
longQC:2021-04-07 12:56:58,095:522:INFO:Process 66315 for ~/SCRATCH_NOBAK/workplace_5z/LongQC/minimap2-coverage/minimap2-coverage terminated.
longQC:2021-04-07 12:56:58,096:526:INFO:Overlap computation finished.
longQC:2021-04-07 12:57:08,103:598:INFO:Generating coverage related plots...
lq_coverage:2021-04-07 12:57:08,118:121:INFO:Estimating coverage distribution..
lq_coverage:2021-04-07 12:57:08,186:571:DEBUG:GaussianMixture(n_components=2)
lq_coverage:2021-04-07 12:57:08,192:576:INFO:The order of componens 0.009008786180148729 0.001502131247968907
lq_coverage:2021-04-07 12:57:08,192:577:INFO:Means of components: 77.92692972768067 52.171159446345385 k=2
lq_coverage:2021-04-07 12:57:08,192:578:INFO:Covariances of components: 76.03986535434747<PHONE_NUMBER>2634 k=2
lq_coverage:2021-04-07 12:57:08,229:123:INFO:Estimation of coverage distribution finished.
lq_coverage:2021-04-07 12:57:08,795:392:INFO:Coordinates of coverage analysis were parsed.
Traceback (most recent call last):
  File "~/SCRATCH_NOBAK/workplace_5z/LongQC/longQC.py", line 956, in <module>
    main(args)
  File "~/SCRATCH_NOBAK/workplace_5z/LongQC/longQC.py", line 62, in main
    args.handler(args)
  File "~/SCRATCH_NOBAK/workplace_5z/LongQC/longQC.py", line 611, in command_sample
    lc.plot_length_vs_coverage(fig_path_cl)
  File "/scratch/blumenscheitc/workplace_5z/LongQC/lq_coverage.py", line 479, in plot_length_vs_coverage
    self.__check_outlier_coverage(interval)
  File "/scratch/blumenscheitc/workplace_5z/LongQC/lq_coverage.py", line 500, in __check_outlier_coverage
    meds = stats['median'][np.where(stats['size']>=LqCoverage.LENGTH_BIN_THRESHOLD)[0]]
  File "~/.conda/envs/bio39/lib/python3.8/site-packages/pandas/core/series.py", line 877, in __getitem__
    return self._get_with(key)
  File "~/.conda/envs/bio39/lib/python3.8/site-packages/pandas/core/series.py", line 912, in _get_with
    return self.loc[key]
  File "~/.conda/envs/bio39/lib/python3.8/site-packages/pandas/core/indexing.py", line 895, in __getitem__
    return self._getitem_axis(maybe_callable, axis=axis)
  File "~/.conda/envs/bio39/lib/python3.8/site-packages/pandas/core/indexing.py", line 1113, in _getitem_axis
    return self._getitem_iterable(key, axis=axis)
  File "~/.conda/envs/bio39/lib/python3.8/site-packages/pandas/core/indexing.py", line 1053, in _getitem_iterable
    keyarr, indexer = self._get_listlike_indexer(key, axis, raise_missing=False)
  File "~/.conda/envs/bio39/lib/python3.8/site-packages/pandas/core/indexing.py", line 1266, in _get_listlike_indexer
    self._validate_read_indexer(keyarr, indexer, axis, raise_missing=raise_missing)
  File "~/.conda/envs/bio39/lib/python3.8/site-packages/pandas/core/indexing.py", line 1321, in _validate_read_indexer
    raise KeyError(
KeyError: "Passing list-likes to .loc or [] with any missing labels is no longer supported. The following labels were missing: Int64Index([0], dtype='int64', name='Binned read length'). See https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#deprecate-loc-reindex-listlike"
Error in job LongQC while creating output file QC_results/A22.
RuleException:
CalledProcessError in line 33 of /scratch/blumenscheitc/workplace_5z/long_reads_preprocess/Snakefile:
Command '
        python ~/SCRATCH_NOBAK/workplace_5z/LongQC/longQC.py sampleqc -x ont-ligation --ncpu 100 -o QC_results/A22 filtered_reads/A22.fastq.gz
        ' returned non-zero exit status 1
  File "/scratch/blumenscheitc/workplace_5z/long_reads_preprocess/Snakefile", line 33, in __rule_LongQC
  File "/usr/lib/python3.5/concurrent/futures/thread.py", line 55, in run
Removing output files of failed job LongQC since they might be corrupted:
QC_results/A22
Skipped removing non-empty directory QC_results/A22
Will exit after finishing currently running jobs.
Exiting because a job execution failed. Look above for error message

Hello @CptChiler,
Thank you for your interest in LongQC! This is maybe the same issue with #23.
I pushed revised codes just before, and could you clone the latest repo of LongQC?
As you mentioned, steps until minimap2 finished without error. Table parsing step had some issues.
Version 1.2.0b should be able to handle your datasets faced some issues.
$python longQC.py --version
The command should return "LongQC 1.2.0b".
Yoshinori

Thanks for the fast answer @yfukasawa,
after new cloning its calling -> LongQC 1.2.0b and now its works perfectly.
Heads up for this amazing QC tool, good job mate.


CAD-1401: Check log symlink before removing.

description
This PR fixes a small bug: https://github.com/input-output-hk/cardano-node/issues/1501. Now we explicitly check if symLinkPath exists before removing it.
checklist

[ ] compiles (cabal v2-build or stack build)
[ ] tests run successfully (cabal v2-test or stack test)
[ ] documentation added
[ ] link to an issue
[ ] add milestone (the current sprint)

bors r+


[BUG] Grayskull doesn't clean temporary directories

Describe the bug
My /tmp partition becomes filled after running grayskull pypi ... a couple of times
To Reproduce
Steps to reproduce the behavior:

Run grayskull pypi ...
Observe that there are /tmp/grayskull-* directories which have not been removed after the command has finished

Expected behavior
grayskull automatically removes temporary directories after usage
Environment:
grayskull --version
0.8.5

Should it? As far as I know it is up to the distro to set up a cleaning routine for the /tmp directory.
For example: https://askubuntu.com/questions/20783/how-is-the-tmp-directory-cleaned-up

Hi @spinoch , thanks for taking the time to report it. But as @ocefpaf mentioned that is not really a bug, as the temporary folders are managed by the OS and are cleaned periodically.
If you want to, we are open to improvements, and I suggest maybe create an option called --clean-tmp and it will clean the temporary folders which grayskull created after it finishes. That should not be difficult to implement, we are very open to new contributors if you want to try it :)

I will close this as was explained that it is not a bug. Thanks for your time reporting it.

Ah, I thought this was standard practice in software engineering.

That should not be difficult to implement, we are very open to new contributors if you want to try it :)

I would like to, but time constraints... Perhaps on my next batch of creating conda-forge recipes ;)


New Repository request: data-exchange-csv

What type of help do you need?
A new repository has been requested by the Data Exchange team: Marcelo Caldas (mcq1) called data-exchange-csv.
Admins: Marcelo Caldas - mscaldas2012, Matt Krystof - mkrystof

[ ] Question
[x] New Repo
[ ] Delete Repo
[ ] User Membership (please make sure new members are familiar with the CDC open practices and set up their profile with name and org info to help people collaborate with them)
[ ] Other

Please describe how you'd like us to help.

Repository created. Added them as admin, but may be missing one more admin.


pull request for e2e test at 12/15/2016 16:56:20

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


cmd/compile: == and != comparisons of addresses of symbols not handled consistently

What version of Go are you using (go version)?
1.9, 1.10, tip
Does this issue reproduce with the latest release?
Yes, but not with 1.8 or older releases.
What operating system and processor architecture are you using (go env)?
linux amd64
What did you do?
https://play.golang.org/p/KyovZxzxQfS
What did you expect to see?
Either "equal" or "unequal" should be printed. Go 1.8 printed "equal".
What did you see instead?
No output.
It seems that the problem is caused by CL 38338, which added a SSA rule to simplify a comparison of the addresses of two symbols (even when those addresses are numerically identical):
(EqPtr (Addr {a} x) (Addr {b} x)) -> (ConstBool [b2i(a == b)])

However, the negated form of this rule is missing, so the compiler still emits a numeric comparison of the two addresses for the second comparison in the code. Adding this rule optimizes away that comparison and fixes the program output (to "unequal"):
(NeqPtr (Addr {a} x) (Addr {b} x)) -> (ConstBool [b2i(a != b)])

@randall77

I don't think this is a bug.
The language spec says:

Pointers to distinct zero-size variables may or may not be equal.
I admit that it's a bit weird that they are both equal and not equal at the same time.  But a valid program should not be relying on the result in any case.

That said, I'm not adverse to the fix you suggested.  It seems harmless enough.

I have read that line in the language spec, but have always understood it as saying that the equality may change from one Go release to the next; I didn't think of it as possibly causing inconsistent behaviour. The risk is that a program using an imported type may not necessarily know that the type is zero-width, and could be surprised by this behaviour.
Alternatively, instead of treating this as a bug fix, it could be considered an improvement to CL 38338, by optimizing the other kind of comparison as well.

I admit that it's a bit weird that they are both equal and not equal at the same time. But a valid program should not be relying on the result in any case.

I guess, although I think (a == b) || (a != b) should always evaluate to true, whether guaranteed by the spec or not.

I guess, although I think (a == b) || (a != b) should always evaluate to true, whether guaranteed by the spec or not.

I think this assumption is similar to the one that a == a should always evaluate to true. But it does not. Neither does your particular example always evaluate to true in, for example, sql (when a and/or b is NULL).

I'll weigh in for team bug.
The spec defines !p to mean "not p", and u == v and u != v to mean "u equals v" and "u not equals v", respectively. By composition, it follows that !(u == v) also means "u not equals v", which should then be the same as u != v. (This is basically @josharian's (a == b) || (a != b) argument framed differently.)
I argue this is a bug because it violates this constraint. This program should either print not equal 1\nnot equal 2\n, or nothing at all: https://play.golang.org/p/cPI8UBx-GBB
I acknowledge the spec could be more precise in its description of comparing pointers to zero-width variables, but I think the simplest interpretation is that "equal" and "not equal" are exclusive relations that hold indefinitely for any two values. I think if we really wanted to admit the current behavior, we should revise the spec to explicitly state that results may by different for each comparison (of pointer to zero-width variables).


Access to the S3

Hello @patryciabp  and I can't access to the s3 bucket since today.
We have this error:
'The AWS Access Key Id you provided does not exist in our records.'
Thank you in advance for your answer.

Hi @ArilessTir - not sure if the s3 bucket you are referencing is OS-C's or on BNPP's side, but OS-C credentials required rotation yesterday.  You can obtain new keys from https://console-openshift-console.apps.odh-cl1.apps.os-climate.org/k8s/ns/sandbox/secrets/physrisk-s3-keys

Hi Heather,
Thanks it works


HDDS-11235. Spare InfoBucket RPC call in FileSystem#mkdir() call.

What changes were proposed in this pull request?
In BasicRootedOzoneFileSystem#mkdir() method we use getBucket in all circumstances, as that call is also used to create the bucket if it does not exists.
However, this results in a GetBucketInfo RPC call every time, even when the bucket exists, and we create a key with this call. In this latter case we should not call getBucket() but use the RPCClient (ClientProtocol) directly using the bucket name to create the directory.
In order to achieve functional parity with the old approach, I have extracted the logic that handles non existent volumes and buckets in the getBucket() call, and in createDirectory I am changing the getBucket call also to directly call getBucketInfo if keyStr is not present.
The RpcClient#createDirectory change is to ensure verification of the volume and bucket name that was done by the getBucket call earlier in the client adapter impl.
What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-11235
How was this patch tested?
I have created a special client that logs RPC calls that it makes, and ran mkdir FS API calls with a client that emits some additional logs.
Logging in this client was added to the OzoneManagerProtocolClientSideTranslatorPB@submitRequest call, nothing else was changed to get the logging.
Output before the change:
Submitting RPC request: ServiceList
Creating base directory /pifta/test/dir in Ozone
Submitting RPC request: InfoBucket
Submitting RPC request: CreateDirectory
After the change the same code using fs.mkdirs() generates the following output:
Submitting RPC request: ServiceList
Creating base directory /pifta/test/dir in Ozone
Submitting RPC request: CreateDirectory
This test above was done against a directory that was created in an exiting volume and bucket.
I tested the following scenarios after addressing missing volume and bucket creation for the new code, the test uses fs.mkdirs() to create a path:
Volume does not exists, and creating a directory multiple levels down the tree:
Submitting RPC request: CreateDirectory
Submitting RPC request: CreateVolume
Submitting RPC request: CreateBucket
Submitting RPC request: CreateDirectory
Volume exists, but bucket does not exist, and creating a directory multiple levels down the tree:
Submitting RPC request: CreateDirectory
Submitting RPC request: CreateBucket
Submitting RPC request: CreateDirectory
Volume and bucket exists, and creating directory multiple levels down the tree:
Submitting RPC request: CreateDirectory
Volume and bucket does not exists, and creating bucket:
Submitting RPC request: InfoBucket
Submitting RPC request: CreateVolume
Submitting RPC request: CreateBucket
Volume exists, and creating bucket:
Submitting RPC request: InfoBucket
Submitting RPC request: CreateBucket
Creating volume:
Submitting RPC request: CreateVolume
When I tried to supply empty path, or "/" as a path, then the code did not send any RPCs besides the getServiceInfo, which is being sent at FileSystem initialization.
Interestingly, if I try to create a volume twice that leads to a VOLUME_ALREADY_EXISTS, while if I try to create a bucket or a key twice, then the secondary call does not throw an already exists exception (it did not do it originally either), however the code suggest that it was an intention to throw a FileAlreadyExistsException at least... I leave this part of the functionality unchanged.

In the face of concurrency we can still have behavior that is not optimal. We should eventually offload create volume/bucket/path as a single OM API for HFCS compatibility.

@kerneltime yes, I absolutely agree, here is what is in my head currently:
This change is not really about getting rid of all non-optimal edge cases, the aim is to get rid of things that are easy to get rid of. My secondary goal is to gain experience in how our client is implemented, as I think we should not have any checks done on the client side that we can do only by doing an RPC.
At the end of the day I want to play with the idea of removing most of the checks from the client side and making it really thin, because, to be honest, we have to do these checks anyway on the server side also. All in all, once the easily removable excess RPCs are done, I am planning to come up with some larger re-design in this direction.
I am not sure if you had the time to check into the new changes, I would be glad to be sure that you still approve the current version.

Thank you for @tanvipenumudy and @kerneltime for the reviews!


Integration Test - Release - 2019/02/18 02:01:27

Auto create for integration test. IssueCommandFlow

@PRMergerTest2 : Thanks for your contribution! The author, @v-caxian, has been notified to review your proposed change.


Crunchyroll No video formats found

Checklist

[ X] I'm reporting a broken site support
[ X] I've verified that I'm running youtube-dl version 2020.07.28
[ X] I've checked that all provided URLs are alive and playable in a browser
[ X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[ X] I've searched the bugtracker for similar issues including closed ones

Verbose log

youtube-dl.exe https://www.crunchyroll.com/the-god-of-high-school/episode-4-marriagebonds-796231 --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://www.crunchyroll.com/the-god-of-high-school/episode-4-marriagebonds-796231', '--verbose']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2020.07.28
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.19041
[debug] exe versions: ffmpeg 4.0, ffprobe 4.0, rtmpdump 2.3
[debug] Proxy map: {}
[crunchyroll] 796231: Downloading webpage
[crunchyroll] 796231: Downloading adaptive_hls-audio-jaJP-hardsub-ptBR information
WARNING: Failed to download m3u8 information: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)>
[crunchyroll] 796231: Downloading adaptive_hls-audio-jaJP information
WARNING: Failed to download m3u8 information: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)>
[crunchyroll] 796231: Downloading adaptive_hls-audio-jaJP-hardsub-ruRU information
WARNING: Failed to download m3u8 information: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)>
[crunchyroll] 796231: Downloading adaptive_hls-audio-jaJP-hardsub-frFR information
WARNING: Failed to download m3u8 information: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)>
[crunchyroll] 796231: Downloading adaptive_hls-audio-jaJP-hardsub-arME information
WARNING: Failed to download m3u8 information: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)>
[crunchyroll] 796231: Downloading adaptive_hls-audio-jaJP-hardsub-deDE information
WARNING: Failed to download m3u8 information: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)>
[crunchyroll] 796231: Downloading adaptive_hls-audio-jaJP-hardsub-itIT information
WARNING: Failed to download m3u8 information: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)>
[crunchyroll] 796231: Downloading adaptive_hls-audio-jaJP-hardsub-esLA information
WARNING: Failed to download m3u8 information: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)>
[crunchyroll] 796231: Downloading adaptive_hls-audio-jaJP-hardsub-esES information
WARNING: Failed to download m3u8 information: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)>
[crunchyroll] 796231: Downloading adaptive_hls-audio-jaJP-hardsub-enUS information
WARNING: Failed to download m3u8 information: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)>
[crunchyroll] 796231: Downloading media info for 360p
[crunchyroll] 796231: Downloading stream info for 360p
[crunchyroll] 796231: Downloading m3u8 information
WARNING: Failed to download m3u8 information: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)>
[crunchyroll] 796231: Downloading media info for 720p
[crunchyroll] 796231: Downloading stream info for 720p
[crunchyroll] 796231: Downloading m3u8 information
WARNING: Failed to download m3u8 information: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)>
[crunchyroll] 796231: Downloading media info for 480p
[crunchyroll] 796231: Downloading stream info for 480p
[crunchyroll] 796231: Downloading media info for 1080p
[crunchyroll] 796231: Downloading stream info for 1080p
ERROR: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpq2whuxta\build\youtube_dl\YoutubeDL.py", line 797, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpq2whuxta\build\youtube_dl\extractor\common.py", line 530, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpq2whuxta\build\youtube_dl\extractor\crunchyroll.py", line 574, in _real_extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpq2whuxta\build\youtube_dl\extractor\common.py", line 1350, in _sort_formats
youtube_dl.utils.ExtractorError: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Description

Cannot download anything from crunchyroll. Not even with a cookie file and user-agent. I think the problem could be the new beta that changed the video format or something like that, but that's just guessing, I'm not sure the beta does anything for the old site even the url are different (for example https://beta.crunchyroll.com/watch/GRNV437G6/marriagebonds).

It still works for me, seems like the exe is not working anymore
try to install from the source code

Also you can try to upgrade your python version from 3.4.4 to 3.8.x Maybe this is the problem?

Also you can try to upgrade your python version from 3.4.4 to 3.8.x Maybe this is the problem?

On windows python is embedded into the binary.
I will try to install it from the source but I'm not sure I will be able to do it.

Ok this is strange but with --prefer-ffmpeg --no-check-certificate it's working for some reason (not all the times, but by tring 2-3 times I can download it), however I copied some files in the youtube-dl folder, including the updated ffmpeg static library, a not used python38.dll (the log still say python 3.4.4), and some files from the python 3.8.5 zip. Not really sure what I've done really maybe with this setup it was working before but only failed some times.
Still I think there is something wrong right now.

--prefer-ffmpeg --no-check-certificate This seems to work only with the non-premium content, for exemple if you try to log in with -u<EMAIL_ADDRESS>-p ............ it will give you the same error.

--prefer-ffmpeg --no-check-certificate This seems to work only with the non-premium content, for exemple if you try to log in with -u<EMAIL_ADDRESS>-p ............ it will give you the same error.

For premium content I suggest you to use both a cookie.txt file and a user agent string. it should work this way (at least it's working for me). I always also use username and password because sometimes it's the other way around (past updates).
I created a personal frontend with a webview that do that for me but you can do it manually, just remeber to log out and log in, and create a new cookie.txt each time (it will expire after a few hours).

I will try to install it from the source but I'm not sure I will be able to do it.

This also happens with the source code, so for the moment you can download only the non-premium content.
I'm not an expert but I suppose that crunchyroll made some changes to their site, so the only logical thing is that the extractor from crunchyroll.py got broken.
In fact it has not been updated since 3 months

I will try to install it from the source but I'm not sure I will be able to do it.

This also happens with the source code, so for the moment you can download only the non-premium content.
I'm not an expert but I suppose that crunchyroll made some changes to their site, so the only logical thing is that the extractor from crunchyroll.py got broken.
In fact it has not been updated since 3 months

like I said the problem is not that you cannot download premium content (you can with the cookies and user agent instead of username password), the problem is that it fail to download with the embedded python version even for free content


[BUG] By hoovering the button it still displays a blue one

Updating color scheming with following conversions.
1751ec => 51ec17
2051d3 => 51d320
1a4ac8 => 4ac81a
0d3dba => 3dba0d


Cleanup regex string

Signed-off-by: WillardHu<EMAIL_ADDRESS>Please provide a description of this PR:
Use raw string(...) with regexp.MustCompile to avoid having to escape twice

Hi @WillardHu. Thanks for your PR.
I'm waiting for a istio member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.
Once the patch is verified, the new status will be reflected by the ok-to-test label.
I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

/ok-to-test

@WillardHu: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Rerun command

integ-pilot-istiodremote-tests_istio
e8c516cba381579e2f1341b0792e4ee260d6c2e8
link
/test integ-pilot-istiodremote-tests_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest


[Issue] Existing resource references appear as "created" in output log

In templates we reference existing resources, like:
https://github.com/Azure-Samples/todo-nodejs-mongo-aca/blob/main/infra/app/api.bicep#L40
When we do an azd deploy on that file, those references are listed as "Created"

We should see if we can determine if the resource was referenced or created and update the output accordingly.

I was going to suggest something similar, though I was imagining three states: "Created", "Updated" (properties change), and "Already created" (something to signify no change). Don't know if that granularity is possible.

@vhvb1989 recent changes on UX improvements has this handled. Can we close this?

yeah, this is no longer valid


remove outdated version label

What type of PR is this?

/kind cleanup
What this PR does / why we need it:
Removes the outdated "version: 0.0.1" label from certificate deployment YAMLs.
Which issue(s) this PR fixes:

None
Does this PR introduce a user-facing change?:

NONE

what was this used for?
LGTM

I think this was just leftover from some kind of template, I could be wrong. Agree that we should remove it.
/lgtm


Document Texas Engagement in Learning Log - Sprint 100

Problem statement
This is an ongoing task to update the conversations and takeaways from Texas and their meetings about HIV.
What you need to know

Learning log

Acceptance criteria

[x] Learning log updated with recent conversations

Learning log has been updated.


🚀 Feature: I hope to have the registration function turned on and off

🔖 Feature description
Hope to make a management background, there is a super administrator, can manage all users, as well as configure website parameters, such as limit registration, limit upload and so on.
🎤 Pitch
Make the function more powerful

This is already implemented, isn't it? An admin can already manage users, enable/disable the registration and limit the share size. What do you want to have implemented?


Any issues refreshing your list of devices in the ISY?

I was having trouble getting it to refresh the list of light switches in the ISY and ended up having to remove the ISY completely from Smartthings and re-add the ISY as a new device.  It could just be me.... what steps do you take when you want to re-update the list of light switches?
Example: After adding the ISY to Smartthings, I installed new light switches in the ISY and I want the new switches to show up in Smartthings.

I'm transitioning away from Insteon so I hadn't tried it before, but I got a chance to try it this morning and the same thing happens here.  The SmartThings API doesn't handle single network addresses (the ISY-994i's) with multiple devices behind them very well, and unfortunately the workarounds mean you have to reinstall everything to add devices.

Oh man I'm bummed that you are going away from Insteon!  This open source project you wrote is saving me $1k+ in replacing fans, lights etc throughout my house.  Do you think with some coding love it's at least possible to re-pull up that screen in Smartthings and have it refresh the device list and checkmark the lights, etc?  As long as you think it's in the cards I can either try to find someone to code it or take a swing myself.  If you think it's totally impossible then maybe I won't try...

The shortcoming in the SmartThings API was that traffic from a particular network address (e.g. the ISY's) would always go to a single device, even if there were multiple devices behind that address.  The device list screen only works when the ISY's address is not registered to any devices.  So, you could try temporarily renaming the device that has the ISY's address to something else.
If you go to https://graph.api.smartthings.com/device/list, you'll see all your Insteon devices that have been configured, and most will have a device network ID consisting of 12 hex characters, a colon, and then the Insteon address.  For instance:
0123456789ab:cd ef 01 1
One of them won't have the colon or the Insteon address after it.  This receives all the traffic from the ISY.  If you edit that device and change the device network ID to something else, you should at least be able to see the complete device list from the ISY-994i again (go to My Home => SmartApps => ISY Connect - don't try to install a second copy of ISY Connect otherwise querying on/off status won't work).
This might let you install more devices, but I haven't tried it, so it may also mess things up and you'll have to remove ISY and reinstall it again.  If you decide to edit the code and have any questions, let me know and I can try to answer them.

What I did to get around the issue of getting all the devices back to the SmartApp to add additional devices was to add a state variable to the "primary device" (address w/o insteon address) then in the smart app rather than picking up the devices in the location handler I pickup the devices from the "primary app".

@bytemaster-0xff I like your approach - sounds like an elegant solution.  So did you have the parse function in the device type call the parent's locationHandler when the state variable was set, and then clear the state variable when configuration was complete?

@rllynch Here is the chunk of code I use to populate the lists on the primary page, if there isn't a primary devices as a child (deviceNetworkId == dni) then I assume the location handler in the smart app just parses and populates the current and allNodes.
def d
    d = getChildDevices()?.find {
        it.device.deviceNetworkId == dni
    }

	if(d == null){
    	log.debug "No matching children"
    }
    else {
    	log.debug "CURRENT NODES: " + d.state.currentNodes;
        state.currentNodes = d.state.currentNodes;
        state.allNodes = d.state.allNodes
    }
```

Thanks for the elegant solution @bytemaster-0xff
Could you give a little more context on how to add this to my custom app? I'm not familiar with Groovy and am having a hard time understanding where I should insert your code snippet.

I would like some additional info on this change as well if that isnt to much trouble.
I have the same issue where I am unable to edit the devices after the fact and deleting and recreating each time is painful.
Also would this same change also fix the Smattthings App status? If I use the switch paddle to change the state it takes a really long time for the update to be reflected I the app if at all?

I can't help with the code as I haven't tried it.  I don't add insteon devices anymore but the one time I did rebuild it was quite painful so I would love to see this fixed.
As for the state changes you have to rememeber there is no way to push that update.  You have to setup an app like pollster or use CORE to "refresh" the devices.  You just need to refresh one and it will go out and poll all the devices and the status is updated.   I am using pollster with an external call from google code that refreshes it ever 3 minutes.


How to setup gradient_accumulation?

Hi,
in order to train a model SetFit, I would like simulate a batch_size of 16 but with a batch_size of 8. For doing that, I need to setup gradient_accumulation to 2.
How to do that?
Thanks.

I'm afraid that gradient accumulation is not supported at this time. Hopefully this will be implemented some time soon. I suspect the main bottleneck for this is that SentenceTransformers, on which SetFit relies heavily, does not implement gradient accumulation in its fit method.
I hope this answers your question somewhat. I'll close this for the time being.


Displaying leave/join irc channel

How to display on discord channel when anyone leave/join irc channel?

"IrcStatusNotices": true
In config.json


Disabled grouped options get extra multiselect__option--group class

Fiddle to reproduce: https://jsfiddle.net/9etuLmj6/4
Upon having grouped options, where one of them is disabled and the option group-select is set to false (or not passed down as a prop), the option that should be disabled gets the extra class multiselect__option--group while it is clearly not a group.
Removing $isDisabled: true from the option or settings :group-select="true" on the multiselect will not set this class.
In the above example this can be seen because the option 'Adonis' is red or by inspecting the html.
This wouldn't really be a problem, until we want to apply custom css to option group headers.

I was facing the same issue. Created MR to fix the same.

@shentao I also need a solution to this problem

@shentao I'm wondering why multiselect__option--group also inherits multiselect__option--disabled right now they look exactly the same and that's confusing to differentiate between disabled items and group labels

also, has this been merged? Or not? confused that the case is still open but it points to a merged branch


[Nomination]

Who are you nominating?
What are you nominating them for?
Please provide links to their work.

I propose my candidacy. I am successfully participating in other ambassador programs


I cant reproduce the mentioned WER of 17%

Hello, I cant reproduce the results you got, can you help me? I used the provided released models and the minimum WER I got was 83%, am I doing something wrong? Should I train my own model to achieve this alleged 17% WER? Please help!

Hi @greboide, the metric reported is the CER (Character Error Rate) not WER (word error rate) since the code I provided does not have any language model.

My bad man, sorry for the confusion, do you have any pointers on how to add a language model?

You can check it out in the @SeanNaren repo, for example.


Duplicate dagger and daggerdbl

Duplicate entry for dagger and daggerdbl in 3 files:
GF-latin-plus_unique-glyphs.nam
filter lists/nice names/plus_unique-glyphs.txt
filter lists/uni names/plus_unique-glyphs.txt

GF Latin Plus glyphs sets are available in three different formats: .nam, nice-names-, and uni-names- filter lists for Glyphs App.

@alexeiva I know that.
Check these 4 lines:
https://github.com/googlefonts/tools/blob/master/encodings/GF Glyph Sets/GF-latin-plus_unique-glyphs.nam#L316
0x2020 † DAGGER
0x2020 † DAGGER
0x2021 ‡ DOUBLE DAGGER
0x2021 ‡ DOUBLE DAGGER

Same issue for the other files I mentioned earlier.


LL-4542 - app needs to be updated cta

https://ledgerhq.atlassian.net/browse/LL-4542

why is there 2000 flow errors again ? @machard


Choose file sends file as application/octet-stream, but needs text/csv

Hi,
I want to test functionality where user uploads csv file. And on server there is verification of the uploaded file type:
file_content_type != 'text/csv' && file_content_type != 'application/vnd.ms-excel'

When I make "Choose file" with Selenium2Library and submit, I get error from server that file type is incorrect. Basically it was sent as application/octet-stream type, but when I do the same manually, browser sends text/csv type.
Is it possible to add additional parameter to the keyword "Choose file", where will be possible to specify file type?
Example:

Keyword
locator
path
file type

Choose file
file
test.csv
text/csv

I'll take a look at this.

Okay, so I haven't messed with form uploads in a while and I was reading up on this.
I assume when you did this manually you pulled up the file browser dialog and selected the file that way. When the RF-S2L selects a file it simply types the file name into the upload dialog box. My hypothesis is that your browser then doesn't specify what the mime type for whatever reason and just falls back to application/octet-stream. The bad news here is, there's no way (that I have found) to set the mime type.
So technically as per your suggestion this doesn't seem to be possible. There may be a work around to fix your particular issue, but that'll require some more investigation. What browser are you testing this against?

Thanks for you response
After you commented, I've checked with other browsers that I have and results are:
Works on:

Firefox 37.0.1

Doesn't work on:

Chromium 41.0.2272.76 (webdriver 2.15)
google-chrome-stable 42.0.2311.135-1 (webdriver 2.15)

OS environment:
Ubuntu 14.04

Thanks for getting me that info @chevi!
After doing some more investigation into this it seems it's a issue with the chrome webdriver. This issue has also been reported on their ticket tracker here. I've mentioned that you're having an issue with it as well, but you're more than free to make a comment on that issue.
There's nothing really I can do on my side. Hopefully they'll fix that issue soon.


Other installation methods

Hello!
I was hoping you could consider adding installation methods :slightly_smiling_face:
Currently, the only available installation methods are Zulu, homebrew and manual installation.
While I like the prompt Zulu set for me, I'm not a fan of programs that change my shell environment without asking. Using homebrew on Linux, even if possible, does not seem so straight-forward.
I know nothing about these, but what about Zplug, Zgen or Antigen? Do they fill the same purpose as Zulu? Would they be good candidate as installation methods for ZUnit?
Also, coming from Bash, I started to use Basher for other projects, and like its cleanness and simplicity (it git clones shell projects from providers like github, gitlab, etc.). Basher supports Zsh (and Fish) as well, and I would love to be able to install ZUnit through it. The only problem I see is that ZUnit's installation seems to be in 2 steps: build, then install, which Basher would not support (it only clones stuff, and doesn't execute any custom code). Is the build step mandatory? Couldn't you directly provide the zunit executable script in the repo?

I know nothing about these, but what about Zplug, Zgen or Antigen? Do they fill the same purpose as Zulu? Would they be good candidate as installation methods for ZUnit?

You should be able to install zunit through zplug or any of the these. Here is an example from my zshrc:
https://github.com/MichaelAquilina/swayconfig/blob/master/zshrc#L30-L40
I do agree however that this should be ideally available through a distros package manager. I was considering adding this to the opensuse build service for example.

I have actually added docs for installation with zplug on the website, I guess I just forgot to add to the README.


Flat plane meshes disappear at specific y positions

I'm having a strange problem with flat MeshInstances not rendering if their global y position is exactly -1, or other specific values like -5 or +3 (every 4 units apart). I uploaded a test project to try figuring out what the issue is, and to make sure it isn't specific to my game.
As many details as I could get from the test project:

Non-flat meshes are fine.
The disappearances only happen at those specific, consistent values. Moving the tiles up or down by even 0.001 causes them to appear normally.
Whether the MeshInstance is saved in the scene or created at runtime makes no difference.
I added TestCubes as children of all the tiles. The TestCubes that are children of the "invisible" tiles are rendered normally, and in their correct positions.
The mesh used doesn't seem to matter; I originally had the problem with a simple quad exported from Blender, and the same thing happens with a simple plane created with SurfaceTool.
I don't know if it has anything to do with culling, but rotating the camera around to any angle has no effect on which tiles are visible.
The "invisible" tiles are also invisible in the editor.
In the editor, moving an "invisible" tile to a different y position does not make it visible again until the scene is saved and reloaded.

Screenshot from the test project showing the quads being rendered in most of the MeshInstances, but those at y = -5/-1/+3/etc. are invisible:

Issue #3253 might be the same, although these MeshInstances are invisible at runtime as well as in the editor.
Finally, I noticed an octree error that might be related while I was testing. As mentioned above, moving the problematic MeshInstances up/down by 0.001 makes them visible again (they only disappear at specific integer values); however, if I do this in a function while the game is running, instead of the tiles becoming visible again, I get this error message once for each "invisible" MeshInstance in the scene (but not for the properly rendered MeshInstances). Issue #3325 mentions this error as well, but in different circumstances.
Not sure how Godot's octree works, but because the "disappearing points" repeat consistently every 4 units, I wonder if completely flat meshes at the exact border between octree nodes are somehow not getting sorted into any node, and so not rendered at all. The octree error when moving "invisible" MeshInstances: ERR_FAIL_COND( e.octant_owners.front()==NULL );, from here.

Thanks for the excellent debugging, I have good hope that it might get fixed for 2.0 as it got narrowed down pretty well already.

I might be wrong but I think it's this change to aabb that is the issue https://github.com/godotengine/godot/commit/7006fe3cc4580b2ece75681c0adc1ab6ab27891a

@henkz1 Thanks, you're exactly right. Reverting that change fixes the issue.
So which is normally the desired behavior for AABB intersection tests? Should AABBs that share a face but not any internal volume be considered to intersect? If not (i.e. if the current behavior of AABB::intersect is correct), we could add a function AABB::intersect_inclusive that works like the old version of intersect, using >/< instead of >=/<=, and only change the octree to use intersect_inclusive. The octree's intersect test should be inclusive, since meshes on the border between two nodes are considered inside both nodes.

Good idea. It could also be an optional argument that defaults to false, e.g. AABB::intersect(const AABB& p_aabb, bool inclusive=false).

Any of you want to do a PR for this?


Support gas calculation

Note that this PR is WIP, so tests are not included
To see calculated gas run the test_gas_usage test from the crates/forge/tests/integration/syscalls.rs
and uncomment line nr 60 in the crates/forge-runner/src/printing.rs

Closes #834
Introduced changes

SierraCasmRunner was copied (and slightly modified) to enable gas calculation

Checklist

[x] Linked relevant issue
[ ] Updated relevant documentation
[ ] Added relevant tests
[x] Performed self-review of the code
[ ] Added changes to CHANGELOG.md

Please do not review 🔒  Changes are coming

My main concern with this PR is that we have to copy SierraCasmRunner from cairo repo because VM has pub(crate) fields and we are not able to access them after running the code.
Only CairoRunner can do it (since it is located in the same crate).

Ideally, we should be able to use SierraCasmRunner from the cairo repo and extract used resources directly from the VM.
However gas is calculated properly, so I'm pinging you @Arcticae and @MaksymilianDemitraszek

@war-in i am fine with copying it for the time being, with the priority to upstream the changes

Changelog still needs updating, and docs if applicable

Not sure tbh, because it does not affect users (I've removed printing)

As @piotmag769 and @Arcticae mentioned, we should add support for the onchain data.
Those are described here and we should implement this as soon as we close this PR.

Are there any test checking if gas from cheatnet is added to the final sum?

Are there any test checking if gas from cheatnet is added to the final sum?

Just added them https://github.com/foundry-rs/starknet-foundry/pull/1037/commits/10974de052c59908c031a3484aa74c99bb5c86db


Allow definition of styles in nested objects

We should allow definition of margin, border, padding etc via an object:
{
  margin: {
    top: '1px'
  }
}

vs marginTop in this case.

An immediate case that could make it hairy is interop between values. If I define the style as marginTop, once initialized can I modify via margin.top and visa versa?

I'm not sure I agree yet - what's wrong with enforcing "1 0 0 0"?

After more thought, this is very low priority, closing.


sc2: Added Pygalisks

Adding pygalisks.
Currently adding them on the Predator Nest, but I'm not completely happy with it, because the whole point is they're supposed to be accessible. Gave them a 60s cooldown and uncapped count by default, though that means merc upgrades can't realistically affect them. Currently 6 for 300 minerals (50 minerals per).
I buffed their stats slightly from Piercing the Shroud:

Damage +4 (4->8)
Life +25 (50->75)
Armor +1 (2->3)

Also gave them burrow and a chibified version of the Ultra's old Ram attack, at about half the attack speed of their vs units attack but 25 damage per attack.
I like the identity of a small, cheap, but durable army that has low DPS. They still melt vs anything that does more than zergling damage per attack lol.
TODO

[ ] Proper Unlock Trigger
[ ] Some upgrades

[ ] Ducal Blades (splash damage)
[ ] Stim (they are a dominion experiment)
[ ] Combat Carapace (more health, mashup of Combat Shield+Organic Carapace)
[ ] Rapid regeneration / some kind of regen ability. Maybe on burrow?

Changed around the wireframes and buttons a bit so you can more easily tell them apart from ultras in the command-card. Not fully happy with the button, it's kind of the wrong colour, but all the other ultralisk buttons are even more off (and the baseline one looks huge)

Tested with /send commands, everything unlocked properly (even the Predator nest on getting Pygalisks).

I'm not fully happy with them on the predator nest; it would be nice to see a different way to build them, but it will do for now until we agree on a better solution.

No HP upgrade, no upgrade icons


Adding tests for angle/torsion distribution and clustering

Description
First round of tests for analyze_foldamers.
These use a stored cgmodel and pdb files from a short replica exchange simulation.
The only module not tested is helical fitting which we still need to work on.
Status

[ ] Ready to go

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@35ca6b1). Click here to learn what that means.
The diff coverage is n/a.


Include Node type in Schema file

What is the current behavior?
I am using syntax Highligther like this
https://github.com/kumarharsh/graphql-for-vscode
Because the https://www.graph.cool/docs/reference/schema/system-artifacts-uhieg2shio/
namely the User and File Type implements the Node interface.
Syntax Highlight cannot work.
What is the expected behavior?
Include the Node interface in schema file.
This has at least two advantages

Transparency. The schema becomes clearer without documentation. (By the way I did not find documentation about the Node interface)

Allows for proper Syntax Highlighting.

All fields that are part of the interface should also exist on the Type. So I wonder why that affects syntax highlighting.

@kbrandwijk Because the Node Interface is missing..

You need to download the full schema file and point your tool towards that. You can look into https://github.com/graphcool/graphql-config for a nice tool to obtain & sync your schema.