kubelet is unable to mount NFS volumes for a pod

I've tried both CoreOS 991.2.0 and CoreOS 1000.0.0 with quay.io/coreos/hyperkube:v1.1.8_coreos.0.  In both cases the pods having NFS mounts fail.
Here is what strace reveals.
core@ip-10-0-24-116 /etc/systemd/system $ sudo strace -f -p 13201 -vs1024 -e execve,mount
Process 13201 attached with 14 threads
Process 17904 attached
[pid 17904] execve("/bin/mount", ["mount", "-t", "nfs", "files:/mnt/files", "/var/lib/kubelet/pods/86e248cc-f761-11e5-90a3-06f47eab549b/volumes/kubernetes.io~nfs/data"], ["PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"]) = 0
[pid 17904] mount("files:/mnt/files", "/var/lib/kubelet/pods/86e248cc-f761-11e5-90a3-06f47eab549b/volumes/kubernetes.io~nfs/data", "nfs", MS_MGC_VAL, NULL) = -1 EINVAL (Invalid argument)
[pid 17904] +++ exited with 32 +++

I am able to perform the mount by hand, on the host.  Here is what strace of that looks like.
core@ip-10-0-24-116 /etc/systemd/system $ sudo strace -f -vs1024 -e execve,mount mount files:/mnt/files /mnt/files
execve("/bin/mount", ["mount", "files:/mnt/files", "/mnt/files"], ["COREOS_PRIVATE_IPV4=<IP_ADDRESS>", "COREOS_PUBLIC_IPV4=<IP_ADDRESS>", "TERM=screen-256color", "PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:/opt/bin:/mnt/host/source/chromite/bin", "LESSCHARSET=utf-8", "MAIL=/var/mail/root", "LOGNAME=root", "USER=root", "USERNAME=root", "HOME=/root", "SHELL=/bin/bash", "SUDO_COMMAND=/bin/strace -f -vs1024 -e execve,mount mount files:/mnt/files /mnt/files", "SUDO_USER=core", "SUDO_UID=500", "SUDO_GID=500"]) = 0
Process 18450 attached
[pid 18450] execve("/sbin/mount.nfs", ["/sbin/mount.nfs", "files:/mnt/files", "/mnt/files", "-o", "rw"], ["COREOS_PRIVATE_IPV4=<IP_ADDRESS>", "COREOS_PUBLIC_IPV4=<IP_ADDRESS>", "TERM=screen-256color", "LESSCHARSET=utf-8", "LOGNAME=root", "USER=root", "USERNAME=root", "SUDO_COMMAND=/bin/strace -f -vs1024 -e execve,mount mount files:/mnt/files /mnt/files", "SUDO_USER=core", "SUDO_UID=500", "SUDO_GID=500"]) = 0
[pid 18450] mount("files:/mnt/files", "/mnt/files", "nfs", 0, "vers=4.2,addr=<IP_ADDRESS>,clientaddr=<IP_ADDRESS>") = -1 EPROTONOSUPPORT (Protocol not supported)
[pid 18450] mount("files:/mnt/files", "/mnt/files", "nfs", 0, "vers=4.1,addr=<IP_ADDRESS>,clientaddr=<IP_ADDRESS>") = 0
[pid 18450] +++ exited with 0 +++

Copying /sbin/mount.nfs and /lib64/libtirpc.so.1 into the container root, and running ldconfig -r ROOT gets NFS mounts to succeed.
I also ran into a problem with private DNS being unavailable in the kubelet container.  I used the RKT_OPTS fix described in #367 to work around this.

I'm not sure where the CoreOS hyperkube images come from.  Is there somewhere I should send this?

This is an appropriate place to track this issue. For reference the coreos hyperkube images are built from the release branches in the coreos/kubernetes repo: https://github.com/coreos/kubernetes/tree/coreos-hyperkube-v1.1.8/coreos
It is still somewhat in discussion how mount tools should be handled when running the containerized kubelet. One option is simply adding them to the hyperkube container. Another (longer term) option might be using shared mounts and 'utility' containers such that the tools themselves could be distributed independently of the application container, but then exposed via mounts.

Thanks for the pointer.  Adding nfs-common to the hyperkube Dockerfile worked to create a hyperkube image that can mount NFS.

These tools are also missing on the v1.2.0_coreos and v1.2.2_coreos images as well.
Following the CoreOS kubernetes deployment guide does not allow for NFS mounts for this reason.

Any idea when this might be added?

The workaround is to download and execute kubelet binary directly on coreos host.

Any progress here? This is a show stopper for deploying coreos with kubernetes in production.
I would be nice to be able to do that according to the official install instruction and not needing to create a variant kubelet.service which downloads kubelet directly to host instead.

The workaround for now is to mount in whatever you may require from the host as a volume, with RKT_OPTS:
https://coreos.com/kubernetes/docs/latest/kubelet-wrapper.html#customizing-rkt-options
For example, mounting in the host's resolv.conf:
[Service]
Environment="RKT_OPTS=--volume=resolv,kind=host,source=/etc/resolv.conf --mount volume=resolv,target=/etc/resolv.conf"
Environment=KUBELET_VERSION=v1.2.3_coreos.0
ExecStart=/usr/lib/coreos/kubelet-wrapper \
  --api-servers=http://<IP_ADDRESS>:8080 \
  --config=/etc/kubernetes/manifests

This only sort of works for nfs. It would require mounting both /sbin/mount.nfs and a missing shared library. Where this gets weird is that you're relying on most shared libs existing in the container (debian), but then a single shared lib from the host (coreOS). Last time I tested this it required bind mounting /lib64/libtirpc.so.1 to /usr/lib/x86_64-linux-gnu/libtirpc.so.1 -- but this was just mucking around and not something I would really recommend doing.

This seems to be fixed in https://github.com/coreos/kubernetes/releases/tag/v1.2.4%2Bcoreos.1

nfs-common is installed on it yes but I still can't get nfs to mount due to rpc.statd not running.
Found that after determining the kubelet doesn't get the dns settings from the host it's running so doesn't resolve the storage urls.

@Rio Did you try this? https://github.com/coreos/coreos-kubernetes/issues/372#issuecomment-218514725

@robszumski I had tried it several times and in several ways but it never worked. Kept getting access denied errors. However I just tried it again and now it does work. So just ignore what I said earlier ;)

I have still the rpc.statd problem with CoreOS 1010.5.0 and v1.2.4_coreos.1.
Output: mount.nfs: rpc.statd is not running but is required for remote locking.
mount.nfs: Either use '-o nolock' to keep locks local, or start statd.
mount.nfs: an incorrect mount option was specified

Same message on CoreOS 1068.0.0 and v1.2.4_coreos.1

@plaflamme. can you share your /etc/systemd/systemd/kubelet.service file? After updating my kubelet to v1.2.4_coreos.1 my nfs share was able to mount into pods.

@kbrwn here you go:
core@w2 ~ $ cat /etc/systemd/system/kubelet.service
[Service]
Environment=KUBELET_VERSION=v1.2.4_coreos.1
Environment=KUBELET_ACI=quay.io/coreos/hyperkube
ExecStartPre=/usr/bin/mkdir -p /etc/kubernetes/manifests
ExecStart=/usr/lib/coreos/kubelet-wrapper   --api-servers=https://<IP_ADDRESS>   --network-plugin-dir=/etc/kubernetes/cni/net.d   --network-plugin=   --register-node=true   --allow-privileged=true   --config=/etc/kubernetes/manifests   --hostname-override=<IP_ADDRESS>   --cluster_dns=<IP_ADDRESS>   --cluster_domain=cluster.local   --kubeconfig=/etc/kubernetes/worker-kubeconfig.yaml   --tls-cert-file=/etc/kubernetes/ssl/worker.pem   --tls-private-key-file=/etc/kubernetes/ssl/worker-key.pem
Restart=always
RestartSec=10

[Install]
WantedBy=multi-user.target
core@w2 ~ $

Interestingly, it eventually succeeded at mounting the volume, but only after I manually called sudo mount.nfs on that node to test that I was able to mount the volume manually.
For some reason, rpc.statd kept failing to start. Here's the relevant information from journalctl
Jun 09 02:13:40 w2 rpc.statd[7604]: Version 1.2.8 starting
Jun 09 02:13:40 w2 rpc.statd[7604]: Flags: TI-RPC
Jun 09 02:13:40 w2 rpc.statd[7604]: Failed to read /var/lib/nfs/state: Success
Jun 09 02:13:40 w2 rpc.statd[7604]: Initializing NSM state
Jun 09 02:13:40 w2 rpc.statd[7604]: failed to create RPC listeners, exiting
Jun 09 02:13:40 w2 kubelet-wrapper[1784]: E0609 02:13:40.430525    1784 kubelet.go:1780] Unable to mount volumes for pod "kube-registry-v0-51t17_kube-system(598b3299-2de6-11e6-a739-0800273afbf4)": Mount failed: exit status 32
Jun 09 02:13:40 w2 kubelet-wrapper[1784]: Mounting arguments: <IP_ADDRESS>:/Docker /var/lib/kubelet/pods/598b3299-2de6-11e6-a739-0800273afbf4/volumes/kubernetes.io~nfs/kube-system-kube-registry-pv nfs []
Jun 09 02:13:40 w2 kubelet-wrapper[1784]: Output: mount.nfs: rpc.statd is not running but is required for remote locking.
Jun 09 02:13:40 w2 kubelet-wrapper[1784]: mount.nfs: Either use '-o nolock' to keep locks local, or start statd.
Jun 09 02:13:40 w2 kubelet-wrapper[1784]: mount.nfs: an incorrect mount option was specified
Jun 09 02:13:40 w2 kubelet-wrapper[1784]: ; skipping pod

This repeated itself for about 15 minutes until this:
Jun 09 02:28:28 w2 sudo[22155]:     core : TTY=pts/0 ; PWD=/home/core ; USER=root ; COMMAND=/sbin/mount.nfs <IP_ADDRESS>:/Docker /tmp/patate/
Jun 09 02:28:28 w2 sudo[22155]: pam_unix(sudo:session): session opened for user root by core(uid=0)
Jun 09 02:28:28 w2 sudo[22155]: pam_systemd(sudo:session): Cannot create session: Already running in a session
Jun 09 02:28:28 w2 dbus[691]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service'
Jun 09 02:28:28 w2 systemd[1]: Starting Authorization Manager...
Jun 09 02:28:28 w2 polkitd[22165]: Started polkitd version 0.113
Jun 09 02:28:28 w2 polkitd[22165]: Loading rules from directory /etc/polkit-1/rules.d
Jun 09 02:28:28 w2 systemd[1]: Started Authorization Manager.
Jun 09 02:28:28 w2 polkitd[22165]: Loading rules from directory /usr/share/polkit-1/rules.d
Jun 09 02:28:28 w2 polkitd[22165]: Finished loading, compiling and executing 3 rules
Jun 09 02:28:28 w2 dbus[691]: [system] Successfully activated service 'org.freedesktop.PolicyKit1'
Jun 09 02:28:28 w2 polkitd[22165]: Acquired the name org.freedesktop.PolicyKit1 on the system bus
Jun 09 02:28:28 w2 polkitd[22165]: Registered Authentication Agent for unix-process:22161:131523 (system bus name :1.61 [/usr/bin/pkttyagent --notify-fd 4 --fallback], object path /
org/freedesktop/PolicyKit1/AuthenticationAgent, locale en_US.UTF-8)
Jun 09 02:28:28 w2 systemd[1]: Starting RPC Bind...
Jun 09 02:28:28 w2 systemd[1]: Reached target Host and Network Name Lookups.
Jun 09 02:28:28 w2 systemd[1]: Started RPC Bind.
Jun 09 02:28:28 w2 systemd[1]: Reached target RPC Port Mapper.
Jun 09 02:28:28 w2 systemd[1]: Starting NFS status monitor for NFSv2/3 locking....
Jun 09 02:28:28 w2 rpc.statd[22203]: Version 1.3.2 starting
Jun 09 02:28:28 w2 rpc.statd[22203]: Flags: TI-RPC
Jun 09 02:28:28 w2 rpc.statd[22203]: Failed to read /var/lib/nfs/state: Success
Jun 09 02:28:28 w2 rpc.statd[22203]: Initializing NSM state
Jun 09 02:28:28 w2 rpc.statd[22203]: Running as root.  chown /var/lib/nfs to choose different user
Jun 09 02:28:28 w2 systemd[1]: Started NFS status monitor for NFSv2/3 locking..
Jun 09 02:28:28 w2 polkitd[22165]: Unregistered Authentication Agent for unix-process:22161:131523 (system bus name :1.61, object path /org/freedesktop/PolicyKit1/AuthenticationAgen
t, locale en_US.UTF-8) (disconnected from bus)
Jun 09 02:28:28 w2 sudo[22155]: pam_unix(sudo:session): session closed for user root

So it looks like I ssh'ed into the node and tried to mount the volume manually which succeeded (because I later unmounted it). This seems to have successfully started rpc.statd which I guess then allowed the volume to be mounted correctly, because the pod successfully started soon after.
So it seems like rpc.statd fails to start until it was started as root. Maybe it's using the wrong privileges?

I was seeing same issue trying to mount nfs/3 through kubernetes with coreos 1010.6.0 and hyperkube v1.2.4_coreos.1
Output: mount.nfs: rpc.statd is not running but is required for remote locking.
mount.nfs: Either use '-o nolock' to keep locks local, or start statd.
mount.nfs: an incorrect mount option was specified

<timestamp> <host> rpc.statd[16092]: Version 1.2.8 starting
<timestamp> <host> rpc.statd[16092]: Flags: TI-RPC
<timestamp> <host> rpc.statd[16092]: Failed to read /var/lib/nfs/state: Success
<timestamp> <host> rpc.statd[16092]: Initializing NSM state
<timestamp> <host> rpc.statd[16092]: failed to create RPC listeners, exiting

Fixed it by starting the rpcbind service defined in /usr/lib/systemd/system - with systemctl start rpcbind. Maybe there should be a hook in kubelet when mounting nfs/3 ?
After rpcbind was started everything worked as expected.

Hi, same problem here. Manually mounting the share on the node with sudo, done the trick.
Tested on CoreOS stable (1010.6.0).

same with hyperkube v1.3.0_coreos.1 with kubelet-wrapper on latest stable (1010.6.0)

Guys. any idea how to hot fix this? Its critical for us, we can't setup our prod properly! HELP!

@Orpheus2015  You can create a service with the binary version of kubelet till this bug is fixed. I have been mounting NFS on kubernetes without any issues.
Add this on the service, the rest of the service you can find it here https://coreos.com/kubernetes/docs/latest/deploy-master.html
[Service] ExecStartPre=/usr/bin/mkdir -p /etc/kubernetes/manifests ExecStartPre=/usr/bin/mkdir -p /opt/bin ExecStartPre=/usr/bin/curl -s -L -o /opt/bin/kubelet -z /opt/bin/kubelet https://storage.googleapis.com/kubernetes-release/release/v1.2.4/bin/linux/amd64/kubelet ExecStartPre=/usr/bin/chmod +x /opt/bin/kubelet

I don't have problems anymore with kubelet-wrapper v1.3.0. You can also try to switch to nfsv3 rather than nfsv4 - for whatever reason, that works for me. Or as alogoc suggested, use the binary

I am running CoreOS stable (1122.2.0) and can confirm I need to run sudo systemctl start rpc-statd then my NFS mounts will work.

I am running CoreOS stable (1122.2.0) and can confirm I need to run sudo systemctl start rpc-statd then my NFS mounts will work.

I think the more appropriate thing is to start/enable nfs-client.target, which has an [Install] section. This makes it more appropriate for starting via cloud-config/ignition for greater immutability.

Running:
Kubernetes - v1.7.5+coreos.1
Tectonic - 1.7.5+tectonic.1
systemctl start rpc-statd fixed my issue (described by @alexanderkiel).
Also
systemctl enable rpcbind to enable it


BEAM-1542: Bump grpc-google-common-protos.version to support Cloud Spanner client.

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

[x] Make sure the PR title is formatted like:
[BEAM-<Jira issue #>] Description of pull request
[ ] Make sure tests pass via mvn clean verify. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
[x] Replace <Jira issue #> in the title with the actual Jira issue
number, if there is one.
[ ] If this contribution is large, please file an Apache
Individual Contributor License Agreement.

This unblocks https://github.com/apache/beam/pull/2166

Coverage increased (+0.003%) to 70.666% when pulling 22ce069f9117f098ffde062b1eeaa0d4d5b5497c on mairbek:bump-version into 8302783c3239ddcf8b5259b4aff8ee33673d02cd on apache:master.

Is this needed on its own? E.g., is the gRPC code broken at HEAD?
Otherwise, prefer to only make upgrades for a reason (like, part of Spanner support).

R: @dhalperi


Audio file could not be read as PCM WAV, AIFF/AIFF-C, or Native FLAC

I am recording voice using javascript in .wav format:
navigator.mediaDevices.getUserMedia({audio:true})
      .then(stream => {handlerFunction(stream)})

      function handlerFunction(stream) {
            rec = new MediaRecorder(stream);
            rec.ondataavailable = e => {
              audioChunks.push(e.data);
              if (rec.state == "inactive"){

                let blob = new Blob(audioChunks,{type:'audio/wav;codecs=0'});

                sendData(blob)
              }
            }
          }

sending the file to convert it to text using speech_recognition:
    filename = "name.wav"
    print(filename)
    data = request.body
    BASE_DIR = os.path.dirname(os.path.dirname(os.path.abspath(__file__)))
    uploadedFile = open(filename, "wb")
    uploadedFile.write(request.body)
    uploadedFile.close()
    #os.path.join(BASE_DIR,filename)
    r = sr.Recognizer()
    file = sr.AudioFile(filename)
    with file as source:
        audio = r.record(source)
    msg = r.recognize_google(audio)
    print(msg)
    return redirect('/')

getting Error:
ValueError: Audio file could not be read as PCM WAV, AIFF/AIFF-C, or Native FLAC; check if file is corrupted or in another format

audio is saving and sound is clear
audio file:https://drive.google.com/open?id=17ucX9xRG0x5-JEtZDFaotSNLlcRs0jZc

@Paritoshyadav did you get to the bottom of this? I got the same error and would be great to learn about your fix if any.

Try converting it using ffmpeg from the terminal (or use the os commands in python for doing it while the code is running)

Try converting it using ffmpeg from the terminal (or use the os commands in python for doing it while the code is running)

can you expain detail??

Try converting it using ffmpeg from the terminal (or use the os commands in python for doing it while the code is running)

can you expain detail??

@Asalle @cuongnguyengit  u need to install FFmpeg like:= https://github.com/kkroening/ffmpeg-python or from any other repo or lib that use FFmpeg and use it to convert the current file format to
PCM WAV, AIFF/AIFF-C, or Native FLAC format before processing it

Try converting it using ffmpeg from the terminal (or use the os commands in python for doing it while the code is running)

can you expain detail??

@Asalle @cuongnguyengit u need to install FFmpeg like:= https://github.com/kkroening/ffmpeg-python or from any other repo or lib that use FFmpeg and use it to convert the current file format to
PCM WAV, AIFF/AIFF-C, or Native FLAC format before processing it

https://github.com/kkroening/ffmpeg-python/blob/master/examples/README.md#convert-sound-to-raw-pcm-audio.
I found the following url, i see the url. can u indicate for me how to read the wav file?

@cuongnguyengit example:
stream = ffmeg.input(filename)
stream = ffmeg.output(stream,covert_filename)
ffmeg.run(stream)
// here filename = audio.mp4 file and convert_filename = audio.wav or any format you want to save it

@cuongnguyengit example:
stream = ffmeg.input(filename)
stream = ffmeg.output(stream,covert_filename)
ffmeg.run(stream)
// here filename = audio.mp4 file and convert_filename = audio.wav or any format you want to save it

i dont understand a problem. your recording is formatted into "audio.mp4" but not "audio.wav"?
u sent a blod data with mp4 format, then processing the format. Do i understand correctly??

@cuongnguyengit
since its been a while I solve this problem I don't remember correctly but I think recording the data from javascript don't give u wav or some other format that u need to play the file..... there is the problem in format when u record through frontend/javascript i don't remember the exact problem now but it was something like that

Can you please tell how you record the audio from microphone and convert it to text

tend/javascript i don't remember the exact problem now but it w

So how did you generated text from audio I was working on a project and had similar frontend code like you and it is giving me same issue that frontend is giving corrputed/unplayable file and wanted to extract text so how did you made it work please answer it would be very helpful!!


Can pull (download) PDS member from z/OS but there's no upload cloud icon to save back to z/OS

Problem description revised:
Running z/OS 2.3. Installed latest ZOWE OE extension for VS Code and ZOWE CLI on Win10 Pro, also fully updated.
CLI working because I can list PDSs and their members and pull them in. CLI profile is for TSO user with full UPDATE access on z/OS side. From a Windows command prompt window, using the "zowe zos-files upload file-to-data-set" CLI command and the same profile name, I can also successfully add/update a member in the same PDS I'm try to edit/save in the ZOWE OE. So the problem isn't with RACF or with the CLI.
Pull from mainframe (down arrow) cloud icon appears to right of member name in ZOWE Explorer window but there's not save to mainframe (up arrow) cloud icon. I can, however, save to mainframe by closing the file and being prompted to save. That updates on the z/OS. However, where's the upload cloud icon?

@cds-ari thanks for trying our extensions.  The git repo for filing Zowe Explorer issue is here: https://github.com/zowe/vscode-extension-for-zowe. This repo is for the Z Open Editor.
The Cloud icon in Zowe Explorer is performing the "Pull from Mainframe" operation that you also see in the context menu when you right-click a file. Open and saving files does not require special icons, but uses the regular VS Code operations. You just click the file to get it and open it in the editor and Cmd-S or Ctrl-S or menu File > Save to save it back to z/OS.  Pull from Mainframe is only intended to load the latest from z/OS in case you want to restore the file losing your changes or if you know that another client changed it since you opened it.  If another user save in parallel it will actually check and show you a diff viewer as well.


minor changes to fzf preview display

Hi, thanks for your contribution.
Giving preview window more horizontal space is a good addition, but on the other hand, I think that increasing borders is a bit too opinionated - if people mind having text right on the edge of the terminal window, they should configure their margins and kerning globally. The following screenshot shows difference between default Gnome Terminal and personalized Alacritty:

That's an understandably safe approach for defaults. I do find a little better readability from the extra horizontal space. I'll make a request for just the change to the preview window without the margin spacing. I'd rather that than maintaining a fork, personally. I've found this to be a really handy utility, so I appreciate your consideration at all.

As there are no critical bugs or issues (e.g. this) right now, your addition will be batch-released in 2.13.2 as a small improvement and source file update. Until then, use the master branch or build the package for your system.
Anyhow, thanks for using this utility and contributing back!


Failing DataLoader2Integration Test

🐛 Describe the bug
After my PR is landed, the nightly releases become broken. See https://github.com/pytorch/data/actions/runs/3281029405

[ ] Fix the test
[x] Investigate why the test is failing but succeeded on PR. And, the integration test is unrelated to my PR

Versions
main branch

Found the culprit https://github.com/pytorch/pytorch/pull/87017/files
We should check isinstance(datapipe, (MapDataPipe, IterDataPipe)). Sending a fix now

Closing this issue as the fix has been landed.


feature(nanocld): accept optional ssl keys

- What I did
I added the optional ssl params
- How I did it
Added it in the DaemonState struct
- How to verify it
I added tests
- Description for the changelog

Closes #389
- A picture of a cute animal (not mandatory but encouraged)

Please don't review yet. I will make some additional changes.

It is ready for review now

Hey @Abhicodes-crypto thanks for your contribution! It's a good start!
But you have to make the server inside bin/nanocl/src/server.rs use the keys now !
You have an example on how to do it there

But you have to make the server inside bin/nanocl/src/server.rs use the keys now !
You have an example on how to do it there

Sure @leon3s .Would be happy to add the changes. Should I do this in the current PR or raise a new PR. I would personally prefer to raise a new PR. Because I am unsure of how to do it and would need some time.
Some doubts that I have :

Referring the code here I can pass ssl_key as key.pem, ssl_ca as chain file, but where do I use ssl_cert I have no idea.
Also in bind_openssl what is the port that I have to use.
Also curious to know the use case here.

Sorry @Abhicodes-crypto you have to include it in this pull request unless we are accepting the arguments without using them.
From this code you can see there is 2 method used:

set_private_key_file("key.pem") refer to our ssl_key
set_certificate_chain_file("cert.pem") refer to our ssl_cert

For the CA you need to use another method set_ca_file.
You will bind these certificate for each tcp host passed.
    } else if host.starts_with("tcp://") {
      let addr = host.replace("tcp://", "");
      // load ssl keys
     // if the ssl_keys are set
      let mut builder =
        SslAcceptor::mozilla_intermediate(SslMethod::tls()).unwrap();
      builder
        .set_private_key_file("tests/server.pem", SslFiletype::PEM)
        .unwrap();
      builder
        .set_certificate_chain_file("tests/cert.pem")
        .unwrap();
      builder.set_ca_file("tests/ca.pem").unwrap();
      server = match server.bind_openssl(&addr, builder) {
        Err(err) => {
          log::error!("Error binding to tcp host {}: {}", &addr, &err);
          return Err(err);
        }
        Ok(server) => server,
      };
      /// Unless we do normal binding
      server = match server.bind(&addr) {
        Err(err) => {
          log::error!("Error binding to tcp host {}: {}", &addr, &err);
          return Err(err);
        }
        Ok(server) => server,
      };
      log::info!("Listening on {}", &host);
    }

For the use case, it's to enable encryption between a client and a server. Where the client will need to have a specific certificate signed by the CA to be able to connect. It's not like classic https there the objectif it's to enable authorization aswell!
This is required for the daemon to talk to each other over internet in a secure way!


Recommend updating grammars when releasing

This will help ensure we keep pulling in fixes from the grammar repos.
/cc @bkeepers https://github.com/github/linguist/pull/1953#issuecomment-69073698

:+1:


pickling support & tests added

very small change to enable pickling support (e.g. for multiprocessing). Tested under Python 2.7 & 3.4

Fine w/ me, but be warned that some filesystems can act funny if you try to do concurrent reads on different parts of a a file.

Released https://pypi.python.org/pypi/twobitreader


Clear suggested-actions on button click

Fixes #2160
Changelog Entry
Fix #2160. Clear suggested-actions after button click, by @tdurnford in PR #2189
Specific Changes
Called the setSuggestedActions function in the suggested action's onClick method to clear the suggested actions bar.

[x] Testing Added

Coverage increased (+0.2%) to 63.483% when pulling 4924ab12cf051c06eeaec39072ab987fd8cc6b8e on tdurnford:2160 into 8c8679e90fe9babaf7c356e873af2734e9578a4d on microsoft:master.

rebuilding due to timeout


net: dhcpv4: Use less parameters in debug print

Having 24 parameters in a debug print is a bit extreme especially
as it is causing warning from new logger. Split the debug print
to three pieces each having 8 parameters which is more reasonable.
Signed-off-by: Jukka Rissanen<EMAIL_ADDRESS>

Codecov Report

Merging #8824 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #8824   +/-   ##
=======================================
  Coverage   52.32%   52.32%
=======================================
  Files         195      195
  Lines       24730    24730
  Branches     5140     5140
=======================================
  Hits        12941    12941
  Misses       9715     9715
  Partials     2074     2074

Impacted Files
Coverage Δ

subsys/net/ip/dhcpv4.c
6.01% <ø> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e854dd0...cba2044. Read the comment docs.


[native filter] Should not show empty filter indicator when no filters applicable (see comment)

I created a filter_box, and I set it's not applicable to any charts in the dashboard. So there is no filter indicator showing up for the chart. This is correct behavior:

But for native filter component, even i set filter scope is not applicable for any charts, the chart still show an empty filter indicator:

This behavior is misleading. Empty filter indicator means the filter field is applicable to this chart, but currently there is no value applied.
Environment
latest master.
Checklist
Make sure to follow these steps before submitting your issue - thank you!

[x] I have checked the superset logs for python stacktraces and included it here as text if there are any.
[x] I have reproduced the issue with at least the latest released version of superset.
[x] I have checked the issue tracker for the same issue and I haven't found one similar.

Additional context
cc @junlincc

New native filter component only allows compatible filters to be added to the filter bar, meaning user can only select from datasets that power at least one chart on the dashboard. there will be no more incompatible filters in this case. We can remove that....
Expected behavior: When user open a new dashboard, there should be no indicator showing until use click Apply. @michael-s-molina @kgabryje let's double check later this week.

there will be no more incompatible filters in this case.

This statement is not true: remember what is jinja template? see SIP-45. filter compatible or not can not be decided by front-end.

New native filter component only allows compatible filters to be added to the filter bar, meaning user can only select from datasets that power at least one chart on the dashboard.

This statement is not true. User can, and they should be allowed to, add filter component from all dataset.

I have a hard time to think of the use case that i create a filter with dataset that's not being used in any charts on the dashboard??

there will be no more incompatible filters in this case.

This statement is not true: remember what is jinja template? see SIP-45. filter compatible or not can not be decided by front-end.

we will solve that issue separately, we have looked into solutions

I have a hard time to think of the use case that i create a filter with dataset that's not being used in any charts on the dashboard??

i can create a small dataset only used by filter, so that i don't have to offer long list of options from original table.
i can create filter first, then add chart later.


[Bug]: Lat Longs Incorrect Windows Poorly handles UTF8 characters.

Guidelines

[X] I agree to follow this project's Contributing Guidelines.

Project Version
Current
Platform and OS Version
No response
Existing Issues
No response
What happened?
There are incorrect lat long coordinates in the online dataset for drinking water microplastics: https://data.ca.gov/dataset/microplastics-in-drinking-water/resource/b027a5ef-d42e-415c-b9b9-257c1bd5ae89
Currently unable to update them correctly because UTF-8 Errors on Windows.
Steps to reproduce
Read the linked dataset on a Windows machine.
Expected behavior
Correct lat longs
Attachments
No response
Screenshots or Videos
No response
Additional Information
Suggest Using the code below to update the dataset lat longs.
library(tidyverse)
library(readxl)
library(tidygeocoder)
library(sf)
library(mapview)
library(mapdata)
library(data.table)

# Read Samples Excel file into R
# Data file does not exist
Samples_excel <- fread("https://data.ca.gov/dataset/e7624fce-c058-4fa1-a29f-2594d8f8f160/resource/b027a5ef-d42e-415c-b9b9-257c1bd5ae89/download/samples_merged.csv", encoding = "UTF-8")

# Geocode locations to closest precision possible, add XY location values
Samples_GeoCoded <- Samples_excel %>%
  geocode("Location", method = 'osm', lat = "Approximate_Latitude", long = "Approximate_Longitude")

@hsherrod2019, did this get finished?

@wincowgerDEV
Yes, everything is up to date with the lat longs! There are a few cells that have multiple locations per cell (as we talked about earlier), so those are the only ones that could not be corrected, but I made a note in the app indicating that.


Include lager into list of extra apps when testing

Starting lager as lager:start is an issue since dependencies
started by lager are not included in a list of started applications
so we don't stop them after we are done with current test.
This commit uses test_util:start_applications so all deps of lager are
included into #test_context{}
COUCHDB-2688

+1


Version table update

Removed Swift 2 and added Swift 4. :)
Closes #1186

Hey @BasThomas, how are we with the updates? 😉

I'll take a look later today!

@sunshinejr - is this what you meant? If not, I don't really know what should be done further... let me know :)

This is good, thanks, @BasThomas! What we should do next, I think, is that we should check whether 3.* is true for all 3.0 Swift versions that we have in this table. So I've imagined that if there is a problem with 3.0, we would have 2 rows: one for 3.0 (with Moya versions that are working for Swift 3.0) and one for 3.1-3.2 Swift (with Moya versions that work for Swift 3.1-3.2). Does it make sense?

That does make sense. I think that all versions should work fine with all 3.x versions though. Why do you think they might not be?

Oh, I was pretty sure that there was some issue that not all version were working correctly. So maybe let's just double check if it works? Will you have time to do that maybe, @BasThomas?

Unfortunately not. Think that would involve downloading old versions of Xcode as well, right? :(

I'm currently using Xcode 8.2.1 for 2.3 project, but it has probably 3.0.2 Swift and I can use 3.1.1 Swift toolchain there as well. On the other hand 3.2 & 4.0 Swift can be checked on Xcode 9.0 beta I think. This is unfortunately time consuming and I'm not sure when/if I can do it, so maybe someone with more free time could pick this one, @Moya/contributors?

FYI, I removed the milestone as the 9.0.0 is released already. We should try to get it merged ASAP, though!

We still need some more work here on determining which versions of Moya are compatible with Swift 3.0 and Swift 3.1-3.2

Support for Swift 3.0 started on 8.0.0. According to the Changelog, Swift 3.1 started to be supported on 8.0.3. And I don't think we had to make changes for 3.2.

Just a friendly reminder, that we still need a volunteer to help out with this one! cc @Moya/contributors

Alright, I think we don't have to wait for this one until someone does the check. For now, we can just mention whatever we have figured out now: 4.0 is supported for Moya/Core & Moya/ReactiveSwift. Moya/RxSwift will be covered in Moya 10.0.
So, would you add the info in the ReactiveSwift column, @BasThomas? (the same as in the Moya/Core, >= 9.0.0). Also, I'm thinking that we don't need to remove Swift 2 row at all, maybe someone somewhere will need this info, it doesn't hurt to have it on.

@sunshinejr @BasThomas just made the update for ReactiveMoya 👍

If you are at it, can you bring back the Swift 2 row as well, @pedrovereza? 😄

Ok I think now I got it 😅

Cool, thanks, @pedrovereza & @BasThomas! Let's get this one in :)


Upgrade to latest go-control-plane and consul

go test -coverprofile cp.out ./...
ok      github.com/spoud/rotor  0.028s  coverage: 77.8% of statements
?       github.com/spoud/rotor/constants        [no test files]
ok      github.com/spoud/rotor/differ   0.021s  coverage: 92.8% of statements
ok      github.com/spoud/rotor/main/rotor       0.094s  coverage: 96.2% of statements
ok      github.com/spoud/rotor/main/rotor-test-client   0.034s  coverage: 14.3% of statements
ok      github.com/spoud/rotor/main/tbn-xds-test-server 0.044s  coverage: 50.0% of statements
ok      github.com/spoud/rotor/plugins/aws      0.041s  coverage: 91.9% of statements
ok      github.com/spoud/rotor/plugins/consul   0.029s  coverage: 95.1% of statements
ok      github.com/spoud/rotor/plugins/envoy/v1 0.025s  coverage: 87.0% of statements
?       github.com/spoud/rotor/plugins/envoy/v2 [no test files]
ok      github.com/spoud/rotor/plugins/file     0.038s  coverage: 86.0% of statements
ok      github.com/spoud/rotor/plugins/kubernetes       0.027s  coverage: 87.8% of statements
?       github.com/spoud/rotor/plugins/kubernetes/labels        [no test files]
ok      github.com/spoud/rotor/plugins/marathon 0.026s  coverage: 90.4% of statements
ok      github.com/spoud/rotor/plugins/marathon/config  0.011s  coverage: 98.9% of statements
ok      github.com/spoud/rotor/updater  0.032s  coverage: 76.5% of statements
ok      github.com/spoud/rotor/xds/adapter      0.092s  coverage: 89.5% of statements
?       github.com/spoud/rotor/xds/collector    [no test files]
ok      github.com/spoud/rotor/xds/collector/v1 0.021s  coverage: 79.2% of statements
ok      github.com/spoud/rotor/xds/log  0.007s  coverage: 98.1% of statements
ok      github.com/spoud/rotor/xds/poller       0.374s  coverage: 82.6% of statements

Housecleaning mostly...


Leaked Developer Credentials

I received the following message on the Google Play Developer Console:

Your app has URL credential, which is generally not something intentional.

The Google link explains the problem.

I believe the alert is displayed because of that:
Sentry.init(this, "https://123:abc00@app.getsentry.com/98765");

How can I initialize the Sentry without this warning?

First off, to clarify (and for anyone who ends up here after Googling for this) the only thing that anyone can do with these credentials is send event data to your Sentry organization, not read data or perform other API requests on behalf of users of your organization.
Off of the top of my head, I'm not sure that we have any alternate methods of instantiating the client that doesn't utilize the keys as part of the DSN, but I'll check and follow up.

Ok... thanks @tkaemming!

I believe Sentry.init is the only method currently (by my skim of the existing code, which is actually a different project entirely: https://github.com/joshdholtz/Sentry-Android).
I'm working on a new Android client right now, and you'll be able to provide init via a variable in your application manifest, although I don't think that will change the error. At the end of the day, as @tkaemming said, you'll need to ship this (rather harmless) key with your app in order for sending exceptions to work.

@bretthoerner,
Sorry, I opened an issue in the wrong repository.
This issue, opened at Sentry-Android repository, answers my question.
Thanks.


[BUG]: Android kotlin version mismatched

Version
6.0.0
What platforms are you having the problem on?
Android
System Version
Android
On what device are you experiencing the issue?
Real device
Architecture
New architecture with interop layer
What happened?
[Module was compiled with an incompatible version of Kotlin. The binary version of its metadata is 1.0.0, expected version is 1.7.1]
Reproduction
repository link
Reproduction
Step to reproduce this bug are:
in react native execution part

Duplicate of https://github.com/TheWidlarzGroup/react-native-video/issues/4009


Made slide-toggle label non user selectable

Since checkbox labels aren't user-selectable, I've thought it would be a more consistent behavior if slide toggles aren't either.

@googlebot I signed it!

Sorry, this is my first time contributing.
Thank you for clarifying, I've made the requested changes so we should be golden now.

I've noticed that CI still failed because my first commit still isn't formatted correctly. Do I have to make a new PR, or can I do anything else to fix it?

You'll have to change the message on the first commit as well. Force pushing to rewrite it is allowed.

Alright, fixed it :)


Python packaging

Currently all the work in this repo exists as a single file (atlas_reader.py). I think this will eventually become somewhat unwieldy as functionality is added/updated, so I'm planning to work on quickly converting everything into a more standard python package framework. I'll try to whip this up quickly so edits can be made—I'll open a PR soon!

Perfect @rmarkello - That's exactly what we need to start the project! Also, I'm new to packaging, so I'm happy if somebody does it with experience.


Add details about creating kubelet-client.crt

On this page
https://github.com/kelseyhightower/kubernetes-the-hard-way/blob/master/docs/06-kubernetes-worker.md
there is a unit file with this ExecStart.
ExecStart=/usr/bin/kubelet \\
  --api-servers=${API_SERVERS} \\
  --allow-privileged=true \\
  --cluster-dns=<IP_ADDRESS> \\
  --cluster-domain=cluster.local \\
  --container-runtime=docker \\
  --experimental-bootstrap-kubeconfig=/var/lib/kubelet/bootstrap.kubeconfig \\
  --network-plugin=kubenet \\
  --kubeconfig=/var/lib/kubelet/kubeconfig \\
  --serialize-image-pulls=false \\
  --register-node=true \\
  --tls-cert-file=/var/lib/kubelet/kubelet-client.crt \\
  --tls-private-key-file=/var/lib/kubelet/kubelet-client.key \\
  --cert-dir=/var/lib/kubelet \\
  --v=2

Where are /var/lib/kubelet/kubelet-client.crt coming from? I searched the rest of the repo, but I didn't see anything that talked about how to create that file. Seems like there is some detail missing there.

That certificate is generated automatically by the boostrap process you enabled with this line:
 --experimental-bootstrap-kubeconfig=/var/lib/kubelet/bootstrap.kubeconfig \\

I've updated all the docs. This should be fixed now.


Fix panic and added bool marshaling

Hello there.
I catched some problem when working with lib. There is little fix for more comfortable use

Coverage decreased (-0.4%) to 96.059% when pulling f64770e3ba8b65e944e3fd7ff376cde6d22962b0 on Xsikor:master into 783c6d9f2eb97ca8b027cbda5b595e11c10d6141 on roistat:master.

Coverage increased (+0.08%) to 96.552% when pulling be6f42a32c59940a496b419c7c73215d52f8d144 on Xsikor:master into 783c6d9f2eb97ca8b027cbda5b595e11c10d6141 on roistat:master.


build: promote dfilemaker and retire dfilemaker1

Retire dfilemaker1, a tool which creates some number of files in the current working directory and does not create a tree, store a variety of data, or generally produce an interesting or varied set.
Remove dfilemaker from experimental, to replace dfilemaker1.  dfilemaker supports creation of trees of various sizes, numbers of levels, and data content.

Signed the commit which I had forgotten to do earlier, required to merge.  While I was at it, rebased on main after merging #614


Add impress:substep:enter and impress:substep:leave events

to trigger an action (alert for instance), I simply add function like
$("#foo").on('impress:stepenter',function(){
   alert("triggered");
});

Is there a way to trigger an action on substep show? For example
$("#fooSubstep").on('impress:substep:enter',function(){
   alert("triggered from substep #fooSubstep");
});

(via email)

Hey @henrikingo, I saw that we have the onSubstepShow and onSubstepHide functions implemented. Are those the ones that needed to be implemented for this? Let me know.

No, those are used internally in impressConsole.js. This issue is still waiting for a PR.

Hey @henrikingo I've just opened #730 for adding the new events for the substep plugin.
Let me know what you think. Thanks

Thanks!


Update to SEO documentation

Documentation for the Managing SEO with the seoMetaTags method details:

If the record doesn't have a SEO meta tags field, the method tries to guess reasonable values by inspecting the other fields of the record (single-line strings and images).

This is only the case, as far as I can tell, if there is still a seo content field present:
 get seoMetaTags() {
    const seoField = this.fields.find(f => f.fieldType === 'seo');

    if (seoField) {
      return seoTagsBuilder(this, this.entity.repo, i18n);
    }

    return null;
  }

https://github.com/datocms/js-datocms-client/blob/ba21a2516fe87408f7f164e935f545aea68a627e/src/local/Item.js#L117
I have tried to with minimal copy changes make that clear. May need further clarification.

You are right, thank you!


GUI support for selecting the I/O backend

I'm not sure about the API yet, by default nothing should change for existing users. But they should be able to switch to direct I/O (#716), or later liburing (#268).

ctx.load("some_type", io_engine="direct", path="...")
ctx.load("some_type", io_engine="mmap", path="...")
ctx.load("some_type", io_engine="s3", path="...")

Maybe the I/O engine can be selected by URL scheme? For example:

ctx.load("auto", url="direct:///home/clausen/...")
ctx.load("auto", url="s3://some-host/some-bucket/default.hdr")

Or even include dataset type in scheme:

ctx.load(url="direct+auto:///home/clausen/...")
ctx.load(url="s3+mib://some-host/some-bucket/default.hdr")

Some engines also may need configuration (OAuth token maybe?)
Datasets possibly don't support all I/O engines, like HDF5

API support done in #896, GUI support TBD. There is already a sketch in the IOBackend interface to create a backend from JSON, needs concrete implementation in the web API, the backends and the GUI itself.

API support done in #896, GUI support TBD. There is already a sketch in the IOBackend interface to create a backend from JSON, needs concrete implementation in the web API, the backends and the GUI itself.

GUI support done in https://github.com/LiberTEM/LiberTEM/commit/57011a1d4863e041b265722774cc22aa0b90b10c as part of #1129


Fix Python search

This seemed to work ok for me locally. It seemed to require using the non-versioned environment variables to work. Also, it seems to its own thing with site-packages anyways, but this is at least an attempt to get that right too.

So AppVeyor is off to the races again. Sorry. :facepalm:


Access operation Security from CodeGeneration templates

Expose OpenAPI security in OperationModelBase to provide additional control over clients and controllers.

@RicoSuter any thoughts?


Pi 3B+ not booting from ssd after install

Hello
I own a Pi 3B+ and a Pi Desktop Hat card plus a Transcend mSATA ssd.
I just gave a try to your 1.1.7 contrib. package install went smoothly and pd-check did'nt signal any error.
Still reboot could'nt complete, it seems to block on the disk detection step, see console image attached.
I'm using the 4.14.80-v7+ #1161 Raspian build
root@raspberrypi> /opt/vc/bin/vcgencmd version
Nov  4 2018 16:32:03
Copyright (c) 2012 Broadcom
version ed5baf9520a3c4ca82ba38594b898f0c0446da66 (clean) (release)
Could you please help?
Thanks

hi again
I finally figured out what my problem was: I was restoring /boot/config.txt without noticing that you're adding parms for the RTC and the MCU as part of the install.
I suppose this was blocking the boot process as it did'nt happen again


mouse events on markPoint labels are not fired

I have a markPoint which renders like this:

But it seems like mouse events are completely swallowed over the label. When I try to do:
chart.on("mousedown", function(ev){});..
nothing seems to be fired.
Also, it seems like emphasis style only works when hovering over symbol where it should work when hovering over labels as well.
Why are mouse events swallowed on labels?

Labels on symbol can't trigger mouse event currently.


[Bug]: some video cant convert decryot

What happened?
some video cant convert decryot
this error
[11:43:50] [udemy-downloader] [handle_segments:1150] INFO: > Decrypting video, this might take a minute...
ERROR: cannot open input file (003 1.3 û Carrier and Generic Communication System.encrypted.mp4) -4
[11:43:50] [udemy-downloader] [handle_segments:1153] ERROR: > Return code from the decrypter was non-0 (error), skipping!
Expected Result
encrypt all video
Branch
master/main
What operating systems are you seeing the problem on?
Windows
Relevant log output
No response
Other information
No response

ensure you have the proper KeyID and Key in the keyfile.json. otherwise, use --log-level DEBUG and post the log

Do you mean this?
log.txt

Do you mean this? log.txt

That file is hardly readable, there should be a logs folder that has a file for every time you run the program, use the log-level option and then upload the latest log file in that folder

2022-01-12-05-03-07.log

2022-01-12-05-03-07.log

thanks, did you enable debug logging?

oh no i forget
i send again

2022-01-12-11-20-35.log

2022-01-12-11-20-35.log

Thanks, I've found where the error comes from, just so I can test before pushing the fix, can you upload 019 6.3.3-8-PSK_en.vtt?

I've pushed a possible fix for the caption conversion error, please give that a try.

ya thnks , captions its true,
but video convert for some video not decrypt
It is in the top log
sample :
003 1.3 – Carrier and Generic Communication System.encrypted.m4a
003 1.3 – Carrier and Generic Communication System.encrypted.mp4

ya thnks , captions its true, but video convert for some video not decrypt It is in the top log sample : 003 1.3 – Carrier and Generic Communication System.encrypted.m4a 003 1.3 – Carrier and Generic Communication System.encrypted.mp4

Maybe I'm just overlooking it, but I don't see this in any of the logs provided. But in most cases, this is caused by the decryption key/key id pair not being in the keyfile (or being entered incorrectly)

I used the key/key id correctly but it does not work for some videos,
For example, he did not codify one of his lessons in this course, but he decoded the rest of the lessons

2022-01-14-09-19-48.log
just its leason cant decrypt or convert :
003 1.3 – Carrier and Generic Communication System.encrypted.m4a
003 1.3 – Carrier and Generic Communication System.encrypted.mp4

can you help me?

Master branch has been updated, please pull the new changes and make sure to install the new dependency (shaka-packager - https://github.com/google/shaka-packager/releases/latest)
Use --log-level after updating, if you have an error still, post the log. this time, the log will show the output from the decryption program so I can see exactly what the problem is.

its stop work here
not continue
2022-01-17-04-15-48.log

How did you get kid?
Are you sure kid is correct?

I used the key/key id correctly but it does not work for some videos, For example, he did not codify one of his lessons in this course, but he decoded the rest of the lessons

Are you stil able to obtain kid and key?

I used the key/key id correctly but it does not work for some videos, For example, he did not codify one of his lessons in this course, but he decoded the rest of the lessons

can you tell please how it finding! (kid and key)

Someone please guide how to aquire the key and key ID


Full table scan on MPI_LINK during mdm-clear

When performing mdm-clear operation for approximately 1,000,000 mdm-links, and associated golden resources, slow sql errors show up in logs as well as other errors associated to DB contention, and the whole operation requires many hours to complete
To Reproduce

Generate 1,000,000 mdm links to golden resources
Run mdm-clear operation

Expected behaviour
Batch job should advance to a constant pace until finish, without generating slow queries.
Note that is reasonable to expect the operation to run for a few hours to complete for a large number of resources as described, as it runs in batches to allow for other processes to share the server.
HAPI FHIR Version
v6.4.4

Fixed by https://github.com/hapifhir/hapi-fhir/pull/4805


Set correct type for setMatrixArrayType

Typescript complained about unknown "Type". Judging from the code Float32ArrayConstructor | ArrayConstructor is appropriate.

Thank you very much!

wow! that was quick!


Add missing import to macOS source file

Summary

I tried using RNCPicker on macOS and got a compile error. I traced the error to a missing import statement in one of the macOS source files. RCTBubblingEventBlock was an unrecognized type, and adding #import <React/RCTComponent.h> fixed it.
Test Plan

What's required for testing (prerequisites)?
I am using Xcode 12 on macOS 10.15.7
Create a test react-native project that imports Picker, and observe it fails to compile
Manually edit the local version of RNCPicker in node_modules and add the import. Observe it passes now.
What are the steps to reproduce (after prerequisites)?
To repro the error:
npx react-native init pickerTest --version 0.62
cd pickerTest
npx react-native-macos-init
yarn add yarn add @react-native-community/picker
# Modify macos/Podfile to have a minimum OS of 10.14 instead of 10.13
open macos/pickerTest.xcworkspace
# Build and run on xcode

Expected: project builds ands runs normally
Actual: Compilation fails on RNCPicker
Compatibility

OS
Implemented

macOS
✅

Checklist

[x] I have tested this on a device and a simulator
[ ] I added the documentation in README.md
[ ] I mentioned this change in CHANGELOG.md
[ ] I updated the typed files (TS and Flow)
[ ] I added a sample use of the API in the example project (example/App.js)

#140 already addresses this, and is by the guy who added macOS support to begin with. Closing this PR.


Compiler doesn't find librt.so

Hi there,
I am trying to use boost interprocess (header only) library. The compiling itself
runs perfectly, but the node script crashes by showing the message:
node: symbol lookup error: /home/[...]/image_processing_interface/build/Release/image_processing_interface.node: undefined symbol: shm_unlink
The method shm_unlink is from the "mman.h"-lib, a linux standard lib, as you know. I guess boost
calls it to allocate a managed shared memory segment.
Basically (without the node-specific things) the source-code is like this:
#include <boost/interprocess/managed_shared_memory.hpp>
#include <iostream>
#include "SLY_register_settings.hpp"

using namespace boost::interprocess;
using namespace std;

int main()
{
    //allocate the absolute minium of memory
    shared_memory_object::remove(SALLY_SHARED_MEM);
    managed_shared_memory sharedMem{open_or_create, SALLY_SHARED_MEM, mapped_region::get_page_size()};
    bool *sharedRegAlloc = sharedMem.find_or_construct<bool>(SIPR_REGISTER)[16](false);
    interprocess_mutex *mutex = sharedMem.find_or_construct<interprocess_mutex>(SALLY_MUTEX)();
}

Compiling with the standard g++ compiler works and it runs also.
Maybe an issue or you have some tip for me?

I found the reason for this problem by compiling with g++ and looking for the paths of the libs.
The missing library was librt: "/lib/x86_64-linux-gnu/librt.so".
But I used already the "-fno-rtti"-flag. My binding.gyp looks now like this:
{
    "targets": [{
        "target_name": "image_processing_interface",
        "cflags_cc!": ["-fno-exceptions", "-fno-rtti"],
        "sources": [
            "main.cpp",
            "SLY_async_worker.cpp"
        ],
        'include_dirs': [
            "<!@(node -p \"require('node-addon-api').include\")",
            "/usr/include/boost",
        ],
        'libraries': [
            "/lib/x86_64-linux-gnu/librt.so",
        ],
        'dependencies': [
            "<!(node -p \"require('node-addon-api').gyp\")",
        ],
    }]
}

Maybe the flag is wrong or the compiler can't find it. Any suggestions?

@MaxHausmann librt is part of glibc, it houses a number of auxiliary functions (aio, clock/timer functions and, notably, POSIX message queues, what boost::interprocess is undoubtedly using.)
Adding 'libraries': ['-lrt'] should fix it.

Okay, despite "-fno-rtti"? Because I thought that is for using such libraries? (Without it, my program won't compile at all).

Thank you, that fixed it!

@MaxHausmann -fno-rtti is not in any way related to librt. It stops the compiler from emitting (most) Runtime Type Information, what you need to make C++'s dynamic_cast work.


Cinder event catcher does not work in storage provider

There is an issue with Storage provider event catcher worker process, getting error in log, see bellow.
[----] I, [2016-09-26T13:28:39.008545 #27039:2aec9ef07958]  INFO -- : ManageIQ::Providers::StorageManager::CinderManager::EventCatcher::Runner started. ID [975], PID [27039], GUID [5e4563a6-83dc-11e6-9a17-0242fa0d9a65], Zone [default], Role [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket]
[----] I, [2016-09-26T13:28:39.008602 #27039:2aec9ef07958]  INFO -- : MIQ(ManageIQ::Providers::StorageManager::CinderManager::EventCatcher::Runner#do_wait_for_worker_monitor) EMS [<IP_ADDRESS>] as [adm1] Checking that worker monitor has started before doing work
[----] I, [2016-09-26T13:28:39.011013 #27039:2aec9ef07958]  INFO -- : MIQ(ManageIQ::Providers::StorageManager::CinderManager::EventCatcher::Runner#do_wait_for_worker_monitor) EMS [<IP_ADDRESS>] as [adm1] Starting work since worker monitor has started
[----] I, [2016-09-26T13:28:39.011272 #27039:2aec9ef07958]  INFO -- : MIQ(ManageIQ::Providers::StorageManager::CinderManager::EventCatcher::Runner#start_event_monitor) EMS [<IP_ADDRESS>] as [adm1] Validating Connection/Credentials
[----] I, [2016-09-26T13:28:39.011531 #27039:2aec9ef07958]  INFO -- : MIQ(ManageIQ::Providers::Openstack::CloudManager#with_provider_connection) Connecting through ManageIQ::Providers::Openstack::CloudManager: [oc_dom1]
[----] I, [2016-09-26T13:28:39.017028 #27039:2aec9ef07958]  INFO -- : MIQ(ManageIQ::Providers::StorageManager::CinderManager::EventCatcher::Runner#start_event_monitor) EMS [<IP_ADDRESS>] as [adm1] Starting Event Monitor Thread
[----] I, [2016-09-26T13:28:39.017286 #27039:2aec9ef07958]  INFO -- : MIQ(ManageIQ::Providers::StorageManager::CinderManager::EventCatcher::Runner#start_event_monitor) EMS [<IP_ADDRESS>] as [adm1] Started Event Monitor Thread
[----] I, [2016-09-26T13:28:39.018455 #27039:2aec9ef07958]  INFO -- : MIQ(ManageIQ::Providers::StorageManager::CinderManager::EventCatcher::Runner#worker_monitor_drb) EMS [<IP_ADDRESS>] as [adm1] Initializing DRb Connection to MiqServer with ID=[1], NAME=[EVM], PID=[21431], GUID=[2b1ad006-4a3f-11e5-b078-54ee75346316] DRb URI=[druby://<IP_ADDRESS>:42617]
[----] I, [2016-09-26T13:28:39.020852 #27039:2aec9ef07958]  INFO -- : MIQ(ManageIQ::Providers::StorageManager::CinderManager::EventCatcher::Runner#do_work) EMS [<IP_ADDRESS>] as [adm1] Waiting for the Monitor Thread to exit...
/home/.../projects/manageiq/app/models/manageiq/providers/base_manager/event_catcher/runner.rb:122:in `monitor_events': must be implemented in subclass (NotImplementedError)
    from /home/.../projects/manageiq/app/models/manageiq/providers/base_manager/event_catcher/runner.rb:164:in `block in start_event_monitor'

I am not who is working on cinder provider, maybe @hsong-rh?

@hsong-rh Thanks, closing this issue.


Added Ability to use Access Tokens

Signed-off-by: Brad Wadsworth<EMAIL_ADDRESS>Description of your changes
This change will read the secret key in a Kubernetes secret and if it is not in a JSON format, it will treat it as a Access Token. The documentation has also been updated to demonstrate how a CronJob resource can keep the Access Token up to date
Fixes #460
I have:

[X] Read and followed Crossplane's contribution process.
[X] Run make reviewable test to ensure this PR is ready for review.

How has this code been tested
Tested the change in a Kind cluster using the update docs/AUTHENTICATION.md.

Also, we need to merge it into master instead of the 0.21 release. This feature will be included in the 0.22 release (that are coming probably in the next week)

@Feggah pushed a fix for Go lint.

Hey @bradkwadsworth-mw, I was waiting for the part of the documentation that you said you would add:

I will work on some disclaimers in the documentation and push another commit to this PR.

After that I believe we can merge the PR. I just want to test it out, as I wasn't able to setup the GKE properly to test this feature

Oops, your are right. Just pushed a new commit with a disclaimer doc update.

Added some info for standing up a GKE cluster with Workload identity enabled. I tested it a few times and had another person test as well so I'm fairly confident it is repeatable.


Add script to analyze results from multiple runs and display statistics

Given a run using Hydra multirun folder structure, and our logger output, display results with confidence intervals and summary statistics.

I've started on a basic training results viewer in my fork, what would be the best way to collaborate and have it ideally hit your goals here?

I made this before I was aware of how the diagnostics folder was structured, maybe we should move it there? https://github.com/facebookresearch/mbrl-lib/blob/plotting/notebooks/plot_over_trials.ipynb

@a3ahmad @natolambert Thanks a lot! A pull request would be the best way to get started, then we can discuss there a bit if any adjustments are necessary :)

Done, this is a first pass effort I initially built for my own use. But since you had a similar ask I thought I would offer it as a starting point. Happy to make any changes to bolster it, if you feel it's worthwhile. If not, no problem -- I'll keep using it locally :)


Adding --versions to mc find command

Requires this https://github.com/minio/mc/pull/4394 to be merged first.

Closed with Issue #685.
Fixed by PR #697 .


Images downloaded when access EPUB files

Greetings,
We have observed images are downloaded when open a EPUB file. Images are stored in image gallery and this creates discomfort in UI experience
Can this be corrected.
Regards
Pramod

@admin-vividlipi can you check this on version 0.3.2. Also, delete folioreader folder from internal storage.


Add warning when not excluding _app folder in Cloudflare Pages adapter

Ok so basically, I spent some time trying to debug a bunch of weird 404 errors that were being thrown when I deployed to Cloudflare Pages, after some time I realized it was because I was using a custom exclude array that didn't exclude the _app folder.
For some reason in my deployment I couldn't serve the _app folder from the server so it kept throwing a 404 error.
Initially, I thought of submitting a PR that would always exclude the _app folder, but there's probably a good reason why
SvelteKit allows for the developer to choose, so I thought it'd be nice to log a warning instead so anyone that gets in the same situation can hopefully not get stuck like me.

lint is failing and will need to be fixed

Initially, I thought of submitting a PR that would always exclude the _app folder, but there's probably a good reason why
SvelteKit allows for the developer to choose

It looks like the PR implementing the feature originally did that, but @Rich-Harris suggested not to here: https://github.com/sveltejs/kit/pull/9111#issuecomment-1440293408. I'm not too well versed in this feature, but it sounds to me like it's required to exclude _app or else things break. If the only consequence of not excluding it is that your app breaks, I don't see the value in letting users do that. I think it can only result in a poor user experience. But I'm not that familiar with this feature though, so maybe I'm missing something. Thoughts @Rich-Harris?

okay, re-wrapping my head around the Cloudflare Pages _routes.json config. There's a few things going on here:

leaving the app directory out of exclude should be fine — it should just result in an env.ASSETs.fetch here (which results in an unwanted function invocation, but nothing worse than that): https://github.com/sveltejs/kit/blob/d93eb42bee7fd06d4d3f7e3dde7381ab032b076c/packages/adapter-cloudflare/src/worker.js#L36-L38 It's not doing that because we (incorrectly) only serve static files and prerendered pages. We can fix that, and when we do, the warning in this PR will be unnecessary
In SvelteKit 2, we added a /_app/env.js module which is dynamically generated in certain cases. This must result in a function invocation. We forgot that we need to make sure we only treat certain things inside ${base}/_app (namely immutable and version.json) as static files

IOW we're basically talking about an entirely different chunk of work. I'll open a new PR.

closing in favour of #11593 — thanks


Resolving component props as route props

I think it could be done better with creating another type like WithRouteProps<ComponentProps, RouteProps> and extracting only RouteProps and using it in RouterRenderNode.render. So we could define props like
type TestComponentProps = WithRouteProps<
  {
  id: string;
  },
  {
    randomSelfProp: number;
  }>

But I wasn't able to implement it.

I don't really follow still--sorry!
If you mean that you want component Props to have params.* passed in directly rather than in a params object, that can be done although I think it's ok as-is although it's a little more verbose.


Lab 6 - Azure Open Dataset is no longer accepting anonymous read requests

Module: Ingest data with Spark and Microsoft Fabric notebooks
Lab/Demo: 6
Task: 3 - Create a Fabric notebook and load external data
Step: 3

Description of issue
The code results in an access denied error.

We have the same issue in lab 10  please let us know if any updates on this issue.

I tested the lab today and had no issues reading and ingesting the data from the blob storage. Most likely the data was only temporarily unavailable. I'm closing the issue as no repro but feel free to reopen it if the problem persists.


Exposes layout object to validators

This change passes the layout object to validation functions so we can develop layout-specific rules. (Relevant Trello)

Coverage increased (+1.1%) to 73.087% when pulling 9554a5fd49539a41dfb4e46eaec42eaf19b579ce on layout-in-validation into d8c743154675fece2396a1c5a4e46f8bf4b007fa on master.

This would also require an update of documentation: https://github.com/nymag/clay-kiln/blob/master/validators/README.md

Coverage increased (+1.03%) to 72.999% when pulling e1bf878ed725a2e634a1135ebafa721f61987ee4 on layout-in-validation into d8c743154675fece2396a1c5a4e46f8bf4b007fa on master.

👍🏼 from sunny CA

note: in kiln v1.0, we're passing the full state object, so you can grab the layout uri (state.page.data.layout) or data (state.components[layoutURI]) in the validator yourself.


Added yield in jsonrpc_fund

Also fixes #1278
According to this: https://github.com/lbryio/lbry/issues/1278#issuecomment-416981496


fix - memory leak on solutions hashmap

Fix memory leak on solutions hashmap.
Unused solutions were still being referenced from the solutions hashmap.
The main motivation is to remove old solutions after the algorithm moves to the next bunch of characters to analyze as they won't be accessed anymore in the data processing pipeline.
These unused references were creating tons of objects in the java memory heap as shared in https://github.com/open-korean-text/open-korean-text/issues/71#issuecomment-410179039

Coverage decreased (-0.4%) to 98.029% when pulling b95e28951145da1e221e845939a8cfa4a83c200f on Damiox:fix-memoryleak-solutionshashmap into 7e559d0eb41cfddbbb5c546997106c0bbfcb37c9 on open-korean-text:master.

Thank you so much, @Damiox!!!


Question: Documented perception module inputs doesn't match the implementation in dag files

Apollo README for Perception here https://github.com/ApolloAuto/apollo/blob/master/modules/perception/README.md#input describes that Apollo uses 2 cameras and 4 lidars as Perception input sensors. But when we look at the code(master branch) things are configured differently.
For example, in camera.dag(https://github.com/ApolloAuto/apollo/blob/master/modules/drivers/camera/dag/camera.dag) it enables 5 CameraComponents. Again, for Lidar, in velodyne.dag(https://github.com/ApolloAuto/apollo/blob/master/modules/drivers/velodyne/dag/velodyne.dag), we can see that it configures/instantiates 5 VelodyneDriverComponents.
Or if I assume that its velodyne128.dag it still doesnt match the configuration.
Or is this just a dummy configuration and the Apollo users with latest version are supposed to change this configuration according to the Perception documentation.
System information
Apollo version 5.5:
Steps to reproduce the issue:
N/A
Supporting materials (screenshots, command lines, code/script snippets):
https://github.com/ApolloAuto/apollo/blob/master/modules/perception/README.md#input
https://github.com/ApolloAuto/apollo/blob/master/modules/drivers/camera/dag/camera.dag
https://github.com/ApolloAuto/apollo/blob/master/modules/drivers/velodyne/dag/velodyne.dag

These dag files are demo configurations. Different vehicles will enable different configurations.


indexing linux kernel before any other sub directory | luceue issue

phenomenon, multiple sources
src/

linux/
nginx/
other source/

must index linux/ first and alone, or will meet updating luceue issue

just a walk around, maybe there's better solution


Support channel definitions from /file/list_homepage

This PR for issue #1049
Is ready to be reviewed by @liamcardenas
Uses existing reducers, actions, selectors
Moves component/common/category-list.jsx to its own top level component at component/categoryList because it needs props to fetchChannel and select claimsByChannel and claimsById
Fetches channels in componentDidMount when the category is a channel
Returns false in isCardVisible when !section -- this fixed the error I was getting; I'm not sure exactly how the code for the UI works
Adds const channel to the CategoryList render function, which is an empty array until the data comes in, and once the data comes in is an array of proper uris made with 'buildURIfromcategory` selector data
Maps the channel array to <FileCard> components when appropriate
Displays a ' for a channel (categoryLink, names=[]) when featuredUris[category].lengthis false inDiscoverPage`
Imports CategoryList from new location in Discover and Subscriptions pages
Fixes various linting errors I found along the way
Includes fake data for demo/testing purposes to be removed after review/updates

This PR still contains sample data to demonstrate the functionality. I will remove it and clean up commit history following approval.

Lets merge this. @daovist once you remove the mock data I'll merge


Edit: machine-learning-azure-ml-customer-churn-scenario.md

Some of the paras were too long, I broke them up.
In line 24, you mention the ETL section, but I don’t find that anywhere. We also need to say what the acronym means.
Line 201: Need a link for your reference

Hi @ClarityQueen, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

This seems like a small (but important) contribution, so no contribution license agreement is required at this point. Real humans will now evaluate your PR.

TTYL, AZPRBOT;


Statistics inconsistent when specs are repeated

From @sguptatw on June 29, 2017 7:47
Expected behavior
The specifications executed count should be the number of specifications executed. i.e If any specs are repeated, then it should be listed as many times.
Actual behavior
The scenario count reflects the repeated execution, the specifications dont.
Steps to replicate

Run specs from the command line

gauge run specs -d="ttt"
# Specification Heading
  ## Vowel counts in single word	 ✔ ✔
  ## Vowel counts in multiple word	 ✔ ✔

Successfully generated html-report to => /Users/sswaroop/work/test/ttt/reports/html-report
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	2 executed	2 passed	0 failed	0 skipped

Now run the following command

gauge run specs/example.spec specs -d="ttt"
# Specification Heading
  ## Vowel counts in single word	 ✔ ✔
  ## Vowel counts in multiple word	 ✔ ✔
  ## Vowel counts in single word	 ✔ ✔
  ## Vowel counts in multiple word	 ✔ ✔

Successfully generated html-report to => /Users/sswaroop/work/test/ttt/reports/html-report
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	4 executed	4 passed	0 failed	0 skipped

The specification count is 1 and the scenario count is 4.
Version
Gauge version: 0.9.0.nightly-2017-06-28

Plugins
-------
csharp (0.10.1)
html-report (4.0.1)
java (0.6.4)
ruby (0.4.1)
spectacle (0.1.2)

Copied from original issue: getgauge/html-report#151

The approach to this has changed. If we specify duplicate specifications, the specification will be run only once(only the first specified specification is run). The same applies for scenarios also.

Available in nightly > 07/07/17


Lack of agreement with real data

Hello,
I'm trying to calculate the position of the Moon with the Earth's center as the origin, using this code:
import spiceypy as spice

spice.furnsh("../meta.txt")
# print distance of Moon for every second in the day
for i in range(86400):
    date = 2457708.5 + (i / 86400)              # 2457708.5 corresponds to 14 November 2016, 00:00 UTC, the date at which the Moon was at its perigee
    x, y, z = spice.spkpos("Moon", date, "J2000", "NONE", "Earth")[0][0:3]
    print("distance:", ((x ** 2 + y ** 2 + z ** 2) ** 0.5))

meta.txt:
\begindata
KERNELS_TO_LOAD=(
'<path>/de438.bsp')
\begintext

But all the values I get are around 403,087.56 km, while Moon's perigee is around 363,228.9 km.
Where am I wrong?

Hi @KDarshan20,
the date (ephemeris time) shall be expressed as seconds past J2000 TDB (see https://naif.jpl.nasa.gov/pub/naif/toolkit_docs/FORTRAN/spicelib/spkpos.html).
In your code, your are computing times starting at 2000-01-29 22:41:48.500000 UTC, for fractions of a second.
You'll need to convert the Julian Date (or UTC calendar time) you have to seconds past J2000 TDB (use str2et for
that).
Hope this helps.
Jorge

That cleared it.
Thanks for the quick reply!


problem of convergence

When I set the seed equals 1, the result F_ ecp is 0.049 in fold-6. And other folds is normal and the average is 0.6588. What is the problem?

Did you run the model successfully?
I have a bug of
Token indices sequence length is longer than the specified maximum sequence length for this model (730 > 512). Running this sequence through the model will result in indexing errors
If you solve this please let me know, thank u~

When I set the seed equals 1, the result F_ ecp is 0.049 in fold-6. And other folds is normal and the average is 0.6588. What is the problem?

Did you run the model successfully?
I have a bug of
Token indices sequence length is longer than the specified maximum sequence length for this model (730 > 512). Running this sequence through the model will result in indexing errors
If you solve this please let me know, thank u~

I can run this model.
I get warning:
Token indices sequence length is longer than the specified maximum sequence length for this model (730 > 512). Running this sequence through the model will result in indexing errors
Token indices sequence length is longer than the specified maximum sequence length for this model (658 > 512). Running this sequence through the model will result in indexing errors
Token indices sequence length is longer than the specified maximum sequence length for this model (557 > 512). Running this sequence through the model will result in indexing errors
Although there are warnings, the code can run.


feat: implement text to image tool with flux1 schnell model

First tests

could you add a quick example under https://github.com/landing-ai/vision-agent-tools/tree/main/docs

could you add a quick example under https://github.com/landing-ai/vision-agent-tools/tree/main/docs

Thanks! Done:
https://github.com/landing-ai/vision-agent-tools/blob/feat/text-to-image/docs/flux1.md


Translate into non English language?

Is there any support to translate editor other language then English?
If not, I would like to help to translate it into Russian.

This would be something to contribute upstream in Quill.

https://quilljs.com/docs/

A lot of the strings are inside of the Quill CSS files, like snow.theme.css. So you would need to switch the CSS imports to use a translated file.


Winget not working anymore

Brief description of your issue
I have winget installed on all our company clients. As of yesterday they all stopped working. Whenever I type
winget search chrome (or any other software, it does not search bun instead it just puts out a blue backslash, removes my Prompt and that's it.
When I try to use
winget install chrome (or any other software), the same. Output switches to blue text, writes a backslash and that's it.
Strangely enough I ran a batch file with eight winget install lines, nothing else and it actually installed the first program. When it came to chrome it all turned blue and stopped.
Steps to reproduce
Unknown
I just type winget install chrome and it fails.
Expected behavior
I expect winget search to search and winget install to install.
Actual behavior
Instead of searching and installing it switches the output to blue text and only outputs a blue backslash.
Environment
Windows 11 latest patch level
Windows AD domain network
winget version 1.2.10691

I just realized it needed an update. Can be closed.


SubSchema internal references are not resolved

Hello,
I have a problem when working with multiple schemas which refer to the internal content.
NOTE: The test cases below are based on RefResolutionTest.kt class.
When working with a root schema referencing its internal variables, the properties are resolved successfully, for instance:
    @Test
    fun `ref definitions`() {
        val root: CompositeSchema = createSchemaLoaderForString(
                """
            {
                "$ref": "#/$defs/ddd",
                "$defs": {
                   "ddd": {
                        "title": "my title",
                        "$anchor": "myAnchor"
                   }
                }
            }
            """.trimIndent()
        )() as CompositeSchema
        val actual = root.accept(TraversingSchemaVisitor<String>("$ref", "title"))!!
        assertThat(actual).isEqualTo("my title")
    }

Here we refer to "ddd" header directly from the schema and it works well, returning the correct value.
If we want to add a simple subSchema and refer it from the root schema, it works well as well:
    @Test
    fun `ref definitions child`() {
        val actual = createSchemaLoaderForString(
                """
                {
                    "$ref": "http://subschema.json#/$defs/ddd"
                }
            """,
                mapOf(
                        Pair(
                                "http://subschema.json",
                                """
                                    {
                                        "$defs": {
                                           "ddd": {
                                                "title": "my title",
                                                "$anchor": "myAnchor"
                                           }
                                        }
                                    }
                                """
                        )
                )
        )() as CompositeSchema

        val referred = (actual.subschemas.iterator().next() as ReferenceSchema).referredSchema as CompositeSchema
        assertThat(referred.title!!.value).isEqualTo("my title")
    }

However, if the subSchema uses internal "$ref" reference, that fails as the application is looking for the referenced object in the root schema, and not within the subSchema.
For instance, if we move the schema from the first example to a be a subschema in the second example, it does not longer work:
    @Test
    fun `ref definitions child self ref`() {
        val actual = createSchemaLoaderForString(
                """
                {
                    "$ref": "http://subschema.json#/$defs/ddd"
                }
            """,
                mapOf(
                        Pair(
                                "http://subschema.json",
                                """
                                    {
                                        "$ref": "#/$defs/ddd",
                                        "$defs": {
                                           "ddd": {
                                                "title": "my title",
                                                "$anchor": "myAnchor"
                                           }
                                        }
                                    }
                                """
                        )
                )
        )() as CompositeSchema
    }

and returns the following error:
java.lang.Error: json pointer evaluation error: could not resolve property $defs in {
  "$ref": "http://subschema.json#/$defs/ddd"
}
	at com.github.erosb.jsonsKema.SchemaLoader$evaluateJsonPointer$lookupNext$1.invoke(SchemaLoader.kt:375)
	at com.github.erosb.jsonsKema.SchemaLoader$evaluateJsonPointer$lookupNext$1.invoke(SchemaLoader.kt:366)
	at com.github.erosb.jsonsKema.SchemaLoader.enterScope(SchemaLoader.kt:176)
	at com.github.erosb.jsonsKema.SchemaLoader.evaluateJsonPointer$lookupNext(SchemaLoader.kt:366)
	at com.github.erosb.jsonsKema.SchemaLoader.access$evaluateJsonPointer$lookupNext(SchemaLoader.kt:107)
	at com.github.erosb.jsonsKema.SchemaLoader$evaluateJsonPointer$1.invoke(SchemaLoader.kt:404)
	at com.github.erosb.jsonsKema.SchemaLoader$evaluateJsonPointer$1.invoke(SchemaLoader.kt:403)
	at com.github.erosb.jsonsKema.SchemaLoader.runWithChangedBaseURI(SchemaLoader.kt:412)
	at com.github.erosb.jsonsKema.SchemaLoader.evaluateJsonPointer(SchemaLoader.kt:403)
	at com.github.erosb.jsonsKema.SchemaLoader.resolve(SchemaLoader.kt:353)
	at com.github.erosb.jsonsKema.SchemaLoader.loadSchema(SchemaLoader.kt:305)
	at com.github.erosb.jsonsKema.SchemaLoader.loadRootSchema(SchemaLoader.kt:290)
	at com.github.erosb.jsonsKema.SchemaLoader.invoke(SchemaLoader.kt:184)

So it looks like it tries to resolve the "ddd" header from the root schema, when it is defined within the subSchema itself.
Would it be possible to fix the issue as it blocks our project from upgrading from everit library?
Thank you!
Best regards,
Aleksandr.

Hello @bsanchezb I have some experimental changes in the issue-16 branch. It is passing on your testcase, but overall I'm hesitant to release it.
Can you build this branch and do some experimental testing? Or do you need a maven central release instead?

Hi @erosb ,
Thank you for taking a look on the issue. I may check it on my side, but probably later, as now I'm very busy with other stuff.
I will let you know.
Kind regards,
Aleksandr.

Hi @erosb ,
I had similar issue for one of my project while migrating from [https://github.com/everit-org
/
json-schema](url). I pulled issue-16 branch and used that library version to build my project.It seems to be working fine. Once @bsanchezb confirms, I would like to have this merged and released to maven central.It would be great help.
Thanks

@prabhat2020 I deployed the fix to maven central, you can upgrade to version 0.10.0:
<dependency>
    <groupId>com.github.erosb</groupId>
    <artifactId>json-sKema</artifactId>
    <version>0.10.0</version>
</dependency>

Thanks @erosb for quick response

I hope the previous release fixed the problem for everyone - closing the issue.

Hello @bsanchezb , thank you for your feedback.

I think it would be nice if ValidationFailure could return a more user-friendly error from a getMessage() method, similarly as it was in everit-json-schema project with a message returned from ValidationException

Can you please elaborate a bit on it? I think the current structure of ValidationFailure should be similar to the old  ValidationException, at least that was the intention (it is just not an exception, otherwise it is the same). Can you please give me an example schema and json instance, and let me know how to improve the error message? Also, what was your workaround?
I'm really interested in making the new library easier to use.

Hello @erosb,
First of all, thank you for the great work on the project!
The ValidationFailure object does not (always) return original cause of the failure, such as line and position of the issue in the JSON or a requirement within the JWS schema. It has a number of Causes and Schemas you need to iterate over in order to access the relevant information.
You may see the class I had to create in order to return a more user-friendly message similar to the old ValidationException. You may also take a look on my unit tests I had to slightly change because of the change in the behavior (after transformations applied with my helper class from above). Obviously, I do not expect the same messages to be returned as before, but an easier way to access the information I need would be much appreciated.
KR,
Aleksandr


Distributed Data Parallel Training on examples/ImageNet error

Distributed Data Parallel Training on example/ImageNet error
(base) xx@VM-1-8-ubuntu:~/codes/julia_learn/cv/lux/ImageNet$ mpiexecjl -n 2 julia --project=.. -t 8 main.jl --arch ResNet18 --batch-size=256 /train_tmp
┌ Warning: MPI Implementation is not CUDA Aware
└ @ FluxMPI.MPIExtensions ~/.julia/packages/FluxMPI/nB5FP/src/mpi_extensions.jl:38
┌ Warning: MPI Implementation is not CUDA Aware
└ @ FluxMPI.MPIExtensions ~/.julia/packages/FluxMPI/nB5FP/src/mpi_extensions.jl:38
2022-05-15T02:21:28.548 [0 / 2] Using GPU 1
2022-05-15T02:21:28.594 [1 / 2] Using GPU 2
2022-05-15T02:21:41.372 => creating model `ResNet18`
2022-05-15T02:21:54.928 ==> staring `ResNet18` warmup...
2022-05-15T02:22:22.044 ==> forward pass warmup completed
2022-05-15T02:24:32.537 ==> backward pass warmup completed
signal (11): Segmentation fault
in expression starting at /home/zhangyong/codes/julia_learn/cv/lux/ImageNet/main.jl:537
unknown function (ip: 0x7f0f43b0da5f)
unknown function (ip: 0x7f0b84ba9f3d)
unknown function (ip: 0x7f0b84b945ff)
unknown function (ip: 0x7f0b84b9e526)
unknown function (ip: 0x7f0b84b3076a)
unknown function (ip: 0x7f0b84a6d0b6)
unknown function (ip: 0x7f0b84a6efff)
unknown function (ip: 0x7f0b84a6f895)
MPI_Bcast at /usr/lib/libmpi.so (unknown line)
Bcast! at /home/zhangyong/.julia/packages/MPI/08SPr/src/collective.jl:53 [inlined]
Bcast! at /home/zhangyong/.julia/packages/MPI/08SPr/src/collective.jl:59 [inlined]
#synchronize!#19 at /home/zhangyong/.julia/packages/FluxMPI/nB5FP/src/synchronize.jl:18 [inlined]
synchronize!##kw at /home/zhangyong/.julia/packages/FluxMPI/nB5FP/src/synchronize.jl:18 [inlined]
#17 at /home/zhangyong/.julia/packages/FluxMPI/nB5FP/src/synchronize.jl:14 [inlined]
#fmap#17 at /home/zhangyong/.julia/packages/Functors/qBIlC/src/functor.jl:50
fmap##kw at /home/zhangyong/.julia/packages/Functors/qBIlC/src/functor.jl:49 [inlined]
#18 at /home/zhangyong/.julia/packages/Functors/qBIlC/src/functor.jl:50
unknown function (ip: 0x7f0acc2b2732)
_jl_invoke at /buildworker/worker/package_linux64/build/src/gf.c:2358 [inlined]
ijl_apply_generic at /buildworker/worker/package_linux64/build/src/gf.c:2540
map at ./tuple.jl:221 [inlined]
map at ./namedtuple.jl:218
_default_walk at /home/zhangyong/.julia/packages/Functors/qBIlC/src/functor.jl:43
[inlined]
#fmap#17 at /home/zhangyong/.julia/packages/Functors/qBIlC/src/functor.jl:50
unknown function (ip: 0x7f0acc2b2430)
unknown function (ip: 0x7f0acc2b2009)
unknown function (ip: 0x7f0acc2b1fd0)
fmap##kw at /home/zhangyong/.julia/packages/Functors/qBIlC/src/functor.jl:49 [inlined]
#18 at /home/zhangyong/.julia/packages/Functors/qBIlC/src/functor.jl:50
unknown function (ip: 0x7f0acc2b1e8d)

......

__libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
_start at /home/zhangyong/.julia/juliaup/julia-1.8.0-beta3+0~x64/bin/julia (unknown line)
Allocations: 281319919 (Pool: 281207097; Big: 112822); GC: 86
ERROR: failed process: Process(`mpiexec -n 2 julia -t 8 main.jl --arch ResNet18 --batch-size=256 /train_tmp`, ProcessExited(1)) [1]

Stacktrace:
 [1] pipeline_error
   @ ./process.jl:561 [inlined]
 [2] run(::Cmd; wait::Bool)
   @ Base ./process.jl:476
 [3] run(::Cmd)
   @ Base process.jl:474
 [4] (::var"#1#2")(exe::Cmd)
   @ Main none:4
 [5] (::MPI.var"#28#29"{var"#1#2"})(cmd::Cmd)
   @ MPI ~/.julia/packages/MPI/08SPr/src/environment.jl:25
 [6] _mpiexec(fn::MPI.var"#28#29"{var"#1#2"})
   @ MPI ~/.julia/packages/MPI/08SPr/deps/deps.jl:6
 [7] mpiexec(fn::var"#1#2")
   @ MPI ~/.julia/packages/MPI/08SPr/src/environment.jl:25
 [8] top-level scope
   @ none:4

julia> versioninfo()
Julia Version 1.8.0-beta3
Commit 3e092a2521 (2022-03-29 15:42 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
  CPU: 96 × Intel(R) Xeon(R) Platinum 8255C CPU @ 2.50GHz
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, cascadelake)
  Threads: 1 on 96 virtual cores
Environment:
  JULIA_CUDA_MEMORY_POOL = none

This is an interesting one. I have encountered segfaults with CUDA-aware MPI, but that doesn't seem to be the case here. (Also if your MPI is not CUDA aware don't set the environment variable that will just slow things down)
If you run the script again does it segfault at the same location?

I don't set the environment variable JULIA_CUDA_MEMORY_POOL, get a same error, it segfault at the same location.

There was indeed a bug in FluxMPI for cuda-unaware MPI which should be resolved by https://github.com/avik-pal/FluxMPI.jl/commit/63cb56fb88bb7b8798dcd1a48ff331d4be62e4d9.

OK, I updated FluxMPI to v0.5.2, and try again, I work well.
mpiexecjl -n 6 julia --project=.. -t 8 main.jl --arch ResNet18 --batch-size=256 /train_tmp
Epoch: [0] [1550/5084]  Batch Time  0.524 ( 0.274)      Data Time  0.008 ( 0.015)       Loss 4.9286e+00 (6.0613e+00)    Acc@1   9.52 (  2.68)   Acc@5  19.05 (  8.54)
Epoch: [0] [1560/5084]  Batch Time  0.170 ( 0.274)      Data Time  0.010 ( 0.015)       Loss 4.9276e+00 (6.0557e+00)    Acc@1   4.76 (  2.71)   Acc@5  28.57 (  8.61)

data in put /train_tmp, this is a tmpfs on mem. sudo mount -t tmpfs -o size=200G  tmpfs /train_tmp

GPU memory consumption is high, batch_size smaller(256).  gpu:3090,24G x6
GPU low utilization rate: <30%

That is a different issue. Please open a separate discussion/issue for that


Using the right image for reference

Hi!
First, thanks for publishing a repo of your code.
As published. the code uses the left image as reference for disparity calculation. What would be needed to be changed to use the right image instead? Would a training from scratch be needed on the SceneFlow dataset, or could the pre-trained models be used?

@makaibranden
Hi, it is better to train a new model from scratch for right reference.
But I think it is also okay to finetune the pretrain model for right reference.
It needs to notice that the feature concatenation of cost volume.
For left reference, right features were shifted right by each disparity because corresponding point is at (x-d,y) in right image.
For right reference, left features should be shifted left by each disparity because corresponding point is at (x+d,y) in left image.


fix: new Connection Types feature issues

Due to the new "Connection types" feature, nigthly tests were failing.
This PR fixes it.
It has been tested using the nightly cluster and running ODS-1932 (In this test there is a creation and edition of a connection)

cc @jgarciao  I've fixed the issue with the creation of the data connection in the setup of pipelines tests

(The error is not related with data connections)

I think this broke the ability to create a Data Connection in a Data Science Project? I've tried running against 2.14/2.15 and the latest nightly I could find for 2.16 and it always failed for me


Issues when trying to push Synthetics tests up to an Elastic dashboard by means of tags

I am trying to push Synthetic tests up to an Elastic dashboard using tags.
In my example I have tagged a number of tests with the tag "dev" and using the following syntax
npx @elastic/synthetics push --auth <>  --url <> --tags dev
However I am receiving the error:
Aborted. Invalid CLI flags.
Tags and Match are not supported in push command.
Am I using the wrong syntax? is there an alternative method I can use? The issue is preventing me from having a repository where I can cherry pick which tests I wish to push up to different envirnments. Currently the push command pushes up every single test in my repo irrespective of tags.
Many Thanks in advance.
David Lyons.

Tags/Match options has been added to the push command in version 1.9.0 https://github.com/elastic/synthetics/pull/913, Please update your synthetics cli package by npm install -g @elastic/syntheticsand try again.


Indexing SharePoint document libraries

Hi,
I'm trying to integrate with SharePoint online document libraries using the guide provided her https://learn.microsoft.com/en-us/azure/search/search-howto-index-sharepoint-online.  Everything creates, no errors however my index appears to be empty, when I run it no documents appear, obviously there are documents in the library.  Are there any logs anywhere which will provide me some details on what's gone wrong?
Any help would be appreciated, the demo works no issues, just now I'm trying to hook into SharePoint content I'm having issues.
Thanks.

Got this working.

Hi. I'm trying to do the same.Can you please tell me how you got this to work?
How do I make it look at other indexes other than the "gptkbindex" ?

@dGanguly1
The AZURE_SEARCH_INDEX environment variable determines which index is used. Change that variable to change the index name.


Proposal for a common convention for synonyms for register ABI names in hand-coded assembler

(Moved from https://github.com/riscv/riscv-isa-manual/issues/825 at suggestion of @nick-knight; added section on alternative solutions)
The sheer number of RISC-V registers can make it hard to keep track of what has been assigned where when coding assembler by hand. Some assemblers allow the creation of synonyms -- "renaming" -- for the ABI names of the registers via .equ, .eqv or a similar statement, which can help. Such synonyms can also reduce the chance that a single typo -- say, from t0 to t1 -- remains unnoticed by coder and assembler.
However, there is currently no standard or recommended best practice for this that I am aware of. Providing such a recommendation or standard could cut down on the number of variants in the wild, aiding readability and supporting debugging of hand-written code.
This issue proposes adding a simple, short recommendation for a "common convention" or "best practices" for creating synonyms for ABI register names when hand-coding assembler, for inclusion in The RISC-V Instruction Set Manual Volume I: Unprivileged ISA, presumably in Chapter 25. The assumption is that this is going to happen anyway, so an attempt should be made to nudge coders towards a common format.
Criteria
To keep it simple, there are three criteria for this scheme:

Synonyms should only be created if many registers are in use at the same time and only for registers that are used for a longer time. In no way should "renaming" become the default practice.
The original ABI register name should be conserved to aid debugging. The idea is to add information, accepting the inherent redundancy for the sake of human readers and error detection.
In addition, an indicator of the type of data stored in the register or its intended use may be included for the same reason.

Syntax
The original register ABI name is kept, but followed by an underscore; then an optional single letter for the type or use, followed by a second underscore; finally the user-chosen name.
Examples:
    .eqv t0_n_cats t0      # current number of cats
    .eqv s1_p_catname s1   # pointer to the beginning of a string
    .eqv s2_f_havetuna s2  # flag to bool if goal achieved

As an initial suggestion for the type indicators:

c counter
f flag
l loop counter
n number of
p pointer

Important: The original ABI name of the register remains untouched and fully functional. Any new definition creates a synonym, not a replacement.
Example: The Battle of the Four Armies
Consider as a toy example a battle between hobbits, orcs, elves, and dragons, whose numbers are stored in s0, s1, s2, and s3 respectively. A code snippet to decide the winner could look like this:
        bgtz s3, dragons_win
        bgt s1, s2, orcs_win
        bgt s2, s1, elves_win
        j hobbits_win

Since these registers are used heavily in the rest of the code as well, we create synonyms following the scheme proposed:
.eqv s0_n_hobbits s0  # number of hobbitses
.eqv s1_n_orcs s1     # number of orcs
.eqv s2_n_elves s2    # number of elves
.eqv s3_n_dragons s3  # number of dragons

Our code snippet then becomes:
        bgtz s3_n_dragons, dragons_win
        bgt s1_n_orcs, s2_n_elves, orcs_win
        bgt s2_n_elves, s1_n_orcs, elves_win
        j hobbits_win

The additional information makes the code more readable and the logic easier to follow while preserving all original information. Also, a typo such as t2_n_elves will now be caught by the assembler because this name is not defined.
Drawbacks

Creating synonyms for register names or renaming registers is uncommon, since most processors simply do not have enough of them for these problems to occur. Any such change could cause confusion when readers first are confronted with code that contains renamed registers. Some people will object on principle.
There is currently no assembler-level support for this; some assemblers might even refuse creating register synonyms; possibly this might break some compiler/assembler level checks. This is a chicken-or-egg problem, as a convention for register synonyms would provide a basis for assembler writers to implement this function.
Register renaming might start to be considered a must or best practice in itself for hand-coding assembler, not a tool to be used sparingly in situations where a large number of registers in use becomes unwieldy.
There is currently no way to take back or delete synonyms once stated.

Alternatives
It seems that some people are currently using #define statements to implement this functionality. However, RISC-V should not be dependent on a single high-level language for this. Given the (slow) rise of Rust as a C alternative, this current solution seems especially problematic.
Open questions

A suggestion for the scope of using these modified names should be included, possibly on a per-subroutine or segment basis.

Thanks for moving your proposal to this repo.
I'd like to echo the comments Paul (https://github.com/riscv/riscv-isa-manual/issues/825#issuecomment-1048905783) and Nick (https://github.com/riscv/riscv-isa-manual/issues/825#issuecomment-1048942480) made.
FWIW, I'm in the camp that the C preprocessor already satisfies this need--elegantly, at that.

The #define solution leaves anybody without a C-based system out in the cold -- see https://github.com/TheThirdOne/rars for instance. Shouldn't RISC-V be independent of C, at least in the long term?

I'm sympathetic to that concern, but in no way is reliance on the C preprocessor reliance on the C language.  No one's being left out in the cold (unless they're rejecting use of the C preprocessor for anti-pragmatic reasons).

Okay. How about I create a pull request that states the problem and points to C preprocessor as a software-supported solution in a general way, mentions the above naming scheme as a poor substitute if that is not possible, and then somebody who has more experience with (and appreciation for) the C preprocessor adds some examples and hints for best practices?

Makes sense to me.

@nick-knight Sorry, you had mentioned in another comment that you use the preprocessor method extensively in your code. Might you have any recommendations or even some sort of a style guide based on your experience, or a recommendation of what not to do? Thank you!

Obviously this is a solution that nobody seems to see a problem for. I'm going to close this issue, and if it comes up again in a few years we'll know where to find it. Thank you everybody for your feedback!