[BUG] k3d not working with "Docker Toolbox on Windows"

What did you do?
Tried installing k3d on Windows 10 WSL bash. With Docker Toolbox on Windows https://docs.docker.com/toolbox/toolbox_install_windows/

How was the cluster created? And What did you do afterwards?

curl -s https://raw.githubusercontent.com/rancher/k3d/master/install.sh | bash
k3d --version
docker version
k3d create
export KUBECONFIG="$(k3d get-kubeconfig --name='k3s-default')"
kubectl cluster-info

# Lots of errors
docker logs k3d-k3s-default-server

kubectl get pods --all-namespaces
# Lots of errors
kubectl logs -n kube-system coredns-695688789-sks4b

What did you expect to happen?
No error messages for the last commands docker logs k3d-k3s-default-server and kubectl logs -n kube-system coredns-695688789-sks4b
Screenshots or terminal output
$ curl -s https://raw.githubusercontent.com/rancher/k3d/master/install.sh | bash
Preparing to install k3d into /usr/local/bin
k3d installed into /usr/local/bin/k3d
Run 'k3d --help' to see what you can do with it.

$ k3d --version
k3d version v1.2.2

$ docker version
Client:
 Version:           18.09.6
 API version:       1.39
 Go version:        go1.10.8
 Git commit:        481bc77
 Built:             Sat May  4 02:35:57 2019
 OS/Arch:           linux/amd64
 Experimental:      true

Server: Docker Engine - Community
 Engine:
  Version:          18.09.1
  API version:      1.39 (minimum version 1.12)
  Go version:       go1.10.6
  Git commit:       4c52b90
  Built:            Wed Jan  9 19:41:57 2019
  OS/Arch:          linux/amd64
  Experimental:     false

$ k3d create
2019/06/07 18:38:01 Created cluster network with ID f03510dd8524a889aa4161b965cab7b491fd197f718c35f53b75c6e397cfd80a
2019/06/07 18:38:01 Add TLS SAN for <IP_ADDRESS>
2019/06/07 18:38:01 Creating cluster [k3s-default]
2019/06/07 18:38:01 Creating server using docker.io/rancher/k3s:v0.5.0...
2019/06/07 18:38:01 SUCCESS: created cluster [k3s-default]
2019/06/07 18:38:01 You can now use the cluster with:

export KUBECONFIG="$(k3d get-kubeconfig --name='k3s-default')"
kubectl cluster-info

$ export KUBECONFIG="$(k3d get-kubeconfig --name='k3s-default')"

$ kubectl cluster-info
Kubernetes master is running at https://<IP_ADDRESS>:6443
CoreDNS is running at https://<IP_ADDRESS>:6443/api/v1/namespaces/kube-system/services/kube-dns:dns/proxy

To further debug and diagnose cluster problems, use 'kubectl cluster-info dump'.

$ docker logs k3d-k3s-default-server
time="2019-06-08T01:38:01.295353326Z" level=info msg="Starting k3s v0.5.0 (8c0116dd)"
time="2019-06-08T01:38:03.680457910Z" level=info msg="Running kube-apiserver --basic-auth-file=/var/lib/rancher/k3s/server/cred/passwd --requestheader-username-headers=X-Remote-User --service-cluster-ip-range=<IP_ADDRESS>/16 --advertise-address=<IP_ADDRESS> --insecure-port=0 --bind-address=<IP_ADDRESS> --api-audiences=unknown --watch-cache=false --advertise-port=6445 --service-account-issuer=k3s --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --allow-privileged=true --secure-port=6444 --tls-cert-file=/var/lib/rancher/k3s/server/tls/localhost.crt --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --requestheader-allowed-names=kubernetes-proxy --kubelet-client-key=/var/lib/rancher/k3s/server/tls/token-node.key --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --authorization-mode=Node,RBAC --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.key --tls-private-key-file=/var/lib/rancher/k3s/server/tls/localhost.key --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/token-node-1.crt"
E0608 01:38:04.245900       1 prometheus.go:138] failed to register depth metric admission_quota_controller: duplicate metrics collector registration attempted
E0608 01:38:04.246322       1 prometheus.go:150] failed to register adds metric admission_quota_controller: duplicate metrics collector registration attempted
E0608 01:38:04.246434       1 prometheus.go:162] failed to register latency metric admission_quota_controller: duplicate metrics collector registration attempted
E0608 01:38:04.246509       1 prometheus.go:174] failed to register work_duration metric admission_quota_controller: duplicate metrics collector registration attempted
E0608 01:38:04.246576       1 prometheus.go:189] failed to register unfinished_work_seconds metric admission_quota_controller: duplicate metrics collector registration attempted
E0608 01:38:04.246694       1 prometheus.go:202] failed to register longest_running_processor_microseconds metric admission_quota_controller: duplicate metrics collector registration attempted
W0608 01:38:04.323507       1 genericapiserver.go:315] Skipping API batch/v2alpha1 because it has no resources.
W0608 01:38:04.331378       1 genericapiserver.go:315] Skipping API node.k8s.io/v1alpha1 because it has no resources.
E0608 01:38:04.394938       1 prometheus.go:138] failed to register depth metric admission_quota_controller: duplicate metrics collector registration attempted
E0608 01:38:04.395128       1 prometheus.go:150] failed to register adds metric admission_quota_controller: duplicate metrics collector registration attempted
E0608 01:38:04.395246       1 prometheus.go:162] failed to register latency metric admission_quota_controller: duplicate metrics collector registration attempted
E0608 01:38:04.395323       1 prometheus.go:174] failed to register work_duration metric admission_quota_controller: duplicate metrics collector registration attempted
E0608 01:38:04.395400       1 prometheus.go:189] failed to register unfinished_work_seconds metric admission_quota_controller: duplicate metrics collector registration attempted
E0608 01:38:04.395461       1 prometheus.go:202] failed to register longest_running_processor_microseconds metric admission_quota_controller: duplicate metrics collector registration attempted
E0608 01:38:04.409054       1 controller.go:148] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/<IP_ADDRESS>, ResourceVersion: 0, AdditionalErrorMsg:
time="2019-06-08T01:38:04.436425259Z" level=info msg="Running kube-scheduler --leader-elect=false --port=10251 --bind-address=<IP_ADDRESS> --secure-port=0 --kubeconfig=/var/lib/rancher/k3s/server/cred/kubeconfig-system.yaml"
time="2019-06-08T01:38:04.442364922Z" level=info msg="Running kube-controller-manager --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.key --cluster-cidr=<IP_ADDRESS>/16 --root-ca-file=/var/lib/rancher/k3s/server/tls/token-ca.crt --leader-elect=false --kubeconfig=/var/lib/rancher/k3s/server/cred/kubeconfig-system.yaml --port=10252 --bind-address=<IP_ADDRESS> --secure-port=0 --allocate-node-cidrs=true"
W0608 01:38:04.450753       1 authorization.go:47] Authorization is disabled
W0608 01:38:04.450994       1 authentication.go:55] Authentication is disabled
time="2019-06-08T01:38:04.735527600Z" level=info msg="Creating CRD listenerconfigs.k3s.cattle.io"
time="2019-06-08T01:38:04.760407582Z" level=info msg="Creating CRD addons.k3s.cattle.io"
time="2019-06-08T01:38:04.780682263Z" level=info msg="Creating CRD helmcharts.k3s.cattle.io"
time="2019-06-08T01:38:04.802830548Z" level=info msg="Waiting for CRD helmcharts.k3s.cattle.io to become available"
E0608 01:38:04.844869       1 autoregister_controller.go:193] v1.k3s.cattle.io failed with : apiservices.apiregistration.k8s.io "v1.k3s.cattle.io" already exists
time="2019-06-08T01:38:05.305204658Z" level=info msg="Done waiting for CRD helmcharts.k3s.cattle.io to become available"time="2019-06-08T01:38:05.305322727Z" level=info msg="Waiting for CRD addons.k3s.cattle.io to become available"
time="2019-06-08T01:38:05.807375332Z" level=info msg="Done waiting for CRD addons.k3s.cattle.io to become available"
time="2019-06-08T01:38:05.810677137Z" level=info msg="Listening on :6443"
time="2019-06-08T01:38:06.164764985Z" level=info msg="Node token is available at /var/lib/rancher/k3s/server/node-token"time="2019-06-08T01:38:06.164895057Z" level=info msg="To join node to cluster: k3s agent -s https://<IP_ADDRESS>:6443 -t ${NODE_TOKEN}"
time="2019-06-08T01:38:06.167052357Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-1.64.0.tgz"
time="2019-06-08T01:38:06.167368640Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml"
time="2019-06-08T01:38:06.167472130Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml"
time="2019-06-08T01:38:06.375916133Z" level=info msg="Wrote kubeconfig /output/kubeconfig.yaml"
time="2019-06-08T01:38:06.376031588Z" level=info msg="Run: k3s kubectl"
time="2019-06-08T01:38:06.376077645Z" level=info msg="k3s is up and running"
time="2019-06-08T01:38:06.701540087Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log"
time="2019-06-08T01:38:06.701847586Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml -a /run/k3s/containerd/containerd.sock --state /run/k3s/containerd --root /var/lib/rancher/k3s/agent/containerd"
time="2019-06-08T01:38:06.703074341Z" level=info msg="Waiting for containerd startup: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: connection error: desc = \"transport: Error while dialing dial unix /run/k3s/containerd/containerd.sock: connect: no such file or directory\""
time="2019-06-08T01:38:07.706822659Z" level=warning msg="failed to start br_netfilter module"
time="2019-06-08T01:38:07.707656405Z" level=info msg="Connecting to wss://localhost:6443/v1-k3s/connect"
time="2019-06-08T01:38:07.707722569Z" level=info msg="Connecting to proxy" url="wss://localhost:6443/v1-k3s/connect"
time="2019-06-08T01:38:07.755669679Z" level=info msg="Handling backend connection request [k3d-k3s-default-server]"
time="2019-06-08T01:38:07.756518754Z" level=warning msg="Disabling CPU quotas due to missing cpu.cfs_period_us"
time="2019-06-08T01:38:07.756792296Z" level=info msg="Running kubelet --container-runtime=remote --container-runtime-endpoint=unix:///run/k3s/containerd/containerd.sock --anonymous-auth=false --client-ca-file=/var/lib/rancher/k3s/agent/client-ca.pem --tls-private-key-file=/var/lib/rancher/k3s/agent/token-node.key --eviction-minimum-reclaim=imagefs.available=10%,nodefs.available=10% --cni-conf-dir=/var/lib/rancher/k3s/agent/etc/cni/net.d --seccomp-profile-root=/var/lib/rancher/k3s/agent/kubelet/seccomp --cni-bin-dir=/bin --hostname-override=k3d-k3s-default-server --authentication-token-webhook=true --authorization-mode=Webhook --fail-swap-on=false --tls-cert-file=/var/lib/rancher/k3s/agent/token-node.crt --cluster-dns=<IP_ADDRESS> --cluster-domain=cluster.local --address=<IP_ADDRESS> --cpu-cfs-quota=false --cert-dir=/var/lib/rancher/k3s/agent/kubelet/pki --healthz-bind-address=<IP_ADDRESS> --read-only-port=0 --root-dir=/var/lib/rancher/k3s/agent/kubelet --serialize-image-pulls=false --allow-privileged=true --eviction-hard=imagefs.available<5%,nodefs.available<5% --kubeconfig=/var/lib/rancher/k3s/agent/kubeconfig.yaml --resolv-conf=/tmp/k3s-resolv.conf --cgroup-driver=cgroupfs"
Flag --allow-privileged has been deprecated, will be removed in a future version
W0608 01:38:07.767574       1 info.go:52] Couldn't collect info from any of the files in "/etc/machine-id,/var/lib/dbus/machine-id"
W0608 01:38:07.768544       1 server.go:214] WARNING: all flags other than --config, --write-config-to, and --cleanup are deprecated. Please begin using a config file ASAP.
W0608 01:38:07.770461       1 proxier.go:480] Failed to read file /lib/modules/4.14.92-boot2docker/modules.builtin with error open /lib/modules/4.14.92-boot2docker/modules.builtin: no such file or directory. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0608 01:38:07.783510       1 proxier.go:493] Failed to load kernel module ip_vs with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0608 01:38:07.783834       1 proxier.go:493] Failed to load kernel module ip_vs_rr with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0608 01:38:07.784084       1 proxier.go:493] Failed to load kernel module ip_vs_wrr with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0608 01:38:07.784371       1 proxier.go:493] Failed to load kernel module ip_vs_sh with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0608 01:38:07.784606       1 proxier.go:493] Failed to load kernel module nf_conntrack_ipv4 with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0608 01:38:07.791830       1 probe.go:268] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating.
E0608 01:38:07.818982       1 kubelet_network_linux.go:68] Failed to ensure rule to drop packet marked by KUBE-MARK-DROP in filter chain KUBE-FIREWALL: error appending rule: exit status 1: iptables: No chain/target/match by that name.
E0608 01:38:07.820187       1 cri_stats_provider.go:373] Failed to get the info of the filesystem with mountpoint "/var/lib/rancher/k3s/agent/containerd/io.containerd.snapshotter.v1.overlayfs": unable to find data in memory cache.
 Stats initialization may not have completed yet: invalid capacity 0 on image filesystem
time="2019-06-08T01:38:07.850853889Z" level=info msg="waiting for node k3d-k3s-default-server: nodes \"k3d-k3s-default-server\" not found"
W0608 01:38:07.854786       1 node.go:113] Failed to retrieve node info: nodes "k3d-k3s-default-server" not found
W0608 01:38:07.855122       1 proxier.go:314] invalid nodeIP, initializing kube-proxy with <IP_ADDRESS> as nodeIP
E0608 01:38:07.867658       1 conntrack.go:85] failed to set conntrack hashsize to 32768: write /sys/module/nf_conntrack/parameters/hashsize: operation not supported
W0608 01:38:07.874816       1 manager.go:537] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
E0608 01:38:07.876158       1 eviction_manager.go:247] eviction manager: failed to get summary stats: failed to get node info: node "k3d-k3s-default-server" not found
W0608 01:38:07.895587       1 lease.go:222] Resetting endpoints for master service "kubernetes" to [<IP_ADDRESS>]
E0608 01:38:07.898766       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:08.000286       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:08.100458       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:08.200814       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:08.301959       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:08.403627       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:08.506072       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:08.608700       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:08.710084       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:08.810888       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
W0608 01:38:08.886459       1 controllermanager.go:445] Skipping "csrsigning"
E0608 01:38:08.911297       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:09.011461       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
W0608 01:38:09.040187       1 shared_informer.go:312] resyncPeriod<PHONE_NUMBER>8201 is smaller than resyncCheckPeriod<PHONE_NUMBER>2869 and the informer has already started. Changing it to<PHONE_NUMBER>2869
E0608 01:38:09.040504       1 resource_quota_controller.go:171] initial monitor sync has error: [couldn't start monitor for resource "extensions/v1beta1, Resource=networkpolicies": unable to monitor quota for resource "extensions/v1beta1, Resource=networkpolicies", couldn't start monitor for resource "k3s.cattle.io/v1, Resource=helmcharts": unable to monitor quota for resource "k3s.cattle.io/v1, Resource=helmcharts", couldn't start monitor for resource "k3s.cattle.io/v1, Resource=addons": unable to monitor quota for resource "k3s.cattle.io/v1, Resource=addons", couldn't start monitor for resource "k3s.cattle.io/v1, Resource=listenerconfigs": unable to monitor quota for resource "k3s.cattle.io/v1, Resource=listenerconfigs"]
W0608 01:38:09.041154       1 controllermanager.go:445] Skipping "root-ca-cert-publisher"
E0608 01:38:09.111648       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:09.211849       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:09.311996       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:09.412650       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:09.513444       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:09.616702       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:09.717373       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:09.817914       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:09.919538       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:10.021290       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:10.121547       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:10.224442       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:10.324620       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:10.426642       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:10.528729       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:10.629327       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:10.730373       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:10.831404       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:10.933432       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:11.033635       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:11.133870       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:11.236064       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:11.347255       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:11.447885       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:11.548154       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:11.648660       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:11.748881       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:11.849332       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
time="2019-06-08T01:38:11.912654090Z" level=info msg="waiting for node k3d-k3s-default-server CIDR not assigned yet"
time="2019-06-08T01:38:11.915771494Z" level=info msg="Updated coredns node hosts entry [<IP_ADDRESS> k3d-k3s-default-server]"
E0608 01:38:11.949732       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
E0608 01:38:11.972793       1 proxier.go:696] Failed to ensure that filter chain INPUT jumps to KUBE-EXTERNAL-SERVICES: error appending rule: exit status 1: iptables: No chain/target/match by that name.
E0608 01:38:12.049990       1 kubelet.go:2207] node "k3d-k3s-default-server" not found
time="2019-06-08T01:38:13.915897489Z" level=info msg="waiting for node k3d-k3s-default-server CIDR not assigned yet"
time="2019-06-08T01:38:15.946193390Z" level=info msg="waiting for node k3d-k3s-default-server CIDR not assigned yet"
E0608 01:38:17.880856       1 summary_sys_containers.go:47] Failed to get system container stats for "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy": failed to get cgroup stats for "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy": failed to get container info for "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy": unknown container "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy"
time="2019-06-08T01:38:17.947998415Z" level=info msg="waiting for node k3d-k3s-default-server CIDR not assigned yet"
E0608 01:38:19.363922       1 resource_quota_controller.go:437] failed to sync resource monitors: [couldn't start monitor for resource "k3s.cattle.io/v1, Resource=listenerconfigs": unable to monitor quota for resource "k3s.cattle.io/v1, Resource=listenerconfigs", couldn't start monitor for resource "extensions/v1beta1, Resource=networkpolicies": unable to monitor quota for resource "extensions/v1beta1, Resource=networkpolicies", couldn't start monitor for resource "k3s.cattle.io/v1, Resource=helmcharts": unable to monitor quota for resource "k3s.cattle.io/v1, Resource=helmcharts", couldn't start monitor for resource "k3s.cattle.io/v1, Resource=addons": unable to monitor quota for resource "k3s.cattle.io/v1, Resource=addons"]
W0608 01:38:19.419621       1 actual_state_of_world.go:503] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="k3d-k3s-default-server" does not exist
W0608 01:38:19.457953       1 node_lifecycle_controller.go:833] Missing timestamp for Node k3d-k3s-default-server. Assuming now as a timestamp.
E0608 01:38:19.962047       1 proxier.go:696] Failed to ensure that filter chain INPUT jumps to KUBE-EXTERNAL-SERVICES: error appending rule: exit status 1: iptables: No chain/target/match by that name.
E0608 01:38:20.089132       1 clusterroleaggregation_controller.go:180] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
E0608 01:38:20.156695       1 clusterroleaggregation_controller.go:180] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
E0608 01:38:27.893876       1 summary_sys_containers.go:47] Failed to get system container stats for "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy": failed to get cgroup stats for "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy": failed to get container info for "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy": unknown container "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy"
E0608 01:38:34.194231       1 proxier.go:696] Failed to ensure that filter chain INPUT jumps to KUBE-EXTERNAL-SERVICES: error appending rule: exit status 1: iptables: No chain/target/match by that name.
E0608 01:38:37.905681       1 summary_sys_containers.go:47] Failed to get system container stats for "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy": failed to get cgroup stats for "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy": failed to get container info for "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy": unknown container "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy"
E0608 01:38:47.911644       1 summary_sys_containers.go:47] Failed to get system container stats for "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy": failed to get cgroup stats for "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy": failed to get container info for "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy": unknown container "/docker/b65fddd6296529c9414952b929986d92093e67ffcb0c9173cce5766cfd88ae22/kube-proxy"

$ kubectl get pods --all-namespaces
NAMESPACE     NAME                         READY   STATUS    RESTARTS   AGE
kube-system   coredns-695688789-568cf      1/1     Running   0          38s
kube-system   helm-install-traefik-ccbmb   1/1     Running   0          37s

$ kubectl logs -n kube-system coredns-695688789-568cf
.:53
2019-06-08T01:38:38.615Z [INFO] CoreDNS-1.3.0
2019-06-08T01:38:38.615Z [INFO] linux/amd64, go1.11.4, c8f0e94
CoreDNS-1.3.0
linux/amd64, go1.11.4, c8f0e94
2019-06-08T01:38:38.615Z [INFO] plugin/reload: Running configuration MD5 = ef347efee19aa82f09972f89f92da1cf
E0608 01:39:03.615524       1 reflector.go:205] github.com/coredns/coredns/plugin/kubernetes/controller.go:322: Failed to list *v1.Namespace: Get https://<IP_ADDRESS>:443/api/v1/namespaces?limit=500&resourceVersion=0: dial tcp <IP_ADDRESS>:443: i/o timeout
E0608 01:39:03.617480       1 reflector.go:205] github.com/coredns/coredns/plugin/kubernetes/controller.go:317: Failed to list *v1.Endpoints: Get https://<IP_ADDRESS>:443/api/v1/endpoints?limit=500&resourceVersion=0: dial tcp <IP_ADDRESS>:443: i/o timeout
E0608 01:39:03.617647       1 reflector.go:205] github.com/coredns/coredns/plugin/kubernetes/controller.go:315: Failed to list *v1.Service: Get https://<IP_ADDRESS>:443/api/v1/services?limit=500&resourceVersion=0: dial tcp <IP_ADDRESS>:443: i/o timeout

Which OS & Architecture?

Windows 10 amd64

Which version of k3d?

k3d version v1.2.2

Which version of docker?
$ docker version
Client:
 Version:           18.09.6
 API version:       1.39
 Go version:        go1.10.8
 Git commit:        481bc77
 Built:             Sat May  4 02:35:57 2019
 OS/Arch:           linux/amd64
 Experimental:      true

Server: Docker Engine - Community
 Engine:
  Version:          18.09.1
  API version:      1.39 (minimum version 1.12)
  Go version:       go1.10.6
  Git commit:       4c52b90
  Built:            Wed Jan  9 19:41:57 2019
  OS/Arch:          linux/amd64
  Experimental:     false

Additional note

Previously filed a bug for the same issue https://github.com/rancher/k3d/issues/68 but still reproducible with k3d 1.2.2 which includes the fix https://github.com/rancher/k3d/pull/71
On my WSL bash shell, I had to create a soft link docker-machine that points to docker-machine.exe

I think this could be just a general docker-machine networking issue, not specific to windows wsl.

I tried this on my machine too and couldn't get k3d working correctly. Seems like a docker-machine issue. I'll try to keep working on this and search for anything in the meantime.

Hey @kkimdev, do you still have issues?
@zeerorg did you maybe find out more about this issue?

@iwilltry42 Yes I just tried again the same instruction and hitting the same issue.  FYI, this is WSL 1 and not WSL 2.

Unfortunately, I cannot test it myself as my Windows machine is set up with the latest Insider Build, using WSL 2 and "native docker"...

hi everyone,
just saw this one and it that it was related to my beloved WSL :)
quick question: how are you connecting the docker linux cli to the docker-machine.exe windows daemon?
If I'm not too much mistaken, docker-machine.exe will run a virtualbox VM with the docker daemon on it, correct?
and here is 2 lines that seem to indicate a module is missing:
time="2019-06-08T01:38:06.703074341Z" level=info msg="Waiting for containerd startup: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: connection error: desc = "transport: Error while dialing dial unix /run/k3s/containerd/containerd.sock: connect: no such file or directory""
time="2019-06-08T01:38:07.706822659Z" level=warning msg="failed to start br_netfilter module"
Looks like the same error we had before the WSL2 custom kernel.
if you symlink docker to docker.exe, do you have the same/another error?

@nunix Hi thanks for the comment!  Though I recently ditched "Docker Toolbox on Windows" and started using native Docker installed on WSL 2. https://ariya.io/2019/06/cross-compiling-with-docker-on-wsl-2
It also fails to start k3d for a different reason though, maybe I should file a bug.

ok no problem.
For K3d to work on WSL2, you will need to build the custom kernel first (it will certainly be updated in the future):
https://gist.github.com/ibuildthecloud/1b7d6940552ada6d37f54c71a89f7d00
Hope this helps.
BR
Nunix

@nunix oh nice! Thanks for the info!  It seems like it's just missing few required CONFIG_ in the WSL2 default kernel.

So how's the status of this issue? Is there still work needed or did WSL2 solve all the problems here?

Any update on this @kkimdev ?

Hi there, is this still a valid open issue? (@kkimdev )

@iwilltry42 Hi, my main project got changed and no longer use k3d in my daily work, and I don't know the latest status.  Please feel free to close, thanks!


[firebase_crashlytics] log should print if debugging and enableInDevMode is not set

Feature Request
When a consumer calls Crashlytics.instance.log(msg) while debugging (and without enableInDevMode set), we should print the msg to the console. When teams write meaningful debug statements, they should be useful in both production and development. Sometimes we may throw some quick temporary prints but we're not really discussing those ones.
Use Case
Flutter developer/team "X" just implemented Firebase Crashlytics via Flutter's plugin and swapped all their meaningful print statements to Crashlytics.instance.log(msg), but now all their logs are gone. They wrote a wrapper method that does both print and log to Crashlytics.
Of course, we could leave it up to them to write the wrapper if they chose, but opening this to get community's thoughts on it.

@jeffscaturro-aka
The issue at https://github.com/flutter/flutter/issues/30591 has been closed and moved here. Future collaboration on this issue will be done here.

1151

Given the age of this issue and that Crashlytics has had a major rework since; I'm going to close this issue in favour of trying the latest release.


Why not use Github Gist instead of Github Issues?

The GitHub issue search API does not require authentication. This allows utterances to find and display the issue (and comments) associated with a particular blog page without forcing the user to sign in.
There's no equivalent API for Gists.


Warehouse login page missing password reset

I noticed that there doesn't appear to be a password reset button on the Login page for Warehouse.  Do you think we should add one, so users can automatically recover their passwords if they forget them?

Open PR: https://github.com/pypa/warehouse/pull/1262
Existing Issue: https://github.com/pypa/warehouse/issues/1228
@lgh2 is there something this issue intends to capture that the above issue and PR do not?

I'm sorry Ernest, I didn't see the other issue.


How in c# attribute implementation differentiates in and out binding?

Any where in the C# attribute binding example there is not a direction parameter.The trigger is always has the direction in. How about if there 2 more bindings. So how the implementation differentiates input or output direction ?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 549d8479-4b0d-a018-c431-5dc1112a7fa7
Version Independent ID: d583e5b2-559f-8b7d-a1f6-62e0005f13d8
Content: Azure Functions trigger and binding example
Content Source: articles/azure-functions/functions-bindings-example.md
Service: azure-functions
GitHub Login: @craigshoemaker
Microsoft Alias: cshoe

@vinothrao Thank you posting your question. We will review this and provide an update as appropriate.

To understand the input and output binding usage please check the Binding Section Azure Function documentation.
See blob storage Input usage
See blob storage Output usage

@vinothrao Checking in to see if the above post helped answering your question.

@vinothrao Since we have not heard back from you we will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.


Review of documentation and core project docs

Need someone to do a review of the grammar and general wording of this project's docs.

README.md
SECURITY.md
CONTRIBUTING.md
CONTRIBUTORS.md
CHANGELOG.md

Reached out to core team to get someone to read these.

Going to close this now, a few others have had a read - the code coverage can be done if needed as a future work.


Explain what the auth field in the secret encodes

I found this useful when creating my secret via a yaml file.

/assign
/approve
/lgtm


Update Fork

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.0 out of 2 committers have signed the CLA.:x: maweck:x: productionlineYou have signed the CLA already but the status is still pending? Let us recheck it.


Add countries states cities database repo

Thank you for contributing! Please confirm this pull request meets the following requirements:

[x] I followed the contributing guidelines: https://github.com/github/explore/blob/master/CONTRIBUTING.md
[x] I have no affiliation with the project I am suggesting (as a maintainer, creator, contractor, or employee).

Which change are you proposing?

[ ] Suggesting edits to an existing topic or collection
[x] Curating a new topic or collection
[ ] Something that does not neatly fit into the binary options above

Editing an existing topic or collection
I'm suggesting these edits to an existing topic or collection:

[ ] Image (and my file is *.png, square, dimensions 288x288)
[x] Content (and my changes are in index.md)

Please replace this line with an explanation of why you think these changes should be made.

Curating a new topic or collection

[ ] I've formatted my changes as a new folder directory, named for the topic or collection as it appears in the URL on GitHub (e.g. https://github.com/topics/[NAME] or https://github.com/collections/[NAME])
[ ] My folder contains a *.png image (if applicable) and index.md
[x] All required fields in my index.md conform to the Style Guide and API docs: https://github.com/github/explore/tree/master/docs

Please replace this line with an explanation of why you think this topic or collection should be curated.

Something that does not neatly fit into the binary options above

[ ] My suggested edits are not about an existing topic or collection, or at least not a single one
[ ] My suggested edits are not about curating a new topic or collection, or at least not a single one
[ ] My suggested edits conform to the Style Guide and API docs: https://github.com/github/explore/tree/master/docs

Please replace this line with an explanation of your proposed changes.

Please note: we will close your PR without comment if you do not check the boxes above and provide ALL requested information.

Hey, @dr5hn Thank you for contributing. But, Unfortunately as per contribution guidelines, we restrict self promotion. Thank you!

Ok no worries. Will wait for repo's FAN's to post it 😉
Thanks

[x]  I have no affiliation with the project I am suggesting (as a maintainer, creator, contractor, or employee).

Passing on this, sorry @dr5hn!


marwaita: 11.1 -> 11.2

Motivation for this change
Update to version 11.2
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
21.11 Release Notes (or backporting 21.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 141621 run on x86_64-linux 1

1 package built:

marwaita


service/block: Implement block store

This PR implements the block store which allows block data to be stored and retrieved via the provided DAGService. The block.Service receives an ipld.DAGService upon construction and uses it for writing and reading block data. Block data can be retrieved via the DataAvailabilityHeader.
Merging blocked by #110.
Resolves #47.
Related to #25.

Do we store the block data in mem for a while and then pop it out after X number of new blocks?

This sounds reasonable to me, perhaps do what geth does and allow the user to specify a command line argument that sets the max RAM allowed to be used by the cache, so that very big blocks don't DoS nodes in the future. If a node has to restart for whatever reason, then you'd also have to rebuild this cache by reading the disk. I think some kind of ring buffer struct would be fine here since for sampling you'll want to access the entire block for sampling.
Current PR LGTM.


Alpine: use busybox ntpd

Kairos version: alpine-ubuntu and probably alpine-opensuse-leap
CPU architecture, OS, and Version: amd64
Describe the bug
It could be just a problem for my server, but when openntpd is used, prometheus gives an alert:
 Clock on <hostname>:9796 is out of sync by more than 300s. Ensure NTP is configured correctly on this host.

I stopped the openntpd-service, patched /etc/init.d/ntpd to use the busybox binary (necessary since ntpd doesn't point to busybox), started the ntpd-service and the alert disappears.
(There would be no need for a patch if openntpd wasn't installed in the alpine flavor, ntpd would point to busybox)
To Reproduce
Join an alpine k3s-agent (no special config) to a cluster with prometheus monitoring and alerting installed. After a short period the alert is firing.
Expected behavior
No such errors.
Question
Is it mandatory to install a dedicated ntpd-package on alpine? Why not stick with the (working) busybox-version?
It could also help reduce confusion. See #476

I can now confirm, that this nasty problem occurs on every server I installed alpine on. On every node I have to manually stop openntpd service, patch /etc/init.d/ntpd and start the busybox-version of ntpd to get rid of the message. Perhaps it is related to the fact, that openntpd not only acts as a client but also as a server which is not really needed here.
@mudler: I would recommend removing the openntpd package from alpine images:
In the file images/Dockerfile.alpine-opensuse-leap remove line 97 and the backslash from the previous one. That should do the trick.
(One has to test, if ntpd-service (busybox) is starting. But I think it should.)

good catch @christianprim , I think that should be trivial to fix indeed, I think there was just some overlap with openntpd at some point, but ntpd from busybox should fit just fine our case


Exceptions when attempting to import

It appears that a Class Inheritance was missed and caused a super() to throw an TypeError exception I have created PR to correct this but the 16x8 Matrix still appears to not work.
https://github.com/adafruit/micropython-adafruit-ht16k33/pull/7

We have merged this PR with the fix for this issue, however, this library is no longer supported. We are only supporting CircuitPython. Please fork this repo if you wish to continue development.


Add stableid.json and stableabilityid.json to version control

sc2_typeenums.h mentions these files:

All units and abilities are represented as unsigned numbers in the StarCraft II engine. This can make issue abilities unnecessarily hard.
This file aims to provide a type safe and named way of representing unit types and ability types. Entries in it are generated by a custom
built script so it is possible they don't have every possible id in the engine but they should have most of the common ones.
See stableid.json and stableabilityid.json to see all of them.

I'm unable to find these files, and I think it would be useful to have them published here. (or maybe in the proto repository).

That comment is a bit out of date. Those used to be loose files, but now they are included in the game installation.
The id mapping those files define is the same as what is output by ObservationInterface::GetUnitTypeData. This is the most reliable place to find this data.
For the common id's at least, we were thinking about exposing that list in the proto files themselves. (See Blizzard/s2client-proto#16)
Technically you can actually find this file in your SC2 documents directory:
C:\Users\username\Documents\StarCraft II\stableid.json
I wouldn't rely on looking at this file though as we may remove/move it in the future. (We were planning on allowing you to override the id mapping with this file, but never got around to implementing it. The file is still sitting there though.)


Multitype

@diorcety there a re a few design issues in your grammar, I'm working on it :-)

Obsoleted by #654


How to zoom at the center of the image programmatically

I've take a look at this PR. According to this I can use
zoomState.changeScale(
     zoomstate.scale * 2,
     Offset(X,Y),
)

Where X and Y would be if I understood it correctly. @usuiat  Is the formula looks correct to you?
X = (w∗scale−w)/2
Y = (h∗scale−h)/2

Currently cant access the layout size from the zoomState. How can I achieve this?

Currently, on passing the same offset, it behaves like the following.
zoomState.changeScale(
                zoomState.scale + 1,
                Offset(zoomState.offsetX, zoomState.offsetY),
              )

https://github.com/usuiat/Zoomable/assets/50016799/ad772ba5-26bd-43e1-89d8-ec6861381ee0
@usuiat I would appreciate your response. Thanks!

@hellosagar
One possible way to achieve this is Modifier.onSizeChanged.
You can get the size of image like below.
var size = remember { Size.Unspecified }
Image(
    ...
    modifier = Modifier
        .onSizeChanged { size = it.toSize() }
        .zoomable( ... )
)

Then you can pass size.center to ZoomState.changeScale.
zoomState.changeScale(
    targetScale = 2f,
    position = size.center
)

By the way, I am wondering if I should make ZoomState.layoutSize public.
Because it is not available at the time ZoomState is created.


fix:Update watchtower image to latest and added env WATCHTOWER_LIFECYCLE_…

This docker-compose.yml file is being used by Appsmith images for AWS and DigitalOcean.
I've updated this for a quick fix instead of building and publishing new images.

@sum35h - The PR was pointing to v1.4, which is no longer in use. I modified the base, but it seems that your local branch is not up to date. Could you please relook at it and fix the issue?

@sum35h - As discussed, for changes to v1.4 branch, please checkout v1.4 and raise a PR against it. Also, raise a different PR using the main as a base to update the file in the main branch.


Add utility to generate schema for ndt5 and ndt7 output formats

This change adds a simple utility to generate schemas for the ndt5 and ndt7 output formats. This utility could be used in conjunction with jostler and the autoloading pipeline for special deployments.
This change includes separate go.mod files so that the bigquery and related dependencies are not inherited by the ndt-server itself, only by this command.

This change is

Pull Request Test Coverage Report for Build 1647

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.04%) to 81.68%

Totals

Change from base Build 1645:
0.04%

Covered Lines:
1828

Relevant Lines:
2238

💛  - Coveralls


[ENH/WIP] Strip reportlets out of full report

A first stab at #478. Requires poldracklab/niworkflows#210 to be merged in first
The stripped svgs are stored in:
fmriprep/
 |- sub-01/
 |   |- anat/
 |   |- func/
 |   \- svg/
 |       \- *.svg  <------- HERE
 \- sub-01.html

we can move it if you think that is not right.

Maybe figures/ or fig/? Just to give a description besides the file type.


Make sure custom protocol is handled as secure context on macOS

What kind of change does this PR introduce? (check at least one)

[x] Bugfix
[ ] Feature
[ ] New Binding Issue #___
[ ] Code style update
[ ] Refactor
[ ] Build-related changes
[ ] Other, please describe:

Does this PR introduce a breaking change? (check one)

[ ] Yes. Issue #___
[x] No

The PR fulfills these requirements:

[ ] When resolving a specific issue, it's referenced in the PR's title (e.g. fix: #xxx[,#xxx], where "xxx" is the issue number)
[x] A change file is added if any packages will require a version bump due to this PR per the instructions in the readme.

Other information:
Do not seem to affect other platforms need to test on Windows and Linux to be sure it didn’t break anything.
Fix #1550
Related to https://github.com/tauri-apps/wry/issues/85
Without the fix:

With the fix

I'm checking how local storage behaves with this solution. I think the webview caches it based on the url :/

I'm checking how local storage behaves with this solution. I think the webview caches it based on the url :/

maybe we could make sure local storage use app and not tauri-shared directory for storage.

I'm checking how local storage behaves with this solution. I think the webview caches it based on the url :/

maybe we could make sure local storage use app and not tauri-shared directory for storage.

That would be great

That would be great

macOS
It's stored inside ~/Library/WebKit and uses the package.id

Windows
We already use with_user_data_folder so not a problem
Linux
Need to check this out

Linux might need this: https://webkitgtk.org/reference/webkit2gtk/stable/WebKitWebsiteDataManager.html#WebKitWebsiteDataManager--local-storage-directory

webkit stores localstorage under $HOME/.local/share/webkitgtk/localstorage, so we do need to change it. I'll PR wry.

Unfortunately navigator.mediaDevices is still undefined on Linux :( we probably need to tweak something on the wry end.

Unfortunately navigator.mediaDevices is still undefined on Linux :( we probably need to tweak something on the wry end.

ok I'll try to make some tests to see what we can do

Since this is a macOS PR i'll merge it.

I think we haven't enabled it yet but the method/signal should be here:
https://webkitgtk.org/reference/webkit2gtk/stable/WebKitWebView.html#WebKitWebView-permission-request


Ability to modify sequence bar in plots

I'd like to be able to move/hide the sequence bar in plots.

This has been added.


Class-based endpoints produce an error on schema generation

When using class-based endpoints, if no methods are explicitly passed to add_route, this will raise an error when generating the schema. (using starlette==0.11.4, starlette-api==0.6.2)
from starlette.requests import Request
from starlette.responses import Response
from starlette_api.applications import Starlette
from starlette_api.endpoints import HTTPEndpoint

app = Starlette(
    title="Test",
    version="1.0",
    description="Test",
    schema="/schema/",
    docs="/docs/",
    redoc="/redoc/",
)

class FooEndpoint(HTTPEndpoint):
    async def get(self, request: Request):
        return Response()

    async def post(self, request: Request):
        return Response()

app.add_route("/", FooEndpoint, name="foo")

Traceback:
INFO: ('<IP_ADDRESS>', 53618) - "GET /schema/ HTTP/1.1" 500
ERROR: Exception in ASGI application
Traceback (most recent call last):
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/uvicorn/protocols/http/httptools_impl.py", line 372, in run_asgi
    result = await asgi(self.receive, self.send)
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/uvicorn/middleware/debug.py", line 83, in __call__
    raise exc from None
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/uvicorn/middleware/debug.py", line 80, in __call__
    await asgi(receive, self.send)
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/starlette/middleware/errors.py", line 125, in asgi
    raise exc from None
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/starlette/middleware/errors.py", line 103, in asgi
    await asgi(receive, _send)
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/starlette/exceptions.py", line 74, in app
    raise exc from None
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/starlette/exceptions.py", line 63, in app
    await instance(receive, sender)
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/starlette_api/routing.py", line 174, in awaitable
    response = await run_in_threadpool(injected_func)
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/starlette/concurrency.py", line 24, in run_in_threadpool
    return await loop.run_in_executor(None, func, *args)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/starlette_api/schemas.py", line 223, in schema
    return OpenAPIResponse(self.schema)
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/starlette_api/schemas.py", line 219, in schema
    return self.schema_generator.get_schema(self.routes)
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/starlette_api/schemas.py", line 175, in get_schema
    self.spec.add_path(path=path, operations={e.method: self.get_endpoint_schema(e) for e in endpoints})
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/starlette_api/schemas.py", line 175, in <dictcomp>
    self.spec.add_path(path=path, operations={e.method: self.get_endpoint_schema(e) for e in endpoints})
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/starlette_api/schemas.py", line 156, in get_endpoint_schema
    self.get_endpoint_parameters_schema(endpoint, schema)
  File "/Users/test/.virtualenvs/play/lib/python3.7/site-packages/starlette_api/schemas.py", line 114, in get_endpoint_parameters_schema
    for field in itertools.chain(endpoint.query_fields.values(), endpoint.path_fields.values())
AttributeError: 'NoneType' object has no attribute 'values'

Should be fixed with changes committed on 0429f27.
Thanks !


Split out CRFM API proxy client into its own library

Users should be able to pip install a library and get access to the CRFM API proxy.
Also, the client code is currently entangled with the server code; it would be nice to decouple them in the long term.

closing as duplicate of #1327 which also has a proposal.


Modify command system for better LAN compatiblity as well as a generic random bot names system

Add an option to have ip address (v4) to be automatically considered operator as well as add a system using http://random-word-form.herokuapp.com/ to generate a generic random name for bots.

Remove the bot names I spent 5 hours on mine it needs to be used.

I have removed bot names per request


Support impossible checks when validate position

Similar to this functionality IMPOSSIBLE_CHECK from shakmaty.
Not sure where it should be implemented, maybe in FenReader
Variants

[x] Standard: #446
[x] Chess960: re-use function from Standard: #458
[x] ThreeChecks: re-use function from Standard: #458
[x] KingOfTheHill: re-use function from Standard: #458
[x] Antichess
[ ] Atomic
[ ] Crazyhouse
[ ] Horde
[ ] Racing Kings

What's the purpose of supporting illegal checks?

It's generally not feasible to prevent all illegal (as in proof-game solving) positions. So instead, we allow all positions that meet very basic validity requirements. There are interesting positions among those, so it's nice to allow this.
This is the status quo, and now also required for backwards compatibility.
Now a tricky problem: Stockfish, on paper, assumes strict legality, and does not care what happens if it is asked to analyse/play a position that violates this (producing illegal moves, bad evals, crashes). So can we safely pass a given position to current and future Stockfish versions? Not feasible to answer.
Instead, we checked the current implementation of Stockfish for the assumptions it currently actually makes. This leads to the following (somewhat arbitrary looking) criteria for valid checks, as implemented in https://docs.rs/shakmaty/0.25.0/src/shakmaty/position.rs.html#2906-2937:

There can be at most two checkers
If the last move was a two-step pawn advance, as indicated by the en passant square, then the pushed pawn must be the only checker, or it has uncovered check by a single sliding piece
Discovered checkers cannot be aligned on the same file/rank/diagonal

It seems likely that these criteria are pretty stable.
They should be implemented in scalachess, too. I think the proper place is the strict validation of https://github.com/lichess-org/scalachess/blob/34bd38de897d472bb1ae96e16f094792ba24fdeb/src/main/scala/Situation.scala#L53
Related: https://github.com/lichess-org/lila/issues/9817

Is this feature expected for standard chess only?

We can implement this for all variants (one by one). And the most important one is standard.

Since the goal of this issue is to make situation validation compatible with stockfish, do we need to implement it for the other variants like AntiChess? As I understand, stockfish only evaluates standard chess position or assumes the position it receives is for  standard chess.

We use fairy stockfish for variants. So it would be nice to have those validation as well.
But they can be different from Standard. Not sure Shakmaty, implement those or not. If it does, we can just port from it :D

Also, I think the logic for standard can be reused for crazy house.

Also for Horde, I think the standard rule should also work. If the variant already has validation to make sure that white does not have a king, then we can just check if the standard rule for impossible checks is violated.

Yeah, I think you're right, that makes only Atomic (as always) left.

I read the rules for Atomic chess, and as I understand it, the rules does not change for checks, the only different rules from standard is related to captures and king being side by side.  Technically the standard logic for impossible checks should work too.

I noticed that there is already some validation for some these impossible check positions. For example I cannot continue playing this game or analyse it in horde chess. How does Lila do this validation if its not from scala chess?

https://lichess.org/editor/5r2/8/4k2R/8/3pP3/8/PPPP1PPP/2PPPPP1_b_-_e3_0_1?variant=horde&color=white

Is this closable?


what is parameters API required to enable eventhub connector

Please advise how can we build logic-app connector using REST API

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 6606f6c7-6243-13d6-9fde-15f387f0e331
Version Independent ID: 875d1e7a-abbc-6cee-e7af-0f9786769917
Content: Connect to Azure Event Hubs - Azure Logic Apps
Content Source: articles/connectors/connectors-create-api-azure-event-hubs.md
Service: logic-apps
GitHub Login: @ecfan
Microsoft Alias: estfan

Hi @ranokarno,
Thanks for your reaching out! Are you referring to the parameters that are described in the Event Hub connector reference topic?

hi @ecfan,
I am looking for parameter of API/ARM template to achieve above 'sent-event' action.
https://docs.microsoft.com/bs-cyrl-ba/azure/templates/microsoft.web/2016-06-01/connections?view=azurermps-4.4.1

I am looking into reference of supported parameter as listed in
parameterValues or customParameterValues in this link https://docs.microsoft.com/en-us/azure/templates/microsoft.web/2016-06-01/connections#apiconnectiondefinitionproperties-object

Hi @ranokarno,
Perhaps this reference doc is what you're seeking?
https://docs.microsoft.com/azure/templates/microsoft.eventhub/allversions
However, the easiest way to create an Azure Resource Manager template that's already parameterized for your logic app, trigger, actions, and connections is to use Visual Studio, create an Azure Resource Group project, and then use the Logic App Designer inside Visual Studio to build your logic app. The .json file for the logic app will already be a template that includes the parameters and definitions for the logic app workflow, connections, and resource definitions. Here's more information about how to create already parameterized templates:
Create Azure Resource Manager templates to automate deployment for Azure Logic Apps

Hi @ranokarno, is this issue still active for you?

Hi @ranokarno,
Since we haven't heard back from you, we'll close this thread for now. If you have more questions, please tag me in your reply. Thanks for reaching out!
@mike-urnun-msft: #please-close


Wrong loss shape when using keras generators

I am facing the following issue when trying to train a Squeezenet with no weights and two classes:
expected loss to have shape (None, 2) but got array with shape (64, 1)

the code has been deeply inspired by this tutorial (https://blog.keras.io/building-powerful-image-classification-models-using-very-little-data.html)
from keras.preprocessing.image import ImageDataGenerator
from keras import backend as K
from keras_squeezenet import SqueezeNet

img_width, img_height = 227, 227

train_data_dir = 'C:/IMAGES/KERAS/train'
validation_data_dir = 'C:/IMAGES/KERAS/validation'
nb_train_samples = 2000
nb_validation_samples = 800
epochs = 2
batch_size = 64

if K.image_data_format() == 'channels_first':
    input_shape = (3, img_width, img_height)
else:
    input_shape = (img_width, img_height, 3)

model = SqueezeNet(weights=None, classes=2)

model.compile(loss='binary_crossentropy',
              optimizer='rmsprop',
              metrics=['accuracy'])

train_datagen = ImageDataGenerator(
    rescale=1. / 255,
    shear_range=0,
    zoom_range=0,
    horizontal_flip=True)

test_datagen = ImageDataGenerator(rescale=1. / 255)

train_generator = train_datagen.flow_from_directory(
    train_data_dir,
    target_size=(img_width, img_height),
    batch_size=batch_size,
    class_mode='binary')

validation_generator = test_datagen.flow_from_directory(
    validation_data_dir,
    target_size=(img_width, img_height),
    batch_size=batch_size,
    class_mode='binary')

model.fit_generator(
    generator=train_generator,
    steps_per_epoch=nb_train_samples // batch_size,
    epochs=epochs,
    validation_data=validation_generator,
    validation_steps=nb_validation_samples // batch_size)

In the folders train and validation there are 2 subfolders (OK and NOK), and both classes are well read by the generators. This is the output from them:
Found 40294 images belonging to 2 classes.
Found 1273 images belonging to 2 classes.

Setting classes=1 when declaring the model solves the error of the expected vs real shape of the loss vector but makes the classifier pointless.
Any idea about how to have more than 1 class when using generators?

Issue here was the class_mode='binary' used on the data generators. Changing it into categorical made it work.


login with google

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

Hello mqurishi,
First of all, I would like to thank you for your interest in this project and for your input. Your valuable feedback will be very helpful in moving this project forward.
Regarding the Google login feature you mentioned, the login_google_account() function in autochatgpt/login.py used to support this. However, due to refactoring in commit 02fa7e5f67cabbf58d31b0ec8d2bb052d4e03981, it is no longer supported.
I am aware of this issue and have already begun work on a fix. We will post an update as soon as this issue is completed. In the meantime, we ask for your patience.
If you have any additional information or encounter any problems, please do not hesitate to contact us. Thank you in advance for your cooperation.

Sorry, we do not yet support 2-step verification.


Implement social media sharing

Implementing share for twitter, XMTP, lens.
#117
dividing into subtask is ok.

UI is like this.

We can integrate

XMTP

When offers are created

Lens

When orders are created

EPNS

When offers are created
NFT you want is listed
Receive Referral Fee
Your offer/order is matched

Twitter

When orders are created

@Aqrare
Hey, I think if you integrate all of them, the task is would be too big.
So, you can just implement Twitter first for this issue, then create each issue to XMPT, Lens, EPNS

Yes, I'm just dividing and making them!

I divided this issue
XMTP #130
Twitter #197
Lens #l199
EPNS #128

So I'll close this issue

ok!

I recommend doing https://github.com/kaguraswap/monorepo/issues/197 this first.

ok! I'll do that


fix problem with alias to datatree

address issue https://github.com/umr-lops/xsar/issues/165

commit https://github.com/umr-lops/xarray-safe-s1/pull/6/commits/37fbafd9fae71fa551a8a51a2189b70b0a86c548 allowed to get tide of the issue having reader.datatree equal to None.


"View comparison for these 2 commits"

Dashboard feed always says "2 commits" regardless of many actual commits there are when you push.
There might be 1 commit, there might be 6, it will still say "2 commits".

Thanks for the report!
Would change sentence to View comparison for commits be better? Because the actual link is comparing the last commit before push and the last commit after push.

Sure, if it's hard to count how many actual commits there are. And perhaps hide that link if there is only one commit?
GitHub does it like this:
1 commit: no link
2 commits: View comparison for these 2 commits »
3 or more comments: 1 more commit »

By merging https://github.com/gogits/gogs/pull/2125 , this should be fixed.


Add InputHint as an optional parameter to BotContext.Reply method

On the BotContext object there is an overload for the Reply method in order to allow the developer to supply SSML as well as text. i.e.
BotContext Reply(string text, string speak = null)
Can we also add an optional parameter to this method for InputHint, as if the developer is providing SSML then there is a good chance they might want to indicate if they are waiting for more input or wish to end the conversation when using channels like Cortana etc. i.e.
BotContext Reply(string text, string speak = null, InputHint inputHint = null)
This will help avoid having the create the activity explicitly just to provide an inputHint along with SSML.
Happy to implement this and submit a PR if this is something we think we should do.

@garypretty, it's likely that the BotContext.Reply() and other queue based methods will be going away in favor of a BotContext.SendActivities() that more accurately takes an array of activities as input which it delivers immediately. Higher level abstractions like queuing responses and a simpler Reply() methods would need to be layered on using middleware.
That layering opens up the possibility to create simpler methods targeted at building speech enabled bots. For instance I could see creating a piece of middleware targeted at Cortana skills that streamlines the management of inputHint and adds Speak() methods which optimizes formatting responses for Cortana.

To go along with this I do think it probably makes since to add inputHint as an optional argument to MessageStyler.text(). I just ran into a need for the same thing on the JavaScript side of things.

All sounds sensible. I'll raise A PR for the change to. MessageStyler instead then. Thanks for the follow up.

Thanks @garypretty I updated all of the methods on MessageStyler class to take an optional inputHint.

Closing as PR has now been merged.


Sample h5 and json files don't work

I believe the sample tiny_shakespeare.h5 and tiny_shakespeare.json files are from an earlier version of this repo and will break when training. I re-ran the processor.py script and it now works.

The repo only ships with a .txt version of the dataset; you must have created the .h5 and .json versions yourself.

Ah! Maybe when running the preprocess.py without any arguments? I thought it said somewhere it pulls from the tiny_shakespeare.txt file?


Figure out process for updating/uploading the sitemap.xml.gz

Prior art:

https://github.com/crimethinc/website/issues/123
https://github.com/crimethinc/website/issues/925
https://github.com/crimethinc/website/issues/502

https://crimethinc.com/sitemap.xml.gz 404s
I'm not sure if we ever actually had the sitemap up on the production site. We might've been waiting until we could figure out a way to not manually run a script and/or have to commit the .xml.gz to source control.
It would be amazing if someone could figure out how to do this at all and even better would be how to automate it with Heroku et al.

@veganstraightedge, I was about to close this issue since all the previous parts are done. I try to generate the sitemap.xml.gz locally, it works, and I can download the file when I hit localhost:3000/sitemap.xml.gz, but when I hit crimethinc.com/sitemap.xml.gz I get a 404. Can you validate that sitemap:refresh is correctly execute when we deploy the app?

@just1602 @ghost thank you both for your discussion on this issue!
Sorry that I was pretty absent from that discussion.
These two issues helped inform my work on this PR:

https://github.com/crimethinc/website/pull/4060

✅ https://crimethinc.com/sitemap.xml


Add ModuleName Parameter

Always assumed module would be named after the parent folder, but what if you don't want that?  Add ModuleName to allow choice.

Added


Data normalization

This PR added different data normalization options for pre-processing. It doesn't work for flat-field correction at the moment because flat-field correction is applied to each stack right before tiling and it changes z-score parameters. One solution would be creating a directory with flat-field corrected images upfront and run subsequent preprocessing and inference from there rather than from the original image directory. I think that would also simply the code as everything needs to be run on flat-field corrected images anyway.

@smguo I'll take a look but first you'll need to fix the failing tests: https://travis-ci.com/czbiohub/microDL/builds/115356900
If your addition breaks the preprocessing tests due to flatfield correction I suggest you make the original tests work, then add tests using normalization and not flatfield correction.

Thanks @jennyfolkesson. The tests are now fixed

Thank you for your patience @smguo, I took last week off so I didn't get to this until now.
I think it would make more sense to do the heavy lifting in generate_meta or a similar script, instead of in the tiling part of preprocessing.
There you could specify normalization type and load stacks, compute means and stds accordingly, and fill in which rows each mean + std should go in. E.g. if doing normalization on an entire z-stack, each row for that stack will have duplicate mean and std values. That way the tiling only needs the minimal change of passing mean and std for each row if they exist to mp_utils.
What are your thoughts @anithapk ?

I agree with Jenny's thoughts on this. For the dataset level normalization, add a script to generate mean and std per channel and append that info to frames_meta.csv or maintain a json with this info (prefer this, will reduce redundancy). Modify tiling so that it reads the json to get mean and std of the respective channels. Currently, it is a find/search in frames_meta, would prefer to reduce/avoid that if possible.

@jennyfolkesson @anithapk I agree with that the heavy lifting is better done in generate_meta script instead of in the tiling part of preprocessing as we discussed, and my understanding is my implementation of data normalization follows this idea... but let me know if it doesn't.
One minor difference is that I compute the mean and std for each image and store them in frame_metadata.csv, and I have the an auxiliary function to estimate the mean and std per stack, volume, or dataset from the table based on the preprocess config. The reason of doing this is that the user only have to generate frame_metadata.csv once for different normalization schemes.

To me it looks like for each t, p, z, c you call this get mean std function, which in turn loops through each z again to get indices that are collected and averaged. This is a lot of overhead (excess loops) on the tiling process, and this is what should be precomputed in generate_meta or similar. Does that make sense?

Sorry for the delay in getting back to this @jennyfolkesson! The mean and std for each image are calculated in generate_meta and stored in frame_metadata.csv. During tiling, get_zscore_params() only aggregates the mean and std from frame_metadata based on the normalization scheme without loading images, so there shouldn't be much overhead. get_zscore_params() loops through z only because I try to use get_meta_idx() that's already in aux_utils, but I could get rid of the loop by using pd.dataframe.isin() or modify get_meta_idx() so it can take lists of indices as input rather than single index. Let me know if you have a preference.


Data gets converted only when accessed

Overview
The DownloadHandler performs data conversion in the case of accessing its text property.
For requests not using it, that's unnecessary CPU and garbage.
The PR moves the access into the Response, where executed only when needed.
Changes

Fixes: #7526

/azp run

/azp run

/azp run


Remove manual configuration/intervention in release process

Our release process is currently structured around having a single CI build that builds a specific set of packages (defined at queue time) and then feeding that into a release pipeline. There is a trade off to be made between having lots of discrete build and release pipelines requiring zero configuration on each run, and requiring manual work to drive a release.
This is a much better conversation that we need to have around the unified pipelines model in Azure Pipelines and the granularity of our CI pipelines.

Pretty sure this issue sort of fades away with the transition do unified pipelines.

Yep - closing this since unified pipelines looks to be the right direction (sans a few teething issues around required checks etc).


Update sbt-scala-native-crossproject, ... to 1.2.0

Updates

org.portable-scala:sbt-scala-native-crossproject
org.portable-scala:sbt-scalajs-crossproject

from 1.0.0 to 1.2.0.
GitHub Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Files still referring to the old version number
The following files still refer to the old version number (1.0.0).
You might want to review and update them manually.
modules/auth/client/js/yarn.lock
modules/common/js/yarn.lock
modules/features/client/js/yarn.lock
project/Dependencies.scala

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.portable-scala" } ]

labels: sbt-plugin-update, early-semver-minor, semver-spec-minor, old-version-remains, commit-count:1

Superseded by #646.


Add machinethink.net blog

Machine learning on iOS

There was a bit of invalid JSON in this but I fixed it up and merged! Thanks

Nice, thanks!


Readiness status

Is there any way of detecting (from outside of the process) when the worker process is up and running and able to start processing jobs?
During deployment on Kubernetes a ReadinessProbe will not shut down the old worker until the new one is ready, but how can we determine that from outside?
Can we make it write to a file when it's up and ready to process jobs?

Hey @andyjeffries, sorry for the delay replying to this one! I wonder if you could use the pidfile that the supervisor sets as your readiness probe. See the supervisor_pidfile configuration option mentioned here. Initially, that was how we were going to run Solid Queue in k8s in the cloud but we never got to do that because we moved to on-premises using Kamal, so our setup is much simpler.  The pidfile is setup right before the workers are started by the supervisor, so strictly they aren't ready to process jobs yet, but there's also a shutdown timeout that the previous supervisor will wait until actually terminating all workers, so I think it should be ok.

Thanks @rosa , that should work OK for now. Would be great if there was a hook that could be executed for when it's up and running ready to process jobs...

@rosa How do you define healthcheck for Kamal? I'm wondering how to do it in most reliable way especially with the recent change https://github.com/basecamp/kamal/pull/740

@morgoth you could use Kamal's healthcheck option and the supervisor_pidfile option, and just check for the file's presence. This only works for deploys, though, the healthcheck will do nothing once the deploy has finished. If you meant a health check more in the sense of continuous monitoring, we don't have anything like that. So far we've been fine just monitoring other things like number of pending jobs in specific queues.
In any case, I'm planning to improve the existing supervisor_pidfile approach so that we can detect that all workers are ready to process jobs/all dispatchers ready to dispatch, for version 1.0.

Maybe provide hooks into the SolidQueue boot/shutdown callbacks? This would allow custom logic for readiness detection (vs using the supervisor pid). We used this exact approach with Sidekiq on k8s, and it worked well enough.

Hey everyone, thanks a lot for your patience here! I got a simple implementation for lifecycle hooks, just on start and stop over in #317. Do you think this could work for you? You'd need to register a block with SolidQueue.on_start that'd be called right before forking the other processes and use it like you use Sidekiq's on(:startup).
Let me know if I missed anything!

Absolutely perfect for me. We'd just create a file and remove the file in each hook, and we'd check for the presence of that file to determine readiness (it's simplistic, but enough to know if the process boots slowly when we can shut down the old ones). Many thanks @rosa !


Function Block [FB_14] Authorization and Authentication OAD001 Generates False Negatives

The OAD001 [NEG] Malformed Authorization Code Requests generates FALSE NEG results.  The current logic utilizes a Selenium browser session to enable a user to login before performing the negative OAuth 2.0 Authorization Endpoint testing.  Currently the target Data Custodian treats the negative OAuth 2.0 Authorization Endpoint test as a new browser session and requires the CMD Test Harness to perform a login function.
Section 4.1.1 Authorization Request of the OAuth 2.0 Authorization Framework [RFC 6749] states:
The authorization server validates the request to ensure that all required parameters are present and valid.  If the request is valid, the authorization server authenticates the resource owner and obtains an authorization decision (by asking the resource owner or by establishing approval via other means.
Therefore, requiring the CMD Test Harness to process a login when the malformed Authorization Endpoint request is process, is a valid NEG condition.  However, most Data Custodian implementations incorrectly implement this portion of the OAuth 2.0 standard.

Refactored [FB_14] Authorization and Authentication -- OAD001 [NEG] Malformed Authorization Code Request test step to eliminate authentication steps and added additional scripting text to indicate Data Custodian has not properly implemented Section 4.1.1 Authorization Request of the OAuth 2.0 Authorization Framework [RFC6749] standard


Changes for EPEL 8

Related to issue #278.

Make packit work with pyyaml < 5.1
Use contextlib.suppress instead of contextlib.nullcontext

/packit build


Change isMultiPart() implementation

the current implementation of isMultipart() is as follows
fun isMultipart(): Boolean = (header(Header.CONTENT_TYPE) ?: "").toLowerCase().contains("multipart/form-data")
but there are more then just form-data multiparts.
my suggestion would be just remove the form-data part. i.e.
fun isMultipart(): Boolean = (header(Header.CONTENT_TYPE) ?: "").toLowerCase().contains("multipart/")
One such scenario would be mutipart/related where different content is divided by boundaries in the body.
 Content-Type: multipart/related; boundary="--MIME-Boundary"; charset="UTF-8"; type="text/xml"; start="<0D520A13-CA4A-4308-96BE-28DFF2FEE9E3>"
----MIME-Boundary
Content-Id: <0D520A13-CA4A-4308-96BE-28DFF2FEE9E3>
Content-Type: application/xml
Content-Transfer-Encoding: 8bit

<?xml version='1.0' encoding='UTF-8'?>
... content here

----MIME-Boundary
Content-Id: <... some other id>
Content-Type: text/html
Content-Transfer-Encoding: 8bit

... some data here

----MIME-Boundary--

Sounds reasonable. Would you like to make a PR?

Sure thing: https://github.com/tipsy/javalin/pull/97


Upgrade to support Swift 5.0 with Xcode 10.2.1

Hi!
Awesome project!
However the moment I found it, it was available in older swift version.
So here is the updated version of the project for who uses (the current) swift 5.0 and Xcode 10.2.1.
Thanks!

Hi @fitsyu
Many thanks for your PR. I was going to update this library next month, so your work will be helpful!.
I will keep this ticket open till then.
Regards,

Hi @fitsyu
Many thanks for your PR. I was going to update this library next month, so your work will be helpful!.
I will keep this ticket open till then.
Regards,

Glad if it can be of help for this project.
I found a strange issue and monkey-patch it in the last commit.
So the last commit probably better just to drop it


Rewrite build-script to dockerfile

see #44 for more information

More layers means slower cold build and slower download.
Lots of && \ lines are ugly compared to shell script where this is not needed

These are two main reasons why things are the way they are. Sorry, I'll have to decline this PR.


[Closed]  CheckEvenOrOddNumber.ts with checkEvenOrOdd complete

Why:

Closes #1396
What's being changed:
Made CheckEvenOrOddNumber.ts file and put checkEvenOrOdd function within it. Put file in the check-even-or-odd-number folder as directed.

@kevinsfernandes
Sorry, the issue was closed by another PR. Please look for other issues to contributing.
Thank you!

This was assigned to me and not to the person who had their pull request accepted.
Get Outlook for Androidhttps://aka.ms/AAb9ysg

From: Victoria Cheng @.>
Sent: Wednesday, October 5, 2022 11:49:13 AM
To: codinasion/program @.>
Cc: kevinsfernandes @.>; Mention @.>
Subject: Re: [codinasion/program] CheckEvenOrOddNumber.ts with checkEvenOrOdd complete (PR #1486)
@kevinsfernandeshttps://github.com/kevinsfernandes
Sorry, the issue was closed by another PR. Please look for other issues to contributing.
Thank you!
—
Reply to this email directly, view it on GitHubhttps://github.com/codinasion/program/pull/1486#issuecomment-1268616017, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ATKYF6IH4VYV54L462N35ULWBWPPTANCNFSM6AAAAAAQ4IJ4G4.
You are receiving this because you were mentioned.Message ID: @.***>


Bowtie2 error

Hi,
I got some errors when proceed to the mapping step. then I just use the bowtie2 command manually, It seems to have something to do with the --mm setting of bowtie2.
In the pipeline, the parameters of bowtie2 is set as: bowtie2 -k $multimapping -X2000 --local --mm --threads...
Running this command line, I got some errors:
mmap: Invalid argument
Error: Could not memory-map the index file mypath/mm10/bowtie2_index/mm10_no_alt_analysis_set_ENCODE.fasta.rev.2.bt2
But if I remove --mm, it will work.
Any idea why is it? Can we change the bowtie parameter settings. I am using the Slurm clusters
Many thanks in advance!
Best,
Mengjun

Please update your pipeline code and use -no_idx_on_mem_bwt2. This removes --mm flag in the bowtie2 mapping command line.

Many thanks, it works.
But I have the problem that when I run BDS command directly on an interactive node, every time I close or log out of the interactive node,  the pipeline stops running  and the screen of the pipeline becomes dead. Do you know why this happening?  Thank you!


Help needed: GCN asm question

Hi, I see a strange situation where this bit of code works correctly
	#SUB
	v_sub_co_u32_e32  v6, vcc, v0, v2
	v_subb_co_u32_e32 v7, vcc, v1, v3, vcc
	s_mov_b64_e32 s[0:1], vcc
	v_addc_co_u32 v6, vcc, 0, v6, vcc
	s_orn2_b64_e32 vcc, vcc, s[0:1]
	v_addc_co_u32_e32 v7, vcc, -1, v7, vcc

But the below fails non-deterministically (i.e. after a while, and not always at the same spot)
	#SUB BAD
	v_sub_co_u32_e32  v6, vcc, v0, v2
	v_subb_co_u32_e32 v7, vcc, v1, v3, vcc
	v_addc_co_u32 v6, s[0:1], 0, v6, vcc
	s_orn2_b64_e32 vcc, s[0:1], vcc
	v_addc_co_u32_e32 v7, vcc, -1, v7, vcc

In my oppinion the two pieces should be equivalent. I'm running this on RadeonVII. I checked multiple times the ISA docs about "manually inserted wait states", and it does not appear I have any missing wait-states.
These were both generated using this function:
typedef uint u32;
typedef ulong u64;
u32  U32(u32 x)   { return x; }
#define OVL __attribute__((overloadable))
u64 OVL U64(u64 x)   { return x; }
u64 OVL U64(u32 a, u32 b) { return as_ulong((uint2)(a, b)); }

u64 sub(u64 a, u64 b) {
  u32 c, d;
  u64 stmp;
#if USE_BAD
  __asm("#SUB BAD\n\t"
        "v_sub_co_u32_e32  %[c], vcc, %[aLo], %[bLo]\n\t"
	"v_subb_co_u32_e32 %[d], vcc, %[aHi], %[bHi], vcc\n\t"
        "v_addc_co_u32 %[c], %[stmp], 0, %[c], vcc\n\t"
        "s_orn2_b64_e32 vcc, %[stmp], vcc\n\t"
        "v_addc_co_u32_e32 %[d], vcc, -1, %[d], vcc"
        : [c] "=&v"(c), [d] "=v"(d), [stmp] "=&s"(stmp)
        : [aLo] "v"(U32(a)), [aHi] "v"(U32(a>>32)), [bLo] "v"(U32(b)), [bHi] "v"(U32(b>>32))
        : "vcc");
#else
  __asm("#SUB\n\t"
        "v_sub_co_u32_e32  %[c], vcc, %[aLo], %[bLo]\n\t"
	"v_subb_co_u32_e32 %[d], vcc, %[aHi], %[bHi], vcc\n\t"
        "s_mov_b64_e32 %[stmp], vcc\n\t"
        "v_addc_co_u32 %[c], vcc, 0, %[c], vcc\n\t"
        "s_orn2_b64_e32 vcc, vcc, %[stmp]\n\t"
        "v_addc_co_u32_e32 %[d], vcc, -1, %[d], vcc"
        : [c] "=&v"(c), [d] "=v"(d), [stmp] "=&s"(stmp)
        : [aLo] "v"(U32(a)), [aHi] "v"(U32(a>>32)), [bLo] "v"(U32(b)), [bHi] "v"(U32(b>>32))
        : "vcc");
#endif

  return U64(c, d);
}

I'm using ROCm 3.3.0, targeting Radeon VII. Should I suspect a bug in the compiler? A bug in the HW (such as a needed wait-state that's not in the docs)? or am I doing something wrong? thanks!

(the source in its entirety is here:
https://github.com/preda/gpuowl/blob/d8c6b122122dbab7527d6a23f7ef915642519fd2/gpuowl.cl#L146
)

Would you describe what "fails" means?  The while application, or are you testing just that function and getting incorrect results?

I guess the problem is with
v_addc_co_u32 v6, s[0:1], 0, v6, vcc
which accesses two scalar operands (s[0:1] and VCC) with a vector instruction. According to "6.2.1. Instruction Inputs"

At most one SGPR can be read per instruction, ...

"3.9. Vector Compares: VCC and VCCZ" states

VCC physically resides in the SGPR register file, so when an instruction
sources VCC, that counts against the limit on the total number of SGPRs that
can be sourced for a given instruction. VCC physically resides in the highest
two user SGPRs.

Would you describe what "fails" means? The while application, or are you testing just that function and getting incorrect results?

@b-sumner I am testing the whole application that uses this function. The function does not fail every time, but only from time to time. When using the "good" version everything works reliably correctly, when swapping with the "bad" version it fails after a [long] while.

I was wrong. s[0:1] is a destination so it should not count as "read register".

I was wrong. s[0:1] is a destination so it should not count as "read register".

Yes. Also, I'd expect the assembler to detect the not-allowed situations (like reading too many SGPRs) and report an error instead of accepting it and fail at runtime.

The best advice for inline asm I can give is to never use it. It really does more harm than good and I 1000% advise against ever using it. It's only for the most desperate situations. Why are you trying to use it for this? This looks like a basic sub with overflow.
I do see you are missing an implicit exec read on your constraints which may or may not be relevant

The best advice for inline asm I can give is to never use it. It really does more harm than good and I 1000% advise against ever using it. It's only for the most desperate situations. Why are you trying to use it for this? This looks like a basic sub with overflow.
I do see you are missing an implicit exec read on your constraints which may or may not be relevant

@arsenm could you please explain me a bit more about the missing exec read constrain? (why do I need it?)
That code is not a "basic sub with overflow". Instead, it implements this C function:
u64 sub(u64 a, u64 b) {
  return (a >= b) ? a - b : (a - b - 0xffffffff);
}

which LLVM compiles to:
	v_sub_co_u32_e32 v6, vcc, v0, v2
	v_subb_co_u32_e32 v7, vcc, v1, v3, vcc
	v_add_co_u32_e32 v8, vcc, 1, v6
	v_addc_co_u32_e32 v9, vcc, -1, v7, vcc
	v_cmp_lt_u64_e32 vcc, v[0:1], v[2:3]
	v_cndmask_b32_e32 v1, v7, v9, vcc
	v_cndmask_b32_e32 v0, v6, v8, vcc

and at this it becomes visible how this is a sub-optimal ("wasteful") compilation: not only in the number of vectorial instructions (7 vs. 4), but also most importantly in the VGPR allocation -- the compiler unfortunately does a terrible job.
See also #1002 , #989 , #967 , #488 , #477 for other examples of missed optimizations that require asm() to work-around. Some of these are extremely basic (such as recognizing the carry-out idiom for 64-bit operations), have been reported 3 years ago, and are still not fixed in LLVM.

Nearly all VALU instructions have an implicit exec register read. It's a special register, but still a register that needs a read constraint (e.g. after the second : you need "exec"). If you only had SALU instructions in your asm, it wouldn't be necessary.
I suspect you could also work around the optimizer by using the add/sub with overflow builtins which would be preferable to the asm

I would very much prefer to not have to use inline assembly, ever. Simply enjoy the compiler instead of suspecting it, fighting it, coercing it in order to get not-terrible code. But optimizing GCN is not an easy task, and the compiler is not there yet.

Nearly all VALU instructions have an implicit exec register read. It's a special register, but still a register that needs a read constraint (e.g. after the second : you need "exec"). If you only had SALU instructions in your asm, it wouldn't be necessary.

Ok, thanks, I'll try that.

I suspect you could also work around the optimizer by using the add/sub with overflow builtins which would be preferable to the asm

Thanks I was not aware of those builtins. Found them here https://clang.llvm.org/docs/LanguageExtensions.html#checked-arithmetic-builtins and I'll look into using them.

@preda you have probably seen that there is a hazard when VALU writes SGPR and VMEM reads that SGPR.  That hazard is hanging off the end of the inline asm and compiler doesn't know about it and may be scheduling a VMEM too early.

@preda you have probably seen that there is a hazard when VALU writes SGPR and VMEM reads that SGPR. That hazard is hanging off the end of the inline asm and compiler doesn't know about it and may be scheduling a VMEM too early.

@b-sumner but there's no SGPR output from that assembly block. "stmp" is named in the output list only to be used as a temporary SGPR, it's value is not used after the block (you see, it's not used in the return value of the sum() function). Do you think the hazard you mention still applies?

@preda, yes sorry I'm trying to do too many things at once.

Nearly all VALU instructions have an implicit exec register read. It's a special register, but still a register that needs a read constraint (e.g. after the second : you need "exec"). If you only had SALU instructions in your asm, it wouldn't be necessary.

@arsenm thanks for pointing out the read-exec dependency!
so is this the correct way to write it:
int dummy;
int x = 1;
int y;
__asm("v_add_u32 %0, %1, %1" : "=v"(y) : "v"(x), "{exec}"(dummy));

i.e. I have to use a dummy variable explicitly mapped to the exec register (the compiler won't accept just "exec" or "{exec}"). It seems the size mismatch (exec being 64-bit, dummy in the example 32-bit) doesn't matter either.

@preda, a unhandled hazard still seems like a possibility.  Can you test that bad sub function by itself and see if it ever produces an incorrect result, randomly or not?

I found a bug in my code: s_orn2_b64 sets SCC, so I need to add "scc" to clobbered list. I'm validating now.

I suspect you could also work around the optimizer by using the add/sub with overflow builtins which would be preferable to the asm

@arsenm looking at the LLVM carry builtins, I don't see any good match to represent the GCN v_mad_u64_u32, i.e. a multiplication with 32-bit multiplicands but a 64-bit carry-in. (plus a 1-bit carry-out).


Model TODO list:

[x] Create Model class
[x] Interface with RVO library
[ ] Test multi-simulation RVO Wrapper methods.
[ ] Test virtual environment setup.
[x] Setup parallelization: parfor simulation loops (Rather than agent parfors).
[x] Implement inference algorithm (InferGoals)
[x] Produce Simulation Velocities (RunSims)
[ ] Goal Sampling
[x] Goal Sequence
[ ] Awareness
[ ] Test goal prediction results.
[ ] Test simultaneous multiple agents.
[ ] Create dummy publisher so we may track how often Model produces/receives information
[ ] Consider tracker ids for better intention inference
[ ] When calc_pref_velocities for unmodelled agents inside simulation, allow to either set curr_velocity or use most likely goal for such agent (Optional: unknown side-effects of latter)

Simulation paralellization is setup, but did not significantly reduce processing time. It is believed this difference was not more significant due to the small number of parallel simulations executed (4 agents, 3 goals). Will check again with goal sampling.


Improve focus indication (for the demo and or part of core styles)

Just based on the codepen, I'd suggest improving (explicitly setting) :focus styles.
In Firefox, the focus around the demo page's images is quite faint (the default dotted outline)

This may just be something to add/suggest in the demo itself.  However, the close button may benefit from a defined style in parvus' own stylesheet.
Focus indication on the close button in Firefox is a very faint gray

In Chrome, the default for the images is fine, but the close button's style is again almost imperceptible
non-focused vs. focused

maybe something simple/consistent like swapping foreground/background?
.parvus__btn--close:focus {
    background-color: var(--button-color);
    color: var(--button-background-color);
    border-color: var(--button-background-color);
}

Hi @patrickhlauke,
I had the same thoughts the last few days. I'll implement a reasonable focus style and not hope for a good one from the website (after all, Parvus, an image lightbox, is also used).


Print better error message if Python not found at sourcing time

Since https://github.com/colcon/colcon-core/pull/70 we use Python to source packages in topological order.
If the python executable is not found it crashes with The system cannot find the path specified.
We should provide a better error message so that users know what fails.
One way to do it might be to check that the file exist before calling it. But it may be to expensive...

One way to do it might be to check that the file exist before calling it. But it may be to expensive...

That sounds good and is certainly not too expensive. Each recusrively sourced script is checked for existence before so one extra check won't be significant. Please consider to create a pull request for the additional check.


Change the docker image for Installation Guide Test - needs sudo

Description
The installation guide test used to pull a Cuda docker image from dockerhub and run tests inside this container. Earlier this test was running in cuda7.5 containers which had 'sudo' installed inside it. I changed this to cuda9 a couple of days back.
However, the latest cuda docker images - nvidia/cuda:9.0-cudnn7-devel and nvidia/cuda:8.0-cudnn5-devel do not have sudo installed which is needed by the scripts in the mxnet installation page.
Hence I have created a simple docker image on the host called mxnet/base-cuda9 which only has the following -

nvidia/cuda:9.0-cudnn7-devel
sudo

Please Note:

These tests are going to run on the official MXNet CI soon and these docker images will not be needed at that point since I plan to fix the script itself.
The dockerfile and docker Image are only present on the Jenkins setup where this nightly test is running. Please add a comment below if you would like me to add this image to the MXNet dockerhub repo.

@anirudh2290 This needs to go into 1.2 to make a nightly test pass.
@gautamkmr @b0noI Can you please review!
Checklist
Essentials

[x] Changes are complete (i.e. I finished coding on this PR)
[x] All changes have test coverage:
Unit tests are added for small changes to verify correctness (e.g. adding a new operator)
Nightly tests are added for complicated/long-running ones (e.g. changing distributed kvstore)
Build tests will be added for build configuration changes (e.g. adding a new build option with NCCL)
[x] Code is well-documented:
For user-facing API changes, API doc string has been updated.
For new C++ functions in header files, their functionalities and arguments are documented.
For new examples, README.md is added to explain the what the example does, the source of the dataset, expected performance on test set and reference to the original paper if applicable
Check the API doc at http://mxnet-ci-doc.s3-accelerate.dualstack.amazonaws.com/PR-$PR_ID/$BUILD_ID/index.html
[x] To the my best knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change

Changes

[x] Created a new docker image on the slave where these nightly tests run, I can publish this image to dockerhub if needed.
[x] Changed the installation guide GPU tests to run in this new docker container

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

I don't think pushing to dockerhub is needed but if there is a request, I will change the name and create a new PR.

Ah, is it because you're trying to replicate what we're basically doing in our containers, just from a users point of view and that's why a pretty much empty docker container is required?

I think pushing to dockerhub could cause confusion since this is basically an empty cuda9 container and is not really related to mxnet itself.

Currently, this change is to run the installation guide test locally for the 1.2 release.
Yes as you pointed out, it should be an (almosyt) empty container for this test similar to the user and hence I do not want to test it on the existing containers.
As a part of migration to new CI, all of these tests will use the docker images available in this repo and I will add a new one to the ci folder if needed.

I will add a dockerfile to the repo for this test but only during migration. Doing so now would require temporary changes to the test script to build the docker image. There is no point of doing that when we move to using the pipeline soon.

I see, thanks for elaborating. So just to clarify: This means if a new slave for the internal CI gets deployed or if the docker cache gets cleaned, this task is going to fail, right?
Fine with me as a temporary solution, we just have to be aware of that risk.

Alrighty, fine with me :)
Could you please add a jira ticket before we merge?

@marcoabreu jira is added. Can we merge this ?