ASAN Fixes

Depends on #45 , #44 . I goofed on opening the PRs in the right order, merge this before #46
Apply fixes reported by ASAN/UBSAN.
There are two major reworks included in this, a few smaller ones:

replace use of signature type strings with an enum to remove a ton of unnecessary memcmp/strcmp
change use of uint8_t* as a string type to char*
fixed a few memory leaks
fixed memcpy from NULL UB

Posted this comment on another PR but meant it for here:
build fails due to defined_sb_variables being uint8_t and passed into strcmp:
backends/guest/common/util.c: In function ‘is_secure_boot_variable’:
backends/guest/common/util.c:180:34: error: pointer targets in passing argument 1 of ‘strcmp’ differ in signedness [-Werror=pointer-sign]
   if (strcmp(defined_sb_variables[i], var) == 0)
              ~~~~~~~~~~~~~~~~~~~~^~~
In file included from backends/guest/common/util.c:6:
/usr/include/string.h:137:12: note: expected ‘const char *’ but argument is of type ‘const uint8_t *’ {aka ‘const unsigned char *’}
 extern int strcmp (const char *__s1, const char *__s2)
            ^~~~~~

backends/guest/guest_svc_read.c: In function ‘read_path’:
backends/guest/guest_svc_read.c:284:37: error: pointer targets in passing argument 1 of ‘strcmp’ differ in signedness [-Werror=pointer-sign]
          strcmp(defined_sb_variables[i], PK_VARIABLE) == 0))
                 ~~~~~~~~~~~~~~~~~~~~^~~
In file included from backends/guest/guest_svc_read.c:11:
/usr/include/string.h:137:12: note: expected ‘const char *’ but argument is of type ‘const uint8_t *’ {aka ‘const unsigned char *’}
 extern int strcmp (const char *__s1, const char *__s2)
            ^~~~~~
backends/guest/guest_svc_read.c:289:33: error: pointer targets in passing argument 3 of ‘print_variables’ differ in signedness [-Werror=pointer-sign]
             defined_sb_variables[i]);
             ~~~~~~~~~~~~~~~~~~~~^~~
In file included from backends/guest/guest_svc_read.c:17:
./backends/guest/include/common/read.h:64:5: note: expected ‘const char *’ but argument is of type ‘const uint8_t *’ {aka ‘const unsigned char *’}
 int print_variables(const uint8_t *buffer, size_t buffer_size, const char *var_name);
     ^~~~~~~~~~~~~~~

With the following, build finishes and all tests are passing:
diff --git a/backends/guest/common/util.c b/backends/guest/common/util.c
index 9a25198..faef127 100644
--- a/backends/guest/common/util.c
+++ b/backends/guest/common/util.c
@@ -177,7 +177,7 @@ bool is_secure_boot_variable(const char *var)
        int i = 0;

        for (i = 0; i < defined_sb_variable_len; i++) {
-               if (strcmp(defined_sb_variables[i], var) == 0)
+               if (strcmp( (const char *) defined_sb_variables[i], var) == 0)
                        return true;
        }

I have libc version 2.28 btw.

Posted this reply on the other PR, but including it here:

build fails due to defined_sb_variables being uint8_t and passed into strcmp

Fixed in a later PR, specifically commit https://github.com/open-power/secvarctl/commit/6814e0b217ce58d6b61fc5e8a675cacb51e63049 points libstb-secvar to a new commit level with all the secvarctl-related fixes thus far.

I can move that commit to this branch when I do the now mandatory fun rebase on Monday if you want, otherwise the next PR takes care of it


feat(bot-discord): Adds extinguish slash command

This PR adds the following slash command:

/admin extinguish

:shipit:


fix: additional styling to match Umbraco.BlockGrid.ExampleWebsite

Description
BlockPreview output should be as close as possible to the Angular/WebComponent equivalent.
Issue
Based off of the source repo, BlockPreview should ideally provide a 1:1 replication.
Umbraco 13 Angular View:

Umbraco 13 BlockPreview View:

Umbraco 13 BlockPreview View with Fix:

Note
I have also added position:relative to the .card class as this was missing from the original styling. In Umbraco.BlockGrid.Example.Website project, the card is a button element rather than a div which contains position: relative.
Fix
Applied styling to the container element .blockelement__draggable-element produced by BlockPreview to grow to the full height of the area.
.blockelement__draggable-element {
    height: 100%;
}

.blockelement__draggable-element > div {
    height: 100%;
}

This fix could potentially sit in /wwwroot/App_Plugins/Umbraco.Community.BlockPreview/views/block-preview.html, however I decided against an inline style fix as I avoid using them when possible and in the event people have worked around this in their own styling I did not want to force a change on their website styling.

Thank you once again @kevin9092! Appreciate the depth of your notes as well, really helpful #h5yr


Handling of "Weird" MC answers doesn't look right

https://github.com/HotDocsCorp/hotdocs-open-sdk/commit/384f9eeb52f403bcb86feb133a06fc40dfc58eff doesn't look quite right to me
Shouldn't selValueUnans be set to false within the while loop? Otherwise if we have this
<Answer name=""Some MC Value"">
  <MCValue>
    <SelValue unans=""true""></SelValue>
    <SelValue>Test</SelValue>
  </MCValue>
</Answer>

Then when it gets to the second SelValue it will still have selValueUnans as true and will skip over it.

I've checked in a significant improvement to the way we read Answer XML. This (and many issues like it) should be addressed now.  In this case, I changed the answer reading so it ignores any SelValues that are set to unanswered, but pays attention to those that are not.  Also greatly improved our support for empty XML elements like .


[BUG] longhorn fails to attach volume on minikube

Describe the bug
When running longhorn in minikube, it fails to attach a PVC to a pod.
To Reproduce
minikube config set driver docker
minikube start
minikube ssh "sudo apt update && sudo apt install -y open-iscsi"
git clone https://github.com/longhorn/longhorn.git
kubectl create namespace longhorn-system || true
helm upgrade --install --namespace longhorn-system longhorn ./longhorn/chart/ --set persistence.defaultClassReplicaCount=1 --set defaultSettings.defaultReplicaCount=1

# Wait for all pods to go up

cat << EOF | kubectl apply -f -
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: test-claim
spec:
  storageClassName: longhorn
  accessModes:
    - ReadWriteOnce
  resources:
    requests:
      storage: 1Gi
EOF

cat << EOF | kubectl apply -f -
apiVersion: v1
kind: Pod
metadata:
  name: test-pod
spec:
  containers:
    - name: test
      image: nginx
      volumeMounts:
      - mountPath: "/var/www/html"
        name: test-volume
  volumes:
    - name: test-volume
      persistentVolumeClaim:
        claimName: test-claim
EOF

Expected behavior
PVC to be attached to the pod
Log
time="2020-08-18T12:06:44Z" level=info msg="Start overwriting built-in settings with customized values"
time="2020-08-18T12:06:44Z" level=info msg="cannot list the content of the src directory /var/lib/rancher/longhorn/engine-binaries for the copy, will do nothing: Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net bash -c ls /var/lib/rancher/longhorn/engine-binaries/*], output , stderr, ls: cannot access '/var/lib/rancher/longhorn/engine-binaries/*': No such file or directory\n, error exit status 2"
time="2020-08-18T12:06:44Z" level=info msg="Start upgrading"
time="2020-08-18T12:06:44Z" level=warning msg="Cannot verify current CRD version, assume it's not v1alpha1: unable to verify if version matches v1alpha1: settings.longhorn.rancher.io \"default-engine-image\" is forbidden: User \"system:serviceaccount:longhorn-system:longhorn-service-account\" cannot get resource \"settings\" in API group \"longhorn.rancher.io\" in the namespace \"longhorn-system\""
time="2020-08-18T12:06:44Z" level=info msg="Initialized CRD API Version to longhorn.io/v1beta1"
time="2020-08-18T12:06:44Z" level=info msg="Finish upgrading"
time="2020-08-18T12:06:44Z" level=info msg="Upgrade leader lost: minikube"
time="2020-08-18T12:06:44Z" level=info msg="Start Longhorn replica controller"
time="2020-08-18T12:06:44Z" level=info msg="Start Longhorn engine controller"
time="2020-08-18T12:06:44Z" level=info msg="Start Longhorn websocket controller"
time="2020-08-18T12:06:44Z" level=info msg="Starting Longhorn instance manager controller"
time="2020-08-18T12:06:44Z" level=info msg="Start Longhorn Setting controller"
time="2020-08-18T12:06:44Z" level=info msg="Start kubernetes controller"
time="2020-08-18T12:06:44Z" level=info msg="Start Longhorn node controller"
time="2020-08-18T12:06:44Z" level=info msg="Start Longhorn Kubernetes node controller"
time="2020-08-18T12:06:44Z" level=info msg="Start Longhorn Engine Image controller"
time="2020-08-18T12:06:44Z" level=info msg="Start Longhorn volume controller"
time="2020-08-18T12:06:47Z" level=info msg="Latest Longhorn version is v1.0.2"
time="2020-08-18T12:06:47Z" level=debug msg="Cannot update latest Longhorn version: settings.longhorn.io \"latest-longhorn-version\" is invalid: metadata.resourceVersion: Invalid value: 0x0: must be specified for an update"
time="2020-08-18T12:06:48Z" level=debug msg="Updated setting default-engine-image to longhornio/longhorn-engine:v1.0.2"
time="2020-08-18T12:06:48Z" level=debug msg="Updated setting default-instance-manager-image to longhornio/longhorn-instance-manager:v1_20200514"
time="2020-08-18T12:06:49Z" level=info msg="Event(v1.ObjectReference{Kind:\"Node\", Namespace:\"longhorn-system\", Name:\"minikube\", UID:\"77dd064e-baa2-4f34-a754-b1cfa8dba633\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"511\", FieldPath:\"\"}): type: 'Warning' reason: 'Ready' Node minikube is down: the manager pod longhorn-manager-xbs4p is not running"
time="2020-08-18T12:06:49Z" level=info msg="Event(v1.ObjectReference{Kind:\"Node\", Namespace:\"longhorn-system\", Name:\"minikube\", UID:\"77dd064e-baa2-4f34-a754-b1cfa8dba633\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"511\", FieldPath:\"\"}): type: 'Normal' reason: 'Schedulable' "
time="2020-08-18T12:06:49Z" level=info msg="Event(v1.ObjectReference{Kind:\"Node\", Namespace:\"longhorn-system\", Name:\"minikube\", UID:\"77dd064e-baa2-4f34-a754-b1cfa8dba633\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"511\", FieldPath:\"\"}): type: 'Normal' reason: 'Ready' Disk default-disk-23105261ac064cfd(/var/lib/longhorn/) on node minikube is ready"
time="2020-08-18T12:06:49Z" level=debug msg="Prepare to create default instance manager instance-manager-e-55361ddd, node: minikube, default instance manager image: longhornio/longhorn-instance-manager:v1_20200514, type: engine"
time="2020-08-18T12:06:49Z" level=info msg="Event(v1.ObjectReference{Kind:\"Node\", Namespace:\"longhorn-system\", Name:\"minikube\", UID:\"77dd064e-baa2-4f34-a754-b1cfa8dba633\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"511\", FieldPath:\"\"}): type: 'Normal' reason: 'Schedulable' Disk default-disk-23105261ac064cfd(/var/lib/longhorn/) on node minikube is schedulable"
time="2020-08-18T12:06:49Z" level=debug msg="Prepare to create default instance manager instance-manager-r-f891ce56, node: minikube, default instance manager image: longhornio/longhorn-instance-manager:v1_20200514, type: replica"
time="2020-08-18T12:06:49Z" level=debug msg="Created engine image ei-ee18f965 (longhornio/longhorn-engine:v1.0.2)"
time="2020-08-18T12:06:49Z" level=debug msg="Waiting for engine image longhornio/longhorn-engine:v1.0.2 to be ready"
time="2020-08-18T12:06:49Z" level=debug msg="Instance Manager Controller minikube picked up instance-manager-e-55361ddd"
time="2020-08-18T12:06:49Z" level=warning msg="Starts to clean up then recreates pod for instance manager instance-manager-e-55361ddd with state stopped"
time="2020-08-18T12:06:50Z" level=debug msg="Engine Image Controller minikube picked up ei-ee18f965 (longhornio/longhorn-engine:v1.0.2)"
time="2020-08-18T12:06:50Z" level=info msg="Created daemon set engine-image-ei-ee18f965 for engine image ei-ee18f965 (longhornio/longhorn-engine:v1.0.2)"
time="2020-08-18T12:06:50Z" level=info msg="Created instance manager pod instance-manager-e-55361ddd for instance manager instance-manager-e-55361ddd"
time="2020-08-18T12:06:50Z" level=debug msg="Instance Manager Controller minikube picked up instance-manager-r-f891ce56"
time="2020-08-18T12:06:50Z" level=warning msg="Starts to clean up then recreates pod for instance manager instance-manager-r-f891ce56 with state stopped"
time="2020-08-18T12:06:51Z" level=debug msg="Requeue longhorn-system/instance-manager-e-55361ddd due to conflict: Operation cannot be fulfilled on instancemanagers.longhorn.io \"instance-manager-e-55361ddd\": the object has been modified; please apply your changes to the latest version and try again"
time="2020-08-18T12:06:51Z" level=error msg="Instance Manager instance-manager-e-55361ddd is state error but the related pod is pending."
time="2020-08-18T12:06:51Z" level=warning msg="Starts to clean up then recreates pod for instance manager instance-manager-e-55361ddd with state error"
time="2020-08-18T12:06:51Z" level=info msg="Created instance manager pod instance-manager-r-f891ce56 for instance manager instance-manager-r-f891ce56"
time="2020-08-18T12:06:52Z" level=debug msg="Requeue longhorn-system/instance-manager-r-f891ce56 due to conflict: Operation cannot be fulfilled on instancemanagers.longhorn.io \"instance-manager-r-f891ce56\": the object has been modified; please apply your changes to the latest version and try again"
time="2020-08-18T12:06:52Z" level=error msg="Instance Manager instance-manager-r-f891ce56 is state error but the related pod is pending."
 Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:06Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:11Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:11Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:16Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:16Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:21Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:21Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:26Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:26Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:29Z\" level=error msg=\"Failed to startup frontend: Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m node -T iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27 -p <IP_ADDRESS> --login], output , stderr, iscsiadm: No records found\\n, error exit status 21\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: 2020/08/18 12:09:29 failed to start up frontend: Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m node -T iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27 -p <IP_ADDRESS> --login], output , stderr, iscsiadm: No records found"
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: , error exit status 21"
time="2020-08-18T12:09:30Z" level=warning msg="Engine of volume pvc-5566bdfe-8158-422b-baaf-0c453c368a27 dead unexpectedly, reattach the volume"
time="2020-08-18T12:09:30Z" level=info msg="Event(v1.ObjectReference{Kind:\"Volume\", Namespace:\"longhorn-system\", Name:\"pvc-5566bdfe-8158-422b-baaf-0c453c368a27\", UID:\"363a234c-8510-4976-ab21-c39d72026a26\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"1061\", FieldPath:\"\"}): type: 'Warning' reason: 'DetachedUnexpectly' Engine of volume pvc-5566bdfe-8158-422b-baaf-0c453c368a27 dead unexpectedly, reattach the volume"
time="2020-08-18T12:09:30Z" level=warning msg="Try to get requested log for pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d on node minikube"
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:02Z\" level=info msg=\"Creating volume /host/var/lib/longhorn/replicas/pvc-5566bdfe-8158-422b-baaf-0c453c368a27-11f6df98, size<PHONE_NUMBER>/512\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:02Z\" level=info msg=\"Listening on data server <IP_ADDRESS>:10001\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:02Z\" level=info msg=\"Listening on sync agent server <IP_ADDRESS>:10002\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:02Z\" level=info msg=\"Listening on gRPC Replica server <IP_ADDRESS>:10000\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:02Z\" level=info msg=\"Listening on sync <IP_ADDRESS>:10002\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:03Z\" level=info msg=\"New connection from: <IP_ADDRESS>:41888\""
time="2020-08-18T12:09:30Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Opening volume /host/var/lib/longhorn/replicas/pvc-5566bdfe-8158-422b-baaf-0c453c368a27-11f6df98, size<PHONE_NUMBER>/512\""
time="2020-08-18T12:09:31Z" level=debug msg="Prepare to delete instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:09:31Z" level=warning msg="Instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 is state error, error message: exit status 1"
time="2020-08-18T12:09:31Z" level=warning msg="Instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 crashed on Instance Manager instance-manager-e-55361ddd at minikube, try to get log"
time="2020-08-18T12:09:31Z" level=info msg="Event(v1.ObjectReference{Kind:\"Engine\", Namespace:\"longhorn-system\", Name:\"pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1\", UID:\"0db606ab-3c9a-446b-9c81-7e5a1b831a95\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"1123\", FieldPath:\"\"}): type: 'Normal' reason: 'Stop' Stops pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:09:31Z" level=error msg="failed to receive log for instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: rpc error: code = NotFound desc = cannot find process pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:09:31Z" level=warning msg="cannot get crash log for instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 on Instance Manager instance-manager-e-55361ddd at minikube, error rpc error: code = NotFound desc = cannot find process pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:09:31Z" level=debug msg="Instance handler updated instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 state, old state error, new state stopped"
time="2020-08-18T12:09:32Z" level=debug msg="Prepare to delete instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d"
time="2020-08-18T12:09:32Z" level=info msg="Event(v1.ObjectReference{Kind:\"Replica\", Namespace:\"longhorn-system\", Name:\"pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d\", UID:\"da0e3c78-36c7-4e1e-a3e6-65c2655c1603\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"1133\", FieldPath:\"\"}): type: 'Normal' reason: 'Stop' Stops pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d"
time="2020-08-18T12:09:32Z" level=debug msg="Prepare to delete instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d"
time="2020-08-18T12:09:32Z" level=info msg="Event(v1.ObjectReference{Kind:\"Replica\", Namespace:\"longhorn-system\", Name:\"pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d\", UID:\"da0e3c78-36c7-4e1e-a3e6-65c2655c1603\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"1136\", FieldPath:\"\"}): type: 'Normal' reason: 'Stop' Stops pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d"
<IP_ADDRESS> - - [18/Aug/2020:12:09:32 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2200 "" "Go-http-client/1.1"
time="2020-08-18T12:09:33Z" level=debug msg="Instance handler updated instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d state, old state running, new state stopped"
time="2020-08-18T12:09:33Z" level=info msg="Event(v1.ObjectReference{Kind:\"Volume\", Namespace:\"longhorn-system\", Name:\"pvc-5566bdfe-8158-422b-baaf-0c453c368a27\", UID:\"363a234c-8510-4976-ab21-c39d72026a26\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"1114\", FieldPath:\"\"}): type: 'Normal' reason: 'Detached' volume pvc-5566bdfe-8158-422b-baaf-0c453c368a27 has been detached"
time="2020-08-18T12:09:34Z" level=debug msg="Prepare to create instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d"
time="2020-08-18T12:09:34Z" level=info msg="Event(v1.ObjectReference{Kind:\"Replica\", Namespace:\"longhorn-system\", Name:\"pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d\", UID:\"da0e3c78-36c7-4e1e-a3e6-65c2655c1603\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"1150\", FieldPath:\"\"}): type: 'Normal' reason: 'Start' Starts pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d"
<IP_ADDRESS> - - [18/Aug/2020:12:09:34 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 3161 "" "Go-http-client/1.1"
time="2020-08-18T12:09:35Z" level=debug msg="Instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d starts running, IP <IP_ADDRESS>"
time="2020-08-18T12:09:35Z" level=debug msg="Instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d starts running, Port 10000"
time="2020-08-18T12:09:35Z" level=debug msg="Instance handler updated instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d state, old state stopped, new state running"
time="2020-08-18T12:09:36Z" level=debug msg="Prepare to create instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:09:36Z" level=info msg="Event(v1.ObjectReference{Kind:\"Engine\", Namespace:\"longhorn-system\", Name:\"pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1\", UID:\"0db606ab-3c9a-446b-9c81-7e5a1b831a95\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"1158\", FieldPath:\"\"}): type: 'Normal' reason: 'Start' Starts pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:36 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2437 "" "Go-http-client/1.1"
time="2020-08-18T12:09:37Z" level=debug msg="Instance process pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 had been created, need to wait for instance manager update"
time="2020-08-18T12:09:37Z" level=debug msg="Instance handler updated instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 state, old state stopped, new state starting"
<IP_ADDRESS> - - [18/Aug/2020:12:09:38 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2463 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:38 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2464 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:38 +0000] "GET /v1/nodes/minikube HTTP/1.1" 200 1606 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:38 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2464 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:38 +0000] "GET /v1/nodes/minikube HTTP/1.1" 200 1606 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:40 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2464 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:42 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2464 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:44 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2464 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:46 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2464 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:48 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2464 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:50 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2463 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:52 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2464 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:54 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2463 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:56 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2464 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:09:58 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2464 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:10:00 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2464 "" "Go-http-client/1.1"
<IP_ADDRESS> - - [18/Aug/2020:12:10:02 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2464 "" "Go-http-client/1.1"
time="2020-08-18T12:10:03Z" level=warning msg="Instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 is state error, error message: exit status 1"
time="2020-08-18T12:10:03Z" level=debug msg="Instance handler updated instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 state, old state starting, new state error"
time="2020-08-18T12:10:03Z" level=warning msg="Instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 crashed on Instance Manager instance-manager-e-55361ddd at minikube, try to get log"
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Starting with replicas [\\\"tcp://<IP_ADDRESS>:10000\\\"]\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Connecting to remote: <IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Opening: <IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Adding backend: tcp://<IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Start monitoring tcp://<IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Get backend tcp://<IP_ADDRESS>:10000 revision counter 0\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"device pvc-5566bdfe-8158-422b-baaf-0c453c368a27: SCSI device /dev/longhorn/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 shutdown\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: go-iscsi-helper: tgtd is already running"
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:04Z\" level=info msg=\"go-iscsi-helper: found available target id 1\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:04Z\" level=info msg=\"New data socket connnection established\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:06Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Could not scan /sys/class/iscsi_transport.\\niscsiadm: Could not scan /sys/class/iscsi_transport.\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:06Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:11Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:11Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:16Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:16Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:21Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:21Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:26Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:26Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:29Z\" level=error msg=\"Failed to startup frontend: Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m node -T iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27 -p <IP_ADDRESS> --login], output , stderr, iscsiadm: No records found\\n, error exit status 21\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: 2020/08/18 12:09:29 failed to start up frontend: Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m node -T iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27 -p <IP_ADDRESS> --login], output , stderr, iscsiadm: No records found"
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: , error exit status 21"
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Starting with replicas [\\\"tcp://<IP_ADDRESS>:10000\\\"]\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Connecting to remote: <IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Opening: <IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Adding backend: tcp://<IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Start monitoring tcp://<IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Get backend tcp://<IP_ADDRESS>:10000 revision counter 0\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Shutdown SCSI target iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"device pvc-5566bdfe-8158-422b-baaf-0c453c368a27: SCSI device /dev/longhorn/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 shutdown\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: go-iscsi-helper: tgtd is already running"
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:37Z\" level=info msg=\"go-iscsi-helper: found available target id 1\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:37Z\" level=info msg=\"New data socket connnection established\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:39Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:39Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:44Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:44Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:49Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:49Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:54Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:54Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:59Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:59Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:10:02Z\" level=error msg=\"Failed to startup frontend: Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m node -T iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27 -p <IP_ADDRESS> --login], output , stderr, iscsiadm: No records found\\n, error exit status 21\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: 2020/08/18 12:10:02 failed to start up frontend: Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m node -T iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27 -p <IP_ADDRESS> --login], output , stderr, iscsiadm: No records found"
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: , error exit status 21"
time="2020-08-18T12:10:03Z" level=warning msg="Engine of volume pvc-5566bdfe-8158-422b-baaf-0c453c368a27 dead unexpectedly, reattach the volume"
time="2020-08-18T12:10:03Z" level=info msg="Event(v1.ObjectReference{Kind:\"Volume\", Namespace:\"longhorn-system\", Name:\"pvc-5566bdfe-8158-422b-baaf-0c453c368a27\", UID:\"363a234c-8510-4976-ab21-c39d72026a26\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"1153\", FieldPath:\"\"}): type: 'Warning' reason: 'DetachedUnexpectly' Engine of volume pvc-5566bdfe-8158-422b-baaf-0c453c368a27 dead unexpectedly, reattach the volume"
time="2020-08-18T12:10:03Z" level=warning msg="Try to get requested log for pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d on node minikube"
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:02Z\" level=info msg=\"Creating volume /host/var/lib/longhorn/replicas/pvc-5566bdfe-8158-422b-baaf-0c453c368a27-11f6df98, size<PHONE_NUMBER>/512\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:02Z\" level=info msg=\"Listening on data server <IP_ADDRESS>:10001\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:02Z\" level=info msg=\"Listening on sync agent server <IP_ADDRESS>:10002\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:02Z\" level=info msg=\"Listening on gRPC Replica server <IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:02Z\" level=info msg=\"Listening on sync <IP_ADDRESS>:10002\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:03Z\" level=info msg=\"New connection from: <IP_ADDRESS>:41888\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Opening volume /host/var/lib/longhorn/replicas/pvc-5566bdfe-8158-422b-baaf-0c453c368a27-11f6df98, size<PHONE_NUMBER>/512\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:32Z\" level=warning msg=\"Received signal interrupt to shutdown\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:32Z\" level=warning msg=\"Starting to execute registered shutdown func github.com/longhorn/longhorn-engine/app/cmd.startReplica.func4\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:34Z\" level=info msg=\"Listening on data server <IP_ADDRESS>:10001\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:34Z\" level=info msg=\"Listening on sync agent server <IP_ADDRESS>:10002\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:34Z\" level=info msg=\"Listening on gRPC Replica server <IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:34Z\" level=info msg=\"Listening on sync <IP_ADDRESS>:10002\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:36Z\" level=info msg=\"New connection from: <IP_ADDRESS>:42716\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Opening volume /host/var/lib/longhorn/replicas/pvc-5566bdfe-8158-422b-baaf-0c453c368a27-11f6df98, size<PHONE_NUMBER>/512\""
time="2020-08-18T12:10:03Z" level=warning msg="Try to get requested log for pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 on node minikube"
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Starting with replicas [\\\"tcp://<IP_ADDRESS>:10000\\\"]\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Connecting to remote: <IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Opening: <IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Adding backend: tcp://<IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Start monitoring tcp://<IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"Get backend tcp://<IP_ADDRESS>:10000 revision counter 0\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:03Z\" level=info msg=\"device pvc-5566bdfe-8158-422b-baaf-0c453c368a27: SCSI device /dev/longhorn/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 shutdown\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: go-iscsi-helper: tgtd is already running"
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:04Z\" level=info msg=\"go-iscsi-helper: found available target id 1\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:04Z\" level=info msg=\"New data socket connnection established\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:06Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Could not scan /sys/class/iscsi_transport.\\niscsiadm: Could not scan /sys/class/iscsi_transport.\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:06Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:11Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:11Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:16Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:16Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:21Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:21Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:26Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:26Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:29Z\" level=error msg=\"Failed to startup frontend: Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m node -T iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27 -p <IP_ADDRESS> --login], output , stderr, iscsiadm: No records found\\n, error exit status 21\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: 2020/08/18 12:09:29 failed to start up frontend: Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m node -T iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27 -p <IP_ADDRESS> --login], output , stderr, iscsiadm: No records found"
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: , error exit status 21"
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Starting with replicas [\\\"tcp://<IP_ADDRESS>:10000\\\"]\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Connecting to remote: <IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Opening: <IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Adding backend: tcp://<IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Start monitoring tcp://<IP_ADDRESS>:10000\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Get backend tcp://<IP_ADDRESS>:10000 revision counter 0\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"Shutdown SCSI target iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:36Z\" level=info msg=\"device pvc-5566bdfe-8158-422b-baaf-0c453c368a27: SCSI device /dev/longhorn/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 shutdown\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: go-iscsi-helper: tgtd is already running"
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:37Z\" level=info msg=\"go-iscsi-helper: found available target id 1\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:37Z\" level=info msg=\"New data socket connnection established\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:39Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:39Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:44Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:44Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:49Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:49Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:54Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:54Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:59Z\" level=warning msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:09:59Z\" level=warning msg=\"Nodes cleaned up for iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: time=\"2020-08-18T12:10:02Z\" level=error msg=\"Failed to startup frontend: Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m node -T iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27 -p <IP_ADDRESS> --login], output , stderr, iscsiadm: No records found\\n, error exit status 21\""
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: 2020/08/18 12:10:02 failed to start up frontend: Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m node -T iqn.2019-10.io.longhorn:pvc-5566bdfe-8158-422b-baaf-0c453c368a27 -p <IP_ADDRESS> --login], output , stderr, iscsiadm: No records found"
time="2020-08-18T12:10:03Z" level=warning msg="pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: , error exit status 21"
time="2020-08-18T12:10:03Z" level=debug msg="Prepare to delete instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:10:03Z" level=warning msg="Instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 is state error, error message: exit status 1"
time="2020-08-18T12:10:03Z" level=warning msg="Instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 crashed on Instance Manager instance-manager-e-55361ddd at minikube, try to get log"
time="2020-08-18T12:10:03Z" level=info msg="Event(v1.ObjectReference{Kind:\"Engine\", Namespace:\"longhorn-system\", Name:\"pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1\", UID:\"0db606ab-3c9a-446b-9c81-7e5a1b831a95\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"1196\", FieldPath:\"\"}): type: 'Normal' reason: 'Stop' Stops pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:10:03Z" level=error msg="failed to receive log for instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: rpc error: code = NotFound desc = cannot find process pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:10:03Z" level=warning msg="cannot get crash log for instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 on Instance Manager instance-manager-e-55361ddd at minikube, error rpc error: code = NotFound desc = cannot find process pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:10:03Z" level=debug msg="Prepare to delete instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:10:03Z" level=warning msg="Instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 is state error, error message: exit status 1"
time="2020-08-18T12:10:03Z" level=warning msg="Instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 crashed on Instance Manager instance-manager-e-55361ddd at minikube, try to get log"
time="2020-08-18T12:10:03Z" level=info msg="Event(v1.ObjectReference{Kind:\"Engine\", Namespace:\"longhorn-system\", Name:\"pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1\", UID:\"0db606ab-3c9a-446b-9c81-7e5a1b831a95\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"1204\", FieldPath:\"\"}): type: 'Normal' reason: 'Stop' Stops pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:10:03Z" level=error msg="failed to receive log for instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: rpc error: code = NotFound desc = cannot find process pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:10:03Z" level=warning msg="cannot get crash log for instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 on Instance Manager instance-manager-e-55361ddd at minikube, error rpc error: code = NotFound desc = cannot find process pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:10:03Z" level=debug msg="Prepare to delete instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:10:03Z" level=warning msg="Instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 is state error, error message: exit status 1"
time="2020-08-18T12:10:03Z" level=warning msg="Instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 crashed on Instance Manager instance-manager-e-55361ddd at minikube, try to get log"
time="2020-08-18T12:10:03Z" level=info msg="Event(v1.ObjectReference{Kind:\"Engine\", Namespace:\"longhorn-system\", Name:\"pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1\", UID:\"0db606ab-3c9a-446b-9c81-7e5a1b831a95\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"1207\", FieldPath:\"\"}): type: 'Normal' reason: 'Stop' Stops pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:10:03Z" level=error msg="failed to receive log for instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1: rpc error: code = NotFound desc = cannot find process pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:10:03Z" level=warning msg="cannot get crash log for instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 on Instance Manager instance-manager-e-55361ddd at minikube, error rpc error: code = NotFound desc = cannot find process pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1"
time="2020-08-18T12:10:04Z" level=debug msg="Instance handler updated instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-e-8971fbd1 state, old state error, new state stopped"
time="2020-08-18T12:10:04Z" level=debug msg="Prepare to delete instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d"
time="2020-08-18T12:10:04Z" level=info msg="Event(v1.ObjectReference{Kind:\"Replica\", Namespace:\"longhorn-system\", Name:\"pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d\", UID:\"da0e3c78-36c7-4e1e-a3e6-65c2655c1603\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"1214\", FieldPath:\"\"}): type: 'Normal' reason: 'Stop' Stops pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d"
<IP_ADDRESS> - - [18/Aug/2020:12:10:04 +0000] "GET /v1/volumes/pvc-5566bdfe-8158-422b-baaf-0c453c368a27 HTTP/1.1" 200 2200 "" "Go-http-client/1.1"
time="2020-08-18T12:10:04Z" level=debug msg="Prepare to delete instance pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d"
time="2020-08-18T12:10:04Z" level=info msg="Event(v1.ObjectReference{Kind:\"Replica\", Namespace:\"longhorn-system\", Name:\"pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d\", UID:\"da0e3c78-36c7-4e1e-a3e6-65c2655c1603\", APIVersion:\"longhorn.io/v1beta1\", ResourceVersion:\"1216\", FieldPath:\"\"}): type: 'Normal' reason: 'Stop' Stops pvc-5566bdfe-8158-422b-baaf-0c453c368a27-r-f57ce09d"

Environment:

Longhorn version: 1.0.2
Kubernetes version: 1.18.3
Node OS type and version: minikube v1.12.1 on Ubuntu 19.10 using docker driver.

Here is the key error log:
msg=\"FAIL to discover due to Failed to execute: nsenter [--mount=/host/proc/118/ns/mnt --net=/host/proc/118/ns/net iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>], output , stderr, Failed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\nFailed to connect to bus: No data available\\niscsiadm: can not connect to iSCSI daemon (111)!\\niscsiadm: Cannot perform discovery. Initiatorname required.\\niscsiadm: Could not perform SendTargets discovery: could not connect to iscsid\\n, error exit status 20\""

I am not sure if this is caused by the iscsi version issue, or there is something wrong with the iscsiadm setup. Notice that the OS version you are using is Ubuntu 19.10 but Longhorn is using Ubuntu 18.04

iscsiadm: Cannot perform discovery. Initiatorname required.
This seems due to the iscsid/open-iscsi wasn't configured correctly on the node. The initiator name wasn't set.


Zend_Mail SMTP SSL Problem with PHP 5.6

PHP 5.6 changed the SSL certificate verification default, causing Zend_Mail SMTP to fail when the server CN doesn't exactly match the certificate CN. The solution to this is to set the verify_peer and verify_peer_name stream context options to false, but Zend_Mail provides no way to do this.
@ermajn has opened an issue in zf2 repo. https://github.com/zendframework/zend-mail/issues/14

We are sorry, but ZF1 reaches its End of Life (EOL).


Reregister event hub consumer after unregister caused IllegalStateException

Steps to reproduce:

when the microservice starts all binders go up and … all is ok
after several tasks I decide to stop the binders and … all is ok
after some while I decide to restart the binders….I have a problem

Stacktrace as below:
reactor.core.Exceptions$ErrorCallbackNotImplemented: java.lang.IllegalStateException: Register cannot be called on an EventProcessorHost after unregister. Please create a new EventProcessorHost instance.
Caused by: java.lang.IllegalStateException: Register cannot be called on an EventProcessorHost after unregister. Please create a new EventProcessorHost instance.
at com.microsoft.azure.eventprocessorhost.EventProcessorHost.registerEventProcessorFactory(EventProcessorHost.java:461)
at com.microsoft.azure.spring.integration.eventhub.impl.AbstractEventHubTemplate.register(AbstractEventHubTemplate.java:103)
at com.microsoft.azure.spring.integration.eventhub.impl.EventHubTemplate.subscribe(EventHubTemplate.java:40)
at com.microsoft.azure.spring.integration.core.api.SubscribeByGroupOperation.subscribe(SubscribeByGroupOperation.java:30)
at com.microsoft.azure.spring.integration.core.AbstractInboundChannelAdapter.doStart(AbstractInboundChannelAdapter.java:38)
at org.springframework.integration.endpoint.AbstractEndpoint.start(AbstractEndpoint.java:156)
at org.springframework.cloud.stream.binder.DefaultBinding.start(DefaultBinding.java:116)
at com.wba.oneit.oneleo.config.BinderStartStopService.lambda$start$0(BinderStartStopService.java:41)
at java.util.concurrent.ConcurrentHashMap$EntrySetView.forEach(ConcurrentHashMap.java:4795)
at com.wba.oneit.oneleo.config.BinderStartStopService.start(BinderStartStopService.java:39)

The root cause is inside:
protected void register(String name, String consumerGroup, EventHubProcessor eventProcessor) {
        EventProcessorHost host = this.clientFactory.getOrCreateEventProcessorHost(name, consumerGroup);
        host.registerEventProcessorFactory(context -> eventProcessor, buildEventProcessorOptions(startPosition));
    }

    protected void unregister(String name, String consumerGroup) {
        this.clientFactory.getOrCreateEventProcessorHost(name, consumerGroup).unregisterEventProcessor()
                          .whenComplete((s, t) -> {
                              if (t != null) {
                                  log.warn(String.format("Failed to unregister consumer '%s' with group '%s'", name,
                                          consumerGroup), t);
                              }
                          });

where this.clientFactory.getOrCreateEventProcessorHost is called in both register and unregister cases.
But when I do the mentioned sequence of operations (register , unregister,  register)  I have an error during the second register phase because the EventProcessorHost retrieved from the map
is registered and it has valorised variables that are null during the first register phase .
How to fix
It seems that we should remove EventProcessorHost after unregister, then creating new one after reregister.

I've submitted a PR for this bug @ #546


chore: revert check where airmass skips on python 3.9

Related #1678

Failure unrelated to PR goal. Merging


Transposition table

Adding transposition table lookups
TODO:

Test more rigorously
Reduce token count
Enhance evaluation metric

Whoops! Accidentally opened a PR to merge into main on here instead of my fork haha


Incorrect Screenshot in section "Enable password writeback for SSPR"

Between steps 5 and 6 in the "Enable password writeback for SSPR" section there is a screenshot that is incorrectly duplicated from the previous section.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 115ae83a-95dd-5643-bc88-f5447ebb2b99
Version Independent ID: 7462ce84-0a9f-4bfd-7eba-c00928d77865
Content: Enable Azure Active Directory password writeback - Microsoft Entra
Content Source: articles/active-directory/authentication/tutorial-enable-sspr-writeback.md
Service: active-directory
Sub-service: authentication
GitHub Login: @Justinha
Microsoft Alias: justinha

@CCDanC
Thanks for your feedback! We will investigate and update as appropriate.

@CCDanC
Thank you for bringing this to our attention. One of our customers raised the similar concern, Content author working on this thread, once it's done document will update as appropriate. Please check below thread for your reference.
Duplicate of https://github.com/MicrosoftDocs/azure-docs/issues/107657
We are going to close this thread, but if there are any further questions regarding the documentation, please tag me in your reply and we will be happy to continue the conversation.


brew bump: don't use Repology for versioned formulae

[x] Have you followed the guidelines in our Contributing document?
[x] Have you checked to ensure there aren't other open Pull Requests for the same change?
[x] Have you added an explanation of what your changes do and why you'd like us to include them?
[ ] Have you written new tests for your changes? Here's an example.

[ ] Have you successfully run brew tests with your changes locally?

This PR proposes to avoid checking Repology for versioned formulae when brew bumping them.
Currently, brew bump's Repology output for a versioned formula shows the latest version for the corresponding non-versioned formula. This leads to incorrect PRs like https://github.com/Homebrew/homebrew-core/pull/94115, https://github.com/Homebrew/homebrew-core/pull/94113, https://github.com/Homebrew/homebrew-core/pull/94110, etc. For example:
➜ brew bump traefik@1
==> traefik@1
Current formula version:  1.7.34
Latest livecheck version: 1.7.34
Latest Repology version:  2.6.0
Open pull requests:       none

With these changes, we have:
➜ brew bump traefik@1
==> traefik@1
Current formula version:  1.7.34
Latest livecheck version: 1.7.34
Latest Repology version:  not found
Open pull requests:       none

The message could probably improved/changed from "not found" for this particular case. I think it's fine to skip Repology altogether because:

They don't list the versioned formula separately for Homebrew's case (see e.g. https://repology.org/project/traefik/versions, the page contains both traefik and traefik@1).
Other distributions that have versioned formulae may not use the same name (e.g. Scoop uses traefik1) and searching through all these may be wasteful or include different packages.

This would only be a problem for formulae like openssl where we have only versioned formulae, but there are very few of these, they're usually very popular (Python, OpenSSL, etc.) and livecheck is probably sufficient.

Review period will end on 2022-02-01 at 09:52:09 UTC.

Review period skipped due to critical label.


Use case:   science development

Scientist starts from an approved tag on some fixture F, and wishes all science aspects to remain frozen as they develop some new feature.
Changes are required on repositories  X & Y.
Sequence

Clone and build approved tag (detached head everywhere)
create and checkout new feature branches (from detached head) on repos X & Y
develop/test/commit repeatedly on feature branch
ready for merge  (all changes committed on feature branches)

Catch up to development of fixture F

checkout develop configuration of fixture F
checkout develop branches of repos X & Y
checkout feature branches of X & Y
merge (or rebase) X & Y feature branches onto develop branches
repeat steps 3 and 4 until ready for PR

Issue PR's

push feature branches for X & Y to GitHub host
issue PRs onto develop for feature branches
do something magical for CI

Most of these steps (except catching up to changes in develop) are now covered by v1.0.0.

Good.   Is that remaining "bit" problematic, hard,  straightforward, or not yet known?

I think it will be better to deal with handling develop branches first (both specifying in repolist and assigning an appropriate command to check out) before handling the 'catch up' phase.

This issue has been resolved. See this wiki entry.


Fix issues with filebeat deployment

Currently deployment when filebeat is enabled will fail due to changes upstream.

Fixed in #68


Update to embedded hal 1.0.0

embedded hal is out. This crate should support it. The README of embedded-hal point to here.

I tried to use this crate and it's unusable because 1.0-rc.1 conflicts with 1.0. This makes it very difficult to have an application with a mix of 0.2 and 1.0 stuff.

There is a draft PR here: https://github.com/ryankurte/embedded-hal-compat/pull/32 it's currently blocked on how to handle the &self & &mut self differences.

This has been done in #34, which has now been published in version 0.13.0.
Thanks everybody!


training and testing and dataset preparation script

could you provide training, testing and how to prepare dataset script for better understand?

Datasets can be downloaded from:
https://drive.google.com/file/d/1fJAK5WZTjerW7EWHHQAR9pRJVNg1T1Y7/view?usp=sharing, https://drive.google.com/open?id=1nVGCTd9ttULRXFezh4xILQ9lUkg0WZCG, https://drive.google.com/file/d/1_ZsLyqI487NRDQhwvI7rg86FK3YAZvz1/view?usp=sharing, https://drive.google.com/file/d/1GjGMI0q3bgcpcB_CjI40fX54WgLPuTpS/view?usp=sharing
You will then have to change the data directories in each of the ./data/* files to wherever you choose to store the data on your machine.
  Let me know if you have any other questions!


tensorflow 1 is much slower than 2 with tf.data.Dataset.from_tensor_slices

Click to expand!
Issue Type
Performance
Source
source
Tensorflow Version
tf 1.15.0 vs tf 2.8
Custom Code
Yes
OS Platform and Distribution
Ubuntu 16
Mobile device
No response
Python version
3.7
Bazel version
No response
GCC/Compiler version
No response
CUDA/cuDNN version
No response
GPU model and memory
No response
Current Behaviour?
It was very slow when I used tf.data.Dataset.from_tensor_slices() in a tf1 environment to create a dataset, but very quickly with tf2. Whether this is an optimization of tf2. If you have to be in a tf1 environment, is there a good alternative?

Standalone code to reproduce the issue
df = pd.read_csv(train_file, header=None, names=TRAIN_DATA_COLUMNS)
features = collections.OrderedDict()
for col in CONTINUOUS_COLUMNS:
    features[col] = df[col].to_numpy().astype(np.float32)
    print(features[col].dtype)

for col in CATEGORICAL_COLUMNS:
    features[col] = df[col].to_numpy()
    print(features[col].dtype)
labels = df[LABEL_COLUMN].to_numpy()
dataset = tf.data.Dataset.from_tensor_slices((features, labels))

Relevant log output
No response

@zhanglirong1999 ,
Tensorflow  1.x is not actively supported. So we request to use the 2.x version as the latest version is much faster than the older version. Thank you!


Slow down in scrobbling

Since version 2 I've noticed the scrobbling pipeline has slowed down significantly. Did you ever notice this @alexesprit
I believe it's from the Libre.fm changes that cause a 522 timeout on their servers ( I'm not authenticated ).
Update
Could be that I'm not able to access libre.fm atm in which case we might want to add sensible timeouts to certain aspects. Opinions?

Yes, it's same for me. This happens because of Libre.fm is down now. I partially fixed this issue by adding timeouts for all network requests (15 sec).
If it won't be resolved until tomorrow, I'll exclude Libre.fm from the list of track info providers and will publish a patch update.

Glad we caught this early on :+1: Always the fun part of relying on 3rd parties.