gk-deploy - setup-openshift-heketi-storage task makes GCE VMs crash

Hi,
I'm trying to install Heketi to manage GlusterFS on a 1 master / 3 nodes Google Compute Engine platform.
All images are:

based on CentOS-7 GCE image
4 vCPU
16 Go memory
Nodes:
1 main disk with centos-7
1 raw additional disk (/dev/sdb) without any partition.

I followed https://github.com/gluster/gluster-kubernetes/blob/master/docs/setup-guide.md.
Everything is deployed with Ansible on the top of Kubernetes 1.8.4 (Kubespray v2.3.0), basic steps are:

Install on master and nodes some packages (lvm2, glusterfs-fuse)
Open firewall ports TCP 2222, 24007, 24008 and glusterFS configured range 49152-49251
Set SE Boleans virt_sandbox_use_fusefs, virt_use_fusefs, virt_use_glusterd to 1
Configure /etc/lvm/lvm.conf with use_lvmetad, udev_rules and udev_sync to 0
Create glusterfs-daemonset.yaml, heketi-service-account.yaml, heketi.json.template
Finally, execute gk-deploy.

Everything is fined until heketi tries to create all pvs/vgs/bricks with setup-openshift-heketi-storage. It fails 90% of time making GCE VMs reboot, and thus forcing pods to reboot, implying vg and lv not well configured.
I've been testing without gk-deploy, following all steps from https://github.com/heketi/heketi/blob/master/doc/admin/install-kubernetes.md. BTW, it still crashed the same way and the same moment.
It sounds like Kernel Panic, but I can't see anything in host logs.
Am I missing something ? Is it related to GCE or Heketi ?

Oh dear. This is the first I hear of this. Do you have access to any logs on the affected nodes that might indicate what the operation was that caused the crash? I believe heketi runs pvcreate on the nodes when adding the devices during the topology load, so at least that seems to complete successfully...
If you have any way to capture the logs from the heketi pod such that you can view them after the pod has gone away, you should be able to see the exact commands it tried to execute and replicate them manually to see what errors you get.

Is it related to GCE or Heketi ?

Why not both? ;)

Sure, I'm trying to deploy on Ubuntu 16.04 to see if it's related to CentOS 7.4 kernel or not. I'll make another installed a bit later to give you logs.
Yup, topology loading is successful. The crash occurs during the next step, when the lvcreate is involved. When I launch the generated command by hand, my VM crashes.
I'll keep up to any news on that

Sure, I'm trying to deploy on Ubuntu 16.04 to see if it's related to CentOS 7.4 kernel or not. I'll make another installed a bit later to give you logs.
Yup, topology loading is successful. The crash occurs during the next step, when the lvcreate is involved. When I launch the generated command by hand, my VM crashes.
I'll keep up to any news on that

@jarrpa Some news, it seems that this bug does not occur on Ubuntu 16.04 VMs.

@Flow76320 Very odd... I use CentOS 7.4-based VMs and don't run into this. Might be GCE-related or GCE+CentOS at this point?

Hi @jarrpa,
I can confirm that everything is working on GCE, Ubuntu 16.04.
I tried to apply the same configuration (adapted for CentOS 7) on CentOS 7-based GCE VMs, here is the (long) stack from /var/log/messages
Dec 20 13:12:24 k8s-1-8-1-node1-centos yum[19891]: Updated: glusterfs-fuse-3.12.3-1.el7.x86_64
Dec 20 13:12:24 k8s-1-8-1-node1-centos systemd: Stopping System Logging Service...
Dec 20 13:12:24 k8s-1-8-1-node1-centos rsyslogd: [origin software="rsyslogd" swVersion="8.24.0" x-pid="19916" x-info="http://www.rsyslog.com"] exiting on signal 15.
Dec 20 13:12:24 k8s-1-8-1-node1-centos systemd: Starting System Logging Service...
Dec 20 13:12:24 k8s-1-8-1-node1-centos rsyslogd: [origin software="rsyslogd" swVersion="8.24.0" x-pid="19925" x-info="http://www.rsyslog.com"] start
Dec 20 13:12:24 k8s-1-8-1-node1-centos systemd: Started System Logging Service.
Dec 20 13:12:26 k8s-1-8-1-node1-centos kubelet: I1220 13:12:26.275322    5101 container_manager_linux.go:446] [ContainerManager]: Discovered runtime cgroups name: /system.slice/docker.service
Dec 20 13:12:26 k8s-1-8-1-node1-centos kubelet: I1220 13:12:26.350801    5101 qos_container_manager_linux.go:320] [ContainerManager]: Updated QoS cgroup configuration
Dec 20 13:12:40 k8s-1-8-1-node1-centos kubelet: W1220 13:12:40.496898    5101 conversion.go:110] Could not get instant cpu stats: cumulative stats decrease
Dec 20 13:12:50 k8s-1-8-1-node1-centos kubelet: W1220 13:12:50.508101    5101 conversion.go:110] Could not get instant cpu stats: cumulative stats decrease
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.475996    5101 kubelet.go:1837] SyncLoop (ADD, "api"): "glusterfs-lqd28_kube-system(8d755ff5-e587-11e7-898c-42010a84000c)"
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.476705    5101 qos_container_manager_linux.go:320] [ContainerManager]: Updated QoS cgroup configuration
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: E1220 13:13:21.478478    5101 helpers.go:468] PercpuUsage had 0 cpus, but the actual number is 4; ignoring extra CPUs
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.639831    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "glusterfs-run" (UniqueName: "kubernetes.io/empty-dir/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-run") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.639899    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "glusterfs-misc" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-misc") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.639927    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "glusterfs-lvm" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-lvm") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.640005    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "glusterfs-heketi" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-heketi") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.640036    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "glusterfs-logs" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-logs") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.640061    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "glusterfs-etc" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-etc") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.640086    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "glusterfs-cgroup" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-cgroup") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.640144    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "glusterfs-ssl" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-ssl") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.640223    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "glusterfs-config" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-config") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.640287    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "glusterfs-dev" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-dev") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.640364    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-tlmnd" (UniqueName: "kubernetes.io/secret/8d755ff5-e587-11e7-898c-42010a84000c-default-token-tlmnd") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.740755    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "glusterfs-run" (UniqueName: "kubernetes.io/empty-dir/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-run") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.740832    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "glusterfs-misc" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-misc") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.740864    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "glusterfs-heketi" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-heketi") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.740892    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "glusterfs-lvm" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-lvm") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.740923    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "glusterfs-logs" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-logs") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.740950    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "glusterfs-misc" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-misc") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.740954    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "glusterfs-etc" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-etc") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.740992    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "glusterfs-etc" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-etc") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.741024    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "glusterfs-config" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-config") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.741054    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "glusterfs-dev" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-dev") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.741087    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "glusterfs-cgroup" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-cgroup") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.741120    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "glusterfs-ssl" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-ssl") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.741163    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "default-token-tlmnd" (UniqueName: "kubernetes.io/secret/8d755ff5-e587-11e7-898c-42010a84000c-default-token-tlmnd") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.741305    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "glusterfs-run" (UniqueName: "kubernetes.io/empty-dir/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-run") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.741372    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "glusterfs-lvm" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-lvm") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.741428    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "glusterfs-logs" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-logs") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.741431    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "glusterfs-heketi" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-heketi") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.741476    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "glusterfs-dev" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-dev") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.741490    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "glusterfs-cgroup" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-cgroup") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.741519    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "glusterfs-config" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-config") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.741553    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "glusterfs-ssl" (UniqueName: "kubernetes.io/host-path/8d755ff5-e587-11e7-898c-42010a84000c-glusterfs-ssl") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos systemd: Started Kubernetes transient mount for /var/lib/kubelet/pods/8d755ff5-e587-11e7-898c-42010a84000c/volumes/kubernetes.io~secret/default-token-tlmnd.
Dec 20 13:13:21 k8s-1-8-1-node1-centos systemd: Starting Kubernetes transient mount for /var/lib/kubelet/pods/8d755ff5-e587-11e7-898c-42010a84000c/volumes/kubernetes.io~secret/default-token-tlmnd.
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.764184    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "default-token-tlmnd" (UniqueName: "kubernetes.io/secret/8d755ff5-e587-11e7-898c-42010a84000c-default-token-tlmnd") pod "glusterfs-lqd28" (UID: "8d755ff5-e587-11e7-898c-42010a84000c")
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.781999    5101 kuberuntime_manager.go:371] No sandbox for pod "glusterfs-lqd28_kube-system(8d755ff5-e587-11e7-898c-42010a84000c)" can be found. Need to start a new one
Dec 20 13:13:21 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:13:21.929795501Z" level=error msg="Handler for GET /v1.26/images/gluster/gluster-centos:latest/json returned error: No such image: gluster/gluster-centos:latest"
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.933056    5101 provider.go:119] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.933728    5101 provider.go:119] Refreshing cache for provider: *gcp_credentials.dockerConfigKeyProvider
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.936012    5101 config.go:191] body of failing http response: &{0x7656e0 0xc42195db40 0x76e930}
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: E1220 13:13:21.936058    5101 metadata.go:142] while reading 'google-dockercfg' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.936097    5101 provider.go:119] Refreshing cache for provider: *gcp_credentials.dockerConfigUrlKeyProvider
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: I1220 13:13:21.937380    5101 config.go:191] body of failing http response: &{0x7656e0 0xc42195dc80 0x76e930}
Dec 20 13:13:21 k8s-1-8-1-node1-centos kubelet: E1220 13:13:21.937404    5101 metadata.go:159] while reading 'google-dockercfg-url' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg-url
Dec 20 13:13:22 k8s-1-8-1-node1-centos kubelet: I1220 13:13:22.303548    5101 kubelet.go:1871] SyncLoop (PLEG): "glusterfs-lqd28_kube-system(8d755ff5-e587-11e7-898c-42010a84000c)", event: &pleg.PodLifecycleEvent{ID:"8d755ff5-e587-11e7-898c-42010a84000c", Type:"ContainerStarted", Data:"35eede0d90bf73270bf707de04f7a074e2a5b3617f0537783620d3b4e6f1262c"}
Dec 20 13:13:25 k8s-1-8-1-node1-centos systemd-logind: Removed session 11.
Dec 20 13:13:26 k8s-1-8-1-node1-centos kubelet: I1220 13:13:26.351408    5101 qos_container_manager_linux.go:320] [ContainerManager]: Updated QoS cgroup configuration
Dec 20 13:13:33 k8s-1-8-1-node1-centos kubelet: I1220 13:13:33.202403    5101 kube_docker_client.go:330] Pulling image "gluster/gluster-centos:latest": "10d9c09437ad: Extracting [===========================>                       ]  26.74MB/49.49MB"
Dec 20 13:13:36 k8s-1-8-1-node1-centos kubelet: I1220 13:13:36.873168    5101 kube_docker_client.go:333] Stop pulling image "gluster/gluster-centos:latest": "Status: Downloaded newer image for gluster/gluster-centos:latest"
Dec 20 13:13:37 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:13:36.991761978Z" level=warning msg="Unknown healthcheck type 'NONE' (expected 'CMD') in container cc69a7055e49127967070c13828d2375e9bf74316453bd01657f2b1a39b15818"
Dec 20 13:13:37 k8s-1-8-1-node1-centos systemd-journald[26]: Failed to set file attributes: Operation not supported
Dec 20 13:13:37 k8s-1-8-1-node1-centos kernel: RPC: Registered named UNIX socket transport module.
Dec 20 13:13:37 k8s-1-8-1-node1-centos kernel: RPC: Registered udp transport module.
Dec 20 13:13:37 k8s-1-8-1-node1-centos kernel: RPC: Registered tcp transport module.
Dec 20 13:13:37 k8s-1-8-1-node1-centos kernel: RPC: Registered tcp NFSv4.1 backchannel transport module.
Dec 20 13:13:37 k8s-1-8-1-node1-centos kernel: Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
Dec 20 13:13:37 k8s-1-8-1-node1-centos kubelet: I1220 13:13:37.417145    5101 kubelet.go:1871] SyncLoop (PLEG): "glusterfs-lqd28_kube-system(8d755ff5-e587-11e7-898c-42010a84000c)", event: &pleg.PodLifecycleEvent{ID:"8d755ff5-e587-11e7-898c-42010a84000c", Type:"ContainerStarted", Data:"cc69a7055e49127967070c13828d2375e9bf74316453bd01657f2b1a39b15818"}
Dec 20 13:13:40 k8s-1-8-1-node1-centos kubelet: W1220 13:13:40.592806    5101 conversion.go:110] Could not get instant cpu stats: different number of cpus
Dec 20 13:13:50 k8s-1-8-1-node1-centos kubelet: W1220 13:13:50.609884    5101 conversion.go:110] Could not get instant cpu stats: different number of cpus
Dec 20 13:14:26 k8s-1-8-1-node1-centos kubelet: I1220 13:14:26.352034    5101 qos_container_manager_linux.go:320] [ContainerManager]: Updated QoS cgroup configuration
Dec 20 13:14:48 k8s-1-8-1-node1-centos kubelet: I1220 13:14:48.930765    5101 kubelet.go:1837] SyncLoop (ADD, "api"): "deploy-heketi-75f9ddb9b6-bf2gl_kube-system(c1954332-e587-11e7-898c-42010a84000c)"
Dec 20 13:14:48 k8s-1-8-1-node1-centos kubelet: I1220 13:14:48.931353    5101 qos_container_manager_linux.go:320] [ContainerManager]: Updated QoS cgroup configuration
Dec 20 13:14:49 k8s-1-8-1-node1-centos kubelet: I1220 13:14:49.034789    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "db" (UniqueName: "kubernetes.io/empty-dir/c1954332-e587-11e7-898c-42010a84000c-db") pod "deploy-heketi-75f9ddb9b6-bf2gl" (UID: "c1954332-e587-11e7-898c-42010a84000c")
Dec 20 13:14:49 k8s-1-8-1-node1-centos kubelet: I1220 13:14:49.034864    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "heketi-service-account-token-hplkp" (UniqueName: "kubernetes.io/secret/c1954332-e587-11e7-898c-42010a84000c-heketi-service-account-token-hplkp") pod "deploy-heketi-75f9ddb9b6-bf2gl" (UID: "c1954332-e587-11e7-898c-42010a84000c")
Dec 20 13:14:49 k8s-1-8-1-node1-centos kubelet: I1220 13:14:49.034895    5101 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume "config" (UniqueName: "kubernetes.io/secret/c1954332-e587-11e7-898c-42010a84000c-config") pod "deploy-heketi-75f9ddb9b6-bf2gl" (UID: "c1954332-e587-11e7-898c-42010a84000c")
Dec 20 13:14:49 k8s-1-8-1-node1-centos kubelet: I1220 13:14:49.135464    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "heketi-service-account-token-hplkp" (UniqueName: "kubernetes.io/secret/c1954332-e587-11e7-898c-42010a84000c-heketi-service-account-token-hplkp") pod "deploy-heketi-75f9ddb9b6-bf2gl" (UID: "c1954332-e587-11e7-898c-42010a84000c")
Dec 20 13:14:49 k8s-1-8-1-node1-centos kubelet: I1220 13:14:49.135548    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "config" (UniqueName: "kubernetes.io/secret/c1954332-e587-11e7-898c-42010a84000c-config") pod "deploy-heketi-75f9ddb9b6-bf2gl" (UID: "c1954332-e587-11e7-898c-42010a84000c")
Dec 20 13:14:49 k8s-1-8-1-node1-centos kubelet: I1220 13:14:49.135592    5101 reconciler.go:257] operationExecutor.MountVolume started for volume "db" (UniqueName: "kubernetes.io/empty-dir/c1954332-e587-11e7-898c-42010a84000c-db") pod "deploy-heketi-75f9ddb9b6-bf2gl" (UID: "c1954332-e587-11e7-898c-42010a84000c")
Dec 20 13:14:49 k8s-1-8-1-node1-centos kubelet: I1220 13:14:49.138092    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "db" (UniqueName: "kubernetes.io/empty-dir/c1954332-e587-11e7-898c-42010a84000c-db") pod "deploy-heketi-75f9ddb9b6-bf2gl" (UID: "c1954332-e587-11e7-898c-42010a84000c")
Dec 20 13:14:49 k8s-1-8-1-node1-centos systemd: Started Kubernetes transient mount for /var/lib/kubelet/pods/c1954332-e587-11e7-898c-42010a84000c/volumes/kubernetes.io~secret/config.
Dec 20 13:14:49 k8s-1-8-1-node1-centos systemd: Starting Kubernetes transient mount for /var/lib/kubelet/pods/c1954332-e587-11e7-898c-42010a84000c/volumes/kubernetes.io~secret/config.
Dec 20 13:14:49 k8s-1-8-1-node1-centos systemd: Started Kubernetes transient mount for /var/lib/kubelet/pods/c1954332-e587-11e7-898c-42010a84000c/volumes/kubernetes.io~secret/heketi-service-account-token-hplkp.
Dec 20 13:14:49 k8s-1-8-1-node1-centos systemd: Starting Kubernetes transient mount for /var/lib/kubelet/pods/c1954332-e587-11e7-898c-42010a84000c/volumes/kubernetes.io~secret/heketi-service-account-token-hplkp.
Dec 20 13:14:49 k8s-1-8-1-node1-centos kubelet: I1220 13:14:49.156706    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "config" (UniqueName: "kubernetes.io/secret/c1954332-e587-11e7-898c-42010a84000c-config") pod "deploy-heketi-75f9ddb9b6-bf2gl" (UID: "c1954332-e587-11e7-898c-42010a84000c")
Dec 20 13:14:49 k8s-1-8-1-node1-centos kubelet: I1220 13:14:49.158003    5101 operation_generator.go:484] MountVolume.SetUp succeeded for volume "heketi-service-account-token-hplkp" (UniqueName: "kubernetes.io/secret/c1954332-e587-11e7-898c-42010a84000c-heketi-service-account-token-hplkp") pod "deploy-heketi-75f9ddb9b6-bf2gl" (UID: "c1954332-e587-11e7-898c-42010a84000c")
Dec 20 13:14:49 k8s-1-8-1-node1-centos kubelet: I1220 13:14:49.236667    5101 kuberuntime_manager.go:371] No sandbox for pod "deploy-heketi-75f9ddb9b6-bf2gl_kube-system(c1954332-e587-11e7-898c-42010a84000c)" can be found. Need to start a new one
Dec 20 13:14:49 k8s-1-8-1-node1-centos kernel: IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
Dec 20 13:14:49 k8s-1-8-1-node1-centos kernel: IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
Dec 20 13:14:49 k8s-1-8-1-node1-centos kernel: cni0: port 5(veth228a0f44) entered blocking state
Dec 20 13:14:49 k8s-1-8-1-node1-centos kernel: cni0: port 5(veth228a0f44) entered disabled state
Dec 20 13:14:49 k8s-1-8-1-node1-centos kernel: device veth228a0f44 entered promiscuous mode
Dec 20 13:14:49 k8s-1-8-1-node1-centos kernel: cni0: port 5(veth228a0f44) entered blocking state
Dec 20 13:14:49 k8s-1-8-1-node1-centos kernel: cni0: port 5(veth228a0f44) entered forwarding state
Dec 20 13:14:49 k8s-1-8-1-node1-centos NetworkManager[471]: <info>  [1513775689.4554] device (veth228a0f44): link connected
Dec 20 13:14:49 k8s-1-8-1-node1-centos NetworkManager[471]: <info>  [1513775689.4571] manager: (veth228a0f44): new Veth device (/org/freedesktop/NetworkManager/Devices/16)
Dec 20 13:14:49 k8s-1-8-1-node1-centos kubelet: I1220 13:14:49.840436    5101 kubelet.go:1871] SyncLoop (PLEG): "deploy-heketi-75f9ddb9b6-bf2gl_kube-system(c1954332-e587-11e7-898c-42010a84000c)", event: &pleg.PodLifecycleEvent{ID:"c1954332-e587-11e7-898c-42010a84000c", Type:"ContainerStarted", Data:"f9ed5b8e4142d7298dc37a6cda713762d009c127d095980678db8427aafdf025"}
Dec 20 13:14:51 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:14:51.034932436Z" level=error msg="Handler for GET /v1.26/images/heketi/heketi:latest/json returned error: No such image: heketi/heketi:latest"
Dec 20 13:14:51 k8s-1-8-1-node1-centos kubelet: I1220 13:14:51.035858    5101 provider.go:119] Refreshing cache for provider: *gcp_credentials.dockerConfigKeyProvider
Dec 20 13:14:51 k8s-1-8-1-node1-centos kubelet: I1220 13:14:51.038323    5101 config.go:191] body of failing http response: &{0x7656e0 0xc421df8b00 0x76e930}
Dec 20 13:14:51 k8s-1-8-1-node1-centos kubelet: E1220 13:14:51.038373    5101 metadata.go:142] while reading 'google-dockercfg' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg
Dec 20 13:14:51 k8s-1-8-1-node1-centos kubelet: I1220 13:14:51.038396    5101 provider.go:119] Refreshing cache for provider: *gcp_credentials.dockerConfigUrlKeyProvider
Dec 20 13:14:51 k8s-1-8-1-node1-centos kubelet: I1220 13:14:51.039969    5101 config.go:191] body of failing http response: &{0x7656e0 0xc422230580 0x76e930}
Dec 20 13:14:51 k8s-1-8-1-node1-centos kubelet: E1220 13:14:51.040008    5101 metadata.go:159] while reading 'google-dockercfg-url' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg-url
Dec 20 13:15:48 k8s-1-8-1-node1-centos journal: Runtime journal is using 8.0M (max allowed 743.9M, trying to leave 1.0G free of 7.2G available → current limit 743.9M).
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Initializing cgroup subsys cpuset
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Initializing cgroup subsys cpu
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Initializing cgroup subsys cpuacct
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Linux version 3.10.0-693.11.1.el7.x86_64<EMAIL_ADDRESS>(gcc version 4.8.5 20150623 (Red Hat 4.8.5-16) (GCC) ) #1 SMP Mon Dec 4 23:52:40 UTC 2017
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-693.11.1.el7.x86_64 root=UUID=1fa60645-f538-4c89-b52f-17a8543344ec ro crashkernel=auto console=ttyS0,38400n8
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: e820: BIOS-provided physical RAM map:
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000bfffcfff] usable
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: BIOS-e820: [mem 0x00000000bfffd000-0x00000000bfffffff] reserved
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: BIOS-e820: [mem 0x00000000fffbc000-0x00000000ffffffff] reserved
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: BIOS-e820: [mem 0x0000000100000000-0x00000003ffffffff] usable
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: NX (Execute Disable) protection: active
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: SMBIOS 2.4 present.
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Hypervisor detected: KVM
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: e820: last_pfn = 0x400000 max_arch_pfn = 0x400000000
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: x86 PAT enabled: cpu 0, old 0x70106, new 0x7010600070106
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: e820: last_pfn = 0xbfffd max_arch_pfn = 0x400000000
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: found SMP MP-table at [mem 0x000f32c0-0x000f32cf] mapped at [ffff8800000f32c0]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Using GB pages for direct mapping
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: RAMDISK: [mem 0x36892000-0x37440fff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Early table checksum verification disabled
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: RSDP<PHONE_NUMBER>0f3030 00014 (v00 Google)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: RSDT 00000000bfffdb90 00034 (v01 Google GOOGRSDT 00000001 GOOG 00000001)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: FACP 00000000bfffff00 000F4 (v02 Google GOOGFACP 00000001 GOOG 00000001)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: DSDT 00000000bfffdbd0 017B2 (v01 Google GOOGDSDT 00000001 GOOG 00000001)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: FACS 00000000bffffec0 00040
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: SSDT 00000000bffff4c0 009F2 (v01 Google GOOGSSDT 00000001 GOOG 00000001)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: APIC 00000000bffff3c0 00086 (v01 Google GOOGAPIC 00000001 GOOG 00000001)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: WAET 00000000bffff390 00028 (v01 Google GOOGWAET 00000001 GOOG 00000001)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: No NUMA configuration found
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Faking a node at [mem 0x0000000000000000-0x00000003ffffffff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: NODE_DATA(0) allocated [mem 0x3fffd7000-0x3ffffdfff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Reserving 161MB of memory at 704MB for crashkernel (System RAM: 15359MB)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: kvm-clock: Using msrs 4b564d01 and 4b564d00
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: kvm-clock: cpu 0, msr 3:fff87001, primary cpu clock
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: kvm-clock: using sched offset of<PHONE_NUMBER> cycles
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Zone ranges:
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel:  DMA      [mem 0x00001000-0x00ffffff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel:  DMA32    [mem 0x01000000-0xffffffff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel:  Normal   [mem 0x100000000-0x3ffffffff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Movable zone start for each node
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Early memory node ranges
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel:  node   0: [mem 0x00001000-0x0009efff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel:  node   0: [mem 0x00100000-0xbfffcfff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel:  node   0: [mem 0x100000000-0x3ffffffff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Initmem setup node 0 [mem 0x00001000-0x3ffffffff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: PM-Timer IO Port: 0xb008
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Using ACPI (MADT) for SMP configuration information
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: smpboot: Allowing 4 CPUs, 0 hotplug CPUs
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: PM: Registered nosave memory: [mem 0x000a0000-0x000effff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: PM: Registered nosave memory: [mem 0x000f0000-0x000fffff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: PM: Registered nosave memory: [mem 0xbfffd000-0xbfffffff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: PM: Registered nosave memory: [mem 0xc0000000-0xfffbbfff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: PM: Registered nosave memory: [mem 0xfffbc000-0xffffffff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: e820: [mem 0xc0000000-0xfffbbfff] available for PCI devices
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Booting paravirtualized kernel on KVM
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: setup_percpu: NR_CPUS:5120 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: PERCPU: Embedded 33 pages/cpu @ffff8803ffc00000 s97048 r8192 d29928 u524288
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 3870598
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Policy zone: Normal
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-693.11.1.el7.x86_64 root=UUID=1fa60645-f538-4c89-b52f-17a8543344ec ro crashkernel=auto console=ttyS0,38400n8
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: PID hash table entries: 4096 (order: 3, 32768 bytes)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Memory: 4983656k/16777216k available (6886k kernel code, 1048980k absent, 506332k reserved, 4545k data, 1764k init)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Hierarchical RCU implementation.
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: #011RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=4.
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: NR_IRQS:327936 nr_irqs:456 0
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Console: colour *CGA 80x25
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: console [ttyS0] enabled
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: allocated 62914560 bytes of page_cgroup
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: please try 'cgroup_disable=memory' option if you don't want memory cgroups
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: tsc: Detected 2500.000 MHz processor
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Calibrating delay loop (skipped) preset value.. 5000.00 BogoMIPS (lpj=2500000)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: pid_max: default: 32768 minimum: 301
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Security Framework initialized
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: SELinux:  Initializing.
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Yama: becoming mindful.

Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ..TIMER: vector=0x30 apic1=0 pin1=0 apic2=-1 pin2=-1
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: smpboot: CPU0: Intel(R) Xeon(R) CPU @ 2.50GHz (fam: 06, model: 3e, stepping: 04)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Performance Events: unsupported p6 CPU model 62 no PMU driver, software events only.
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: kvm-clock: cpu 1, msr 3:fff87041, secondary cpu clock
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: kvm-clock: cpu 2, msr 3:fff87081, secondary cpu clock
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: smpboot: Booting Node   0, Processors  #1 #2 #3 OK
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: kvm-clock: cpu 3, msr 3:fff870c1, secondary cpu clock
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Brought up 4 CPUs
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: smpboot: Total of 4 processors activated (20000.00 BogoMIPS)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: node 0 initialised, 2559562 pages in 50ms
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: devtmpfs: initialized
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: EVM: security.selinux
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: EVM: security.ima
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: EVM: security.capability
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: atomic64 test passed for x86-64 platform with CX8 and with SSE
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: pinctrl core: initialized pinctrl subsystem
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: RTC time: 13:15:48, date: 12/20/17
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: NET: Registered protocol family 16
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: bus type PCI registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: PCI: Using configuration type 1 for base access
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: Added _OSI(Module Device)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: Added _OSI(Processor Device)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: Added _OSI(3.0 _SCP Extensions)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: Added _OSI(Processor Aggregator Device)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: Executed 2 blocks of module-level executable AML code
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: Interpreter enabled
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: (supports S0 S3 S4 S5)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: Using IOAPIC for interrupt routing
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: PCI host bridge to bus 0000:00
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: pci_bus 0000:00: root bus resource [bus 00-ff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: PCI Interrupt Link [LNKS] (IRQs *9)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: Enabled 16 GPEs in block 00 to 0F
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: vgaarb: loaded
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: SCSI subsystem initialized
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: bus type USB registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: usbcore: registered new interface driver usbfs
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: usbcore: registered new interface driver hub
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: usbcore: registered new device driver usb
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: PCI: Using ACPI for IRQ routing
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: NetLabel: Initializing
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: NetLabel:  domain hash size = 128
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: NetLabel:  protocols = UNLABELED CIPSOv4
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: NetLabel:  unlabeled traffic allowed by default
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: amd_nb: Cannot enumerate AMD northbridges
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Switched to clocksource kvm-clock
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: pnp: PnP ACPI init
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: bus type PNP registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: pnp: PnP ACPI: found 7 devices
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: bus type PNP unregistered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: NET: Registered protocol family 2
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: TCP: Hash tables configured (established 131072 bind 65536)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: TCP: reno registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: UDP hash table entries: 8192 (order: 6, 262144 bytes)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: NET: Registered protocol family 1
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: pci 0000:00:00.0: Limiting direct PCI/PCI transfers
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Unpacking initramfs...
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Freeing initrd memory: 11964k freed
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: software IO TLB [mem 0xbbffd000-0xbfffd000] (64MB) mapped at [ffff8800bbffd000-ffff8800bfffcfff]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters,<PHONE_NUMBER>0 ms ovfl timer
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: RAPL PMU: hw unit of domain pp0-core 2^-0 Joules
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: RAPL PMU: hw unit of domain package 2^-0 Joules
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: RAPL PMU: hw unit of domain dram 2^-0 Joules
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: sha1_ssse3: Using AVX optimized SHA-1 implementation
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: sha256_ssse3: Using AVX optimized SHA-256 implementation
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: futex hash table entries: 1024 (order: 4, 65536 bytes)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Initialise system trusted keyring
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: audit: initializing netlink socket (disabled)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: type=2000 audit(1513775748.351:1): initialized
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: HugeTLB registered 1 GB page size, pre-allocated 0 pages
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: HugeTLB registered 2 MB page size, pre-allocated 0 pages
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: zpool: loaded
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: zbud: loaded
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: VFS: Disk quotas dquot_6.5.2
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: msgmni has been set to 29753
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Key type big_key registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: NET: Registered protocol family 38
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Key type asymmetric registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Asymmetric key parser 'x509' registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: io scheduler noop registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: io scheduler deadline registered (default)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: io scheduler cfq registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: pciehp: PCI Express Hot Plug Controller Driver version: 0.4
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: Power Button [PWRF]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input1
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: Sleep Button [SLPF]
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: GHES: HEST is not enabled!
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: 00:05: ttyS2 at I/O 0x3e8 (irq = 6) is a 16550A
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: 00:06: ttyS3 at I/O 0x2e8 (irq = 7) is a 16550A
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Non-volatile memory driver v1.3
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Linux agpgart interface v0.103
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: crash memory driver: version 1.1
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: rdac: device handler registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: hp_sw: device handler registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: emc: device handler registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: alua: device handler registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: libphy: Fixed MDIO Bus: probed
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ehci-pci: EHCI PCI platform driver
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ohci-pci: OHCI PCI platform driver
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: uhci_hcd: USB Universal Host Controller Interface driver
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: usbcore: registered new interface driver usbserial
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: usbcore: registered new interface driver usbserial_generic
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: usbserial: USB Serial support registered for generic
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: i8042: Warning: Keylock active
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: serio: i8042 KBD port at 0x60,0x64 irq 1
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: serio: i8042 AUX port at 0x60,0x64 irq 12
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: mousedev: PS/2 mouse device common for all mice
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: rtc_cmos 00:00: RTC can wake from S4
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: rtc_cmos 00:00: alarms up to one day, 114 bytes nvram
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: cpuidle: using governor menu
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: hidraw: raw HID events driver (C) Jiri Kosina
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: usbcore: registered new interface driver usbhid
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: usbhid: USB HID core driver
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: drop_monitor: Initializing network drop monitor service
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: TCP: cubic registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Initializing XFRM netlink socket
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: NET: Registered protocol family 10
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: NET: Registered protocol family 17
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: microcode: CPU0 sig=0x306e4, pf=0x1, revision=0x1
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: microcode: CPU1 sig=0x306e4, pf=0x1, revision=0x1
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: microcode: CPU2 sig=0x306e4, pf=0x1, revision=0x1
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: microcode: CPU3 sig=0x306e4, pf=0x1, revision=0x1
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: microcode: Microcode Update Driver: v2.01<EMAIL_ADDRESS>Peter Oruba
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Loading compiled-in X.509 certificates
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717'
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b'
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Loaded X.509 cert 'CentOS Linux kernel signing key: 61b8e87b841184f62f80d60779ab692a49d83baf'
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: registered taskstats version 1
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Key type trusted registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Key type encrypted registered
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: IMA: No TPM chip found, activating TPM-bypass!
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel:  Magic number: 13:637:281
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: tty tty18: hash matches
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: rtc_cmos 00:00: setting system clock to 2017-12-20 13:15:48 UTC<PHONE_NUMBER>)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: Freeing unused kernel memory: 1764k freed
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: random: systemd: uninitialized urandom read (16 bytes read)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: random: systemd: uninitialized urandom read (16 bytes read)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: random: systemd: uninitialized urandom read (16 bytes read)
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Detected virtualization kvm.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Detected architecture x86-64.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Running in initial RAM disk.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Set hostname to <localhost>.
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: random: systemd: uninitialized urandom read (16 bytes read)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: random: systemd: uninitialized urandom read (16 bytes read)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: random: systemd: uninitialized urandom read (16 bytes read)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: random: systemd: uninitialized urandom read (16 bytes read)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: random: systemd: uninitialized urandom read (16 bytes read)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: random: systemd: uninitialized urandom read (16 bytes read)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: random: systemd: uninitialized urandom read (16 bytes read)
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Reached target Local File Systems.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting Local File Systems.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Reached target Timers.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting Timers.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Created slice Root Slice.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting Root Slice.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Listening on udev Control Socket.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting udev Control Socket.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Created slice System Slice.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting System Slice.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Reached target Slices.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting Slices.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Listening on Journal Socket.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting Journal Socket.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting Journal Service...
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting Apply Kernel Variables...
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting Setup Virtual Console...
Dec 20 13:15:48 k8s-1-8-1-node1-centos journal: Journal started
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd-vconsole-setup: putfont: PIO_FONT trying ...
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting Create list of required static device nodes for the current kernel...
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Reached target Swap.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting Swap.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Listening on udev Kernel Socket.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting udev Kernel Socket.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Reached target Sockets.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Starting Sockets.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd[1]: Started Journal Service.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd: Started Apply Kernel Variables.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd: Started Create list of required static device nodes for the current kernel.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd: Starting Create Static Device Nodes in /dev...
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd: Started Create Static Device Nodes in /dev.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd: Starting udev Kernel Device Manager...
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd-udevd: starting version 219
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd: Started udev Kernel Device Manager.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd: Starting udev Coldplug all Devices...
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd: Mounting Configuration File System...
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input2
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd: Started udev Coldplug all Devices.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd: Mounted Configuration File System.
Dec 20 13:15:48 k8s-1-8-1-node1-centos systemd: Starting dracut initqueue hook...
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: virtio-pci 0000:00:03.0: virtio_pci: leaving for legacy driver
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 10
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: virtio-pci 0000:00:04.0: virtio_pci: leaving for legacy driver
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: scsi host0: Virtio SCSI HBA
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: scsi 0:0:1:0: Direct-Access     Google   PersistentDisk   1    PQ: 0 ANSI: 6
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: random: fast init done
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: scsi 0:0:2:0: Direct-Access     Google   PersistentDisk   1    PQ: 0 ANSI: 6
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: sd 0:0:1:0: [sda] 20971520 512-byte logical blocks: (10.7 GB/10.0 GiB)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: sd 0:0:1:0: [sda] 4096-byte physical blocks
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: sd 0:0:2:0: [sdb]<PHONE_NUMBER> 512-byte logical blocks: (536 GB/500 GiB)
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: sd 0:0:2:0: [sdb] 4096-byte physical blocks
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: sd 0:0:2:0: [sdb] Write Protect is off
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: sd 0:0:1:0: [sda] Write Protect is off
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: sd 0:0:1:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: sda: sda1
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: sd 0:0:1:0: [sda] Attached SCSI disk
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: sd 0:0:2:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: sd 0:0:2:0: [sdb] Attached SCSI disk
Dec 20 13:15:48 k8s-1-8-1-node1-centos kernel: psmouse serio1: alps: Unknown ALPS touchpad: E7=10 00 64, EC=10 00 64
Dec 20 13:15:49 k8s-1-8-1-node1-centos systemd: Found device PersistentDisk /.
Dec 20 13:15:49 k8s-1-8-1-node1-centos systemd: Starting File System Check on /dev/disk/by-uuid/1fa60645-f538-4c89-b52f-17a8543344ec...
Dec 20 13:15:49 k8s-1-8-1-node1-centos systemd-fsck: /sbin/fsck.xfs: XFS file system.
Dec 20 13:15:49 k8s-1-8-1-node1-centos systemd: Started File System Check on /dev/disk/by-uuid/1fa60645-f538-4c89-b52f-17a8543344ec.
Dec 20 13:15:49 k8s-1-8-1-node1-centos kernel: input: ImPS/2 Generic Wheel Mouse as /devices/platform/i8042/serio1/input/input3
Dec 20 13:15:49 k8s-1-8-1-node1-centos kernel: tsc: Refined TSC clocksource calibration: 2500.000 MHz
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd-vconsole-setup: ...................
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd-vconsole-setup: setfont: putfont: 512,8x16:  failed: -1
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd-vconsole-setup: putfont: PIO_FONT: Invalid argument
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd-vconsole-setup: /usr/bin/setfont failed with error code 71.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Started Setup Virtual Console.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Starting Show Plymouth Boot Screen...
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Reached target System Initialization.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Starting System Initialization.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Received SIGRTMIN+20 from PID 179 (plymouthd).
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Started Show Plymouth Boot Screen.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Reached target Paths.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Starting Paths.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Started Forward Password Requests to Plymouth Directory Watch.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Starting Forward Password Requests to Plymouth Directory Watch.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Reached target Basic System.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Starting Basic System.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd-vconsole-setup: /usr/bin/setfont failed with error code 71.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Started dracut initqueue hook.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Mounting /sysroot...
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Reached target Remote File Systems (Pre).
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Starting Remote File Systems (Pre).
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Reached target Remote File Systems.
Dec 20 13:15:53 k8s-1-8-1-node1-centos systemd: Starting Remote File Systems.
Dec 20 13:15:54 k8s-1-8-1-node1-centos kernel: SGI XFS with ACLs, security attributes, no debug enabled
Dec 20 13:15:54 k8s-1-8-1-node1-centos kernel: XFS (sda1): Mounting V5 Filesystem
Dec 20 13:15:54 k8s-1-8-1-node1-centos kernel: XFS (sda1): Starting recovery (logdev: internal)
Dec 20 13:15:54 k8s-1-8-1-node1-centos kernel: random: crng init done
Dec 20 13:15:56 k8s-1-8-1-node1-centos kernel: XFS (sda1): Ending recovery (logdev: internal)
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Mounted /sysroot.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Reached target Initrd Root File System.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Starting Initrd Root File System.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Starting Reload Configuration from the Real Root...
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Reloading.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Started Reload Configuration from the Real Root.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Reached target Initrd File Systems.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Starting Initrd File Systems.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Reached target Initrd Default Target.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Starting Initrd Default Target.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Starting dracut pre-pivot and cleanup hook...
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Started dracut pre-pivot and cleanup hook.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Starting Cleaning Up and Shutting Down Daemons...
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped target Timers.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping Timers.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Starting Plymouth switch root service...
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped Cleaning Up and Shutting Down Daemons.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped dracut pre-pivot and cleanup hook.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping dracut pre-pivot and cleanup hook...
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped target Initrd Default Target.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping Initrd Default Target.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped target Basic System.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping Basic System.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped target Sockets.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping Sockets.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped target Slices.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping Slices.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped target System Initialization.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping System Initialization.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped Apply Kernel Variables.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping Apply Kernel Variables...
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping udev Kernel Device Manager...
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped target Local File Systems.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping Local File Systems.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped target Swap.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping Swap.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped target Paths.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping Paths.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped target Remote File Systems.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping Remote File Systems.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped target Remote File Systems (Pre).
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping Remote File Systems (Pre).
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped dracut initqueue hook.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping dracut initqueue hook...
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped udev Coldplug all Devices.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping udev Coldplug all Devices...
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped udev Kernel Device Manager.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped Create Static Device Nodes in /dev.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping Create Static Device Nodes in /dev...
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopped Create list of required static device nodes for the current kernel.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping Create list of required static device nodes for the current kernel...
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Closed udev Control Socket.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping udev Control Socket.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Closed udev Kernel Socket.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Stopping udev Kernel Socket.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Starting Cleanup udevd DB...
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Started Cleanup udevd DB.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Reached target Switch Root.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Starting Switch Root.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Started Plymouth switch root service.
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Starting Switch Root...
Dec 20 13:15:56 k8s-1-8-1-node1-centos systemd: Switching root.
Dec 20 13:15:56 k8s-1-8-1-node1-centos journal: Journal stopped
Dec 20 13:15:58 k8s-1-8-1-node1-centos journal: Runtime journal is using 8.0M (max allowed 743.9M, trying to leave 1.0G free of 7.2G available → current limit 743.9M).
Dec 20 13:15:59 k8s-1-8-1-node1-centos journal: Runtime journal is using 8.0M (max allowed 743.9M, trying to leave 1.0G free of 7.2G available → current limit 743.9M).
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd-journald[104]: Received SIGTERM from PID 1 (systemd).
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: type=1403 audit(1513775757.154:2): policy loaded auid=4294967295 ses=4294967295
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd[1]: Successfully loaded SELinux policy in 410.402ms.
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: ip_tables: (C) 2000-2006 Netfilter Core Team
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd[1]: Inserted module 'ip_tables'
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd[1]: Relabelled /dev and /run in 14.089ms.
Dec 20 13:15:59 k8s-1-8-1-node1-centos journal: Journal started
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: device-mapper: uevent: version 1.0.3
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised<EMAIL_ADDRESS>Dec 20 13:15:59 k8s-1-8-1-node1-centos journal: Runtime journal is using 8.0M (max allowed 743.9M, trying to leave 1.0G free of 7.2G available → current limit 743.9M).
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Detected virtualization kvm.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Detected architecture x86-64.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Set hostname to <k8s-1-8-1-node1-centos>.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Cannot add dependency job for unit docker.socket, ignoring: Unit not found.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Cannot add dependency job for unit docker-storage-setup.service, ignoring: Unit not found.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Starting Flush Journal to Persistent Storage...
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Started Load/Save Random Seed.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd-modules-load: Inserted module 'dm_thin_pool'
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd-modules-load: Inserted module 'dm_snapshot'
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Started Flush Journal to Persistent Storage.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd-modules-load: Inserted module 'dm_mirror'
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Started udev Coldplug all Devices.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Starting udev Wait for Complete Device Initialization...
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd-modules-load: Inserted module 'br_netfilter'
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: Bridge firewalling registered
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Started Load Kernel Modules.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Starting Apply Kernel Variables...
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Started Configure read-only root support.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Started Apply Kernel Variables.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Started Create Static Device Nodes in /dev.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Starting udev Kernel Device Manager...
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd-udevd: starting version 219
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Started udev Kernel Device Manager.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Found device /dev/ttyS0.
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: AES CTR mode by8 optimization enabled
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: alg: No test for crc32 (crc32-pclmul)
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: EDAC MC: Ver: 3.0.0
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: EDAC sbridge:  Ver: 1.1.1
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: input: PC Speaker as /devices/platform/pcspkr/input/input4
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: piix4_smbus 0000:00:01.3: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: sd 0:0:1:0: Attached scsi generic sg0 type 0
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: sd 0:0:2:0: Attached scsi generic sg1 type 0
Dec 20 13:15:59 k8s-1-8-1-node1-centos kernel: ppdev: user-space parallel port driver
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Created slice system-lvm2\x2dpvscan.slice.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Starting system-lvm2\x2dpvscan.slice.
Dec 20 13:15:59 k8s-1-8-1-node1-centos systemd: Starting LVM2 PV scan on device 8:16...
Dec 20 13:16:00 k8s-1-8-1-node1-centos systemd: Started LVM2 PV scan on device 8:16.
Dec 20 13:16:04 k8s-1-8-1-node1-centos systemd-vconsole-setup: /usr/bin/setfont failed with error code 71.
Dec 20 13:16:04 k8s-1-8-1-node1-centos systemd: Started udev Wait for Complete Device Initialization.
Dec 20 13:16:04 k8s-1-8-1-node1-centos systemd: Starting Activation of LVM2 logical volumes...
Dec 20 13:16:05 k8s-1-8-1-node1-centos lvm: 1 logical volume(s) in volume group "vg_0fa25aac6d5431d39ec107677e8dff72" now active
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Started Activation of LVM2 logical volumes.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Reached target Encrypted Volumes.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Encrypted Volumes.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Activation of LVM2 logical volumes...
Dec 20 13:16:05 k8s-1-8-1-node1-centos lvm: 1 logical volume(s) in volume group "vg_0fa25aac6d5431d39ec107677e8dff72" now active
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Started Activation of LVM2 logical volumes.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
Dec 20 13:16:05 k8s-1-8-1-node1-centos lvm: 1 logical volume(s) in volume group "vg_0fa25aac6d5431d39ec107677e8dff72" monitored
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Reached target Local File Systems (Pre).
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Local File Systems (Pre).
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Reached target Local File Systems.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Local File Systems.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Create Volatile Files and Directories...
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Tell Plymouth To Write Out Runtime Data...
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Started Tell Plymouth To Write Out Runtime Data.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Started Create Volatile Files and Directories.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Security Auditing Service...
Dec 20 13:16:05 k8s-1-8-1-node1-centos auditd[380]: Started dispatcher: /sbin/audispd pid: 382
Dec 20 13:16:05 k8s-1-8-1-node1-centos audispd: No plugins found, exiting
Dec 20 13:16:05 k8s-1-8-1-node1-centos auditd[380]: dispatcher 382 reaped
Dec 20 13:16:05 k8s-1-8-1-node1-centos kernel: type=1305 audit(1513775765.616:3): audit_pid=380 old=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:auditd_t:s0 res=1
Dec 20 13:16:05 k8s-1-8-1-node1-centos auditd[380]: Init complete, auditd 2.7.6 listening for events (startup state enable)
Dec 20 13:16:05 k8s-1-8-1-node1-centos augenrules: /sbin/augenrules: No change
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Started Security Auditing Service.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Update UTMP about System Boot/Shutdown...
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Started Update UTMP about System Boot/Shutdown.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Reached target System Initialization.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting System Initialization.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Started Daily Cleanup of Temporary Directories.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Daily Cleanup of Temporary Directories.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Reached target Timers.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Timers.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Started Flexible branding.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Flexible branding.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Reached target Paths.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Paths.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Listening on D-Bus System Message Bus Socket.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting D-Bus System Message Bus Socket.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Reached target Sockets.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Sockets.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Reached target Basic System.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Basic System.
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Dump dmesg to /var/log/dmesg...
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting NTP client/server...
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Run automatic yum updates as a cron job...
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Disk expand for EL7...
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting Permit User Sessions...
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting System Logging Service...
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Starting ACPI Event Daemon...
Dec 20 13:16:05 k8s-1-8-1-node1-centos systemd: Started D-Bus System Message Bus.
Dec 20 13:16:05 k8s-1-8-1-node1-centos chronyd[411]: chronyd version 3.1 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SECHASH +SIGND +ASYNCDNS +IPV6 +DEBUG)
Dec 20 13:16:05 k8s-1-8-1-node1-centos acpid: starting up with netlink and the input layer
Dec 20 13:16:05 k8s-1-8-1-node1-centos chronyd[411]: commandkey directive is no longer supported
Dec 20 13:16:05 k8s-1-8-1-node1-centos chronyd[411]: generatecommandkey directive is no longer supported
Dec 20 13:16:06 k8s-1-8-1-node1-centos acpid: skipping incomplete file /etc/acpi/events/videoconf
Dec 20 13:16:06 k8s-1-8-1-node1-centos acpid: 1 rule loaded
Dec 20 13:16:06 k8s-1-8-1-node1-centos acpid: waiting for events: event logging is off
Dec 20 13:16:06 k8s-1-8-1-node1-centos chronyd[411]: Frequency -0.126 +/- 0.014 ppm read from /var/lib/chrony/drift
Dec 20 13:16:06 k8s-1-8-1-node1-centos growpart: NOCHANGE: partition 1 could only be grown by -6695 [fudge=20480]
Dec 20 13:16:06 k8s-1-8-1-node1-centos rsyslogd: [origin software="rsyslogd" swVersion="8.24.0" x-pid="405" x-info="http://www.rsyslog.com"] start
Dec 20 13:16:06 k8s-1-8-1-node1-centos rsyslogd: imjournal: fscanf on state file `/var/lib/rsyslog/imjournal.state' failed  [v8.24.0 try http://www.rsyslog.com/e/2027 ]
Dec 20 13:16:06 k8s-1-8-1-node1-centos rsyslogd: imjournal: ignoring invalid state file [v8.24.0]
Dec 20 13:16:06 k8s-1-8-1-node1-centos systemd: Starting D-Bus System Message Bus...
Dec 20 13:16:06 k8s-1-8-1-node1-centos systemd: Starting Login Service...
Dec 20 13:16:06 k8s-1-8-1-node1-centos systemd: Starting Authorization Manager...
Dec 20 13:16:06 k8s-1-8-1-node1-centos systemd: Started System Logging Service.
Dec 20 13:16:06 k8s-1-8-1-node1-centos systemd: Started Dump dmesg to /var/log/dmesg.
Dec 20 13:16:06 k8s-1-8-1-node1-centos polkitd[445]: Started polkitd version 0.112
Dec 20 13:16:07 k8s-1-8-1-node1-centos systemd: Started Run automatic yum updates as a cron job.
Dec 20 13:16:07 k8s-1-8-1-node1-centos expand-root: meta-data=/dev/sda1              isize=512    agcount=4, agsize=655296 blks
Dec 20 13:16:07 k8s-1-8-1-node1-centos expand-root: =                       sectsz=4096  attr=2, projid32bit=1
Dec 20 13:16:07 k8s-1-8-1-node1-centos expand-root: =                       crc=1        finobt=0 spinodes=0
Dec 20 13:16:07 k8s-1-8-1-node1-centos expand-root: data     =                       bsize=4096   blocks=2621184, imaxpct=25
Dec 20 13:16:07 k8s-1-8-1-node1-centos expand-root: =                       sunit=0      swidth=0 blks
Dec 20 13:16:07 k8s-1-8-1-node1-centos expand-root: naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
Dec 20 13:16:07 k8s-1-8-1-node1-centos expand-root: log      =internal               bsize=4096   blocks=2560, version=2
Dec 20 13:16:07 k8s-1-8-1-node1-centos expand-root: =                       sectsz=4096  sunit=1 blks, lazy-count=1
Dec 20 13:16:07 k8s-1-8-1-node1-centos expand-root: realtime =none                   extsz=4096   blocks=0, rtextents=0
Dec 20 13:16:08 k8s-1-8-1-node1-centos systemd: Started Permit User Sessions.
Dec 20 13:16:10 k8s-1-8-1-node1-centos systemd: Started ACPI Event Daemon.
Dec 20 13:16:10 k8s-1-8-1-node1-centos systemd: Started NTP client/server.
Dec 20 13:16:10 k8s-1-8-1-node1-centos systemd: Started Disk expand for EL7.
Dec 20 13:16:10 k8s-1-8-1-node1-centos systemd: Started Authorization Manager.
Dec 20 13:16:10 k8s-1-8-1-node1-centos systemd-logind: Watching system buttons on /dev/input/event0 (Power Button)
Dec 20 13:16:10 k8s-1-8-1-node1-centos systemd-logind: Watching system buttons on /dev/input/event1 (Sleep Button)
Dec 20 13:16:10 k8s-1-8-1-node1-centos systemd: Starting firewalld - dynamic firewall daemon...
Dec 20 13:16:10 k8s-1-8-1-node1-centos systemd-logind: New seat seat0.
Dec 20 13:16:10 k8s-1-8-1-node1-centos systemd: Started Command Scheduler.
Dec 20 13:16:10 k8s-1-8-1-node1-centos systemd: Starting Command Scheduler...
Dec 20 13:16:10 k8s-1-8-1-node1-centos systemd: Starting Wait for Plymouth Boot Screen to Quit...
Dec 20 13:16:10 k8s-1-8-1-node1-centos systemd: Starting Terminate Plymouth Boot Screen...
Dec 20 13:16:10 k8s-1-8-1-node1-centos systemd: Started Login Service.
Dec 20 13:16:11 k8s-1-8-1-node1-centos systemd: Received SIGRTMIN+21 from PID 179 (plymouthd).
Dec 20 13:16:11 k8s-1-8-1-node1-centos systemd: Started Wait for Plymouth Boot Screen to Quit.
Dec 20 13:16:11 k8s-1-8-1-node1-centos systemd: Started Terminate Plymouth Boot Screen.
Dec 20 13:16:11 k8s-1-8-1-node1-centos systemd: Started Serial Getty on ttyS0.
Dec 20 13:16:11 k8s-1-8-1-node1-centos systemd: Starting Serial Getty on ttyS0...
Dec 20 13:16:11 k8s-1-8-1-node1-centos systemd: Started Getty on tty1.
Dec 20 13:16:11 k8s-1-8-1-node1-centos systemd: Starting Getty on tty1...
Dec 20 13:16:11 k8s-1-8-1-node1-centos systemd: Reached target Login Prompts.
Dec 20 13:16:11 k8s-1-8-1-node1-centos systemd: Starting Login Prompts.
Dec 20 13:16:12 k8s-1-8-1-node1-centos systemd: Started firewalld - dynamic firewall daemon.
Dec 20 13:16:12 k8s-1-8-1-node1-centos systemd: Reached target Network (Pre).
Dec 20 13:16:12 k8s-1-8-1-node1-centos systemd: Starting Network (Pre).
Dec 20 13:16:12 k8s-1-8-1-node1-centos systemd: Starting Network Manager...
Dec 20 13:16:12 k8s-1-8-1-node1-centos kernel: ip6_tables: (C) 2000-2006 Netfilter Core Team
Dec 20 13:16:12 k8s-1-8-1-node1-centos kernel: Ebtables v2.0 registered
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.3054] NetworkManager (version 1.8.0-11.el7_4) is starting... (for the first time)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.3064] Read config: /etc/NetworkManager/NetworkManager.conf (lib: 10-slaves-order.conf)
Dec 20 13:16:12 k8s-1-8-1-node1-centos kernel: nf_conntrack version 0.5.0 (65536 buckets, 262144 max)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.3410] manager[0x55e06d5cf0c0]: monitoring kernel firmware directory '/lib/firmware'.
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.3439] policy: hostname management mode: default
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.3446] dns-mgr[0x55e06d5d7950]: init: dns=default, rc-manager=file
Dec 20 13:16:12 k8s-1-8-1-node1-centos systemd: Started Network Manager.
Dec 20 13:16:12 k8s-1-8-1-node1-centos systemd: Starting Network Manager Wait Online...
Dec 20 13:16:12 k8s-1-8-1-node1-centos dbus-daemon: dbus[407]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service'
Dec 20 13:16:12 k8s-1-8-1-node1-centos dbus[407]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service'
Dec 20 13:16:12 k8s-1-8-1-node1-centos systemd: Starting Network Manager Script Dispatcher Service...
Dec 20 13:16:12 k8s-1-8-1-node1-centos dbus-daemon: dbus[407]: [system] Successfully activated service 'org.freedesktop.nm_dispatcher'
Dec 20 13:16:12 k8s-1-8-1-node1-centos dbus[407]: [system] Successfully activated service 'org.freedesktop.nm_dispatcher'
Dec 20 13:16:12 k8s-1-8-1-node1-centos systemd: Started Network Manager Script Dispatcher Service.
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.3773] settings: loaded plugin ifcfg-rh: (c) 2007 - 2015 Red Hat, Inc.  To report bugs please use the NetworkManager mailing list. (/usr/lib64/NetworkManager/libnm-settings-plugin-ifcfg-rh.so)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.3793] settings: loaded plugin iBFT: (c) 2014 Red Hat, Inc.  To report bugs please use the NetworkManager mailing list. (/usr/lib64/NetworkManager/libnm-settings-plugin-ibft.so)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.3794] settings: loaded plugin keyfile: (c) 2007 - 2016 Red Hat, Inc.  To report bugs please use the NetworkManager mailing list.
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.4088] ifcfg-rh: new connection /etc/sysconfig/network-scripts/ifcfg-eth0 (89930db4-584b-46b9-a518-72e150d69467,"System eth0")
Dec 20 13:16:12 k8s-1-8-1-node1-centos dbus-daemon: dbus[407]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
Dec 20 13:16:12 k8s-1-8-1-node1-centos dbus[407]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
Dec 20 13:16:12 k8s-1-8-1-node1-centos systemd: Starting Hostname Service...
Dec 20 13:16:12 k8s-1-8-1-node1-centos dbus[407]: [system] Successfully activated service 'org.freedesktop.hostname1'
Dec 20 13:16:12 k8s-1-8-1-node1-centos dbus-daemon: dbus[407]: [system] Successfully activated service 'org.freedesktop.hostname1'
Dec 20 13:16:12 k8s-1-8-1-node1-centos systemd: Started Hostname Service.
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5164] settings: hostname: using hostnamed
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5166] settings: hostname changed from (none) to "k8s-1-8-1-node1-centos"
Dec 20 13:16:12 k8s-1-8-1-node1-centos nm-dispatcher: req:1 'hostname': new request (3 scripts)
Dec 20 13:16:12 k8s-1-8-1-node1-centos nm-dispatcher: req:1 'hostname': start running ordered scripts...
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5184] dhcp-init: Using DHCP client 'dhclient'
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5184] manager: rfkill: WiFi enabled by radio killswitch; enabled by state file
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5185] manager: rfkill: WWAN enabled by radio killswitch; enabled by state file
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5185] manager: Networking is enabled by state file
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5202] Loaded device plugin: NMBondDeviceFactory (internal)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5202] Loaded device plugin: NMBridgeDeviceFactory (internal)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5203] Loaded device plugin: NMDummyDeviceFactory (internal)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5203] Loaded device plugin: NMEthernetDeviceFactory (internal)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5203] Loaded device plugin: NMInfinibandDeviceFactory (internal)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5203] Loaded device plugin: NMIPTunnelDeviceFactory (internal)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5203] Loaded device plugin: NMMacsecDeviceFactory (internal)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5217] Loaded device plugin: NMMacvlanDeviceFactory (internal)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5217] Loaded device plugin: NMTunDeviceFactory (internal)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5218] Loaded device plugin: NMVethDeviceFactory (internal)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5218] Loaded device plugin: NMVlanDeviceFactory (internal)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5218] Loaded device plugin: NMVxlanDeviceFactory (internal)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5269] Loaded device plugin: NMTeamFactory (/usr/lib64/NetworkManager/libnm-device-plugin-team.so)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5303] Loaded device plugin: NMWifiFactory (/usr/lib64/NetworkManager/libnm-device-plugin-wifi.so)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5340] device (lo): link connected
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5347] manager: (lo): new Generic device (/org/freedesktop/NetworkManager/Devices/1)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5359] manager: (eth0): new Ethernet device (/org/freedesktop/NetworkManager/Devices/2)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5370] device (eth0): state change: unmanaged -> unavailable (reason 'managed') [10 20 2]
Dec 20 13:16:12 k8s-1-8-1-node1-centos kernel: IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5449] device (eth0): link connected
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5489] device (eth0): state change: unavailable -> disconnected (reason 'none') [20 30 0]
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5494] policy: auto-activating connection 'System eth0'
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5504] device (eth0): Activation: starting connection 'System eth0' (89930db4-584b-46b9-a518-72e150d69467)
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5506] device (eth0): state change: disconnected -> prepare (reason 'none') [30 40 0]
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5507] manager: NetworkManager state is now CONNECTING
Dec 20 13:16:12 k8s-1-8-1-node1-centos kernel: Netfilter messages via NETLINK v0.30.
Dec 20 13:16:12 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775772.5510] device (eth0): state change: prepare -> config (reason 'none') [40 50 0]
Dec 20 13:16:12 k8s-1-8-1-node1-centos kernel: ip_set: protocol 6
Dec 20 13:16:12 k8s-1-8-1-node1-centos firewalld[483]: WARNING: ICMP type 'beyond-scope' is not supported by the kernel for ipv6.
Dec 20 13:16:12 k8s-1-8-1-node1-centos firewalld[483]: WARNING: beyond-scope: INVALID_ICMPTYPE: No supported ICMP type., ignoring for run-time.
Dec 20 13:16:12 k8s-1-8-1-node1-centos firewalld[483]: WARNING: ICMP type 'failed-policy' is not supported by the kernel for ipv6.
Dec 20 13:16:12 k8s-1-8-1-node1-centos firewalld[483]: WARNING: failed-policy: INVALID_ICMPTYPE: No supported ICMP type., ignoring for run-time.
Dec 20 13:16:12 k8s-1-8-1-node1-centos firewalld[483]: WARNING: ICMP type 'reject-route' is not supported by the kernel for ipv6.
Dec 20 13:16:12 k8s-1-8-1-node1-centos firewalld[483]: WARNING: reject-route: INVALID_ICMPTYPE: No supported ICMP type., ignoring for run-time.
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.1762] device (eth0): state change: config -> ip-config (reason 'none') [50 70 0]
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.1780] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.2208] dhcp4 (eth0): dhclient started with pid 622
Dec 20 13:16:13 k8s-1-8-1-node1-centos dhclient[622]: DHCPREQUEST on eth0 to <IP_ADDRESS> port 67 (xid=0x230f821a)
Dec 20 13:16:13 k8s-1-8-1-node1-centos dhclient[622]: DHCPACK from <IP_ADDRESS> (xid=0x230f821a)
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3548] dhcp4 (eth0):   address <IP_ADDRESS>
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3548] dhcp4 (eth0):   plen 32 (<IP_ADDRESS>)
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3549] dhcp4 (eth0):   classless static route <IP_ADDRESS>/32 gw <IP_ADDRESS>
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3549] dhcp4 (eth0):   gateway <IP_ADDRESS>
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3549] dhcp4 (eth0):   lease time 86400
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3549] dhcp4 (eth0):   hostname 'k8s-1-8-1-node1-centos.c.festive-sunbeam-186117.internal'
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3549] dhcp4 (eth0):   nameserver '<IP_ADDRESS>'
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3549] dhcp4 (eth0):   domain name 'c.festive-sunbeam-186117.internal'
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3549] dhcp (eth0):   domain search 'c.festive-sunbeam-186117.internal.'
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3549] dhcp (eth0):   domain search 'google.internal.'
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3549] dhcp4 (eth0): state changed unknown -> bound
Dec 20 13:16:13 k8s-1-8-1-node1-centos dhclient[622]: bound to <IP_ADDRESS> -- renewal in 36990 seconds.
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3567] device (eth0): state change: ip-config -> ip-check (reason 'none') [70 80 0]
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3580] device (eth0): state change: ip-check -> secondaries (reason 'none') [80 90 0]
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3583] device (eth0): state change: secondaries -> activated (reason 'none') [90 100 0]
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3585] manager: NetworkManager state is now CONNECTED_LOCAL
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3651] manager: NetworkManager state is now CONNECTED_SITE
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3652] policy: set 'System eth0' (eth0) as default for IPv4 routing and DNS
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3675] device (eth0): Activation: successful, device activated.
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3689] manager: startup complete
Dec 20 13:16:13 k8s-1-8-1-node1-centos nm-dispatcher: req:2 'up' [eth0]: new request (3 scripts)
Dec 20 13:16:13 k8s-1-8-1-node1-centos nm-dispatcher: req:2 'up' [eth0]: start running ordered scripts...
Dec 20 13:16:13 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775773.3697] manager: NetworkManager state is now CONNECTED_GLOBAL
Dec 20 13:16:13 k8s-1-8-1-node1-centos nm-dispatcher: req:3 'connectivity-change': new request (3 scripts)
Dec 20 13:16:13 k8s-1-8-1-node1-centos systemd: Started Network Manager Wait Online.
Dec 20 13:16:13 k8s-1-8-1-node1-centos systemd: Starting LSB: Bring up/down networking...
Dec 20 13:16:13 k8s-1-8-1-node1-centos nm-dispatcher: req:3 'connectivity-change': start running ordered scripts...
Dec 20 13:16:13 k8s-1-8-1-node1-centos network: Bringing up loopback interface:  [  OK  ]
Dec 20 13:16:13 k8s-1-8-1-node1-centos network: Bringing up interface eth0:  [  OK  ]
Dec 20 13:16:13 k8s-1-8-1-node1-centos systemd: Started LSB: Bring up/down networking.
Dec 20 13:16:13 k8s-1-8-1-node1-centos systemd: Reached target Network.
Dec 20 13:16:13 k8s-1-8-1-node1-centos systemd: Starting Network.
Dec 20 13:16:13 k8s-1-8-1-node1-centos systemd: Starting Dynamic System Tuning Daemon...
Dec 20 13:16:13 k8s-1-8-1-node1-centos systemd: Starting Postfix Mail Transport Agent...
Dec 20 13:16:13 k8s-1-8-1-node1-centos systemd: Starting Docker Application Container Engine...
Dec 20 13:16:13 k8s-1-8-1-node1-centos systemd: Reached target Network is Online.
Dec 20 13:16:13 k8s-1-8-1-node1-centos systemd: Starting Network is Online.
Dec 20 13:16:13 k8s-1-8-1-node1-centos systemd: Starting Google Compute Engine Instance Setup...
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Running set_multiqueue.
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Could not set channels for eth0 to 4.
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Setting /proc/irq/29/smp_affinity_list to 0 for device virtio1.
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO /proc/irq/29/smp_affinity_list: real affinity 0
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Setting /proc/irq/30/smp_affinity_list to 0 for device virtio1.
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO /proc/irq/30/smp_affinity_list: real affinity 0
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Setting /proc/irq/31/smp_affinity_list to 1 for device virtio1.
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO /proc/irq/31/smp_affinity_list: real affinity 1
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Setting /proc/irq/32/smp_affinity_list to 1 for device virtio1.
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO /proc/irq/32/smp_affinity_list: real affinity 1
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Setting /proc/irq/33/smp_affinity_list to 2 for device virtio1.
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO /proc/irq/33/smp_affinity_list: real affinity 2
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Setting /proc/irq/34/smp_affinity_list to 2 for device virtio1.
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO /proc/irq/34/smp_affinity_list: real affinity 2
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Setting /proc/irq/35/smp_affinity_list to 3 for device virtio1.
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO /proc/irq/35/smp_affinity_list: real affinity 3
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Setting /proc/irq/36/smp_affinity_list to 3 for device virtio1.
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO /proc/irq/36/smp_affinity_list: real affinity 3
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Started Dynamic System Tuning Daemon.
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Queue 0 XPS=1 for /sys/class/net/eth0/queues/tx-0/xps_cpus
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Queue 1 XPS=2 for /sys/class/net/eth0/queues/tx-1/xps_cpus
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Queue 2 XPS=4 for /sys/class/net/eth0/queues/tx-2/xps_cpus
Dec 20 13:16:14 k8s-1-8-1-node1-centos instance-setup: INFO Queue 3 XPS=8 for /sys/class/net/eth0/queues/tx-3/xps_cpus
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Started Google Compute Engine Instance Setup.
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Starting OpenSSH server daemon...
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Starting Google Compute Engine Network Setup...
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Started OpenSSH server daemon.
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Started Google Compute Engine Network Setup.
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Started Google Compute Engine Accounts Daemon.
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Starting Google Compute Engine Accounts Daemon...
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Starting Google Compute Engine Startup Scripts...
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Starting Google Compute Engine Shutdown Scripts...
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Started Google Compute Engine Clock Skew Daemon.
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Starting Google Compute Engine Clock Skew Daemon...
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Started Google Compute Engine IP Forwarding Daemon.
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Starting Google Compute Engine IP Forwarding Daemon...
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Started Google Compute Engine Shutdown Scripts.
Dec 20 13:16:14 k8s-1-8-1-node1-centos google-clock-skew: INFO Starting Google Clock Skew daemon.
Dec 20 13:16:14 k8s-1-8-1-node1-centos google-clock-skew: INFO Clock drift token has changed: 0.
Dec 20 13:16:14 k8s-1-8-1-node1-centos startup-script: INFO Starting startup scripts.
Dec 20 13:16:14 k8s-1-8-1-node1-centos startup-script: INFO No startup scripts found in metadata.
Dec 20 13:16:14 k8s-1-8-1-node1-centos startup-script: INFO Finished running startup scripts.
Dec 20 13:16:14 k8s-1-8-1-node1-centos google-ip-forwarding: INFO Starting Google IP Forwarding daemon.
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Started Google Compute Engine Startup Scripts.
Dec 20 13:16:14 k8s-1-8-1-node1-centos google-accounts: INFO Starting Google Accounts daemon.
Dec 20 13:16:14 k8s-1-8-1-node1-centos systemd: Started Postfix Mail Transport Agent.
Dec 20 13:16:14 k8s-1-8-1-node1-centos docker: Command "daemon" is deprecated, and will be removed in Docker 1.16. Please run `dockerd` directly.
Dec 20 13:16:15 k8s-1-8-1-node1-centos systemd: Time has been changed
Dec 20 13:16:15 k8s-1-8-1-node1-centos google-clock-skew: INFO Synced system time with hardware clock.
Dec 20 13:16:15 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:15.182332794Z" level=info msg="libcontainerd: new containerd process, pid: 1045"
Dec 20 13:16:17 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:17.760384547Z" level=info msg="[graphdriver] using prior storage driver: overlay"
Dec 20 13:16:18 k8s-1-8-1-node1-centos chronyd[411]: Selected source <IP_ADDRESS>
Dec 20 13:16:21 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:21.604530234Z" level=info msg="Graph migration to content-addressability took 0.00 seconds"
Dec 20 13:16:21 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:21.605811428Z" level=info msg="Loading containers: start."
Dec 20 13:16:21 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:21.823031076Z" level=error msg="Failed to load container mount 26c5c1e74ada2746a446155f20a2ec3b4d6f896d4ea8031e94a7253b540e723c: mount does not exist"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.236527300Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (c010e92932f95b29acc252ca3593dc3b0d41220458429e16a868fb9e52512244)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.237205689Z" level=warning msg="libcontainerd: failed to retrieve container c010e92932f95b29acc252ca3593dc3b0d41220458429e16a868fb9e52512244 state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.246362294Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (611d9e2649bfb065bd04934a729acb3248ecd1817367e23cdb4bed9bad204563)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.246730880Z" level=warning msg="libcontainerd: failed to retrieve container 611d9e2649bfb065bd04934a729acb3248ecd1817367e23cdb4bed9bad204563 state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.252208630Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (e21986a98ed7a63300584993001c0758dca36f414072f144ec0ba281bbb05531)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.252606079Z" level=warning msg="libcontainerd: failed to retrieve container e21986a98ed7a63300584993001c0758dca36f414072f144ec0ba281bbb05531 state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.257309115Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (c071c1932410931f871ab75a189aa03344020d0f5a2cd422528bfcb0430be361)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.257702931Z" level=warning msg="libcontainerd: failed to retrieve container c071c1932410931f871ab75a189aa03344020d0f5a2cd422528bfcb0430be361 state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.263111290Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (37cd5d91bef45c2a10eaf37af784fd125ed25c1ed1370822e90669f583fcfb50)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.263414133Z" level=warning msg="libcontainerd: failed to retrieve container 37cd5d91bef45c2a10eaf37af784fd125ed25c1ed1370822e90669f583fcfb50 state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.271303326Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (3d54e303497a69792fabc2638ed3050b3c889bca020e8e36a75b351356689501)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.271959896Z" level=warning msg="libcontainerd: failed to retrieve container 3d54e303497a69792fabc2638ed3050b3c889bca020e8e36a75b351356689501 state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.277488427Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (7df64adaa4645b097fdeae601eff7174ca6e2a7516b11b6c297c9edff19aa846)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.277746422Z" level=warning msg="libcontainerd: failed to retrieve container 7df64adaa4645b097fdeae601eff7174ca6e2a7516b11b6c297c9edff19aa846 state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos kernel: TECH PREVIEW: Overlay filesystem may not be fully supported.#012Please review provided documentation for limitations.
Dec 20 13:16:22 k8s-1-8-1-node1-centos kernel: TECH PREVIEW: Overlay filesystem may not be fully supported.#012Please review provided documentation for limitations.
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.297521273Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (cc69a7055e49127967070c13828d2375e9bf74316453bd01657f2b1a39b15818)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.298069345Z" level=warning msg="libcontainerd: failed to retrieve container cc69a7055e49127967070c13828d2375e9bf74316453bd01657f2b1a39b15818 state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.330305667Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (f0b837b798e8a641bfeb06fb43c4006990e0e6b0d2a9656646c741b9b80d6b3d)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.330805525Z" level=warning msg="libcontainerd: failed to retrieve container f0b837b798e8a641bfeb06fb43c4006990e0e6b0d2a9656646c741b9b80d6b3d state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.336360677Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (f9ed5b8e4142d7298dc37a6cda713762d009c127d095980678db8427aafdf025)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.336919350Z" level=warning msg="libcontainerd: failed to retrieve container f9ed5b8e4142d7298dc37a6cda713762d009c127d095980678db8427aafdf025 state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.337077093Z" level=warning msg="failed to cleanup ipc mounts:\nfailed to umount /var/lib/docker/containers/f9ed5b8e4142d7298dc37a6cda713762d009c127d095980678db8427aafdf025/shm: invalid argument"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.345166949Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (27729655e8d90d45f347e345f2dc56522ba2ddaf470fa616186acfbc2f257237)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.345649500Z" level=warning msg="libcontainerd: failed to retrieve container 27729655e8d90d45f347e345f2dc56522ba2ddaf470fa616186acfbc2f257237 state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.345776012Z" level=warning msg="failed to cleanup ipc mounts:\nfailed to umount /var/lib/docker/containers/27729655e8d90d45f347e345f2dc56522ba2ddaf470fa616186acfbc2f257237/shm: invalid argument"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.366990778Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (d95cae8a723b925c67e90bcaa76fa446520f7c5b061a1e0879f4280853b95d70)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.367448514Z" level=warning msg="libcontainerd: failed to retrieve container d95cae8a723b925c67e90bcaa76fa446520f7c5b061a1e0879f4280853b95d70 state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.384056874Z" level=warning msg="failed to cleanup ipc mounts:\nfailed to umount /var/lib/docker/containers/d95cae8a723b925c67e90bcaa76fa446520f7c5b061a1e0879f4280853b95d70/shm: invalid argument"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.389350150Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (38909b8d9208be2cbe27f79a570c1c5cf509664c2441e90f7bd7dad6728e2a3f)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.389742569Z" level=warning msg="libcontainerd: failed to retrieve container 38909b8d9208be2cbe27f79a570c1c5cf509664c2441e90f7bd7dad6728e2a3f state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.389853692Z" level=warning msg="failed to cleanup ipc mounts:\nfailed to umount /var/lib/docker/containers/38909b8d9208be2cbe27f79a570c1c5cf509664c2441e90f7bd7dad6728e2a3f/shm: invalid argument"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.395299648Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (573f1f9cb6427445c134311aea95600d7b25888f1423aa480cf8d9a7ae43eb1f)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.396947325Z" level=warning msg="libcontainerd: failed to retrieve container 573f1f9cb6427445c134311aea95600d7b25888f1423aa480cf8d9a7ae43eb1f state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.397043185Z" level=warning msg="failed to cleanup ipc mounts:\nfailed to umount /var/lib/docker/containers/573f1f9cb6427445c134311aea95600d7b25888f1423aa480cf8d9a7ae43eb1f/shm: invalid argument"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.402317437Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (d61431cfed6ddc205d8411c5e4a50e3489b82cc3cdce66603962655071560d64)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.402594261Z" level=warning msg="libcontainerd: failed to retrieve container d61431cfed6ddc205d8411c5e4a50e3489b82cc3cdce66603962655071560d64 state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.402683047Z" level=warning msg="failed to cleanup ipc mounts:\nfailed to umount /var/lib/docker/containers/d61431cfed6ddc205d8411c5e4a50e3489b82cc3cdce66603962655071560d64/shm: invalid argument"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.407784615Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (88abdb57a342b77ec93c1aa6d042f348b16fd6b50895786446083e9b7d8bb109)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.408166425Z" level=warning msg="libcontainerd: failed to retrieve container 88abdb57a342b77ec93c1aa6d042f348b16fd6b50895786446083e9b7d8bb109 state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.408274995Z" level=warning msg="failed to cleanup ipc mounts:\nfailed to umount /var/lib/docker/containers/88abdb57a342b77ec93c1aa6d042f348b16fd6b50895786446083e9b7d8bb109/shm: invalid argument"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.414406480Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (35eede0d90bf73270bf707de04f7a074e2a5b3617f0537783620d3b4e6f1262c)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.414826769Z" level=warning msg="libcontainerd: failed to retrieve container 35eede0d90bf73270bf707de04f7a074e2a5b3617f0537783620d3b4e6f1262c state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.414934422Z" level=warning msg="failed to cleanup ipc mounts:\nfailed to umount /var/lib/docker/containers/35eede0d90bf73270bf707de04f7a074e2a5b3617f0537783620d3b4e6f1262c/shm: invalid argument"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.437817481Z" level=warning msg="libcontainerd: client is out of sync, restore was called on a fully synced container (285ba23bda8ad446694177501f16a84b597ff5827402e63a6f60ab89866ef44d)."
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.438398075Z" level=warning msg="libcontainerd: failed to retrieve container 285ba23bda8ad446694177501f16a84b597ff5827402e63a6f60ab89866ef44d state: rpc error: code = 2 desc = containerd: container not found"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.438532917Z" level=warning msg="failed to cleanup ipc mounts:\nfailed to umount /var/lib/docker/containers/285ba23bda8ad446694177501f16a84b597ff5827402e63a6f60ab89866ef44d/shm: invalid argument"
Dec 20 13:16:22 k8s-1-8-1-node1-centos kernel: IPv6: ADDRCONF(NETDEV_UP): docker0: link is not ready
Dec 20 13:16:22 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775782.5324] manager: (docker0): new Bridge device (/org/freedesktop/NetworkManager/Devices/3)
Dec 20 13:16:22 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775782.5359] device (docker0): state change: unmanaged -> unavailable (reason 'connection-assumed') [10 20 41]
Dec 20 13:16:22 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775782.5400] ifcfg-rh: add connection in-memory (c34d0b70-f1f9-4e04-8b9e-66b7f7ed08dd,"docker0")
Dec 20 13:16:22 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775782.5410] device (docker0): state change: unavailable -> disconnected (reason 'connection-assumed') [20 30 41]
Dec 20 13:16:22 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775782.5418] device (docker0): Activation: starting connection 'docker0' (c34d0b70-f1f9-4e04-8b9e-66b7f7ed08dd)
Dec 20 13:16:22 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775782.5423] device (docker0): state change: disconnected -> prepare (reason 'none') [30 40 0]
Dec 20 13:16:22 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775782.5427] device (docker0): state change: prepare -> config (reason 'none') [40 50 0]
Dec 20 13:16:22 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775782.5430] device (docker0): state change: config -> ip-config (reason 'none') [50 70 0]
Dec 20 13:16:22 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775782.5507] device (docker0): state change: ip-config -> ip-check (reason 'none') [70 80 0]
Dec 20 13:16:22 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775782.5513] device (docker0): state change: ip-check -> secondaries (reason 'none') [80 90 0]
Dec 20 13:16:22 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775782.5516] device (docker0): state change: secondaries -> activated (reason 'none') [90 100 0]
Dec 20 13:16:22 k8s-1-8-1-node1-centos NetworkManager[501]: <info>  [1513775782.5579] device (docker0): Activation: successful, device activated.
Dec 20 13:16:22 k8s-1-8-1-node1-centos nm-dispatcher: req:4 'up' [docker0]: new request (3 scripts)
Dec 20 13:16:22 k8s-1-8-1-node1-centos nm-dispatcher: req:4 'up' [docker0]: start running ordered scripts...
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.580973353Z" level=info msg="Removing stale sandbox 67356ddcfeac93f4089a00a23e6079e05b15c07ac911ce330677958fff8d11f0 (27729655e8d90d45f347e345f2dc56522ba2ddaf470fa616186acfbc2f257237)"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.688337880Z" level=info msg="Removing stale sandbox 7e1601cfaaa1e3807d387d27ceced7faf08202fcd0e9c87b27ac49c0a575b834 (38909b8d9208be2cbe27f79a570c1c5cf509664c2441e90f7bd7dad6728e2a3f)"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.800974845Z" level=info msg="Removing stale sandbox c3a2fe97b81495e3ead6b285cd83b4e192428026fe96a16bbbaad47c93900be9 (35eede0d90bf73270bf707de04f7a074e2a5b3617f0537783620d3b4e6f1262c)"
Dec 20 13:16:22 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:22.908858827Z" level=info msg="Removing stale sandbox e84f4706f442767e8ac868ac902aa4476b554c8664d713ac7329c8bffe357871 (573f1f9cb6427445c134311aea95600d7b25888f1423aa480cf8d9a7ae43eb1f)"
Dec 20 13:16:23 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:23.010409474Z" level=info msg="Removing stale sandbox 3a2d87bba05e9ceaf77e173484f3c355ae4ee2730035036cd66dd8b9fb20fefb (285ba23bda8ad446694177501f16a84b597ff5827402e63a6f60ab89866ef44d)"
Dec 20 13:16:23 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:23.116705988Z" level=info msg="Removing stale sandbox 472d57f059469cae2eeb5edbf9cce887daa525b72ce628b5412c0d958aac2e67 (88abdb57a342b77ec93c1aa6d042f348b16fd6b50895786446083e9b7d8bb109)"
Dec 20 13:16:23 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:23.219757417Z" level=info msg="Removing stale sandbox<PHONE_NUMBER>f69fae5a7d61318b9b2447bc5bfc6596cb150429509c3ae6345620 (d95cae8a723b925c67e90bcaa76fa446520f7c5b061a1e0879f4280853b95d70)"
Dec 20 13:16:23 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:23.331825824Z" level=info msg="Removing stale sandbox 9eda496334b8bb3391acd14b2470ed5a466a6057fb3656ed884f52188235d721 (f9ed5b8e4142d7298dc37a6cda713762d009c127d095980678db8427aafdf025)"
Dec 20 13:16:23 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:23.435123495Z" level=info msg="Removing stale sandbox a23e51bddaa6cdf7ec99eda0f0373f499230d7052bac6288cc8c3022d7cc4074 (d61431cfed6ddc205d8411c5e4a50e3489b82cc3cdce66603962655071560d64)"
Dec 20 13:16:23 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:23.464296120Z" level=info msg="Default bridge (docker0) is assigned with an IP address <IP_ADDRESS>/16. Daemon option --bip can be used to set a preferred IP address"
Dec 20 13:16:23 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:23.522641901Z" level=info msg="Loading containers: done."
Dec 20 13:16:23 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:23.754585322Z" level=info msg="Daemon has completed initialization"
Dec 20 13:16:23 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:23.754650070Z" level=info msg="Docker daemon" commit=092cba3 graphdriver=overlay version=1.13.1
Dec 20 13:16:23 k8s-1-8-1-node1-centos docker: time="2017-12-20T13:16:23.767808376Z" level=info msg="API listen on /var/run/docker.sock"
Dec 20 13:16:23 k8s-1-8-1-node1-centos systemd: Started Docker Application Container Engine.
Dec 20 13:16:23 k8s-1-8-1-node1-centos systemd: Started Kubernetes Kubelet Server.
Dec 20 13:16:23 k8s-1-8-1-node1-centos systemd: Starting Kubernetes Kubelet Server...
Dec 20 13:16:23 k8s-1-8-1-node1-centos systemd: Reached target Multi-User System.
Dec 20 13:16:23 k8s-1-8-1-node1-centos systemd: Starting Multi-User System.
Dec 20 13:16:23 k8s-1-8-1-node1-centos systemd: Starting Update UTMP about System Runlevel Changes...
Dec 20 13:16:23 k8s-1-8-1-node1-centos systemd: Started Update UTMP about System Runlevel Changes.
Dec 20 13:16:23 k8s-1-8-1-node1-centos systemd: Startup finished in 653ms (kernel) + 8.241s (initrd) + 26.764s (userspace) = 35.660s.
Dec 20 13:16:24 k8s-1-8-1-node1-centos kubelet: Flag --require-kubeconfig has been deprecated, You no longer need to use --require-kubeconfig. This will be removed in a future version. Providing --kubeconfig enables API server mode, omitting --kubeconfig enables standalone mode unless --require-kubeconfig=true is also set. In the latter case, the legacy default kubeconfig path will be used until --require-kubeconfig is removed.
Dec 20 13:16:24 k8s-1-8-1-node1-centos kubelet: Flag --network-plugin-dir has been deprecated, Use --cni-bin-dir instead. This flag will be removed in a future version.
Dec 20 13:16:24 k8s-1-8-1-node1-centos kubelet: I1220 13:16:24.894431    1179 feature_gate.go:156] feature gates: map[Initializers:true]
Dec 20 13:16:24 k8s-1-8-1-node1-centos kubelet: W1220 13:16:24.894990    1179 server.go:276] --require-kubeconfig is deprecated. Set --kubeconfig without using --require-kubeconfig.
Dec 20 13:16:24 k8s-1-8-1-node1-centos systemd: Started Kubernetes systemd probe.
Dec 20 13:16:24 k8s-1-8-1-node1-centos systemd: Starting Kubernetes systemd probe.
Dec 20 13:16:24 k8s-1-8-1-node1-centos kubelet: I1220 13:16:24.912236    1179 mount_linux.go:205] Detected OS with systemd
Dec 20 13:16:24 k8s-1-8-1-node1-centos kubelet: I1220 13:16:24.912276    1179 client.go:75] Connecting to docker on unix:///var/run/docker.sock
Dec 20 13:16:24 k8s-1-8-1-node1-centos kubelet: I1220 13:16:24.912303    1179 client.go:95] Start docker client with request timeout=2m0s
Dec 20 13:16:24 k8s-1-8-1-node1-centos kubelet: W1220 13:16:24.965261    1179 server.go:289] --cloud-provider=auto-detect is deprecated. The desired cloud provider should be set explicitly
Dec 20 13:16:24 k8s-1-8-1-node1-centos kubelet: I1220 13:16:24.975706    1179 manager.go:149] cAdvisor running in container: "/sys/fs/cgroup/cpu,cpuacct/system.slice/kubelet.service"
Dec 20 13:16:24 k8s-1-8-1-node1-centos kubelet: W1220 13:16:24.993649    1179 manager.go:157] unable to connect to Rkt api service: rkt: cannot tcp Dial rkt api service: dial tcp <IP_ADDRESS>:15441: getsockopt: connection refused
Dec 20 13:16:24 k8s-1-8-1-node1-centos kubelet: W1220 13:16:24.996170    1179 manager.go:166] unable to connect to CRI-O api service: Get http://%2Fvar%2Frun%2Fcrio.sock/info: dial unix /var/run/crio.sock: connect: no such file or directory
Dec 20 13:16:25 k8s-1-8-1-node1-centos kubelet: I1220 13:16:25.014051    1179 fs.go:139] Filesystem UUIDs: map[1fa60645-f538-4c89-b52f-17a8543344ec:/dev/sda1]
Dec 20 13:16:25 k8s-1-8-1-node1-centos kubelet: I1220 13:16:25.014086    1179 fs.go:140] Filesystem partitions: map[tmpfs:{mountpoint:/dev/shm major:0 minor:18 fsType:tmpfs blockSize:0} /dev/sda1:{mountpoint:/var/lib/docker/overlay major:8 minor:1 fsType:xfs blockSize:0}]
Dec 20 13:16:25 k8s-1-8-1-node1-centos kubelet: I1220 13:16:25.020489    1179 manager.go:216] Machine: {NumCores:4 CpuFrequency:2500000 MemoryCapacity:15601311744 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:9d5e7accd1b90164fc3c47a48b3e5483 SystemUUID:11ED3A0D-9A73-BA0A-CAE3-7A19C34277AA BootID:5d04f0a9-52e6-4210-950b-ceac4e4b39ad Filesystems:[{Device:tmpfs DeviceMajor:0 DeviceMinor:18 Capacity:7800655872 Type:vfs Inodes:1904457 HasInodes:true} {Device:/dev/sda1 DeviceMajor:8 DeviceMinor:1 Capacity:10725883904 Type:vfs Inodes:5242368 HasInodes:true}] DiskMap:map[8:16:{Name:sdb Major:8 Minor:16 Size:536870912000 Scheduler:deadline} 253:0:{Name:dm-0 Major:253 Minor:0 Size:12582912 Scheduler:none} 8:0:{Name:sda Major:8 Minor:0 Size:10737418240 Scheduler:deadline}] NetworkDevices:[{Name:eth0 MacAddress:42:01:0a:84:00:0d Speed:0 Mtu:1460}] Topology:[{Id:0 Memory:16105713664 Cores:[{Id:0 Threads:[0 2] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]} {Id:1 Threads:[1 3] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]}] Caches:[{Size:31457280 Type:Unified Level:3}]}] CloudProvider:GCE InstanceType:n1-standard-4 InstanceID:6150059013050960080}
Dec 20 13:16:25 k8s-1-8-1-node1-centos kubelet: I1220 13:16:25.021700    1179 manager.go:222] Version: {KernelVersion:3.10.0-693.11.1.el7.x86_64 ContainerOsVersion:CentOS Linux 7 (Core) DockerVersion:1.13.1 DockerAPIVersion:1.26 CadvisorVersion: CadvisorRevision:}
Dec 20 13:16:25 k8s-1-8-1-node1-centos kubelet: I1220 13:16:25.022844    1179 server.go:422] --cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /
Dec 20 13:16:25 k8s-1-8-1-node1-centos kubelet: I1220 13:16:25.025233    1179 container_manager_linux.go:252] container manager verified user specified cgroup-root exists: /