VM status always CrashLoopBackOff

I already deployed kubevirt, but when I deploy vm that status always CrashLoopBackOff
kubevirt status:

vm status:

vm.yaml:
apiVersion: kubevirt.io/v1
kind: VirtualMachine
metadata:
  name: testvm
  namespace: kubevirt
spec:
  running: false
  template:
    metadata:
      labels:
        kubevirt.io/size: small
        kubevirt.io/domain: testvm
    spec:
      domain:
        devices:
          disks:
            - name: containerdisk
              disk:
                bus: virtio
            - name: cloudinitdisk
              disk:
                bus: virtio
          interfaces:
          - name: default
            masquerade: {}
        resources:
          requests:
            memory: 64M
      networks:
      - name: default
        pod: {}
      volumes:
        - name: containerdisk
          containerDisk:
            image: XXXX/kubevirt/cirros-container-disk-demo:latest
        - name: cloudinitdisk
          cloudInitNoCloud:
            userDataBase64: SGkuXG4=

describe vm:
Name:         testvm
Namespace:    kubevirt
Labels:       <none>
Annotations:  kubevirt.io/latest-observed-api-version: v1
              kubevirt.io/storage-observed-api-version: v1alpha3
API Version:  kubevirt.io/v1
Kind:         VirtualMachine
Metadata:
  Creation Timestamp:  2023-01-04T08:52:40Z
  Generation:          2
  Managed Fields:
    API Version:  kubevirt.io/v1alpha3
    Fields Type:  FieldsV1
    fieldsV1:
      f:metadata:
        f:annotations:
          f:kubevirt.io/latest-observed-api-version:
          f:kubevirt.io/storage-observed-api-version:
    Manager:      Go-http-client
    Operation:    Update
    Time:         2023-01-04T08:52:40Z
    API Version:  kubevirt.io/v1
    Fields Type:  FieldsV1
    fieldsV1:
      f:metadata:
        f:annotations:
          .:
          f:kubectl.kubernetes.io/last-applied-configuration:
      f:spec:
        .:
        f:template:
          .:
          f:metadata:
            .:
            f:labels:
              .:
              f:kubevirt.io/domain:
              f:kubevirt.io/size:
          f:spec:
            .:
            f:domain:
              .:
              f:devices:
                .:
                f:disks:
                f:interfaces:
              f:resources:
                .:
                f:requests:
                  .:
                  f:memory:
            f:networks:
            f:volumes:
    Manager:      kubectl-client-side-apply
    Operation:    Update
    Time:         2023-01-04T08:52:40Z
    API Version:  kubevirt.io/v1
    Fields Type:  FieldsV1
    fieldsV1:
      f:spec:
        f:running:
    Manager:      kubectl-patch
    Operation:    Update
    Time:         2023-01-04T08:53:06Z
    API Version:  kubevirt.io/v1alpha3
    Fields Type:  FieldsV1
    fieldsV1:
      f:status:
        .:
        f:conditions:
        f:printableStatus:
        f:startFailure:
          .:
          f:consecutiveFailCount:
          f:lastFailedVMIUID:
          f:retryAfterTimestamp:
        f:volumeSnapshotStatuses:
    Manager:         Go-http-client
    Operation:       Update
    Subresource:     status
    Time:            2023-01-04T08:53:40Z
  Resource Version:  47339936
  Self Link:         /apis/kubevirt.io/v1/namespaces/kubevirt/virtualmachines/testvm
  UID:               2ceb03e1-3b3e-4fad-9815-02b3e3d46159
Spec:
  Running:  true
  Template:
    Metadata:
      Creation Timestamp:  <nil>
      Labels:
        kubevirt.io/domain:  testvm
        kubevirt.io/size:    small
    Spec:
      Domain:
        Devices:
          Disks:
            Disk:
              Bus:  virtio
            Name:   containerdisk
            Disk:
              Bus:  virtio
            Name:   cloudinitdisk
          Interfaces:
            Masquerade:
            Name:  default
        Machine:
          Type:  q35
        Resources:
          Requests:
            Memory:  64M
      Networks:
        Name:  default
        Pod:
      Volumes:
        Container Disk:
          Image:  XXXX/kubevirt/cirros-container-disk-demo:latest
        Name:     containerdisk
        Cloud Init No Cloud:
          userDataBase64:  SGkuXG4=
        Name:              cloudinitdisk
Status:
  Conditions:
    Last Probe Time:       2023-01-04T08:53:40Z
    Last Transition Time:  2023-01-04T08:53:40Z
    Message:               VMI does not exist
    Reason:                VMINotExists
    Status:                False
    Type:                  Ready
    Last Probe Time:       <nil>
    Last Transition Time:  <nil>
    Status:                True
    Type:                  LiveMigratable
  Printable Status:        CrashLoopBackOff
  Start Failure:
    Consecutive Fail Count:  2
    Last Failed VMIUID:      ef81cd50-839e-4fbb-8b7d-bd7cf993bc1a
    Retry After Timestamp:   2023-01-04T08:54:16Z
  Volume Snapshot Statuses:
    Enabled:  false
    Name:     containerdisk
    Reason:   Snapshot is not supported for this volumeSource type [containerdisk]
    Enabled:  false
    Name:     cloudinitdisk
    Reason:   Snapshot is not supported for this volumeSource type [cloudinitdisk]
Events:
  Type    Reason            Age                From                       Message
  ----    ------            ----               ----                       -------
  Normal  SuccessfulDelete  28s                virtualmachine-controller  Stopped the virtual machine by deleting the virtual machine instance 245f9a4c-f566-4cc0-9c25-d43fd6e0109b
  Normal  SuccessfulCreate  14s (x2 over 35s)  virtualmachine-controller  Started the virtual machine by creating the new virtual machine instance testvm
  Normal  SuccessfulDelete  6s                 virtualmachine-controller  Stopped the virtual machine by deleting the virtual machine instance ef81cd50-839e-4fbb-8b7d-bd7cf993bc1a

Environment:

KubeVirt version (use virtctl version): v0.58.0
Kubernetes version (use kubectl version): 1.23.6
VM or VMI specifications: use demo image cirros-container-disk-demo:latest
Cloud provider or hardware configuration: N/A
OS (e.g. from /etc/os-release): CentOS7

Could you provide the output of k describe vmi testvm and the logs of the corresponding virt-launcher oid k logs virt-launcher-testvm-...?

I can not find vmi and no virt-launcher-testvm-...  pod exist
virt-launcher-testvm-... pod exist when execute k apply -f vm.yaml    that status is PodInitializing to Terminating
a few seconds that pod is disappear ，can not get logs

You can take the VMI spec from your VM yaml. That way, you will be able to run VMI directly:
---
apiVersion: kubevirt.io/v1
kind: VirtualMachineInstance
metadata:
  labels:
    kubevirt.io/size: small
    kubevirt.io/domain: testvm
  name: testvm
  namespace: kubevirt
spec:
  domain:
    devices:
      disks:
        - name: containerdisk
          disk:
            bus: virtio
        - name: cloudinitdisk
          disk:
            bus: virtio
      interfaces:
      - name: default
        masquerade: {}
    resources:
      requests:
        memory: 64M
  networks:
  - name: default
    pod: {}
  volumes:
    - name: containerdisk
      containerDisk:
        image: XXXX/kubevirt/cirros-container-disk-demo:latest
    - name: cloudinitdisk
      cloudInitNoCloud:
        userDataBase64: SGkuXG4=

Probably that will allow you to get the logs.

use your vmi yaml, I get virt-launcher-testvm-... logs
{"component":"virt-launcher","level":"info","msg":"Collected all requested hook sidecar sockets","pos":"manager.go:86","timestamp":"2023-01-05T01:56:54.676168Z"}
{"component":"virt-launcher","level":"info","msg":"Sorted all collected sidecar sockets per hook point based on their priority and name: map[]","pos":"manager.go:89","timestamp":"2023-01-05T01:56:54.676248Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon: qemu:///system","pos":"libvirt.go:497","timestamp":"2023-01-05T01:56:54.686849Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon failed: virError(Code=38, Domain=7, Message='Failed to connect socket to '/var/run/libvirt/libvirt-sock': No such file or directory')","pos":"libvirt.go:505","timestamp":"2023-01-05T01:56:54.692878Z"}
{"component":"virt-launcher","level":"info","msg":"libvirt version: 8.0.0, package: 2.module_el8.6.0+1087+b42c8331 (CentOS Buildsys<EMAIL_ADDRESS>2022-02-08-22:20:52, )","subcomponent":"libvirt","thread":"46","timestamp":"2023-01-05T01:56:54.725000Z"}
{"component":"virt-launcher","level":"info","msg":"hostname: testvm","subcomponent":"libvirt","thread":"46","timestamp":"2023-01-05T01:56:54.725000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Child process (dmidecode -q -t 0,1,2,3,4,11,17) unexpected exit status 1: /dev/mem: No such file or directory","pos":"virCommandWait:2752","subcomponent":"libvirt","thread":"46","timestamp":"2023-01-05T01:56:54.725000Z"}
{"component":"virt-launcher","level":"info","msg":"Connected to libvirt daemon","pos":"libvirt.go:513","timestamp":"2023-01-05T01:56:55.196669Z"}
{"component":"virt-launcher","level":"info","msg":"Registered libvirt event notify callback","pos":"client.go:510","timestamp":"2023-01-05T01:56:55.203010Z"}
{"component":"virt-launcher","level":"info","msg":"Marked as ready","pos":"virt-launcher.go:74","timestamp":"2023-01-05T01:56:55.203404Z"}
panic: timed out waiting for domain to be defined

goroutine 1 [running]:
main.waitForDomainUUID(0xc00028e900, 0xc00028e720, 0xc00021ec00, {0x1d22aa0, 0xc000366410})
	cmd/virt-launcher/virt-launcher.go:244 +0x43a
main.main()
	cmd/virt-launcher/virt-launcher.go:475 +0x109a
{"component":"virt-launcher-monitor","level":"info","msg":"Reaped pid 13 with status 512","pos":"virt-launcher-monitor.go:125","timestamp":"2023-01-05T02:01:21.213862Z"}
{"component":"virt-launcher-monitor","level":"error","msg":"dirty virt-launcher shutdown: exit-code 2","pos":"virt-launcher-monitor.go:143","timestamp":"2023-01-05T02:01:21.214420Z"}

but this node exits /dev/mem.    do not exits /var/run/libvirt

Those errors about /dev/mem and /var/run/libvirt are more like warnings. We can ignore them. Still, there is not that much useful info in the log. Could you try to run the same VMI with increased verbosity (by adding the labels: debugLogs: "true", logVerbosity: "6"):
---
apiVersion: kubevirt.io/v1
kind: VirtualMachineInstance
metadata:
  labels:
    kubevirt.io/size: small
    kubevirt.io/domain: testvm
    debugLogs: "true"
    logVerbosity: "6"
  name: testvm
  namespace: kubevirt
spec:
  domain:
    devices:
      disks:
        - name: containerdisk
          disk:
            bus: virtio
        - name: cloudinitdisk
          disk:
            bus: virtio
      interfaces:
      - name: default
        masquerade: {}
    resources:
      requests:
        memory: 64M
  networks:
  - name: default
    pod: {}
  volumes:
    - name: containerdisk
      containerDisk:
        image: XXXX/kubevirt/cirros-container-disk-demo:latest
    - name: cloudinitdisk
      cloudInitNoCloud:
        userDataBase64: SGkuXG4=

this is the detailed logs
{"component":"virt-launcher-monitor","level":"info","msg":"set log verbosity to 6","pos":"virt-launcher-monitor.go:77","timestamp":"2023-01-05T06:56:13.873274Z"}
{"component":"virt-launcher","level":"info","msg":"set log verbosity to 6","pos":"virt-launcher.go:360","timestamp":"2023-01-05T06:56:13.925692Z"}
{"component":"virt-launcher","level":"info","msg":"Collected all requested hook sidecar sockets","pos":"manager.go:86","timestamp":"2023-01-05T06:56:13.925736Z"}
{"component":"virt-launcher","level":"info","msg":"Sorted all collected sidecar sockets per hook point based on their priority and name: map[]","pos":"manager.go:89","timestamp":"2023-01-05T06:56:13.925771Z"}
{"component":"virt-launcher","level":"info","msg":"Enabling libvirt log filters: 3:remote 4:event 3:util.json 3:util.object 3:util.dbus 3:util.netlink 3:node_device 3:rpc 3:access 3:util.threadjob 3:cpu.cpu 3:qemu.qemu_monitor 1:*","pos":"libvirt_helper.go:537","timestamp":"2023-01-05T06:56:13.927816Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon: qemu:///system","pos":"libvirt.go:497","timestamp":"2023-01-05T06:56:13.927989Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon failed: virError(Code=38, Domain=7, Message='Failed to connect socket to '/var/run/libvirt/libvirt-sock': No such file or directory')","pos":"libvirt.go:505","timestamp":"2023-01-05T06:56:13.957556Z"}
{"component":"virt-launcher","level":"info","msg":"libvirt version: 8.0.0, package: 2.module_el8.6.0+1087+b42c8331 (CentOS Buildsys<EMAIL_ADDRESS>2022-02-08-22:20:52, )","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.960000Z"}
{"component":"virt-launcher","level":"info","msg":"hostname: testvm","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.960000Z"}
{"component":"virt-launcher","level":"info","msg":"outputs=1:stderr","pos":"virLogParseOutputs:1635","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.960000Z"}
{"component":"virt-launcher","level":"info","msg":"output=1:stderr","pos":"virLogParseOutput:1482","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.960000Z"}
{"component":"virt-launcher","level":"info","msg":"libvirt version: 8.0.0, package: 2.module_el8.6.0+1087+b42c8331 (CentOS Buildsys<EMAIL_ADDRESS>2022-02-08-22:20:52, )","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.960000Z"}
{"component":"virt-launcher","level":"info","msg":"hostname: testvm","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.960000Z"}
{"component":"virt-launcher","level":"info","msg":"Decided on pid file path '/run/libvirtd.pid'","pos":"main:971","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.960000Z"}
{"component":"virt-launcher","level":"info","msg":"Decided on socket paths '/run/libvirt/libvirt-sock', '/run/libvirt/libvirt-sock-ro' and '/run/libvirt/libvirt-admin-sock'","pos":"main:985","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.960000Z"}
{"component":"virt-launcher","level":"info","msg":"Ensuring run dir '/run/libvirt' exists","pos":"main:1017","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.960000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load network","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.961000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'network' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_network.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.961000Z"}
{"component":"virt-launcher","level":"info","msg":"Module '/usr/lib64/libvirt/connection-driver/libvirt_driver_network.so' does not exist","pos":"virModuleLoad:113","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load interface","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'interface' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_interface.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Module '/usr/lib64/libvirt/connection-driver/libvirt_driver_interface.so' does not exist","pos":"virModuleLoad:113","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load secret","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'secret' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_secret.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Module '/usr/lib64/libvirt/connection-driver/libvirt_driver_secret.so' does not exist","pos":"virModuleLoad:113","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load storage","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'storage' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_storage.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Module '/usr/lib64/libvirt/connection-driver/libvirt_driver_storage.so' does not exist","pos":"virModuleLoad:113","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load nodedev","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'nodedev' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_nodedev.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Module '/usr/lib64/libvirt/connection-driver/libvirt_driver_nodedev.so' does not exist","pos":"virModuleLoad:113","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load nwfilter","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'nwfilter' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_nwfilter.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Module '/usr/lib64/libvirt/connection-driver/libvirt_driver_nwfilter.so' does not exist","pos":"virModuleLoad:113","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load qemu","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'qemu' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_qemu.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Load module file '/usr/lib64/libvirt/connection-driver/libvirt_driver_qemu.so'","pos":"virModuleLoadFile:48","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.962000Z"}
{"component":"virt-launcher","level":"info","msg":"Lookup function 'qemuRegister'","pos":"virModuleLoadFunc:69","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.963000Z"}
{"component":"virt-launcher","level":"info","msg":"driver=0x7f0a827fb020 name=QEMU","pos":"virRegisterConnectDriver:524","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"registering QEMU as driver 3","pos":"virRegisterConnectDriver:535","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"Attempting to configure auditing subsystem","pos":"main:1147","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/daemon","pos":"virHookCheck:161","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/daemon.d is not accessible","pos":"virHookCheck:172","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/qemu","pos":"virHookCheck:161","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/qemu.d is not accessible","pos":"virHookCheck:172","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/lxc","pos":"virHookCheck:161","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/lxc.d is not accessible","pos":"virHookCheck:172","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/network","pos":"virHookCheck:161","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/network.d is not accessible","pos":"virHookCheck:172","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/libxl","pos":"virHookCheck:161","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/libxl.d is not accessible","pos":"virHookCheck:172","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/bhyve","pos":"virHookCheck:161","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/bhyve.d is not accessible","pos":"virHookCheck:172","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"Setting up networking from caller","pos":"virSystemdGetListenFDs:901","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"No LISTEN_PID from caller","pos":"virSystemdGetListenFDs:904","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"No activation FDs present","pos":"virSystemdGetActivation:1008","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"Skipping systemd notify, not requested","pos":"virSystemdNotifyStartup:624","subcomponent":"libvirt","thread":"28","timestamp":"2023-01-05T06:56:13.964000Z"}
{"component":"virt-launcher","level":"info","msg":"Running global init for Remote state driver","pos":"virStateInitialize:656","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.967000Z"}
{"component":"virt-launcher","level":"info","msg":"State init result 1 (mandatory=0)","pos":"virStateInitialize:662","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.967000Z"}
{"component":"virt-launcher","level":"info","msg":"Running global init for QEMU state driver","pos":"virStateInitialize:656","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.967000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:234","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.967000Z"}
{"component":"virt-launcher","level":"info","msg":"About to run dmidecode -q -t 0,1,2,3,4,11,17","pos":"virCommandRunAsync:2630","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.967000Z"}
{"component":"virt-launcher","level":"info","msg":"Command result 0, with PID 50","pos":"virCommandRunAsync:2633","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.968000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Child process (dmidecode -q -t 0,1,2,3,4,11,17) unexpected exit status 1: /dev/mem: No such file or directory","pos":"virCommandWait:2752","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.971000Z"}
{"component":"virt-launcher","level":"info","msg":"Result status 0, stdout: '' stderr: '/dev/mem: No such file or directory","pos":"virCommandRun:2479","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.971000Z"}
{"component":"virt-launcher","level":"info","msg":"'","subcomponent":"libvirt","timestamp":"2023-01-05T06:56:13.971427Z"}
{"component":"virt-launcher","level":"info","msg":"clone call returned Operation not permitted, container support is not enabled","pos":"virProcessNamespaceAvailable:1506","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"filename=/etc/libvirt/qemu.conf","pos":"virConfReadFile:724","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry stdio_handler 0x7f0a3c01fe40","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry vnc_listen 0x7f0a3c0213a0","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry vnc_tls 0x7f0a3c021400","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry vnc_sasl 0x7f0a3c0214d0","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry user 0x7f0a3c0215c0","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry group 0x7f0a3c0216b0","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry dynamic_ownership 0x7f0a3c021780","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry remember_owner 0x7f0a3c021870","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry namespaces 0x7f0a3c0218f0","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry cgroup_controllers 0x7f0a3c021950","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry virtiofsd_debug 0x7f0a3c021a40","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f0a3c021400 2","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string 0x7f0a3c0213a0 3","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f0a3c0214d0 2","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.973000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value int (nil) 0","pos":"virConfGetValueInt:1042","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f0a3c021a40 2","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string 0x7f0a3c0215c0 3","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.974000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string 0x7f0a3c0216b0 3","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.975000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f0a3c021780 2","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.975000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f0a3c021870 2","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.975000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list 0x7f0a3c021950 4","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.975000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.975000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value int (nil) 0","pos":"virConfGetValueInt:1042","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.975000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list 0x7f0a3c0218f0 4","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.975000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.975000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.975000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.975000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.975000Z"}
{"component":"virt-launcher","level":"info","msg":"name=nop driverName=qemu configDir=/etc/libvirt flags=0x0","pos":"virLockManagerPluginNew:132","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.977000Z"}
{"component":"virt-launcher","level":"info","msg":"version=1000000 configFile=/etc/libvirt/qemu-nop.conf flags=0x0","pos":"virLockManagerNopInit:37","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.977000Z"}
{"component":"virt-launcher","level":"info","msg":"name=\u003cnull\u003e","pos":"virSecurityDriverLookup:54","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.977000Z"}
{"component":"virt-launcher","level":"info","msg":"Not enabled name=selinux","pos":"virSecurityDriverLookup:70","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.977000Z"}
{"component":"virt-launcher","level":"info","msg":"Probed name=none","pos":"virSecurityDriverLookup:65","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.977000Z"}
{"component":"virt-launcher","level":"info","msg":"Auto-probed security driver is \"none\"; confined guests will not be created","pos":"virSecurityManagerNew:198","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.977000Z"}
{"component":"virt-launcher","level":"info","msg":"drv=0x7f0a93aef280 (none) virtDriver=QEMU flags=0x8","pos":"virSecurityManagerNewDriver:86","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.977000Z"}
{"component":"virt-launcher","level":"info","msg":"drv=0x7f0a93aef400 (stack) virtDriver=QEMU flags=0x8","pos":"virSecurityManagerNewDriver:86","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.977000Z"}
{"component":"virt-launcher","level":"info","msg":"drv=0x7f0a93aef0c0 (dac) virtDriver=QEMU flags=0xa","pos":"virSecurityManagerNewDriver:86","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.977000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:234","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.977000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:234","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.978000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:234","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.978000Z"}
{"component":"virt-launcher","level":"error","msg":"Unable to open /dev/kvm: No such file or directory","pos":"virHostCPUGetCPUID:1325","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.978000Z"}
{"component":"virt-launcher","level":"info","msg":"Scanning for configs in /run/libvirt/qemu","pos":"virDomainObjListLoadAllConfigs:577","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.978000Z"}
{"component":"virt-launcher","level":"info","msg":"Scanning for configs in /etc/libvirt/qemu","pos":"virDomainObjListLoadAllConfigs:577","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.978000Z"}
{"component":"virt-launcher","level":"info","msg":"Autostart file /run/libvirt/qemu/autostarted does not exist, do autostart","pos":"virDriverShouldAutostart:99","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.978000Z"}
{"component":"virt-launcher","level":"info","msg":"State init result 1 (mandatory=0)","pos":"virStateInitialize:662","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.978000Z"}
{"component":"virt-launcher","level":"info","msg":"name=qemu:///system","pos":"virConnectOpen:1206","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"Loading config file '/etc/libvirt/libvirt.conf'","pos":"virConfLoadConfig:1515","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"filename=/etc/libvirt/libvirt.conf","pos":"virConfReadFile:724","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"Split \"qemu:///system\" to URI components:","pos":"virConnectOpenInternal:971","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"  scheme qemu","subcomponent":"libvirt","timestamp":"2023-01-05T06:56:14.460760Z"}
{"component":"virt-launcher","level":"info","msg":"  server \u003cnull\u003e","subcomponent":"libvirt","timestamp":"2023-01-05T06:56:14.460780Z"}
{"component":"virt-launcher","level":"info","msg":"  user \u003cnull\u003e","subcomponent":"libvirt","timestamp":"2023-01-05T06:56:14.460795Z"}
{"component":"virt-launcher","level":"info","msg":"  port 0","subcomponent":"libvirt","timestamp":"2023-01-05T06:56:14.461619Z"}
{"component":"virt-launcher","level":"info","msg":"  path /system","subcomponent":"libvirt","timestamp":"2023-01-05T06:56:14.461633Z"}
{"component":"virt-launcher","level":"info","msg":"trying driver 0 (Test) ...","pos":"virConnectOpenInternal:1069","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"Checking for supported URI schemes","pos":"virConnectOpenInternal:1090","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"No matching URI scheme","pos":"virConnectOpenInternal:1099","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"trying driver 1 (ESX) ...","pos":"virConnectOpenInternal:1069","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"Checking for supported URI schemes","pos":"virConnectOpenInternal:1090","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"No matching URI scheme","pos":"virConnectOpenInternal:1099","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"trying driver 2 (remote) ...","pos":"virConnectOpenInternal:1069","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"Matching any URI scheme for 'qemu'","pos":"virConnectOpenInternal:1107","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"driver 2 remote returned DECLINED","pos":"virConnectOpenInternal:1137","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"trying driver 3 (QEMU) ...","pos":"virConnectOpenInternal:1069","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"Checking for supported URI schemes","pos":"virConnectOpenInternal:1090","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"Matched URI scheme 'qemu'","pos":"virConnectOpenInternal:1093","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"driver 3 QEMU returned SUCCESS","pos":"virConnectOpenInternal:1137","subcomponent":"libvirt","thread":"35","timestamp":"2023-01-05T06:56:14.460000Z"}
{"component":"virt-launcher","level":"info","msg":"Connected to libvirt daemon","pos":"libvirt.go:513","timestamp":"2023-01-05T06:56:14.462558Z"}

{"component":"virt-launcher","level":"error","msg":"Unable to open /dev/kvm: No such file or directory","pos":"virHostCPUGetCPUID:1325","subcomponent":"libvirt","thread":"48","timestamp":"2023-01-05T06:56:13.978000Z"}

Do you have HW virtualization enabled on your nodes?

sometimes virt-launcher-testvm-... logs has this error
{"component":"virt-launcher","level":"error","msg":"internal error: Child process (dmidecode -q -t 0,1,2,3,4,11,17) unexpected exit status 1: /dev/mem: No such file or directory","pos":"virCommandWait:2752","subcomponent":"libvirt","thread":"44","timestamp":"2023-01-05T10:01:21.246000Z"}

Hi, is there any update on this issue? I met a very similiar problem. Didn't find more useful logs.

I tuned up the verbosity of virt-handler log, looks like vmi.status.phase is set to Failed. It might be related to code here.
Sadly I am having a tough time compiling kubevirt for further troubleshooting. It would be nice if someone can help me how to build virt-handler image only, thanks.

@lobshunter, do you also see "Unable to open /dev/kvm: No such file or directory" in the logs? Could you add the annotation to your VMI yaml kubevirt.io/keep-launcher-alive-after-failure and try to exec into the pod and check the kvm device and its permissions? Also, could you please attach the logs of virt-handler pods?

@huangpx1, 能否询问一下libvirt版本

@vasiliy-u

do you also see "Unable to open /dev/kvm: No such file or directory"

Hmmm, no. I just saw /dev/mem: No such file or directory, but that's not a critical error. And I have also attached into VMI pod, /dev/kvm does exist.

Also, could you please attach the logs of virt-handler pods?

I am naively inserting printf into virt-handler to debug. VMI turned into Failed state here. Seems like virt-handler doesn't log a lot there, so I am adding more printfs now. I will upload virt-handler logs later, hopefully printf can provide more informations.

/dev/kvm does exist

Then your case is probably different from the one initially reported here. Could you maybe attach the logs of virt-launcher with added VMI labels: debugLogs: "true" and logVerbosity: "6"?

Sure. log of virt-launcher:

virt-launcher

{"component":"virt-launcher-monitor","level":"info","msg":"set log verbosity to 6","pos":"virt-launcher-monitor.go:77","timestamp":"2023-02-09T09:32:44.304561Z"}
{"component":"virt-launcher","level":"info","msg":"set log verbosity to 6","pos":"virt-launcher.go:360","timestamp":"2023-02-09T09:32:44.338967Z"}
{"component":"virt-launcher","level":"info","msg":"Collected all requested hook sidecar sockets","pos":"manager.go:86","timestamp":"2023-02-09T09:32:44.339038Z"}
{"component":"virt-launcher","level":"info","msg":"Sorted all collected sidecar sockets per hook point based on their priority and name: map[]","pos":"manager.go:89","timestamp":"2023-02-09T09:32:44.339135Z"}
{"component":"virt-launcher","level":"info","msg":"Enabling libvirt log filters: 3:remote 4:event 3:util.json 3:util.object 3:util.dbus 3:util.netlink 3:node_device 3:rpc 3:access 3:util.threadjob 3:cpu.cpu 3:qemu.qemu_monitor 1:*","pos":"libvirt_helper.go:537","timestamp":"2023-02-09T09:32:44.341055Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon: qemu:///system","pos":"libvirt.go:497","timestamp":"2023-02-09T09:32:44.341129Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon failed: virError(Code=38, Domain=7, Message='Failed to connect socket to '/var/run/libvirt/libvirt-sock': No such file or directory')","pos":"libvirt.go:505","timestamp":"2023-02-09T09:32:44.341937Z"}
{"component":"virt-launcher","level":"info","msg":"libvirt version: 8.0.0, package: 2.module_el8.6.0+1087+b42c8331 (CentOS Buildsys<EMAIL_ADDRESS>2022-02-08-22:20:52, )","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.356000Z"}
{"component":"virt-launcher","level":"info","msg":"hostname: virtualmachine1","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.356000Z"}
{"component":"virt-launcher","level":"info","msg":"outputs=1:stderr","pos":"virLogParseOutputs:1635","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.356000Z"}
{"component":"virt-launcher","level":"info","msg":"output=1:stderr","pos":"virLogParseOutput:1482","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.356000Z"}
{"component":"virt-launcher","level":"info","msg":"libvirt version: 8.0.0, package: 2.module_el8.6.0+1087+b42c8331 (CentOS Buildsys<EMAIL_ADDRESS>2022-02-08-22:20:52, )","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.356000Z"}
{"component":"virt-launcher","level":"info","msg":"hostname: virtualmachine1","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.356000Z"}
{"component":"virt-launcher","level":"info","msg":"Decided on pid file path '/run/libvirtd.pid'","pos":"main:971","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.356000Z"}
{"component":"virt-launcher","level":"info","msg":"Decided on socket paths '/run/libvirt/libvirt-sock', '/run/libvirt/libvirt-sock-ro' and '/run/libvirt/libvirt-admin-sock'","pos":"main:985","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.356000Z"}
{"component":"virt-launcher","level":"info","msg":"Ensuring run dir '/run/libvirt' exists","pos":"main:1017","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.356000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load network","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'network' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_network.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Module '/usr/lib64/libvirt/connection-driver/libvirt_driver_network.so' does not exist","pos":"virModuleLoad:113","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load interface","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'interface' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_interface.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Module '/usr/lib64/libvirt/connection-driver/libvirt_driver_interface.so' does not exist","pos":"virModuleLoad:113","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load secret","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'secret' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_secret.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Module '/usr/lib64/libvirt/connection-driver/libvirt_driver_secret.so' does not exist","pos":"virModuleLoad:113","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load storage","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'storage' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_storage.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Module '/usr/lib64/libvirt/connection-driver/libvirt_driver_storage.so' does not exist","pos":"virModuleLoad:113","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load nodedev","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'nodedev' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_nodedev.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Module '/usr/lib64/libvirt/connection-driver/libvirt_driver_nodedev.so' does not exist","pos":"virModuleLoad:113","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load nwfilter","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'nwfilter' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_nwfilter.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Module '/usr/lib64/libvirt/connection-driver/libvirt_driver_nwfilter.so' does not exist","pos":"virModuleLoad:113","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Module load qemu","pos":"virDriverLoadModule:56","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Resolved 'qemu' to '/usr/lib64/libvirt/connection-driver/libvirt_driver_qemu.so'","pos":"virFileFindResourceFull:1738","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Load module file '/usr/lib64/libvirt/connection-driver/libvirt_driver_qemu.so'","pos":"virModuleLoadFile:48","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.357000Z"}
{"component":"virt-launcher","level":"info","msg":"Lookup function 'qemuRegister'","pos":"virModuleLoadFunc:69","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"driver=0x7f5df3773020 name=QEMU","pos":"virRegisterConnectDriver:524","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"registering QEMU as driver 3","pos":"virRegisterConnectDriver:535","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"Attempting to configure auditing subsystem","pos":"main:1147","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/daemon","pos":"virHookCheck:161","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/daemon.d is not accessible","pos":"virHookCheck:172","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/qemu","pos":"virHookCheck:161","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/qemu.d is not accessible","pos":"virHookCheck:172","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/lxc","pos":"virHookCheck:161","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/lxc.d is not accessible","pos":"virHookCheck:172","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/network","pos":"virHookCheck:161","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/network.d is not accessible","pos":"virHookCheck:172","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/libxl","pos":"virHookCheck:161","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/libxl.d is not accessible","pos":"virHookCheck:172","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"No hook script /etc/libvirt/hooks/bhyve","pos":"virHookCheck:161","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"Hook dir /etc/libvirt/hooks/bhyve.d is not accessible","pos":"virHookCheck:172","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.359000Z"}
{"component":"virt-launcher","level":"info","msg":"Setting up networking from caller","pos":"virSystemdGetListenFDs:901","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.360000Z"}
{"component":"virt-launcher","level":"info","msg":"No LISTEN_PID from caller","pos":"virSystemdGetListenFDs:904","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.360000Z"}
{"component":"virt-launcher","level":"info","msg":"No activation FDs present","pos":"virSystemdGetActivation:1008","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.360000Z"}
{"component":"virt-launcher","level":"info","msg":"Skipping systemd notify, not requested","pos":"virSystemdNotifyStartup:624","subcomponent":"libvirt","thread":"22","timestamp":"2023-02-09T09:32:44.360000Z"}
{"component":"virt-launcher","level":"info","msg":"Running global init for Remote state driver","pos":"virStateInitialize:656","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.361000Z"}
{"component":"virt-launcher","level":"info","msg":"State init result 1 (mandatory=0)","pos":"virStateInitialize:662","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.361000Z"}
{"component":"virt-launcher","level":"info","msg":"Running global init for QEMU state driver","pos":"virStateInitialize:656","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.361000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:234","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.362000Z"}
{"component":"virt-launcher","level":"info","msg":"About to run dmidecode -q -t 0,1,2,3,4,11,17","pos":"virCommandRunAsync:2630","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.362000Z"}
{"component":"virt-launcher","level":"info","msg":"Command result 0, with PID 41","pos":"virCommandRunAsync:2633","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.362000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Child process (dmidecode -q -t 0,1,2,3,4,11,17) unexpected exit status 1: /dev/mem: No such file or directory","pos":"virCommandWait:2752","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.363000Z"}
{"component":"virt-launcher","level":"info","msg":"Result status 0, stdout: '' stderr: '/dev/mem: No such file or directory","pos":"virCommandRun:2479","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.363000Z"}
{"component":"virt-launcher","level":"info","msg":"'","subcomponent":"libvirt","timestamp":"2023-02-09T09:32:44.363957Z"}
{"component":"virt-launcher","level":"info","msg":"clone call returned Operation not permitted, container support is not enabled","pos":"virProcessNamespaceAvailable:1506","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"filename=/etc/libvirt/qemu.conf","pos":"virConfReadFile:724","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry stdio_handler 0x7f5dac01fe40","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry vnc_listen 0x7f5dac0213a0","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry vnc_tls 0x7f5dac021400","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry vnc_sasl 0x7f5dac0214d0","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry user 0x7f5dac0215c0","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry group 0x7f5dac0216b0","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry dynamic_ownership 0x7f5dac021780","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry remember_owner 0x7f5dac021870","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry namespaces 0x7f5dac0218f0","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry cgroup_controllers 0x7f5dac021950","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Add entry virtiofsd_debug 0x7f5dac021a40","pos":"virConfAddEntry:215","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f5dac021400 2","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string 0x7f5dac0213a0 3","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f5dac0214d0 2","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.364000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value unsigned long long (nil) 0","pos":"virConfGetValueULLong:1293","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string 0x7f5dac01fe40 3","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value int (nil) 0","pos":"virConfGetValueInt:1042","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value uint (nil) 0","pos":"virConfGetValueUInt:1091","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f5dac021a40 2","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool (nil) 0","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string 0x7f5dac0215c0 3","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string 0x7f5dac0216b0 3","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f5dac021780 2","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value bool 0x7f5dac021870 2","pos":"virConfGetValueBool:994","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list 0x7f5dac021950 4","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value int (nil) 0","pos":"virConfGetValueInt:1042","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list 0x7f5dac0218f0 4","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string (nil) 0","pos":"virConfGetValueString:869","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.365000Z"}
{"component":"virt-launcher","level":"info","msg":"name=nop driverName=qemu configDir=/etc/libvirt flags=0x0","pos":"virLockManagerPluginNew:132","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.366000Z"}
{"component":"virt-launcher","level":"info","msg":"version=1000000 configFile=/etc/libvirt/qemu-nop.conf flags=0x0","pos":"virLockManagerNopInit:37","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.366000Z"}
{"component":"virt-launcher","level":"info","msg":"name=\u003cnull\u003e","pos":"virSecurityDriverLookup:54","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.366000Z"}
{"component":"virt-launcher","level":"info","msg":"Not enabled name=selinux","pos":"virSecurityDriverLookup:70","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.366000Z"}
{"component":"virt-launcher","level":"info","msg":"Probed name=none","pos":"virSecurityDriverLookup:65","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.366000Z"}
{"component":"virt-launcher","level":"info","msg":"Auto-probed security driver is \"none\"; confined guests will not be created","pos":"virSecurityManagerNew:198","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.366000Z"}
{"component":"virt-launcher","level":"info","msg":"drv=0x7f5e00f1a280 (none) virtDriver=QEMU flags=0x8","pos":"virSecurityManagerNewDriver:86","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.366000Z"}
{"component":"virt-launcher","level":"info","msg":"drv=0x7f5e00f1a400 (stack) virtDriver=QEMU flags=0x8","pos":"virSecurityManagerNewDriver:86","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.366000Z"}
{"component":"virt-launcher","level":"info","msg":"drv=0x7f5e00f1a0c0 (dac) virtDriver=QEMU flags=0xa","pos":"virSecurityManagerNewDriver:86","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.366000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:234","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.366000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:234","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.367000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:234","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.367000Z"}
{"component":"virt-launcher","level":"info","msg":"Mapped x86_64 to 34 (x86_64)","pos":"virArchFromHost:234","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.367000Z"}
{"component":"virt-launcher","level":"info","msg":"Scanning for configs in /run/libvirt/qemu","pos":"virDomainObjListLoadAllConfigs:577","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.367000Z"}
{"component":"virt-launcher","level":"info","msg":"Scanning for configs in /etc/libvirt/qemu","pos":"virDomainObjListLoadAllConfigs:577","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.367000Z"}
{"component":"virt-launcher","level":"info","msg":"Autostart file /run/libvirt/qemu/autostarted does not exist, do autostart","pos":"virDriverShouldAutostart:99","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.367000Z"}
{"component":"virt-launcher","level":"info","msg":"State init result 1 (mandatory=0)","pos":"virStateInitialize:662","subcomponent":"libvirt","thread":"39","timestamp":"2023-02-09T09:32:44.367000Z"}
{"component":"virt-launcher","level":"info","msg":"name=qemu:///system","pos":"virConnectOpen:1206","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.842000Z"}
{"component":"virt-launcher","level":"info","msg":"Loading config file '/etc/libvirt/libvirt.conf'","pos":"virConfLoadConfig:1515","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.842000Z"}
{"component":"virt-launcher","level":"info","msg":"filename=/etc/libvirt/libvirt.conf","pos":"virConfReadFile:724","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.842000Z"}
{"component":"virt-launcher","level":"info","msg":"Get value string list (nil) 0","pos":"virConfGetValueStringList:917","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.842000Z"}
{"component":"virt-launcher","level":"info","msg":"Split \"qemu:///system\" to URI components:","pos":"virConnectOpenInternal:971","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"  scheme qemu","subcomponent":"libvirt","timestamp":"2023-02-09T09:32:44.843046Z"}
{"component":"virt-launcher","level":"info","msg":"  server \u003cnull\u003e","subcomponent":"libvirt","timestamp":"2023-02-09T09:32:44.843056Z"}
{"component":"virt-launcher","level":"info","msg":"  user \u003cnull\u003e","subcomponent":"libvirt","timestamp":"2023-02-09T09:32:44.843067Z"}
{"component":"virt-launcher","level":"info","msg":"  port 0","subcomponent":"libvirt","timestamp":"2023-02-09T09:32:44.843094Z"}
{"component":"virt-launcher","level":"info","msg":"  path /system","subcomponent":"libvirt","timestamp":"2023-02-09T09:32:44.843103Z"}
{"component":"virt-launcher","level":"info","msg":"trying driver 0 (Test) ...","pos":"virConnectOpenInternal:1069","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"Checking for supported URI schemes","pos":"virConnectOpenInternal:1090","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"No matching URI scheme","pos":"virConnectOpenInternal:1099","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"trying driver 1 (ESX) ...","pos":"virConnectOpenInternal:1069","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"Checking for supported URI schemes","pos":"virConnectOpenInternal:1090","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"No matching URI scheme","pos":"virConnectOpenInternal:1099","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"trying driver 2 (remote) ...","pos":"virConnectOpenInternal:1069","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"Matching any URI scheme for 'qemu'","pos":"virConnectOpenInternal:1107","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"driver 2 remote returned DECLINED","pos":"virConnectOpenInternal:1137","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"trying driver 3 (QEMU) ...","pos":"virConnectOpenInternal:1069","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"Checking for supported URI schemes","pos":"virConnectOpenInternal:1090","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"Matched URI scheme 'qemu'","pos":"virConnectOpenInternal:1093","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"driver 3 QEMU returned SUCCESS","pos":"virConnectOpenInternal:1137","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.843000Z"}
{"component":"virt-launcher","level":"info","msg":"Connected to libvirt daemon","pos":"libvirt.go:513","timestamp":"2023-02-09T09:32:44.843375Z"}
{"component":"virt-launcher","level":"info","msg":"dom=(nil), (VM: name=\u003cnull\u003e, uuid=), conn=0x7f5dac0161b0, eventID=0, cb=0x55b83a3be5d0, opaque=0x7f5dd4002660, freecb=0x55b83a3b89b0","pos":"virConnectDomainEventRegisterAny:9465","subcomponent":"libvirt","thread":"28","timestamp":"2023-02-09T09:32:44.846000Z"}
{"component":"virt-launcher","level":"info","msg":"dom=(nil), (VM: name=\u003cnull\u003e, uuid=), conn=0x7f5dac0161b0, eventID=19, cb=0x55b83a3bca10, opaque=0x7f5dd8002ab0, freecb=0x55b83a3b89b0","pos":"virConnectDomainEventRegisterAny:9465","subcomponent":"libvirt","thread":"27","timestamp":"2023-02-09T09:32:44.846000Z"}
{"component":"virt-launcher","level":"info","msg":"dom=(nil), (VM: name=\u003cnull\u003e, uuid=), conn=0x7f5dac0161b0, eventID=15, cb=0x55b83a3bcec0, opaque=0x7f5dcc005c30, freecb=0x55b83a3b89b0","pos":"virConnectDomainEventRegisterAny:9465","subcomponent":"libvirt","thread":"26","timestamp":"2023-02-09T09:32:44.846000Z"}
{"component":"virt-launcher","level":"info","msg":"dom=(nil), (VM: name=\u003cnull\u003e, uuid=), conn=0x7f5dac0161b0, eventID=18, cb=0x55b83a3bcb20, opaque=0x7f5dd0003f30, freecb=0x55b83a3b89b0","pos":"virConnectDomainEventRegisterAny:9465","subcomponent":"libvirt","thread":"25","timestamp":"2023-02-09T09:32:44.846000Z"}
{"component":"virt-launcher","level":"info","msg":"Registered libvirt event notify callback","pos":"client.go:510","timestamp":"2023-02-09T09:32:44.846972Z"}
{"component":"virt-launcher","level":"info","msg":"Marked as ready","pos":"virt-launcher.go:74","timestamp":"2023-02-09T09:32:44.847220Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:246","timestamp":"2023-02-09T09:32:54.847775Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f5dac0161b0, domains=0x7f5df877d920, flags=0x3","pos":"virConnectListAllDomains:6669","subcomponent":"libvirt","thread":"24","timestamp":"2023-02-09T09:32:54.848000Z"}
{"component":"virt-launcher","level":"info","msg":"Periodically checking for domain with UUID","pos":"virt-launcher.go:246","timestamp":"2023-02-09T09:33:04.848114Z"}
{"component":"virt-launcher","level":"info","msg":"conn=0x7f5dac0161b0, domains=0x7f5df6779920, flags=0x3","pos":"virConnectListAllDomains:6669","subcomponent":"libvirt","thread":"28","timestamp":"2023-02-09T09:33:04.848000Z"}

thanks. hm... no obvious errors there. could you also exec into virt-launcher and provide the output of cat /var/log/libvirt/qemu/<vmi>.log?

could you also exec into virt-launcher and provide the output of cat /var/log/libvirt/qemu/.log?
Tried it before, qemu didn't even started, so no log at all.

Would this information be more helpful?
virt-handler decides LauncherClient is Unresponsive here. The error is No command socket found for vmi 8522db80-5504-47db-9985-3c1d35eca802 and No command socketdir for vmi 8522db80-5504-47db-9985-3c1d35eca802. (keep adding more printf....)

In your case, virt-launcher binary crashes because it timeouts waiting for qemu to come up. The 'unresponsive' status is the result of the crash. Since the error comes from the launcher itself, I am not sure that printing smth in handler may help here. Personally, I would look into the launcher pod to debug further.

BTW, just to double-check: what kubevirt version are you running? Is it the latest upstream release v0.58.0? Or a custom build? Could you also specify your host OS, Kubernetes distribution and container runtime? Do you have Apparmor or SELinux enabled on your host?

I would look into the launcher pod to debug further.

I tried to dig into launcher but got stucked at libvirt part.
IIUC, virt-launcher spawns virt-launcher-monitor, then virt-launcher-monitor spawns libvirtd and calls libvirtd's socket API for virtualmachine lifecycle management. But it uses go-libvirt instead of virsh cli to communicate with libvirtd. Then I had no idea how to go further. Is there same equivalent virsh command I can use to ensure libvirtd works? Or any other suggestions would be great.

You can still use virsh cli from the launcher pod. Not sure what command exactly to check, though. I would also try to run qemu directly and see if there are errors. Smth similar to qemu-system-x86_64 -accel kvm

My environment:

kubevirt v0.58.0 x64
kubernetes 1.21.14(installed by kubeadm).
SELinux disabled
worker node:

container runtime: containerd: v1.6.4
host OS: CentOS7 with kernel 5.19.6-1.el7.elrepo.x86_64
container runtime: docker 20.10.23
host OS: Kylin Linux Advanced Serve with kernel 4.19.90-25.23.v2101.ky10.x86_64(like some kind of CentOS redistribution.....)

kubernetes 1.21.14(installed by kubeadm).

This one is pretty old. I don't think KubeVirt v0.58.0 has been tested with it. The supported (and tested) versions are 1.22, 1.23, 1.24. Not 100% sure that it may cause problems, but I would either try to update to smth newer or run an older release of KubeVirt.

Hmmm I have other kubevirt workers on the same k8s cluster, they work fine(Rocky Linux 8.4 with 4.18.0-348.7.1.el8_5.x86_64). I suppose kubernetes isn't the problem.
I will try virsh/qemu directly inside launcher pod later this week. Will post up here if I found anything new.

I already deployed kubevirt, but when I deploy vm that status always CrashLoopBackOff
kubevirt status:
vm status:
vm.yaml:
apiVersion: kubevirt.io/v1
kind: VirtualMachine
metadata:
  name: testvm
  namespace: kubevirt
spec:
  running: false
  template:
    metadata:
      labels:
        kubevirt.io/size: small
        kubevirt.io/domain: testvm
    spec:
      domain:
        devices:
          disks:
            - name: containerdisk
              disk:
                bus: virtio
            - name: cloudinitdisk
              disk:
                bus: virtio
          interfaces:
          - name: default
            masquerade: {}
        resources:
          requests:
            memory: 64M
      networks:
      - name: default
        pod: {}
      volumes:
        - name: containerdisk
          containerDisk:
            image: XXXX/kubevirt/cirros-container-disk-demo:latest
        - name: cloudinitdisk
          cloudInitNoCloud:
            userDataBase64: SGkuXG4=

describe vm:
Name:         testvm
Namespace:    kubevirt
Labels:       <none>
Annotations:  kubevirt.io/latest-observed-api-version: v1
              kubevirt.io/storage-observed-api-version: v1alpha3
API Version:  kubevirt.io/v1
Kind:         VirtualMachine
Metadata:
  Creation Timestamp:  2023-01-04T08:52:40Z
  Generation:          2
  Managed Fields:
    API Version:  kubevirt.io/v1alpha3
    Fields Type:  FieldsV1
    fieldsV1:
      f:metadata:
        f:annotations:
          f:kubevirt.io/latest-observed-api-version:
          f:kubevirt.io/storage-observed-api-version:
    Manager:      Go-http-client
    Operation:    Update
    Time:         2023-01-04T08:52:40Z
    API Version:  kubevirt.io/v1
    Fields Type:  FieldsV1
    fieldsV1:
      f:metadata:
        f:annotations:
          .:
          f:kubectl.kubernetes.io/last-applied-configuration:
      f:spec:
        .:
        f:template:
          .:
          f:metadata:
            .:
            f:labels:
              .:
              f:kubevirt.io/domain:
              f:kubevirt.io/size:
          f:spec:
            .:
            f:domain:
              .:
              f:devices:
                .:
                f:disks:
                f:interfaces:
              f:resources:
                .:
                f:requests:
                  .:
                  f:memory:
            f:networks:
            f:volumes:
    Manager:      kubectl-client-side-apply
    Operation:    Update
    Time:         2023-01-04T08:52:40Z
    API Version:  kubevirt.io/v1
    Fields Type:  FieldsV1
    fieldsV1:
      f:spec:
        f:running:
    Manager:      kubectl-patch
    Operation:    Update
    Time:         2023-01-04T08:53:06Z
    API Version:  kubevirt.io/v1alpha3
    Fields Type:  FieldsV1
    fieldsV1:
      f:status:
        .:
        f:conditions:
        f:printableStatus:
        f:startFailure:
          .:
          f:consecutiveFailCount:
          f:lastFailedVMIUID:
          f:retryAfterTimestamp:
        f:volumeSnapshotStatuses:
    Manager:         Go-http-client
    Operation:       Update
    Subresource:     status
    Time:            2023-01-04T08:53:40Z
  Resource Version:  47339936
  Self Link:         /apis/kubevirt.io/v1/namespaces/kubevirt/virtualmachines/testvm
  UID:               2ceb03e1-3b3e-4fad-9815-02b3e3d46159
Spec:
  Running:  true
  Template:
    Metadata:
      Creation Timestamp:  <nil>
      Labels:
        kubevirt.io/domain:  testvm
        kubevirt.io/size:    small
    Spec:
      Domain:
        Devices:
          Disks:
            Disk:
              Bus:  virtio
            Name:   containerdisk
            Disk:
              Bus:  virtio
            Name:   cloudinitdisk
          Interfaces:
            Masquerade:
            Name:  default
        Machine:
          Type:  q35
        Resources:
          Requests:
            Memory:  64M
      Networks:
        Name:  default
        Pod:
      Volumes:
        Container Disk:
          Image:  XXXX/kubevirt/cirros-container-disk-demo:latest
        Name:     containerdisk
        Cloud Init No Cloud:
          userDataBase64:  SGkuXG4=
        Name:              cloudinitdisk
Status:
  Conditions:
    Last Probe Time:       2023-01-04T08:53:40Z
    Last Transition Time:  2023-01-04T08:53:40Z
    Message:               VMI does not exist
    Reason:                VMINotExists
    Status:                False
    Type:                  Ready
    Last Probe Time:       <nil>
    Last Transition Time:  <nil>
    Status:                True
    Type:                  LiveMigratable
  Printable Status:        CrashLoopBackOff
  Start Failure:
    Consecutive Fail Count:  2
    Last Failed VMIUID:      ef81cd50-839e-4fbb-8b7d-bd7cf993bc1a
    Retry After Timestamp:   2023-01-04T08:54:16Z
  Volume Snapshot Statuses:
    Enabled:  false
    Name:     containerdisk
    Reason:   Snapshot is not supported for this volumeSource type [containerdisk]
    Enabled:  false
    Name:     cloudinitdisk
    Reason:   Snapshot is not supported for this volumeSource type [cloudinitdisk]
Events:
  Type    Reason            Age                From                       Message
  ----    ------            ----               ----                       -------
  Normal  SuccessfulDelete  28s                virtualmachine-controller  Stopped the virtual machine by deleting the virtual machine instance 245f9a4c-f566-4cc0-9c25-d43fd6e0109b
  Normal  SuccessfulCreate  14s (x2 over 35s)  virtualmachine-controller  Started the virtual machine by creating the new virtual machine instance testvm
  Normal  SuccessfulDelete  6s                 virtualmachine-controller  Stopped the virtual machine by deleting the virtual machine instance ef81cd50-839e-4fbb-8b7d-bd7cf993bc1a

Environment:

KubeVirt version (use virtctl version): v0.58.0
Kubernetes version (use kubectl version): 1.23.6
VM or VMI specifications: use demo image cirros-container-disk-demo:latest
Cloud provider or hardware configuration: N/A
OS (e.g. from /etc/os-release): CentOS7

i met a very similar problem.. have u got any solution for this issue??

sameeeeeeeeeee here any solutions ?????????????,

Did anyone find a solution for this? I'm facing same issue

In your case, virt-launcher binary crashes because it timeouts waiting for qemu to come up. The 'unresponsive' status is the result of the crash. Since the error comes from the launcher itself, I am not sure that printing smth in handler may help here. Personally, I would look into the launcher pod to debug further.

This is most likely because the handler did not send a sync command in time.
Can anybody share both virt-launcher and virt-handler logs?