I1228 16:45:00.472419    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for roles.rbac.authorization.k8s.io
I1228 16:45:00.472579    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for leases.coordination.k8s.io
I1228 16:45:00.472850    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for daemonsets.apps
I1228 16:45:00.473030    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for replicasets.apps
I1228 16:45:00.473295    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for events.events.k8s.io
I1228 16:45:00.474291    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for ingresses.extensions
I1228 16:45:00.474470    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for deployments.apps
I1228 16:45:00.474668    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for statefulsets.apps
I1228 16:45:00.474822    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for jobs.batch
I1228 16:45:00.475089    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for limitranges
I1228 16:45:00.475339    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for podtemplates
I1228 16:45:00.475618    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for endpoints
I1228 16:45:00.475839    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for networkpolicies.networking.k8s.io
I1228 16:45:00.476007    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for endpointslices.discovery.k8s.io
I1228 16:45:00.476858    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for serviceaccounts
I1228 16:45:00.477050    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for controllerrevisions.apps
I1228 16:45:00.477432    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for rolebindings.rbac.authorization.k8s.io
I1228 16:45:00.477723    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for helmcharts.helm.cattle.io
I1228 16:45:00.477981    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for addons.k3s.cattle.io
I1228 16:45:00.478194    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for cronjobs.batch
I1228 16:45:00.478448    2850 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for ingresses.networking.k8s.io
I1228 16:45:00.478568    2850 controllermanager.go:554] Started "resourcequota"
I1228 16:45:00.478637    2850 resource_quota_controller.go:273] Starting resource quota controller
I1228 16:45:00.478708    2850 shared_informer.go:240] Waiting for caches to sync for resource quota
I1228 16:45:00.478892    2850 resource_quota_monitor.go:304] QuotaMonitor running
I1228 16:45:00.585891    2850 garbagecollector.go:142] Starting garbage collector controller
I1228 16:45:00.586007    2850 shared_informer.go:240] Waiting for caches to sync for garbage collector
I1228 16:45:00.586144    2850 graph_builder.go:289] GraphBuilder running
I1228 16:45:00.587438    2850 controllermanager.go:554] Started "garbagecollector"
W1228 16:45:00.587570    2850 controllermanager.go:533] "service" is disabled
I1228 16:45:00.679350    2850 controllermanager.go:554] Started "pvc-protection"
I1228 16:45:00.681566    2850 pvc_protection_controller.go:110] Starting PVC protection controller
I1228 16:45:00.681693    2850 shared_informer.go:240] Waiting for caches to sync for PVC protection
I1228 16:45:00.832813    2850 shared_informer.go:247] Caches are synced for TTL
I1228 16:45:00.839990    2850 shared_informer.go:247] Caches are synced for node
I1228 16:45:00.840197    2850 range_allocator.go:172] Starting range CIDR allocator
I1228 16:45:00.840300    2850 shared_informer.go:240] Waiting for caches to sync for cidrallocator
I1228 16:45:00.840349    2850 shared_informer.go:247] Caches are synced for cidrallocator
I1228 16:45:00.962391    2850 shared_informer.go:247] Caches are synced for certificate-csrapproving
I1228 16:45:00.972132    2850 shared_informer.go:247] Caches are synced for PV protection
I1228 16:45:00.972958    2850 shared_informer.go:247] Caches are synced for service account
I1228 16:45:00.982808    2850 shared_informer.go:247] Caches are synced for certificate-csrsigning-legacy-unknown
I1228 16:45:00.983030    2850 shared_informer.go:247] Caches are synced for certificate-csrsigning-kube-apiserver-client
I1228 16:45:00.989388    2850 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-serving
I1228 16:45:00.989608    2850 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-client
I1228 16:45:01.004445    2850 shared_informer.go:247] Caches are synced for namespace
I1228 16:45:01.029877    2850 shared_informer.go:247] Caches are synced for expand
I1228 16:45:01.046933    2850 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring
I1228 16:45:01.073554    2850 shared_informer.go:247] Caches are synced for daemon sets
I1228 16:45:01.081384    2850 shared_informer.go:247] Caches are synced for endpoint
I1228 16:45:01.081922    2850 shared_informer.go:247] Caches are synced for taint
I1228 16:45:01.082764    2850 taint_manager.go:187] Starting NoExecuteTaintManager
I1228 16:45:01.084102    2850 shared_informer.go:247] Caches are synced for PVC protection
I1228 16:45:01.093769    2850 shared_informer.go:247] Caches are synced for GC
I1228 16:45:01.097708    2850 shared_informer.go:247] Caches are synced for HPA
I1228 16:45:01.110060    2850 shared_informer.go:247] Caches are synced for ClusterRoleAggregator
I1228 16:45:01.119138    2850 shared_informer.go:247] Caches are synced for stateful set
I1228 16:45:01.143642    2850 shared_informer.go:247] Caches are synced for ReplicationController
I1228 16:45:01.144105    2850 shared_informer.go:247] Caches are synced for ReplicaSet
I1228 16:45:01.149417    2850 shared_informer.go:247] Caches are synced for attach detach
I1228 16:45:01.154164    2850 shared_informer.go:247] Caches are synced for endpoint_slice
I1228 16:45:01.158141    2850 shared_informer.go:247] Caches are synced for disruption
I1228 16:45:01.158340    2850 disruption.go:339] Sending events to api server.
I1228 16:45:01.158711    2850 shared_informer.go:247] Caches are synced for persistent volume
I1228 16:45:01.166493    2850 shared_informer.go:247] Caches are synced for deployment
I1228 16:45:01.166980    2850 shared_informer.go:247] Caches are synced for job
I1228 16:45:01.186959    2850 shared_informer.go:247] Caches are synced for resource quota
I1228 16:45:01.197121    2850 shared_informer.go:247] Caches are synced for crt configmap
I1228 16:45:01.606139    2850 controller.go:606] quota admission added evaluator for: replicasets.apps
I1228 16:45:01.624312    2850 request.go:655] Throttling request took 1.047675124s, request: GET:https://<IP_ADDRESS>:6444/apis/extensions/v1beta1?timeout=32s
I1228 16:45:01.680492    2850 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-86cbb8457f to 1"
I1228 16:45:01.788733    2850 event.go:291] "Event occurred" object="kube-system/local-path-provisioner" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set local-path-provisioner-7c458769fb to 1"
I1228 16:45:01.788961    2850 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-854c77959c to 1"
I1228 16:45:01.790893    2850 event.go:291] "Event occurred" object="kube-system/helm-install-traefik" kind="Job" apiVersion="batch/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: helm-install-traefik-cz6fm"
I1228 16:45:01.802639    2850 controller.go:606] quota admission added evaluator for: events.events.k8s.io
I1228 16:45:02.318926    2850 event.go:291] "Event occurred" object="kube-system/local-path-provisioner-7c458769fb" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: local-path-provisioner-7c458769fb-sssm6"
I1228 16:45:02.319131    2850 event.go:291] "Event occurred" object="kube-system/coredns-854c77959c" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-854c77959c-hfs5g"
I1228 16:45:02.344526    2850 event.go:291] "Event occurred" object="kube-system/metrics-server-86cbb8457f" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: metrics-server-86cbb8457f-9bs2q"
E1228 16:45:02.618291    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1228 16:45:02.618836    2850 shared_informer.go:240] Waiting for caches to sync for resource quota
I1228 16:45:02.618977    2850 shared_informer.go:247] Caches are synced for resource quota
W1228 16:45:03.349237    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1228 16:45:03.474281    2850 memcache.go:196] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E1228 16:45:04.014395    2850 memcache.go:101] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1228 16:45:04.043834    2850 shared_informer.go:240] Waiting for caches to sync for garbage collector
I1228 16:45:04.144805    2850 shared_informer.go:247] Caches are synced for garbage collector
I1228 16:45:04.187172    2850 shared_informer.go:247] Caches are synced for garbage collector
I1228 16:45:04.187340    2850 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
W1228 16:45:08.393310    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:45:08.393592    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:45:08.393671    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:45:33.758378    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1228 16:45:35.895377    2850 request.go:655] Throttling request took 1.041272973s, request: GET:https://<IP_ADDRESS>:6444/apis/scheduling.k8s.io/v1beta1?timeout=32s
W1228 16:45:36.853566    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
time="2020-12-28T16:45:39.724343219Z" level=info msg="Cluster-Http-Server 2020/12/28 16:45:39 http: TLS handshake error from <IP_ADDRESS>:44132: remote error: tls: bad certificate"
time="2020-12-28T16:45:39.834524127Z" level=info msg="Cluster-Http-Server 2020/12/28 16:45:39 http: TLS handshake error from <IP_ADDRESS>:37410: remote error: tls: bad certificate"
time="2020-12-28T16:45:39.972116136Z" level=info msg="Cluster-Http-Server 2020/12/28 16:45:39 http: TLS handshake error from <IP_ADDRESS>:44144: remote error: tls: bad certificate"
time="2020-12-28T16:45:40.055789372Z" level=info msg="Cluster-Http-Server 2020/12/28 16:45:40 http: TLS handshake error from <IP_ADDRESS>:37422: remote error: tls: bad certificate"
time="2020-12-28T16:45:41.713707318Z" level=info msg="certificate CN=rasp-2 signed by CN=k3s-server-ca@1609173832: notBefore=2020-12-28 16:43:52 +0000 UTC notAfter=2021-12-28 16:45:41 +0000 UTC"
time="2020-12-28T16:45:41.743388450Z" level=info msg="certificate CN=rasp-3 signed by CN=k3s-server-ca@1609173832: notBefore=2020-12-28 16:43:52 +0000 UTC notAfter=2021-12-28 16:45:41 +0000 UTC"
time="2020-12-28T16:45:43.253503284Z" level=info msg="certificate CN=system:node:rasp-3,O=system:nodes signed by CN=k3s-client-ca@1609173832: notBefore=2020-12-28 16:43:52 +0000 UTC notAfter=2021-12-28 16:45:43 +0000 UTC"
time="2020-12-28T16:45:43.284712214Z" level=info msg="certificate CN=system:node:rasp-2,O=system:nodes signed by CN=k3s-client-ca@1609173832: notBefore=2020-12-28 16:43:52 +0000 UTC notAfter=2021-12-28 16:45:43 +0000 UTC"
time="2020-12-28T16:45:46.542859941Z" level=info msg="Handling backend connection request [rasp-2]"
time="2020-12-28T16:45:46.555078474Z" level=info msg="Handling backend connection request [rasp-3]"
I1228 16:45:52.245286    2850 node_controller.go:390] Initializing node rasp-3 with cloud provider
time="2020-12-28T16:45:52.247851025Z" level=info msg="Couldn't find node internal ip label on node rasp-3"
time="2020-12-28T16:45:52.248052742Z" level=info msg="Couldn't find node hostname label on node rasp-3"
W1228 16:45:52.248155    2850 actual_state_of_world.go:506] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="rasp-3" does not exist
W1228 16:45:52.308414    2850 actual_state_of_world.go:506] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="rasp-2" does not exist
I1228 16:45:52.603117    2850 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I1228 16:45:52.638851    2850 range_allocator.go:373] Set node rasp-2 PodCIDR to [<IP_ADDRESS>/24]
I1228 16:45:52.644275    2850 node_controller.go:454] Successfully initialized node rasp-3 with cloud provider
I1228 16:45:52.644582    2850 node_controller.go:390] Initializing node rasp-2 with cloud provider
time="2020-12-28T16:45:52.644742823Z" level=info msg="Couldn't find node internal ip label on node rasp-2"
time="2020-12-28T16:45:52.644895686Z" level=info msg="Couldn't find node hostname label on node rasp-2"
I1228 16:45:52.650128    2850 event.go:291] "Event occurred" object="rasp-3" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully"
time="2020-12-28T16:45:52.693038886Z" level=info msg="Updated coredns node hosts entry [<IP_ADDRESS> rasp-3]"
I1228 16:45:52.728874    2850 range_allocator.go:373] Set node rasp-3 PodCIDR to [<IP_ADDRESS>/24]
time="2020-12-28T16:45:52.994699586Z" level=info msg="Updated coredns node hosts entry [<IP_ADDRESS> rasp-2]"
I1228 16:45:53.251592    2850 node_controller.go:454] Successfully initialized node rasp-2 with cloud provider
I1228 16:45:53.251934    2850 node_controller.go:390] Initializing node rasp-2 with cloud provider
time="2020-12-28T16:45:53.252142517Z" level=info msg="Couldn't find node internal ip label on node rasp-2"
time="2020-12-28T16:45:53.252361681Z" level=info msg="Couldn't find node hostname label on node rasp-2"
I1228 16:45:53.281934    2850 event.go:291] "Event occurred" object="rasp-2" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully"
I1228 16:45:53.634557    2850 node_controller.go:454] Successfully initialized node rasp-2 with cloud provider
I1228 16:45:53.635138    2850 event.go:291] "Event occurred" object="rasp-2" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully"
I1228 16:45:56.085596    2850 node_lifecycle_controller.go:1429] Initializing eviction metric for zone:
I1228 16:45:56.085887    2850 event.go:291] "Event occurred" object="rasp-3" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node rasp-3 event: Registered Node rasp-3 in Controller"
I1228 16:45:56.086049    2850 event.go:291] "Event occurred" object="rasp-2" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node rasp-2 event: Registered Node rasp-2 in Controller"
W1228 16:45:56.086105    2850 node_lifecycle_controller.go:1044] Missing timestamp for Node rasp-3. Assuming now as a timestamp.
W1228 16:45:56.086451    2850 node_lifecycle_controller.go:1044] Missing timestamp for Node rasp-2. Assuming now as a timestamp.
I1228 16:45:56.086662    2850 node_lifecycle_controller.go:1245] Controller detected that zone  is now in state Normal.
E1228 16:46:04.369824    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1228 16:46:06.526308    2850 event.go:291] "Event occurred" object="kube-system/local-path-provisioner-7c458769fb-sssm6" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod kube-system/local-path-provisioner-7c458769fb-sssm6"
W1228 16:46:08.394308    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:46:08.394568    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:46:08.394648    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I1228 16:46:08.595841    2850 request.go:655] Throttling request took 1.041617032s, request: GET:https://<IP_ADDRESS>:6444/apis/batch/v1beta1?timeout=32s
W1228 16:46:09.553558    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
I1228 16:46:23.402139    2850 event.go:291] "Event occurred" object="kube-system/helm-install-traefik" kind="Job" apiVersion="batch/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: helm-install-traefik-g8tqb"
E1228 16:46:23.530355    2850 job_controller.go:402] Error syncing job: failed pod(s) detected for job key "kube-system/helm-install-traefik"
E1228 16:46:23.583184    2850 job_controller.go:402] Error syncing job: failed pod(s) detected for job key "kube-system/helm-install-traefik"
E1228 16:46:35.094992    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1228 16:46:41.300241    2850 request.go:655] Throttling request took 1.04134417s, request: GET:https://<IP_ADDRESS>:6444/apis/batch/v1beta1?timeout=32s
W1228 16:46:42.258277    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1228 16:46:55.320869    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:46:56.325444    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:46:56.325736    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:46:56.325847    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:47:00.324997    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:47:05.327161    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:47:05.822355    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E1228 16:47:10.369491    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
W1228 16:47:11.374817    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:47:11.375096    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:47:11.375175    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I1228 16:47:14.225289    2850 request.go:655] Throttling request took 1.039999182s, request: GET:https://<IP_ADDRESS>:6444/apis/coordination.k8s.io/v1?timeout=32s
W1228 16:47:15.183770    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1228 16:47:15.393973    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again
E1228 16:47:20.426829    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:47:21.432909    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:47:21.433181    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:47:21.433302    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:47:25.462143    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again
E1228 16:47:30.482756    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded
W1228 16:47:31.487354    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:47:31.487648    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:47:31.487726    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:47:35.504666    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again
E1228 16:47:36.432031    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E1228 16:47:40.536754    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:47:41.541782    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:47:41.542149    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:47:41.542297    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:47:46.205334    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again
I1228 16:47:47.892539    2850 request.go:655] Throttling request took 1.040489762s, request: GET:https://<IP_ADDRESS>:6444/apis/networking.k8s.io/v1beta1?timeout=32s
W1228 16:47:48.850844    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1228 16:47:51.232627    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded
W1228 16:47:52.237284    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:47:52.237693    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:47:52.237794    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:47:57.293522    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": dial tcp <IP_ADDRESS>:443: i/o timeout
W1228 16:47:58.300617    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:47:58.300908    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:47:58.300988    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:48:02.298440    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded
E1228 16:48:08.206608    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E1228 16:48:08.266304    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:48:09.268943    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:48:09.269282    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:48:09.269364    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:48:13.270858    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:48:18.273467    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
I1228 16:48:21.210121    2850 request.go:655] Throttling request took 1.04156605s, request: GET:https://<IP_ADDRESS>:6444/apis/authorization.k8s.io/v1?timeout=32s
W1228 16:48:22.168387    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1228 16:48:23.276417    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:48:38.997352    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E1228 16:48:41.868589    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:48:53.300683    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I1228 16:48:54.278816    2850 request.go:655] Throttling request took 1.041157878s, request: GET:https://<IP_ADDRESS>:6444/apis/apiextensions.k8s.io/v1?timeout=32s
W1228 16:48:54.304909    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:48:54.305172    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:48:54.305361    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W1228 16:48:55.236817    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1228 16:48:58.337510    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded
W1228 16:48:59.340316    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:48:59.340605    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:48:59.340691    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:49:03.739128    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
W1228 16:49:04.743673    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:49:04.743957    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:49:04.744037    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:49:08.767047    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded
E1228 16:49:09.694302    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W1228 16:49:09.771966    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:49:09.772281    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:49:09.772378    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:49:14.855511    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again
E1228 16:49:19.885198    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:49:20.889387    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:49:20.889659    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:49:20.889750    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:49:24.889841    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
I1228 16:49:27.789667    2850 request.go:655] Throttling request took 1.041652563s, request: GET:https://<IP_ADDRESS>:6444/apis/autoscaling/v1?timeout=32s
W1228 16:49:28.748287    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1228 16:49:29.891766    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
I1228 16:49:37.141319    2850 trace.go:205] Trace[188756419]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:k3s/v1.20.0+k3s2 (linux/arm64) kubernetes/2ea6b16/system:serviceaccount:kube-system:job-controller,client:<IP_ADDRESS> (28-Dec-2020 16:49:36.043) (total time: 1097ms):
Trace[188756419]: ---"Object stored in database" 1096ms (16:49:00.140)
Trace[188756419]: [1.097486466s] [1.097486466s] END
I1228 16:49:37.159397    2850 event.go:291] "Event occurred" object="kube-system/helm-install-traefik" kind="Job" apiVersion="batch/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: helm-install-traefik-g2kx8"
E1228 16:49:37.255845    2850 job_controller.go:402] Error syncing job: failed pod(s) detected for job key "kube-system/helm-install-traefik"
E1228 16:49:37.310069    2850 job_controller.go:402] Error syncing job: failed pod(s) detected for job key "kube-system/helm-install-traefik"
W1228 16:49:37.873106    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:49:37.873417    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:49:37.873508    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:49:40.326324    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E1228 16:49:41.895968    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded
W1228 16:49:42.918404    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:49:42.918728    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:49:42.918888    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:49:47.050963    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:49:48.056089    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:49:48.056509    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:49:48.056591    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:49:52.055750    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:49:59.918301    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded
I1228 16:50:00.858756    2850 request.go:655] Throttling request took 1.041550638s, request: GET:https://<IP_ADDRESS>:6444/apis/batch/v1?timeout=32s
W1228 16:50:00.922272    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:50:00.922529    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:50:00.922608    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W1228 16:50:01.816750    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1228 16:50:04.954813    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:50:05.959183    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:50:05.959510    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:50:05.959590    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:50:10.426901    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": dial tcp <IP_ADDRESS>:443: i/o timeout (Client.Timeout exceeded while awaiting headers)
E1228 16:50:10.995645    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W1228 16:50:11.432606    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:50:11.432889    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:50:11.432973    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:50:15.429906    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:50:21.606909    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:50:22.608920    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:50:22.609253    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:50:22.609336    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:50:26.612564    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
I1228 16:50:34.569278    2850 request.go:655] Throttling request took 1.041575013s, request: GET:https://<IP_ADDRESS>:6444/apis/events.k8s.io/v1beta1?timeout=32s
E1228 16:50:34.961438    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
W1228 16:50:35.527295    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
W1228 16:50:35.965118    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:50:35.965448    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:50:35.965537    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:50:39.988548    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:50:40.994258    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:50:40.994553    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:50:40.994634    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:50:41.724514    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E1228 16:50:45.017302    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again
E1228 16:50:50.019152    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
I1228 16:51:07.993619    2850 request.go:655] Throttling request took 1.040743666s, request: GET:https://<IP_ADDRESS>:6444/apis/scheduling.k8s.io/v1beta1?timeout=32s
W1228 16:51:08.951630    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1228 16:51:09.963675    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:51:12.377947    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E1228 16:51:14.965966    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:51:40.995244    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:51:40.995523    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:51:40.995649    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I1228 16:51:41.147547    2850 request.go:655] Throttling request took 1.041246718s, request: GET:https://<IP_ADDRESS>:6444/apis/policy/v1beta1?timeout=32s
E1228 16:51:41.872902    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:51:42.105137    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1228 16:51:42.986664    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E1228 16:51:46.874687    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:52:12.792334    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded
E1228 16:52:13.594490    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W1228 16:52:13.797200    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:52:13.797645    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:52:13.797728    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I1228 16:52:14.482616    2850 request.go:655] Throttling request took 1.040987189s, request: GET:https://<IP_ADDRESS>:6444/apis/scheduling.k8s.io/v1?timeout=32s
W1228 16:52:15.440794    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1228 16:52:17.795823    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:52:22.798779    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded
E1228 16:52:41.894686    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:52:42.898900    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:52:42.899173    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:52:42.899391    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:52:44.425169    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E1228 16:52:46.898182    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
I1228 16:52:47.889147    2850 request.go:655] Throttling request took 1.041198541s, request: GET:https://<IP_ADDRESS>:6444/apis/extensions/v1beta1?timeout=32s
W1228 16:52:48.847453    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1228 16:52:51.899834    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:53:11.875475    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:53:15.167150    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1228 16:53:21.207036    2850 request.go:655] Throttling request took 1.041486559s, request: GET:https://<IP_ADDRESS>:6444/apis/autoscaling/v1?timeout=32s
E1228 16:53:21.921191    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": dial tcp <IP_ADDRESS>:443: i/o timeout
W1228 16:53:22.164937    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
W1228 16:53:22.925706    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:53:22.925982    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:53:22.926106    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:53:26.953657    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:53:27.956495    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:53:27.956780    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:53:27.956860    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:53:31.956820    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:53:42.023181    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded
W1228 16:53:43.034060    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:53:43.034399    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:53:43.034483    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:53:45.830133    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E1228 16:53:47.033472    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded
I1228 16:53:54.684589    2850 request.go:655] Throttling request took 1.041027137s, request: GET:https://<IP_ADDRESS>:6444/apis/authorization.k8s.io/v1?timeout=32s
W1228 16:53:55.643069    2850 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1228 16:53:56.960849    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
W1228 16:53:57.965540    2850 handler_proxy.go:102] no RequestInfo found in the context
E1228 16:53:57.965951    2850 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1228 16:53:57.966032    2850 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E1228 16:54:01.965006    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:54:11.875041    2850 available_controller.go:508] v1beta1.metrics.k8s.io failed with: failing or missing response from https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1: Get "https://<IP_ADDRESS>:443/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E1228 16:54:16.440380    2850 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

Updated log from the agent:

Click to expand

time="2020-12-28T16:45:06Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock"
time="2020-12-28T16:45:06Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/477a397d5ed8de53c8cee46d5f565f81e93de8dadbff870dc27452b47238f6f5"
time="2020-12-28T16:45:39.153495442Z" level=info msg="Starting k3s agent v1.20.0+k3s2 (2ea6b163)"
time="2020-12-28T16:45:39.154820371Z" level=info msg="Module overlay was already loaded"
time="2020-12-28T16:45:39.444577277Z" level=info msg="Running load balancer <IP_ADDRESS>:46415 -> [<IP_ADDRESS>:6443]"
time="2020-12-28T16:45:43.369718337Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log"
time="2020-12-28T16:45:43.370248695Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml -a /run/k3s/containerd/containerd.sock --state /run/k3s/containerd --root /var/lib/rancher/k3s/agent/containerd"
time="2020-12-28T16:45:44.373526761Z" level=info msg="Waiting for containerd startup: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/k3s/containerd/containerd.sock: connect: no such file or directory\""
time="2020-12-28T16:45:45.375559531Z" level=info msg="Waiting for containerd startup: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/k3s/containerd/containerd.sock: connect: no such file or directory\""
time="2020-12-28T16:45:46.387484303Z" level=info msg="Containerd is now running"
time="2020-12-28T16:45:46.503215182Z" level=info msg="Connecting to proxy" url="wss://<IP_ADDRESS>:6443/v1-k3s/connect"
time="2020-12-28T16:45:46.546842038Z" level=warning msg="Disabling CPU quotas due to missing cpu.cfs_period_us"
time="2020-12-28T16:45:46.547443124Z" level=info msg="Running kubelet --address=<IP_ADDRESS> --anonymous-auth=false --authentication-token-webhook=true --authorization-mode=Webhook --cgroup-driver=cgroupfs --client-ca-file=/var/lib/rancher/k3s/agent/client-ca.crt --cloud-provider=external --cluster-dns=<IP_ADDRESS> --cluster-domain=cluster.local --cni-bin-dir=/var/lib/rancher/k3s/data/477a397d5ed8de53c8cee46d5f565f81e93de8dadbff870dc27452b47238f6f5/bin --cni-conf-dir=/var/lib/rancher/k3s/agent/etc/cni/net.d --container-runtime-endpoint=unix:///run/k3s/containerd/containerd.sock --container-runtime=remote --containerd=unix:///run/k3s/containerd/containerd.sock --cpu-cfs-quota=false --eviction-hard=imagefs.available<5%,nodefs.available<5% --eviction-minimum-reclaim=imagefs.available=10%,nodefs.available=10% --fail-swap-on=false --healthz-bind-address=<IP_ADDRESS> --hostname-override=rasp-2 --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-labels= --pod-manifest-path=/var/lib/rancher/k3s/agent/pod-manifests --read-only-port=0 --resolv-conf=/etc/resolv.conf --serialize-image-pulls=false --tls-cert-file=/var/lib/rancher/k3s/agent/serving-kubelet.crt --tls-private-key-file=/var/lib/rancher/k3s/agent/serving-kubelet.key"
time="2020-12-28T16:45:46.553416220Z" level=info msg="Running kube-proxy --cluster-cidr=<IP_ADDRESS>/16 --healthz-bind-address=<IP_ADDRESS> --hostname-override=rasp-2 --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables"
Flag --cloud-provider has been deprecated, will be removed in 1.23, in favor of removing cloud provider code from Kubelet.
Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed.
W1228 16:45:46.556081    2869 server.go:226] WARNING: all flags other than --config, --write-config-to, and --cleanup are deprecated. Please begin using a config file ASAP.
I1228 16:45:46.560361    2869 server.go:412] Version: v1.20.0+k3s2
time="2020-12-28T16:45:46.745465960Z" level=info msg="Waiting for node rasp-2: nodes \"rasp-2\" not found"
I1228 16:45:46.934701    2869 dynamic_cafile_content.go:167] Starting client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt
E1228 16:45:47.012031    2869 node.go:161] Failed to retrieve node info: nodes "rasp-2" not found
E1228 16:45:48.194400    2869 node.go:161] Failed to retrieve node info: nodes "rasp-2" not found
time="2020-12-28T16:45:48.821689429Z" level=info msg="Waiting for node rasp-2: nodes \"rasp-2\" not found"
E1228 16:45:50.427564    2869 node.go:161] Failed to retrieve node info: nodes "rasp-2" not found
time="2020-12-28T16:45:50.922539647Z" level=info msg="Waiting for node rasp-2: nodes \"rasp-2\" not found"
W1228 16:45:51.945475    2869 nvidia.go:81] Error reading "/sys/bus/pci/devices/": open /sys/bus/pci/devices/: no such file or directory
W1228 16:45:51.951828    2869 sysinfo.go:203] Nodes topology is not available, providing CPU topology
W1228 16:45:51.953267    2869 sysfs.go:348] unable to read /sys/devices/system/cpu/cpu0/online: open /sys/devices/system/cpu/cpu0/online: no such file or directory
W1228 16:45:51.953495    2869 sysfs.go:348] unable to read /sys/devices/system/cpu/cpu1/online: open /sys/devices/system/cpu/cpu1/online: no such file or directory
W1228 16:45:51.953679    2869 sysfs.go:348] unable to read /sys/devices/system/cpu/cpu2/online: open /sys/devices/system/cpu/cpu2/online: no such file or directory
W1228 16:45:51.953882    2869 sysfs.go:348] unable to read /sys/devices/system/cpu/cpu3/online: open /sys/devices/system/cpu/cpu3/online: no such file or directory
E1228 16:45:51.954274    2869 info.go:114] Failed to get system UUID: open /etc/machine-id: no such file or directory
W1228 16:45:51.955213    2869 machine.go:253] Cannot determine CPU /sys/bus/cpu/devices/cpu0 online state, skipping
W1228 16:45:51.955366    2869 machine.go:253] Cannot determine CPU /sys/bus/cpu/devices/cpu1 online state, skipping
W1228 16:45:51.955498    2869 machine.go:253] Cannot determine CPU /sys/bus/cpu/devices/cpu2 online state, skipping
W1228 16:45:51.955629    2869 machine.go:253] Cannot determine CPU /sys/bus/cpu/devices/cpu3 online state, skipping
E1228 16:45:51.955742    2869 machine.go:72] Cannot read number of physical cores correctly, number of cores set to 0
W1228 16:45:51.956476    2869 machine.go:253] Cannot determine CPU /sys/bus/cpu/devices/cpu0 online state, skipping
W1228 16:45:51.956610    2869 machine.go:253] Cannot determine CPU /sys/bus/cpu/devices/cpu1 online state, skipping
W1228 16:45:51.956736    2869 machine.go:253] Cannot determine CPU /sys/bus/cpu/devices/cpu2 online state, skipping
W1228 16:45:51.956872    2869 machine.go:253] Cannot determine CPU /sys/bus/cpu/devices/cpu3 online state, skipping
E1228 16:45:51.956916    2869 machine.go:86] Cannot read number of sockets correctly, number of sockets set to 0
W1228 16:45:51.957074    2869 info.go:53] Couldn't collect info from any of the files in "/etc/machine-id,/var/lib/dbus/machine-id"
I1228 16:45:51.959966    2869 server.go:645] --cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /
I1228 16:45:51.961801    2869 container_manager_linux.go:287] container manager verified user specified cgroup-root exists: []
I1228 16:45:51.961917    2869 container_manager_linux.go:292] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:remote CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: ReservedSystemCPUs: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:imagefs.available Operator:LessThan Value:{Quantity: Percentage:0.05} GracePeriod:0s MinReclaim:} {Signal:nodefs.available Operator:LessThan Value:{Quantity: Percentage:0.05} GracePeriod:0s MinReclaim:}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalTopologyManagerScope:container ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:false CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none Rootless:false}
I1228 16:45:51.962506    2869 topology_manager.go:120] [topologymanager] Creating topology manager with none policy per container scope
I1228 16:45:51.962628    2869 container_manager_linux.go:323] [topologymanager] Initializing Topology Manager with none policy and container-level scope
I1228 16:45:51.962686    2869 container_manager_linux.go:328] Creating device plugin manager: true
I1228 16:45:51.964075    2869 kubelet.go:262] Adding pod path: /var/lib/rancher/k3s/agent/pod-manifests
I1228 16:45:51.964405    2869 kubelet.go:273] Watching apiserver
I1228 16:45:51.972725    2869 kuberuntime_manager.go:216] Container runtime containerd initialized, version: v1.4.3-k3s1, apiVersion: v1alpha2
I1228 16:45:51.994305    2869 server.go:1177] Started kubelet
E1228 16:45:52.005888    2869 cri_stats_provider.go:376] Failed to get the info of the filesystem with mountpoint "/var/lib/rancher/k3s/agent/containerd/io.containerd.snapshotter.v1.native": unable to find data in memory cache.
 Stats initialization may not have completed yet: invalid capacity 0 on image filesystem
I1228 16:45:52.010871    2869 server.go:148] Starting to listen on <IP_ADDRESS>:10250
I1228 16:45:52.019109    2869 fs_resource_analyzer.go:64] Starting FS ResourceAnalyzer
I1228 16:45:52.019741    2869 server.go:409] Adding debug handlers to kubelet server.
I1228 16:45:52.033730    2869 volume_manager.go:271] Starting Kubelet Volume Manager
I1228 16:45:52.036948    2869 desired_state_of_world_populator.go:142] Desired state populator starts to run
I1228 16:45:52.128235    2869 cpu_manager.go:193] [cpumanager] starting with none policy
I1228 16:45:52.128341    2869 cpu_manager.go:194] [cpumanager] reconciling every 10s
I1228 16:45:52.128558    2869 state_mem.go:36] [cpumanager] initializing new in-memory state store
I1228 16:45:52.129738    2869 policy_none.go:43] [cpumanager] none policy: Start
E1228 16:45:52.134391    2869 kubelet.go:2240] node "rasp-2" not found
I1228 16:45:52.141248    2869 kubelet_node_status.go:71] Attempting to register node rasp-2
W1228 16:45:52.222537    2869 manager.go:594] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I1228 16:45:52.226421    2869 plugin_manager.go:114] Starting Kubelet Plugin Manager
E1228 16:45:52.232730    2869 eviction_manager.go:260] eviction manager: failed to get summary stats: failed to get node info: node "rasp-2" not found
E1228 16:45:52.235188    2869 kubelet.go:2240] node "rasp-2" not found
I1228 16:45:52.298046    2869 kubelet_node_status.go:74] Successfully registered node rasp-2
I1228 16:45:52.636653    2869 kuberuntime_manager.go:1006] updating runtime config through cri with podcidr <IP_ADDRESS>/24
I1228 16:45:52.639242    2869 kubelet_network.go:77] Setting Pod CIDR:  -> <IP_ADDRESS>/24
I1228 16:45:52.774064    2869 kubelet_network_linux.go:56] Initialized IPv4 iptables rules.
I1228 16:45:52.774391    2869 status_manager.go:158] Starting to sync pod status with apiserver
I1228 16:45:52.774523    2869 kubelet.go:1799] Starting kubelet main sync loop.
E1228 16:45:52.774760    2869 kubelet.go:1823] skipping pod synchronization - PLEG is not healthy: pleg has yet to be successful
I1228 16:45:52.941504    2869 reconciler.go:157] Reconciler: start to sync state
time="2020-12-28T16:45:53.049929297Z" level=info msg="Node CIDR assigned for: rasp-2"
I1228 16:45:53.050403    2869 flannel.go:92] Determining IP address of default interface
I1228 16:45:53.052907    2869 flannel.go:105] Using interface with name wlan0 and address <IP_ADDRESS>
I1228 16:45:53.076282    2869 kube.go:117] Waiting 10m0s for node controller to sync
I1228 16:45:53.076369    2869 kube.go:300] Starting kube subnet manager
time="2020-12-28T16:45:53.349078159Z" level=info msg="Failed to update node rasp-2: nodes \"rasp-2\" is forbidden: node \"rasp-2\" is not allowed to modify taints"
I1228 16:45:54.076779    2869 kube.go:124] Node controller sync successful
I1228 16:45:54.077306    2869 vxlan.go:121] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false
I1228 16:45:54.361523    2869 flannel.go:78] Wrote subnet file to /run/flannel/subnet.env
I1228 16:45:54.361631    2869 flannel.go:82] Running backend.

I1228 16:45:55.448384    2869 server.go:650] Version: v1.20.0+k3s2
I1228 16:45:55.452282    2869 conntrack.go:103] Set sysctl 'net/netfilter/nf_conntrack_max' to 131072
I1228 16:45:55.452816    2869 conntrack.go:52] Setting nf_conntrack_max to 131072
I1228 16:45:55.454875    2869 conntrack.go:83] Setting conntrack hashsize to 32768
I1228 16:45:55.462752    2869 conntrack.go:103] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
I1228 16:45:55.463394    2869 conntrack.go:103] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
I1228 16:45:55.464437    2869 config.go:224] Starting endpoint slice config controller
I1228 16:45:55.464540    2869 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I1228 16:45:55.464779    2869 config.go:315] Starting service config controller
I1228 16:45:55.464828    2869 shared_informer.go:240] Waiting for caches to sync for service config
I1228 16:45:55.564923    2869 shared_informer.go:247] Caches are synced for endpoint slice config
I1228 16:45:55.565199    2869 shared_informer.go:247] Caches are synced for service config
I1228 16:45:55.574420    2869 network_policy_controller.go:149] Starting network policy controller
I1228 16:46:03.739720    2869 topology_manager.go:187] [topologymanager] Topology Admit Handler
I1228 16:46:03.768288    2869 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "local-path-provisioner-service-account-token-wnmth" (UniqueName: "kubernetes.io/secret/36077827-f878-46c6-9474-575c48df3f94-local-path-provisioner-service-account-token-wnmth") pod "local-path-provisioner-7c458769fb-sssm6" (UID: "36077827-f878-46c6-9474-575c48df3f94")
I1228 16:46:03.768568    2869 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "config-volume" (UniqueName: "kubernetes.io/configmap/36077827-f878-46c6-9474-575c48df3f94-config-volume") pod "local-path-provisioner-7c458769fb-sssm6" (UID: "36077827-f878-46c6-9474-575c48df3f94")
I1228 16:46:23.450374    2869 topology_manager.go:187] [topologymanager] Topology Admit Handler
I1228 16:46:23.545229    2869 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "values" (UniqueName: "kubernetes.io/configmap/897177e6-03db-4a81-b7b1-177d6d949819-values") pod "helm-install-traefik-g8tqb" (UID: "897177e6-03db-4a81-b7b1-177d6d949819")
I1228 16:46:23.546250    2869 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "content" (UniqueName: "kubernetes.io/configmap/897177e6-03db-4a81-b7b1-177d6d949819-content") pod "helm-install-traefik-g8tqb" (UID: "897177e6-03db-4a81-b7b1-177d6d949819")
I1228 16:46:23.547237    2869 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "helm-traefik-token-fvjsz" (UniqueName: "kubernetes.io/secret/897177e6-03db-4a81-b7b1-177d6d949819-helm-traefik-token-fvjsz") pod "helm-install-traefik-g8tqb" (UID: "897177e6-03db-4a81-b7b1-177d6d949819")
E1228 16:46:47.176310    2869 remote_image.go:113] PullImage "rancher/klipper-helm:v0.3.2" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/rancher/klipper-helm:v0.3.2": failed to extract layer sha256:d870250d9815ed31516d3a031055aa9a05349fe9f15a182dea54a59916ac563b: mount callback failed on /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount571813358: write /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount571813358/usr/bin/helm_v3: no space left on device: unknown
E1228 16:46:47.176539    2869 kuberuntime_image.go:51] Pull image "rancher/klipper-helm:v0.3.2" failed: rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/rancher/klipper-helm:v0.3.2": failed to extract layer sha256:d870250d9815ed31516d3a031055aa9a05349fe9f15a182dea54a59916ac563b: mount callback failed on /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount571813358: write /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount571813358/usr/bin/helm_v3: no space left on device: unknown
E1228 16:46:47.177385    2869 kuberuntime_manager.go:829] container &Container{Name:helm,Image:rancher/klipper-helm:v0.3.2,Command:[],Args:[install],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:NAME,Value:traefik,ValueFrom:nil,},EnvVar{Name:VERSION,Value:,ValueFrom:nil,},EnvVar{Name:REPO,Value:,ValueFrom:nil,},EnvVar{Name:HELM_DRIVER,Value:secret,ValueFrom:nil,},EnvVar{Name:CHART_NAMESPACE,Value:kube-system,ValueFrom:nil,},EnvVar{Name:CHART,Value:https://%{KUBERNETES_API}%/static/charts/traefik-1.81.0.tgz,ValueFrom:nil,},EnvVar{Name:HELM_VERSION,Value:,ValueFrom:nil,},EnvVar{Name:NO_PROXY,Value:.svc,.cluster.local,<IP_ADDRESS>/16,<IP_ADDRESS>/16,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:values,ReadOnly:false,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:content,ReadOnly:false,MountPath:/chart,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:helm-traefik-token-fvjsz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod helm-install-traefik-g8tqb_kube-system(897177e6-03db-4a81-b7b1-177d6d949819): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/rancher/klipper-helm:v0.3.2": failed to extract layer sha256:d870250d9815ed31516d3a031055aa9a05349fe9f15a182dea54a59916ac563b: mount callback failed on /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount57181E1228 16:46:48.064895    2869 pod_workers.go:191] Error syncing pod 897177e6-03db-4a81-b7b1-177d6d949819 ("helm-install-traefik-g8tqb_kube-system(897177e6-03db-4a81-b7b1-177d6d949819)"), skipping: failed to "StartContainer" for "helm" with ImagePullBackOff: "Back-off pulling image \"rancher/klipper-helm:v0.3.2\""
E1228 16:47:22.630019    2869 remote_image.go:113] PullImage "rancher/klipper-helm:v0.3.2" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/rancher/klipper-helm:v0.3.2": failed to extract layer sha256:d870250d9815ed31516d3a031055aa9a05349fe9f15a182dea54a59916ac563b: mount callback failed on /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount589282692: write /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount589282692/usr/bin/helm_v3: no space left on device: unknown
E1228 16:47:22.630301    2869 kuberuntime_image.go:51] Pull image "rancher/klipper-helm:v0.3.2" failed: rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/rancher/klipper-helm:v0.3.2": failed to extract layer sha256:d870250d9815ed31516d3a031055aa9a05349fe9f15a182dea54a59916ac563b: mount callback failed on /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount589282692: write /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount589282692/usr/bin/helm_v3: no space left on device: unknown
E1228 16:47:22.631249    2869 kuberuntime_manager.go:829] container &Container{Name:helm,Image:rancher/klipper-helm:v0.3.2,Command:[],Args:[install],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:NAME,Value:traefik,ValueFrom:nil,},EnvVar{Name:VERSION,Value:,ValueFrom:nil,},EnvVar{Name:REPO,Value:,ValueFrom:nil,},EnvVar{Name:HELM_DRIVER,Value:secret,ValueFrom:nil,},EnvVar{Name:CHART_NAMESPACE,Value:kube-system,ValueFrom:nil,},EnvVar{Name:CHART,Value:https://%{KUBERNETES_API}%/static/charts/traefik-1.81.0.tgz,ValueFrom:nil,},EnvVar{Name:HELM_VERSION,Value:,ValueFrom:nil,},EnvVar{Name:NO_PROXY,Value:.svc,.cluster.local,<IP_ADDRESS>/16,<IP_ADDRESS>/16,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:values,ReadOnly:false,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:content,ReadOnly:false,MountPath:/chart,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:helm-traefik-token-fvjsz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod helm-install-traefik-g8tqb_kube-system(897177e6-03db-4a81-b7b1-177d6d949819): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/rancher/klipper-helm:v0.3.2": failed to extract layer sha256:d870250d9815ed31516d3a031055aa9a05349fe9f15a182dea54a59916ac563b: mount callback failed on /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount589282692: write /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount589282692/usr/bin/helm_v3: no space left on device: unknown
E1228 16:47:22.631588    2869 pod_workers.go:191] Error syncing pod 897177e6-03db-4a81-b7b1-177d6d949819 ("helm-install-traefik-g8tqb_kube-system(897177e6-03db-4a81-b7b1-177d6d949819)"), skipping: failed to "StartContainer" for "helm" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/rancher/klipper-helm:v0.3.2\": failed to extract layer sha256:d870250d9815ed31516d3a031055aa9a05349fe9f15a182dea54a59916ac563b: mount callback failed on /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount589282692: write /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount589282692/usr/bin/helm_v3: no space left on device: unknown"
E1228 16:47:33.779641    2869 pod_workers.go:191] Error syncing pod 897177e6-03db-4a81-b7b1-177d6d949819 ("helm-install-traefik-g8tqb_kube-system(897177e6-03db-4a81-b7b1-177d6d949819)"), skipping: failed to "StartContainer" for "helm" with ImagePullBackOff: "Back-off pulling image \"rancher/klipper-helm:v0.3.2\""
E1228 16:48:09.073659    2869 remote_image.go:113] PullImage "rancher/klipper-helm:v0.3.2" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/rancher/klipper-helm:v0.3.2": failed to extract layer sha256:d870250d9815ed31516d3a031055aa9a05349fe9f15a182dea54a59916ac563b: mount callback failed on /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount670747882: write /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount670747882/usr/bin/helm_v3: no space left on device: unknown
E1228 16:48:09.073859    2869 kuberuntime_image.go:51] Pull image "rancher/klipper-helm:v0.3.2" failed: rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/rancher/klipper-helm:v0.3.2": failed to extract layer sha256:d870250d9815ed31516d3a031055aa9a05349fe9f15a182dea54a59916ac563b: mount callback failed on /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount670747882: write /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount670747882/usr/bin/helm_v3: no space left on device: unknown
E1228 16:48:09.074612    2869 kuberuntime_manager.go:829] container &Container{Name:helm,Image:rancher/klipper-helm:v0.3.2,Command:[],Args:[install],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:NAME,Value:traefik,ValueFrom:nil,},EnvVar{Name:VERSION,Value:,ValueFrom:nil,},EnvVar{Name:REPO,Value:,ValueFrom:nil,},EnvVar{Name:HELM_DRIVER,Value:secret,ValueFrom:nil,},EnvVar{Name:CHART_NAMESPACE,Value:kube-system,ValueFrom:nil,},EnvVar{Name:CHART,Value:https://%{KUBERNETES_API}%/static/charts/traefik-1.81.0.tgz,ValueFrom:nil,},EnvVar{Name:HELM_VERSION,Value:,ValueFrom:nil,},EnvVar{Name:NO_PROXY,Value:.svc,.cluster.local,<IP_ADDRESS>/16,<IP_ADDRESS>/16,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:values,ReadOnly:false,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:content,ReadOnly:false,MountPath:/chart,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:helm-traefik-token-fvjsz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod helm-install-traefik-g8tqb_kube-system(897177e6-03db-4a81-b7b1-177d6d949819): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/rancher/klipper-helm:v0.3.2": failed to extract layer sha256:d870250d9815ed31516d3a031055aa9a05349fe9f15a182dea54a59916ac563b: mount callback failed on /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount670747882: write /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount670747882/usr/bin/helm_v3: no space left on device: unknown
E1228 16:48:09.074907    2869 pod_workers.go:191] Error syncing pod 897177e6-03db-4a81-b7b1-177d6d949819 ("helm-install-traefik-g8tqb_kube-system(897177e6-03db-4a81-b7b1-177d6d949819)"), skipping: failed to "StartContainer" for "helm" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/rancher/klipper-helm:v0.3.2\": failed to extract layer sha256:d870250d9815ed31516d3a031055aa9a05349fe9f15a182dea54a59916ac563b: mount callback failed on /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount670747882: write /var/lib/rancher/k3s/agent/containerd/tmpmounts/containerd-mount670747882/usr/bin/helm_v3: no space left on device: unknown"
E1228 16:48:24.779749    2869 pod_workers.go:191] Error syncing pod 897177e6-03db-4a81-b7b1-177d6d949819 ("helm-install-traefik-g8tqb_kube-system(897177e6-03db-4a81-b7b1-177d6d949819)"), skipping: failed to "StartContainer" for "helm" with ImagePullBackOff: "Back-off pulling image \"rancher/klipper-helm:v0.3.2\""
E1228 16:48:38.779875    2869 pod_workers.go:191] Error syncing pod 897177e6-03db-4a81-b7b1-177d6d949819 ("helm-install-traefik-g8tqb_kube-system(897177e6-03db-4a81-b7b1-177d6d949819)"), skipping: failed to "StartContainer" for "helm" with ImagePullBackOff: "Back-off pulling image \"rancher/klipper-helm:v0.3.2\""

Most errors are very probably caused by the overlay fs I'm using, so I'm closing this issue. Thanks for the help @brandond

It is normal to see TLS Handshake errors when adding new nodes; part of the node join code validates the server certificate a couple different ways and one of these steps will generate that message.

It is normal to see TLS Handshake errors when adding new nodes; part of the node join code validates the server certificate a couple different ways and one of these steps will generate that message.


mariadb image without OS

In our workflow we use two docker images.
Image 1 : Build Tools
Image 2 : MariaDB  for testing and configuration using the enviromental variables.
Previously the image was similar to https://hub.docker.com/_/mariadb
Can this image be made with so it uses the environmetal variables for configuration?

Hi @rvdkraan All "next-gen" CircleCI convenience images are based on a common image - CircleCI-Public/cimg-base. This allows us better control over all the images as a whole, rather than inheriting from multiple different upstream images.
Which environment variables are you trying to set that are not working?

    environment:
      MYSQL_DATABASE: dbName
      MYSQL_USER: dbUser
      MYSQL_PASSWORD: dbPassword

@rvdkraan I cannot reproduce any issue with setting the environment variables described above. My sample config is as follows:
https://gist.github.com/BytesGuy/9aac2a005ddd1363b66402275c14b1d0
We do not have any plans to offer next-gen images based on different base images at this time. As such I would advise forking an existing image (like the old legacy image, or the official image you linked in the original post) that suits your needs and modify it as required: https://circleci.com/docs/2.0/custom-images/

Hi BytesGuy
is your test working because both your docker images are based on  cimg/base?
Can cimg/mariadb only be used together with an  cimg/base instead of a custom image.
Our image was generated using the wizard.

Hi @rvdkraan That's good news! I think you were affected by #12 which is now fixed 😄


provider-aws does not support source: Filesystem

What problem are you facing?
I think below source code is already self explanatory.  Official AWS Provider doesn't support source: Filesystem and as seen in the below reference it checks for Secret, IRSA, WebIdentity.
https://github.com/upbound/provider-aws/blob/main/apis/v1beta1/types.go#L175
This is blocker for migrating from deprecated providers since we have implemented injecting cloud creds from vault using Filesystem.

How could Official AWS Provider help solve your problem?

Crossplane-Contrib provider support filesystem as source. I tested the latest release by adding Filesyatem as allowed source to the ProviderConfig CRD and it works . Is it bug that the CRD is not updated ?
we use vault inject and feed credentials using side car.

The issue with using crossplane-contrib provider is that down the line if you attempt to latest API spec for provisioning resources , the composition/XR request will fail complaining about kind missing, per my conversation with Chris Haar , the filesystem support in latest api of ProviderConfig should be updated. Waiting on @haarchri  to schedule the implementation

/fresh


Init

ugh. Super glad my install script for terraform-docs is already broken

ugh. Super glad my install script for terraform-docs is already broken

See https://github.com/rhythmictech/terraform-terraform-template/pull/18

I like having it second but the more caveats we have to our rule the harder it will be to script. I like simple too.

@sblack4 I don't understand what you're referring to here


More ideas to mimic everything that is a bit silly about today's society, especially modern games and the modern web.

If you haven't noticed yet, this isn't a serious programming language. Give me more ideas to implement.

AI. Even though the logo is AI generated, BadLang™ itself is missing a mention of AI.

TOS. It could use a good long Terms of Service which has to be read for at least 10 minutes.

TOS. It could use a good long Terms of Service which has to be read for at least 10 minutes.

What about instead entering a long text instead? The text could be copied in some terminals, would still be annoying though.

2FA. The crate google-authenticator might be worth a look.

(👍 means implemented)

Cookies. Currently implementing them

TOS. It could use a good long Terms of Service which has to be read for at least 10 minutes.

What about instead entering a long text instead? The text could be copied in some terminals, would still be annoying though.

What about using different spaces so it's not copyable?

Features:

[x] Updates
[x] Account
[x] Trial/Subscription System
[x] Server outages
[x] Required Internet
[x] Location services
[x] Ads
[x] Mailing List
[x] Cookies
[x] TOS
[x] Dependency Spam
[ ] Popup-Video
[ ] Working subscriptions
[ ] Working mailing list
[ ] Working location services