{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:43728-\u003e<IP_ADDRESS>:53: i/o timeout}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:43:11"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:43728-\u003e<IP_ADDRESS>:53: i/o timeout}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:43:11"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:60656-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:43:21"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:60656-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:43:21"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:60656-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:43:21"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:43:21"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:43:21"}
2021-01-20T18:44:21.391Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:60656-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:44:22"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:33455-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:44:32"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:33455-\u003e<IP_ADDRESS>:53: read: connection refused}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:44:32"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:44:42"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:44:42"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:37695-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:44:42"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:37695-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:44:42"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:37695-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:44:42"}
2021-01-20T18:45:42.413Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:37695-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:45:43"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:42941-\u003e<IP_ADDRESS>:53: i/o timeout}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:45:53"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:42941-\u003e<IP_ADDRESS>:53: i/o timeout}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:45:53"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55955-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:46:03"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55955-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:46:03"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55955-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:46:03"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:46:03"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:46:03"}
2021-01-20T18:47:03.495Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55955-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:47:04"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:40828-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:47:14"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:40828-\u003e<IP_ADDRESS>:53: read: connection refused}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:47:14"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55967-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:47:24"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55967-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:47:24"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55967-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:47:24"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:47:24"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:47:24"}
2021-01-20T18:48:24.512Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55967-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:48:25"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:60719-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:48:35"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:60719-\u003e<IP_ADDRESS>:53: read: connection refused}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:48:35"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:49105-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:48:45"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:48:45"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:48:45"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:49105-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:48:45"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:49105-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:48:45"}
2021-01-20T18:49:45.809Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:49105-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:49:48"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56211-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:49:58"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56211-\u003e<IP_ADDRESS>:53: read: connection refused}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:49:58"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:50:08"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:50:08"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:35794-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:50:08"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:35794-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:50:08"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:35794-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:50:08"}
2021-01-20T18:51:08.390Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:35794-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:51:13"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:37615-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:51:23"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:37615-\u003e<IP_ADDRESS>:53: read: connection refused}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:51:23"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:51:33"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:51:33"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:33459-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:51:33"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:33459-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:51:33"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:33459-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:51:33"}
2021-01-20T18:52:33.531Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:33459-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:52:43"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56705-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:52:53"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56705-\u003e<IP_ADDRESS>:53: read: connection refused}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:52:53"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:53:03"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:53:03"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:53718-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:53:03"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:53718-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:53:03"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:53718-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:53:03"}
2021-01-20T18:54:03.787Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:53718-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:54:24"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:40206-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:54:34"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:40206-\u003e<IP_ADDRESS>:53: read: connection refused}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:54:34"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56135-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:54:44"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56135-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:54:44"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56135-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:54:44"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:54:44"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:54:44"}
2021-01-20T18:55:44.285Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56135-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:56:25"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:41038-\u003e<IP_ADDRESS>:53: i/o timeout}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:56:35"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:41038-\u003e<IP_ADDRESS>:53: i/o timeout}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:56:35"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:56:45"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:56:45"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55560-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:56:45"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55560-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:56:45"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55560-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:56:45"}
2021-01-20T18:57:45.265Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55560-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:59:07"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:48485-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:59:12"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:48485-\u003e<IP_ADDRESS>:53: read: connection refused}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:59:12"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:59:27"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:59:27"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:60223-\u003e<IP_ADDRESS>:53: i/o timeout}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:59:27"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:60223-\u003e<IP_ADDRESS>:53: i/o timeout}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:59:27"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:60223-\u003e<IP_ADDRESS>:53: i/o timeout}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 18:59:27"}
2021-01-20T19:00:27.206Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:60223-><IP_ADDRESS>:53: i/o timeout}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:03:11"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:33642-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:03:21"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:33642-\u003e<IP_ADDRESS>:53: read: connection refused}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:03:21"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:58418-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:03:31"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:58418-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:03:31"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:58418-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:03:31"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:03:31"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:03:31"}
2021-01-20T19:04:31.088Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:58418-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:09:58"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:34007-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:10:08"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:34007-\u003e<IP_ADDRESS>:53: read: connection refused}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:10:08"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:38086-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:10:18"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:10:18"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:38086-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:10:18"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:38086-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:10:18"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:10:18"}
2021-01-20T19:11:18.794Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:38086-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:22:14"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:49062-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:22:24"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:49062-\u003e<IP_ADDRESS>:53: read: connection refused}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:22:24"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:41543-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:22:34"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:41543-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:22:34"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:41543-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:22:34"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:22:34"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:22:34"}
2021-01-20T19:23:34.169Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:41543-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:40:14"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56057-\u003e<IP_ADDRESS>:53: i/o timeout}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:40:24"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56057-\u003e<IP_ADDRESS>:53: i/o timeout}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:40:24"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:44567-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:40:34"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:40:34"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:40:34"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:44567-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:40:34"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:44567-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:40:34"}
2021-01-20T19:41:34.188Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:44567-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:58:14"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:54735-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:58:24"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:54735-\u003e<IP_ADDRESS>:53: read: connection refused}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:58:24"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:37477-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:58:34"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:37477-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:58:34"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:37477-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:58:34"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:58:34"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 19:58:34"}
2021-01-20T19:59:34.208Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:37477-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:16:14"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:41748-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:16:24"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:41748-\u003e<IP_ADDRESS>:53: read: connection refused}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:16:24"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:16:34"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:16:34"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56204-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:16:34"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56204-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:16:34"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56204-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:16:34"}
2021-01-20T20:17:34.225Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:56204-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90
{"Message":"Renewing the cluster identity certificate","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:34:14"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55918-\u003e<IP_ADDRESS>:53: i/o timeout}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:34:24"}
{"Message":"Error: in the HTTP get error : {Failed to get regional uri with error: {Get https://gbl.his.arc.azure.com/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.arc.azure.com on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:55918-\u003e<IP_ADDRESS>:53: i/o timeout}}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:34:24"}
{"Message":"Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:54662-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:34:34"}
{"Message":"Get regional uri from HIS","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:34:34"}
{"Message":"Failed to get a new cert","LogType":"ConfigAgentTrace","LogLevel":"Information","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:34:34"}
{"Message":"Error retrieving the regional uri Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:54662-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:34:34"}
{"Message":"Get Cluster Certificate failed Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus\u0026api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:54662-\u003e<IP_ADDRESS>:53: read: connection refused}","LogType":"ConfigAgentTrace","LogLevel":"Error","Environment":"prod","Role":"ClusterConfigAgent","Location":"eastus","ArmId":"/subscriptions/31f5155e-45b8-476d-aac8-e5e33a43d26e/resourceGroups/aa-cluster-rg/providers/Microsoft.Kubernetes/ConnectedClusters/AArcTest","CorrelationId":"","AgentName":"ControllerManager","AgentVersion":"0.2.28","AgentTimestamp":"2021/01/20 20:34:34"}
2021-01-20T20:35:34.291Z	ERROR	controller	Reconciler error	{"reconcilerGroup": "clusterconfig.azure.com", "reconcilerKind": "AzureClusterIdentityRequest", "controller": "azureclusteridentityrequest", "name": "config-agent-identity-request", "namespace": "azure-arc", "error": "Failed to get regional uri with error: {Get https://gbl.his.hybridcompute.azure-automation.net/discovery?location=eastus&api-version=1.0-preview: dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:54662-><IP_ADDRESS>:53: read: connection refused}"}
github.com/go-logr/zapr.(*zapLogger).Error
/home/vsts/work/1/s/gopath/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:246
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:218
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker
/home/vsts/work/1/s/gopath/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.3/pkg/internal/controller/controller.go:197
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:155
k8s.io/apimachinery/pkg/util/wait.BackoffUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:156
k8s.io/apimachinery/pkg/util/wait.JitterUntil
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:133
k8s.io/apimachinery/pkg/util/wait.Until
/home/vsts/work/1/s/gopath/pkg/mod/k8s.io/apimachinery@v0.18.6/pkg/util/wait/wait.go:90

@likamrat @@shashankbarsin  Any observations? Thanks

@likamrat @@shashankbarsin  Any observations? Thanks

@shashankbarsin  Can you please take a look at the logs shared and help root cause whats the issue with Azure-arc kubernetes connector?

@shashankbarsin  Can you please take a look at the logs shared and help root cause whats the issue with Azure-arc kubernetes connector?

@psakamoori:
"dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:60223-\u003e<IP_ADDRESS>:53: i/o" - this line and UDP port 53 is indicative of a DNS lookup issue on the underlying Kubernetes cluster setup and not of the agents. To confirm, please run the following steps:

Apply this manifest on your cluster
apiVersion: v1
kind: Pod
metadata:
  name: shell-demo
spec:
  volumes:
  - name: shared-data
    emptyDir: {}
  containers:
  - name: nginx
    image: nginx
    volumeMounts:
    - name: shared-data
      mountPath: /usr/share/nginx/html

Wait for the shell-demo applied in #1 to reach Running state

Run the following command to get a shell to the running container:
kubectl exec --stdin --tty shell-demo -- /bin/bash

Run the following command in the shell session of the container to check if you are able to get a successful response back. If not and if there's an issue with DNS resolution, then we get confirmation that it is indeed an issue with the underlying Kubernetes cluster setup
curl https://ipinfo.io -v

@psakamoori:
"dial tcp: lookup gbl.his.hybridcompute.azure-automation.net on <IP_ADDRESS>:53: read udp <IP_ADDRESS>:60223-\u003e<IP_ADDRESS>:53: i/o" - this line and UDP port 53 is indicative of a DNS lookup issue on the underlying Kubernetes cluster setup and not of the agents. To confirm, please run the following steps:

Apply this manifest on your cluster
apiVersion: v1
kind: Pod
metadata:
  name: shell-demo
spec:
  volumes:
  - name: shared-data
    emptyDir: {}
  containers:
  - name: nginx
    image: nginx
    volumeMounts:
    - name: shared-data
      mountPath: /usr/share/nginx/html

Wait for the shell-demo applied in #1 to reach Running state

Run the following command to get a shell to the running container:
kubectl exec --stdin --tty shell-demo -- /bin/bash

Run the following command in the shell session of the container to check if you are able to get a successful response back. If not and if there's an issue with DNS resolution, then we get confirmation that it is indeed an issue with the underlying Kubernetes cluster setup
curl https://ipinfo.io -v

@psakamoori since this is not a Jumpstart scenario you are trying, please open a support ticket via the Azure portal.
I will go ahead and close this for now.

@psakamoori since this is not a Jumpstart scenario you are trying, please open a support ticket via the Azure portal.
I will go ahead and close this for now.

@likamrat this is a Jumpstart scenario -  just trying to connect cluster to azure-arc is failing - this is very basic step.
Please kindly reopen this ticket..As requested by @shashankbarsin  will send out further logs

@likamrat this is a Jumpstart scenario -  just trying to connect cluster to azure-arc is failing - this is very basic step.
Please kindly reopen this ticket..As requested by @shashankbarsin  will send out further logs

I will reopen this for now.
Jumpstart scenario is what included in this repo.  We are not covering Azure Docs as you pointed out using when opening the issue.
https://docs.microsoft.com/en-us/azure/azure-arc/kubernetes/connect-cluster

I will reopen this for now.
Jumpstart scenario is what included in this repo.  We are not covering Azure Docs as you pointed out using when opening the issue.
https://docs.microsoft.com/en-us/azure/azure-arc/kubernetes/connect-cluster

@shashankbarsin  - Thanks for the details...tried the same and below are logs...
kubectl exec --stdin --tty shell-demo -- /bin/bash
root@shell-demo:/# curl https://ipinfo.io -v

Expire in 0 ms for 6 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 2 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 2 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 2 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 2 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 2 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 2 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 2 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 2 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 2 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 2 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 2 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 2 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Could not resolve host: ipinfo.io
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Closing connection 0
curl: (6) Could not resolve host: ipinfo.io
root@shell-demo:/# command terminated with exit code 137

seems DNS is not set correctly..
Question: As explained here: https://docs.microsoft.com/en-us/azure/azure-arc/kubernetes/connect-cluster

Endpoint (DNS)
Description

https://management.azure.com
Required for the agent to connect to Azure and register the cluster

https://eastus.dp.kubernetesconfiguration.azure.com, https://westeurope.dp.kubernetesconfiguration.azure.com
Data plane endpoint for the agent to push status and fetch configuration information

https://login.microsoftonline.com
Required to fetch and update Azure Resource Manager tokens

https://mcr.microsoft.com
Required to pull container images for Azure Arc agents

https://eus.his.arc.azure.com, https://weu.his.arc.azure.com
Required to pull system-assigned managed identity certificates

Failure is bcoz I did not set above outbound URLS? Any pointers to set these..thank you

@shashankbarsin  - Thanks for the details...tried the same and below are logs...
kubectl exec --stdin --tty shell-demo -- /bin/bash
root@shell-demo:/# curl https://ipinfo.io -v

Expire in 0 ms for 6 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)
Expire in 1 ms for 1 (transfer 0x5635506aef90)
Expire in 0 ms for 1 (transfer 0x5635506aef90)