LAST SEEN TYPE REASON OBJECT MESSAGE 83m Normal RequirementsUnknown clusterserviceversion/cluster-logging.v6.2.6 requirements not yet checked 83m Normal RequirementsNotMet clusterserviceversion/cluster-logging.v6.2.6 one or more requirements couldn't be found 83m Normal SuccessfulCreate replicaset/cluster-logging-operator-ff9846bd Created pod: cluster-logging-operator-ff9846bd-5qw7n 83m Normal Scheduled pod/cluster-logging-operator-ff9846bd-5qw7n Successfully assigned openshift-logging/cluster-logging-operator-ff9846bd-5qw7n to crc 83m Normal ScalingReplicaSet deployment/cluster-logging-operator Scaled up replica set cluster-logging-operator-ff9846bd to 1 83m Normal AllRequirementsMet clusterserviceversion/cluster-logging.v6.2.6 all requirements found, attempting install 83m Normal Pulling pod/cluster-logging-operator-ff9846bd-5qw7n Pulling image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:f15ebe396f96093861d528a3307a3e38ac2d4dff594f793c1e56011a3a909175" 83m Normal AddedInterface pod/cluster-logging-operator-ff9846bd-5qw7n Add eth0 [10.217.0.50/23] from ovn-kubernetes 83m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.6 waiting for install components to report healthy 83m Normal InstallWaiting clusterserviceversion/cluster-logging.v6.2.6 installing: waiting for deployment cluster-logging-operator to become ready: deployment "cluster-logging-operator" not available: Deployment does not have minimum availability. 83m Normal Pulled pod/cluster-logging-operator-ff9846bd-5qw7n Successfully pulled image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:f15ebe396f96093861d528a3307a3e38ac2d4dff594f793c1e56011a3a909175" in 9.952s (9.952s including waiting). Image size: 341609952 bytes. 83m Normal Created pod/cluster-logging-operator-ff9846bd-5qw7n Created container cluster-logging-operator 83m Normal Started pod/cluster-logging-operator-ff9846bd-5qw7n Started container cluster-logging-operator 83m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.6 install strategy completed with no errors 83m Normal Scheduled pod/logging-loki-gateway-69ffd5987-wz9b5 Successfully assigned openshift-logging/logging-loki-gateway-69ffd5987-wz9b5 to crc 83m Normal Pulling pod/logging-loki-distributor-76cc67bf56-qjz7m Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 83m Normal Scheduled pod/logging-loki-query-frontend-84558f7c9f-rjbbq Successfully assigned openshift-logging/logging-loki-query-frontend-84558f7c9f-rjbbq to crc 83m Normal ScalingReplicaSet deployment/logging-loki-querier Scaled up replica set logging-loki-querier-5895d59bb8 to 1 83m Normal SuccessfulCreate replicaset/logging-loki-querier-5895d59bb8 Created pod: logging-loki-querier-5895d59bb8-62tqd 83m Normal SuccessfulCreate replicaset/logging-loki-query-frontend-84558f7c9f Created pod: logging-loki-query-frontend-84558f7c9f-rjbbq 83m Normal ScalingReplicaSet deployment/logging-loki-query-frontend Scaled up replica set logging-loki-query-frontend-84558f7c9f to 1 83m Normal Scheduled pod/logging-loki-querier-5895d59bb8-62tqd Successfully assigned openshift-logging/logging-loki-querier-5895d59bb8-62tqd to crc 83m Normal SuccessfulCreate statefulset/logging-loki-ingester create Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester successful 83m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim wal-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 83m Normal NoPods poddisruptionbudget/logging-loki-ingester No matching pods found 83m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim storage-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 83m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway successful 83m Normal NoPods poddisruptionbudget/logging-loki-index-gateway No matching pods found 83m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Claim storage-logging-loki-index-gateway-0 Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway success 83m Normal ScalingReplicaSet deployment/logging-loki-gateway Scaled up replica set logging-loki-gateway-69ffd5987 to 2 83m Normal SuccessfulCreate replicaset/logging-loki-gateway-69ffd5987 Created pod: logging-loki-gateway-69ffd5987-jj95c 83m Normal SuccessfulCreate replicaset/logging-loki-gateway-69ffd5987 Created pod: logging-loki-gateway-69ffd5987-wz9b5 83m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-compactor-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 83m Normal ExternalProvisioning persistentvolumeclaim/wal-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 83m Normal ProvisioningSucceeded persistentvolumeclaim/wal-logging-loki-ingester-0 Successfully provisioned volume pvc-24678b1b-35e7-4280-aac3-ac65512d700e 83m Normal SuccessfulCreate statefulset/logging-loki-compactor create Claim storage-logging-loki-compactor-0 Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor success 83m Normal SuccessfulCreate statefulset/logging-loki-compactor create Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor successful 83m Normal Scheduled pod/logging-loki-distributor-76cc67bf56-qjz7m Successfully assigned openshift-logging/logging-loki-distributor-76cc67bf56-qjz7m to crc 83m Normal AddedInterface pod/logging-loki-distributor-76cc67bf56-qjz7m Add eth0 [10.217.0.52/23] from ovn-kubernetes 83m Normal Provisioning persistentvolumeclaim/storage-logging-loki-compactor-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-compactor-0" 83m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-compactor-0 Successfully provisioned volume pvc-65f24eab-f9a5-4d3d-823c-f892fd42bd3d 83m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-index-gateway-0 waiting for first consumer to be created before binding 83m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 83m Normal Provisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-index-gateway-0" 83m Normal Provisioning persistentvolumeclaim/wal-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/wal-logging-loki-ingester-0" 83m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-compactor-0 waiting for first consumer to be created before binding 83m Warning FailedMount pod/logging-loki-gateway-69ffd5987-wz9b5 MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 83m Normal WaitForFirstConsumer persistentvolumeclaim/wal-logging-loki-ingester-0 waiting for first consumer to be created before binding 83m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-ingester-0 Successfully provisioned volume pvc-20225b66-fa75-4986-8d04-e0e7e948c829 83m Normal SuccessfulCreate replicaset/logging-loki-distributor-76cc67bf56 Created pod: logging-loki-distributor-76cc67bf56-qjz7m 83m Normal ScalingReplicaSet deployment/logging-loki-distributor Scaled up replica set logging-loki-distributor-76cc67bf56 to 1 83m Normal Scheduled pod/logging-loki-gateway-69ffd5987-jj95c Successfully assigned openshift-logging/logging-loki-gateway-69ffd5987-jj95c to crc 83m Warning FailedMount pod/logging-loki-gateway-69ffd5987-jj95c MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 83m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-index-gateway-0 Successfully provisioned volume pvc-26bc9891-b714-4d6d-ab19-80e0b1e49249 83m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-ingester-0 waiting for first consumer to be created before binding 83m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 83m Normal Provisioning persistentvolumeclaim/storage-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-ingester-0" 83m Normal Pulling pod/logging-loki-query-frontend-84558f7c9f-rjbbq Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 83m Normal Pulling pod/logging-loki-compactor-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 83m Normal Pulling pod/logging-loki-querier-5895d59bb8-62tqd Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 83m Normal AddedInterface pod/logging-loki-querier-5895d59bb8-62tqd Add eth0 [10.217.0.53/23] from ovn-kubernetes 83m Normal AddedInterface pod/logging-loki-query-frontend-84558f7c9f-rjbbq Add eth0 [10.217.0.54/23] from ovn-kubernetes 83m Normal AddedInterface pod/logging-loki-gateway-69ffd5987-wz9b5 Add eth0 [10.217.0.55/23] from ovn-kubernetes 83m Normal Scheduled pod/logging-loki-compactor-0 Successfully assigned openshift-logging/logging-loki-compactor-0 to crc 83m Normal Scheduled pod/logging-loki-index-gateway-0 Successfully assigned openshift-logging/logging-loki-index-gateway-0 to crc 83m Normal Scheduled pod/logging-loki-ingester-0 Successfully assigned openshift-logging/logging-loki-ingester-0 to crc 83m Normal AddedInterface pod/logging-loki-compactor-0 Add eth0 [10.217.0.75/23] from ovn-kubernetes 83m Normal AddedInterface pod/logging-loki-index-gateway-0 Add eth0 [10.217.0.80/23] from ovn-kubernetes 83m Normal AddedInterface pod/logging-loki-ingester-0 Add eth0 [10.217.0.62/23] from ovn-kubernetes 83m Normal Pulling pod/logging-loki-index-gateway-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 83m Normal Pulling pod/logging-loki-gateway-69ffd5987-wz9b5 Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" 83m Normal Pulling pod/logging-loki-ingester-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 83m Normal Pulling pod/logging-loki-gateway-69ffd5987-jj95c Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" 83m Normal AddedInterface pod/logging-loki-gateway-69ffd5987-jj95c Add eth0 [10.217.0.61/23] from ovn-kubernetes 83m Normal Started pod/logging-loki-compactor-0 Started container loki-compactor 83m Normal Pulled pod/logging-loki-query-frontend-84558f7c9f-rjbbq Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 3.205s (3.205s including waiting). Image size: 216113723 bytes. 83m Normal Started pod/logging-loki-index-gateway-0 Started container loki-index-gateway 83m Normal Created pod/logging-loki-gateway-69ffd5987-jj95c Created container gateway 83m Normal Pulled pod/logging-loki-gateway-69ffd5987-wz9b5 Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" in 2.398s (2.398s including waiting). Image size: 179177912 bytes. 83m Normal Created pod/logging-loki-gateway-69ffd5987-wz9b5 Created container gateway 83m Normal Pulled pod/logging-loki-querier-5895d59bb8-62tqd Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 3.453s (3.453s including waiting). Image size: 216113723 bytes. 83m Normal Started pod/logging-loki-gateway-69ffd5987-jj95c Started container gateway 83m Normal Pulling pod/logging-loki-gateway-69ffd5987-jj95c Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" 83m Normal Pulled pod/logging-loki-compactor-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 2.573s (2.573s including waiting). Image size: 216113723 bytes. 83m Normal Started pod/logging-loki-query-frontend-84558f7c9f-rjbbq Started container loki-query-frontend 83m Normal Pulled pod/logging-loki-ingester-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 2.252s (2.252s including waiting). Image size: 216113723 bytes. 83m Normal Created pod/logging-loki-index-gateway-0 Created container loki-index-gateway 83m Normal Pulled pod/logging-loki-index-gateway-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 2.245s (2.245s including waiting). Image size: 216113723 bytes. 83m Normal Started pod/logging-loki-distributor-76cc67bf56-qjz7m Started container loki-distributor 83m Normal Created pod/logging-loki-distributor-76cc67bf56-qjz7m Created container loki-distributor 83m Normal Pulled pod/logging-loki-distributor-76cc67bf56-qjz7m Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 3.484s (3.484s including waiting). Image size: 216113723 bytes. 83m Normal Pulling pod/logging-loki-gateway-69ffd5987-wz9b5 Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" 83m Normal Created pod/logging-loki-query-frontend-84558f7c9f-rjbbq Created container loki-query-frontend 83m Normal Started pod/logging-loki-gateway-69ffd5987-wz9b5 Started container gateway 83m Normal Started pod/logging-loki-ingester-0 Started container loki-ingester 83m Normal Created pod/logging-loki-ingester-0 Created container loki-ingester 83m Normal Created pod/logging-loki-querier-5895d59bb8-62tqd Created container loki-querier 83m Normal Created pod/logging-loki-compactor-0 Created container loki-compactor 83m Normal Started pod/logging-loki-querier-5895d59bb8-62tqd Started container loki-querier 83m Normal Pulled pod/logging-loki-gateway-69ffd5987-jj95c Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" in 2.358s (2.358s including waiting). Image size: 179177912 bytes. 83m Normal Started pod/logging-loki-gateway-69ffd5987-wz9b5 Started container opa 83m Normal Pulled pod/logging-loki-gateway-69ffd5987-wz9b5 Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" in 2.006s (2.006s including waiting). Image size: 159515440 bytes. 83m Normal Created pod/logging-loki-gateway-69ffd5987-jj95c Created container opa 83m Normal Created pod/logging-loki-gateway-69ffd5987-wz9b5 Created container opa 83m Normal Pulled pod/logging-loki-gateway-69ffd5987-jj95c Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" in 1.91s (1.91s including waiting). Image size: 159515440 bytes. 83m Normal Started pod/logging-loki-gateway-69ffd5987-jj95c Started container opa 82m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 82m Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: HTTP probe failed with statuscode: 503 82m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 82m Warning FailedMount pod/collector-hgndg MountVolume.SetUp failed for volume "metrics" : secret "collector-metrics" not found 82m Normal Scheduled pod/collector-hgndg Successfully assigned openshift-logging/collector-hgndg to crc 82m Normal SuccessfulCreate daemonset/collector Created pod: collector-hgndg 82m Normal SuccessfulDelete daemonset/collector Deleted pod: collector-hgndg 81m Normal SuccessfulCreate daemonset/collector Created pod: collector-ql6sd 81m Normal Scheduled pod/collector-ql6sd Successfully assigned openshift-logging/collector-ql6sd to crc 81m Normal AddedInterface pod/collector-ql6sd Add eth0 [10.217.0.83/23] from ovn-kubernetes 81m Normal Pulling pod/collector-ql6sd Pulling image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:438aa27c0408214bc64d01b20f233d698fa48344aa2dd878bc090232f227c17c" 81m Normal Pulled pod/collector-ql6sd Successfully pulled image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:438aa27c0408214bc64d01b20f233d698fa48344aa2dd878bc090232f227c17c" in 6.712s (6.712s including waiting). Image size: 344503702 bytes. 81m Normal Started pod/collector-ql6sd Started container collector 81m Normal Created pod/collector-ql6sd Created container collector 76m Normal IPAllocated service/openstack-logging Assigned IP ["172.17.0.80"] 76m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/allow-shared-ip 76m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/loadBalancerIPs 76m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/address-pool 76m Normal nodeAssigned service/openstack-logging announcing from node "crc" with protocol "layer2" 13m Warning Unhealthy pod/logging-loki-querier-5895d59bb8-62tqd Readiness probe failed: Get "https://10.217.0.53:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 13m Warning ProbeError pod/logging-loki-querier-5895d59bb8-62tqd Readiness probe error: Get "https://10.217.0.53:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 13m Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: Get "https://10.217.0.62:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 13m Warning Unhealthy pod/logging-loki-compactor-0 Readiness probe failed: Get "https://10.217.0.75:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 13m Warning Unhealthy pod/logging-loki-index-gateway-0 Readiness probe failed: Get "https://10.217.0.80:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 13m Warning ProbeError pod/logging-loki-compactor-0 Readiness probe error: Get "https://10.217.0.75:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 13m Warning ProbeError pod/logging-loki-index-gateway-0 Readiness probe error: Get "https://10.217.0.80:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 13m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: Get "https://10.217.0.62:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 12m Warning Unhealthy pod/logging-loki-query-frontend-84558f7c9f-rjbbq Readiness probe failed: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 12m Warning Unhealthy pod/logging-loki-distributor-76cc67bf56-qjz7m Readiness probe failed: Get "https://10.217.0.52:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 12m Warning ProbeError pod/logging-loki-distributor-76cc67bf56-qjz7m Readiness probe error: Get "https://10.217.0.52:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 12m Warning ProbeError pod/logging-loki-querier-5895d59bb8-62tqd Readiness probe error: Get "https://10.217.0.53:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 12m Warning Unhealthy pod/logging-loki-querier-5895d59bb8-62tqd Readiness probe failed: Get "https://10.217.0.53:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 12m Warning ProbeError pod/logging-loki-query-frontend-84558f7c9f-rjbbq Readiness probe error: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 12m Warning ProbeError pod/logging-loki-gateway-69ffd5987-wz9b5 Readiness probe error: Get "https://10.217.0.55:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 12m Warning Unhealthy pod/logging-loki-gateway-69ffd5987-wz9b5 Readiness probe failed: Get "https://10.217.0.55:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 12m Warning Unhealthy pod/logging-loki-gateway-69ffd5987-jj95c Readiness probe failed: Get "https://10.217.0.61:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 12m Warning ProbeError pod/logging-loki-gateway-69ffd5987-jj95c Readiness probe error: Get "https://10.217.0.61:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 8m42s Warning Unhealthy pod/logging-loki-gateway-69ffd5987-jj95c Readiness probe failed: Get "https://10.217.0.61:8083/ready": context deadline exceeded 8m42s Warning Unhealthy pod/logging-loki-gateway-69ffd5987-jj95c Readiness probe failed: Get "https://10.217.0.61:8081/ready": context deadline exceeded 8m42s Warning ProbeError pod/logging-loki-gateway-69ffd5987-jj95c Readiness probe error: Get "https://10.217.0.61:8083/ready": context deadline exceeded... 8m42s Warning ProbeError pod/logging-loki-gateway-69ffd5987-jj95c Readiness probe error: Get "https://10.217.0.61:8081/ready": context deadline exceeded... 8m41s Warning ProbeError pod/logging-loki-gateway-69ffd5987-jj95c Liveness probe error: Get "https://10.217.0.61:8083/live": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m41s Warning Unhealthy pod/logging-loki-gateway-69ffd5987-jj95c Liveness probe failed: Get "https://10.217.0.61:8083/live": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m40s Warning ProbeError pod/logging-loki-distributor-76cc67bf56-qjz7m Readiness probe error: Get "https://10.217.0.52:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m40s Warning Unhealthy pod/logging-loki-gateway-69ffd5987-wz9b5 Liveness probe failed: Get "https://10.217.0.55:8083/live": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m40s Warning ProbeError pod/logging-loki-query-frontend-84558f7c9f-rjbbq Readiness probe error: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m40s Warning ProbeError pod/logging-loki-query-frontend-84558f7c9f-rjbbq Liveness probe error: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m40s Warning Unhealthy pod/logging-loki-query-frontend-84558f7c9f-rjbbq Liveness probe failed: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m40s Warning Unhealthy pod/logging-loki-querier-5895d59bb8-62tqd Liveness probe failed: Get "https://10.217.0.53:3101/loki/api/v1/status/buildinfo": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 8m40s Warning ProbeError pod/logging-loki-querier-5895d59bb8-62tqd Liveness probe error: Get "https://10.217.0.53:3101/loki/api/v1/status/buildinfo": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 8m40s Warning Unhealthy pod/logging-loki-querier-5895d59bb8-62tqd Readiness probe failed: Get "https://10.217.0.53:3101/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 8m40s Warning ProbeError pod/logging-loki-querier-5895d59bb8-62tqd Readiness probe error: Get "https://10.217.0.53:3101/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 8m40s Warning Unhealthy pod/logging-loki-ingester-0 Liveness probe failed: Get "https://10.217.0.62:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m40s Warning ProbeError pod/logging-loki-ingester-0 Liveness probe error: Get "https://10.217.0.62:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m40s Warning Unhealthy pod/logging-loki-gateway-69ffd5987-wz9b5 Readiness probe failed: Get "https://10.217.0.55:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m40s Warning ProbeError pod/logging-loki-gateway-69ffd5987-wz9b5 Readiness probe error: Get "https://10.217.0.55:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m40s Warning Unhealthy pod/logging-loki-query-frontend-84558f7c9f-rjbbq Readiness probe failed: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m40s Warning ProbeError pod/logging-loki-gateway-69ffd5987-wz9b5 Liveness probe error: Get "https://10.217.0.55:8083/live": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m40s Warning Unhealthy pod/logging-loki-gateway-69ffd5987-wz9b5 Liveness probe failed: Get "https://10.217.0.55:8081/live": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m40s Warning ProbeError pod/logging-loki-gateway-69ffd5987-wz9b5 Liveness probe error: Get "https://10.217.0.55:8081/live": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m40s Warning Unhealthy pod/logging-loki-gateway-69ffd5987-wz9b5 Readiness probe failed: Get "https://10.217.0.55:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m40s Warning ProbeError pod/logging-loki-gateway-69ffd5987-wz9b5 Readiness probe error: Get "https://10.217.0.55:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m40s Warning ProbeError pod/logging-loki-compactor-0 Liveness probe error: Get "https://10.217.0.75:3101/loki/api/v1/status/buildinfo": context deadline exceeded... 8m40s Warning Unhealthy pod/logging-loki-compactor-0 Liveness probe failed: Get "https://10.217.0.75:3101/loki/api/v1/status/buildinfo": context deadline exceeded 8m40s Warning Unhealthy pod/logging-loki-gateway-69ffd5987-jj95c Liveness probe failed: Get "https://10.217.0.61:8081/live": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m40s Warning ProbeError pod/logging-loki-gateway-69ffd5987-jj95c Liveness probe error: Get "https://10.217.0.61:8081/live": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m40s Warning Unhealthy pod/logging-loki-distributor-76cc67bf56-qjz7m Liveness probe failed: Get "https://10.217.0.52:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m40s Warning ProbeError pod/logging-loki-distributor-76cc67bf56-qjz7m Liveness probe error: Get "https://10.217.0.52:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m40s Warning Unhealthy pod/logging-loki-distributor-76cc67bf56-qjz7m Readiness probe failed: Get "https://10.217.0.52:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 64s Warning ProbeError pod/logging-loki-gateway-69ffd5987-jj95c Readiness probe error: Get "https://10.217.0.61:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 64s Warning Unhealthy pod/logging-loki-gateway-69ffd5987-jj95c Readiness probe failed: Get "https://10.217.0.61:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)