LAST SEEN TYPE REASON OBJECT MESSAGE 83m Normal RequirementsUnknown clusterserviceversion/cluster-logging.v6.2.9 requirements not yet checked 83m Normal RequirementsNotMet clusterserviceversion/cluster-logging.v6.2.9 one or more requirements couldn't be found 83m Normal AllRequirementsMet clusterserviceversion/cluster-logging.v6.2.9 all requirements found, attempting install 83m Normal SuccessfulCreate replicaset/cluster-logging-operator-66689c4bbf Created pod: cluster-logging-operator-66689c4bbf-wq7db 83m Normal Scheduled pod/cluster-logging-operator-66689c4bbf-wq7db Successfully assigned openshift-logging/cluster-logging-operator-66689c4bbf-wq7db to crc 83m Normal ScalingReplicaSet deployment/cluster-logging-operator Scaled up replica set cluster-logging-operator-66689c4bbf to 1 83m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.9 waiting for install components to report healthy 83m Normal InstallWaiting clusterserviceversion/cluster-logging.v6.2.9 installing: waiting for deployment cluster-logging-operator to become ready: deployment "cluster-logging-operator" not available: Deployment does not have minimum availability. 83m Normal Pulling pod/cluster-logging-operator-66689c4bbf-wq7db Pulling image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:bf86702a43f0ab4fda541a3aa8ace4560088be90be5eb59cd475ce1d97f5afef" 83m Normal AddedInterface pod/cluster-logging-operator-66689c4bbf-wq7db Add eth0 [10.217.0.51/23] from ovn-kubernetes 83m Normal Created pod/cluster-logging-operator-66689c4bbf-wq7db Created container cluster-logging-operator 83m Normal Started pod/cluster-logging-operator-66689c4bbf-wq7db Started container cluster-logging-operator 83m Normal Pulled pod/cluster-logging-operator-66689c4bbf-wq7db Successfully pulled image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:bf86702a43f0ab4fda541a3aa8ace4560088be90be5eb59cd475ce1d97f5afef" in 15.201s (15.201s including waiting). Image size: 343887794 bytes. 83m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.9 install strategy completed with no errors 82m Normal SuccessfulCreate statefulset/logging-loki-compactor create Claim storage-logging-loki-compactor-0 Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor success 82m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-ingester-0 Successfully provisioned volume pvc-a3a5559a-70aa-49f4-9355-10339c24eb8e 82m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-compactor-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 82m Normal SuccessfulCreate statefulset/logging-loki-ingester create Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester successful 82m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim wal-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 82m Normal Scheduled pod/logging-loki-querier-6dcbdf8bb8-jp89f Successfully assigned openshift-logging/logging-loki-querier-6dcbdf8bb8-jp89f to crc 82m Normal ScalingReplicaSet deployment/logging-loki-querier Scaled up replica set logging-loki-querier-6dcbdf8bb8 to 1 82m Normal Scheduled pod/logging-loki-query-frontend-ff66c4dc9-82dsb Successfully assigned openshift-logging/logging-loki-query-frontend-ff66c4dc9-82dsb to crc 82m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim storage-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 82m Normal ScalingReplicaSet deployment/logging-loki-query-frontend Scaled up replica set logging-loki-query-frontend-ff66c4dc9 to 1 82m Normal SuccessfulCreate replicaset/logging-loki-query-frontend-ff66c4dc9 Created pod: logging-loki-query-frontend-ff66c4dc9-82dsb 82m Normal SuccessfulCreate replicaset/logging-loki-querier-6dcbdf8bb8 Created pod: logging-loki-querier-6dcbdf8bb8-jp89f 82m Normal NoPods poddisruptionbudget/logging-loki-ingester No matching pods found 82m Normal ScalingReplicaSet deployment/logging-loki-distributor Scaled up replica set logging-loki-distributor-9c6b6d984 to 1 82m Normal SuccessfulCreate replicaset/logging-loki-distributor-9c6b6d984 Created pod: logging-loki-distributor-9c6b6d984-xjvbj 82m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-ingester-0 waiting for first consumer to be created before binding 82m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 82m Normal Provisioning persistentvolumeclaim/storage-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-ingester-0" 82m Normal ProvisioningSucceeded persistentvolumeclaim/wal-logging-loki-ingester-0 Successfully provisioned volume pvc-aa917a11-7323-4ac7-a103-f4cc2701a09e 82m Normal ExternalProvisioning persistentvolumeclaim/wal-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 82m Normal Provisioning persistentvolumeclaim/wal-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/wal-logging-loki-ingester-0" 82m Normal WaitForFirstConsumer persistentvolumeclaim/wal-logging-loki-ingester-0 waiting for first consumer to be created before binding 82m Normal Provisioning persistentvolumeclaim/storage-logging-loki-compactor-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-compactor-0" 82m Normal SuccessfulCreate statefulset/logging-loki-compactor create Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor successful 82m Normal Scheduled pod/logging-loki-distributor-9c6b6d984-xjvbj Successfully assigned openshift-logging/logging-loki-distributor-9c6b6d984-xjvbj to crc 82m Normal SuccessfulCreate replicaset/logging-loki-gateway-fc6d448bf Created pod: logging-loki-gateway-fc6d448bf-w5jpj 82m Warning FailedMount pod/logging-loki-gateway-fc6d448bf-w5jpj MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 82m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-compactor-0 Successfully provisioned volume pvc-be7fe9e1-0f8a-4f57-b329-67b7e07a76bb 82m Normal WaitForPodScheduled persistentvolumeclaim/storage-logging-loki-index-gateway-0 waiting for pod logging-loki-index-gateway-0 to be scheduled 82m Normal ScalingReplicaSet deployment/logging-loki-gateway Scaled up replica set logging-loki-gateway-fc6d448bf to 2 82m Normal AddedInterface pod/logging-loki-distributor-9c6b6d984-xjvbj Add eth0 [10.217.0.54/23] from ovn-kubernetes 82m Normal Provisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-index-gateway-0" 82m Normal Scheduled pod/logging-loki-gateway-fc6d448bf-w5jpj Successfully assigned openshift-logging/logging-loki-gateway-fc6d448bf-w5jpj to crc 82m Normal Pulling pod/logging-loki-distributor-9c6b6d984-xjvbj Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" 82m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-index-gateway-0 Successfully provisioned volume pvc-a0b65898-2b59-4113-81c7-c4c3ba906e61 82m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 82m Normal Scheduled pod/logging-loki-ingester-0 Successfully assigned openshift-logging/logging-loki-ingester-0 to crc 82m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway successful 82m Normal Scheduled pod/logging-loki-gateway-fc6d448bf-bl8th Successfully assigned openshift-logging/logging-loki-gateway-fc6d448bf-bl8th to crc 82m Warning FailedMount pod/logging-loki-gateway-fc6d448bf-bl8th MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 82m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Claim storage-logging-loki-index-gateway-0 Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway success 82m Normal Scheduled pod/logging-loki-compactor-0 Successfully assigned openshift-logging/logging-loki-compactor-0 to crc 82m Normal SuccessfulCreate replicaset/logging-loki-gateway-fc6d448bf Created pod: logging-loki-gateway-fc6d448bf-bl8th 82m Normal AddedInterface pod/logging-loki-querier-6dcbdf8bb8-jp89f Add eth0 [10.217.0.55/23] from ovn-kubernetes 82m Normal Scheduled pod/logging-loki-index-gateway-0 Successfully assigned openshift-logging/logging-loki-index-gateway-0 to crc 82m Normal Pulling pod/logging-loki-query-frontend-ff66c4dc9-82dsb Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" 82m Normal AddedInterface pod/logging-loki-query-frontend-ff66c4dc9-82dsb Add eth0 [10.217.0.56/23] from ovn-kubernetes 82m Normal AddedInterface pod/logging-loki-ingester-0 Add eth0 [10.217.0.60/23] from ovn-kubernetes 82m Normal Pulling pod/logging-loki-querier-6dcbdf8bb8-jp89f Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" 82m Normal AddedInterface pod/logging-loki-compactor-0 Add eth0 [10.217.0.61/23] from ovn-kubernetes 82m Normal AddedInterface pod/logging-loki-gateway-fc6d448bf-w5jpj Add eth0 [10.217.0.58/23] from ovn-kubernetes 82m Normal Pulling pod/logging-loki-gateway-fc6d448bf-w5jpj Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:f4f8fc520eae06a5c7d8b98ef21bad88253666fc27db9b6bf35b19a63173a167" 82m Normal Pulling pod/logging-loki-compactor-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" 82m Normal Pulling pod/logging-loki-ingester-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" 82m Normal Pulling pod/logging-loki-index-gateway-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" 82m Normal AddedInterface pod/logging-loki-gateway-fc6d448bf-bl8th Add eth0 [10.217.0.57/23] from ovn-kubernetes 82m Normal Pulling pod/logging-loki-gateway-fc6d448bf-bl8th Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:f4f8fc520eae06a5c7d8b98ef21bad88253666fc27db9b6bf35b19a63173a167" 82m Normal AddedInterface pod/logging-loki-index-gateway-0 Add eth0 [10.217.0.62/23] from ovn-kubernetes 82m Normal Created pod/logging-loki-querier-6dcbdf8bb8-jp89f Created container loki-querier 82m Normal Pulled pod/logging-loki-index-gateway-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" in 2.161s (2.161s including waiting). Image size: 225648085 bytes. 82m Normal Pulled pod/logging-loki-query-frontend-ff66c4dc9-82dsb Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" in 3.158s (3.158s including waiting). Image size: 225648085 bytes. 82m Normal Started pod/logging-loki-distributor-9c6b6d984-xjvbj Started container loki-distributor 82m Normal Created pod/logging-loki-query-frontend-ff66c4dc9-82dsb Created container loki-query-frontend 82m Normal Pulled pod/logging-loki-distributor-9c6b6d984-xjvbj Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" in 3.55s (3.55s including waiting). Image size: 225648085 bytes. 82m Normal Pulled pod/logging-loki-querier-6dcbdf8bb8-jp89f Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" in 2.78s (2.78s including waiting). Image size: 225648085 bytes. 82m Normal Started pod/logging-loki-querier-6dcbdf8bb8-jp89f Started container loki-querier 82m Normal Started pod/logging-loki-compactor-0 Started container loki-compactor 82m Normal Created pod/logging-loki-distributor-9c6b6d984-xjvbj Created container loki-distributor 82m Normal Created pod/logging-loki-index-gateway-0 Created container loki-index-gateway 82m Normal Started pod/logging-loki-index-gateway-0 Started container loki-index-gateway 82m Normal Created pod/logging-loki-compactor-0 Created container loki-compactor 82m Normal Pulled pod/logging-loki-compactor-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" in 1.911s (1.911s including waiting). Image size: 225648085 bytes. 82m Normal Started pod/logging-loki-query-frontend-ff66c4dc9-82dsb Started container loki-query-frontend 82m Normal Pulled pod/logging-loki-ingester-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" in 2.307s (2.307s including waiting). Image size: 225648085 bytes. 82m Normal Started pod/logging-loki-ingester-0 Started container loki-ingester 82m Normal Created pod/logging-loki-ingester-0 Created container loki-ingester 82m Normal Started pod/logging-loki-gateway-fc6d448bf-bl8th Started container gateway 82m Normal Started pod/logging-loki-gateway-fc6d448bf-w5jpj Started container gateway 82m Normal Pulled pod/logging-loki-gateway-fc6d448bf-bl8th Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:f4f8fc520eae06a5c7d8b98ef21bad88253666fc27db9b6bf35b19a63173a167" in 4.023s (4.023s including waiting). Image size: 181406084 bytes. 82m Normal Pulling pod/logging-loki-gateway-fc6d448bf-w5jpj Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:d385c61e4b289c60cbb712e7c85c4af518e680cf24e9f7fb10acae2b281f08e8" 82m Normal Created pod/logging-loki-gateway-fc6d448bf-bl8th Created container gateway 82m Normal Created pod/logging-loki-gateway-fc6d448bf-w5jpj Created container gateway 82m Normal Pulling pod/logging-loki-gateway-fc6d448bf-bl8th Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:d385c61e4b289c60cbb712e7c85c4af518e680cf24e9f7fb10acae2b281f08e8" 82m Normal Pulled pod/logging-loki-gateway-fc6d448bf-w5jpj Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:f4f8fc520eae06a5c7d8b98ef21bad88253666fc27db9b6bf35b19a63173a167" in 4.043s (4.043s including waiting). Image size: 181406084 bytes. 82m Normal Pulled pod/logging-loki-gateway-fc6d448bf-w5jpj Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:d385c61e4b289c60cbb712e7c85c4af518e680cf24e9f7fb10acae2b281f08e8" in 2.378s (2.378s including waiting). Image size: 161395402 bytes. 82m Normal Created pod/logging-loki-gateway-fc6d448bf-w5jpj Created container opa 82m Normal Started pod/logging-loki-gateway-fc6d448bf-w5jpj Started container opa 82m Normal Created pod/logging-loki-gateway-fc6d448bf-bl8th Created container opa 82m Normal Pulled pod/logging-loki-gateway-fc6d448bf-bl8th Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:d385c61e4b289c60cbb712e7c85c4af518e680cf24e9f7fb10acae2b281f08e8" in 5.021s (5.021s including waiting). Image size: 161395402 bytes. 82m Normal Started pod/logging-loki-gateway-fc6d448bf-bl8th Started container opa 82m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 81m Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: HTTP probe failed with statuscode: 503 81m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 81m Normal Scheduled pod/collector-fkvvk Successfully assigned openshift-logging/collector-fkvvk to crc 81m Normal SuccessfulDelete daemonset/collector Deleted pod: collector-fkvvk 81m Normal SuccessfulCreate daemonset/collector Created pod: collector-fkvvk 81m Warning FailedMount pod/collector-fkvvk MountVolume.SetUp failed for volume "collector-syslog-receiver" : secret "collector-syslog-receiver" not found 81m Warning FailedMount pod/collector-fkvvk MountVolume.SetUp failed for volume "metrics" : secret "collector-metrics" not found 81m Normal Pulling pod/collector-8mmd4 Pulling image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:bacedab86fc0ed94a09cfa903e4d88e85b321df18224c43efcba4f6640aa8203" 81m Normal Scheduled pod/collector-8mmd4 Successfully assigned openshift-logging/collector-8mmd4 to crc 81m Normal AddedInterface pod/collector-8mmd4 Add eth0 [10.217.0.64/23] from ovn-kubernetes 81m Normal SuccessfulCreate daemonset/collector Created pod: collector-8mmd4 81m Normal Started pod/collector-8mmd4 Started container collector 81m Normal Created pod/collector-8mmd4 Created container collector 81m Normal Pulled pod/collector-8mmd4 Successfully pulled image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:bacedab86fc0ed94a09cfa903e4d88e85b321df18224c43efcba4f6640aa8203" in 5.756s (5.756s including waiting). Image size: 263139944 bytes. 75m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/loadBalancerIPs 75m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/allow-shared-ip 75m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/address-pool 75m Normal IPAllocated service/openstack-logging Assigned IP ["172.17.0.80"] 75m Normal nodeAssigned service/openstack-logging announcing from node "crc" with protocol "layer2" 71m Warning ProbeError pod/logging-loki-gateway-fc6d448bf-w5jpj Liveness probe error: Get "https://10.217.0.58:8083/live": context deadline exceeded... 71m Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-w5jpj Liveness probe failed: Get "https://10.217.0.58:8083/live": context deadline exceeded 71m Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-bl8th Liveness probe failed: Get "https://10.217.0.57:8081/live": write tcp 10.217.0.2:49222->10.217.0.57:8081: write: broken pipe 71m Warning ProbeError pod/logging-loki-gateway-fc6d448bf-bl8th Liveness probe error: Get "https://10.217.0.57:8081/live": write tcp 10.217.0.2:49222->10.217.0.57:8081: write: broken pipe... 71m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: Get "https://10.217.0.60:3101/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 71m Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: Get "https://10.217.0.60:3101/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 71m Warning ProbeError pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe error: Get "https://10.217.0.58:8083/ready": context deadline exceeded... 71m Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe failed: Get "https://10.217.0.58:8083/ready": context deadline exceeded 71m Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-bl8th Readiness probe failed: Get "https://10.217.0.57:8081/ready": context deadline exceeded 71m Warning ProbeError pod/logging-loki-gateway-fc6d448bf-bl8th Readiness probe error: Get "https://10.217.0.57:8083/ready": context deadline exceeded... 71m Warning ProbeError pod/logging-loki-gateway-fc6d448bf-bl8th Readiness probe error: Get "https://10.217.0.57:8081/ready": context deadline exceeded... 71m Warning ProbeError pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe error: Get "https://10.217.0.58:8081/ready": context deadline exceeded... 71m Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe failed: Get "https://10.217.0.58:8081/ready": context deadline exceeded 71m Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-bl8th Readiness probe failed: Get "https://10.217.0.57:8083/ready": context deadline exceeded 71m Warning ProbeError pod/logging-loki-query-frontend-ff66c4dc9-82dsb Readiness probe error: Get "https://10.217.0.56:3101/loki/api/v1/status/buildinfo": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 71m Warning ProbeError pod/logging-loki-querier-6dcbdf8bb8-jp89f Readiness probe error: Get "https://10.217.0.55:3101/ready": dial tcp 10.217.0.55:3101: i/o timeout... 71m Warning Unhealthy pod/logging-loki-querier-6dcbdf8bb8-jp89f Readiness probe failed: Get "https://10.217.0.55:3101/ready": dial tcp 10.217.0.55:3101: i/o timeout 71m Warning Unhealthy pod/logging-loki-query-frontend-ff66c4dc9-82dsb Readiness probe failed: Get "https://10.217.0.56:3101/loki/api/v1/status/buildinfo": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 8m29s Warning ProbeError pod/logging-loki-querier-6dcbdf8bb8-jp89f Readiness probe error: Get "https://10.217.0.55:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 8m29s Warning Unhealthy pod/logging-loki-query-frontend-ff66c4dc9-82dsb Readiness probe failed: Get "https://10.217.0.56:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 8m29s Warning ProbeError pod/logging-loki-query-frontend-ff66c4dc9-82dsb Readiness probe error: Get "https://10.217.0.56:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 8m29s Warning Unhealthy pod/logging-loki-querier-6dcbdf8bb8-jp89f Readiness probe failed: Get "https://10.217.0.55:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 8m23s Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe failed: Get "https://10.217.0.58:8083/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 8m23s Warning ProbeError pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe error: Get "https://10.217.0.58:8083/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 8m23s Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-bl8th Readiness probe failed: Get "https://10.217.0.57:8081/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 8m23s Warning ProbeError pod/logging-loki-gateway-fc6d448bf-bl8th Readiness probe error: Get "https://10.217.0.57:8081/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 8m18s Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: Get "https://10.217.0.60:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 8m18s Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: Get "https://10.217.0.60:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 8m13s Warning ProbeError pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe error: Get "https://10.217.0.58:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m13s Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe failed: Get "https://10.217.0.58:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m13s Warning ProbeError pod/logging-loki-gateway-fc6d448bf-bl8th Readiness probe error: Get "https://10.217.0.57:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m13s Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-bl8th Readiness probe failed: Get "https://10.217.0.57:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m13s Warning ProbeError pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe error: Get "https://10.217.0.58:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 8m13s Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe failed: Get "https://10.217.0.58:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 8m9s Warning ProbeError pod/logging-loki-distributor-9c6b6d984-xjvbj Readiness probe error: Get "https://10.217.0.54:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m9s Warning Unhealthy pod/logging-loki-distributor-9c6b6d984-xjvbj Readiness probe failed: Get "https://10.217.0.54:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m8s Warning Unhealthy pod/logging-loki-index-gateway-0 Readiness probe failed: Get "https://10.217.0.62:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m8s Warning Unhealthy pod/logging-loki-distributor-9c6b6d984-xjvbj Liveness probe failed: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": context deadline exceeded 8m8s Warning ProbeError pod/logging-loki-compactor-0 Readiness probe error: Get "https://10.217.0.61:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m8s Warning Unhealthy pod/logging-loki-querier-6dcbdf8bb8-jp89f Liveness probe failed: Get "https://10.217.0.55:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m8s Warning ProbeError pod/logging-loki-index-gateway-0 Readiness probe error: Get "https://10.217.0.62:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m8s Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe failed: Get "https://10.217.0.58:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m8s Warning ProbeError pod/logging-loki-query-frontend-ff66c4dc9-82dsb Readiness probe error: Get "https://10.217.0.56:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m8s Warning Unhealthy pod/logging-loki-query-frontend-ff66c4dc9-82dsb Readiness probe failed: Get "https://10.217.0.56:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m8s Warning ProbeError pod/logging-loki-query-frontend-ff66c4dc9-82dsb Liveness probe error: Get "https://10.217.0.56:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m8s Warning Unhealthy pod/logging-loki-query-frontend-ff66c4dc9-82dsb Liveness probe failed: Get "https://10.217.0.56:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m8s Warning ProbeError pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe error: Get "https://10.217.0.58:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m8s Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe failed: Get "https://10.217.0.58:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 8m8s Warning ProbeError pod/logging-loki-gateway-fc6d448bf-w5jpj Readiness probe error: Get "https://10.217.0.58:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 8m8s Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: Get "https://10.217.0.60:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m8s Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: Get "https://10.217.0.60:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m8s Warning Unhealthy pod/logging-loki-compactor-0 Readiness probe failed: Get "https://10.217.0.61:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m8s Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-bl8th Readiness probe failed: Get "https://10.217.0.57:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 8m8s Warning ProbeError pod/logging-loki-querier-6dcbdf8bb8-jp89f Liveness probe error: Get "https://10.217.0.55:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m8s Warning ProbeError pod/logging-loki-gateway-fc6d448bf-bl8th Readiness probe error: Get "https://10.217.0.57:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 8m8s Warning Unhealthy pod/logging-loki-gateway-fc6d448bf-bl8th Readiness probe failed: Get "https://10.217.0.57:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 8m8s Warning ProbeError pod/logging-loki-gateway-fc6d448bf-bl8th Readiness probe error: Get "https://10.217.0.57:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 8m8s Warning Unhealthy pod/logging-loki-querier-6dcbdf8bb8-jp89f Readiness probe failed: Get "https://10.217.0.55:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m8s Warning ProbeError pod/logging-loki-querier-6dcbdf8bb8-jp89f Readiness probe error: Get "https://10.217.0.55:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m8s Warning Unhealthy pod/logging-loki-distributor-9c6b6d984-xjvbj Readiness probe failed: Get "https://10.217.0.54:3101/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 8m8s Warning ProbeError pod/logging-loki-distributor-9c6b6d984-xjvbj Readiness probe error: Get "https://10.217.0.54:3101/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 8m8s Warning ProbeError pod/logging-loki-distributor-9c6b6d984-xjvbj Liveness probe error: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": context deadline exceeded... 8m7s Warning Unhealthy pod/logging-loki-index-gateway-0 Liveness probe failed: Get "https://10.217.0.62:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 8m7s Warning Unhealthy pod/logging-loki-ingester-0 Liveness probe failed: Get "https://10.217.0.60:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 8m7s Warning Unhealthy pod/logging-loki-compactor-0 Liveness probe failed: Get "https://10.217.0.61:3101/loki/api/v1/status/buildinfo": context deadline exceeded 8m7s Warning ProbeError pod/logging-loki-compactor-0 Liveness probe error: Get "https://10.217.0.61:3101/loki/api/v1/status/buildinfo": context deadline exceeded... 8m7s Warning ProbeError pod/logging-loki-ingester-0 Liveness probe error: Get "https://10.217.0.60:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 8m7s Warning ProbeError pod/logging-loki-index-gateway-0 Liveness probe error: Get "https://10.217.0.62:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 7m56s Normal nodeAssigned service/openstack-logging announcing from node "crc" with protocol "layer2"