LAST SEEN TYPE REASON OBJECT MESSAGE 71m Normal RequirementsUnknown clusterserviceversion/cluster-logging.v6.2.9 requirements not yet checked 71m Normal RequirementsNotMet clusterserviceversion/cluster-logging.v6.2.9 one or more requirements couldn't be found 71m Normal AllRequirementsMet clusterserviceversion/cluster-logging.v6.2.9 all requirements found, attempting install 71m Normal SuccessfulCreate replicaset/cluster-logging-operator-66689c4bbf Created pod: cluster-logging-operator-66689c4bbf-bcn59 71m Normal Scheduled pod/cluster-logging-operator-66689c4bbf-bcn59 Successfully assigned openshift-logging/cluster-logging-operator-66689c4bbf-bcn59 to crc 71m Normal ScalingReplicaSet deployment/cluster-logging-operator Scaled up replica set cluster-logging-operator-66689c4bbf to 1 71m Normal Pulling pod/cluster-logging-operator-66689c4bbf-bcn59 Pulling image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:bf86702a43f0ab4fda541a3aa8ace4560088be90be5eb59cd475ce1d97f5afef" 71m Normal AddedInterface pod/cluster-logging-operator-66689c4bbf-bcn59 Add eth0 [10.217.0.49/23] from ovn-kubernetes 71m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.9 waiting for install components to report healthy 71m Normal InstallWaiting clusterserviceversion/cluster-logging.v6.2.9 installing: waiting for deployment cluster-logging-operator to become ready: deployment "cluster-logging-operator" not available: Deployment does not have minimum availability. 71m Normal Created pod/cluster-logging-operator-66689c4bbf-bcn59 Created container cluster-logging-operator 71m Normal Started pod/cluster-logging-operator-66689c4bbf-bcn59 Started container cluster-logging-operator 71m Normal Pulled pod/cluster-logging-operator-66689c4bbf-bcn59 Successfully pulled image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:bf86702a43f0ab4fda541a3aa8ace4560088be90be5eb59cd475ce1d97f5afef" in 15.651s (15.651s including waiting). Image size: 343887794 bytes. 71m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.9 install strategy completed with no errors 70m Normal Scheduled pod/logging-loki-distributor-9c6b6d984-vvj56 Successfully assigned openshift-logging/logging-loki-distributor-9c6b6d984-vvj56 to crc 70m Normal Provisioning persistentvolumeclaim/wal-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/wal-logging-loki-ingester-0" 70m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-index-gateway-0 Successfully provisioned volume pvc-8606fd04-7f35-4896-8750-940576cee64d 70m Warning FailedMount pod/logging-loki-gateway-c6d797ccf-9qh4r MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 70m Normal Scheduled pod/logging-loki-query-frontend-ff66c4dc9-mwqzz Successfully assigned openshift-logging/logging-loki-query-frontend-ff66c4dc9-mwqzz to crc 70m Normal ScalingReplicaSet deployment/logging-loki-querier Scaled up replica set logging-loki-querier-6dcbdf8bb8 to 1 70m Normal SuccessfulCreate replicaset/logging-loki-querier-6dcbdf8bb8 Created pod: logging-loki-querier-6dcbdf8bb8-qr6bw 70m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-compactor-0 waiting for first consumer to be created before binding 70m Normal Scheduled pod/logging-loki-gateway-c6d797ccf-9qh4r Successfully assigned openshift-logging/logging-loki-gateway-c6d797ccf-9qh4r to crc 70m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 70m Normal Scheduled pod/logging-loki-querier-6dcbdf8bb8-qr6bw Successfully assigned openshift-logging/logging-loki-querier-6dcbdf8bb8-qr6bw to crc 70m Normal SuccessfulCreate statefulset/logging-loki-ingester create Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester successful 70m Normal Provisioning persistentvolumeclaim/storage-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-ingester-0" 70m Normal Provisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-index-gateway-0" 70m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 70m Normal NoPods poddisruptionbudget/logging-loki-ingester No matching pods found 70m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim wal-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 70m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim storage-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 70m Normal ProvisioningSucceeded persistentvolumeclaim/wal-logging-loki-ingester-0 Successfully provisioned volume pvc-15ed4531-bf9c-4d7a-a111-9dbf850db61b 70m Normal ExternalProvisioning persistentvolumeclaim/wal-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 70m Normal SuccessfulCreate statefulset/logging-loki-compactor create Claim storage-logging-loki-compactor-0 Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor success 70m Normal SuccessfulCreate statefulset/logging-loki-compactor create Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor successful 70m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-ingester-0 waiting for first consumer to be created before binding 70m Normal SuccessfulCreate replicaset/logging-loki-gateway-c6d797ccf Created pod: logging-loki-gateway-c6d797ccf-9qh4r 70m Normal SuccessfulCreate replicaset/logging-loki-gateway-c6d797ccf Created pod: logging-loki-gateway-c6d797ccf-8ng9x 70m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-compactor-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 70m Normal Provisioning persistentvolumeclaim/storage-logging-loki-compactor-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-compactor-0" 70m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-ingester-0 Successfully provisioned volume pvc-49c190c1-aab1-4988-aa72-b6786999be24 70m Normal ScalingReplicaSet deployment/logging-loki-query-frontend Scaled up replica set logging-loki-query-frontend-ff66c4dc9 to 1 70m Normal SuccessfulCreate replicaset/logging-loki-query-frontend-ff66c4dc9 Created pod: logging-loki-query-frontend-ff66c4dc9-mwqzz 70m Normal WaitForFirstConsumer persistentvolumeclaim/wal-logging-loki-ingester-0 waiting for first consumer to be created before binding 70m Normal ScalingReplicaSet deployment/logging-loki-gateway Scaled up replica set logging-loki-gateway-c6d797ccf to 2 70m Normal SuccessfulCreate replicaset/logging-loki-distributor-9c6b6d984 Created pod: logging-loki-distributor-9c6b6d984-vvj56 70m Normal ScalingReplicaSet deployment/logging-loki-distributor Scaled up replica set logging-loki-distributor-9c6b6d984 to 1 70m Normal Scheduled pod/logging-loki-gateway-c6d797ccf-8ng9x Successfully assigned openshift-logging/logging-loki-gateway-c6d797ccf-8ng9x to crc 70m Warning FailedMount pod/logging-loki-gateway-c6d797ccf-8ng9x MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 70m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-index-gateway-0 waiting for first consumer to be created before binding 70m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-compactor-0 Successfully provisioned volume pvc-13c35950-5bd9-4551-b262-990db297da3e 70m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway successful 70m Normal NoPods poddisruptionbudget/logging-loki-index-gateway No matching pods found 70m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Claim storage-logging-loki-index-gateway-0 Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway success 70m Normal Pulling pod/logging-loki-distributor-9c6b6d984-vvj56 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" 70m Normal Pulling pod/logging-loki-query-frontend-ff66c4dc9-mwqzz Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" 70m Normal AddedInterface pod/logging-loki-query-frontend-ff66c4dc9-mwqzz Add eth0 [10.217.0.54/23] from ovn-kubernetes 70m Normal Pulling pod/logging-loki-querier-6dcbdf8bb8-qr6bw Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" 70m Normal AddedInterface pod/logging-loki-querier-6dcbdf8bb8-qr6bw Add eth0 [10.217.0.53/23] from ovn-kubernetes 70m Normal Scheduled pod/logging-loki-index-gateway-0 Successfully assigned openshift-logging/logging-loki-index-gateway-0 to crc 70m Normal Scheduled pod/logging-loki-compactor-0 Successfully assigned openshift-logging/logging-loki-compactor-0 to crc 70m Normal Scheduled pod/logging-loki-ingester-0 Successfully assigned openshift-logging/logging-loki-ingester-0 to crc 70m Normal AddedInterface pod/logging-loki-distributor-9c6b6d984-vvj56 Add eth0 [10.217.0.52/23] from ovn-kubernetes 70m Normal AddedInterface pod/logging-loki-ingester-0 Add eth0 [10.217.0.57/23] from ovn-kubernetes 70m Normal Pulling pod/logging-loki-ingester-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" 70m Normal Pulling pod/logging-loki-gateway-c6d797ccf-8ng9x Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:f4f8fc520eae06a5c7d8b98ef21bad88253666fc27db9b6bf35b19a63173a167" 70m Normal Pulling pod/logging-loki-compactor-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" 70m Normal AddedInterface pod/logging-loki-compactor-0 Add eth0 [10.217.0.58/23] from ovn-kubernetes 70m Normal AddedInterface pod/logging-loki-gateway-c6d797ccf-9qh4r Add eth0 [10.217.0.55/23] from ovn-kubernetes 70m Normal Pulling pod/logging-loki-gateway-c6d797ccf-9qh4r Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:f4f8fc520eae06a5c7d8b98ef21bad88253666fc27db9b6bf35b19a63173a167" 70m Normal AddedInterface pod/logging-loki-index-gateway-0 Add eth0 [10.217.0.60/23] from ovn-kubernetes 70m Normal Pulling pod/logging-loki-index-gateway-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" 70m Normal AddedInterface pod/logging-loki-gateway-c6d797ccf-8ng9x Add eth0 [10.217.0.56/23] from ovn-kubernetes 70m Normal Started pod/logging-loki-ingester-0 Started container loki-ingester 70m Normal Started pod/logging-loki-querier-6dcbdf8bb8-qr6bw Started container loki-querier 70m Normal Created pod/logging-loki-distributor-9c6b6d984-vvj56 Created container loki-distributor 70m Normal Started pod/logging-loki-compactor-0 Started container loki-compactor 70m Normal Created pod/logging-loki-compactor-0 Created container loki-compactor 70m Normal Pulled pod/logging-loki-compactor-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" in 1.569s (1.569s including waiting). Image size: 225648085 bytes. 70m Normal Created pod/logging-loki-ingester-0 Created container loki-ingester 70m Normal Pulled pod/logging-loki-ingester-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" in 1.607s (1.607s including waiting). Image size: 225648085 bytes. 70m Normal Started pod/logging-loki-distributor-9c6b6d984-vvj56 Started container loki-distributor 70m Normal Pulled pod/logging-loki-distributor-9c6b6d984-vvj56 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" in 2.928s (2.928s including waiting). Image size: 225648085 bytes. 70m Normal Started pod/logging-loki-query-frontend-ff66c4dc9-mwqzz Started container loki-query-frontend 70m Normal Created pod/logging-loki-query-frontend-ff66c4dc9-mwqzz Created container loki-query-frontend 70m Normal Pulled pod/logging-loki-query-frontend-ff66c4dc9-mwqzz Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" in 2.843s (2.843s including waiting). Image size: 225648085 bytes. 70m Normal Started pod/logging-loki-index-gateway-0 Started container loki-index-gateway 70m Normal Created pod/logging-loki-index-gateway-0 Created container loki-index-gateway 70m Normal Pulled pod/logging-loki-index-gateway-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" in 1.751s (1.751s including waiting). Image size: 225648085 bytes. 70m Normal Pulled pod/logging-loki-querier-6dcbdf8bb8-qr6bw Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:ebf28f8c032032395ba9a7aa247f68a25e9484857588e375b4660bc04aa0e0fb" in 2.895s (2.895s including waiting). Image size: 225648085 bytes. 70m Normal Created pod/logging-loki-querier-6dcbdf8bb8-qr6bw Created container loki-querier 70m Normal Pulled pod/logging-loki-gateway-c6d797ccf-8ng9x Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:f4f8fc520eae06a5c7d8b98ef21bad88253666fc27db9b6bf35b19a63173a167" in 3.797s (3.797s including waiting). Image size: 181406084 bytes. 70m Normal Pulling pod/logging-loki-gateway-c6d797ccf-8ng9x Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:d385c61e4b289c60cbb712e7c85c4af518e680cf24e9f7fb10acae2b281f08e8" 70m Normal Created pod/logging-loki-gateway-c6d797ccf-9qh4r Created container gateway 70m Normal Started pod/logging-loki-gateway-c6d797ccf-9qh4r Started container gateway 70m Normal Created pod/logging-loki-gateway-c6d797ccf-8ng9x Created container gateway 70m Normal Started pod/logging-loki-gateway-c6d797ccf-8ng9x Started container gateway 70m Normal Pulling pod/logging-loki-gateway-c6d797ccf-9qh4r Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:d385c61e4b289c60cbb712e7c85c4af518e680cf24e9f7fb10acae2b281f08e8" 70m Normal Pulled pod/logging-loki-gateway-c6d797ccf-9qh4r Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:f4f8fc520eae06a5c7d8b98ef21bad88253666fc27db9b6bf35b19a63173a167" in 3.823s (3.823s including waiting). Image size: 181406084 bytes. 70m Normal Pulled pod/logging-loki-gateway-c6d797ccf-8ng9x Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:d385c61e4b289c60cbb712e7c85c4af518e680cf24e9f7fb10acae2b281f08e8" in 2.027s (2.027s including waiting). Image size: 161395402 bytes. 70m Normal Started pod/logging-loki-gateway-c6d797ccf-9qh4r Started container opa 70m Normal Created pod/logging-loki-gateway-c6d797ccf-8ng9x Created container opa 70m Normal Started pod/logging-loki-gateway-c6d797ccf-8ng9x Started container opa 70m Normal Pulled pod/logging-loki-gateway-c6d797ccf-9qh4r Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:d385c61e4b289c60cbb712e7c85c4af518e680cf24e9f7fb10acae2b281f08e8" in 2.027s (2.027s including waiting). Image size: 161395402 bytes. 70m Normal Created pod/logging-loki-gateway-c6d797ccf-9qh4r Created container opa 70m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 70m Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: HTTP probe failed with statuscode: 503 70m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 69m Warning FailedMount pod/collector-5nmqm MountVolume.SetUp failed for volume "collector-syslog-receiver" : secret "collector-syslog-receiver" not found 69m Normal Scheduled pod/collector-5nmqm Successfully assigned openshift-logging/collector-5nmqm to crc 69m Normal SuccessfulDelete daemonset/collector Deleted pod: collector-5nmqm 69m Warning FailedMount pod/collector-5nmqm MountVolume.SetUp failed for volume "metrics" : secret "collector-metrics" not found 69m Normal SuccessfulCreate daemonset/collector Created pod: collector-5nmqm 69m Normal SuccessfulCreate daemonset/collector Created pod: collector-xcq52 69m Normal Scheduled pod/collector-xcq52 Successfully assigned openshift-logging/collector-xcq52 to crc 69m Normal AddedInterface pod/collector-xcq52 Add eth0 [10.217.0.66/23] from ovn-kubernetes 69m Normal Pulling pod/collector-xcq52 Pulling image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:bacedab86fc0ed94a09cfa903e4d88e85b321df18224c43efcba4f6640aa8203" 69m Normal Created pod/collector-xcq52 Created container collector 69m Normal Pulled pod/collector-xcq52 Successfully pulled image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:bacedab86fc0ed94a09cfa903e4d88e85b321df18224c43efcba4f6640aa8203" in 3.486s (3.486s including waiting). Image size: 263139944 bytes. 69m Normal Started pod/collector-xcq52 Started container collector 63m Normal nodeAssigned service/openstack-logging announcing from node "crc" with protocol "layer2" 63m Normal IPAllocated service/openstack-logging Assigned IP ["172.17.0.80"] 63m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/loadBalancerIPs 63m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/address-pool 63m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/allow-shared-ip 6m30s Warning ProbeError pod/logging-loki-gateway-c6d797ccf-8ng9x Readiness probe error: Get "https://10.217.0.56:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m30s Warning Unhealthy pod/logging-loki-gateway-c6d797ccf-8ng9x Readiness probe failed: Get "https://10.217.0.56:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m30s Warning ProbeError pod/logging-loki-gateway-c6d797ccf-9qh4r Readiness probe error: Get "https://10.217.0.55:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m30s Warning Unhealthy pod/logging-loki-gateway-c6d797ccf-9qh4r Readiness probe failed: Get "https://10.217.0.55:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m25s Warning ProbeError pod/logging-loki-distributor-9c6b6d984-vvj56 Liveness probe error: Get "https://10.217.0.52:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 6m25s Warning ProbeError pod/logging-loki-query-frontend-ff66c4dc9-mwqzz Liveness probe error: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m25s Warning Unhealthy pod/logging-loki-querier-6dcbdf8bb8-qr6bw Liveness probe failed: Get "https://10.217.0.53:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m25s Warning Unhealthy pod/logging-loki-gateway-c6d797ccf-8ng9x Readiness probe failed: Get "https://10.217.0.56:8081/ready": context deadline exceeded 6m25s Warning Unhealthy pod/logging-loki-query-frontend-ff66c4dc9-mwqzz Liveness probe failed: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m25s Warning ProbeError pod/logging-loki-querier-6dcbdf8bb8-qr6bw Liveness probe error: Get "https://10.217.0.53:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m25s Warning Unhealthy pod/logging-loki-distributor-9c6b6d984-vvj56 Liveness probe failed: Get "https://10.217.0.52:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 6m25s Warning ProbeError pod/logging-loki-gateway-c6d797ccf-8ng9x Readiness probe error: Get "https://10.217.0.56:8081/ready": context deadline exceeded... 6m24s Warning Unhealthy pod/logging-loki-gateway-c6d797ccf-8ng9x Liveness probe failed: Get "https://10.217.0.56:8083/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m24s Warning ProbeError pod/logging-loki-gateway-c6d797ccf-8ng9x Liveness probe error: Get "https://10.217.0.56:8083/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m24s Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: Get "https://10.217.0.57:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m24s Warning ProbeError pod/logging-loki-gateway-c6d797ccf-9qh4r Liveness probe error: Get "https://10.217.0.55:8083/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m24s Warning ProbeError pod/logging-loki-gateway-c6d797ccf-8ng9x Liveness probe error: Get "https://10.217.0.56:8081/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m24s Warning Unhealthy pod/logging-loki-gateway-c6d797ccf-9qh4r Liveness probe failed: Get "https://10.217.0.55:8083/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m24s Warning ProbeError pod/logging-loki-gateway-c6d797ccf-9qh4r Liveness probe error: Get "https://10.217.0.55:8081/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m24s Warning Unhealthy pod/logging-loki-gateway-c6d797ccf-9qh4r Liveness probe failed: Get "https://10.217.0.55:8081/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m24s Warning Unhealthy pod/logging-loki-gateway-c6d797ccf-8ng9x Liveness probe failed: Get "https://10.217.0.56:8081/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m24s Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: Get "https://10.217.0.57:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m16s Warning ProbeError pod/logging-loki-distributor-9c6b6d984-vvj56 Readiness probe error: Get "https://10.217.0.52:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 6m16s Warning Unhealthy pod/logging-loki-query-frontend-ff66c4dc9-mwqzz Readiness probe failed: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 6m16s Warning ProbeError pod/logging-loki-query-frontend-ff66c4dc9-mwqzz Readiness probe error: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 6m16s Warning Unhealthy pod/logging-loki-querier-6dcbdf8bb8-qr6bw Readiness probe failed: Get "https://10.217.0.53:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 6m16s Warning ProbeError pod/logging-loki-querier-6dcbdf8bb8-qr6bw Readiness probe error: Get "https://10.217.0.53:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 6m16s Warning Unhealthy pod/logging-loki-distributor-9c6b6d984-vvj56 Readiness probe failed: Get "https://10.217.0.52:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 6m15s Warning Unhealthy pod/logging-loki-gateway-c6d797ccf-8ng9x Readiness probe failed: Get "https://10.217.0.56:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m15s Warning ProbeError pod/logging-loki-gateway-c6d797ccf-8ng9x Readiness probe error: Get "https://10.217.0.56:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 6m15s Warning ProbeError pod/logging-loki-index-gateway-0 Readiness probe error: Get "https://10.217.0.60:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m15s Warning Unhealthy pod/logging-loki-gateway-c6d797ccf-9qh4r Readiness probe failed: Get "https://10.217.0.55:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m15s Warning ProbeError pod/logging-loki-gateway-c6d797ccf-9qh4r Readiness probe error: Get "https://10.217.0.55:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m15s Warning Unhealthy pod/logging-loki-gateway-c6d797ccf-9qh4r Readiness probe failed: Get "https://10.217.0.55:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 6m15s Warning ProbeError pod/logging-loki-gateway-c6d797ccf-9qh4r Readiness probe error: Get "https://10.217.0.55:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 6m15s Warning Unhealthy pod/logging-loki-index-gateway-0 Readiness probe failed: Get "https://10.217.0.60:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m15s Warning ProbeError pod/logging-loki-gateway-c6d797ccf-8ng9x Readiness probe error: Get "https://10.217.0.56:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m15s Warning Unhealthy pod/logging-loki-gateway-c6d797ccf-8ng9x Readiness probe failed: Get "https://10.217.0.56:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 6m14s Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: Get "https://10.217.0.57:3101/ready": context deadline exceeded... 6m14s Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: Get "https://10.217.0.57:3101/ready": context deadline exceeded 6m14s Warning Unhealthy pod/logging-loki-compactor-0 Readiness probe failed: Get "https://10.217.0.58:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m14s Warning ProbeError pod/logging-loki-compactor-0 Readiness probe error: Get "https://10.217.0.58:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)...