LAST SEEN TYPE REASON OBJECT MESSAGE 80m Normal RequirementsUnknown clusterserviceversion/cluster-logging.v6.2.7 requirements not yet checked 80m Normal RequirementsNotMet clusterserviceversion/cluster-logging.v6.2.7 one or more requirements couldn't be found 80m Normal AllRequirementsMet clusterserviceversion/cluster-logging.v6.2.7 all requirements found, attempting install 80m Normal SuccessfulCreate replicaset/cluster-logging-operator-79cf69ddc8 Created pod: cluster-logging-operator-79cf69ddc8-t7bh6 80m Normal Scheduled pod/cluster-logging-operator-79cf69ddc8-t7bh6 Successfully assigned openshift-logging/cluster-logging-operator-79cf69ddc8-t7bh6 to crc 80m Normal ScalingReplicaSet deployment/cluster-logging-operator Scaled up replica set cluster-logging-operator-79cf69ddc8 to 1 80m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.7 waiting for install components to report healthy 80m Normal Pulling pod/cluster-logging-operator-79cf69ddc8-t7bh6 Pulling image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:80cac88d8ff5b40036e5983f5dacfc08702afe9c7a66b48d1c88bcb149c285b3" 80m Normal AddedInterface pod/cluster-logging-operator-79cf69ddc8-t7bh6 Add eth0 [10.217.0.44/23] from ovn-kubernetes 80m Normal InstallWaiting clusterserviceversion/cluster-logging.v6.2.7 installing: waiting for deployment cluster-logging-operator to become ready: deployment "cluster-logging-operator" not available: Deployment does not have minimum availability. 80m Normal Created pod/cluster-logging-operator-79cf69ddc8-t7bh6 Created container cluster-logging-operator 80m Normal Started pod/cluster-logging-operator-79cf69ddc8-t7bh6 Started container cluster-logging-operator 80m Normal Pulled pod/cluster-logging-operator-79cf69ddc8-t7bh6 Successfully pulled image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:80cac88d8ff5b40036e5983f5dacfc08702afe9c7a66b48d1c88bcb149c285b3" in 6.57s (6.57s including waiting). Image size: 343173849 bytes. 80m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.7 install strategy completed with no errors 79m Normal SuccessfulCreate statefulset/logging-loki-compactor create Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor successful 79m Normal ScalingReplicaSet deployment/logging-loki-querier Scaled up replica set logging-loki-querier-76788598db to 1 79m Normal Provisioning persistentvolumeclaim/wal-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/wal-logging-loki-ingester-0" 79m Normal WaitForFirstConsumer persistentvolumeclaim/wal-logging-loki-ingester-0 waiting for first consumer to be created before binding 79m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-ingester-0 Successfully provisioned volume pvc-781f9dd2-0de7-48f0-864e-77bafe73e48f 79m Normal Provisioning persistentvolumeclaim/storage-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-ingester-0" 79m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 79m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-ingester-0 waiting for first consumer to be created before binding 79m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-index-gateway-0 Successfully provisioned volume pvc-5f6fb176-b10b-4194-8d04-3c17c8a2bf8b 79m Normal Provisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-index-gateway-0" 79m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 79m Warning FailedMount pod/logging-loki-gateway-795ff9d55b-njxl9 MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 79m Normal Scheduled pod/logging-loki-gateway-795ff9d55b-njxl9 Successfully assigned openshift-logging/logging-loki-gateway-795ff9d55b-njxl9 to crc 79m Normal SuccessfulCreate replicaset/logging-loki-gateway-795ff9d55b Created pod: logging-loki-gateway-795ff9d55b-njxl9 79m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-index-gateway-0 waiting for first consumer to be created before binding 79m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-compactor-0 Successfully provisioned volume pvc-c1b7f5d9-fe84-4a56-a715-9c55df75eab7 79m Normal Provisioning persistentvolumeclaim/storage-logging-loki-compactor-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-compactor-0" 79m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-compactor-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 79m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-compactor-0 waiting for first consumer to be created before binding 79m Normal ScalingReplicaSet deployment/logging-loki-query-frontend Scaled up replica set logging-loki-query-frontend-69d9546745 to 1 79m Normal SuccessfulCreate replicaset/logging-loki-query-frontend-69d9546745 Created pod: logging-loki-query-frontend-69d9546745-4ngf2 79m Normal SuccessfulCreate statefulset/logging-loki-compactor create Claim storage-logging-loki-compactor-0 Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor success 79m Normal SuccessfulCreate replicaset/logging-loki-gateway-795ff9d55b Created pod: logging-loki-gateway-795ff9d55b-mwm5k 79m Normal Scheduled pod/logging-loki-distributor-5f678c8dd6-zhq64 Successfully assigned openshift-logging/logging-loki-distributor-5f678c8dd6-zhq64 to crc 79m Normal AddedInterface pod/logging-loki-distributor-5f678c8dd6-zhq64 Add eth0 [10.217.0.46/23] from ovn-kubernetes 79m Normal Pulling pod/logging-loki-distributor-5f678c8dd6-zhq64 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" 79m Normal ProvisioningSucceeded persistentvolumeclaim/wal-logging-loki-ingester-0 Successfully provisioned volume pvc-7be3af20-b1b1-42cd-b972-0b5dce5dc379 79m Normal ScalingReplicaSet deployment/logging-loki-gateway Scaled up replica set logging-loki-gateway-795ff9d55b to 2 79m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Claim storage-logging-loki-index-gateway-0 Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway success 79m Normal Scheduled pod/logging-loki-query-frontend-69d9546745-4ngf2 Successfully assigned openshift-logging/logging-loki-query-frontend-69d9546745-4ngf2 to crc 79m Normal ExternalProvisioning persistentvolumeclaim/wal-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 79m Normal SuccessfulCreate replicaset/logging-loki-distributor-5f678c8dd6 Created pod: logging-loki-distributor-5f678c8dd6-zhq64 79m Normal ScalingReplicaSet deployment/logging-loki-distributor Scaled up replica set logging-loki-distributor-5f678c8dd6 to 1 79m Normal Scheduled pod/logging-loki-gateway-795ff9d55b-mwm5k Successfully assigned openshift-logging/logging-loki-gateway-795ff9d55b-mwm5k to crc 79m Warning FailedMount pod/logging-loki-gateway-795ff9d55b-mwm5k MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 79m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway successful 79m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim storage-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 79m Normal SuccessfulCreate replicaset/logging-loki-querier-76788598db Created pod: logging-loki-querier-76788598db-r2fdr 79m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim wal-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 79m Normal NoPods poddisruptionbudget/logging-loki-ingester No matching pods found 79m Normal Scheduled pod/logging-loki-querier-76788598db-r2fdr Successfully assigned openshift-logging/logging-loki-querier-76788598db-r2fdr to crc 79m Normal SuccessfulCreate statefulset/logging-loki-ingester create Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester successful 79m Normal Scheduled pod/logging-loki-index-gateway-0 Successfully assigned openshift-logging/logging-loki-index-gateway-0 to crc 79m Normal Pulling pod/logging-loki-querier-76788598db-r2fdr Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" 79m Normal AddedInterface pod/logging-loki-gateway-795ff9d55b-njxl9 Add eth0 [10.217.0.49/23] from ovn-kubernetes 79m Normal Scheduled pod/logging-loki-compactor-0 Successfully assigned openshift-logging/logging-loki-compactor-0 to crc 79m Normal AddedInterface pod/logging-loki-ingester-0 Add eth0 [10.217.0.51/23] from ovn-kubernetes 79m Normal Scheduled pod/logging-loki-ingester-0 Successfully assigned openshift-logging/logging-loki-ingester-0 to crc 79m Normal Pulling pod/logging-loki-query-frontend-69d9546745-4ngf2 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" 79m Normal AddedInterface pod/logging-loki-query-frontend-69d9546745-4ngf2 Add eth0 [10.217.0.48/23] from ovn-kubernetes 79m Normal AddedInterface pod/logging-loki-querier-76788598db-r2fdr Add eth0 [10.217.0.47/23] from ovn-kubernetes 79m Normal Pulling pod/logging-loki-index-gateway-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" 79m Normal AddedInterface pod/logging-loki-index-gateway-0 Add eth0 [10.217.0.53/23] from ovn-kubernetes 79m Normal AddedInterface pod/logging-loki-gateway-795ff9d55b-mwm5k Add eth0 [10.217.0.50/23] from ovn-kubernetes 79m Normal Pulling pod/logging-loki-gateway-795ff9d55b-njxl9 Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:574afd46f23637b1685ddb00b647bb71d2e2d527611182fd2826bb818c5eb198" 79m Normal Pulling pod/logging-loki-compactor-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" 79m Normal AddedInterface pod/logging-loki-compactor-0 Add eth0 [10.217.0.52/23] from ovn-kubernetes 79m Normal Pulling pod/logging-loki-ingester-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" 79m Normal Pulling pod/logging-loki-gateway-795ff9d55b-mwm5k Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:574afd46f23637b1685ddb00b647bb71d2e2d527611182fd2826bb818c5eb198" 79m Normal Pulled pod/logging-loki-distributor-5f678c8dd6-zhq64 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" in 3.414s (3.414s including waiting). Image size: 225282830 bytes. 79m Normal Created pod/logging-loki-querier-76788598db-r2fdr Created container loki-querier 79m Normal Created pod/logging-loki-query-frontend-69d9546745-4ngf2 Created container loki-query-frontend 79m Normal Pulled pod/logging-loki-query-frontend-69d9546745-4ngf2 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" in 3.63s (3.63s including waiting). Image size: 225282830 bytes. 79m Normal Created pod/logging-loki-distributor-5f678c8dd6-zhq64 Created container loki-distributor 79m Normal Started pod/logging-loki-distributor-5f678c8dd6-zhq64 Started container loki-distributor 79m Normal Started pod/logging-loki-querier-76788598db-r2fdr Started container loki-querier 79m Normal Pulled pod/logging-loki-querier-76788598db-r2fdr Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" in 3.014s (3.014s including waiting). Image size: 225282830 bytes. 79m Normal Started pod/logging-loki-ingester-0 Started container loki-ingester 79m Normal Created pod/logging-loki-ingester-0 Created container loki-ingester 79m Normal Pulled pod/logging-loki-ingester-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" in 2.431s (2.431s including waiting). Image size: 225282830 bytes. 79m Normal Created pod/logging-loki-compactor-0 Created container loki-compactor 79m Normal Pulled pod/logging-loki-compactor-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" in 2.509s (2.509s including waiting). Image size: 225282830 bytes. 79m Normal Pulled pod/logging-loki-index-gateway-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" in 2.29s (2.29s including waiting). Image size: 225282830 bytes. 79m Normal Started pod/logging-loki-index-gateway-0 Started container loki-index-gateway 79m Normal Started pod/logging-loki-query-frontend-69d9546745-4ngf2 Started container loki-query-frontend 79m Normal Started pod/logging-loki-compactor-0 Started container loki-compactor 79m Normal Created pod/logging-loki-index-gateway-0 Created container loki-index-gateway 79m Normal Pulling pod/logging-loki-gateway-795ff9d55b-njxl9 Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:182dc5ab627d64b5e565a2edb170903ac381fc534b4366fc5ffae088ea0de5e5" 79m Normal Started pod/logging-loki-gateway-795ff9d55b-njxl9 Started container gateway 79m Normal Pulled pod/logging-loki-gateway-795ff9d55b-mwm5k Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:574afd46f23637b1685ddb00b647bb71d2e2d527611182fd2826bb818c5eb198" in 4.137s (4.137s including waiting). Image size: 180263561 bytes. 79m Normal Created pod/logging-loki-gateway-795ff9d55b-njxl9 Created container gateway 79m Normal Created pod/logging-loki-gateway-795ff9d55b-mwm5k Created container gateway 79m Normal Started pod/logging-loki-gateway-795ff9d55b-mwm5k Started container gateway 79m Normal Pulled pod/logging-loki-gateway-795ff9d55b-njxl9 Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:574afd46f23637b1685ddb00b647bb71d2e2d527611182fd2826bb818c5eb198" in 4.179s (4.179s including waiting). Image size: 180263561 bytes. 79m Normal Pulling pod/logging-loki-gateway-795ff9d55b-mwm5k Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:182dc5ab627d64b5e565a2edb170903ac381fc534b4366fc5ffae088ea0de5e5" 79m Normal Pulled pod/logging-loki-gateway-795ff9d55b-mwm5k Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:182dc5ab627d64b5e565a2edb170903ac381fc534b4366fc5ffae088ea0de5e5" in 1.843s (1.843s including waiting). Image size: 160768505 bytes. 79m Normal Started pod/logging-loki-gateway-795ff9d55b-mwm5k Started container opa 79m Normal Created pod/logging-loki-gateway-795ff9d55b-mwm5k Created container opa 79m Warning Unhealthy pod/logging-loki-gateway-795ff9d55b-mwm5k Readiness probe failed: Get "https://10.217.0.50:8083/ready": dial tcp 10.217.0.50:8083: connect: connection refused 79m Warning ProbeError pod/logging-loki-gateway-795ff9d55b-mwm5k Readiness probe error: Get "https://10.217.0.50:8083/ready": dial tcp 10.217.0.50:8083: connect: connection refused... 79m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 79m Normal Created pod/logging-loki-gateway-795ff9d55b-njxl9 Created container opa 79m Normal Started pod/logging-loki-gateway-795ff9d55b-njxl9 Started container opa 79m Normal Pulled pod/logging-loki-gateway-795ff9d55b-njxl9 Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:182dc5ab627d64b5e565a2edb170903ac381fc534b4366fc5ffae088ea0de5e5" in 31.69s (31.69s including waiting). Image size: 160768505 bytes. 79m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 79m Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: HTTP probe failed with statuscode: 503 78m Normal SuccessfulDelete daemonset/collector Deleted pod: collector-q5b5q 78m Normal SuccessfulCreate daemonset/collector Created pod: collector-q5b5q 78m Warning FailedMount pod/collector-q5b5q MountVolume.SetUp failed for volume "collector-syslog-receiver" : secret "collector-syslog-receiver" not found 78m Normal Scheduled pod/collector-q5b5q Successfully assigned openshift-logging/collector-q5b5q to crc 78m Normal Scheduled pod/collector-2bmhz Successfully assigned openshift-logging/collector-2bmhz to crc 78m Normal SuccessfulCreate daemonset/collector Created pod: collector-2bmhz 78m Normal AddedInterface pod/collector-2bmhz Add eth0 [10.217.0.56/23] from ovn-kubernetes 78m Normal Pulling pod/collector-2bmhz Pulling image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:fa2cfa2ed336ce105c8dea5bfe0825407e37ef296193ae162f515213fe43c8d5" 78m Normal Pulled pod/collector-2bmhz Successfully pulled image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:fa2cfa2ed336ce105c8dea5bfe0825407e37ef296193ae162f515213fe43c8d5" in 6.51s (6.51s including waiting). Image size: 344557702 bytes. 78m Normal Created pod/collector-2bmhz Created container collector 78m Normal Started pod/collector-2bmhz Started container collector 73m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/allow-shared-ip 73m Normal nodeAssigned service/openstack-logging announcing from node "crc" with protocol "layer2" 73m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/loadBalancerIPs 73m Normal IPAllocated service/openstack-logging Assigned IP ["172.17.0.80"] 73m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/address-pool 9m21s Warning Unhealthy pod/logging-loki-gateway-795ff9d55b-njxl9 Readiness probe failed: Get "https://10.217.0.49:8081/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 9m21s Warning ProbeError pod/logging-loki-gateway-795ff9d55b-njxl9 Readiness probe error: Get "https://10.217.0.49:8081/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 9m16s Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: Get "https://10.217.0.51:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 9m16s Warning Unhealthy pod/logging-loki-compactor-0 Readiness probe failed: Get "https://10.217.0.52:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 9m16s Warning ProbeError pod/logging-loki-compactor-0 Readiness probe error: Get "https://10.217.0.52:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 9m16s Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: Get "https://10.217.0.51:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 9m11s Warning ProbeError pod/logging-loki-gateway-795ff9d55b-njxl9 Readiness probe error: Get "https://10.217.0.49:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 9m11s Warning ProbeError pod/logging-loki-gateway-795ff9d55b-mwm5k Readiness probe error: Get "https://10.217.0.50:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 9m11s Warning Unhealthy pod/logging-loki-gateway-795ff9d55b-mwm5k Readiness probe failed: Get "https://10.217.0.50:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 9m11s Warning ProbeError pod/logging-loki-gateway-795ff9d55b-mwm5k Readiness probe error: Get "https://10.217.0.50:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 9m11s Warning Unhealthy pod/logging-loki-gateway-795ff9d55b-mwm5k Readiness probe failed: Get "https://10.217.0.50:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 9m11s Warning Unhealthy pod/logging-loki-gateway-795ff9d55b-njxl9 Readiness probe failed: Get "https://10.217.0.49:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 9m7s Warning ProbeError pod/logging-loki-distributor-5f678c8dd6-zhq64 Readiness probe error: Get "https://10.217.0.46:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 9m7s Warning Unhealthy pod/logging-loki-distributor-5f678c8dd6-zhq64 Readiness probe failed: Get "https://10.217.0.46:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 9m7s Warning Unhealthy pod/logging-loki-querier-76788598db-r2fdr Readiness probe failed: Get "https://10.217.0.47:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 9m7s Warning ProbeError pod/logging-loki-querier-76788598db-r2fdr Readiness probe error: Get "https://10.217.0.47:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 9m7s Warning ProbeError pod/logging-loki-query-frontend-69d9546745-4ngf2 Readiness probe error: Get "https://10.217.0.48:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 9m7s Warning Unhealthy pod/logging-loki-query-frontend-69d9546745-4ngf2 Readiness probe failed: Get "https://10.217.0.48:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 9m6s Warning ProbeError pod/logging-loki-gateway-795ff9d55b-mwm5k Readiness probe error: Get "https://10.217.0.50:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 9m6s Warning Unhealthy pod/logging-loki-gateway-795ff9d55b-mwm5k Readiness probe failed: Get "https://10.217.0.50:8083/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 9m6s Warning Unhealthy pod/logging-loki-compactor-0 Readiness probe failed: Get "https://10.217.0.52:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 9m6s Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: Get "https://10.217.0.51:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 9m6s Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: Get "https://10.217.0.51:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 9m6s Warning Unhealthy pod/logging-loki-index-gateway-0 Readiness probe failed: Get "https://10.217.0.53:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 9m6s Warning ProbeError pod/logging-loki-index-gateway-0 Readiness probe error: Get "https://10.217.0.53:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 9m6s Warning ProbeError pod/logging-loki-gateway-795ff9d55b-mwm5k Readiness probe error: Get "https://10.217.0.50:8083/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 9m6s Warning Unhealthy pod/logging-loki-gateway-795ff9d55b-mwm5k Readiness probe failed: Get "https://10.217.0.50:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 9m6s Warning ProbeError pod/logging-loki-compactor-0 Readiness probe error: Get "https://10.217.0.52:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 9m6s Warning ProbeError pod/logging-loki-gateway-795ff9d55b-njxl9 Readiness probe error: Get "https://10.217.0.49:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 9m6s Warning Unhealthy pod/logging-loki-gateway-795ff9d55b-njxl9 Readiness probe failed: Get "https://10.217.0.49:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 9m6s Warning ProbeError pod/logging-loki-gateway-795ff9d55b-njxl9 Readiness probe error: Get "https://10.217.0.49:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 9m6s Warning Unhealthy pod/logging-loki-gateway-795ff9d55b-njxl9 Readiness probe failed: Get "https://10.217.0.49:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 9m1s Warning ProbeError pod/logging-loki-gateway-795ff9d55b-njxl9 Readiness probe error: Get "https://10.217.0.49:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 9m1s Warning Unhealthy pod/logging-loki-gateway-795ff9d55b-njxl9 Readiness probe failed: Get "https://10.217.0.49:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 9m1s Warning Unhealthy pod/logging-loki-gateway-795ff9d55b-mwm5k Readiness probe failed: Get "https://10.217.0.50:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 9m1s Warning ProbeError pod/logging-loki-gateway-795ff9d55b-mwm5k Readiness probe error: Get "https://10.217.0.50:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)...