LAST SEEN TYPE REASON OBJECT MESSAGE 78m Normal RequirementsUnknown clusterserviceversion/cluster-logging.v6.2.7 requirements not yet checked 78m Normal RequirementsNotMet clusterserviceversion/cluster-logging.v6.2.7 one or more requirements couldn't be found 78m Normal AllRequirementsMet clusterserviceversion/cluster-logging.v6.2.7 all requirements found, attempting install 78m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.7 waiting for install components to report healthy 78m Normal ScalingReplicaSet deployment/cluster-logging-operator Scaled up replica set cluster-logging-operator-79cf69ddc8 to 1 78m Normal SuccessfulCreate replicaset/cluster-logging-operator-79cf69ddc8 Created pod: cluster-logging-operator-79cf69ddc8-n77sv 78m Normal Scheduled pod/cluster-logging-operator-79cf69ddc8-n77sv Successfully assigned openshift-logging/cluster-logging-operator-79cf69ddc8-n77sv to crc 78m Normal AddedInterface pod/cluster-logging-operator-79cf69ddc8-n77sv Add eth0 [10.217.0.50/23] from ovn-kubernetes 78m Normal Pulling pod/cluster-logging-operator-79cf69ddc8-n77sv Pulling image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:80cac88d8ff5b40036e5983f5dacfc08702afe9c7a66b48d1c88bcb149c285b3" 78m Normal InstallWaiting clusterserviceversion/cluster-logging.v6.2.7 installing: waiting for deployment cluster-logging-operator to become ready: deployment "cluster-logging-operator" not available: Deployment does not have minimum availability. 78m Normal Pulled pod/cluster-logging-operator-79cf69ddc8-n77sv Successfully pulled image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:80cac88d8ff5b40036e5983f5dacfc08702afe9c7a66b48d1c88bcb149c285b3" in 9.978s (9.978s including waiting). Image size: 343173849 bytes. 78m Normal Created pod/cluster-logging-operator-79cf69ddc8-n77sv Created container cluster-logging-operator 78m Normal Started pod/cluster-logging-operator-79cf69ddc8-n77sv Started container cluster-logging-operator 78m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.7 install strategy completed with no errors 77m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-ingester-0 Successfully provisioned volume pvc-b6ff06a4-9173-42d6-8817-e6c640459d89 77m Normal SuccessfulCreate statefulset/logging-loki-compactor create Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor successful 77m Normal Scheduled pod/logging-loki-querier-76788598db-rgsmc Successfully assigned openshift-logging/logging-loki-querier-76788598db-rgsmc to crc 77m Normal SuccessfulCreate statefulset/logging-loki-ingester create Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester successful 77m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim wal-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 77m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim storage-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 77m Normal NoPods poddisruptionbudget/logging-loki-ingester No matching pods found 77m Normal SuccessfulCreate replicaset/logging-loki-querier-76788598db Created pod: logging-loki-querier-76788598db-rgsmc 77m Normal ScalingReplicaSet deployment/logging-loki-querier Scaled up replica set logging-loki-querier-76788598db to 1 77m Normal Scheduled pod/logging-loki-query-frontend-69d9546745-6sm7h Successfully assigned openshift-logging/logging-loki-query-frontend-69d9546745-6sm7h to crc 77m Normal Provisioning persistentvolumeclaim/storage-logging-loki-compactor-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-compactor-0" 77m Warning FailedCreate replicaset/logging-loki-gateway-74447864d7 Error creating: pods "logging-loki-gateway-74447864d7-" is forbidden: error looking up service account openshift-logging/logging-loki-gateway: serviceaccount "logging-loki-gateway" not found 77m Normal SuccessfulCreate replicaset/logging-loki-gateway-74447864d7 Created pod: logging-loki-gateway-74447864d7-m77fj 77m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-compactor-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 77m Normal Scheduled pod/logging-loki-gateway-74447864d7-m77fj Successfully assigned openshift-logging/logging-loki-gateway-74447864d7-m77fj to crc 77m Normal SuccessfulCreate replicaset/logging-loki-gateway-74447864d7 Created pod: logging-loki-gateway-74447864d7-6nhsx 77m Warning FailedMount pod/logging-loki-gateway-74447864d7-m77fj MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 77m Normal ScalingReplicaSet deployment/logging-loki-gateway Scaled up replica set logging-loki-gateway-74447864d7 to 2 77m Normal ProvisioningSucceeded persistentvolumeclaim/wal-logging-loki-ingester-0 Successfully provisioned volume pvc-f611e01d-7405-4805-a57b-beaa051c46c7 77m Normal Provisioning persistentvolumeclaim/wal-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/wal-logging-loki-ingester-0" 77m Normal ExternalProvisioning persistentvolumeclaim/wal-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 77m Normal WaitForFirstConsumer persistentvolumeclaim/wal-logging-loki-ingester-0 waiting for first consumer to be created before binding 77m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-index-gateway-0 waiting for first consumer to be created before binding 77m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 77m Normal SuccessfulCreate statefulset/logging-loki-compactor create Claim storage-logging-loki-compactor-0 Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor success 77m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 77m Normal Scheduled pod/logging-loki-distributor-5f678c8dd6-vllhz Successfully assigned openshift-logging/logging-loki-distributor-5f678c8dd6-vllhz to crc 77m Normal AddedInterface pod/logging-loki-distributor-5f678c8dd6-vllhz Add eth0 [10.217.0.52/23] from ovn-kubernetes 77m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-compactor-0 Successfully provisioned volume pvc-06124cee-0e8a-4730-8c09-09f8548b57ef 77m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway successful 77m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Claim storage-logging-loki-index-gateway-0 Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway success 77m Normal SuccessfulCreate replicaset/logging-loki-query-frontend-69d9546745 Created pod: logging-loki-query-frontend-69d9546745-6sm7h 77m Normal Provisioning persistentvolumeclaim/storage-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-ingester-0" 77m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-ingester-0 waiting for first consumer to be created before binding 77m Normal ScalingReplicaSet deployment/logging-loki-query-frontend Scaled up replica set logging-loki-query-frontend-69d9546745 to 1 77m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-compactor-0 waiting for first consumer to be created before binding 77m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-index-gateway-0 Successfully provisioned volume pvc-07e55a36-b2a9-4801-bca9-2649a5aa636a 77m Normal Provisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-index-gateway-0" 77m Normal SuccessfulCreate replicaset/logging-loki-distributor-5f678c8dd6 Created pod: logging-loki-distributor-5f678c8dd6-vllhz 77m Normal ScalingReplicaSet deployment/logging-loki-distributor Scaled up replica set logging-loki-distributor-5f678c8dd6 to 1 77m Normal Scheduled pod/logging-loki-gateway-74447864d7-6nhsx Successfully assigned openshift-logging/logging-loki-gateway-74447864d7-6nhsx to crc 77m Warning FailedMount pod/logging-loki-gateway-74447864d7-6nhsx MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 77m Normal AddedInterface pod/logging-loki-gateway-74447864d7-m77fj Add eth0 [10.217.0.55/23] from ovn-kubernetes 77m Normal Pulling pod/logging-loki-distributor-5f678c8dd6-vllhz Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" 77m Normal Pulling pod/logging-loki-querier-76788598db-rgsmc Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" 77m Normal Scheduled pod/logging-loki-index-gateway-0 Successfully assigned openshift-logging/logging-loki-index-gateway-0 to crc 77m Normal Scheduled pod/logging-loki-ingester-0 Successfully assigned openshift-logging/logging-loki-ingester-0 to crc 77m Normal AddedInterface pod/logging-loki-querier-76788598db-rgsmc Add eth0 [10.217.0.53/23] from ovn-kubernetes 77m Normal Scheduled pod/logging-loki-compactor-0 Successfully assigned openshift-logging/logging-loki-compactor-0 to crc 77m Normal Pulling pod/logging-loki-query-frontend-69d9546745-6sm7h Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" 77m Normal AddedInterface pod/logging-loki-query-frontend-69d9546745-6sm7h Add eth0 [10.217.0.54/23] from ovn-kubernetes 77m Normal Pulling pod/logging-loki-ingester-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" 77m Normal AddedInterface pod/logging-loki-index-gateway-0 Add eth0 [10.217.0.80/23] from ovn-kubernetes 77m Normal Pulling pod/logging-loki-gateway-74447864d7-6nhsx Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:574afd46f23637b1685ddb00b647bb71d2e2d527611182fd2826bb818c5eb198" 77m Normal AddedInterface pod/logging-loki-gateway-74447864d7-6nhsx Add eth0 [10.217.0.57/23] from ovn-kubernetes 77m Normal Pulling pod/logging-loki-gateway-74447864d7-m77fj Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:574afd46f23637b1685ddb00b647bb71d2e2d527611182fd2826bb818c5eb198" 77m Normal Pulling pod/logging-loki-index-gateway-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" 77m Normal AddedInterface pod/logging-loki-ingester-0 Add eth0 [10.217.0.58/23] from ovn-kubernetes 77m Normal Pulling pod/logging-loki-compactor-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" 77m Normal AddedInterface pod/logging-loki-compactor-0 Add eth0 [10.217.0.75/23] from ovn-kubernetes 77m Normal Pulled pod/logging-loki-index-gateway-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" in 2.874s (2.874s including waiting). Image size: 225282830 bytes. 77m Normal Started pod/logging-loki-index-gateway-0 Started container loki-index-gateway 77m Normal Started pod/logging-loki-querier-76788598db-rgsmc Started container loki-querier 77m Normal Created pod/logging-loki-querier-76788598db-rgsmc Created container loki-querier 77m Normal Pulled pod/logging-loki-querier-76788598db-rgsmc Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" in 4.15s (4.15s including waiting). Image size: 225282830 bytes. 77m Normal Pulled pod/logging-loki-query-frontend-69d9546745-6sm7h Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" in 4.026s (4.026s including waiting). Image size: 225282830 bytes. 77m Normal Created pod/logging-loki-query-frontend-69d9546745-6sm7h Created container loki-query-frontend 77m Normal Started pod/logging-loki-query-frontend-69d9546745-6sm7h Started container loki-query-frontend 77m Normal Pulling pod/logging-loki-gateway-74447864d7-6nhsx Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:182dc5ab627d64b5e565a2edb170903ac381fc534b4366fc5ffae088ea0de5e5" 77m Normal Started pod/logging-loki-ingester-0 Started container loki-ingester 77m Normal Created pod/logging-loki-ingester-0 Created container loki-ingester 77m Normal Pulled pod/logging-loki-ingester-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" in 3.013s (3.013s including waiting). Image size: 225282830 bytes. 77m Normal Pulled pod/logging-loki-compactor-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" in 3.036s (3.036s including waiting). Image size: 225282830 bytes. 77m Normal Pulled pod/logging-loki-gateway-74447864d7-m77fj Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:574afd46f23637b1685ddb00b647bb71d2e2d527611182fd2826bb818c5eb198" in 3.243s (3.243s including waiting). Image size: 180263561 bytes. 77m Normal Created pod/logging-loki-gateway-74447864d7-m77fj Created container gateway 77m Normal Started pod/logging-loki-gateway-74447864d7-m77fj Started container gateway 77m Normal Pulling pod/logging-loki-gateway-74447864d7-m77fj Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:182dc5ab627d64b5e565a2edb170903ac381fc534b4366fc5ffae088ea0de5e5" 77m Normal Started pod/logging-loki-gateway-74447864d7-6nhsx Started container gateway 77m Normal Created pod/logging-loki-gateway-74447864d7-6nhsx Created container gateway 77m Normal Pulled pod/logging-loki-gateway-74447864d7-6nhsx Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:574afd46f23637b1685ddb00b647bb71d2e2d527611182fd2826bb818c5eb198" in 3.079s (3.079s including waiting). Image size: 180263561 bytes. 77m Normal Created pod/logging-loki-compactor-0 Created container loki-compactor 77m Normal Started pod/logging-loki-compactor-0 Started container loki-compactor 77m Normal Pulled pod/logging-loki-distributor-5f678c8dd6-vllhz Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:8c073f8de8288bf63489a400d7f93e96562652832965d33e0515f48d46282459" in 4.176s (4.176s including waiting). Image size: 225282830 bytes. 77m Normal Created pod/logging-loki-distributor-5f678c8dd6-vllhz Created container loki-distributor 77m Normal Started pod/logging-loki-distributor-5f678c8dd6-vllhz Started container loki-distributor 77m Normal Created pod/logging-loki-index-gateway-0 Created container loki-index-gateway 77m Normal Created pod/logging-loki-gateway-74447864d7-6nhsx Created container opa 77m Normal Started pod/logging-loki-gateway-74447864d7-m77fj Started container opa 77m Normal Created pod/logging-loki-gateway-74447864d7-m77fj Created container opa 77m Normal Pulled pod/logging-loki-gateway-74447864d7-m77fj Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:182dc5ab627d64b5e565a2edb170903ac381fc534b4366fc5ffae088ea0de5e5" in 1.773s (1.773s including waiting). Image size: 160768505 bytes. 77m Normal Started pod/logging-loki-gateway-74447864d7-6nhsx Started container opa 77m Normal Pulled pod/logging-loki-gateway-74447864d7-6nhsx Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:182dc5ab627d64b5e565a2edb170903ac381fc534b4366fc5ffae088ea0de5e5" in 1.816s (1.816s including waiting). Image size: 160768505 bytes. 77m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 76m Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: HTTP probe failed with statuscode: 503 76m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 76m Warning FailedMount pod/collector-v5bxn MountVolume.SetUp failed for volume "metrics" : secret "collector-metrics" not found 76m Normal SuccessfulDelete daemonset/collector Deleted pod: collector-v5bxn 76m Normal SuccessfulCreate daemonset/collector Created pod: collector-v5bxn 76m Warning FailedMount pod/collector-v5bxn MountVolume.SetUp failed for volume "collector-syslog-receiver" : secret "collector-syslog-receiver" not found 76m Normal Scheduled pod/collector-v5bxn Successfully assigned openshift-logging/collector-v5bxn to crc 76m Normal Scheduled pod/collector-t2cnk Successfully assigned openshift-logging/collector-t2cnk to crc 76m Normal SuccessfulCreate daemonset/collector Created pod: collector-t2cnk 76m Normal Pulling pod/collector-t2cnk Pulling image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:fa2cfa2ed336ce105c8dea5bfe0825407e37ef296193ae162f515213fe43c8d5" 76m Normal AddedInterface pod/collector-t2cnk Add eth0 [10.217.0.84/23] from ovn-kubernetes 76m Normal Started pod/collector-t2cnk Started container collector 76m Normal Created pod/collector-t2cnk Created container collector 76m Normal Pulled pod/collector-t2cnk Successfully pulled image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:fa2cfa2ed336ce105c8dea5bfe0825407e37ef296193ae162f515213fe43c8d5" in 11.146s (11.146s including waiting). Image size: 344557702 bytes. 70m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/loadBalancerIPs 70m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/address-pool 70m Normal IPAllocated service/openstack-logging Assigned IP ["172.17.0.80"] 70m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/allow-shared-ip 70m Normal nodeAssigned service/openstack-logging announcing from node "crc" with protocol "layer2" 7m50s Warning Unhealthy pod/logging-loki-gateway-74447864d7-m77fj Readiness probe failed: Get "https://10.217.0.55:8083/ready": context deadline exceeded 7m50s Warning ProbeError pod/logging-loki-gateway-74447864d7-m77fj Readiness probe error: Get "https://10.217.0.55:8083/ready": context deadline exceeded... 7m15s Warning ProbeError pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe error: Get "https://10.217.0.57:8083/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 7m15s Warning Unhealthy pod/logging-loki-querier-76788598db-rgsmc Liveness probe failed: Get "https://10.217.0.53:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 7m15s Warning ProbeError pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe error: Get "https://10.217.0.57:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 7m15s Warning Unhealthy pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe failed: Get "https://10.217.0.57:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 7m15s Warning ProbeError pod/logging-loki-query-frontend-69d9546745-6sm7h Liveness probe error: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 7m15s Warning Unhealthy pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe failed: Get "https://10.217.0.57:8083/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 7m15s Warning Unhealthy pod/logging-loki-gateway-74447864d7-m77fj Readiness probe failed: Get "https://10.217.0.55:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 7m15s Warning Unhealthy pod/logging-loki-query-frontend-69d9546745-6sm7h Liveness probe failed: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 7m15s Warning ProbeError pod/logging-loki-gateway-74447864d7-m77fj Readiness probe error: Get "https://10.217.0.55:8081/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 7m15s Warning ProbeError pod/logging-loki-distributor-5f678c8dd6-vllhz Liveness probe error: Get "https://10.217.0.52:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 7m15s Warning Unhealthy pod/logging-loki-distributor-5f678c8dd6-vllhz Liveness probe failed: Get "https://10.217.0.52:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 7m15s Warning ProbeError pod/logging-loki-querier-76788598db-rgsmc Liveness probe error: Get "https://10.217.0.53:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 7m14s Warning ProbeError pod/logging-loki-gateway-74447864d7-m77fj Liveness probe error: Get "https://10.217.0.55:8081/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 7m14s Warning ProbeError pod/logging-loki-gateway-74447864d7-6nhsx Liveness probe error: Get "https://10.217.0.57:8081/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 7m14s Warning ProbeError pod/logging-loki-gateway-74447864d7-m77fj Liveness probe error: Get "https://10.217.0.55:8083/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 7m14s Warning Unhealthy pod/logging-loki-gateway-74447864d7-6nhsx Liveness probe failed: Get "https://10.217.0.57:8081/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 7m14s Warning ProbeError pod/logging-loki-gateway-74447864d7-6nhsx Liveness probe error: Get "https://10.217.0.57:8083/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 7m14s Warning Unhealthy pod/logging-loki-gateway-74447864d7-m77fj Liveness probe failed: Get "https://10.217.0.55:8083/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 7m14s Warning Unhealthy pod/logging-loki-gateway-74447864d7-6nhsx Liveness probe failed: Get "https://10.217.0.57:8083/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 7m14s Warning Unhealthy pod/logging-loki-gateway-74447864d7-m77fj Liveness probe failed: Get "https://10.217.0.55:8081/live": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 7m10s Warning Unhealthy pod/logging-loki-gateway-74447864d7-m77fj Readiness probe failed: Get "https://10.217.0.55:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 7m10s Warning Unhealthy pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe failed: Get "https://10.217.0.57:8081/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 7m10s Warning ProbeError pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe error: Get "https://10.217.0.57:8081/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 7m10s Warning Unhealthy pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe failed: Get "https://10.217.0.57:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 7m5s Warning Unhealthy pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe failed: Get "https://10.217.0.57:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 7m5s Warning ProbeError pod/logging-loki-gateway-74447864d7-m77fj Readiness probe error: Get "https://10.217.0.55:8083/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 7m5s Warning Unhealthy pod/logging-loki-gateway-74447864d7-m77fj Readiness probe failed: Get "https://10.217.0.55:8083/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 7m5s Warning ProbeError pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe error: Get "https://10.217.0.57:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 7m Warning ProbeError pod/logging-loki-gateway-74447864d7-m77fj Readiness probe error: Get "https://10.217.0.55:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 7m Warning ProbeError pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe error: Get "https://10.217.0.57:8083/ready": context deadline exceeded... 7m Warning Unhealthy pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe failed: Get "https://10.217.0.57:8083/ready": context deadline exceeded 7m Warning Unhealthy pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe failed: Get "https://10.217.0.57:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 7m Warning ProbeError pod/logging-loki-gateway-74447864d7-m77fj Readiness probe error: Get "https://10.217.0.55:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 7m Warning Unhealthy pod/logging-loki-gateway-74447864d7-m77fj Readiness probe failed: Get "https://10.217.0.55:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 7m Warning Unhealthy pod/logging-loki-gateway-74447864d7-m77fj Readiness probe failed: Get "https://10.217.0.55:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 6m56s Warning ProbeError pod/logging-loki-query-frontend-69d9546745-6sm7h Readiness probe error: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 6m56s Warning Unhealthy pod/logging-loki-query-frontend-69d9546745-6sm7h Readiness probe failed: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 6m55s Warning ProbeError pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe error: Get "https://10.217.0.57:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 6m55s Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: Get "https://10.217.0.58:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 6m55s Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: Get "https://10.217.0.58:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 6m55s Warning ProbeError pod/logging-loki-gateway-74447864d7-m77fj Readiness probe error: Get "https://10.217.0.55:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 6m54s Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: Get "https://10.217.0.58:3101/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 6m54s Warning Unhealthy pod/logging-loki-query-frontend-69d9546745-6sm7h Readiness probe failed: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 6m54s Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: Get "https://10.217.0.58:3101/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 6m54s Warning ProbeError pod/logging-loki-compactor-0 Readiness probe error: Get "https://10.217.0.75:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 6m54s Warning Unhealthy pod/logging-loki-compactor-0 Readiness probe failed: Get "https://10.217.0.75:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 6m54s Warning ProbeError pod/logging-loki-querier-76788598db-rgsmc Readiness probe error: Get "https://10.217.0.53:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 6m54s Warning ProbeError pod/logging-loki-query-frontend-69d9546745-6sm7h Readiness probe error: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 6m54s Warning Unhealthy pod/logging-loki-querier-76788598db-rgsmc Readiness probe failed: Get "https://10.217.0.53:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 6m46s Warning ProbeError pod/logging-loki-query-frontend-69d9546745-6sm7h Readiness probe error: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m46s Warning Unhealthy pod/logging-loki-query-frontend-69d9546745-6sm7h Readiness probe failed: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m46s Warning Unhealthy pod/logging-loki-querier-76788598db-rgsmc Readiness probe failed: Get "https://10.217.0.53:3101/ready": context deadline exceeded 6m46s Warning Unhealthy pod/logging-loki-distributor-5f678c8dd6-vllhz Readiness probe failed: Get "https://10.217.0.52:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 6m46s Warning ProbeError pod/logging-loki-distributor-5f678c8dd6-vllhz Readiness probe error: Get "https://10.217.0.52:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 6m46s Warning ProbeError pod/logging-loki-querier-76788598db-rgsmc Readiness probe error: Get "https://10.217.0.53:3101/ready": context deadline exceeded... 6m45s Warning ProbeError pod/logging-loki-query-frontend-69d9546745-6sm7h Liveness probe error: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": context deadline exceeded... 6m45s Warning Unhealthy pod/logging-loki-distributor-5f678c8dd6-vllhz Liveness probe failed: Get "https://10.217.0.52:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m45s Warning Unhealthy pod/logging-loki-index-gateway-0 Readiness probe failed: Get "https://10.217.0.80:3101/ready": context deadline exceeded 6m45s Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: Get "https://10.217.0.58:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m45s Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: Get "https://10.217.0.58:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m45s Warning ProbeError pod/logging-loki-compactor-0 Readiness probe error: Get "https://10.217.0.75:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m45s Warning Unhealthy pod/logging-loki-compactor-0 Readiness probe failed: Get "https://10.217.0.75:3101/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m45s Warning ProbeError pod/logging-loki-index-gateway-0 Readiness probe error: Get "https://10.217.0.80:3101/ready": context deadline exceeded... 6m45s Warning Unhealthy pod/logging-loki-query-frontend-69d9546745-6sm7h Liveness probe failed: Get "https://10.217.0.54:3101/loki/api/v1/status/buildinfo": context deadline exceeded 6m45s Warning Unhealthy pod/logging-loki-querier-76788598db-rgsmc Liveness probe failed: Get "https://10.217.0.53:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m45s Warning ProbeError pod/logging-loki-querier-76788598db-rgsmc Liveness probe error: Get "https://10.217.0.53:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m45s Warning ProbeError pod/logging-loki-distributor-5f678c8dd6-vllhz Liveness probe error: Get "https://10.217.0.52:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m44s Warning ProbeError pod/logging-loki-index-gateway-0 Liveness probe error: Get "https://10.217.0.80:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m44s Warning Unhealthy pod/logging-loki-index-gateway-0 Liveness probe failed: Get "https://10.217.0.80:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m44s Warning Unhealthy pod/logging-loki-compactor-0 Liveness probe failed: Get "https://10.217.0.75:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m44s Warning ProbeError pod/logging-loki-compactor-0 Liveness probe error: Get "https://10.217.0.75:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 6m44s Warning Unhealthy pod/logging-loki-ingester-0 Liveness probe failed: Get "https://10.217.0.58:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 6m44s Warning ProbeError pod/logging-loki-ingester-0 Liveness probe error: Get "https://10.217.0.58:3101/loki/api/v1/status/buildinfo": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 5m51s Normal nodeAssigned service/openstack-logging announcing from node "crc" with protocol "layer2" 5m51s Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/loadBalancerIPs 5m51s Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/allow-shared-ip 5m51s Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/address-pool 2m15s Warning ProbeError pod/logging-loki-gateway-74447864d7-6nhsx Readiness probe error: Get "https://10.217.0.57:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 2m14s Warning ProbeError pod/logging-loki-index-gateway-0 Readiness probe error: Get "https://10.217.0.80:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 2m14s Warning Unhealthy pod/logging-loki-index-gateway-0 Readiness probe failed: Get "https://10.217.0.80:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)