LAST SEEN TYPE REASON OBJECT MESSAGE 79m Normal RequirementsUnknown clusterserviceversion/cluster-logging.v6.2.6 requirements not yet checked 79m Normal RequirementsNotMet clusterserviceversion/cluster-logging.v6.2.6 one or more requirements couldn't be found 79m Normal SuccessfulCreate replicaset/cluster-logging-operator-ff9846bd Created pod: cluster-logging-operator-ff9846bd-vvvc4 79m Normal Scheduled pod/cluster-logging-operator-ff9846bd-vvvc4 Successfully assigned openshift-logging/cluster-logging-operator-ff9846bd-vvvc4 to crc 79m Normal ScalingReplicaSet deployment/cluster-logging-operator Scaled up replica set cluster-logging-operator-ff9846bd to 1 79m Normal AllRequirementsMet clusterserviceversion/cluster-logging.v6.2.6 all requirements found, attempting install 79m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.6 waiting for install components to report healthy 79m Normal Pulling pod/cluster-logging-operator-ff9846bd-vvvc4 Pulling image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:f15ebe396f96093861d528a3307a3e38ac2d4dff594f793c1e56011a3a909175" 79m Normal AddedInterface pod/cluster-logging-operator-ff9846bd-vvvc4 Add eth0 [10.217.0.49/23] from ovn-kubernetes 79m Normal InstallWaiting clusterserviceversion/cluster-logging.v6.2.6 installing: waiting for deployment cluster-logging-operator to become ready: deployment "cluster-logging-operator" not available: Deployment does not have minimum availability. 79m Normal Pulled pod/cluster-logging-operator-ff9846bd-vvvc4 Successfully pulled image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:f15ebe396f96093861d528a3307a3e38ac2d4dff594f793c1e56011a3a909175" in 11.667s (11.667s including waiting). Image size: 341609952 bytes. 79m Normal Created pod/cluster-logging-operator-ff9846bd-vvvc4 Created container cluster-logging-operator 79m Normal Started pod/cluster-logging-operator-ff9846bd-vvvc4 Started container cluster-logging-operator 79m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.6 install strategy completed with no errors 78m Normal Provisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-index-gateway-0" 78m Normal SuccessfulCreate replicaset/logging-loki-query-frontend-84558f7c9f Created pod: logging-loki-query-frontend-84558f7c9f-zcnfl 78m Normal ExternalProvisioning persistentvolumeclaim/wal-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 78m Normal WaitForFirstConsumer persistentvolumeclaim/wal-logging-loki-ingester-0 waiting for first consumer to be created before binding 78m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-ingester-0 Successfully provisioned volume pvc-1280e5f8-9ce2-4e5a-9fb8-148ee1ecef97 78m Normal Provisioning persistentvolumeclaim/storage-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-ingester-0" 78m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 78m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-ingester-0 waiting for first consumer to be created before binding 78m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Claim storage-logging-loki-index-gateway-0 Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway success 78m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 78m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-index-gateway-0 waiting for first consumer to be created before binding 78m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-compactor-0 Successfully provisioned volume pvc-87d705e0-af27-4716-b69b-1c0e7b627147 78m Normal Provisioning persistentvolumeclaim/storage-logging-loki-compactor-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-compactor-0" 78m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-compactor-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 78m Normal ScalingReplicaSet deployment/logging-loki-query-frontend Scaled up replica set logging-loki-query-frontend-84558f7c9f to 1 78m Normal Provisioning persistentvolumeclaim/wal-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/wal-logging-loki-ingester-0" 78m Normal Scheduled pod/logging-loki-query-frontend-84558f7c9f-zcnfl Successfully assigned openshift-logging/logging-loki-query-frontend-84558f7c9f-zcnfl to crc 78m Normal SuccessfulCreate statefulset/logging-loki-compactor create Claim storage-logging-loki-compactor-0 Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor success 78m Normal SuccessfulCreate statefulset/logging-loki-compactor create Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor successful 78m Normal Scheduled pod/logging-loki-distributor-76cc67bf56-shzjb Successfully assigned openshift-logging/logging-loki-distributor-76cc67bf56-shzjb to crc 78m Normal ProvisioningSucceeded persistentvolumeclaim/wal-logging-loki-ingester-0 Successfully provisioned volume pvc-adc16b44-90b2-4f96-9c5e-50adc2966741 78m Normal ScalingReplicaSet deployment/logging-loki-querier Scaled up replica set logging-loki-querier-5895d59bb8 to 1 78m Normal SuccessfulCreate replicaset/logging-loki-querier-5895d59bb8 Created pod: logging-loki-querier-5895d59bb8-bqnhh 78m Normal Scheduled pod/logging-loki-querier-5895d59bb8-bqnhh Successfully assigned openshift-logging/logging-loki-querier-5895d59bb8-bqnhh to crc 78m Normal SuccessfulCreate statefulset/logging-loki-ingester create Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester successful 78m Normal SuccessfulCreate replicaset/logging-loki-distributor-76cc67bf56 Created pod: logging-loki-distributor-76cc67bf56-shzjb 78m Normal ScalingReplicaSet deployment/logging-loki-distributor Scaled up replica set logging-loki-distributor-76cc67bf56 to 1 78m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim wal-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 78m Normal NoPods poddisruptionbudget/logging-loki-ingester No matching pods found 78m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim storage-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 78m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway successful 78m Normal NoPods poddisruptionbudget/logging-loki-index-gateway No matching pods found 78m Normal AddedInterface pod/logging-loki-distributor-76cc67bf56-shzjb Add eth0 [10.217.0.51/23] from ovn-kubernetes 78m Normal Pulling pod/logging-loki-querier-5895d59bb8-bqnhh Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 78m Normal Scheduled pod/logging-loki-ingester-0 Successfully assigned openshift-logging/logging-loki-ingester-0 to crc 78m Normal Scheduled pod/logging-loki-compactor-0 Successfully assigned openshift-logging/logging-loki-compactor-0 to crc 78m Normal Scheduled pod/logging-loki-index-gateway-0 Successfully assigned openshift-logging/logging-loki-index-gateway-0 to crc 78m Normal Scheduled pod/logging-loki-gateway-58996586f7-7vqxj Successfully assigned openshift-logging/logging-loki-gateway-58996586f7-7vqxj to crc 78m Normal AddedInterface pod/logging-loki-gateway-58996586f7-7vqxj Add eth0 [10.217.0.55/23] from ovn-kubernetes 78m Normal ScalingReplicaSet deployment/logging-loki-gateway Scaled up replica set logging-loki-gateway-58996586f7 to 2 78m Normal SuccessfulCreate replicaset/logging-loki-gateway-58996586f7 Created pod: logging-loki-gateway-58996586f7-7vqxj 78m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-index-gateway-0 Successfully provisioned volume pvc-35584002-1f0d-4e05-9e7a-554085f01b14 78m Normal SuccessfulCreate replicaset/logging-loki-gateway-58996586f7 Created pod: logging-loki-gateway-58996586f7-4xczf 78m Normal Pulling pod/logging-loki-query-frontend-84558f7c9f-zcnfl Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 78m Normal AddedInterface pod/logging-loki-query-frontend-84558f7c9f-zcnfl Add eth0 [10.217.0.53/23] from ovn-kubernetes 78m Normal Pulling pod/logging-loki-distributor-76cc67bf56-shzjb Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 78m Normal Scheduled pod/logging-loki-gateway-58996586f7-4xczf Successfully assigned openshift-logging/logging-loki-gateway-58996586f7-4xczf to crc 78m Normal AddedInterface pod/logging-loki-querier-5895d59bb8-bqnhh Add eth0 [10.217.0.52/23] from ovn-kubernetes 78m Normal Pulling pod/logging-loki-index-gateway-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 78m Normal AddedInterface pod/logging-loki-gateway-58996586f7-4xczf Add eth0 [10.217.0.54/23] from ovn-kubernetes 78m Normal AddedInterface pod/logging-loki-compactor-0 Add eth0 [10.217.0.58/23] from ovn-kubernetes 78m Normal AddedInterface pod/logging-loki-ingester-0 Add eth0 [10.217.0.57/23] from ovn-kubernetes 78m Normal Pulling pod/logging-loki-gateway-58996586f7-7vqxj Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" 78m Normal Pulling pod/logging-loki-gateway-58996586f7-4xczf Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" 78m Normal Pulling pod/logging-loki-ingester-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 78m Normal AddedInterface pod/logging-loki-index-gateway-0 Add eth0 [10.217.0.60/23] from ovn-kubernetes 78m Normal Pulling pod/logging-loki-compactor-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 78m Normal Pulled pod/logging-loki-gateway-58996586f7-4xczf Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" in 3.368s (3.368s including waiting). Image size: 179177912 bytes. 78m Normal Pulled pod/logging-loki-query-frontend-84558f7c9f-zcnfl Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 4.004s (4.004s including waiting). Image size: 216113723 bytes. 78m Normal Pulled pod/logging-loki-compactor-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 3.152s (3.152s including waiting). Image size: 216113723 bytes. 78m Normal Pulled pod/logging-loki-querier-5895d59bb8-bqnhh Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 3.926s (3.926s including waiting). Image size: 216113723 bytes. 78m Normal Pulled pod/logging-loki-index-gateway-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 3.124s (3.124s including waiting). Image size: 216113723 bytes. 78m Normal Pulled pod/logging-loki-ingester-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 3.239s (3.239s including waiting). Image size: 216113723 bytes. 78m Normal Pulled pod/logging-loki-distributor-76cc67bf56-shzjb Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 4.141s (4.141s including waiting). Image size: 216113723 bytes. 78m Normal Pulled pod/logging-loki-gateway-58996586f7-7vqxj Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" in 3.77s (3.77s including waiting). Image size: 179177912 bytes. 78m Normal Created pod/logging-loki-querier-5895d59bb8-bqnhh Created container loki-querier 78m Normal Started pod/logging-loki-compactor-0 Started container loki-compactor 78m Normal Started pod/logging-loki-gateway-58996586f7-4xczf Started container gateway 78m Normal Started pod/logging-loki-index-gateway-0 Started container loki-index-gateway 78m Normal Created pod/logging-loki-index-gateway-0 Created container loki-index-gateway 78m Normal Created pod/logging-loki-gateway-58996586f7-7vqxj Created container gateway 78m Normal Created pod/logging-loki-ingester-0 Created container loki-ingester 78m Normal Started pod/logging-loki-ingester-0 Started container loki-ingester 78m Normal Created pod/logging-loki-gateway-58996586f7-4xczf Created container gateway 78m Normal Started pod/logging-loki-query-frontend-84558f7c9f-zcnfl Started container loki-query-frontend 78m Normal Created pod/logging-loki-query-frontend-84558f7c9f-zcnfl Created container loki-query-frontend 78m Normal Pulling pod/logging-loki-gateway-58996586f7-4xczf Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" 78m Normal Started pod/logging-loki-gateway-58996586f7-7vqxj Started container gateway 78m Normal Pulling pod/logging-loki-gateway-58996586f7-7vqxj Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" 78m Normal Created pod/logging-loki-compactor-0 Created container loki-compactor 78m Normal Started pod/logging-loki-querier-5895d59bb8-bqnhh Started container loki-querier 78m Normal Started pod/logging-loki-distributor-76cc67bf56-shzjb Started container loki-distributor 78m Normal Created pod/logging-loki-distributor-76cc67bf56-shzjb Created container loki-distributor 78m Normal Pulled pod/logging-loki-gateway-58996586f7-7vqxj Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" in 2s (2s including waiting). Image size: 159515440 bytes. 78m Normal Pulled pod/logging-loki-gateway-58996586f7-4xczf Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" in 2.134s (2.134s including waiting). Image size: 159515440 bytes. 78m Normal Started pod/logging-loki-gateway-58996586f7-4xczf Started container opa 78m Normal Created pod/logging-loki-gateway-58996586f7-4xczf Created container opa 78m Normal Started pod/logging-loki-gateway-58996586f7-7vqxj Started container opa 78m Normal Created pod/logging-loki-gateway-58996586f7-7vqxj Created container opa 78m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 77m Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: HTTP probe failed with statuscode: 503 77m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 77m Normal SuccessfulCreate daemonset/collector Created pod: collector-hbgfm 77m Normal Scheduled pod/collector-hbgfm Successfully assigned openshift-logging/collector-hbgfm to crc 77m Warning FailedMount pod/collector-hbgfm MountVolume.SetUp failed for volume "metrics" : secret "collector-metrics" not found 77m Normal SuccessfulDelete daemonset/collector Deleted pod: collector-hbgfm 77m Normal Scheduled pod/collector-88hn7 Successfully assigned openshift-logging/collector-88hn7 to crc 77m Normal SuccessfulCreate daemonset/collector Created pod: collector-88hn7 77m Normal AddedInterface pod/collector-88hn7 Add eth0 [10.217.0.84/23] from ovn-kubernetes 77m Normal Pulling pod/collector-88hn7 Pulling image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:438aa27c0408214bc64d01b20f233d698fa48344aa2dd878bc090232f227c17c" 77m Normal Started pod/collector-88hn7 Started container collector 77m Normal Created pod/collector-88hn7 Created container collector 77m Normal Pulled pod/collector-88hn7 Successfully pulled image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:438aa27c0408214bc64d01b20f233d698fa48344aa2dd878bc090232f227c17c" in 7.228s (7.228s including waiting). Image size: 344503702 bytes. 71m Warning ProbeError pod/logging-loki-gateway-58996586f7-7vqxj Readiness probe error: Get "https://10.217.0.55:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 71m Warning Unhealthy pod/logging-loki-gateway-58996586f7-7vqxj Readiness probe failed: Get "https://10.217.0.55:8083/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 71m Warning ProbeError pod/logging-loki-gateway-58996586f7-7vqxj Readiness probe error: Get "https://10.217.0.55:8081/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 71m Warning Unhealthy pod/logging-loki-gateway-58996586f7-7vqxj Readiness probe failed: Get "https://10.217.0.55:8081/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 71m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: Get "https://10.217.0.57:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 71m Warning Unhealthy pod/logging-loki-query-frontend-84558f7c9f-zcnfl Readiness probe failed: Get "https://10.217.0.53:3101/loki/api/v1/status/buildinfo": context deadline exceeded 71m Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: Get "https://10.217.0.57:3101/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 71m Warning ProbeError pod/logging-loki-query-frontend-84558f7c9f-zcnfl Readiness probe error: Get "https://10.217.0.53:3101/loki/api/v1/status/buildinfo": context deadline exceeded... 71m Warning ProbeError pod/logging-loki-query-frontend-84558f7c9f-zcnfl Liveness probe error: Get "https://10.217.0.53:3101/loki/api/v1/status/buildinfo": context deadline exceeded... 71m Warning Unhealthy pod/logging-loki-query-frontend-84558f7c9f-zcnfl Liveness probe failed: Get "https://10.217.0.53:3101/loki/api/v1/status/buildinfo": context deadline exceeded 71m Warning Unhealthy pod/logging-loki-gateway-58996586f7-7vqxj Readiness probe failed: Get "https://10.217.0.55:8081/ready": context deadline exceeded 71m Warning ProbeError pod/logging-loki-gateway-58996586f7-7vqxj Readiness probe error: Get "https://10.217.0.55:8081/ready": context deadline exceeded... 71m Warning Unhealthy pod/logging-loki-gateway-58996586f7-7vqxj Readiness probe failed: Get "https://10.217.0.55:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 71m Warning ProbeError pod/logging-loki-gateway-58996586f7-7vqxj Readiness probe error: Get "https://10.217.0.55:8083/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)... 71m Normal IPAllocated service/openstack-logging Assigned IP ["172.17.0.80"] 71m Normal nodeAssigned service/openstack-logging announcing from node "crc" with protocol "layer2" 71m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/address-pool 71m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/allow-shared-ip 71m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/loadBalancerIPs