LAST SEEN TYPE REASON OBJECT MESSAGE 92m Normal RequirementsUnknown clusterserviceversion/cluster-logging.v6.2.6 requirements not yet checked 92m Normal RequirementsNotMet clusterserviceversion/cluster-logging.v6.2.6 one or more requirements couldn't be found 92m Normal SuccessfulCreate replicaset/cluster-logging-operator-ff9846bd Created pod: cluster-logging-operator-ff9846bd-cp7lm 92m Normal Scheduled pod/cluster-logging-operator-ff9846bd-cp7lm Successfully assigned openshift-logging/cluster-logging-operator-ff9846bd-cp7lm to crc 92m Normal ScalingReplicaSet deployment/cluster-logging-operator Scaled up replica set cluster-logging-operator-ff9846bd to 1 92m Normal AllRequirementsMet clusterserviceversion/cluster-logging.v6.2.6 all requirements found, attempting install 92m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.6 waiting for install components to report healthy 92m Normal Pulling pod/cluster-logging-operator-ff9846bd-cp7lm Pulling image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:f15ebe396f96093861d528a3307a3e38ac2d4dff594f793c1e56011a3a909175" 92m Normal AddedInterface pod/cluster-logging-operator-ff9846bd-cp7lm Add eth0 [10.217.0.50/23] from ovn-kubernetes 92m Normal InstallWaiting clusterserviceversion/cluster-logging.v6.2.6 installing: waiting for deployment cluster-logging-operator to become ready: deployment "cluster-logging-operator" not available: Deployment does not have minimum availability. 92m Normal Pulled pod/cluster-logging-operator-ff9846bd-cp7lm Successfully pulled image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:f15ebe396f96093861d528a3307a3e38ac2d4dff594f793c1e56011a3a909175" in 5.499s (5.499s including waiting). Image size: 341609952 bytes. 92m Normal Created pod/cluster-logging-operator-ff9846bd-cp7lm Created container cluster-logging-operator 92m Normal Started pod/cluster-logging-operator-ff9846bd-cp7lm Started container cluster-logging-operator 92m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.6 install strategy completed with no errors 92m Normal SuccessfulCreate statefulset/logging-loki-ingester create Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester successful 92m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-compactor-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 92m Normal ExternalProvisioning persistentvolumeclaim/wal-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 92m Normal WaitForFirstConsumer persistentvolumeclaim/wal-logging-loki-ingester-0 waiting for first consumer to be created before binding 92m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-ingester-0 Successfully provisioned volume pvc-52cfb90f-1588-4167-9558-f8b56f1c4606 92m Normal Provisioning persistentvolumeclaim/storage-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-ingester-0" 92m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 92m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-ingester-0 waiting for first consumer to be created before binding 92m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-index-gateway-0 Successfully provisioned volume pvc-490c2d52-64a5-4148-a0dc-6f9e19539b3a 92m Normal Provisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-index-gateway-0" 92m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 92m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-index-gateway-0 waiting for first consumer to be created before binding 92m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Claim storage-logging-loki-index-gateway-0 Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway success 92m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway successful 92m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim storage-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 92m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-compactor-0 Successfully provisioned volume pvc-0a12d857-d9cd-466b-9164-704d77585948 92m Normal Provisioning persistentvolumeclaim/storage-logging-loki-compactor-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-compactor-0" 92m Normal Scheduled pod/logging-loki-query-frontend-84558f7c9f-hxcvg Successfully assigned openshift-logging/logging-loki-query-frontend-84558f7c9f-hxcvg to crc 92m Normal SuccessfulCreate statefulset/logging-loki-compactor create Claim storage-logging-loki-compactor-0 Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor success 92m Normal SuccessfulCreate statefulset/logging-loki-compactor create Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor successful 92m Normal Scheduled pod/logging-loki-distributor-76cc67bf56-hvxhx Successfully assigned openshift-logging/logging-loki-distributor-76cc67bf56-hvxhx to crc 92m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim wal-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 92m Normal NoPods poddisruptionbudget/logging-loki-ingester No matching pods found 92m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-compactor-0 waiting for first consumer to be created before binding 92m Normal ScalingReplicaSet deployment/logging-loki-query-frontend Scaled up replica set logging-loki-query-frontend-84558f7c9f to 1 92m Normal SuccessfulCreate replicaset/logging-loki-query-frontend-84558f7c9f Created pod: logging-loki-query-frontend-84558f7c9f-hxcvg 92m Normal SuccessfulCreate replicaset/logging-loki-distributor-76cc67bf56 Created pod: logging-loki-distributor-76cc67bf56-hvxhx 92m Normal ScalingReplicaSet deployment/logging-loki-distributor Scaled up replica set logging-loki-distributor-76cc67bf56 to 1 92m Normal Scheduled pod/logging-loki-querier-5895d59bb8-zhskj Successfully assigned openshift-logging/logging-loki-querier-5895d59bb8-zhskj to crc 92m Normal Provisioning persistentvolumeclaim/wal-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/wal-logging-loki-ingester-0" 92m Normal ProvisioningSucceeded persistentvolumeclaim/wal-logging-loki-ingester-0 Successfully provisioned volume pvc-7352ea09-b04a-46fd-a2df-b3bc5dde887a 92m Normal SuccessfulCreate replicaset/logging-loki-querier-5895d59bb8 Created pod: logging-loki-querier-5895d59bb8-zhskj 92m Normal ScalingReplicaSet deployment/logging-loki-querier Scaled up replica set logging-loki-querier-5895d59bb8 to 1 92m Warning FailedMount pod/logging-loki-gateway-6f9c8b877-5dtcw MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 92m Normal Scheduled pod/logging-loki-gateway-6f9c8b877-5dtcw Successfully assigned openshift-logging/logging-loki-gateway-6f9c8b877-5dtcw to crc 92m Normal Pulling pod/logging-loki-query-frontend-84558f7c9f-hxcvg Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 92m Normal SuccessfulCreate replicaset/logging-loki-gateway-6f9c8b877 Created pod: logging-loki-gateway-6f9c8b877-jv5cr 92m Normal ScalingReplicaSet deployment/logging-loki-gateway Scaled up replica set logging-loki-gateway-6f9c8b877 to 2 92m Normal Pulling pod/logging-loki-querier-5895d59bb8-zhskj Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 92m Normal AddedInterface pod/logging-loki-querier-5895d59bb8-zhskj Add eth0 [10.217.0.74/23] from ovn-kubernetes 92m Normal Scheduled pod/logging-loki-ingester-0 Successfully assigned openshift-logging/logging-loki-ingester-0 to crc 92m Normal SuccessfulCreate replicaset/logging-loki-gateway-6f9c8b877 Created pod: logging-loki-gateway-6f9c8b877-5dtcw 92m Normal Pulling pod/logging-loki-distributor-76cc67bf56-hvxhx Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 92m Normal Scheduled pod/logging-loki-gateway-6f9c8b877-jv5cr Successfully assigned openshift-logging/logging-loki-gateway-6f9c8b877-jv5cr to crc 92m Warning FailedMount pod/logging-loki-gateway-6f9c8b877-jv5cr MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 92m Normal Scheduled pod/logging-loki-index-gateway-0 Successfully assigned openshift-logging/logging-loki-index-gateway-0 to crc 92m Normal AddedInterface pod/logging-loki-query-frontend-84558f7c9f-hxcvg Add eth0 [10.217.0.75/23] from ovn-kubernetes 92m Normal AddedInterface pod/logging-loki-distributor-76cc67bf56-hvxhx Add eth0 [10.217.0.69/23] from ovn-kubernetes 92m Normal Scheduled pod/logging-loki-compactor-0 Successfully assigned openshift-logging/logging-loki-compactor-0 to crc 91m Normal Pulling pod/logging-loki-gateway-6f9c8b877-jv5cr Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" 91m Normal AddedInterface pod/logging-loki-ingester-0 Add eth0 [10.217.0.78/23] from ovn-kubernetes 91m Normal Pulling pod/logging-loki-ingester-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 91m Normal AddedInterface pod/logging-loki-compactor-0 Add eth0 [10.217.0.79/23] from ovn-kubernetes 91m Normal Pulling pod/logging-loki-compactor-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 91m Normal Pulling pod/logging-loki-index-gateway-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 91m Normal AddedInterface pod/logging-loki-index-gateway-0 Add eth0 [10.217.0.80/23] from ovn-kubernetes 91m Normal AddedInterface pod/logging-loki-gateway-6f9c8b877-jv5cr Add eth0 [10.217.0.76/23] from ovn-kubernetes 91m Normal AddedInterface pod/logging-loki-gateway-6f9c8b877-5dtcw Add eth0 [10.217.0.77/23] from ovn-kubernetes 91m Normal Pulling pod/logging-loki-gateway-6f9c8b877-5dtcw Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" 91m Normal Pulled pod/logging-loki-querier-5895d59bb8-zhskj Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 4.053s (4.053s including waiting). Image size: 216113723 bytes. 91m Normal Created pod/logging-loki-ingester-0 Created container loki-ingester 91m Normal Pulled pod/logging-loki-compactor-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 2.652s (2.652s including waiting). Image size: 216113723 bytes. 91m Normal Created pod/logging-loki-compactor-0 Created container loki-compactor 91m Normal Started pod/logging-loki-compactor-0 Started container loki-compactor 91m Normal Pulled pod/logging-loki-index-gateway-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 2.75s (2.75s including waiting). Image size: 216113723 bytes. 91m Normal Pulled pod/logging-loki-distributor-76cc67bf56-hvxhx Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 4.072s (4.072s including waiting). Image size: 216113723 bytes. 91m Normal Created pod/logging-loki-distributor-76cc67bf56-hvxhx Created container loki-distributor 91m Normal Started pod/logging-loki-distributor-76cc67bf56-hvxhx Started container loki-distributor 91m Normal Pulled pod/logging-loki-query-frontend-84558f7c9f-hxcvg Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 3.892s (3.892s including waiting). Image size: 216113723 bytes. 91m Normal Pulled pod/logging-loki-gateway-6f9c8b877-5dtcw Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" in 2.787s (2.787s including waiting). Image size: 179177912 bytes. 91m Normal Pulled pod/logging-loki-gateway-6f9c8b877-jv5cr Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" in 3.246s (3.246s including waiting). Image size: 179177912 bytes. 91m Normal Started pod/logging-loki-ingester-0 Started container loki-ingester 91m Normal Pulled pod/logging-loki-ingester-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 2.826s (2.826s including waiting). Image size: 216113723 bytes. 91m Normal Pulling pod/logging-loki-gateway-6f9c8b877-5dtcw Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" 91m Normal Created pod/logging-loki-querier-5895d59bb8-zhskj Created container loki-querier 91m Normal Created pod/logging-loki-index-gateway-0 Created container loki-index-gateway 91m Normal Started pod/logging-loki-index-gateway-0 Started container loki-index-gateway 91m Normal Started pod/logging-loki-gateway-6f9c8b877-jv5cr Started container gateway 91m Normal Created pod/logging-loki-gateway-6f9c8b877-jv5cr Created container gateway 91m Normal Pulling pod/logging-loki-gateway-6f9c8b877-jv5cr Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" 91m Normal Started pod/logging-loki-query-frontend-84558f7c9f-hxcvg Started container loki-query-frontend 91m Normal Created pod/logging-loki-query-frontend-84558f7c9f-hxcvg Created container loki-query-frontend 91m Normal Created pod/logging-loki-gateway-6f9c8b877-5dtcw Created container gateway 91m Normal Started pod/logging-loki-gateway-6f9c8b877-5dtcw Started container gateway 91m Normal Started pod/logging-loki-querier-5895d59bb8-zhskj Started container loki-querier 91m Normal Started pod/logging-loki-gateway-6f9c8b877-jv5cr Started container opa 91m Normal Started pod/logging-loki-gateway-6f9c8b877-5dtcw Started container opa 91m Normal Pulled pod/logging-loki-gateway-6f9c8b877-5dtcw Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" in 5.19s (5.19s including waiting). Image size: 159515440 bytes. 91m Normal Created pod/logging-loki-gateway-6f9c8b877-5dtcw Created container opa 91m Normal Pulled pod/logging-loki-gateway-6f9c8b877-jv5cr Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" in 5.18s (5.18s including waiting). Image size: 159515440 bytes. 91m Normal Created pod/logging-loki-gateway-6f9c8b877-jv5cr Created container opa 91m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 91m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 91m Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: HTTP probe failed with statuscode: 503 90m Warning FailedMount pod/collector-zsks9 MountVolume.SetUp failed for volume "collector-syslog-receiver" : secret "collector-syslog-receiver" not found 90m Normal Scheduled pod/collector-zsks9 Successfully assigned openshift-logging/collector-zsks9 to crc 90m Warning FailedMount pod/collector-zsks9 MountVolume.SetUp failed for volume "metrics" : secret "collector-metrics" not found 90m Normal SuccessfulCreate daemonset/collector Created pod: collector-zsks9 90m Normal SuccessfulDelete daemonset/collector Deleted pod: collector-zsks9 90m Normal SuccessfulCreate daemonset/collector Created pod: collector-dmrkn 90m Normal Scheduled pod/collector-dmrkn Successfully assigned openshift-logging/collector-dmrkn to crc 90m Normal Pulling pod/collector-dmrkn Pulling image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:438aa27c0408214bc64d01b20f233d698fa48344aa2dd878bc090232f227c17c" 90m Normal AddedInterface pod/collector-dmrkn Add eth0 [10.217.0.86/23] from ovn-kubernetes 90m Normal Created pod/collector-dmrkn Created container collector 90m Normal Pulled pod/collector-dmrkn Successfully pulled image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:438aa27c0408214bc64d01b20f233d698fa48344aa2dd878bc090232f227c17c" in 6.47s (6.47s including waiting). Image size: 344503702 bytes. 90m Normal Started pod/collector-dmrkn Started container collector 84m Normal nodeAssigned service/openstack-logging announcing from node "crc" with protocol "layer2" 84m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/loadBalancerIPs 84m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/allow-shared-ip 84m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/address-pool 84m Normal IPAllocated service/openstack-logging Assigned IP ["172.17.0.80"] 72m Warning Unhealthy pod/logging-loki-gateway-6f9c8b877-5dtcw Liveness probe failed: HTTP probe failed with statuscode: 503 72m Warning ProbeError pod/logging-loki-gateway-6f9c8b877-5dtcw Liveness probe error: HTTP probe failed with statuscode: 503... 72m Warning Unhealthy pod/logging-loki-gateway-6f9c8b877-jv5cr Readiness probe failed: Get "https://10.217.0.76:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 72m Warning ProbeError pod/logging-loki-gateway-6f9c8b877-jv5cr Readiness probe error: Get "https://10.217.0.76:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)... 71m Warning ProbeError pod/logging-loki-gateway-6f9c8b877-jv5cr Readiness probe error: HTTP probe failed with statuscode: 503... 71m Warning Unhealthy pod/logging-loki-gateway-6f9c8b877-jv5cr Readiness probe failed: HTTP probe failed with statuscode: 503 14m Warning Unhealthy pod/logging-loki-gateway-6f9c8b877-5dtcw Readiness probe failed: Get "https://10.217.0.77:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 14m Warning ProbeError pod/logging-loki-gateway-6f9c8b877-5dtcw Readiness probe error: Get "https://10.217.0.77:8081/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)...