LAST SEEN TYPE REASON OBJECT MESSAGE 19m Normal RequirementsUnknown clusterserviceversion/cluster-logging.v6.2.8 requirements not yet checked 19m Normal RequirementsNotMet clusterserviceversion/cluster-logging.v6.2.8 one or more requirements couldn't be found 19m Normal AllRequirementsMet clusterserviceversion/cluster-logging.v6.2.8 all requirements found, attempting install 19m Normal SuccessfulCreate replicaset/cluster-logging-operator-c769fd969 Created pod: cluster-logging-operator-c769fd969-m424n 19m Normal Scheduled pod/cluster-logging-operator-c769fd969-m424n Successfully assigned openshift-logging/cluster-logging-operator-c769fd969-m424n to crc 19m Normal ScalingReplicaSet deployment/cluster-logging-operator Scaled up replica set cluster-logging-operator-c769fd969 to 1 19m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.8 waiting for install components to report healthy 19m Normal Pulling pod/cluster-logging-operator-c769fd969-m424n Pulling image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:3303e932fe310496b6ae4a8d40a4d6cea0fd93cb4059506d88e774c124cf1b3c" 19m Normal AddedInterface pod/cluster-logging-operator-c769fd969-m424n Add eth0 [10.217.0.48/23] from ovn-kubernetes 19m Normal InstallWaiting clusterserviceversion/cluster-logging.v6.2.8 installing: waiting for deployment cluster-logging-operator to become ready: deployment "cluster-logging-operator" not available: Deployment does not have minimum availability. 19m Normal Created pod/cluster-logging-operator-c769fd969-m424n Created container cluster-logging-operator 19m Normal Started pod/cluster-logging-operator-c769fd969-m424n Started container cluster-logging-operator 19m Normal Pulled pod/cluster-logging-operator-c769fd969-m424n Successfully pulled image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:3303e932fe310496b6ae4a8d40a4d6cea0fd93cb4059506d88e774c124cf1b3c" in 18.49s (18.49s including waiting). Image size: 343181526 bytes. 19m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.8 install strategy completed with no errors 18m Normal ProvisioningSucceeded persistentvolumeclaim/wal-logging-loki-ingester-0 Successfully provisioned volume pvc-1f2caf94-6eb5-4a83-974d-e98a4eaf4320 18m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim wal-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 18m Normal ExternalProvisioning persistentvolumeclaim/wal-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 18m Normal WaitForFirstConsumer persistentvolumeclaim/wal-logging-loki-ingester-0 waiting for first consumer to be created before binding 18m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-ingester-0 Successfully provisioned volume pvc-d6d6b637-ab83-4afc-b9e1-7f7de0c54cdb 18m Normal Provisioning persistentvolumeclaim/storage-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-ingester-0" 18m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 18m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-ingester-0 waiting for first consumer to be created before binding 18m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim storage-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 18m Normal Provisioning persistentvolumeclaim/wal-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/wal-logging-loki-ingester-0" 18m Normal SuccessfulCreate statefulset/logging-loki-ingester create Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester successful 18m Normal Scheduled pod/logging-loki-querier-76bf7b6d45-rfqd7 Successfully assigned openshift-logging/logging-loki-querier-76bf7b6d45-rfqd7 to crc 18m Normal Scheduled pod/logging-loki-distributor-5d5548c9f5-4kq9t Successfully assigned openshift-logging/logging-loki-distributor-5d5548c9f5-4kq9t to crc 18m Normal SuccessfulCreate replicaset/logging-loki-querier-76bf7b6d45 Created pod: logging-loki-querier-76bf7b6d45-rfqd7 18m Normal ScalingReplicaSet deployment/logging-loki-querier Scaled up replica set logging-loki-querier-76bf7b6d45 to 1 18m Normal ScalingReplicaSet deployment/logging-loki-distributor Scaled up replica set logging-loki-distributor-5d5548c9f5 to 1 18m Normal SuccessfulCreate replicaset/logging-loki-distributor-5d5548c9f5 Created pod: logging-loki-distributor-5d5548c9f5-4kq9t 18m Normal AddedInterface pod/logging-loki-distributor-5d5548c9f5-4kq9t Add eth0 [10.217.0.51/23] from ovn-kubernetes 18m Normal Provisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-index-gateway-0" 18m Normal SuccessfulCreate statefulset/logging-loki-compactor create Claim storage-logging-loki-compactor-0 Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor success 18m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Claim storage-logging-loki-index-gateway-0 Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway success 18m Normal Pulling pod/logging-loki-distributor-5d5548c9f5-4kq9t Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:c9e7d4b4842e9a0a7f74b2a010c3cfdb433fa00b73ca7a1b86a56c935cdb633d" 18m Normal Provisioning persistentvolumeclaim/storage-logging-loki-compactor-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-compactor-0" 18m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-compactor-0 waiting for first consumer to be created before binding 18m Normal ScalingReplicaSet deployment/logging-loki-query-frontend Scaled up replica set logging-loki-query-frontend-6d6859c548 to 1 18m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-compactor-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 18m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-compactor-0 Successfully provisioned volume pvc-5d364e47-5da2-47c1-9e45-2eb0aad42eeb 18m Normal Scheduled pod/logging-loki-gateway-78d96f4c68-9bhm5 Successfully assigned openshift-logging/logging-loki-gateway-78d96f4c68-9bhm5 to crc 18m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway successful 18m Normal ScalingReplicaSet deployment/logging-loki-gateway Scaled up replica set logging-loki-gateway-78d96f4c68 to 2 18m Normal SuccessfulCreate replicaset/logging-loki-query-frontend-6d6859c548 Created pod: logging-loki-query-frontend-6d6859c548-lm9mq 18m Normal SuccessfulCreate replicaset/logging-loki-gateway-78d96f4c68 Created pod: logging-loki-gateway-78d96f4c68-9bhm5 18m Normal SuccessfulCreate replicaset/logging-loki-gateway-78d96f4c68 Created pod: logging-loki-gateway-78d96f4c68-sf9z2 18m Normal Scheduled pod/logging-loki-query-frontend-6d6859c548-lm9mq Successfully assigned openshift-logging/logging-loki-query-frontend-6d6859c548-lm9mq to crc 18m Normal WaitForPodScheduled persistentvolumeclaim/storage-logging-loki-index-gateway-0 waiting for pod logging-loki-index-gateway-0 to be scheduled 18m Normal Scheduled pod/logging-loki-ingester-0 Successfully assigned openshift-logging/logging-loki-ingester-0 to crc 18m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-index-gateway-0 Successfully provisioned volume pvc-a0642d47-5d43-4050-afd6-ff53c3106669 18m Normal SuccessfulCreate statefulset/logging-loki-compactor create Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor successful 18m Normal AddedInterface pod/logging-loki-querier-76bf7b6d45-rfqd7 Add eth0 [10.217.0.52/23] from ovn-kubernetes 18m Normal Scheduled pod/logging-loki-gateway-78d96f4c68-sf9z2 Successfully assigned openshift-logging/logging-loki-gateway-78d96f4c68-sf9z2 to crc 18m Warning FailedMount pod/logging-loki-gateway-78d96f4c68-sf9z2 MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 18m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 18m Normal AddedInterface pod/logging-loki-ingester-0 Add eth0 [10.217.0.57/23] from ovn-kubernetes 18m Normal AddedInterface pod/logging-loki-query-frontend-6d6859c548-lm9mq Add eth0 [10.217.0.53/23] from ovn-kubernetes 18m Normal AddedInterface pod/logging-loki-gateway-78d96f4c68-sf9z2 Add eth0 [10.217.0.54/23] from ovn-kubernetes 18m Normal Pulling pod/logging-loki-querier-76bf7b6d45-rfqd7 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:c9e7d4b4842e9a0a7f74b2a010c3cfdb433fa00b73ca7a1b86a56c935cdb633d" 18m Normal AddedInterface pod/logging-loki-compactor-0 Add eth0 [10.217.0.58/23] from ovn-kubernetes 18m Normal Pulling pod/logging-loki-ingester-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:c9e7d4b4842e9a0a7f74b2a010c3cfdb433fa00b73ca7a1b86a56c935cdb633d" 18m Normal Scheduled pod/logging-loki-compactor-0 Successfully assigned openshift-logging/logging-loki-compactor-0 to crc 18m Normal Pulling pod/logging-loki-compactor-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:c9e7d4b4842e9a0a7f74b2a010c3cfdb433fa00b73ca7a1b86a56c935cdb633d" 18m Normal Pulling pod/logging-loki-gateway-78d96f4c68-sf9z2 Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:0460d39f2624e731821734a679b0235240dc8e107a1986acc8197ab377f628ed" 18m Normal Pulling pod/logging-loki-query-frontend-6d6859c548-lm9mq Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:c9e7d4b4842e9a0a7f74b2a010c3cfdb433fa00b73ca7a1b86a56c935cdb633d" 18m Normal Pulling pod/logging-loki-gateway-78d96f4c68-9bhm5 Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:0460d39f2624e731821734a679b0235240dc8e107a1986acc8197ab377f628ed" 18m Normal Scheduled pod/logging-loki-index-gateway-0 Successfully assigned openshift-logging/logging-loki-index-gateway-0 to crc 18m Normal AddedInterface pod/logging-loki-gateway-78d96f4c68-9bhm5 Add eth0 [10.217.0.55/23] from ovn-kubernetes 18m Normal Pulling pod/logging-loki-index-gateway-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:c9e7d4b4842e9a0a7f74b2a010c3cfdb433fa00b73ca7a1b86a56c935cdb633d" 18m Normal AddedInterface pod/logging-loki-index-gateway-0 Add eth0 [10.217.0.75/23] from ovn-kubernetes 18m Normal Created pod/logging-loki-querier-76bf7b6d45-rfqd7 Created container loki-querier 18m Normal Pulled pod/logging-loki-distributor-5d5548c9f5-4kq9t Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:c9e7d4b4842e9a0a7f74b2a010c3cfdb433fa00b73ca7a1b86a56c935cdb633d" in 6.544s (6.544s including waiting). Image size: 225276683 bytes. 18m Normal Created pod/logging-loki-index-gateway-0 Created container loki-index-gateway 18m Normal Pulled pod/logging-loki-index-gateway-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:c9e7d4b4842e9a0a7f74b2a010c3cfdb433fa00b73ca7a1b86a56c935cdb633d" in 5.202s (5.202s including waiting). Image size: 225276683 bytes. 18m Normal Pulled pod/logging-loki-compactor-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:c9e7d4b4842e9a0a7f74b2a010c3cfdb433fa00b73ca7a1b86a56c935cdb633d" in 5.564s (5.564s including waiting). Image size: 225276683 bytes. 18m Normal Created pod/logging-loki-compactor-0 Created container loki-compactor 18m Normal Started pod/logging-loki-compactor-0 Started container loki-compactor 18m Normal Pulled pod/logging-loki-ingester-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:c9e7d4b4842e9a0a7f74b2a010c3cfdb433fa00b73ca7a1b86a56c935cdb633d" in 5.82s (5.82s including waiting). Image size: 225276683 bytes. 18m Normal Created pod/logging-loki-ingester-0 Created container loki-ingester 18m Normal Started pod/logging-loki-ingester-0 Started container loki-ingester 18m Normal Started pod/logging-loki-index-gateway-0 Started container loki-index-gateway 18m Normal Created pod/logging-loki-distributor-5d5548c9f5-4kq9t Created container loki-distributor 18m Normal Started pod/logging-loki-distributor-5d5548c9f5-4kq9t Started container loki-distributor 18m Normal Pulled pod/logging-loki-gateway-78d96f4c68-9bhm5 Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:0460d39f2624e731821734a679b0235240dc8e107a1986acc8197ab377f628ed" in 5.912s (5.912s including waiting). Image size: 174532765 bytes. 18m Normal Started pod/logging-loki-query-frontend-6d6859c548-lm9mq Started container loki-query-frontend 18m Normal Pulling pod/logging-loki-gateway-78d96f4c68-sf9z2 Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:13cd0be568d2cac6058c41fb774f1baafc03dc696d57d0eaa612db681818653d" 18m Normal Started pod/logging-loki-gateway-78d96f4c68-sf9z2 Started container gateway 18m Normal Created pod/logging-loki-gateway-78d96f4c68-sf9z2 Created container gateway 18m Normal Pulled pod/logging-loki-gateway-78d96f4c68-sf9z2 Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:0460d39f2624e731821734a679b0235240dc8e107a1986acc8197ab377f628ed" in 5.954s (5.954s including waiting). Image size: 174532765 bytes. 18m Normal Created pod/logging-loki-query-frontend-6d6859c548-lm9mq Created container loki-query-frontend 18m Normal Pulled pod/logging-loki-query-frontend-6d6859c548-lm9mq Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:c9e7d4b4842e9a0a7f74b2a010c3cfdb433fa00b73ca7a1b86a56c935cdb633d" in 6.141s (6.141s including waiting). Image size: 225276683 bytes. 18m Normal Pulled pod/logging-loki-querier-76bf7b6d45-rfqd7 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:c9e7d4b4842e9a0a7f74b2a010c3cfdb433fa00b73ca7a1b86a56c935cdb633d" in 6.498s (6.498s including waiting). Image size: 225276683 bytes. 18m Normal Created pod/logging-loki-gateway-78d96f4c68-9bhm5 Created container gateway 18m Normal Started pod/logging-loki-querier-76bf7b6d45-rfqd7 Started container loki-querier 18m Normal Started pod/logging-loki-gateway-78d96f4c68-9bhm5 Started container gateway 18m Normal Pulling pod/logging-loki-gateway-78d96f4c68-9bhm5 Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:13cd0be568d2cac6058c41fb774f1baafc03dc696d57d0eaa612db681818653d" 18m Normal Pulled pod/logging-loki-gateway-78d96f4c68-9bhm5 Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:13cd0be568d2cac6058c41fb774f1baafc03dc696d57d0eaa612db681818653d" in 2.608s (2.608s including waiting). Image size: 160762347 bytes. 18m Normal Created pod/logging-loki-gateway-78d96f4c68-9bhm5 Created container opa 18m Normal Started pod/logging-loki-gateway-78d96f4c68-9bhm5 Started container opa 18m Normal Started pod/logging-loki-gateway-78d96f4c68-sf9z2 Started container opa 18m Normal Created pod/logging-loki-gateway-78d96f4c68-sf9z2 Created container opa 18m Normal Pulled pod/logging-loki-gateway-78d96f4c68-sf9z2 Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:13cd0be568d2cac6058c41fb774f1baafc03dc696d57d0eaa612db681818653d" in 2.608s (2.608s including waiting). Image size: 160762347 bytes. 18m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 18m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 18m Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: HTTP probe failed with statuscode: 503 17m Normal Scheduled pod/collector-bg5l7 Successfully assigned openshift-logging/collector-bg5l7 to crc 17m Normal SuccessfulCreate daemonset/collector Created pod: collector-bg5l7 17m Warning FailedMount pod/collector-bg5l7 MountVolume.SetUp failed for volume "metrics" : secret "collector-metrics" not found 17m Normal SuccessfulDelete daemonset/collector Deleted pod: collector-bg5l7 17m Normal SuccessfulCreate daemonset/collector Created pod: collector-4jmff 17m Normal Scheduled pod/collector-4jmff Successfully assigned openshift-logging/collector-4jmff to crc 17m Normal AddedInterface pod/collector-4jmff Add eth0 [10.217.0.83/23] from ovn-kubernetes 17m Normal Pulling pod/collector-4jmff Pulling image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:7683a6c06eb7e40d1338bcf4a3f846b03e4993c0caef74234126696c21551978" 17m Normal Started pod/collector-4jmff Started container collector 17m Normal Pulled pod/collector-4jmff Successfully pulled image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:7683a6c06eb7e40d1338bcf4a3f846b03e4993c0caef74234126696c21551978" in 5.847s (5.847s including waiting). Image size: 320720510 bytes. 17m Normal Created pod/collector-4jmff Created container collector 12m Normal IPAllocated service/openstack-logging Assigned IP ["172.17.0.80"] 12m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/loadBalancerIPs 12m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/address-pool 12m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/allow-shared-ip 12m Normal nodeAssigned service/openstack-logging announcing from node "crc" with protocol "layer2" 10m Warning ProbeError pod/logging-loki-gateway-78d96f4c68-9bhm5 Readiness probe error: Get "https://10.217.0.55:8083/ready": context deadline exceeded... 10m Warning Unhealthy pod/logging-loki-gateway-78d96f4c68-9bhm5 Readiness probe failed: Get "https://10.217.0.55:8083/ready": context deadline exceeded 10m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: Get "https://10.217.0.57:3101/ready": context deadline exceeded... 10m Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: Get "https://10.217.0.57:3101/ready": context deadline exceeded