LAST SEEN TYPE REASON OBJECT MESSAGE 78m Normal Scheduled pod/logging-loki-compactor-0 Successfully assigned openshift-logging/logging-loki-compactor-0 to crc 78m Normal Scheduled pod/logging-loki-distributor-76cc67bf56-kh68l Successfully assigned openshift-logging/logging-loki-distributor-76cc67bf56-kh68l to crc 78m Normal Scheduled pod/logging-loki-ingester-0 Successfully assigned openshift-logging/logging-loki-ingester-0 to crc 78m Normal Scheduled pod/logging-loki-gateway-7c9c75f6cc-rxvv4 Successfully assigned openshift-logging/logging-loki-gateway-7c9c75f6cc-rxvv4 to crc 76m Normal Scheduled pod/collector-mqjqf Successfully assigned openshift-logging/collector-mqjqf to crc 78m Normal Scheduled pod/logging-loki-query-frontend-84558f7c9f-zmggt Successfully assigned openshift-logging/logging-loki-query-frontend-84558f7c9f-zmggt to crc 76m Normal Scheduled pod/collector-42tlr Successfully assigned openshift-logging/collector-42tlr to crc 78m Normal Scheduled pod/logging-loki-gateway-7c9c75f6cc-v4gvv Successfully assigned openshift-logging/logging-loki-gateway-7c9c75f6cc-v4gvv to crc 78m Normal Scheduled pod/cluster-logging-operator-ff9846bd-4tr6l Successfully assigned openshift-logging/cluster-logging-operator-ff9846bd-4tr6l to crc 78m Normal Scheduled pod/logging-loki-querier-5895d59bb8-pj2ck Successfully assigned openshift-logging/logging-loki-querier-5895d59bb8-pj2ck to crc 78m Normal Scheduled pod/logging-loki-index-gateway-0 Successfully assigned openshift-logging/logging-loki-index-gateway-0 to crc 78m Normal RequirementsUnknown clusterserviceversion/cluster-logging.v6.2.6 requirements not yet checked 78m Normal RequirementsNotMet clusterserviceversion/cluster-logging.v6.2.6 one or more requirements couldn't be found 78m Normal SuccessfulCreate replicaset/cluster-logging-operator-ff9846bd Created pod: cluster-logging-operator-ff9846bd-4tr6l 78m Normal AllRequirementsMet clusterserviceversion/cluster-logging.v6.2.6 all requirements found, attempting install 78m Normal ScalingReplicaSet deployment/cluster-logging-operator Scaled up replica set cluster-logging-operator-ff9846bd to 1 78m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.6 waiting for install components to report healthy 78m Normal Pulling pod/cluster-logging-operator-ff9846bd-4tr6l Pulling image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:f15ebe396f96093861d528a3307a3e38ac2d4dff594f793c1e56011a3a909175" 78m Normal AddedInterface pod/cluster-logging-operator-ff9846bd-4tr6l Add eth0 [10.217.0.48/23] from ovn-kubernetes 78m Normal InstallWaiting clusterserviceversion/cluster-logging.v6.2.6 installing: waiting for deployment cluster-logging-operator to become ready: deployment "cluster-logging-operator" not available: Deployment does not have minimum availability. 78m Normal Started pod/cluster-logging-operator-ff9846bd-4tr6l Started container cluster-logging-operator 78m Normal Created pod/cluster-logging-operator-ff9846bd-4tr6l Created container cluster-logging-operator 78m Normal Pulled pod/cluster-logging-operator-ff9846bd-4tr6l Successfully pulled image "registry.redhat.io/openshift-logging/cluster-logging-rhel9-operator@sha256:f15ebe396f96093861d528a3307a3e38ac2d4dff594f793c1e56011a3a909175" in 14.111s (14.111s including waiting). Image size: 341609952 bytes. 78m Normal InstallSucceeded clusterserviceversion/cluster-logging.v6.2.6 install strategy completed with no errors 78m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-compactor-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 78m Normal Provisioning persistentvolumeclaim/wal-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/wal-logging-loki-ingester-0" 78m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway successful 78m Normal SuccessfulCreate statefulset/logging-loki-index-gateway create Claim storage-logging-loki-index-gateway-0 Pod logging-loki-index-gateway-0 in StatefulSet logging-loki-index-gateway success 78m Normal Provisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-index-gateway-0" 78m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-index-gateway-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 78m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-index-gateway-0 waiting for first consumer to be created before binding 78m Normal SuccessfulCreate statefulset/logging-loki-compactor create Claim storage-logging-loki-compactor-0 Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor success 78m Normal SuccessfulCreate statefulset/logging-loki-compactor create Pod logging-loki-compactor-0 in StatefulSet logging-loki-compactor successful 78m Normal WaitForFirstConsumer persistentvolumeclaim/storage-logging-loki-ingester-0 waiting for first consumer to be created before binding 78m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim storage-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 78m Normal ProvisioningSucceeded persistentvolumeclaim/wal-logging-loki-ingester-0 Successfully provisioned volume pvc-34d6b7dc-1757-4e9c-8ca1-365a0e5f3719 78m Normal ScalingReplicaSet deployment/logging-loki-gateway Scaled up replica set logging-loki-gateway-7c9c75f6cc to 2 78m Normal SuccessfulCreate replicaset/logging-loki-gateway-7c9c75f6cc Created pod: logging-loki-gateway-7c9c75f6cc-rxvv4 78m Normal SuccessfulCreate replicaset/logging-loki-gateway-7c9c75f6cc Created pod: logging-loki-gateway-7c9c75f6cc-v4gvv 78m Normal NoPods poddisruptionbudget/logging-loki-ingester No matching pods found 78m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-compactor-0 Successfully provisioned volume pvc-6d868cee-7190-4ddd-8be2-c5615ee47f2d 78m Normal Provisioning persistentvolumeclaim/storage-logging-loki-ingester-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-ingester-0" 78m Normal Provisioning persistentvolumeclaim/storage-logging-loki-compactor-0 External provisioner is provisioning volume for claim "openshift-logging/storage-logging-loki-compactor-0" 78m Normal SuccessfulCreate replicaset/logging-loki-distributor-76cc67bf56 Created pod: logging-loki-distributor-76cc67bf56-kh68l 78m Normal ScalingReplicaSet deployment/logging-loki-distributor Scaled up replica set logging-loki-distributor-76cc67bf56 to 1 78m Normal ExternalProvisioning persistentvolumeclaim/storage-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 78m Normal SuccessfulCreate statefulset/logging-loki-ingester create Claim wal-logging-loki-ingester-0 Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester success 78m Normal SuccessfulCreate statefulset/logging-loki-ingester create Pod logging-loki-ingester-0 in StatefulSet logging-loki-ingester successful 78m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-index-gateway-0 Successfully provisioned volume pvc-eb682481-aadb-408a-b2e0-691d36d7d4fb 78m Normal ExternalProvisioning persistentvolumeclaim/wal-logging-loki-ingester-0 Waiting for a volume to be created either by the external provisioner 'kubevirt.io.hostpath-provisioner' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 78m Normal ScalingReplicaSet deployment/logging-loki-query-frontend Scaled up replica set logging-loki-query-frontend-84558f7c9f to 1 78m Normal SuccessfulCreate replicaset/logging-loki-query-frontend-84558f7c9f Created pod: logging-loki-query-frontend-84558f7c9f-zmggt 78m Normal WaitForFirstConsumer persistentvolumeclaim/wal-logging-loki-ingester-0 waiting for first consumer to be created before binding 78m Normal SuccessfulCreate replicaset/logging-loki-querier-5895d59bb8 Created pod: logging-loki-querier-5895d59bb8-pj2ck 78m Normal ProvisioningSucceeded persistentvolumeclaim/storage-logging-loki-ingester-0 Successfully provisioned volume pvc-6423dc60-e3c7-4d59-af5e-5bff824b0511 78m Normal ScalingReplicaSet deployment/logging-loki-querier Scaled up replica set logging-loki-querier-5895d59bb8 to 1 78m Warning FailedMount pod/logging-loki-gateway-7c9c75f6cc-rxvv4 MountVolume.SetUp failed for volume "logging-loki-gateway-ca-bundle" : configmap "logging-loki-gateway-ca-bundle" not found 78m Normal Pulling pod/logging-loki-query-frontend-84558f7c9f-zmggt Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 78m Warning FailedMount pod/logging-loki-gateway-7c9c75f6cc-v4gvv MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 78m Warning FailedMount pod/logging-loki-gateway-7c9c75f6cc-v4gvv MountVolume.SetUp failed for volume "logging-loki-gateway-ca-bundle" : configmap "logging-loki-gateway-ca-bundle" not found 78m Normal AddedInterface pod/logging-loki-gateway-7c9c75f6cc-v4gvv Add eth0 [10.217.0.53/23] from ovn-kubernetes 78m Normal AddedInterface pod/logging-loki-distributor-76cc67bf56-kh68l Add eth0 [10.217.0.50/23] from ovn-kubernetes 78m Normal Pulling pod/logging-loki-querier-5895d59bb8-pj2ck Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 78m Normal AddedInterface pod/logging-loki-querier-5895d59bb8-pj2ck Add eth0 [10.217.0.51/23] from ovn-kubernetes 78m Normal AddedInterface pod/logging-loki-query-frontend-84558f7c9f-zmggt Add eth0 [10.217.0.52/23] from ovn-kubernetes 78m Normal Pulling pod/logging-loki-distributor-76cc67bf56-kh68l Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 78m Warning FailedMount pod/logging-loki-gateway-7c9c75f6cc-rxvv4 MountVolume.SetUp failed for volume "tls-secret" : secret "logging-loki-gateway-http" not found 78m Normal Pulling pod/logging-loki-index-gateway-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 78m Normal AddedInterface pod/logging-loki-gateway-7c9c75f6cc-rxvv4 Add eth0 [10.217.0.54/23] from ovn-kubernetes 78m Normal AddedInterface pod/logging-loki-index-gateway-0 Add eth0 [10.217.0.68/23] from ovn-kubernetes 78m Normal Pulling pod/logging-loki-gateway-7c9c75f6cc-rxvv4 Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" 78m Normal Pulling pod/logging-loki-gateway-7c9c75f6cc-v4gvv Pulling image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" 78m Normal Pulling pod/logging-loki-ingester-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 78m Normal AddedInterface pod/logging-loki-ingester-0 Add eth0 [10.217.0.55/23] from ovn-kubernetes 78m Normal Pulling pod/logging-loki-compactor-0 Pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 78m Normal AddedInterface pod/logging-loki-compactor-0 Add eth0 [10.217.0.61/23] from ovn-kubernetes 78m Warning Failed pod/logging-loki-distributor-76cc67bf56-kh68l Error: ImagePullBackOff 78m Normal BackOff pod/logging-loki-distributor-76cc67bf56-kh68l Back-off pulling image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" 78m Warning Failed pod/logging-loki-distributor-76cc67bf56-kh68l Error: ErrImagePull 78m Warning Failed pod/logging-loki-distributor-76cc67bf56-kh68l Failed to pull image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919": rpc error: code = Canceled desc = copying system image from manifest list: writing blob: storing blob to file "/var/tmp/container_images_storage846010270/1": happened during read: context canceled 78m Normal Started pod/logging-loki-gateway-7c9c75f6cc-v4gvv Started container gateway 78m Normal Created pod/logging-loki-query-frontend-84558f7c9f-zmggt Created container loki-query-frontend 78m Normal Created pod/logging-loki-index-gateway-0 Created container loki-index-gateway 78m Normal Pulled pod/logging-loki-ingester-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 16.853s (16.853s including waiting). Image size: 216113723 bytes. 78m Normal Created pod/logging-loki-ingester-0 Created container loki-ingester 78m Normal Started pod/logging-loki-ingester-0 Started container loki-ingester 78m Normal Pulled pod/logging-loki-compactor-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 16.585s (16.585s including waiting). Image size: 216113723 bytes. 78m Normal Created pod/logging-loki-compactor-0 Created container loki-compactor 78m Normal Started pod/logging-loki-compactor-0 Started container loki-compactor 78m Normal Pulled pod/logging-loki-index-gateway-0 Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 16.751s (16.751s including waiting). Image size: 216113723 bytes. 78m Normal Pulled pod/logging-loki-gateway-7c9c75f6cc-rxvv4 Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" in 16.894s (16.894s including waiting). Image size: 179177912 bytes. 78m Normal Created pod/logging-loki-gateway-7c9c75f6cc-rxvv4 Created container gateway 78m Normal Started pod/logging-loki-query-frontend-84558f7c9f-zmggt Started container loki-query-frontend 78m Normal Pulling pod/logging-loki-gateway-7c9c75f6cc-v4gvv Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" 78m Normal Created pod/logging-loki-gateway-7c9c75f6cc-v4gvv Created container gateway 78m Normal Pulled pod/logging-loki-gateway-7c9c75f6cc-v4gvv Successfully pulled image "registry.redhat.io/openshift-logging/lokistack-gateway-rhel9@sha256:ad8b5cee31875481991739c882fd765f01d0391184de7e2e19e8394efda5a4d6" in 17.063s (17.063s including waiting). Image size: 179177912 bytes. 78m Normal Pulled pod/logging-loki-querier-5895d59bb8-pj2ck Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 17.688s (17.688s including waiting). Image size: 216113723 bytes. 78m Normal Created pod/logging-loki-querier-5895d59bb8-pj2ck Created container loki-querier 78m Normal Started pod/logging-loki-querier-5895d59bb8-pj2ck Started container loki-querier 78m Normal Started pod/logging-loki-index-gateway-0 Started container loki-index-gateway 78m Normal Pulled pod/logging-loki-query-frontend-84558f7c9f-zmggt Successfully pulled image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" in 17.638s (17.638s including waiting). Image size: 216113723 bytes. 78m Normal Started pod/logging-loki-gateway-7c9c75f6cc-rxvv4 Started container gateway 78m Normal Pulling pod/logging-loki-gateway-7c9c75f6cc-rxvv4 Pulling image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" 77m Normal Pulled pod/logging-loki-gateway-7c9c75f6cc-v4gvv Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" in 1.474s (1.474s including waiting). Image size: 159515440 bytes. 77m Normal Pulled pod/logging-loki-gateway-7c9c75f6cc-rxvv4 Successfully pulled image "registry.redhat.io/openshift-logging/opa-openshift-rhel9@sha256:62c2e9714d7de73861ca4a607a9509ddc9771399569015a5ad8f8b42639ebaae" in 1.35s (1.35s including waiting). Image size: 159515440 bytes. 77m Normal Created pod/logging-loki-gateway-7c9c75f6cc-rxvv4 Created container opa 77m Normal Started pod/logging-loki-gateway-7c9c75f6cc-rxvv4 Started container opa 77m Normal Created pod/logging-loki-gateway-7c9c75f6cc-v4gvv Created container opa 77m Normal Started pod/logging-loki-gateway-7c9c75f6cc-v4gvv Started container opa 77m Normal Pulled pod/logging-loki-distributor-76cc67bf56-kh68l Container image "registry.redhat.io/openshift-logging/logging-loki-rhel9@sha256:1bd60df77d8be8eae3551f68a3a55a464610be839b0c0556600c7f1a36887919" already present on machine 77m Normal Created pod/logging-loki-distributor-76cc67bf56-kh68l Created container loki-distributor 77m Normal Started pod/logging-loki-distributor-76cc67bf56-kh68l Started container loki-distributor 77m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 77m Warning Unhealthy pod/logging-loki-ingester-0 Readiness probe failed: HTTP probe failed with statuscode: 503 77m Warning ProbeError pod/logging-loki-ingester-0 Readiness probe error: HTTP probe failed with statuscode: 503... 76m Normal SuccessfulDelete daemonset/collector Deleted pod: collector-mqjqf 76m Normal SuccessfulCreate daemonset/collector Created pod: collector-mqjqf 76m Warning FailedMount pod/collector-mqjqf MountVolume.SetUp failed for volume "metrics" : secret "collector-metrics" not found 76m Normal SuccessfulCreate daemonset/collector Created pod: collector-42tlr 76m Normal AddedInterface pod/collector-42tlr Add eth0 [10.217.0.81/23] from ovn-kubernetes 76m Normal Pulling pod/collector-42tlr Pulling image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:438aa27c0408214bc64d01b20f233d698fa48344aa2dd878bc090232f227c17c" 76m Normal Created pod/collector-42tlr Created container collector 76m Normal Pulled pod/collector-42tlr Successfully pulled image "registry.redhat.io/openshift-logging/vector-rhel9@sha256:438aa27c0408214bc64d01b20f233d698fa48344aa2dd878bc090232f227c17c" in 8.522s (8.522s including waiting). Image size: 344503702 bytes. 76m Normal Started pod/collector-42tlr Started container collector 71m Normal IPAllocated service/openstack-logging Assigned IP ["172.17.0.80"] 71m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/address-pool 71m Normal nodeAssigned service/openstack-logging announcing from node "crc" with protocol "layer2" 71m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/allow-shared-ip 71m Warning deprecatedAnnotation service/openstack-logging Service uses deprecated annotation metallb.universe.tf/loadBalancerIPs