maas-deploy-ROSA.md

Msg @clusterbot in Slack run:
rosa create 4.20.6

models-as-a-service$ ./scripts/deploy.sh --operator-type odh
[INFO] ===================================================
[INFO]   Models-as-a-Service Deployment
[INFO] ===================================================
[INFO] Validating configuration...
[INFO] Configuration validated successfully
[INFO] Deployment configuration:
[INFO]   Mode: operator
[INFO]   Operator: odh
[INFO]   Policy Engine: kuadrant
[INFO]   Namespace: opendatahub
[INFO]   TLS Backend: true
[INFO] Starting operator-based deployment...
[INFO] Installing optional operators in parallel...
[INFO] Applying cert-manager and LeaderWorkerSet subscriptions...
namespace/cert-manager-operator created
namespace/openshift-lws-operator created
operatorgroup.operators.coreos.com/leader-worker-set created
operatorgroup.operators.coreos.com/cert-manager-operator created
subscription.operators.coreos.com/leader-worker-set created
subscription.operators.coreos.com/openshift-cert-manager-operator created
[INFO] Waiting for operators to be installed...
  * Waiting for Subscription cert-manager-operator/openshift-cert-manager-operator to start setup...
  * Waiting for Subscription openshift-lws-operator/leader-worker-set to start setup...
subscription.operators.coreos.com/leader-worker-set condition met
  * Waiting for Subscription setup to finish setup. CSV = leader-worker-set.v1.0.0 ...
clusterserviceversion.operators.coreos.com/leader-worker-set.v1.0.0 condition met
subscription.operators.coreos.com/openshift-cert-manager-operator condition met
  * Waiting for Subscription setup to finish setup. CSV = cert-manager-operator.v1.18.1 ...
clusterserviceversion.operators.coreos.com/cert-manager-operator.v1.18.1 condition met
[INFO] Activating LeaderWorkerSet API...
leaderworkersetoperator.operator.openshift.io/cluster created
[INFO] Optional operators installed
[INFO] Installing policy engine: kuadrant
[INFO] Installing Kuadrant v1.3.1 (upstream community)
[INFO] Creating Kuadrant v1.3.1 catalog source...
namespace/kuadrant-system created
catalogsource.operators.coreos.com/kuadrant-operator-catalog created
[INFO] Waiting for Kuadrant catalog to be ready...
operatorgroup.operators.coreos.com/kuadrant-operator-group created
[INFO] Installing operator: kuadrant-operator in namespace: kuadrant-system
namespace/kuadrant-system condition met
[INFO] Creating Subscription for kuadrant-operator from kuadrant-operator-catalog (channel: stable)
subscription.operators.coreos.com/kuadrant-operator created
[INFO] Waiting for subscription to install...
  * Waiting for Subscription kuadrant-system/kuadrant-operator to start setup...
subscription.operators.coreos.com/kuadrant-operator condition met
  * Waiting for Subscription setup to finish setup. CSV = kuadrant-operator.v1.3.1 ...
clusterserviceversion.operators.coreos.com/kuadrant-operator.v1.3.1 condition met
[INFO] Operator kuadrant-operator installed successfully
[INFO] Patching kuadrant-operator CSV for OpenShift Gateway controller...
clusterserviceversion.operators.coreos.com/kuadrant-operator.v1.3.1 patched
[INFO] CSV patched for OpenShift Gateway controller
[INFO] Forcing operator restart to apply new Gateway controller configuration...
pod "kuadrant-operator-controller-manager-54b54c8744-m7pds" force deleted from kuadrant-system namespace
pod "limitador-operator-controller-manager-84d8fbb794-xfx99" force deleted from kuadrant-system namespace
[INFO] Waiting for operator pod to restart...
Waiting for deployment "kuadrant-operator-controller-manager" rollout to finish: 1 old replicas are pending termination...
Waiting for deployment "kuadrant-operator-controller-manager" rollout to finish: 1 old replicas are pending termination...
Waiting for deployment "kuadrant-operator-controller-manager" rollout to finish: 1 old replicas are pending termination...
deployment "kuadrant-operator-controller-manager" successfully rolled out
[WARN] Operator pod may not have correct env yet:
[INFO] Waiting 15s for operator to fully initialize with Gateway controller configuration...
[INFO] Initializing Gateway API and ModelsAsService gateway...
[INFO] Setting up Gateway API infrastructure...
gatewayclass.gateway.networking.k8s.io/openshift-default created
[INFO] Setting up ModelsAsService gateway...
[INFO]   Cluster domain: apps.rosa.awygc-36mwp-3o7.a09d.p3.openshiftapps.com
[INFO]   Detecting TLS certificate secret...
[INFO]   * Found certificate from IngressController: 2ohoup0d92lihsmcvom0a2k0uktdak7m-primary-cert-bundle-secret
[INFO]   TLS certificate secret: 2ohoup0d92lihsmcvom0a2k0uktdak7m-primary-cert-bundle-secret
[INFO] Creating maas-default-gateway resource (allowing routes from all namespaces)...
gateway.gateway.networking.k8s.io/maas-default-gateway serverside-applied
[INFO] Waiting for Gateway to be Programmed (Service Mesh initialization)...
gateway.gateway.networking.k8s.io/maas-default-gateway condition met
[INFO] Applying Kuadrant custom resource in kuadrant-system...
kuadrant.kuadrant.io/kuadrant created
[INFO] Waiting for Kuadrant to become ready (initial check)...
[INFO] Waiting for: Kuadrant ready in kuadrant-system (timeout: 60s)
[WARN] Kuadrant ready in kuadrant-system - Timeout after 60s
[INFO] Kuadrant shows MissingDependency - restarting operator to re-register Gateway controller...
pod "authorino-76d7b84c9-hgl5q" force deleted from kuadrant-system namespace
pod "kuadrant-operator-controller-manager-68d7ff44d6-thfrx" force deleted from kuadrant-system namespace
pod "limitador-operator-controller-manager-84d8fbb794-cwxz6" force deleted from kuadrant-system namespace
[INFO] Retrying Kuadrant readiness check after operator restart...
[INFO] Waiting for: Kuadrant ready in kuadrant-system (timeout: 120s)
[INFO] Kuadrant ready in kuadrant-system - Ready
[INFO] Kuadrant setup complete
[INFO] Deploying usage policies (TokenRateLimitPolicy)...
[INFO] Usage policies deployed successfully
[INFO] Installing primary operator: odh
[INFO] Installing ODH operator...
[INFO] Installing operator: opendatahub-operator in namespace: opendatahub
[INFO] Creating namespace: opendatahub
namespace/opendatahub created
namespace/opendatahub condition met
[INFO] Creating OperatorGroup in opendatahub for AllNamespaces mode
operatorgroup.operators.coreos.com/opendatahub-operatorgroup created
[INFO] Creating Subscription for opendatahub-operator from community-operators (channel: fast-3)
subscription.operators.coreos.com/opendatahub-operator created
[INFO] Waiting for subscription to install...
  * Waiting for Subscription opendatahub/opendatahub-operator to start setup...
subscription.operators.coreos.com/opendatahub-operator condition met
  * Waiting for Subscription setup to finish setup. CSV = opendatahub-operator.v3.4.0-ea.1 ...
clusterserviceversion.operators.coreos.com/opendatahub-operator.v3.4.0-ea.1 condition met
[INFO] Operator opendatahub-operator installed successfully
[INFO] Applying custom resources...
[INFO] Waiting for operator CRDs to be established...
⏳ Waiting for CRD datascienceclusters.datasciencecluster.opendatahub.io to appear (timeout: 180s)…
✅ CRD datascienceclusters.datasciencecluster.opendatahub.io detected, waiting for it to become Established...
customresourcedefinition.apiextensions.k8s.io/datascienceclusters.datasciencecluster.opendatahub.io condition met
[INFO] Waiting for operator webhook to be ready...
* Waiting for deployment/opendatahub-operator-controller-manager in opendatahub-operator-system...
  WARNING: deployment/opendatahub-operator-controller-manager was not found within timeout.
[WARN] Webhook deployment not found after 120s, proceeding anyway...
[INFO] Applying DSCInitialization...
dscinitialization.dscinitialization.opendatahub.io/default-dsci created
[INFO] Applying DataScienceCluster with ModelsAsService...
datasciencecluster.datasciencecluster.opendatahub.io/default-dsc serverside-applied
[INFO] Waiting for DataScienceCluster to be ready...
* Waiting for DataScienceCluster 'default-dsc' KServe and ModelsAsService components to be ready...
  - KServe state: , KserveReady: , ModelsAsServiceReady: , ModelControllerReady:
  - KServe state: Managed, KserveReady: False, ModelsAsServiceReady: True, ModelControllerReady: False
  - KServe state: Managed, KserveReady: False, ModelsAsServiceReady: True, ModelControllerReady: False
  * KServe and ModelsAsService are ready in DataScienceCluster 'default-dsc'
  * MAAS_API_IMAGE not set, using operator default
[INFO] Configuring TLS backend for Authorino and MaaS API...
* Waiting for deployment/authorino in kuadrant-system...
  * Found deployment/authorino
[INFO] Running TLS configuration script...
[INFO] TLS configuration script completed successfully
[INFO] Restarting deployments to pick up TLS configuration...
deployment.apps/maas-api restarted
deployment.apps/authorino restarted
[INFO] Waiting for Authorino deployment to be ready...
Waiting for deployment "authorino" rollout to finish: 1 old replicas are pending termination...
Waiting for deployment spec update to be observed...
Waiting for deployment spec update to be observed...
Waiting for deployment "authorino" rollout to finish: 0 out of 1 new replicas have been updated...
Waiting for deployment "authorino" rollout to finish: 0 out of 1 new replicas have been updated...
Waiting for deployment "authorino" rollout to finish: 1 old replicas are pending termination...
Waiting for deployment "authorino" rollout to finish: 1 old replicas are pending termination...
deployment "authorino" successfully rolled out
[INFO] TLS backend configuration complete
[INFO] Tier lookup URL: https://maas-api.opendatahub.svc.cluster.local:8443/v1/tiers/lookup
[INFO] Checking cluster OIDC audience...
[INFO] Configuring AuthPolicy for non-standard cluster audience...
[INFO]   Detected audience: https://rh-oidc.s3.us-east-1.amazonaws.com/27bd6cg0vs7nn08mue83fbof94dj4m9a
[INFO]   Waiting for AuthPolicy 'maas-api-auth-policy' to be created (timeout: 120s)...
[INFO]   Found AuthPolicy 'maas-api-auth-policy'
[INFO]   Annotating AuthPolicy to prevent operator reconciliation...
authpolicy.kuadrant.io/maas-api-auth-policy annotated
[INFO]   Patching AuthPolicy with cluster audience...
authpolicy.kuadrant.io/maas-api-auth-policy patched
[INFO]   AuthPolicy 'maas-api-auth-policy' patched with custom audience
[INFO]   Verified: Custom audience configuration persisted
[INFO] Operator deployment completed
[INFO] ===================================================
[INFO]   Deployment completed successfully!
[INFO] ===================================================