Skip to content

Instantly share code, notes, and snippets.

View nerdalert's full-sized avatar
🐈
🦀 🐿

Brent Salisbury nerdalert

🐈
🦀 🐿
View GitHub Profile

stdout testing for opendatahub-io/models-as-a-service#227

brent@ip-172-31-33-128:~/tls/opendatahub-operator$ make install deploy -e VERSION=tls -e IMG='quay.io/bmajsak/opendatahub-operator:tls'
go: downloading go1.25.0 (linux/amd64)
mkdir -p /home/brent/tls/opendatahub-operator/bin
Downloading sigs.k8s.io/kustomize/kustomize/v5@v5.7.0
Downloading sigs.k8s.io/controller-tools/cmd/controller-gen@v0.17.3
/home/brent/tls/opendatahub-operator/bin/controller-gen --load-build-tags=odh rbac:roleName=controller-manager-role crd:ignoreUnexportedFields=true webhook paths="./..." output:crd:artifacts:config=config/crd/bases output:rbac:artifacts:config=config/rbac output:webhook:artifacts:config=config/webhook
/home/brent/tls/opendatahub-operator

Deploy

  • Had to run the script twice to chmod a new install script breaking out the IDP install. No changes to logic, just calling a different backend script.
$ export ENABLE_KEYCLOAK_IDP=true
  ./scripts/deploy-rhoai-stable.sh
## Installing prerequisites
$ ./deploy/openshift/deploy-to-openshift.sh
[SUCCESS] Logged in as kube:admin
[INFO] Creating namespace: vllm-semantic-router-system
namespace/vllm-semantic-router-system configured
[SUCCESS] Namespace ready
[INFO] Checking for llm-katan image...
[INFO] Building llm-katan image...
--> Found container image ce19342 (6 days old) from Docker Hub for "python:3.10-slim"

Deployment of opendatahub-io/models-as-a-service#333 tested on ROSA, requires this PR as well for a simple wait for the ODH namespace readyness: opendatahub-io/models-as-a-service#329

$ ./scripts/deploy-rhoai-stable.sh
## Installing prerequisites

* Installing cert-manager operator...
namespace/cert-manager-operator created
operatorgroup.operators.coreos.com/cert-manager-operator created
$ ./deployment/scripts/deploy-openshift.sh
=========================================
🚀 MaaS Platform OpenShift Deployment
=========================================

📋 Checking prerequisites...

Required tools:
  • Logs from 1 inference call
{"level":"info","ts":"2025-12-02T20:04:29Z","logger":"authorino.service.auth","msg":"incoming authorization request","request id":"59eafa3d-4e19-4042-877c-4e0737371b4c","object":{"source":{"address":{"Address":{"SocketAddress":{"address":"100.64.0.2:16358","PortSpecifier":{"PortValue":16358}}}}},"destination":{"address":{"Address":{"SocketAddress":{"address":"10.128.0.55:80","PortSpecifier":{"PortValue":80}}}}},"request":{"http":{"id":"59eafa3d-4e19-4042-877c-4e0737371b4c","method":"POST","path":"/llm/facebook-opt-125m-simulated/v1/chat/completions","host":"maas.apps.rosa.fttjk-2ixbb-srb.qeye.p3.openshiftapps.com","scheme":"http"}}}}
{"level":"error","ts":"2025-12-02T20:04:29Z","logger":"authorino.service.auth.authpipeline","msg":"failed to parse CEL expression","request id":"59eafa3d-4e19-4042-877c-4e0737371b4c","expression":"responseBodyJSON(\"/model\")","error":"ERROR: <input>:1:17: undeclared reference to 'responseBodyJSON' (in container '')\n | responseBodyJSON(\"/model\
#!/bin/bash
set -euo pipefail
# Colors for output
RED='\033[0;31m'
GREEN='\033[0;32m'
YELLOW='\033[1;33m'
NC='\033[0m'
log_info() { echo -e "${GREEN}[INFO]${NC} $1"; }
#!/usr/bin/env bash
set -euo pipefail
TAIL_LINES="${TAIL_LINES:-200}"
OUT_FILE="${OUT_FILE:-./maas-debug-$(date +%Y%m%d%H%M%S).txt}"
require_cmd() {
if ! command -v "$1" >/dev/null 2>&1; then
echo "Missing required command: $1" >&2
$ ./deployment/scripts/deploy-openshift.sh
=========================================
🚀 MaaS Platform OpenShift Deployment
=========================================
📋 Checking prerequisites...
Required tools:
- oc: Client Version: 4.8.11
- jq: jq-1.7

Telemetry logging errors in Authorino logs

You can see both metric labels spamming in the kuadrant logs example:

{"level":"error","ts":"2025-11-12T04:08:54Z","logger":"authorino.service.auth.authpipeline","msg":"failed to evaluate CEL expression","request id":"d2beaf26-c088-49c4-82e8-677e594df4eb","expression":"auth.identity.tier","error":"no such key: identity","stacktrace":"github.com/kuadrant/authorino/pkg/service.(*AuthPipeline).metricLabels\n\t/usr/src/authorino/pkg/service/auth_pipeline.go:546\ngithub.com/kuadrant/authorino/pkg/service.(*AuthPipeline).evaluateAuthConfig\n\t/usr/src/authorino/pkg/service/auth_pipeline.go:115\ngithub.com/kuadrant/authorino/pkg/service.(*AuthPipeline).evaluateIdentityConfigs.func1.(*AuthPipeline).evaluateOneAuthConfig.1\n\t/usr/src/authorino/pkg/service/auth_pipeline.go:171\ngithub.com/kuadrant/authorino/pkg/service.(*AuthPipeline).evaluateAuthConfigs.func1\n\t/usr/src/authorino/pkg/service/auth_pipeline.go:162"}
{"level":"error","ts":"2025-11-12T04:08:54Z","logge