AI Conformance Godog Sonobuoy Plugin

README.md

AI Conformance Testing with Godog

This Gist contains the Sonobuoy plugin configuration to run AI Conformance tests using the Godog framework.

Usage

To run the tests on your Kubernetes cluster using Sonobuoy, you can directly provide the URL to the plugin YAML. This command can be copied and pasted:

sonobuoy run --plugin https://gist.githubusercontent.com/hh/194a74486b2b722389c4f95a224286f7/raw/sonobuoy-plugin.yaml --wait

After the tests complete:

1. Retrieve Results:

   outfile=$(sonobuoy retrieve)
   mkdir results && tar -xf $outfile -C results
   cat results/plugins/ai-conformance/results/global/junit.xml

Configuration

The plugin is configured to use the image ghcr.io/ii/ai-conformance:latest and enables Godog tests via the --features flag.

gist_README.md

AI Conformance Testing with Godog

This Gist contains the Sonobuoy plugin configuration to run AI Conformance tests using the Godog framework.

Usage

To run the tests on your Kubernetes cluster using Sonobuoy:

1. Download the plugin YAML: Download sonobuoy-plugin.yaml from this Gist.

2. Run Sonobuoy:

   sonobuoy run --plugin sonobuoy-plugin.yaml --wait

3. Retrieve Results:

   outfile=$(sonobuoy retrieve)
   mkdir results && tar -xf $outfile -C results
   cat results/plugins/ai-conformance/results/global/junit.xml

Configuration

The plugin is configured to use the image ghcr.io/ii/ai-conformance:latest and enables Godog tests via the --godog flag.

sonobuoy-plugin.yaml

podSpec:
  containers: []
  nodeSelector:
    kubernetes.io/os: linux
  restartPolicy: Never
  serviceAccountName: sonobuoy-serviceaccount
  tolerations:
  - effect: NoSchedule
    key: node-role.kubernetes.io/master
    operator: Exists
  - key: CriticalAddonsOnly
    operator: Exists
  - key: kubernetes.io/e2e-evict-taint-key
    operator: Exists
sonobuoy-config:
  description: Running E2E tests for AI Conformance via Sonobuoy to answer the self-certification
    questionnaire template in https://github.com/cncf/ai-conformance.
  driver: Job
  plugin-name: ai-conformance
  result-format: junit
  source-url: https://raw.githubusercontent.com/carlory/sonobuoy-plugins/master/ai-conformance/plugin.yaml
spec:
  command:
  - kubeconformance
  env:
  - name: E2E_EXTRA_ARGS
    value: --progress-report-url=http://localhost:8099/progress --progress-report-url=http://localhost:8099/progress
      --ai.operator.chart=kuberay-operator --ai.operator.repo=https://ray-project.github.io/kuberay-helm/
      --features
  - name: E2E_FOCUS
    value: \[AIConformance\]
  - name: E2E_PARALLEL
    value: "false"
  - name: E2E_SKIP
    value: \[Disruptive\]|NoExecuteTaintManager
  - name: E2E_USE_GO_RUNNER
    value: "true"
  - name: RESULTS_DIR
    value: /tmp/sonobuoy/results
  image: ghcr.io/ii/ai-conformance:latest
  name: plugin