KubeVirt conformance sanity check

README.md

Conformance sanity check

This guide describes how to run sanity conformance test on a Kubernetes cluster. Note that it does not run networking tests and it serves only to setup an environment where we will run CNI conformance suite. The only change then would be different "conformance manifest" while setup requirements and prerequisities will remain the same.

Prerequisities

• OpenShift cluster with OpenShift Virtualization deployed on it.
• Sonobuoy executable available localy.

Executing conformance tests for a nightly release

To execute the conformance tests for a released conformance test suite, run:

export KUBECONFIG=/path/to/your/kubeconfig
sonobuoy run --skip-preflight --plugin https://gist.githubusercontent.com/phoracek/cf06d8a660733724760b52c4a9cbcb18/raw/2a503a4eb431bf9dd9e3fb2f845c2355ce0626b8/conformance.yaml

The execution can be monitored using the status command:

sonobuoy status

                 PLUGIN     STATUS   RESULT   COUNT
   kubevirt-conformance   complete   passed       1

Sonobuoy has completed. Use `sonobuoy retrieve` to get results.

Once the test run finishes, the result can be fetched:

sonobuoy retrieve

202008201609_sonobuoy_8f8d0b0e-1d37-485a-b61d-bf7185198fbf.tar.gz

And interpreted:

sonobuoy results 202008201609_sonobuoy_8f8d0b0e-1d37-485a-b61d-bf7185198fbf.tar.gz

Plugin: kubevirt-conformance
Status: passed
Total: 580
Passed: 1
Failed: 0
Skipped: 579

conformance.yaml

sonobuoy-config:
  driver: Job
  plugin-name: kubevirt-conformance
  result-format: junit
spec:
  command:
  - /usr/bin/conformance
  image: index.docker.io/kubevirt/conformance:latest
  name: plugin
  resources: {}
  volumeMounts:
  - mountPath: /tmp/results
    name: results