gistfile1.txt

$ mkdir -p ~/.docker/cli-plugins && docker pull docker/docker-model-cli-desktop-module:v0.1.24 && docker create --name extractor docker/docker-model-cli-desktop-module:v0.1.24 nop && docker export extractor > _extract.tmp.tar && tar -xOf _extract.tmp.tar cli-plugins/model/linux/docker-model > ~/.docker/cli-plugins/docker-model && chmod +x ~/.docker/cli-plugins/docker-model && rm _extract.tmp.tar && docker rm extractor && docker rmi docker/docker-model-cli-desktop-module:v0.1.24

$ docker model run ai/llama3.2


_MODEL_RUNNER_TREAT_DESKTOP_AS_MOBY=1

docker model run ai/llama3.2
Interactive chat mode started. Type '/bye' to exit.

Hello
Hello! It's nice to meet you. Is there something I can help you with or would you like to chat?
write a poem on docker and ai
In silicon halls of code and might,
A world of wonder, born of night,
Docker's veil, a container's guise,
A universe of worlds, in tiny sizes.

With AI's spark, the future's gleam,
A fusion born, of human dream,
The container's gate, now swings wide,
As artificial minds, do side by side.

The orchestrator, a conductor's hand,
Guides the machines, to a master plan,
Docker's bridges, connect the dots,
As AI's insights, the future plots.

The AI's eye, a lens to see,
The code's secrets, in a virtual sea,
Docker's tools, a navigator's aid,
To chart the course, through the digital trade.

The AI's brain, a cognitive core,
Analyzes data, and learns more,
Docker's layers, a puzzle to fit,
As AI's patterns, unlock the digital hit.

Note

These instructions should work for any Debian-derived distribution.

Configure the production repository:

curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg
&& curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list |
sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' |
sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
Optionally, configure the repository to use experimental packages:

sed -i -e '/experimental/ s/^#//g' /etc/apt/sources.list.d/nvidia-container-toolkit.list
Update the packages list from the repository:

sudo apt-get update
Install the NVIDIA Container Toolkit packages:

sudo apt-get install -y nvidia-container-toolkit