Local (open-webui & ollama) LLM setup

README.md

Installed programs:

sudo pacman -S ollama
# AUR
yay -S open-webui
# > provides system service to start on Port 8080

Installed models:

• ollama run hf.co/unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF:Q4_K_XL
• ollama run qwen3:8b

Create script:

• start open-webui
• start ollama
• open open-webui

webui.sh e.g. in HOME directory (~/webui.sh)

Create .desktop file:

webui.desktop e.g. in user directory (.local/share/applications/webui.desktop)

webui.desktop

[Desktop Entry]
Name=Open WebUI
Comment=Start Open WebUI service and Ollama server, open Firefox, stop on close
Exec=$HOME/webui.sh
Terminal=true
Type=Application
Categories=Network;

webui.sh

#!/bin/bash

set -x

export OLLAMA_MODELS="$HOME/.local/share/ollama/models"
echo $OLLAMA_MODELS

# Start systemd service
pkexec systemctl start open-webui.service

# Start Ollama server (replace with your actual start command)
ollama serve &
ollama list

# Get Ollama server PID
OLLAMA_PID=$!

# Wait a second to not load a non existing page
sleep 1

# Use a new temporary Firefox profile so it runs in the foreground
TMP_PROFILE=$(mktemp -d)
firefox --no-remote --profile "$TMP_PROFILE" "http://localhost:8080"

# After Firefox window closes
pkexec systemctl stop open-webui.service
kill $OLLAMA_PID

# Clean up temp profile
rm -rf "$TMP_PROFILE"