Skip to content

Instantly share code, notes, and snippets.

View MarioIshac's full-sized avatar

Mario Ishac MarioIshac

View GitHub Profile
@MarioIshac
MarioIshac / build-llama-cpp.sh
Created December 21, 2024 09:41 — forked from cgmb/build-llama-cpp.sh
Build llama.cpp on Ubuntu 24.04
#!/bin/sh
# Build llama.cpp on Ubuntu 24.04 with AMD GPU support
sudo apt -y install git wget hipcc libhipblas-dev librocblas-dev cmake build-essential
# ensure you have the necessary permissions by adding yourself to the video and render groups
sudo usermod -aG video,render $USER
# reboot to apply the group changes
# run rocminfo to check everything is working thus far
@cgmb
cgmb / build-llama-cpp.sh
Last active October 19, 2025 09:58
Build llama.cpp on Ubuntu 24.04
#!/bin/sh
# Build llama.cpp on Ubuntu 24.04 with AMD GPU support
sudo apt -y install git wget hipcc libhipblas-dev librocblas-dev cmake build-essential
# ensure you have the necessary permissions by adding yourself to the video and render groups
sudo usermod -aG video,render $USER
# reboot to apply the group changes
# run rocminfo to check everything is working thus far
@cgmb
cgmb / build-llama-cpp.sh
Last active December 21, 2024 09:41
How to build llama.cpp on Ubuntu Mantic
#!/bin/sh
# Build llama.cpp on Ubuntu 23.10
# Tested with `docker run -it --device=/dev/dri --device=/dev/kfd --security-opt seccomp=unconfined --volume $HOME:/mnt/home debian:sid`
apt -y update
apt -y upgrade
apt -y install git hipcc libhipblas-dev librocblas-dev cmake build-essential
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp/
git checkout b2110
@Equim-chan
Equim-chan / main.go
Last active July 8, 2021 09:25
Golang net/http X-Response-Time header middleware
package main
import (
"fmt"
"log"
"net/http"
"time"
"httptimer"
)