This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/sh | |
| # Build llama.cpp on Ubuntu 24.04 with AMD GPU support | |
| sudo apt -y install git wget hipcc libhipblas-dev librocblas-dev cmake build-essential | |
| # ensure you have the necessary permissions by adding yourself to the video and render groups | |
| sudo usermod -aG video,render $USER | |
| # reboot to apply the group changes | |
| # run rocminfo to check everything is working thus far |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/sh | |
| # Build llama.cpp on Ubuntu 24.04 with AMD GPU support | |
| sudo apt -y install git wget hipcc libhipblas-dev librocblas-dev cmake build-essential | |
| # ensure you have the necessary permissions by adding yourself to the video and render groups | |
| sudo usermod -aG video,render $USER | |
| # reboot to apply the group changes | |
| # run rocminfo to check everything is working thus far |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/sh | |
| # Build llama.cpp on Ubuntu 23.10 | |
| # Tested with `docker run -it --device=/dev/dri --device=/dev/kfd --security-opt seccomp=unconfined --volume $HOME:/mnt/home debian:sid` | |
| apt -y update | |
| apt -y upgrade | |
| apt -y install git hipcc libhipblas-dev librocblas-dev cmake build-essential | |
| git clone https://github.com/ggerganov/llama.cpp.git | |
| cd llama.cpp/ | |
| git checkout b2110 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package main | |
| import ( | |
| "fmt" | |
| "log" | |
| "net/http" | |
| "time" | |
| "httptimer" | |
| ) |