This is stuff that has worked well for me.
Tested on Arch Linux, Ryzen 7 5800X, 64GB RAM, RX 7900 GRE, ROCM 7.2
Changelog
- 2026-02-07: Switch to upstream flash-attention +
FLASH_ATTENTION_FWD_TRITON_AMD_CONFIG_JSON.
This is stuff that has worked well for me.
Tested on Arch Linux, Ryzen 7 5800X, 64GB RAM, RX 7900 GRE, ROCM 7.2
FLASH_ATTENTION_FWD_TRITON_AMD_CONFIG_JSON.