DwarfStar is a narrow, model-specific platform for running local inference. I
wrote about it a few months ago.
It was originally targeting Mac, but has branched out to target Strix Halo via ROCm. Going to try agent directly, and then wire it up to omp.sh via server. Will report back with results. DSV4 Flash 0731 and Vision are both interesting, as is Qwen 3.8 Flash Next.
https://github.com/antirez/ds4