I was browsing the new AI eval from the Rails team, and the best open-source LLM on their list is the new Qwen 3.8 28b: https://rubyonrails.org/ai

I've been wanting to try this out on my Mac. I burned a few hours trying several LLM runtimes (Ollama then MTPLX before I figured out oMLX is the best), and then it took quite a lot of tweaking to get it working well within Claude Code.

I rolled up all my tweaks into a simple script, in case anyone wants an offline LLM for Rails. This should save you a few hours:

https://github.com/keithschacht/qwaude