Janas: Run LLMs larger than RAM by streaming experts from SSD

news.ycombinator.com

saved by: 0 people
related read on: prabanta-dev/janas: 37 tok/s from Qwen3-Next-80B (48 GB) ... discussion