Right-sizes LLM models to your system's RAM, CPU, and GPU

news.ycombinator.com

saved by: 0 people
related read on: AlexsJones/llmfit: Hundreds of models & providers. One co... discussion