Section
2 pages
Quantisation
My Journey into Local LLMs
Picking a Local Model: Quant, VRAM and the 8B Sweet Spot