Blog
Written versions of our YouTube videos, so you can check the numbers and tables at your own pace.
-
Will It Run on My PC? Quantized Files 5 to 94GB: RAM, VRAM and Mac Fit (youtube.com)
Lower quantization shrinks Qwen 27B from 17.56 to 10.52GB on a 32GB Mac mini and speeds Korean from 8.2 to 13.0 tok/s. When a file exceeds RAM, speed collapses. 3090, 5090 and Mac fit, with October 15 prices.