GitSeonjeap
English

Sign in

Reading needs no sign-in. Sign in to write posts or comments, or to recommend and report, in the community.

By signing in you agree to the notices below. Community rules · Privacy notice

Keep browsing without signing in

Blog

Written versions of our YouTube videos, so you can check the numbers and tables at your own pace.

Strata on Mac mini 32GB: 10.3-22.1 Tokens/s (Thinking On) vs 27B

Strata on a Mac mini M6 32GB runs Qwen3.8 Flash-Next Q2_0 (66.4GB) at 10.3-22.1 tokens/s (thinking-on format). No accuracy difference confirmed vs 27B 4-bit (150 questions, 52 coding problems).

StrataStrata enginestrata-mlxMac mini M6Mac mini 32GBQwen3.8Flash-NextQwen 27Blocal LLMKMMLUllama.cpp2-bit quantization

Qwen3.8 27B 4-bit on Mac mini M6 32GB: 49.7 Tokens/s JSON, 8.8 Korean

Qwen3.8 27B 4-bit on a Mac mini M6 32GB: the fastest combo hits 49.7 tokens/s on JSON but only 8.8 on Korean, and the fastest file loses the most quality (vs UD-Q6_K).

Mac mini M6Mac mini 32GBQwen3.8Qwen 27B4-bit quantizationspeculative decodingDFlash2MTPllama.cppMLXlocal LLMKorean tokens per second