From bc9c3c163917e8e35960007d7f219edc10f1a56c Mon Sep 17 00:00:00 2001 From: Codeman maintainer Date: Sun, 8 Nov 2026 09:39:48 +0100 Subject: [PATCH] docs(local-model): two catalogue header claims made exact The Q8 27B row counts a prediction layer its GGUF may or may not carry (not checked, careful side), and the macOS notice on the runtime's page is about Laguna XS 2.1; Laguna S 2.1 is set aside for its open runtime issues. Co-Authored-By: Claude Opus 5.5 --- src/config/local-model-catalog.ts | 10 ++++++---- 1 file changed, 6 insertions(+), 4 deletions(-) diff --git a/src/config/local-model-catalog.ts b/src/config/local-model-catalog.ts index 9bbf2544..3821534f 100644 --- a/src/config/local-model-catalog.ts +++ b/src/config/local-model-catalog.ts @@ -73,9 +73,10 @@ * runtime sets (`RUNTIME_KV_CACHE_TYPE` in src/local-model/runtime.ts, q8_0: 34 bytes per * 32 values), and does not grow after that. * - held = attention layers x K/V heads x head dim x 2 (K and V) x 34/32. The one - * multi-token-prediction layer of a Qwen3.5-family GGUF that carries it (the `-mtp` - * tags, and `qwen3.8:27b-q8_0`) is counted as one more attention layer: whether - * llama.cpp gives it a cache was not checked, so this errs on the careful side. + * multi-token-prediction layer of the `-mtp` tags is counted as one more attention + * layer, and so it is for `qwen3.8:27b-q8_0`, whose GGUF may carry it too: neither + * whether that GGUF has it nor whether llama.cpp gives it a cache was checked, so this + * errs on the careful side. * - overhead = the fixed caches (the f32 recurrent state of the linear-attention layers, * or the sliding-window cache of `n_swa + 512` cells), + 1.0 GB for the runner's own * buffers (calibrated on a third-party table of a 27B model on llama.cpp: 8.4 GB at @@ -120,7 +121,8 @@ * in NVIDIA's table). * - `flint:40b`: runtime issue 19191 breaks integer tool arguments after the first call. * - `lfm2.5:24b-a2b`: its licence allows commercial use only below USD 10M of revenue. - * - `laguna-xs-2.1`, `laguna-s-2.1`: the runtime's own page names an open problem on macOS. + * - `laguna-xs-2.1`: the runtime's own page names an open problem with it on macOS. + * `laguna-s-2.1`: open runtime issues 17602 and 17632. * - `qwen3.8-flash-next:125b`: the Qwen Community License, not an open licence. * - The plain tags `qwen3.5:9b`, `mimo-v2.6:9b` and `qwen3.8:27b`: a Mac pulls their MLX * builds, whose 8 GiB of prefix snapshots do not fit the Macs a 9B or a 27B is for. Their