mirror of
https://github.com/Ark0N/Codeman.git
synced 2026-11-16 11:19:33 +01:00
feat(local-model): Ornith 1.0 9B, the first model a 16 GB Mac can hold
A 16 GB Mac got no model: the two 9B builds of the catalogue need 10.2 GB at 65,536 tokens, 0.987 of the estimated budget, just past the 0.98 a tight fit may reach. New row `ornith:9b-q4_k_m` (Ornith 1.0 9B, MIT), a fine-tune of Qwen3.5-9B for coding agents whose GGUF build has no vision projector: 5.63 GB against 6.55 GB, so 9.3 GB at 65,536 tokens, 0.898 of that budget. SWE-bench Verified 69.4, SWE-bench Pro 42.9, Terminal-Bench 2.1 43.1 on Ornith's card. Its config.json and its GGUF header are those of Qwen3.5-9B (no prediction layer), so it shares the figures of the two other 9B rows. Never run on a Mac: `estimated`. - What changes for a Mac: 16 GB goes from no model to `limited` with this row, tight. That is the only pick that changes: the row is ranked under MiMo V2.6 9B, so every Mac that could already run a 9B keeps its pick and gains an alternative. With the budget a 16 GB Mac mini measured (10.7 GB) the pick is MiMo as before. - Why under MiMo although its own card's numbers are higher: the two vendors' tables put their common base 7 points apart, and runtime issue 16992 (open) was filed on the 35B sibling, which has the same renderer and parser. The 35B stays set aside. - The 16 GB rule itself is untouched: same budget estimate, same 0.98, same eight context checkpoints. - Ranks renumbered 1 to 10; the pins of test/local-model-recommend.test.ts and the table of docs/local-models.md follow. Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
This commit is contained in:
1 parent
9608a17d99
commit
d25cc08606
5 files changed
+151
-69
No files matched your search
@@ -112,7 +112,7 @@ export const LIMITED_BELOW_PARAMS_B = 12;
|
||||
export const DISK_HEADROOM_BYTES = 10 * GIB;
|
||||
/**
|
||||
* How many other models are listed under the pick, at most. Above what the stock catalogue
|
||||
* holds (9 models: 8 beside the pick), so a Mac is shown every model that fits it and the
|
||||
* holds (10 models: 9 beside the pick), so a Mac is shown every model that fits it and the
|
||||
* install accepts every one of them. Still a bound: test/local-model-catalog.test.ts fails for
|
||||
* a catalogue that outgrows it, so nothing drops out of the list unseen.
|
||||
*/
|
||||
|
||||
Reference in new issue
Block a user