You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Support Ternary Bonsai 2 27B (MLX 2-bit) with reasoning and vision #377
The model loads, but the reasoning toggle / thinking-mode parsing is not available for it in LM Studio.
Context
Bonsai 2 27B is Prism ML's ternary (2-bit) compression of Qwen3.8-27B (~1.72 bits/weight, ~98.2% of FP16 quality). The pieces seem to already be in place:
The base model qwen/qwen3.8-27b is supported, including reasoning.
What's missing for Bonsai 2 specifically:
Its chat template (Qwen3.8-based, with reasoning_effort xhigh/medium and enable_thinking) is not recognized, so no reasoning controls are exposed and thinking blocks are not parsed.
Bonsai 2 weights apply additional transforms (blockwise Hadamard rotation, sign flips, model graph changes). The MLX pack ships as plain safetensors and reportedly runs on stock mlx-lm, while the GGUF formats still require Prism ML's llama.cpp fork (upstream integration pending: https://github.com/PrismML-Eng/Bonsai-demo/blob/main/BACKEND-SUPPORT.md).
Activity
NPM8 commentedon Oct 24, 2026
Hi, is there any plan for it? From what I saw it's already supported by mlx python package so maybe there's not that much work to port it here too?