Skip to content
Hacker News · AI·· 1 h agoAI score58

Unsloth releases Qwen3.8-27B GGUFs with Dynamic V3.1 quantization update

Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update

AI summary

Unsloth released updated Qwen3.8-27B GGUFs built with its Unsloth Dynamic V3.1 (preview) quantization algorithm, which it says improves accuracy by 5-10% at comparable sizes across most benchmarks, including Terminal Bench 2.1, DeepSWE v1.1, LiveCodeBench v6, GPQA Diamond, MMLU-Pro and AIME25. Quants from 2-bit to 6-bit were updated while 3-bit UD3 was left unchanged because it performed on par with UD3.1. The post also disputes GSQ-RCO's benchmark claims about ISTA quants, saying Unsloth ran 14 trials versus an estimated 1 and reached the opposite conclusion, and notes Qwen3.8-27B is a 27B dense model with vision, reasoning and a 256K context window that runs on 17GB RAM/VRAM setups.

Source:Hacker News · AI · unsloth.ai