Hacker News · AI·· 1 h agoAI score22
NIL-3B Open Source Sovereign AI Releases GGUF Weights for Local Inference
Nil-3B Open Source Sovereign AI
AI summary
The NIL-3B project has published a GGUF build, nil-3b-q4_k_m.gguf, for running the model locally with a GGUF-compatible inference runtime. Users install dependencies and run `python -m src.chat`, which expects the GGUF file in the project root. The repo notes its LICENSE covers source code only and does not confirm license or redistribution rights for model weights or training data.
Source:Hacker News · AI · huggingface.co