Skip to content
Hacker News · AI·· 1 h agoAI score22

NIL-3B Open Source Sovereign AI Releases GGUF Weights for Local Inference

Nil-3B Open Source Sovereign AI

AI summary

The NIL-3B project has published a GGUF build, nil-3b-q4_k_m.gguf, for running the model locally with a GGUF-compatible inference runtime. Users install dependencies and run `python -m src.chat`, which expects the GGUF file in the project root. The repo notes its LICENSE covers source code only and does not confirm license or redistribution rights for model weights or training data.

Source:Hacker News · AI · huggingface.co