Skip to content
Hacker News · AI·· 3 h agoAI score34

LM Studio vs. Ollama on Linux: Same Qwen3.5 GGUF Files Benchmarked on an RTX 3090

LM Studio vs. Ollama on Linux: same model files, measured on an RTX 3090

AI summary

A Docker-based test on one RTX 3090 compared LM Studio and Ollama running the same Qwen3.5 9B and 27B GGUF files, verified by SHA-256. Ollama was about 10% faster on the 9B model and 5% faster on the 27B for single-request generation, while LM Studio hit 90.2 tokens/s on four concurrent 27B requests versus Ollama's 33.1 tokens/s. LM Studio's official Docker image is CPU-only, so GPU use requires unsupported steps.

Source:Hacker News · AI · homebrewserver.club