Budget
Silent home server
$1,283Sample
16 GB on GeForce RTX 4060 Ti 16 GB
- PaddleOCR-VL · 1.9 GB (16-bit)
- Qwen3 8B · 5.0 GB (Q4_K_M GGUF file)
Weights ≈ 6.9 GB of 15.5 GB usableEstimate
Excludes KV cache and runtime overhead. Runtime compatibility is not validated.
A sub-1B document parser and an 8B tagger run comfortably on 16 GB.
Runtime: paperless-ngx + paperless-gpt + Ollama
