Articles tagged "ollama"

A complete step-by-step guide to installing Qwen3.5-9B locally on Mac, Windows, and Linux. Covers setup via Ollama, llama.cpp, and vLLM, along with quantization options (GGUF Q4/Q5/Q8), GPU acceleration (CUDA/Metal), Docker deployment, API server configuration, performance tuning, and troubleshooting. Practical instructions for developers and IT administrators looking to run SLMs on-premises.