Tags
13 pages
GGUF
RTX 3060 runs the best quantized version of Qwen3: how to choose 12GB video memory
Running Gemma 4 12B on 8GB VRAM: Tuning llama-cli Hybrid Offload Parameters
RTX 3060 12GB Local 35B Guide: llama.cpp --n-cpu-moe for Qwen MoE
Qwen3.6-35B-A3B jailbreak local deployment: uncensored GGUF, llama.cpp, and safety boundaries
Running Qwen3.6-35B Locally on an RTX 3070 8GB: llama.cpp Deployment Notes and Tuning Parameters
llama.cpp b9196 Update: Windows Prebuilt Binaries Support CUDA 13.1, Vulkan, HIP, and SYCL
Best Local LLMs for RTX 3060 12GB: GGUF Models, Quantization, and VRAM Tips
Qwen3.6 GGUF VRAM Table: 27B and 35B-A3B on 8GB to 80GB GPUs
Gemma 4 VRAM Table: Choose E2B, E4B, 26B, or 31B GGUF
How to Use llama-quantize for GGUF Models
Download GGUF Models from Hugging Face with llama.cpp
Llama GGUF Quantization Guide: How to Choose Q8, Q6, Q5, Q4, or Q2
How to Download a GGUF Model from Hugging Face and Import It into Ollama