Can you run it?
This page is a projection of the one entry record, the Reliability and Data control factors that Implement covers. The full verdict is set by all four factors together, floor-weighted so the weakest caps the whole.
- AssessUse & modify + Transparency
- ImplementData control + Reliability
- UseReliability
- SupportTransparency
Install & run
Download the safetensors from the verified deepseek-ai organisation on Hugging Face and
serve with Ollama, llama.cpp, vLLM or SGLang. The small sizes run on a single consumer GPU.
Pin the exact revision and verify checksums.
Hardware & VRAM requirements
The 1.5B-7B models run on consumer GPUs or CPU. The 14B and 32B run on a single data-centre GPU, or on high-end consumer hardware when quantized. Context is 128K, from the Qwen2.5 bases. These are the easiest DeepSeek reasoning weights to deploy.
Serving stacks
vLLM, SGLang, llama.cpp and Ollama all support these models first-class. They are small enough for edge and on-device use.
Safe-deployment controls & Deployment Ceiling
Deployment Ceiling: T2 (conditional). The models have no safety tuning of their own, so supply input/output guardrails and a guard or classifier model. Add prompt-injection defences, treat retrieved and tool content as untrusted in agentic use, and allow for the China-aligned filtering carried over from R1.
Available quantizations
These are the most extensively quantized DeepSeek artifacts, in GGUF and lower-bit formats across all sizes. The MIT licence permits redistribution of the derivatives. Verify provenance per mirror.
Fine-tuning & adaptation
The MIT licence permits unrestricted fine-tuning and further distillation, and the small sizes make it cheap. The distillation data and code are closed, so the distillation itself cannot be reproduced from scratch.
API / OpenAI-compatible integration
Serve the model behind an OpenAI-compatible endpoint (vLLM, SGLang or Ollama) and point the client at it. Handle the reasoning (think-tag) output format in the client.
How this scores
The ownership factors this domain covers, drawn from the one entry record.
ReliabilityIs it reliable and good enough for the job?
StrongPerformance 3, operational 5 and safety 3: solid reasoning for the size and the easiest serving in the family. All three are at or above 3 and operational is 5, so reliability is strong. The gap is the absence of safety tuning and of a first-party guard model.
Doesn't extract your dataDoes running it keep your knowledge and data yours?
StrongSelf-hosted, the MIT-licensed weights run entirely on your own infrastructure, including on-device at the small sizes, with no telemetry and no claw-back. Your data stays yours.
Sources
The same evidence records as the entry sheet. Read means the text was verified; unverified means it is known to exist but not yet read.