Tools

llama.cpp vs vLLM

llama.cpp or vLLM? Their plans monthly and yearly, the capabilities their makers state, security and latest updates, side by side — read from the makers' own pages.

In inglese

In short

Both: Choice of models, Self-hosted, API
Only llama.cpp states: Command line
Only vLLM states: Runs models for you

llama.cpp

Open-source C/C++ software for running large language and vision-language models locally or in the cloud.

Plans

Free

Unlimited public/private repositories
Dependabot security and version updates
2,000 CI/CD minutes/month
500MB of Packages storage
Issues & Projects
Community support

Team

$4 per user/month

Access to GitHub Codespaces
Repository rules
Multiple reviewers in pull requests
Draft pull requests
Code owners
Required reviewers

Enterprise

Starting at $21 per user/month

Data residency
Enterprise Managed Users
User provisioning through SCIM
Enterprise Account to centrally manage multiple organizations
Environment protection rules
Repository rules

Prices checked 2026-09-24 on the maker’s page.

Capabilities

Command line — “llama cli -hf ggml-org/Qwen3.5-0.8B-GGUF” source
Choice of models — “llama cli -hf ggml-org/Qwen3.5-0.8B-GGUF” source
Self-hosted — “locally and in the cloud.” source
API — “Launch OpenAI-compatible API server” source

Latest updates

2026-09-24 b11160
Adds Vulkan int8 cooperative-matrix quantized matmul for AMD RDNA3 and RDNA4, including q8_0, q4_1, q5_0, and q5_1.
2026-09-24 b11159
Handles misalignment in conv_2d and conv_3d.
2026-09-24 b11158

About llama.cpp

vLLM

Open-source engine for serving large language models with batching, caching, quantization, and distributed inference.