AI.info
llama.cpp alternatives
8 alternatives to llama.cpp, each with what it shares — capabilities, price, free plan — read from the makers' pages.
Open-source C/C++ software for running large language and vision-language models locally or in the cloud.
- GPT4All
Both: developer api, choice of models · both have a free plan
- LocalAI
Both: developer api, command line, self-hosted and 1 more · both have a free plan
- vLLM
Both: developer api, self-hosted, choice of models · both have a free plan · the same starting price, $4/mo
- Text Generation Inference
Both: developer api, command line, self-hosted and 1 more · both have a free plan · the same starting price, $4/mo
- LM Studio
Both: developer api, command line, self-hosted and 1 more · both have a free plan
- openpi
Both: developer api, command line, self-hosted and 1 more · both have a free plan · the same starting price, $4/mo
- Unsloth
Both: developer api, command line, self-hosted and 1 more · both have a free plan
- Ollama
Both: developer api, self-hosted, choice of models · both have a free plan