Tools
LiteLLM vs MLflow
LiteLLM or MLflow? Their plans monthly and yearly, the capabilities their makers state, security and latest updates, side by side — read from the makers' own pages.
In short
- Both: Self-hosted, API, Official SDKs, Builds agents and workflows, Traces and evaluates
- Only LiteLLM states: Choice of models
- Only MLflow states: Command line
LiteLLM
LiteLLM is an open-source AI gateway that provides one API for routing, monitoring, and governing access to many LLM providers.
Plans
Open Source
Free
- Free forever · self-hosted
- 100+ providers, one OpenAI API
- Virtual keys, users & teams
- Spend tracking
- Budgets + rate limits
- LLM fallbacks
Enterprise
Price on request
- SSO + SCIM
- OIDC / JWT auth
- Audit logs
- Secret managers + key rotation
- Org & team admins
- Multi-region control plane
Prices checked 2026-09-25 on the maker’s page.
Capabilities
- Choice of models — “Swap models without changing app code.” source
- Self-hosted — “Self-host the same open-source gateway behind 240M+ Docker pulls, in your own cloud or fully air-gapped.” source
- API — “One OpenAI-compatible API to 140+ providers and 1,800+ models.” source
- Official SDKs — “Python SDK to call 100+ LLMs in the OpenAI format.” source
- Builds agents and workflows — “Agent SDK that routes every turn to the right model, across providers.” source
- Traces and evaluates — “Langfuse, Arize Phoenix, LangSmith, and OTEL logging” source
Security
- SOC 2 Type II — “SOC 2 Type II. Our current report is available through the LiteLLM Trust Center .” source
- SOC 2 — “SOC 2 Type II. Our current report is available through the LiteLLM Trust Center .” source
Latest updates
- v1.102.0: Auto Router Controls, Native OCR & Gateway Reliability (v1.102.0)
Auto router controls, native OCR, gateway reliability
- Heuristic auto router, semantic MCP tool search, off-peak pricing (v1.101.0)
- Access group budgets, Together AI overhaul, custom auto-router tiers (v1.100.0)
MLflow
MLflow is an open-source platform for tracking, evaluating, deploying, and monitoring machine learning models, LLM applications, and agents.
Plans
Not read from the maker’s page yet.
Prices checked 2026-09-25 on the maker’s page.
Capabilities
- Command line — “The easiest way to start MLflow server is to run the mlflow CLI command in your terminal.” source
- Self-hosted — “Thousands of users and organizations run their own MLflow instances to meet their specific needs.” source
- API — “This page hosts the API documentation for MLflow.” source
- Official SDKs — “Python API” source
- Builds agents and workflows — “Hands-on guides and code examples for building Agents and LLM applications with MLflow.” source
- Traces and evaluates — “Capture complete traces of your LLM applications and agents to get deep insights into their behavior.” source
Latest updates
- MLflow 3.16.0 Highlights: Build-Your-Own Trace Views, a Redesigned Trace Explorer, and Span Links (3.16.0)
Build trace views in plain English, use the trace explorer, and record links between spans.
- MLflow 3.15.0 Highlights: MCP Registry, a Smarter Assistant, and Multimodal Judges (3.15.0)
Register and share MCP servers, choose LLM providers in the Assistant, save and share Runs table views, transfer artifacts using presigned URLs, and evaluate image…
- MLflow 3.14.0 Highlights: One-Line Agent Onboarding, Review Queues, Pytest Integration, and the LLM Playground (3.14.0)
Onboard apps with mlflow agent setup, collect trace reviews, manage evaluation datasets in the UI, run pytest regression tests, and use an in-browser LLM Playground.