Tools
Langfuse vs Promptfoo
Langfuse or Promptfoo? Their plans monthly and yearly, the capabilities their makers state, security and latest updates, side by side — read from the makers' own pages.
In short
- Both: Command line, Choice of models, Self-hosted, API, Traces and evaluates
- Only Langfuse states: Official SDKs
Langfuse
Langfuse traces, evaluates, and monitors AI agents and LLM applications, with prompt management, experiments, and cost analytics.
Plans
Hobby
Free
- 50k units / month included
- 30 days data access
- 2 users
- Community support via GitHub
- All platform features (with limits)
Core
- $29 / month
- $8/100k units
- 100k units / month included
- 90 days data access
- Unlimited users
- In-app support
- Everything in Hobby
Pro
- $199 / month
- $8/100k units
- 100k units / month included
- 3 years data access
- Data retention management
- Unlimited annotation queues
- High rate limits
- Prioritized in-app support
Enterprise
- $2499 / month
- $8/100k units
- 100k units / month included
- Audit Logs
- SCIM API
- Custom rate limits
- Uptime SLA
- Named lead support engineer
Prices checked 2026-09-25 on the maker’s page.
Capabilities
- Command line — “Langfuse CLI Full API access from the terminal for agent workflows, scripts, and CI/CD.” source
- Choice of models — “Test prompts on real production inputs and compare models side-by-side.” source
- Self-hosted — “Self-host at scale” source
- API — “REST APIs for everything” source
- Official SDKs — “Best-in-class SDKs: Native SDKs for Python and JavaScript” source
- Traces and evaluates — “Trace, evaluate, and improve AI agents with one open platform.” source
Security
- SOC 2 Type II — “The production service is based on the same open-source Langfuse codebase, is covered by SOC 2 Type II and ISO 27001 audits, and undergoes annual third-party penetration tests.” source
- SOC 2 — “We take active steps to demonstrate our commitment to data security and privacy such as annual SOC2 Type 2 and ISO27001 audits as well as External Penetration Tests.” source
- ISO 27001 — “The production service is based on the same open-source Langfuse codebase, is covered by SOC 2 Type II and ISO 27001 audits, and undergoes annual third-party penetration tests.” source
- GDPR — “Langfuse is GDPR compliant, and offers data retention, data masking and data deletion capabilities to manage the processing of personal data .” source
- HIPAA — “We offer a DPA , provide a HIPAA-ready region , and adhere to our Privacy Policy .” source
- Data kept in the EU — “Langfuse Cloud – fully-managed SaaS (multi-tenant) with US, EU, Japan, and HIPAA data regions” source
Latest updates
- Langfuse v4 is live: faster at scale, with more ways to search, monitor, and evaluate
Initial table loads drop from seconds to milliseconds, and dashboards over longer time ranges load at least 10x faster.
Promptfoo
Promptfoo evaluates and red-teams LLM apps, prompts, models, agents, and RAG systems through a CLI, library, and web interface.
Plans
Community
Free Forever
- All LLM evaluation features
- All model providers and integrations
- Red teaming (10k probes/month)
- Custom integration with your own app
- Run locally or self-host on your own infrastructure
- Vulnerability scanning
- Community support
Enterprise
Custom
- Custom red teaming limits
- Team sharing & collaboration
- Continuous monitoring
- Centralized security/compliance dashboard
- SSO and granular permission profiles
- Promptfoo API access
- Managed cloud deployment
- Priority support & SLA guarantees
On-Premise
Custom
- All Enterprise features
- Deployment on your own infrastructure
- Complete data isolation
- Dedicated runner
- Assigned deployment engineer
Prices checked 2026-09-24 on the maker’s page.
Capabilities
- Command line — “promptfoo is an open-source CLI and library for evaluating and red-teaming LLM apps.” source
- Choice of models — “Use OpenAI, Anthropic, Azure, Google, HuggingFace, open-source models like Llama, or integrate custom API providers for any LLM API” source
- Self-hosted — “Run locally or self-host on your own infrastructure” source
- API — “Promptfoo API access” source
- Traces and evaluates — “Test and evaluate your prompts, models, and RAG pipelines” source
Security
- SOC 2 Type II — “Promptfoo SOC2 Type II Report” source
- SOC 2 — “Promptfoo SOC2 Type II Report” source
- ISO 27001 — “Promptfoo ISO 27001 Certificate” source
Latest updates
- Open-Sourcing ModelAudit: Security Scanner for ML Model Files
ModelAudit was released as an MIT-licensed open-source static scanner for ML model files.
- Building a Security Scanner for LLM Apps
Promptfoo is adding code scanning for LLM-related vulnerabilities, first as a GitHub Action that reviews pull requests.
- GPT-5.2 Initial Trust and Safety Assessment (GPT-5.2)
Promptfoo opened a PR for GPT-5.2 support.