Vai al contenuto
AI.info

Tools

Baseten vs Text Generation Inference

Baseten or Text Generation Inference? Their plans monthly and yearly, the capabilities their makers state, security and latest updates, side by side — read from the makers' own pages.

In inglese

In short

  • Both: Choice of models, Self-hosted, API, Runs models for you
  • Only Text Generation Inference states: Command line, Traces and evaluates

Baseten

Baseten provides managed infrastructure to deploy, serve, train, and distribute open-source, custom, and fine-tuned AI models.

Plans

Basic

Free

  • Dedicated deployments
  • Model APIs
  • Training
  • Fast cold starts
  • SOC 2 Type II and HIPAA compliant
  • Email and in-app chat support

Dedicated Deployments — T4

  • $0.01052 per minute
  • 16 GiB VM

Dedicated Deployments — L4

  • $0.01414 per minute
  • 24 GiB VRAM

Dedicated Deployments — A10G

  • $0.02012 per minute
  • 24 GiB VM

Dedicated Deployments — A100

  • $0.06667 per minute
  • 80 GiB VRAM

Dedicated Deployments — H100 MIG

  • $0.0625 per minute
  • 40 GiB VRAM

Dedicated Deployments — H100

  • $0.10833 per minute
  • 80 GiB VRAM

Dedicated Deployments — B200

  • $0.16633 per minute
  • 180 GiB VRAM

Prices checked 2026-09-24 on the maker’s page.

Capabilities

  • Choice of models — “You can deploy open source and custom models on Baseten.” source
  • Self-hosted — “Yes, you can self-host Baseten in order to manage security and use your own cloud commitments.” source
  • API — “Model APIs” source
  • Runs models for you — “Instant access to pre-optimized models running on the Baseten Inference Stack.” source

Security

  • SOC 2 Type II — “Baseten Labs, Inc. SOC 2 Type 2 Report 5.31.26.pdf” source
  • SOC 2 — “Baseten Labs, Inc. SOC 2 Type 2 Report 5.31.26.pdf” source
  • ISO 27001 — “Baseten Labs, Inc. ISO 27001 Certificate.pdf” source
  • GDPR — “SOC 2 ISO 27001:2022 HIPAA CCPA GDPR PCI DSS - SAQ D” source
  • HIPAA — “Baseten Labs, Inc. HIPAA Report 5.31.26.pdf” source

Latest updates

About Baseten

Text Generation Inference

Open-source server for deploying and serving language models with streaming, batching, quantization, and multi-GPU inference.

Plans

Free

Free

  • Unlimited public/private repositories
  • Dependabot security and version updates
  • 2,000 CI/CD minutes/month
  • 500MB of Packages storage
  • Issues & Projects
  • Community support

Team

  • $4 USD per user/month
  • Access to GitHub Codespaces
  • Repository rules
  • Multiple reviewers in pull requests
  • Draft pull requests
  • Code owners
  • 3,000 CI/CD minutes/month

Enterprise

  • Starting at $21 USD per user/month
  • Data residency
  • Enterprise Managed Users
  • User provisioning through SCIM
  • Enterprise account to centrally manage multiple organizations
  • Environment protection rules
  • Audit Log API

Prices checked 2026-09-25 on the maker’s page.

Capabilities

  • Command line — “To see all options to serve your models (in the code or in the cli): text-generation-launcher --help” source
  • Choice of models — “text-generation-launcher --model-id mistralai/Mistral-7B-Instruct-v0.2” source
  • Self-hosted — “You can also opt to install text-generation-inference locally.” source
  • API — “You can consult the OpenAPI documentation of the text-generation-inference REST API using the /docs route.” source
  • Runs models for you — “Text Generation Inference (TGI) is a toolkit for deploying and serving Large Language Models (LLMs).” source
  • Traces and evaluates — “Production ready (distributed tracing with Open Telemetry, Prometheus metrics)” source

Latest updates

  • v3.3.7 (v3.3.7)

    Added support for max_image_fetch_size and announced maintenance mode.

  • v3.3.5 (v3.3.5)

    Added Gemma 3 sliding-window support and XPU LoRA support.

  • v3.3.4 (v3.3.4)

    Added initial Gaudi support for Gemma 3 text and VLM models.

About Text Generation Inference