Zum Inhalt springen
AI.info

events

Simulated-User Evaluation Infrastructure: Evaluating AI Products with 8.3 Billion Persona Agents

Haixin Wang, a founding engineer at MatrAIx, speaks in the Caltech World Model Club and Caltech C joint seminar series. MatrAIx builds simulated-user evaluation infrastructure on a population of 8.3…

Simulated-User Evaluation Infrastructure: Evaluating AI Products with 8.3 Billion Persona Agents | KI-Events

Auf Englisch

Starts
2026-10-31 00:30 UTC
Ends
2026-10-31 01:30 UTC
Organizer
Caltech World Model Club
Location
Annenberg Center for Information Science and Technology, Pasadena, United States

Haixin Wang, a founding engineer at MatrAIx, speaks in the Caltech World Model Club and Caltech C joint seminar series. MatrAIx builds simulated-user evaluation infrastructure on a population of 8.3 billion persona agents, each described by a shared schema of 1,290 attributes covering background, psychology, capability, behaviour and lifestyle. The talk covers how persona cohorts are sampled to evaluate surveys, chatbots, web products and apps across more than 1,000 tasks in 25+ domains, and how the team verifies that agents behave as specified.

Event website