Zum Inhalt springen
AI.info

events

Beyond Vibe Checks: A Hands On Workshop on Evaluating LLM Apps, RAG and Agents

A full-day hands-on workshop in Bengaluru run by DevDay - Bangalore and led by Suman Paul Choudhury of Sahaj Software. Participants build repeatable evaluations for LLM applications, moving from a…

Beyond Vibe Checks: A Hands On Workshop on Evaluating LLM Apps, RAG and Agents | KI-Events

Auf Englisch

Starts
2026-12-12 04:00 UTC
Organizer
DevDay - Bangalore
Location
Sahaj Software, 3rd Floor, Sulochana Building, 365, 1st Cross Rd, 3rd Block, Santhosapuram, Koramangala 3 Block, Koramangala, Bengaluru, Karnata, Bengaluru, India

A full-day hands-on workshop in Bengaluru run by DevDay - Bangalore and led by Suman Paul Choudhury of Sahaj Software. Participants build repeatable evaluations for LLM applications, moving from a single prompt to a RAG pipeline and then a tool-calling agent. Topics include dataset construction, code checks and LLM-as-a-judge scoring, hallucination detection for RAG, agent tool-call assessment, version comparison and production monitoring. The workshop uses LangSmith, and attendees receive an evaluation playbook and notebooks. It is for engineers with Python experience who build LLM products; attendance is invite-only and screened.

Event website