events
Beyond Vibe Checks: A Hands On Workshop on Evaluating LLM Apps, RAG and Agents
A full-day hands-on workshop in Bengaluru run by DevDay - Bangalore and led by Suman Paul Choudhury of Sahaj Software. Participants build repeatable evaluations for LLM applications, moving from a…

- Starts
- 2026-12-12 04:00 UTC
- Organizer
- DevDay - Bangalore
- Location
- Sahaj Software, 3rd Floor, Sulochana Building, 365, 1st Cross Rd, 3rd Block, Santhosapuram, Koramangala 3 Block, Koramangala, Bengaluru, Karnata, Bengaluru, India
A full-day hands-on workshop in Bengaluru run by DevDay - Bangalore and led by Suman Paul Choudhury of Sahaj Software. Participants build repeatable evaluations for LLM applications, moving from a single prompt to a RAG pipeline and then a tool-calling agent. Topics include dataset construction, code checks and LLM-as-a-judge scoring, hallucination detection for RAG, agent tool-call assessment, version comparison and production monitoring. The workshop uses LangSmith, and attendees receive an evaluation playbook and notebooks. It is for engineers with Python experience who build LLM products; attendance is invite-only and screened.
Event website