events

Beyond Prompt Engineering: Evals-First LLM Apps with DSPy

Serverless Toronto hosts an online lunch-and-learn arguing that evaluation should come before prompt tuning. Serj Smorodinsky, a DSPy contributor, and Brett Kennedy, co-author of a Manning book on building LLM applications with DSPy, presen

Starts

2026-09-25T16:00:00+00:00

Organizer

Serverless Toronto

Location

Online event

Serverless Toronto hosts an online lunch-and-learn arguing that evaluation should come before prompt tuning. Serj Smorodinsky, a DSPy contributor, and Brett Kennedy, co-author of a Manning book on building LLM applications with DSPy, present a three-stage loop: build a baseline, define what a correct answer looks like, then optimize. They cover metrics for tasks with and without a right answer, swapping models on measured accuracy, cost, privacy and context window, and monitoring a live system after release. The session ends with Q&A.