Skip to content
AI.info

events

GPU Detective Stories: PyTorch Recompiles & Hidden Bottlenecks

An online session of the AI Performance Engineering Meetup in Seattle, opening with introductions and group updates before two technical talks. Chaim Rand compares six ways to handle torch.compile…

GPU Detective Stories: PyTorch Recompiles & Hidden Bottlenecks | AI Events
Starts
2026-11-16 17:00 UTC
Organizer
AI Performance Engineering Meetup (Seattle)
Location
Online event

An online session of the AI Performance Engineering Meetup in Seattle, opening with introductions and group updates before two technical talks. Chaim Rand compares six ways to handle `torch.compile` recompilations that appear in the request path when input shapes or layouts change, using a dynamic graph-neural-network example and covering tradeoffs against model, input distribution and latency needs. Israel Ogbole of Zymtrace then walks through a profiling case study on training and serving Jev, describing how bottlenecks were found and measured across compute, memory, communication and inference synchronization.

Event website