events

A Developer’s Guide to Running LLMs Locally- Alan Barber

The Central Ohio .NET Developer's Group hosts an evening talk by Alan Barber on how large language models work under the hood. The session explains tokens, tensors, attention, context windows, quantization, and inference performance in deve

Starts

2026-09-24T21:30:00+00:00

Organizer

Central Ohio .NET Developer's Group (CONDG)

Location

Central Insurance, 4450 Bridge Park Ave,, Dublin, United States

The Central Ohio .NET Developer's Group hosts an evening talk by Alan Barber on how large language models work under the hood. The session explains tokens, tensors, attention, context windows, quantization, and inference performance in developer-friendly terms, without assuming advanced linear algebra. It then moves to practical local inference, covering tools such as Ollama, LM Studio, and vLLM and the hardware demands of running useful models locally, including the recurring question of how much VRAM is needed.