Vai al contenuto
AI.info

events

LLMs bajo control: Guidance, Olive y ONNX Runtime

Workshop avanzato per realizzare una pipeline locale basata su un modello Phi con Olive, ONNX Runtime e Guidance, per vincolare l’output di un LLM a uno schema JSON Schema.

LLMs bajo control: Guidance, Olive y ONNX Runtime | Eventi sull’IA

In inglese

Starts
2026-11-13 17:00 UTC
Organizer
Microsoft Speakers Hub en Español
Location
Online event

An advanced online workshop from Microsoft Speakers Hub en Español, part of AI Virtual Days 2026, led by Antonio Jesús García Palomo. Starting from a Phi-family model, participants work through a pipeline that prepares and optimises the model with Microsoft Olive, runs it locally on ONNX Runtime, defines a structured contract in JSON Schema and applies constrained decoding with Guidance and LLGuidance. The exercises compare three approaches: asking the model through prompting to follow a structure, generating and then validating the answer, and restricting generation itself. Participants design their own schemas, and the session stresses that controlling a response's structure does not make its content true.

Event website