jobs

Staff Software Engineer, On-Device Machine Learning Infrastructure

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend wel

Company

Google

Location

Sunnyvale, CA, USA

Status

Open

Posted

2026-08-21T15:39:34+00:00

Google is hiring a staff software engineer to build on-device machine-learning infrastructure: APIs, SDKs and tools that let large language models such as Gemini Nano and Gemma run on phones and browsers, across CPUs, GPUs, NPUs and Edge TPUs. The job involves setting roadmaps, tuning generative AI performance across heterogeneous hardware, coordinating with Android ML, ML Compiler and DeepMind, and mentoring. It asks for eight years in software development, five in ML infrastructure or a related ML field, and on-device deployment experience.