Ir al contenido
AI.info

jobs

Software Engineer, Data Acquisition

Overview: The Data Acquisition team within the Foundations organization at OpenAI is responsible for all aspects of data collection to support our model training operations.

En inglés

Company
OpenAI
Location
San Francisco
Status
Closed
Posted
2023-09-22 01:31 UTC

OpenAI's Data Acquisition team, part of its Foundations organization, is hiring a software engineer in San Francisco for on-site, full-time work. The role covers web crawling, data ingestion and search for model training: leading engineering projects, building distributed systems that handle petabytes, designing indexing and search algorithms, maintaining storage backends, and running Kubernetes and Infrastructure-as-Code deployments. The posting asks for a BS, MS or PhD in computer science, four or more years of industry experience, and expertise in large stateful distributed systems. Crawler experience is a plus.

Original job posting