jobs

Software Engineer, Data Infrastructure

About the TeamData Platform at OpenAI owns the foundational data stack powering critical product, research, and analytics workflows. We operate some of the largest Spark compute fleets in production; design, and build data lakes and metadat

Company

OpenAI

Location

San Francisco; New York City; Seattle; Mountain View

Status

Open

Posted

2024-06-27T22:14:24.195+00:00

OpenAI's Data Platform team is hiring a software engineer to build and run the data infrastructure behind its products, research and analytics. The work covers distributed compute, orchestration, streaming and ML infrastructure: scaling Spark fleets, Kafka and Flink pipelines, Airflow orchestration, and Iceberg and Delta lakes, with full lifecycle ownership and on-call. The posting asks for four or more years in data or infrastructure engineering, plus Terraform and systems such as Spark, Kafka, Flink, Airflow, Trino or Iceberg. The role is at the San Francisco headquarters, hybrid, with relocation assistance.