jobs

Senior Performance Engineer- Pretraining (f/m/d)

Aleph Alpha is hiring a Senior Performance Engineer for its foundation-model pre-training efficiency team in Heidelberg. The role focuses on improving training throughput and hardware utilization across large-scale GPU clusters, working at

In inglese

Company

Aleph Alpha

Location

Heidelberg, Germany

Status

Closed

Posted

2026-09-27T03:35:58.061+00:00

Aleph Alpha is hiring a senior performance engineer for its foundation-model pre-training efficiency team in Heidelberg, Germany. The job is hybrid with regular on-site collaboration. The person profiles large-scale LLM training loops using PyTorch Profiler, Nsight Systems and Nsight Compute, tunes tensor, data and expert parallelism, and balances compute and communication across GPU clusters. The posting asks for Python, PyTorch, the CUDA programming model, NCCL or MPI experience, and trace analysis. Work includes partnering with AI researchers on hardware-aware architectures.