Skip to content
AI.info

jobs

Member of Technical Staff (Analyst, Search Crawler)

The internet is vast, containing trillions of URLs. Perplexity’s crawling and storage system is complex and has multiple stages (URL discovery, crawling, parsing, indexing).

Company
Perplexity
Location
Belgrade; London; Dublin
Status
Open
Posted
2026-10-08 17:09 UTC

Perplexity is hiring a Member of Technical Staff for its web crawling and indexing pipeline, which spans URL discovery, crawling, parsing and indexing. The role mixes data analysis and engineering: diagnosing crawl quality issues, training small models for tasks such as parsing quality, building training datasets and LLM-as-a-judge labeling pipelines, improving page selection for indexing, and designing experiments. The posting asks for four or more years as a data analyst or ML engineer, production-grade coding, metric design experience, and models shipped to production, with crawling or indexing work a plus.

Original job posting