Software Engineers (Backend / Infrastructure / Web Crawling / Research / DevRel)

My client is building a next-generation search platform designed for AI applications — combining large-scale web crawling, advanced retrieval models, and high-performance infrastructure. The team operates at significant scale, solving complex engineering problems across distributed systems and data platforms.

They are hiring across multiple engineering tracks, offering the opportunity to work on core systems that directly power modern AI-driven applications.

The Opportunity

Engineers in this team work on foundational problems across search, data, and infrastructure, including:

1. Building large-scale distributed systems to crawl and index the web
2. Developing low-latency backend platforms capable of processing massive datasets
3. Designing high-performance infrastructure , including GPU orchestration and large-scale compute systems
4. Improving search quality and retrieval performance through applied research and system optimisation
5. Creating tools, APIs, and developer experiences that bring these capabilities to end users

Projects include:

1. Crawling and indexing 100M+ pages per day
2. Designing systems that operate across thousands of machines
3. Building vector databases and retrieval systems at scale
4. Optimising ML pipelines and search performance end-to-end

Role Profiles

Backend Engineers

1. Build and optimise high-throughput, low-latency systems
2. Develop large-scale data processing pipelines
3. Work on core search and retrieval infrastructure

Infrastructure Engineers

1. Design and operate large-scale compute systems , including GPU clusters and Kubernetes environments
2. Build tooling to improve reliability, observability, and performance across the stack

Web Crawling Engineers

1. Build distributed systems to crawl and process the entire web
2. Solve challenges around scale, scheduling, anti-bot systems, and dynamic content

Research Engineers (Generalist)

1. Work across ML, search, and retrieval systems
2. Improve end-to-end search quality, latency, and throughput

Developer Relations Engineers

1. Build developer-facing tools, demos, and APIs
2. Engage the technical community through content, hackathons, and product storytelling

What They’re Looking For

1. Strong engineering fundamentals with experience in distributed systems, data, or performance-critical environments
2. Proficiency in one or more of Python, C++, Rust, or TypeScript
3. Experience building or scaling production systems handling large volumes of data
4. A mindset focused on optimisation, ownership, and solving complex technical problems
5. Curiosity and interest in search, AI infrastructure, or large-scale systems

Why This Role

1. Opportunity to work on foundational infrastructure for next-generation AI applications
2. Exposure to large-scale systems and cutting-edge engineering challenges
3. High-impact role within a lean, technical team
4. Flexibility across multiple engineering tracks based on strengths and interests

BAH Partners specialize in placing the leading technology and quantitative talent into Asia Pacific’s premier financial and technology-driven organizations. If you would like more information, or to confidentially discuss your career options, please contact me at [email protected] or call (852) 2850 4877 | (852) 6535 7977

Follow us @ https://hk.linkedin.com/company/bah