Senior Staff TLM, Data Mining and Sampling for ML and Evaluation

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

The Waymo Driver is performing well in more and more cities, with our scale rapidly accelerating. Our team’s job is to ensure that we can continue to evaluate safety and service quality across new cities and countries, each with their unique challenges. We need an experienced, technically hands-on engineering manager with strong quantitative skills to lead a small team and work with partners to scale eval and ML development by exploring new methods and delivering tools for mining and sampling data.In this hybrid role, you will report to a Senior Staff manager.

You will:

• Develop tools for easy mining of novel situations that might impact safety from our driving logs for use in evaluation and ML datasets, using a mixture of ML and structured data


• Advanced sampling techniques and tuning of simulations to get strong signal for metrics and models from our datasets


• Build automation for our mining and sampling ecosystem so Waymo can rapidly scale to new cities


• Make hands-on technical contributions to both engineering and data science-oriented projects


• Provide strong management and technical leadership for a small team of data science-friendly engineers


• Partner with leads and teams across Waymo to determine and execute on strategy, including product, engineering, data science, frontend, and backend

You have:

• Strong engineering design and programming skills


• Strong data fluency and analysis skills


• Familiarity with statistical methods including hypothesis testing, experiment design, and sampling


• Familiarity with foundational and contemporary ML concepts and practices


• Experience managing teams of up to 8 people


• BS/MS in Computer Science, Robotics, Statistics, Physics, Math, or other quantitative area


• 7+ years of industry experience with:
  
  
  
  
  • C++, SQL, and Python experience
  
  
  • Navigating and modifying a large code base containing C++, SQL, and Python
  
  
  • Building data processing pipelines
  
  
  
  

We prefer:

• Eval experience, such as building and validating metrics to measure quality in complex systems


• Strong statistical background (MSc-level stats or similar expertise from work experience)


• Strong ML background (MSc-level ML or similar expertise from work experience)


• Experience working in the AV industry and/or with simulations