Lead Data Engineer (Python/Snowflake)

84.51° Overview:

84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.

Powered by cutting-edge science, we utilize first-party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer-centric journey using 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.

Join us at 84.51°!

As a Lead Data Engineer, you will have the opportunity to design and build software products and features for both internal and external clients. We are a team of innovators, continuously exploring new technologies that ensure 84.51° remains on the forefront of application development. In this position, you will be utilizing Python, SQL, Azure Cloud Services, and Snowflake.

As part of the Clean Room engineering team, you will work with transaction, audience, and exposure data to measure and report on campaign effectiveness while ensuring that our data and 3 rd party data is treated with the highest standards of privacy compliance.

Responsibilities

Take ownership of stories and drive them to completion through all phases of the entire 84.51° SDLC. This includes external facing and internal applications as well as process improvement activities such as:
Design and develop Python & SQL based data pipeline solutions
Perform unit and integration testing
Create quality checks for ingested and post processed data
Ensure alerting and monitoring of automated pipeline solutions
Provide mentoring to junior team members
Participate in retrospective reviews
Participate in the estimation process for new work and releases
Maintain and enhance existing applications
Bring new perspectives to problems
Be driven to improve yourself and the way things are done
Requirements

Bachelor's degree (Master's degree desired) typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program.
Understanding of Agile Principles (Scrum)
5+ years of proven professional Python and SQL development experience
Proficient with distributed data processing (PySpark, Snowpark)
Proficient with automated testing (PyTest, etc...)
Proficient with VCS (Git, GitHub)
Experience using Python frameworks
Experience with Cloud Technologies & Services (Azure preferred, GCP, AWS)
Experience with dependency management (Conda, venv, etc)
Experience with performance tuning enterprise applications
Experience with debugging enterprise applications
Experience with RESTful APIs
Understanding of CI/CD
Understanding of Object Oriented Principles
Understanding SOLID principles
Preferred Skills

Python & SQL Development
Distributed Data Processing (PySpark, Snowpark)
CI/CD practices
Automated data pipeline orchestration
Data observability - Logging, Monitoring, and Alerting
Azure Cloud infrastructure development
Snowflake
API development
Data quality checks
Cloud Technologies

#LI-DOLF