Azure Data Engineer

Azure Data Engineer (Contract Position)
Job Title: Azure Data Engineer
Start Date: July 8, 2024
End Date: January 8, 2025
Location: Vancouver
Candidate Location Requirements: Vancouver, BC
Onsite Work (if hybrid): 3 days per week
Responsibilities:
As a Data Engineer, you will collaborate closely with studio business leaders, data scientists, analysts, designers, and producers. Your primary focus will be building out the data infrastructure to support critical insights about players. Here are your typical day-to-day responsibilities: Deliver high-quality, well-tested, secure, and maintainable code.
Design, develop, optimize, and maintain data pipelines and back-end services for reporting, optimization, data collection, and related functions.
Create and manage automated unit and integration test suites to ensure data accuracy and completeness.
Experiment with and recommend new technologies to enhance the tech stack.
Design efficient data structures and database schemas, working with distributed systems architecture.
Write efficient, readable, extensible code from scratch across multiple features/solutions.
Suggest and implement performance monitoring protocols for data pipelines.
Develop and maintain documentation and guides on procedures and features.
Perform root cause analysis to identify reasons for alerts and minimize points of failure.
Collaborate with data scientists, developers, and business stakeholders to understand data requirements and develop solutions.
Requirements: Hard Skill: At least 3 years of experience in big data engineering, with a focus on Spark and SQL.
Preferred Qualifications: Experience working with large data sets using SQL, Azure Data Lake, Spark, etc., to derive actionable insights.
Familiarity with Azure DevOps (YAML pipelines).
Proficiency in Azure Databricks (Python, PySpark, Spark SQL).
Knowledge of Azure Data Factory (C#).
Exposure to Azure Data Explorer (KQL/CSL).