Requirements
Roles & Responsibilities:
The ideal candidate will have strong experience in data engineering, ETL development, and production support, ensuring
reliable, scalable, and high -performing data operations within Azure environment and can work in a fast -paced environment. Knowledge of Supply chain / insurance domain and Power BI is a plus but not mandatory.
Must Have Technical/Functional Skills:
â 8+ years overall experience in data engineering or related fields.
â 2.5 years hands -on experience with Databricks and Spark.
â Strong proficiency in SQL and data analysis techniques.
â Experience with ETL processes, data modeling, and performance tuning.
â Familiarity with Python or Scala for data engineering tasks.
â Excellent problem -solving and communication skills.
Development:
â Design, develop, and deploy scalable ETL/ELT data pipelines using Apache
Spark, PySpark, and Databricks.
â Develop and optimize SQL queries for data transformation and analysis.
â Collaborate with product owners, data architects and analysts to build data
models, delta lake structures, and data workflows.
â Collaborate with data analysts and business teams to deliver actionable insights.
â Build job orchestration and monitoring solutions
â Ensure data quality, performance, and reliability across workflows.
â Develop and maintain CI/CD pipelines for Databricks notebooks, jobs, and workflows.
â Work with cloud -based data platforms (Google preferred).