Job Title: Apache Airflow SME / Data Platform Engineer

Role Summary

We are looking for an experienced Apache Airflow SME / Data Platform Engineer who has hands-on experience in designing and building scalable data platforms, not just writing DAGs. The ideal candidate will play a key role in architecting, developing, and optimizing data pipelines and platform infrastructure.

Key Responsibilities

• Design, develop, and manage data platforms using Apache Airflow
• Build, orchestrate, and optimize end-to-end data pipelines
• Architect scalable and reusable data workflow frameworks
• Implement best practices for workflow orchestration, monitoring, and alerting
• Work with data engineers, analysts, and stakeholders to deliver data solutions
• Optimize performance, reliability, and cost of data pipelines
• Troubleshoot and resolve issues in data workflows and platform components
• Ensure data governance, security, and compliance standards

Required Skills

• Strong experience with Apache Airflow (SME level)
• Proven experience in building data platforms (not just DAG development)
• Strong knowledge of Python and SQL
• Experience with cloud platforms (AWS / Azure / GCP)
• Understanding of data engineering concepts (ETL, ELT, data lakes, warehouses)
• Experience with CI/CD pipelines and DevOps practices
• Hands-on experience with monitoring/logging tools

Preferred Skills

• Experience with tools like Spark, Kafka, dbt
• Knowledge of containerization (Docker, Kubernetes)
• Exposure to modern data stack architectures