AWS Data Engineer_Python+Glue_6+yrs

About the Opportunity
A fast-scaling technology consultancy in the Data Engineering & Cloud Modernization space, we partner with enterprise clients across India and globally to build scalable, secure, and automated data pipelines on AWS. Our engineers work at the intersection of data, infrastructure, and automation — enabling real-time analytics, ML readiness, and governed data lakes for Fortune 500 and high-growth tech companies. We value engineering rigor, cloud-native design, and measurable business outcomes. Role & Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using AWS Glue (Spark & Python) for batch and streaming workloads.


• Orchestrate data workflows using AWS Step Functions, Lambda, EventBridge, and Data Pipeline for end-to-end job scheduling and monitoring.


• Optimize data ingestion, transformation, and partitioning strategies across S3, Redshift, Athena, and DynamoDB for performance and cost efficiency.


• Integrate Python scripts with Glue Jobs and AWS SDKs to automate metadata management, data validation, and lineage tracking.


• Collaborate with data analysts and ML engineers to prepare clean, curated datasets for BI dashboards and machine learning models.


• Implement infrastructure-as-code using CloudFormation or CDK to deploy and manage data environments in a repeatable, version-controlled manner.

Skills & Qualifications
Must-Have

• AWS Glue


• Python


• PySpark


• Amazon S3


• Amazon Redshift


• AWS Lambda


• AWS Step Functions


• SQL

Preferred

• AWS CDK


• Apache Airflow


• Amazon Athena

Benefits & Culture Highlights

• Hybrid work model — collaborate in-office when needed, work remotely with flexibility.


• Direct exposure to high-impact client engagements across BFSI, Retail & Tech sectors.


• Career growth path into Cloud Architecture, DataOps leadership, or GenAI pipeline roles.