Sr Data Engineer -AWS

Job Title: Senior Data Engineer

Location: Remote

Experience: 5–8 Years

Employment Type: Full-Time

About the Role

Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You’ll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and scalable analytics.

This role reports to the Head – Data Platform and AI Lead, offering a unique opportunity to be part of a cross-functional team shaping the future of data-driven innovation.

Key Responsibilities

Data Engineering & Pipeline Development

• Design and develop reliable, reusable ETL/ELT pipelines using AWS Glue, Python, and Spark.
  


• Process structured and semi-structured data (e.g., JSON, Parquet, CSV) efficiently for analytics and AI workloads.
  


• Build automation and orchestration workflows using Airflow or AWS Step Functions.
  

Data Lake Architecture & Integration

• Implement AWS-native data lake/lakehouse architectures using S3, Redshift, Glue Catalog, and Lake Formation.
  


• Consolidate data from APIs, on-prem systems, and third-party sources into a centralized platform.
  


• Optimize data models and partitioning strategies for high-performance queries.
  

Security, IAM & Governance Support

• Ensure secure data architecture practices across AWS components using encryption, access control, and policy enforcement.
  


• Implement and manage AWS IAM roles and policies to control data access across services and users.
  


• Collaborate with platform and security teams to maintain compliance and audit readiness (e.g., HIPAA, GxP).
  


• Apply best practices in data security, privacy, and identity management in cloud environments.
  

DevOps & Observability

• Automate deployment of data infrastructure using CI/CD pipelines (GitHub Actions, Jenkins, or AWS CodePipeline).
  


• Create Docker-based containers and manage workloads using ECS or EKS.
  


• Monitor pipeline health, failures, and performance using CloudWatch and custom logs.
  

Collaboration & Communication

• Partner with the Data Platform Lead and AI Lead to align engineering efforts with AI product goals.
  


• Engage with analysts, data scientists, and business teams to gather requirements and deliver data assets.
  


• Contribute to documentation, code reviews, and architectural discussions with clarity and confidence.
  

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, or equivalent.
  


• 5–8 years of experience in data engineering, preferably in AWS cloud environments.
  


• Proficient in Python, SQL, and AWS services: Glue, Redshift, S3, IAM, Lake Formation.
  


• Experience managing IAM roles, security policies, and cloud-based data access controls.
  


• Hands-on experience with orchestration tools like Airflow or AWS Step Functions.
  


• Exposure to CI/CD practices and infrastructure automation.
  


• Strong interpersonal and communication skills—able to convey technical ideas clearly.
  

• Proficiency in Databricks, Unity Catalog, and Spark-based distributed data processing.
  


• Background in Pharma, Life Sciences, or other regulated environments (GxP, HIPAA).
  


• Experience with EMR, Snowflake, or hybrid-cloud data platforms.
  


• Experience with BI/reporting tools such as Power BI or QuickSight.
  


• Knowledge of integration tools (Boomi, Kafka) or real-time streaming frameworks.
  

Ready to build data solutions that fuel AI innovation?

Join Aptus Data Labs and play a key role in transforming raw data into enterprise intelligence.