Sr. Data Engineer

Job Overview

At TE we strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business The Analytics team at TE is part of the Aerospace Defense Marine BU (ADM) Organization and is responsible for driving organic growth by leveraging big data and advanced analytics.

We are on an exciting journey to build and scale our advanced analytics practice. TE is looking for a Senior Data Lake Developer that has experience in building data lake architectures using AWS and related technologies.

In this position you will apply your skills to manage the existing cloud data platform to make it more scalable, reliable, and cost efficient. You will also work on additional projects that would leverage the existing architecture in some cases and use newer technologies where needed

Responsibilities

• Design and implement enterprise-scale Data Lake and Lakehouse architecture.


• Develop scalable ETL/ELT pipelines for data ingestion and transformation.


• Design, develop, and evaluate scalable data warehouse solutions and data models.


• Build enterprise data warehouses using Amazon Redshift, Snowflake, or equivalent cloud data warehouse technologies.


• Demonstrate strong proficiency in SQL for data transformation, optimization, and performance tuning.


• Develop and optimize distributed data processing solutions using Apache Spark (PySpark).


• Coordinate with business and technical teams throughout all phases of the Software Development Life Cycle (SDLC).

• Troubleshoot, debug, and resolve technical issues related to data engineering solutions.


• Participate in major technical and architectural design decisions.


• Mentor and guide junior engineers while promoting engineering best practices.

Qualifications

• Bachelor’s degree in computer science, IS, Data Engineering, Data Science, or a  related field.


• 8 - 10 years of overall experience in Data Engineering.


• 8+ years of hands-on experience building cloud-native data platforms on AWS.


• 5+ years of hands-on experience with Databricks and Delta Lake.


• Strong analytical, problem-solving skills, Excellent communication & stakeholder management.


• Strong proficiency in SQL & Python & experience in optimizing complex queries & data pipelines.


• Ability to lead technical discussions and architectural decisions.


• Performance optimization mindset with experience tuning Spark jobs and SQL workloads.


• Experience working in Agile/Scrum environments.
  

   

  
  

  We Value

  
  
  
  
  • Databricks Certified Developer (Associate level or higher).
  
  
  • AWS Certification (Associate level or higher) is highly desirable.
  
  
  
  

Competencies