Lead Data Engineering

Company Overview

Incedo is a US-based consulting, data science and technology services firm with over 3000 people helping clients

from our six offices across US, Mexico and India. We help our clients achieve competitive advantage through

end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering, data science, and

design capabilities coupled with deep domain understanding. We combine services and products to maximize

business impact for our clients in telecom, Banking, Wealth Management, product engineering and life science

& healthcare industries. 

Working at Incedo will provide you an opportunity to work with industry leading client organizations, deep

technology and domain experts, and global teams. Incedo University, our learning platform, provides ample

learning opportunities starting with a structured onboarding program and carrying throughout various stages of

your career. A variety of fun activities is also an integral part of our friendly work environment. Our flexible

career paths allow you to grow into a program manager, a technical architect or a domain expert based on your

skills and interests. 

Our Mission is to enable our clients to maximize business impact from technology by

• Harnessing the transformational impact of emerging technologies


• Bridging the gap between business and technology

Role Description

Role Description:

As a Principle Engineer - ETL Platform - Informatica at Incedo, you will be responsible for designing and implementing ETL platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in ETL tools such as Informatica or Talend and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the ETL platform and troubleshooting any issues that arise.

Roles & Responsibilities:

•    Develop, maintain, and enhance ETL platform and infrastructure components to ensure scalability, performance, and reliability

•    Design and implement ETL solutions that are flexible and adaptable to changing business requirements

•    Develop and maintain ETL platform and infrastructure code, scripts, and jobs, ensuring they are efficient, accurate, and meet business requirements

•    Collaborate with cross-functional teams, including data analysts, business analysts, and project managers, to understand requirements and deliver solutions that meet business needs

•    Optimize ETL platform and infrastructure to improve performance, scalability, and reliability

•    Implement monitoring and alerting capabilities to ensure platform and infrastructure health and performance

•    Participate in the development and implementation of ETL best practices and standards

•    Create and maintain technical documentation, including design documents, coding standards, and best practices.

•    Foster a collaborative and supportive work environment, promoting open communication and teamwork.

•    Demonstrate strong leadership skills, with the ability to inspire and motivate team members to perform at their best.

 

Technical Skills

Skills Requirements:

• Knowledge of data integration platforms such as Apache Kafka, Amazon Kinesis, or Google Cloud Pub/Sub.


• Understanding of data ingestion techniques such as batch processing, real-time streaming, and event-driven processing.


• Experience with workflow automation tools such as Apache Airflow, AWS Step Functions, or Azure Data Factory.


• Familiarity with distributed data processing frameworks such as Apache Spark, Apache Flink, or Google Dataflow.


• Must have excellent communication skills and be able to communicate complex technical information to non-technical stakeholders in a clear and concise manner.


• Must understand the company's long-term vision and align with it.


• Should be able to identify problems, generate effective solutions, and troubleshoot issues that may arise while working on complex projects.


• Must Display Adaptability to changing circumstances, new technology, and shifting priorities.

Nice-to-have skills

Qualifications

Qualifications 

• 11-12 years of work experience in relevant field


• B.Tech/B.E/M.Tech or MCA degree from a reputed university. Computer science background is preferred 

Company Value

We value diversity at Incedo. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.