Senior Data Engineer

Company Overview

Incedo is a US-based consulting, data science and technology services firm with over 3000 people helping clients

from our six offices across US, Mexico and India. We help our clients achieve competitive advantage through

end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering, data science, and

design capabilities coupled with deep domain understanding. We combine services and products to maximize

business impact for our clients in telecom, Banking, Wealth Management, product engineering and life science

& healthcare industries. 

Working at Incedo will provide you an opportunity to work with industry leading client organizations, deep

technology and domain experts, and global teams. Incedo University, our learning platform, provides ample

learning opportunities starting with a structured onboarding program and carrying throughout various stages of

your career. A variety of fun activities is also an integral part of our friendly work environment. Our flexible

career paths allow you to grow into a program manager, a technical architect or a domain expert based on your

skills and interests. 

Our Mission is to enable our clients to maximize business impact from technology by

• Harnessing the transformational impact of emerging technologies


• Bridging the gap between business and technology

Role Description

Role Description:

As a Senior Big Data Platform Engineer at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise.

Roles & Responsibilities:

•    Designing, developing and maintaining large-scale big data platforms using technologies like Hadoop, Spark and Kafka

•    Creating and managing data warehouses, data lakes and data marts

•    Implementing and optimizing ETL processes and data pipelines

•    Developing and maintaining security and access controls

•    Troubleshooting and resolving big data platform issues

•    Collaborating with other teams to ensure the consistency and integrity of data

Technical Skills

Skills Requirements:

• Experience with big data processing technologies such as Apache Hadoop, Apache Spark, or Apache Kafka.


• Understanding of distributed computing concepts such as MapReduce, Spark RDDs, or Apache Flink data streams.


• Familiarity with big data storage solutions such as HDFS, Amazon S3, or Azure Data Lake Storage.


• Knowledge of big data processing frameworks such as Apache Hive, Apache Pig, or Apache Impala.


• Must have excellent communication skills and be able to communicate complex technical information to non-technical stakeholders in a clear and concise manner.


• Must understand the company's long-term vision and align with it.


• Provide leadership, guidance, and support to team members, ensuring the successful completion of tasks, and promoting a positive work environment that fosters collaboration and productivity, taking responsibility of the whole team.

Nice-to-have skills

Qualifications

Qualifications 

• 4-6 years of work experience in relevant field


• B.Tech/B.E/M.Tech or MCA degree from a reputed university. Computer science background is preferred 

Company Value

We value diversity at Incedo. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.