Senior Data Engineer

Job Summary:

As a Senior Data Engineer you will be responsible for creating effective technological solutions for work with big data. They are also responsible for managing a team of specialists in their field and related IT professions. In addition, their roles include quality control of the work performed.

Position –

Senior Data Engineer- 5 to 7 Years

Technical Skills:

Programming Languages: Proficiency in languages like Python, SQL, and possibly Scala or Java.

Database Technologies: Experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).

Big Data Technologies: Knowledge of distributed computing frameworks such as Hadoop, Spark, and Apache Flink.

Data Warehousing: Familiarity with data warehousing concepts and tools like Amazon Redshift, Google BigQuery, or Snowflake.

ETL Tools: Experience with ETL tools like Apache NiFi, Apache Airflow, Talend, or Informatica.

Data Modeling: Understanding of data modelling principles and experience with tools like ERwin, Lucidchart, or DbSchema.

Version Control: Proficient in version control systems like Git for managing codebase changes.

Cloud Platforms: Experience working with cloud platforms like AWS, Azure, or Google Cloud Platform for deploying and managing data solutions.

Data Visualization: Basic understanding of data visualization tools like Tableau, Power BI, or matplotlib/seaborn in Python.

Requirements

Designing, building, and maintaining scalable and robust data pipelines for ingesting, processing, and transforming large volumes of data.

Collaborating with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business objectives.

Optimizing and fine-tuning data pipelines for performance, reliability, and efficiency.

Implementing data security and privacy measures to ensure compliance with regulations like GDPR or CCPA.

Troubleshooting data-related issues and providing timely resolution.

Participating in code reviews, documentation, and knowledge sharing sessions within the team.