Senior Data Engineer(ID:572754) - Get Hired Fast

Key Responsibilities:

• Design, develop, and maintain robust and scalable data pipelines to ingest, transform, and store large volumes of structured and unstructured data from diverse sources.
• Collaborate with data architects, data scientists, and business analysts to understand data requirements and design efficient data models and schemas.
• Develop and optimize SQL queries and scripts to extract, transform, and load data into relational databases, data warehouses, and data lakes.
• Design and implement data quality checks, validation rules, and monitoring processes to ensure the accuracy, completeness, and integrity of the data.
• Implement security controls and access policies to protect sensitive data and ensure compliance with regulatory requirements.
• Evaluate and recommend new tools, technologies, and best practices to improve the efficiency, reliability, and performance of our data infrastructure.
• Collaborate with IT operations teams to deploy and manage data infrastructure components, monitor system performance, and troubleshoot issues.
• Document technical designs, workflows, and processes, and provide training and support to internal stakeholders as needed.

Qualifications:

• Strong proficiency in Azure cloud services, including Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, and Azure Synapse is an added advantage.
• Hands-on experience designing, implementing, and optimizing data pipelines and ETL processes.
• Experience in data orchestration and workflow management tools such as Apache Airflow or Azure Data Factory
• Proficiency in SQL and experience working with relational databases and data warehousing concepts.
• Experience with programming languages such as Python, Scala, or Java for data manipulation and scripting
• Excellent problem-solving skills and attention to detail, with a strong commitment to delivering high-quality solutions.
• Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders.