Azure Data Factory (ADF) Developer with SQL expertise

Design and Development: Design, develop, and deploy ETL (Extract, Transform, Load) pipelines and data-driven workflows using Azure Data Factory to ingest and process data from disparate sources. SQL Development & Optimization: Write and optimize complex SQL queries, stored procedures, views, and functions for efficient data extraction, transformation, and loading across large datasets. Data Integration: Create and manage ADF linked services, datasets, data flows (mapping and wrangling), and integration runtimes to connect and transform data between various sources and targets, including SQL Server, Azure SQL Data Warehouse/Synapse, and Azure Data Lake Storage. Orchestration and Monitoring: Implement data workflows and orchestration logic in ADF, ensuring scalability and reliability. Monitor, troubleshoot, and optimize pipeline performance, resolving failures and implementing logging and retry mechanisms to meet service level agreements (SLAs). Collaboration and Documentation: Collaborate with data architects, analysts, and stakeholders to understand business requirements and deliver high-quality data solutions. Document ETL processes, pipeline configurations, and data flow diagrams. Data Governance: Ensure data security, compliance, and governance standards are met within the Azure environment, including secure coding practices and access controls. Technical Skills: Strong SQL proficiency and expertise in Azure Data Factory, including knowledge of related Azure data components like Data Lake (Gen2) and Synapse Analytics. General Skills: Understanding of ETL concepts, strong problem-solving skills, and good communication. Familiarity with version control and CI/CD is also helpful. Experience and Education: A Bachelor's degree in a relevant field and typically 3+ years in a data engineering role are expected.