Role Overview
We are looking for an experienced Data Engineer with strong expertise in Microsoft technologies, including Power BI, Power Automate, Azure Data Lake, MS SQL Server, and integrations with Dynamics 365 CRM and Business Central. The candidate will be responsible for end-to-end data engineering solutions designing data pipelines, building scalable data flows, managing on-prem and cloud data systems, and enabling business reporting and analytics.
Key Responsibilities
- Design and develop data pipelines & ETL/ELT processes to sync data from Dynamics 365 CRM / Business Central to on-Prem MS SQL Server / Azure Data Lake.
- Build and maintain Power Automate flows for data integration, data refresh logic, data governance, and automation.
- Develop Power BI semantic models, dashboards, datasets, and incremental refresh strategies.
- Work with large datasets to optimize data architecture, indexing, partitioning, and performance tuning on SQL Server.
- Enable data extraction and transformation through Dataverse, OData, APIs, SSIS, or Azure Data Factory (good to have).
- Establish and enforce data quality, validation rules, schema mapping, and governance controls across platforms.
- Collaborate with business and functional teams to understand reporting requirements and translate them into engineering deliverables.
- Monitor and troubleshoot data workflows, ensuring data availability, accuracy, and reliability.
- Document system design, integration components, and data models.
Required Skills & Experience
- 4–6 years of experience as a Data Engineer / BI Engineer in Microsoft ecosystem.
- Hands-on expertise with:
✔ Microsoft SQL Server (queries, stored procedures, views, data warehousing)
✔ Power BI (data modeling, DAX, gateway management, incremental refresh)
✔ Power Automate cloud flows (data sync, triggers, APIs, business logic automation)
✔ Dynamics 365 CRM / Business Central data model and Dataverse integrations
✔ Azure Data Lake storage and security model
- Experience integrating data using OData feeds, REST APIs, Webhooks, or Azure connectors.
- Sound understanding of data warehouse concepts, star schema, change tracking, and CDC.
Good to Have
- Knowledge of Azure Data Factory, Azure Synapse Analytics, or SSIS.
- Experience handling real-time data pipelines or near real-time refresh.
- Exposure to Data Security, RBAC, GDPR compliance, and audit logging.
- Microsoft certifications (PL-300, DP-203, DP-900, or related).
Qualifications
- Bachelor’s degree in Computer Science, Engineering, or related field.
Soft Skills
- Strong analytical, troubleshooting, and data interpretation skills.
- Excellent communication and documentation abilities.
- Ability to manage multiple parallel tasks with accuracy and ownership.
- Collaborative mindset with willingness to engage with cross-functional stakeholders.