Position: Data Warehouse Architect
Location: Agawam, MA
Duration: 6 Months
Job Description:
We are seeking a highly skilled Data Warehouse Architect with extensive experience in production support management and a solid background in various data technologies and team management. The ideal candidate will possess expertise in ADF, Databricks, Log Analytics, Purview, DevOps, and have significant experience in handling production support.
Key Responsibilities:
- Manage and oversee production support for data warehouse systems, ensuring smooth and efficient operation.
- Utilize Azure Data Lake Storage (ADLS), Azure Databricks, Azure SQL DB, and Azure Synapse Analytics for data warehousing solutions.
- Develop and maintain SQL Server, Azure Data Factory, Azure Automation, PowerShell scripting, and SQL databases.
- Write Python scripts, Spark SQL, and PySpark for data processing and analysis.
- Apply knowledge of ETL tools such as SSIS and Talend to support data ingestion and transformation processes.
- Implement dimensional modeling and data warehousing techniques to enhance data storage solutions.
- Manage data ingestion projects within the Azure environment.
- Lead production support activities, including L1/L2/L3 support levels, and handle the transition of production support from incumbents.
- Report on the operation and performance of production activities, driving automation and efficiency improvements.
- Lead enhancement and forward development initiatives as part of production support.
- Manage a team in an onshore/offshore model, ensuring effective collaboration and project delivery.
- Utilize CI/CD or DevOps practices to streamline development and deployment processes.
- Oversee release management and manage sprints within an Agile framework.
Required Skills:
- Extensive experience in production support management.
- Strong background in ADLS, Azure Databricks, Azure SQL DB, and Azure Synapse Analytics.
- Proficient in SQL Server development, Azure Data Factory, Azure Automation, PowerShell scripting, and SQL databases.
- Skilled in Python scripting, Spark SQL, PySpark, and ETL tools (SSIS, Talend).
- In-depth understanding of ETL processing and data warehousing/dimensional modeling.
- Knowledgeable in Azure Storage services (ADLS, Storage Accounts).
- Experience in managing data ingestion projects and production support roles.
- Demonstrated team management skills in an onshore/offshore model.
- Familiarity with CI/CD pipelines and DevOps practices.
- Experience in release management and working within an Agile framework.
Preferred Qualifications:
- Azure certified data engineering professional.
- Domain experience in Consumer Goods, Life Sciences, Manufacturing, Banking & Capital Markets.
- Strong communication skills to present and defend architecture/design to key business and IT stakeholders.
- Proficiency with Azure Pipeline, Azure Monitor, Redis Cache, Load Balancer, Application Gateway, Azure Functions, and Azure Data Factory integrations.
- Knowledge of microservices and API development.
- Excellent analytical and problem-solving skills.
- Familiarity with CI/CD tools such as Jenkins.
- Experience with NoSQL and document databases.