ROLE OVERVIEW
We are seeking an experienced DevOps Engineer with strong data platform and SRE expertise to drive the
design, implementation, and operational excellence of a modern client Data Platform.
In this high-impact position, you will bridge the gap between infrastructure automation and modern data
architecture. You will lead technical initiatives covering automated provisioning on Microsoft Azure,
orchestrating scalable enterprise data workflows via Astronomer and dbt, and establishing robust
continuous integration/continuous delivery (CI/CD) practices for all data engineering workloads.
PRIMARY RESPONSIBILITIES
Infrastructure as Code: Design, implement, and deploy ARM templates for automated Azure infrastructure
provisioning and environment lifecycle management.
Azure Service Provisioning: Configure and maintain scalable Azure services, including Azure Functions, Event Bus,
and Event Grid for event-driven data flows.
Snowflake Architecture & Security: Create and manage enterprise Snowflake accounts. Maintain role-based
access control (RBAC), virtual warehouses, security policies, and performance tuning.
Workflow Orchestration: Deploy, configure, and operate Astronomer (Apache Airflow) for production-grade
orchestration and scheduling of data pipelines.
dbt Pipeline Automation: Automate deployment pipelines for dbt projects, ensuring strict code quality standards,
modularity, test coverage, and continuous delivery.
Secrets & Security Governance: Centralize and secure credential management using Azure Key Vault (AKV) for
safe DevOps automation and runtime access across environments.
Secure File Transport: Architect and set up SFTP ingestion workflows utilizing a Bastion Host, ensuring secure
landing into Azure Blob Storage containers.
CI/CD Engineering: Build, maintain, and optimize robust CI/CD deployment pipelines (e.g., Azure Repos /
Pipelines) tailored for data engineering workloads.
Platform Observability: Monitor overall system health, data pipeline reliability, and platform performance using
enterprise observability tooling (e.g., Prometheus, Grafana).
Integration Management: Establish seamlessly integrated ecosystems connecting Snowflake with upstream and
downstream systems, specifically dbt and Astronomer.
Architectural Collaboration: Partner closely with Data Engineers, Data Architects, and enterprise stakeholders to
define infrastructure deployment standards, operational SLAs, and reliability targets.
Technical Documentation: Author and maintain comprehensive technical documentation covering infrastructure
designs, CI/CD procedures, runbooks, and DevOps best practices.
Your email job alert is now active!