Job Responsibilities
- Support the review and analysis of the client’s end-to-end data infrastructure, with a focus on scalability, maintainability, and performance.
- Evaluate and optimize existing data pipelines and orchestration workflows, ensuring reliability and efficiency.
- Collaborate with architects and the Technical Product Manager to assess architecture decisions, contributing technical insights and implementation feasibility.
- Build proof-of-concept improvements to support enhanced observability and monitoring, including data lineage, logging, and alerting.
- Assist in evaluating the data governance and metadata management frameworks, identifying pain points in data quality and accessibility.
- Contribute to mapping and enhancing the analytics tooling landscape, ensuring proper integration across reporting and dashboard platforms.
- Work alongside AI/BI specialists to assess the organization’s data readiness for AI-driven analytics and agentic BI use cases.
- Partner with cross-functional teams including data scientists, platform engineers, and business stakeholders to ensure technical alignment and data usability.
- Participate in the development of strategic recommendations and implementation roadmaps, supporting technical documentation and delivery planning.
Basic Qualifications
- 4–6 years of hands-on experience as a Data Engineer or equivalent role within enterprise-scale data environments.
- Strong expertise in building and optimizing ETL/ELT pipelines using tools such as Apache Spark, Databricks, Airflow, dbt, or equivalent.
- Proficiency in working with cloud data platforms (e.g., AWS, Azure, GCP), including data lake and warehouse solutions.
- Experience with observability and monitoring tools such as Datadog, Prometheus, or OpenTelemetry.
- Solid understanding of data governance concepts, metadata cataloging, and quality frameworks.
- Familiarity with analytics and visualization tools such as Power BI, Tableau, or Looker.
- Strong problem-solving, documentation, and communication skills; able to explain technical topics to non-technical audiences.
Preferred Qualifications
- Exposure to agentic AI systems, LLM-powered analytics, or modern BI automation platforms.
- Experience working in regulated or enterprise client environments, particularly during digital transformation or modernization initiatives.
- Familiarity with version control (e.g., Git), CI/CD for data systems, and infrastructure-as-code practices.