Senior Data Engineer AI & Agentic Systems

What You Will Do

• Own technical workstreams. Design and deliver machine learning, Generative AI and agentic/autonomous AI systems from architecture through production.


• Architect scalable data platforms. Build robust batch and streaming pipelines that are tuned for modern AI workloads.


• Integrate GenAI and agentic frameworks into client solutions. This covers RAG pipelines, embeddings, vector databases, context construction, prompt design and output handling.


• Design MLOps/LLMOps architectures for model management, observability, automated evaluation and retraining.


• Lead feature engineering on complex workstreams so that data assets are reliable, reusable and ready for AI.


• Govern and secure data. Implement access controls, PII/PHI handling, authentication and RBAC across cloud environments.


• Make sound engineering trade-offs between quality, latency and cost. Apply evaluation, reliability and guardrail practices to AI features.


• Mentor and raise the bar. Coach junior engineers and drive software engineering best practices across the team.


• Partner with clients and stakeholders. Turn business problems into technical solutions and help build client capabilities.

Must have

• A degree in Computer Science or Engineering, or equivalent experience


• 5+ years in data engineering, including leading technical workstreams and mentoring engineers


• Expert-level Python and SQL, plus comfort with Scala or Java when client systems need them


• Hands-on experience building Agentic AI, GenAI, ML and BI systems in production with frameworks such as Spark, Databricks, LangChain, Dask, Airflow, Dagster or Kedro


• Practical knowledge of RAG, embeddings, vector databases and prompt and context engineering


• Strong MLOps/LLMOps skills:
  
  
  
  • CI/CD for data workflows
  
  
  • Automated agent evaluation (LangSmith, Langfuse, Opik)
  
  
  • Infrastructure as code (Terraform)
  
  
  
  


• Experience on at least one major cloud (AWS, Azure or GCP); multi-cloud is a plus


• Proven experience with data security and governance (PII/PHI, authentication, RBAC)


• The ability to own workstreams on your own, with excellent time management


• Clear, confident written and verbal communication in English