Tech Lead - Databricks & Modern Data Stack

Tech Lead, Databricks &
Modern Data Stack

About the role

Creole Studios is launching a dedicated Data & AI
practice focused on the modern data stack, with Databricks as the anchor. The
target market is US mid -market companies that need data platforms that actually
work in production.

We are hiring our first Tech Lead for this practice. You
will be one of the first engineers on the ground, lead a small pod of data
engineers, and own technical delivery on our early client engagements.

This is a hands -on lead role. Roughly 60% deep technical
work (architecture, code, reviews), 30% team leadership (mentoring, planning,
quality), 10% client and pre -sales support.

Requirements

What you will do

Technical delivery

• Architect
  and build Databricks -based data platforms for US mid -market clients.
  
• Design
  and implement medallion architectures, Delta Lake pipelines, Unity Catalog
  governance, and Workflows -based orchestration.
  
• Write
  production PySpark and SQL. Yes, you will still be in the code.
  
• Set
  engineering standards: code quality, testing, CI/CD, IaC, monitoring.
  
• Own
  technical decisions on your projects. Architecture, tooling, trade -offs.
  

Team leadership

• Lead
  a pod of 3 to 5 data engineers across 1 to 2 client engagements.
  
• Run
  code reviews, design reviews, and weekly technical syncs.
  
• Mentor
  mid and junior engineers. Help them get certified.
  
• Interview
  and help hire engineers into your pod.
  

Client work

• Be
  the technical point of contact for client engineering teams.
  
• Run
  technical workshops, requirement -gathering sessions, and architecture
  reviews with client stakeholders.
  
• Translate
  business requirements into technical solutions.
  
• Support
  pre -sales: scoping calls, technical proposals, effort estimates. You will
  not own pre -sales, but you will be in the room.
  

Practice building

• Contribute
  to internal IP: reusable accelerators, reference architectures, demo
  assets.
  
• Help
  shape engineering standards and delivery playbooks for the practice.
  
• Co -author
  technical blog posts and case studies.
  

What you bring

Must have

• 6
  to 10 years in data engineering, with at least 3 years on Databricks
  or Spark at production scale.
  
• Strong
  PySpark and SQL. You can write, debug, and optimize Spark jobs without
  help.
  
• Databricks
  ecosystem fluency: Delta Lake, Unity Catalog, Workflows or DLT, MLflow
  basics. Databricks Certified Data Engineer Associate or Professional (or
  willing to get certified within 60 days of joining).
  
• One
  cloud at strong level, ideally AWS or Azure. Comfortable with IAM,
  networking basics, and Terraform or equivalent IaC.
  
• Modern
  data stack exposure beyond Databricks: Airflow, dbt, Fivetran, or
  similar.
  
• Prior
  lead or senior engineer experience. You have led at least one team of
  3+ engineers on a real project. You know how to run a code review, push
  back on bad design, and unblock a junior.
  
• Solid
  English, written and spoken. You will be on calls with US clients
  regularly.
  

Strong bonus

• Databricks
  Certified Data Engineer Professional or ML Associate.
  
• Experience
  working with US clients in a services or consulting setting.
  
• GenAI
  or LLM work on Databricks (Mosaic AI, vector search, RAG pipelines).
  
• DevOps
  fluency: CI/CD pipelines, Docker, Kubernetes, observability tooling.
  
• Open
  source contributions, technical writing, or conference talks.
  

What this role is not

• A
  pure individual contributor seat. You will lead people.
  
• A
  management -only role. You will still be in the codebase every week.
  
• A
  9 -to -5 with a fixed scope. Early -practice work is variable. Some weeks are
  heavy delivery, some are pre -sales support, some are internal R&D.
  

Benefits

What you get

• A
  leadership role in a brand new practice with room to grow into a Principal
  or Practice Lead position over 2 to 3 years.
  
• Direct
  working relationship with the founder. Decisions get made quickly.
  
• US
  client exposure from day one. Real platforms, real production scale.
  
• Strong
  compensation with a performance -linked component.
  
• Full
  sponsorship for Databricks certifications, cloud certifications, and
  relevant training.
  
• A
  small, senior team to work with. No bureaucracy. No legacy projects.
  

How to apply

Send the following to [careers email]:

1. A
   resume or LinkedIn profile.
   
2. A
   short note (5 to 10 lines) on the most complex Databricks or Spark problem
   you have solved and how you approached it.
   
3. Optional:
   links to GitHub, technical writing, or conference talks.
   

We will respond to every serious application within 5
working days.

Creole Studios is a 12 year old bootstrapped software
studio with offices in Ahmedabad and a US entity. We build custom software, AI
products, and data platforms for founders and operators globally.