Databricks Developer with Python

Job Description

• Years of Experience: 3 to 8 Years
  
• Role Type: Fixed Term Contract (6 Months)
  
• Payroll Organization: Talpro
  
• • CTC Offered:
  

• Exp Up to 5 Yrs -  ₹100,000 per month (Maximum Rate)
  
• Exp  5 Yrs + -  ₹1,50,000 per month (Maximum Rate)
  

• • Shift Timing: Day shift IST, from 12pm
  
• • Notice Period: Immediate Joiners Only
  
• • Work Location: Bangalore
  
• • Work Mode: Hybrid (3 Days from Office Weekly)
  
• Mandatory Skills:
  
• Databricks 
  
• SQL
  
• PySpark
  
• Python
  

Requirements

⸻

Mandatory Skills:

• • 5 years of hands-on experience as a Databricks / PySpark Developer
  
• • Strong Python programming skills
  
• • Proficient understanding of Apache Spark concepts (DataFrames, Spark SQL, MLlib)
  
• • Familiarity with cloud platforms (preferably Azure)
  
• • Hands-on with Azure Data Factory and other Azure services
  
• • Proficiency in SQL for ETL logic and Delta Lake
  
• • Strong experience in data pipeline design, ETL development, and Spark job optimization
  
• • Hands-on experience with GitLab and understanding of CI/CD pipelines, DevOps tools
  
• 
  

Good to Have Skills:

• • Exposure to data warehousing concepts and data modeling
  
• • Experience creating stored procedures, functions, tables, cursors
  
• • Knowledge of database testing, data comparison, and transformation scripting
  
• • Troubleshooting and performance profiling of database/server resources
  
• 
  

⸻

Role Overview / Job Summary:

We are looking for a skilled Databricks Developer with strong Python expertise to join our Data Engineering team in Bangalore. The ideal candidate will have solid experience building and optimizing large-scale data pipelines using Databricks and PySpark. You will be responsible for ETL design and development, data processing workflows, and ensuring best practices in data engineering within a hybrid work setup.

⸻

Key Responsibilities / Job Responsibilities:

• Design, develop, and deploy ETL processes on Databricks for data integration and transformation

• Build and optimize data pipelines, architectures, and datasets

• Implement and fine-tune Spark jobs, data transformations, and processing workflows

• Collaborate with data engineers, architects, and stakeholders to ensure efficient storage and processing

• Apply best practices for pipeline monitoring, logging, and error handling

• Work with Azure Data Factory and cloud services to deliver robust data solutions

• Engage in DevOps practices using GitLab and CI/CD pipelines

⸻

Additional Instructions:

• Immediate Joiners Preferred

• Candidates must be open to working onsite 1 to 3 days a week in Bangalore

• All mandatory skills must be clearly visible in the candidate’s CV for consideration