Senior Data Engineer with Expertise in Databricks

Are you a Data Engineer with a passion for building seamless data pipelines and driving innovation in cloud-based data environments? Do you excel at transforming raw data into valuable insights, leveraging tools like Azure Databricks or Azure Data Factory? We are looking for a Senior Data Engineer to support our client, a large Swiss Insurance company. If you’re ready to tackle complex challenges and make an impact in the world of modern data platforms, we’d love to connect with you! 

Responsibilities 

• Azure Cloud Architecture & Engineering  
  You are adept at working with Azure / Databricks environments, such as Azure Data Factory, Azure Synapse, and Azure Databricks. Your solutions prioritize scalability, reliability, and efficiency. 

• Data Pipeline Development 
  Design, build, and maintain end-to-end data pipelines using Databricks Python Notebooks, ensuring efficient and reliable data transformation processes. 

• Databricks Expertise 
  Leverage Databricks to perform advanced data processing, enabling seamless integration with data lakes and warehouses while optimizing Spark-based workflows and managing data access by using Unity Catalog.  

• Scalable and Reliable Solutions 
  Architect scalable, cloud-native solutions that meet modern data integration and transformation needs while maintaining data quality and governance standards. 

• CI/CD for Cloud Platforms 
  You bring expertise in working with CI/CD pipelines with tools such as Azure DevOps or Gitlab, ensuring streamlined code deployment and system updates while maintaining robust security and compliance practices. 

• Performance Optimization 
  You excel in monitoring and fine-tuning pipeline performance to ensure optimal functionality for both operational and analytical workloads. 

• Cross-Team Collaboration 
  Work closely with data analysts, scientists, and stakeholders to ensure the data architecture aligns with business objectives and analytical needs. 

What we Value 

The Basics 

• Bachelor's degree in computer science, Data Engineering, or a related field 

• 5+ years of experience in data engineering or related roles 

• Hands-on experience with Azure Data Factory and Databricks / Unity Catalog

• Deep understanding in the creation of pipelines with Databricks Notebooks (PySpark / SparkSQL)

• Familiarity with Spark optimization techniques 

• Understanding the CI/CD principles and working in such an environment 

• Familiarity with PowerBI is a plus 

• Proficiency in English (German is a bonus) 
   

• Innovative Problem-Solving 
  You enjoy tackling complex data challenges and devising efficient solutions that deliver real value. 

• Adaptability and Curiosity 
  You stay up to date with the latest tools, technologies, and best practices in cloud-based data engineering. 

• Detail-Oriented and Quality-Focused 
  You have a sharp eye for detail and are committed to maintaining high standards for data quality and integrity. 

• Team-Oriented Mindset 
  You thrive in collaborative environments, encouraging diverse perspectives, and fostering a culture of innovation and shared success. 

• Insurance Industry  
  It would be great if you had tangible experience in the insurance industry working with Enterprise clients.  

If this sounds like your dream role, we want to hear from you! Join our community of elite data professionals and take the first step toward your next exciting career chapter.