Lead Data Engineer

Job Description

Essential Skills & Experience

• Strong expertise in designing and implementing large-scale data engineering solutions and distributed data processing systems.


• Advanced proficiency with Databricks, Apache Spark, Delta Lake, SQL, Hadoop and Python.


• Experience building and operating cloud-based data platforms on Azure, AWS, or GCP.


• Expertise developing enterprise-grade ETL/ELT pipelines, streaming architectures, and data integration frameworks.


• Strong understanding of data modeling techniques for analytical and operational workloads.


• Experience implementing data quality frameworks, lineage, metadata management, and governance practices.


• Experience with Data formats ( Parquet, Avro, ORC )


• Working knowledge of CI/CD pipelines, infrastructure-as-code, automated testing, and DevOps practices.


• Experience with Workflow orchestration Tools like Airflow


• Strong understanding of security, privacy, and compliance requirements associated with sensitive financial and customer data.


• Knowledge of Java Based application development is a huge Plus.


• Lead by influence across engineering, product, risk, analytics, and architecture teams to align priorities and deliver measurable business outcomes.


• Develop engineering talent through mentoring, knowledge sharing, design guidance, and constructive feedback.


• Bachelor's degree or alternative minimum of 10 years of experience in a related field.