Senior / Lead Data Engineer

JOB SUMMARY

We are looking for a talented and experienced Lead Data Engineer to join our innovative team. The Lead Data Engineer will play a critical role in leading the design, development, and maintenance of our data infrastructure, pipelines, and analytical tools. The ideal candidate will have a strong technical background in data engineering, expertise in analytical tools, and proven leadership skills to mentor and guide a team of data engineers.

JOB DUTIES

• Lead the design, development, and implementation of scalable and efficient data pipelines, databases, and data infrastructure.
• Mentor, coach, and guide a team of data engineers, providing technical leadership and support.
• Collaborate with data scientists, product managers, and business stakeholders to understand data requirements, facilitate data-driven decision-making, and deliver actionable insights.
• Optimize database schemas, tables, and queries to support data storage, retrieval, and analysis.
• Integrate and optimize analytical tools such as Tableau, Power BI, or Looker to enable advanced data analysis, visualization, and reporting capabilities.
• Develop and enforce data engineering best practices, standards, and guidelines to ensure the quality, performance, and reliability of our data solutions.
• Implement ETL processes to integrate data from various sources, ensuring data quality, consistency, and integrity.
• Optimize data pipelines, queries, and infrastructure for performance, scalability, and cost-efficiency.
• Monitor and troubleshoot data pipelines and infrastructure issues, and provide timely resolutions.
• Stay up-to-date with the latest data engineering technologies, analytical tools, and best practices, and drive their adoption within the team.
• Ensure data security, compliance with data governance and privacy regulations, and adherence to analytical tool licensing agreements.
• Work closely with cross-functional teams to identify data needs and requirements, and deliver data solutions that meet business objectives.
• Document data pipelines, processes, and best practices, and contribute to the development of data engineering documentation and standards.
• Stay up-to-date with the latest data engineering technologies, tools, and best practices, and recommend their adoption as appropriate.

JOB REQUIREMENTS

• Bachelor’s degree in Computer Science, Information Systems, or equivalent work experience.
• 6+ years of experience in data engineering, with at least 3 years in a lead or senior engineering role.
• Proven leadership skills with experience in mentoring, coaching, and guiding a team of data engineers.
• Strong technical background in designing and implementing data pipelines, databases, and analytical tools.
• Proficiency in programming languages commonly used in data engineering such as Python, Java.
• Hands-on experience with big data technologies and frameworks such as Hadoop, Spark, Kafka, and Hive.
• Hands-on experience with analytical tools such as Tableau, Power BI, Looker, or similar platforms.
• Solid understanding of relational and NoSQL databases, and experience with database design, optimization, and SQL querying.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
• Experience with real-time data processing and streaming technologies (e.g., Apache Flink, Kafka Streams).
• Excellent analytical and reasoning skills with an ability to anticipate outcomes of a solution.
• Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
• Strong sense of responsibility, initiative, and commitment.
• Self-motivated, proactive, and able to work independently with minimal supervision.
• Knowledge of data governance, data security, and compliance standards and best practices.
• Maintain confidentiality of information processed or prepared.
• Ability to lead, convince and inspire team members in a fast-paced environment.
• Willingness to travel to meet and work with offshore team members.
• Fluency in written and spoken English and Mandarin is highly desirable to liaise with Chinese speaking clients and counterparts.