Data Engineer #IAC

Responsibilities

• Design, develop, and maintain scalable data pipelines and infrastructure to support data processing, transformation, and analysis.
• Collaborate with data scientists and analysts to understand data requirements and ensure efficient data flow and accessibility.
• Implement data models and schemas to organize and structure large volumes of data for optimal storage and retrieval.
• Ensure data quality and integrity through data validation, cleansing, and enrichment processes.
• Optimize data processing workflows for performance and efficiency, leveraging distributed computing technologies.
• Troubleshoot and resolve issues related to data pipelines, ensuring uninterrupted data flow and availability.
• Implement and maintain data security and compliance measures to protect sensitive data.
• Stay updated on emerging technologies and best practices in data engineering to drive continuous improvement and innovation.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Provide technical guidance and support to junior team members, fostering their growth and development.
• Any other ad-hoc duties as assigned by supervisor.

Requirements

• Bachelor's degree in Computer Science or a related field.
• Demonstrated experience in developing and implementing data pipelines and ETL processes.
• Experience with end-to-end machine learning initiatives, including data preprocessing, feature engineering, and model deployment.
• Proficiency in programming languages such as Python, Java, or C++.
• Experience with machine learning frameworks/libraries such as Scikit-learn, TensorFlow, and PyTorch.
• Familiarity with big data technologies including Hadoop and Spark for distributed data processing.
• Proficient in working with relational databases like MySQL and NoSQL databases like MongoDB.
• Knowledge of cloud computing platforms, particularly Amazon Web Services (AWS).
• Experience with version control systems such as Git/GitHub.

Interested applicants, please email your resume to Andre Chua Jing Ming

Email: [email protected]

CEI Reg No: R1989053

EA Licence No: 99C4599

Recruit Express Pte Ltd