Data Engineer

Green Fields Ltd is currently seeking a highly skilled and dedicated Data Engineer to join our team. The ideal candidate will be responsible for developing, testing, and maintaining architectures such as databases and large-scale processing systems. They will also be expected to improve upon the data ingestion processes through automation, streamlining data collection strategies, and implementing necessary APIs for real-time data collection.

The Data Engineer will be a crucial part of our team, working closely with other team members to address complex issues around data structure accessibility and utilization which can drive company strategy and make significant contributions to our growth and success.

Responsibilities:

• Develop, construct, test, and maintain data architectures.
• Design and implement data tools for analytics and data scientist team members to help them in building, optimizing, and implementing their data logics.
• Align architecture with business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
• Build data processing systems with a focus on scalability, performance, and reliability.
• Collaborate with data and analytics experts to strive for greater functionality in our data systems.

Qualifications:

• Bachelor’s degree in Computer Science, Engineering or related field, or equivalent work experience.
• A minimum of three years' experience in a similar role.
• In-depth understanding of database structure principles.
• Experience in data warehousing and data modeling.
• Proficient in SQL, NoSQL, data structures and algorithms.
• Hands-on experience with cloud services (AWS, Google Cloud, Azure).
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with Data Pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.

Benefits:

• Opportunity to work in a fast-paced, high-growth environment.
• Competitive benefits package, including health, dental and vision coverage.
• Generous vacation and holiday pay.
• Continuous learning and professional development opportunities.
• Company-sponsored team bonding activities and events.

We are looking for a candidate who is dedicated, focused and can bring a new level of expertise to our team. If you are passionate about quality data, and want to play a key role in shaping the decision-making processes of our company, then we would like to hear from you.