Senior Specialist: Data Engineer

Your responsibilities will include: Performance Monitoring and Optimization: Continuously monitor and optimize the performance of data pipelines, applications, and services. Architecture Design: Define the architecture for data pipelines, edge applications, and microservices to ensure scalability and reliability. Technical Proficiency: Strong skills in programming languages such as Python, Java, or Scala Big Data Technologies: Expertise in tools like Spark, Hive, parquet, iceberg, etc. Database Management: Proficiency with both relational & NoSQL databases (e.g., MongoDB, CassandraDB) Cloud Computing: Experience with cloud platforms like AWS/GCP, including services for data storage and processing. Containerization & Microservices: Knowledge of containerization technologies (e.g., Docker, Kubernetes) and microservices architecture, particularly in OpenShift, AWS ECS and GCP GKE environments API Management: Experience with API gateways like Nginx and developing APIs for real-time data access Distributed Systems: In-depth understanding of distributed computing principles and technologies Data Engineering: Knowledge of data pipeline design, ETL processes, and data integration Security and Compliance: Familiarity with data security practices and regulatory compliance requirements Performance Optimization: Techniques for monitoring and optimizing the performance of data systems and applications Edge Computing: Understanding of edge computing concepts and technologies for processing data closer to the source Hands-On Experience: Several years of experience in software engineering, data engineering, or cloud engineering roles Project Management: Experience managing complex projects, preferably in a big data or cloud environment. Team Collaboration: Proven ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders Problem-Solving: Strong analytical and problem-solving skills, with a track record of addressing complex technical challenges Continuous Learning: Commitment to staying updated with the latest technologies and best practices in the field