Data Engineer - AA

Company Description Beyondsoft (listed by the Shenzhen Stock Exchange, stock code 002649) is a global provider of IT consulting, product and solution services. Relying on strong R&D and innovation capabilities, the company widely adopts emerging technologies based on big data and mobile internet, including big data management platform, enterprise risk warning and public opinion monitoring system, AI-based intelligent operation and maintenance service, and intelligent automated test products. And a wide range of products and solutions, including internationally authoritative software testing qualification training, for a wide range of services in the fields of high technology, internet, finance, retail, logistics, energy, manufacturing, and medical. For more information, please visit Responsibilities

• Design, build, and maintain scalable data pipelines and ETL processes.
• Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
• Optimize and tune data processing systems for performance and efficiency.
• Implement and manage data storage solutions, ensuring data integrity and security.
• Develop and maintain documentation for data engineering processes and systems.
• Stay updated with emerging technologies and industry trends to continuously improve data engineering practices.

QUALIFICATIONS

• Bachelor's Degree in Computer Science or related field.
• Minimum 2 years of experience in data engineering.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Hands-on experience with Data Warehousing solutions.
• Extensive knowledge of databases and Big Data platforms, including but not limited to SQL, NoSQL, Hadoop, and Spark.
• Solid understanding of analytics software and tools.
• Basic understanding of machine learning concepts.
• Experience with Azure Technologies, including Azure Data Bricks, Azure Data Factory, Azure Data Lake, Azure SQL, and Power BI.
• Familiarity with Azure Logic Apps, Azure Functions, and Azure Log Analytics is a plus.

Azure Sql, Azure Data Lake, Python, Machine Learning, Scala, Data Warehousing, Azure Data Factory, Power Bi, Nosql, Sql, Azure Logic Apps, Azure Functions, Java, Azure Data Bricks, Spark, Azure Log Analytics, Hadoop