Data Engineer

We are once again working with an exciting organization, they are looking for a Data Engineer to join their team.  Your responsibilities will involve maintaining and enhancing the Registry’s data acquisition, integration, and ETL pipelines in support of both operational and business intelligence data stores. The incumbent is responsible for applying diverse data cleansing and transformation techniques as well as the ongoing management and monitoring of all Registry databases. This includes addressing issues pertaining to the ongoing operations and optimization of the data environment including performance, reliability, logging, scalability, etc. This position will also provide support for the companies database systems, warehouse, marts, and supporting applications.

Your will also lead the efforts to develop a unified enterprise data model for the organization. Design, develop, and maintain high-performance data platforms on premise and in Microsoft Azure cloud-based environments including leading the development of a data warehouse environment to support the Registry’s business intelligence roadmap. Champion efforts that will ensure that the organizations business intelligence applications remain relevant for use by internal business groups by actively participating in strategy and project planning discussions. You will work collaboratively with Registry participants and internal support teams, identify and implement changes that improve system performance and the user experience.

You will design, develop, and maintain the ETL pipelines using SSIS that standardize raw data from multiple data sources and optimize both the operational and dimensional/star schema data model necessary for transactional systems and business intelligence applications. Gather business and functional requirements and translate these requirements into robust, scalable, operable solutions aligning to an overall data architecture. Extract, transform, and load data to and from various data sources including relational databases, NoSQL databases, web services, and flat files. Produce various technical documents such as ER diagrams, table schemas, data lineage, API documents, etc.

Provide leadership and oversight on database architectural design for existing systems including database administration, performance monitoring, and troubleshooting. Provide complex analysis, conceptualize, design, implement, and develop solutions for critical data-centric projects. Perform data flow, system and data analysis, and develop meaningful and useful presentation of data in downstream applications. Plan and implement standards, define/code conformed global and reusable objects, perform complex database design and data repository modeling.

Monitor ETL processes, system audits, dashboard reporting, and presentation layer functioning and performance. Proactively identify and implement procedures that resolve performance and/or data reporting issues. Support the optimal performance of the organization’s data and BI systems. Monitor database performance, provide optimization recommendations, and implement recommendations. Follow the release cycles and implement on-time delivery of task assignments, defect correction, change requests, and enhancements. Troubleshoot and solve technical problems. Perform other responsibilities as assignment by management.

Requirements

• Relevant work experience in a data engineering role leveraging SQL, SSIS; including design and support of ETL routines that support the import of data from multiple data sources
  


• Data warehousing experience including the design, development, and ongoing support of star or snowflake data schemas to support business intelligence applications
  


• Database administration or database development experience in a SQL or MySQL environment; knowledge of Microsoft technology stack; background in Azure Infrastructure as a Service environment desired
  


• Experience working with both structured and unstructured data
  


• Demonstrated understanding of Business Intelligence and data solutions including cubes, data warehouse, data marts, and supporting schema types (star, snowflake, etc.)
  


• Data modeling experience in building logical and physical data models
  


• Applied knowledge of Microsoft Security/Authentication Concepts (Active Directory, IIS, Windows OS)
  


• Strong technical planning skills with the ability to prioritize and multitask across a number of work streams
  


• Polished presentation skills; experience creating and presenting findings to executive level staff
  


• Strong written, verbal and interpersonal communication skills, with an ability to communicate ideas and solutions effectively
  


• Must be highly collaborative with the ability to manage and motivate project teams and meet deliverables
  


• Ability to build strong stakeholder relationships and translate complex technical concepts to non-technical stakeholders
  


• Knowledge of SSRS or PowerBI is a plus