Data Engineer

Duties and Responsibilities:

1. Contribute to the creation of a self-service data platform for reporting and analytics 


2. Knowledge for airflow or similar systems is must


3. Design and build data solutions using Databricks, SQL, Python, Spark, and Delta Lake in the Azure ecosystem (Blob Storage, Data Factory, Event Hubs) 


4. Adhere to best practices of ETL / ELT processes (data quality management, data processing, data partitioning, maintainability and reusability) 


5. Collaborate with engineers, product, and business leaders to ensure data platform is integrated with other systems and technologies (Tableau, Power BI, APIs, custom applications) 


6. Establish CI/CD processes, test frameworks, infrastructure-as-code tools, and monitoring/alerting (Git, Terraform, Azure DevOps / GitHub Actions / Jenkins, Azure Monitor / Datadog) 


7. Adhere to the Code of Conduct and be familiar with all compliance policies and procedures stored in LogixGarden relevant to this position 

Qualifications:

To perform this job successfully, an individual must be able to perform each duty satisfactorily. 

The requirements listed below are representative of the knowledge, skills, and/or ability required. Reasonable accommodation may be made to enable individuals with disabilities perform the duties. 

Education (Degrees, Certificates, Licenses, Etc.) 

BS (or higher, MS / PhD) degree in Computer Science / related field, or equivalent technical experience. 

 
Experience 

1.    5+ years of data engineering experience in modern cloud or big data environments

2.    Experience with MS-SQL Server, PostgreSQL, or MySQL

3.    Strong development experience in Python, Scala, or Java for data engineering workflows

4.    Hands-on experience with Databricks and third-party integrations like Delta Live Tables, Azure Synapse, Unity Catalog, and Airflow

5.    Experience working with cloud-based data services including Azure Data Factory, Blob Storage, and Event Hubs

6.    Exposure to data governance and compliance practices in healthcare or regulated domains is a plus

Specific Job Knowledge, Skill and Ability 

1.    Proficient in T-SQL development and query optimization

2.    Strong programming skills in Python or Scala, with working knowledge of Pandas, PySpark, or NumPy

3.    Experience with Databricks notebooks, Delta Lake, and managing metadata with Unity Catalog

4.    Working knowledge of Azure data services such as Synapse Analytics, Data Factory, and Event Hubs

5.    Familiarity with version control and CI/CD workflows using Git, Azure DevOps, or GitHub Actions

6.    Ability to keep security, maintainability, and scalability in mind with the solutions built

7.    Possess excellent interpersonal communication skills and an aptitude for continued learning