Lead Engineer

L1/L2 Support & Monitoring: Monitor Snowflake workloads, Airflow DAGs, and IICS ETL jobs, ensuring smooth execution. Troubleshoot data pipeline failures, performance bottlenecks, and job scheduling issues. Provide L1/L2-level support by analyzing logs, errors, and resolving real-time data ingestion issues. Perform incident management and root cause analysis (RCA) for recurring issues. Data Pipeline & ETL Support: Assist in maintaining and optimizing Snowflake data warehouse performance. Support ETL workflows in Informatica IICS, ensuring data integrity and transformation accuracy. Handle Apache Airflow job scheduling, orchestration, and task dependencies. Work on data validation, troubleshooting missing or incorrect records, and implementing fixes. Security, Maintenance & Documentation: Ensure data security, access control, and role-based permissions in Snowflake. Assist in managing data backup, retention policies, and performance tuning. Maintain detailed runbooks, support documentation, and troubleshooting guides for issue resolution. Collaborate with data engineers and developers to enhance system reliability. 3+ years of experience in Data Engineering Support or ETL Support. Strong understanding of Snowflake architecture, SQL queries, and performance tuning. Hands-on experience in Apache Airflow DAG monitoring and troubleshooting. Knowledge of Informatica IICS (Cloud Data Integration, task flows, and error handling). Basic understanding of Python or SQL scripting for debugging data issues. Experience in data warehousing concepts, ETL workflows, and cloud platforms (AWS/Azure/GCP). Strong analytical and problem-solving skills for resolving data-related issues. Exposure to CI/CD pipelines for data deployment. Knowledge of cloud storage (S3, ADLS, or GCS) and API-based data integrations. Familiarity with Git for version control and JIRA for ticket tracking."