Data Engineer

Title: Data Engineer

Location: Torrance CA (Day 1 Onsite)

Job Description:

Responsibilities
Design develop and maintain robust and scalable data pipelines for extracting transforming
and loading data from various sources including databases and streaming platforms.
Collaborate with data scientists analysts and other stakeholders to understand data
requirements and translate them into technical specifications.
Resolve complex data integration platform related issues. Coordinate with vendors for product
related issues patches bug fixes and upgrades.
Implement data governance best practices to ensure data quality consistency and security
throughout the data lifecycle.
Document data pipelines and technical specifications to facilitate knowledge sharing and
collaboration among team members.
Collaborate with appropriate stakeholders on defining and implementing technology
direction/roadmap within data integration technology space.
Optimize data pipelines for performance scalability and reliability using techniques such as
parallel processing caching and error handling.
Meet with application teams to understand requirements and recommend highlevel direction
and approach to upcoming projects.
Administer Data Integration product platforms including running periodic backups and
performing deployments.
Participate in code reviews agile ceremonies and crossfunctional meetings to contribute to the
overall success of the team and the organization.

Required Work Experience:
Bachelors degree in computer science information technology or a related field.
5 years of experience in data engineering database design ETL processes and data
warehousing.
3 years of experience with AWS tools and technologies (S3 EMR Glue Athena RedShift).
3 years of experience in programming languages such as Python Java or Scala.
Strong knowledge of data storage and processing technologies including databases (SQL and
NoSQL) data lakes and distributed computing frameworks (e.g. Hadoop Spark).
Strong knowledge with one or more Database platforms (DB2 SQL Server Postgres).
Solid understanding of data security privacy and compliance.
Excellent problemsolving and communication skills.
Ability to work collaboratively in crossfunctional teams.
Attention to detail and a commitment to data quality.
Continuous learning mindset to keep up with evolving technologies and best practices in data
engineering