Target - Data Engineer - Scala/Spark/Hadoop

Job Description :As a Data Engineer / Senior Data Engineer you serve as a specialist in the engineering team that supports the product. You help develop and gain insight in the application architecture. You can distill an abstract architecture into concrete design and influence the implementation. You show expertise in applying the appropriate software engineering patterns to build robust and scalable systems. You are an expert in programming and apply your skills in developing the product. You have the skills to design and implement the architecture on your own, but choose to influence your fellow engineers by proposing software designs, providing feedback on software designs and/or implementation. You show good problem solving skills and can help the team in triaging operational issues. You leverage your expertise in eliminating repeat occurrences. Use your skills, experience and talents to be a part of groundbreaking thinking and visionary goals. As a Sr. Engineer, you'll take the lead as you.Role : Use your technology acumen to apply and maintain knowledge of current and emerging technologies within specialized area(s) of the technology domain. Evaluate new technologies and participate in decision-making, accounting for several factors such as viability within Target's technical environment, maintainability, and cost of ownership. Initiate and execute research and proof-of-concept activities for new technologies. Manage total product, financials and forecasting. Lead the design, lifecycle management, and total cost of ownership of services. Lead and conduct code review, design review, testing, and debugging activities at the application level. Lead functional design and architecture discussions with understanding of process flows and system diagrams to enable design decisions. Participate in routine and non-routine construction, automation, and implementation activities, ensuring successful implementation with architectural and operational requirements and best practices met. Provide technical oversight and coach others to resolve complex and severe technical issues. Lead disaster recovery activities and contribute to disaster recovery planning. Embed data quality protocols throughout data acquisition, processing, storage, and operational use.Core responsibilities of this job are described within this job description. Job duties may change at any time due to business needs.About you :4 year degree or equivalent experience2+ Years of software development experienceDemonstrates strong domain-specific knowledge regarding Target's technology capabilities, and key competitors' products and differentiating featuresWorking knowledge on package-specific configuration and deployment along with ability to build custom solutionsHave experience in building Data Pipelines using Scala, Spark, Hadoop, HiveQL etc.Have experience with streaming frameworks such as Kafka.Have experience with Data Warehousing, Data Modelling and Data Profiling.Designs new testing methods and resolves routine and non-routine technical issues with minimal assistanceDemonstrates strong proficiency in core development platforms within own domainBuilds strong commitment within the team to support the appropriate team prioritiesClearly communicates Agile concepts to partners within product teamDemonstrates a solid understanding of the impact of own work on the team and/or guestsWrites and organizes code using multiple computer languages, including distributed programming and understand different frameworks and paradigmDelivers high-performance, scalable, repeatable, and secure deliverables with broad impact (high throughput and low latency)Influences and applies data standards, policies, and proceduresMaintains technical knowledge within areas of expertiseStays current with new and evolving technologies via formal training and self-directed education (ref:hirist.tech)