Python, PySpark, Glue Developer

Min 3+ year of hands of experience of working on Python, PySpark and AWS Glue technologies.
• Strong programming skills in PySpark or Python
• Proven experience as a Python Developer
• Strong knowledge of Python programming language and its libraries/frameworks
• Experience of working on AWS Glue
• Experience of working on SQL
• Experience of Mainframe is an advantage.
• Experience with ETL (Extract, Transform, Load) processes.
• Knowledge of AWS (Amazon Web Services) for cloud-based development
• Familiarity with server administration is a plus
• Must have experience in AWS S3, EC2, DynamoDB, SNS, SQS, CloudWatch, Lambda
• Experience using DevOps, version controlling tools and repositories (Maven, Jenkins, Git, svn, Attunity, Bit bucket, Bamboo etc.)
• Must have hands on experience in CI/CD pipelines, SQL
• In this role, you will work a major project related to the development
• Develop scalable code and endpoints for processing very large datasets using
• Python, SQL, and AWS tools. Previous experience with Pyspark is a plus.
• Consider how to enable distributed computing and scalable run-time processing, using AWS resources and CI/CD best practices. Previous experience with OpenSearch, FastAPI, Docker, Airflow, and Terraform a plus.
• Understand the business implications and customer journey for the project you will lead and make sure what you create provides those business goals.
• Writing complex parallel streams and filters to refine the data for effectively handling the client search.
• Design, develop and provide guidance on implementation.
• Support production environment