Elasticsearch (ELK) Engineer - Collaborative Environment

Position Overview:

We are seeking a skilled Elastic Engineer with over 5 years of experience to join our team. The ideal candidate will have a deep understanding of Elasticsearch architecture, configuration, and performance tuning. Additionally, they should possess strong scripting and automation skills, along with a solid grasp of security best practices for Elasticsearch clusters. The candidate should be proficient in Elasticsearch Query DSL and mapping, capable of creating advanced visualizations and dashboards in Kibana, and experienced in setting up monitoring and alerting in ELK (Elasticsearch, Logstash, Kibana) stack. Familiarity with Logstash Grok patterns, APM setup, integrating Mainframe/Corebanking logs into ELK, designing logging frameworks for applications, and knowledge of machine learning workflows in ELK are highly desirable.

Responsibilities:

1. Set up, configure, and optimize Elasticsearch architecture for performance and scalability.

2. Develop scripts and automation tools (Python, Bash) for efficient management and configuration of Elasticsearch.

3. Implement and enforce security best practices for Elasticsearch clusters.

4. Utilize Elasticsearch Query DSL and mapping to optimize search performance and data indexing.

5. Design and create advanced visualizations and dashboards in Kibana to provide insights into data.

6. Establish monitoring and alerting systems in the ELK stack to ensure system health and performance.

7. Employ Logstash Grok patterns and other filters to seamlessly integrate logs from third-party applications.

8. Configure and optimize APM (Application Performance Monitoring) setups.

9. Integrate Mainframe/Corebanking logs into ELK for comprehensive log management and analysis.

10. Design logging frameworks for applications to ensure consistent and structured logging practices.

11. Collaborate with data scientists to implement machine learning workflows in ELK for data analysis and anomaly detection.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or related field.
• 5+ years of experience as an Elastic Engineer or similar role.
• Proficiency in Elasticsearch architecture, configuration, and performance tuning.
• Strong scripting and automation skills with Python, Bash, or similar languages.
• In-depth understanding of security best practices for Elasticsearch clusters.
• Experience with Elasticsearch Query DSL and mapping.
• Demonstrated ability to create advanced visualizations and dashboards in Kibana.
• Familiarity with setting up monitoring and alerting systems in the ELK stack.
• Experience in Logstash Grok patterns and other filters for log integration.
• Knowledge of APM setup and configurations.
• Experience integrating Mainframe/Corebanking logs into ELK is a plus.
• Ability to design logging frameworks for applications.
• Understanding of machine learning workflows in ELK is advantageous.