We are seeking a highly skilled Senior SRE Engineer to lead our ‘Monitoring and observability’ development and operations. In this role, you will scale, and maintain our core monitoring infrastructure and will bridge the gap between development and operations by implementing robust automation and managing production-grade infrastructure. Additionally, you will champion system reliability by enabling a world-class observability stack built on Prometheus and Grafana.
Key Responsibilities
- Collaborate with engineering to architect, scale, and optimize global monitoring infrastructure using Prometheus (handling PromQL optimization, metric cardinality, and custom exporters) and create advanced, actionable visualizations in Grafana.
- Own the health of monitoring by scaling and tuning Prometheus for metrics collection and designing advanced, actionable dashboards in Grafana.
- Collaborate with product and software engineering teams to define, track, and enforce Service Level Indicators (SLIs), Service Level Objectives (SLOs), and Error Budgets.
- Design high-signal alerting rules that filter out noise, reduce alert fatigue, and directly map to user-facing degradation. Participate in a sustainable on-call rotation.
- Lead technical response during critical production incidents. Facilitate Root Cause Analysis (RCA) and track corrective actions to build permanent engineering safeguards against recurrence.
- Identify operational pain points and eliminate repetitive manual tasks by building robust internal automation tools and scripts.
- Maintain and ensure the high availability of foundational monitoring infrastructure.
- Conduct system load testing, capacity planning, and architectural reviews to predict and prevent performance bottlenecks before they impact customers.
- Introduce controlled failures into testing and production environments to validate system resilience and failover automation.
- Manage, scale, and optimize production-grade Kubernetes clusters ensuring high availability, optimal resource allocation, and strict security compliance.
- Drive infrastructure predictability by managing continuous deployment and environment syncs.
- Design, maintain, and dry-run declarative cloud structures using modern configuration management platforms (e.g., Ansible) and template tools (e.g., Helm charts) to guarantee environment parity.
Candidate Profile & Requirements
Required Skills & Qualifications
- 8-10 years of hands-on experience in DevOps and Site Reliability Engineering roles.
- Expert-level knowledge of Prometheus (PromQL, alerting rules, exporters) and Grafana (dashboard creation, data source integration, alerting).
- Deep operational expertise with Docker, GKE, and AKS.
- Strong proficiency in Terraform, alongside the ability to write automation tools
- understanding of Linux systems internals and multi-cloud networking concepts (VPC peering, Azure VNets, VPN Gateways, DNS, Load Balancing).
- Experience implementing GitOps workflows (e.g., ArgoCD or Flux).
- Familiarity with log aggregation stacks that pair with Grafana (like Loki or Elasticsearch)
Preferred Qualifications
- Proven, production-level experience managing cloud infrastructure esp. GCP and Azure
- Relevant certifications, such as Google Cloud Professional Cloud DevOps Engineer, Microsoft Certified: Azure DevOps Engineer Expert, or Certified Kubernetes Administrator (CKA).
About Everseen
Our Culture