Production Observability: Prometheus & Grafana Monitoring for EKS

Observability in distributed Kubernetes environments requires real-time metrics scraping, alert routing, and visual dashboarding to resolve incidents before users are impacted.

**TL;DR:** Deploy Prometheus Operator via Helm, monitor Golden Signals across all pods, and route operational alerts using Alertmanager.

---

PromQL High Latency Alert Rule Blueprint

groups:
  - name: api-slas
    rules:
      - alert: APIHighLatency
        expr: histogram_quantile(0.99, sum(rate(http_request_duration_seconds_bucket[5m])) by (le)) > 0.5
        for: 2m
        labels:
          severity: critical
        annotations:
          summary: "API 99th percentile latency exceeds 500ms SLA"