Correlation & Root Cause

Alerts that fired together, collapsed into one incident with a probable cause and the evidence behind it
Raw alerts (24h)

1,904

+212
Correlated incidents

46

97.6% reduction
Open incidents

7

2 critical
Mean time to RCA

6m

-4m

INC-4821 · Checkout failures across three services

Correlated from 34 alerts spanning 11 minutes

Signal timeline
14:02:10

payments-db replication lag 14.8sdatabase · orders (MySQL 8.0) — first signal

14:03:44

checkout-api p99 latency 4.2sapi · 22 alerts collapsed

14:05:02

AWS API Gateway 5xx rate 6.1%gateway · api-prod-us-east-1

14:13:20

Replication recovered, latency normalauto-resolved

Probable root cause
Replication lag on orders0.86 confidence

The orders replica fell behind during a bulk backfill. Checkout reads served from the replica timed out, and the gateway surfaced them as 5xx. Latency and error rate both recovered within 90s of replication catching up.

Evidence
  • Lag rose before any API alert fired
  • Backfill jobnightly-customer-loadoverlapped the window
  • No deploy, config change, or scaling event in the window
  • Recovery order matched the failure order in reverse

Alert clusters

Near-identical alerts collapsed by message template — open a brief to hand one to a coding agent

ClusterSeverityAlertsServicesLast seenStatus
Connection pool exhausted on <host>

clu-sample-1

critical86checkout-api, orders-db14:11:02firing
Upstream timeout after <ms>ms

clu-sample-2

warning41gateway-edge14:09:37firing
Talend job <job> exited non-zero

clu-sample-3

warning12etl-nightly13:58:14resolved
Cache miss ratio above <pct>%

clu-sample-4

info9search-api13:44:51resolved

No matching results

Correlated incidents

Alerts grouped by shared service, time proximity, and dependency edges in the service graph

IncidentRoot causeAlertsServicesDurationStatus
Checkout failures

INC-4821

DB replication lag34311mResolved
Partner API timeouts

INC-4819

Upstream vendor outage5822h 14mOpen
Nightly load failure

INC-4816

Talend engine OOM12146mOpen
AI gateway throttling

INC-4812

Provider rate limit27238mResolved
Search latency spike

INC-4808

Cache eviction storm19222mResolved
Identity 5xx burst

INC-4803

Cert rotation restart916mResolved
Ledger freshness miss

INC-4799

dbt run queued behind backfill713h 02mOpen
Stage deploy noise

INC-4791

Rolling restart104614mSuppressed

No matching results

LoveHeartBeat - A Product from RootVyana.

v1.24.0

Theme Customizer

Explore different styles according to your preferences

Color Scheme
RTL

Change text direction

Support Chat

Toggle support chat

Navigation Type
Vertical Navbar Appearance
Horizontal Navbar Shape
Horizontal Navbar Appearance
Purchase template
customize