Processing of metrics data is delayed across a number of insights features
Incident Report for Apollo Graph, Inc.
Resolved
This incident has been resolved.
Posted Mar 08, 2022 - 18:53 PST
Monitoring
We are monitoring ingestion progress as lag continues to decline. Some features (e.g. traces) have already recovered completely.
Posted Mar 08, 2022 - 16:51 PST
Update
A fix has been rolled out and metrics ingestion is actively starting to catch up to near real time.
Posted Mar 08, 2022 - 16:47 PST
Identified
We have identified the underlying issue and are currently working on a solution to catch up on metrics ingestion.
Posted Mar 08, 2022 - 16:38 PST
Investigating
We are aware of an issue that is affecting timely processing of incoming metrics data. The lag is currently around 1 hour and there is no data loss in ingestion. The lag is consistently growing at the moment, and we are investigating ways to mitigate. The experimental performance alerts feature is currently receiving no data.
Posted Mar 08, 2022 - 16:18 PST
This incident affected: Notifications and Studio Metrics Dashboard.