Apollo Generally Unavailable
Incident Report for Apollo
Resolved
The upstream issue has been resolved and all systems are operational.
As always, we appreciate your patience throughout this incident.
Posted Nov 16, 2021 - 14:01 PST
Update
The upstream issue has been resolved and all systems are operational.
As always, we appreciate your patience throughout this incident.
Posted Nov 16, 2021 - 14:00 PST
Update
While we have not seen a resolution on Google's side (again, see https://status.cloud.google.com/incidents/6PM5mNd43NbMqjCZ5REh) we have had a long stretch of success and normal usage on our end. As such, we are closing this out.

Thanks all!
Posted Nov 16, 2021 - 11:00 PST
Update
We are seeing enough time between things returning and our overall health. We will be leaving this StatusPage up till the below underlying Google Status resolves, or 30 mins go by, whichever comes first.

We appreciate your patience in this, and our support team would like to extend some serious #hugops to the folks at GCP.

https://status.cloud.google.com/incidents/6PM5mNd43NbMqjCZ5REh
Posted Nov 16, 2021 - 10:29 PST
Monitoring
Seeing success rate returning and bytes flowing. Monitors are resolving. We will update again in 15 mins most.
Posted Nov 16, 2021 - 10:17 PST
Identified
We have identified that our core issues are coming from our primary Cloud Provider, GCP, being down. We are starting to see some successes and bytes returning to our pipelines, however we are holding off on saying we're out of the woods just yet.

Please check back in about 15 minutes for more updates.
Posted Nov 16, 2021 - 10:11 PST
Investigating
We are currently investigating what appears to be a major outage with our Cloud Provider. We will update again in 15 minutes.
Posted Nov 16, 2021 - 09:55 PST
This incident affected: Uplink, Metrics Ingestion, Schema Publishing, Schema Checks, GraphQL API, Studio Metrics Dashboard, and Studio UI.