Resolved
The upstream issue has been resolved and all systems are operational.As always, we appreciate your patience throughout this incident.
Monitoring
The upstream issue has been resolved and all systems are operational.As always, we appreciate your patience throughout this incident.
Monitoring
While we have not seen a resolution on Google's side (again, see https://status.cloud.google.com/incidents/6PM5mNd43NbMqjCZ5REh) we have had a long stretch of success and normal usage on our end. As such, we are closing this out.
Thanks all!
Monitoring
We are seeing enough time between things returning and our overall health. We will be leaving this StatusPage up till the below underlying Google Status resolves, or 30 mins go by, whichever comes first.
We appreciate your patience in this, and our support team would like to extend some serious #hugops to the folks at GCP.
https://status.cloud.google.com/incidents/6PM5mNd43NbMqjCZ5REh
Monitoring
Seeing success rate returning and bytes flowing. Monitors are resolving. We will update again in 15 mins most.
Identified
We have identified that our core issues are coming from our primary Cloud Provider, GCP, being down. We are starting to see some successes and bytes returning to our pipelines, however we are holding off on saying we're out of the woods just yet.
Please check back in about 15 minutes for more updates.
Investigating
We are currently investigating what appears to be a major outage with our Cloud Provider. We will update again in 15 minutes.