Resolved -
Relevant GCP services have all been marked healthy again on google's status page. Considering this incident resolved.
Jun 12, 16:34 PDT
Update -
A large spike in request processing caused by Google BigQuery service recovery caused some requests to hang in our service. To mitigate, we have added more resources to our infrastructure to handle the follow on load as Google Cloud services continue their recovery process.
Jun 12, 13:26 PDT
Monitoring -
We are seeing authentication to Omni returning to a functioning state in some cases. We are continuing to monitor.
Jun 12, 11:57 PDT
Update -
We are seeing authentication to Omni returning to a functioning state in some cases. We are continuing to monitor.
Jun 12, 11:56 PDT
Update -
Updating the last impact statement: All authentication methods to Omni including external embedding are affected by the upstream services we use from Google Cloud.
Jun 12, 11:48 PDT
Identified -
Customers using Google for authentication into Omni will not be able to access their environment until Google's service is restored. Additionally, some customers connecting Google BigQuery to Omni have reported their queries returning errors which are also stemming from the broader Google Cloud services interruptions.
Jun 12, 11:38 PDT
Investigating -
Our alerts have detected issues with authentication and multiple customer have reported being unable to log in to Omni while active sessions appear to be functioning as normal. We are actively investigating, including any links to broader reports of issues in related cloud services that Omni integrates with.
Jun 12, 11:23 PDT