Some workspaces won't start in the EU

Incident Report for Gitpod

Resolved

Workspaces in EU have been starting normally. And we think the issue is over.
Posted Dec 05, 2022 - 15:43 UTC

Update

We switched the LB back to EU. Waiting for the change to take effect.
Posted Dec 05, 2022 - 14:48 UTC

Monitoring

We switched the load balancer to US, it could cause higher latencies and loading times for EU users as a side-effect. We're monitoring and working through the problem.
Posted Dec 05, 2022 - 14:27 UTC

Update

After further investigation, we've found that the root issue is with GCP network/image registries.
Posted Dec 05, 2022 - 14:04 UTC

Identified

We've identified that a single bad node, we're working on fixing it.
Posted Dec 05, 2022 - 13:53 UTC

Investigating

We've identified poor workspace performance in the EU region. We're investigating the issue.
Posted Dec 05, 2022 - 13:46 UTC
This incident affected: [PAYG] Workspaces and [PAYG] Image Builds.