Degraded workspace performance
Resolved·Degraded performance

All workspace starts now occur in the *41 and *41xl clusters. We think the issue is resolved.

Fri, Apr 22, 2022, 02:05 AM
(3 years ago)
·
Affected components
[PAYG] Workspaces
Updates

Resolved

All workspace starts now occur in the *41 and *41xl clusters. We think the issue is resolved.

Fri, Apr 22, 2022, 02:05 AM

Monitoring

All workspace starts for XL clusters are entirely running on *41xl. 50% of workspace starts for other clusters land on *41, which also contains the fix for performance degradation.

Thu, Apr 21, 2022, 07:45 PM(6 hours earlier)

Monitoring

We've received positive feedback from customers who were previously experiencing issues. Additionally, metrics look promising, too. We've increased the traffic shift for XL clusters to 50%.

Thu, Apr 21, 2022, 12:30 PM(7 hours earlier)

Monitoring

We've deployed a fix for workspaces that run in XL clusters.

25% of new XL workspaces will start on *41xl, which include a fix for this issue: https://github.com/gitpod-io/gitpod/issues/9406

Thu, Apr 21, 2022, 12:23 AM(12 hours earlier)

Identified

We've identified a likely suspect and are testing multiple fixes internally.

Wed, Apr 20, 2022, 07:15 PM(5 hours earlier)

Investigating

Customers have reported that workspaces which were previously running well now have performance issues. We are inspecting recent changes to the system, and are running internal tests.

Wed, Apr 20, 2022, 01:45 PM(5 hours earlier)