All workspace starts now occur in the *41 and *41xl clusters. We think the issue is resolved.
Posted Apr 22, 2022 - 02:05 UTC
Update
All workspace starts for XL clusters are entirely running on *41xl. 50% of workspace starts for other clusters land on *41, which also contains the fix for performance degradation.
Posted Apr 21, 2022 - 19:45 UTC
Update
We've received positive feedback from customers who were previously experiencing issues. Additionally, metrics look promising, too. We've increased the traffic shift for XL clusters to 50%.
Posted Apr 21, 2022 - 12:30 UTC
Monitoring
We've deployed a fix for workspaces that run in XL clusters.
We've identified a likely suspect and are testing multiple fixes internally.
Posted Apr 20, 2022 - 19:15 UTC
Investigating
Customers have reported that workspaces which were previously running well now have performance issues. We are inspecting recent changes to the system, and are running internal tests.