Due to a storage issue on Microsoft Azure a few Aspex Azure servers experienced degraded performance for a time this morning. The issue has been resolved and all servers are performing normally.
Storage - West Europe - Mitigated
Summary of Impact: Between 23:20 UTC on 21 Oct 2019 and 04:32 UTC on 22 Oct 2019, a subset of customers using Storage in West Europe may have experienced difficulties connecting to resources hosted in this region.
Preliminary Root Cause: Engineers determined that an inconsistency within an internal system state caused a single storage scale unit in West Europe to enter an unhealthy state which resulted in downstream availability impact to several services in the region.
Mitigation: Engineers developed, tested, and deployed a platform hotfix to correct the inconsistency, restoring dependent services and mitigating the issue.
Next Steps: Engineers will continue to investigate to establish the full root cause and prevent future occurrences, and the full Root Cause Analysis will be made available within 72 hours. Stay informed about Azure service issues by creating customer service health alerts: https://aka.ms/ash-videos
for video tutorials and https://aka.ms/ash-alerts
for how-to documentation.