Identity Services increased Response Time
Incident window: February 19, 2024 07:38 UTC - 08:33 UTCImpacted Cloud services:
Foundry Identity Service
Foundry Identity Services Response Time increased in US-East Virginia region.
Impact Level : high
Identity Services is being investigated.
[2024-02-19 07:38 UTC] Foundry Identity Services Response Time increased. This could have impacted customers who are using MT identity from Virginia region.
[2024-02-19 8:33 UTC] The services Response time came back normal and it is running healthy.
[2024-02-19 08:34 UTC] The services have been continuing to perform within normal parameters. We are continuing our investigation to identify the root cause.
Root Cause Analysis:
An automatic minor version update was applied to the identity database in the Virginia region. This update caused response delays at the database layer, leading to increased overall application response times.
Timelines:
[2024-02-19 07:38 UTC] Auto minor version upgrade triggered.
[2024-02-19 07:38 UTC] Excessive latency for Identity services in the Virigina region.
[2024-02-19 07:58 UTC] Auto Minor version upgrade completed.
[2024-02-19 08:10 UTC] Latency averages have improved to 20 seconds, but still impacting most APIs.
[2024-02-19 08:20 UTC] Latency averages have improved to 15 seconds, but still impacting most APIs.
[2024-02-19 08:33 UTC] Latency averages have returned to normal. Resolved and Identity services in the Virginia region are responding normally.