API USA overload, elevated errors
Resolved
Mar 19 at 10:24am PDT
We experience an unusually high volume of API calls in USA that over-running current scaling, causing some API calls to fail. Investigation and remediation on the way.
12:12PM MST - Systems have stabilized. We are still heavily engaged in monitoring and root causing the issue. More details as we have them. We are not considering this incident over just yet.
6:28PM - Systems have been stable for some time now. Root cause was issues that arose from migration of a backend system. Issues resolved.
Affected services
API USA Telemetry Ingestion
API USA InsightAPI USA Insight
API USA External Telemetry
API USA Cloud Adapters
API USA Services
API USA Enrollment
API USA Management
API USA Modules
API USA Directory