The new elasticsearch cluster is handling traffic as expected, all metrics continue to be within healthy ranges. We're marking this incident as solved.
Posted Feb 23, 2018 - 19:14 UTC
Monitoring
A new Elasticsearch cluster has been deployed and all data and traffic has been moved there. Log ingestion rate is back to normal, as the rest of our database metrics. Queries to the logs endpoints and dashboard log listings are showing the last results.
Posted Feb 22, 2018 - 22:23 UTC
Identified
The Elastic Search cluster we use in the EU environment to index account logs to enable their search is ingesting slow at a slow rate. The database has reached a large state size, which is making all operations either slow or fail.
No data has been lost.
Our team is working on creating a new clean cluster, but it might take some time to resolve this. In the meantime, queries to the logs endpoints and dashboard log listings will show outdated results.
Posted Feb 20, 2018 - 21:19 UTC
Investigating
Our tenant logs index processing pipeline is running behind. Queries to the Search API will return stale results until the system is caught up. We will post an update with an ETA as soon as possible.
Posted Feb 20, 2018 - 13:03 UTC
This incident affected: Auth0 Europe (PROD) (Management API) and Auth0 Europe (PREVIEW) (Management API).