Incidents history
January 2024 to November 2023
January 2024
No incidents reported.
December 2023
No incidents reported.
November 2023
Rendering errors on some assets
From 4 AM UTC to 11 AM UTC, a subset of assets stored on DatoCMS experienced unresponsiveness, returning 404 errors. The impact was limited, with less than 1% of total assets being affected. We have identified and addressed the root cause, and all affected assets are now functioning correctly.
We will continue to monitor the situation closely to ensure the sustained stability of DatoCMS. If you have any lingering concerns or notice any issues, please reach out to our support team for further assistance.
Errors on CMA and CDA requests
The upstream DNS provider marks the issue as full resolved.
High response times on CMA and CDA - Admin interface not loading
This incident was caused by a customer with a large user base using a private plugin that went rogue.
The plugin started making a lot of API calls and since the user base of this customer is very large the entire platform was hit by a DDoS. This caused generic slow downs as the requests were authenticated as users and were hitting directly our web servers.
To avoid this from happening again we have added rate-limitations to JWT tokens, that are used by plugins acting as users, something that we didn't anticipate before.
High error rate on admin interface
A code change in the CMS conflicted with some plugins which made the user-interface unusable.
This didn't affect the APIs and only records that used certain plugins.
As soon as we got notified we issued a fix in the CMS. Unfortunately opening to third-party plugins opens to the possibility of complex scenarios that we haven't thought about. We have learnt something new from this incident and we'll try to prevent these issues from happening again in the future.