Build trigger and webhooks delay (retrospective)

Incident report for DatoCMS

Resolved

Build triggers and webhooks are now being processed in two separate queues, so that they do not affect each other anymore.

Posted at Nov 24, 08:34 GMT+00:00

Identified

The source of the latency was traced down to an abnormal increase of webhook calls in that time frame.

Posted at Nov 24, 08:00 GMT+00:00

Investigating

Between 2021-11-23T21:30:00+00:00 and 2021-11-23T23:20:00+00:00 there was an high increase of latency in the queue that process build triggers and webhooks.

This means that deploys and webhooks took more time than usual to being triggered.

Posted at Nov 24, 07:20 GMT+00:00