Resolved -
The issue has been resolved, and the team will continue working on restoring the missing events.
Mar 6, 18:05 UTC
Monitoring -
We have successfully implemented a fix for the webhook payload issue.
New events are now being delivered with correct content again. To expedite the resolution, events were rerouted to a new table, which means historical events from before 13:31 UTC are temporarily unavailable while we work on restoring them.
We're actively monitoring the system and continuing restoration efforts, though our preliminary assessment indicates that data from the affected time period (11:20 UTC - 13:31 UTC) may not be completely recoverable.
Mar 6, 13:31 UTC
Update -
We have identified an issue causing corrupted webhook payloads for a subset of users.
Due to a database limitation where a foreign key column hit its maximum value, webhooks may contain corrupted metadata fields, including malformed data like '*mac.com' instead of correct information.
Our team is actively working on a fix, and we'll keep you updated on our progress.
Mar 6, 13:27 UTC
Identified -
We’re currently experiencing an issue affecting webhook deliveries in the US region. Some webhooks may fail or contain invalid data. Our team has identified the cause and is actively working on a fix. Updates will follow as more information becomes available.
Mar 6, 13:10 UTC