On 2026-03-13, 461 sales orders from Spain were not sent to Gains. These have been resent and will be available in Gains 2026-03-15 (start of office hours.)
The process that aggregates order header and lines failed to process one batch of order lines. The orders in the failed batch were all dead-lettered, and an alarm was triggered.
The root cause of the failure to process the batch is not clear after investigation. Threading and behavior under load are covered by automated tests, and a code review found no issues.
Given this is an isolated occurrence across millions of weekly transactions, no further remediation is planned at this time beyond continued monitoring.
We have deployed an update to how we handle process shutdown of related worker processes. A plausible root-cause is a race-condition when we scale workers down. We will continue to monitor the situation.