Resolved -
The backlog affecting inventory processing in the EU production environment has been fully cleared.
Processing has returned to expected levels, and all services are functioning as expected.
Mar 19, 17:13 PDT
Update -
Progress continues on infrastructure improvements to restore normal processing performance. The primary cluster upgrade has now been completed, and backlog reduction is ongoing.
Additional capacity has been brought online, and workload is being redistributed to further accelerate backlog clearance.
We will continue to monitor progress closely and provide further updates as processing performance improves.
Mar 19, 08:44 PDT
Update -
Progress continues on the infrastructure improvements to restore normal processing performance. The primary cluster upgrade is now majorly complete and is beginning to gradually reduce the existing backlog.
Our teams have taken additional actions to further accelerate backlog clearance and improve overall processing times.
We will continue to provide updates as performance continues to improve.
Mar 18, 23:24 PDT
Monitoring -
The infrastructure upgrade to improve inventory normalization performance is currently in progress. At this time, the system is able to handle incoming data at the expected rate; however, the existing backlog is still being processed.
We continue to closely monitor progress as the upgrade completes and additional improvements take effect.
Mar 18, 22:31 PDT
Identified -
Incident Description: Our teams have identified and are actively investigating an issue impacting inventory processing in the EU production environment. While ITV platform remain accessible, some customers may experience delays in processing newly uploaded inventory, and status pages may intermittently show timeouts during the normalization stage.
Priority: P2
Restoration Activity: Our teams have identified resource constraints within the database cluster and are currently upgrading the capacity to improve throughput. Our teams continue to monitor the environment closely while these mitigation actions are in progress.
Mar 18, 19:20 PDT