Provisioning paused: driver package failed validation
开通流程
时间线
-
已解决
Resolved at 18:02 UTC. Duration: 33 minutes. 4 orders were delivered late; each customer has been told, and the delay is added to their term.
-
观察中
Provisioning has resumed and the queue is clearing. Each affected node is being re-provisioned from scratch.
-
已确定原因
The package was corrupted on our mirror during a sync. We have re-fetched it from the upstream source and its checksum matches.
-
调查中
New provisioning is paused since 17:29 UTC: the NVIDIA driver package (580.65.06) failed its checksum validation on every node it was applied to. We stop rather than ship a machine with an unverified driver.
事故复盘 ·
发生了什么,改变了什么
原因
A sync from the upstream driver mirror was interrupted and left a truncated 580.65.06 package with a stale checksum file, which our validation step then rejected on every node.
影响
Provisioning stopped for 33 minutes. 4 orders were delivered late. No machine was shipped with a bad driver.
我们改变了什么
- Mirror syncs are now atomic: a package and its checksum are published together or not at all.
- The provisioning pipeline retries a validation failure against the upstream source before stopping.
时间以您所在时区()显示。