Provisioning paused: driver package failed validation
Proceso de aprovisionamiento
Cronología
-
Resuelto
Resolved at 18:02 UTC. Duration: 33 minutes. 4 orders were delivered late; each customer has been told, and the delay is added to their term.
-
En observación
Provisioning has resumed and the queue is clearing. Each affected node is being re-provisioned from scratch.
-
Causa identificada
The package was corrupted on our mirror during a sync. We have re-fetched it from the upstream source and its checksum matches.
-
Investigando
New provisioning is paused since 17:29 UTC: the NVIDIA driver package (580.65.06) failed its checksum validation on every node it was applied to. We stop rather than ship a machine with an unverified driver.
Revisión posterior al incidente ·
Qué ocurrió y qué cambió
Causa
A sync from the upstream driver mirror was interrupted and left a truncated 580.65.06 package with a stale checksum file, which our validation step then rejected on every node.
Impacto
Provisioning stopped for 33 minutes. 4 orders were delivered late. No machine was shipped with a bad driver.
Qué cambiamos
- Mirror syncs are now atomic: a package and its checksum are published together or not at all.
- The provisioning pipeline retries a validation failure against the upstream source before stopping.
Las horas se muestran en su zona horaria ().
Páginas relacionadas
- Estado del servicioEstado en vivo de gpuserver.io: componentes y centros de datos sondeados cada 60 s desde 5 ciudades, con disponibilidad de 90 días e incidentes desde 2022.
- Historial de incidentesTodos los incidentes y ventanas de mantenimiento de gpuserver.io desde septiembre de 2022, mes a mes, con cronología y revisión posterior al incidente.
- Acuerdo de nivel de servicioEl compromiso del 99,9 %: qué cuenta como inactividad, cómo se mide desde fuera, cinco minutos de plazo por cada minuto perdido, y las exclusiones completas.
- RedPuertos sin contador hasta 25 Gbit/s, dos operadores y un IX por sede, filtrado DDoS permanente, IPv6 enrutado — y las cuatro cosas que no ofrecemos, dichas ya.