Skip to content

Preflight GPU Tests #115

Preflight GPU Tests

Preflight GPU Tests #115

Triggered via schedule September 29, 2024 00:48
Status Failure
Total duration 19m 6s
Artifacts 1

preflight_gpu.yml

on: schedule
Matrix: preflight-gpu-tests
Fit to window
Zoom out
Zoom in

Annotations

21 errors and 50 warnings
preflight-gpu-tests (a100-40gb, 20, 5)
Process completed with exit code 1.
preflight-gpu-tests (l40s, 20, 5)
Process completed with exit code 1.
flyctl error
could not destroy machine 185e751a122208: failed to destroy VM 185e751a122208: request returned non-2xx status, 408 (Request ID: 01J8XMRKG3DQV1V1J6R9T2J6DJ-iad)
preflight-gpu-tests (a100-40gb, 20, 1)
Process completed with exit code 1.
preflight-gpu-tests (l40s, 20, 19)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎Your machine was created, but never started. This could mean that your app is taking a long time to start,⏎but it could be indicative of a region issue.
preflight-gpu-tests (l40s, 20, 9)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎The machine e286602ec676d8 took more than 5m0s to reach "started"
preflight-gpu-tests (l40s, 20, 12)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎Your machine was created, but never started. This could mean that your app is taking a long time to start,⏎but it could be indicative of a region issue.
preflight-gpu-tests (l40s, 20, 7)
Process completed with exit code 1.
preflight-gpu-tests (a100-40gb, 20, 6)
Process completed with exit code 1.
flyctl error
release command failed - aborting deployment. error finding the release_command machine 3d8d7321c17668 exit event: timeout reached waiting for health checks to pass for machine 3d8d7321c17668: failed to get VM 3d8d7321c17668: Get "https://api.machines.dev/v1/apps/preflight-pf-gpu-gha-a4a7f7c2-2024-09-h66xfhaz/machines/3d8d7321c17668": net/http: request canceled
preflight-gpu-tests (l40s, 20, 8)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎The machine e28661e0f70e78 took more than 5m0s to reach "started"
flyctl error
could not destroy machine 28714d9a633418: failed to destroy VM 28714d9a633418: request returned non-2xx status, 408 (Request ID: 01J8XN0PNX787R16PDSXXJS57R-sjc)
preflight-gpu-tests (l40s, 20, 1)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎Your machine was created, but never started. This could mean that your app is taking a long time to start,⏎but it could be indicative of a region issue.
preflight-gpu-tests (l40s, 20, 6)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎Your machine was created, but never started. This could mean that your app is taking a long time to start,⏎but it could be indicative of a region issue.
preflight-gpu-tests (l40s, 20, 2)
Process completed with exit code 1.
build
You are using 'latest' as default version. Will lock to '~> v1'.
build
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 18)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 15)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 18)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 15)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 10)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 16)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 16)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 10)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 17)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 3)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 3)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 14)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 0)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 11)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 0)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 14)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 9)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 11)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 4)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 4)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 17)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 17)
Failed to download action 'https://api.github.com/repos/actions/setup-go/tarball/0a12ed9d6a96ab950c8f026ed9f722fe0da7ef32'. Error: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
preflight-gpu-tests (a100-40gb, 20, 17)
Back off 24.342 seconds before retry.
preflight-gpu-tests (a100-40gb, 20, 17)
Failed to download action 'https://api.github.com/repos/actions/setup-go/tarball/0a12ed9d6a96ab950c8f026ed9f722fe0da7ef32'. Error: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
preflight-gpu-tests (a100-40gb, 20, 17)
Back off 18.004 seconds before retry.
preflight-gpu-tests (a100-40gb, 20, 5)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 5)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 7)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 1)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 13)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 19)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 8)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 12)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 13)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 19)
Failed to download action 'https://api.github.com/repos/actions/setup-go/tarball/0a12ed9d6a96ab950c8f026ed9f722fe0da7ef32'. Error: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
preflight-gpu-tests (l40s, 20, 19)
Back off 24.75 seconds before retry.
preflight-gpu-tests (l40s, 20, 19)
Failed to download action 'https://api.github.com/repos/actions/setup-go/tarball/0a12ed9d6a96ab950c8f026ed9f722fe0da7ef32'. Error: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
preflight-gpu-tests (l40s, 20, 19)
Back off 10.782 seconds before retry.
preflight-gpu-tests (l40s, 20, 19)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 9)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 12)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 7)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 6)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 8)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 1)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 6)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 2)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 2)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2

Artifacts

Produced during runtime
Name Size
flyctl
39.4 MB