2026-03-13 15:04:38,959 [INFO] RTX 4090: 47 offers available 2026-03-13 15:04:39,426 [INFO] RTX 3090: 47 offers available 2026-03-13 15:04:39,780 [INFO] RTX 3090 Ti: 7 offers available 2026-03-13 15:04:40,090 [INFO] L40S: 4 offers available 2026-03-13 15:04:40,419 [INFO] L40: 5 offers available 2026-03-13 15:04:40,765 [INFO] RTX 4080: 5 offers available 2026-03-13 15:04:41,158 [INFO] RTX 4080S: 14 offers available 2026-03-13 15:04:41,501 [INFO] RTX A6000: 9 offers available 2026-03-13 15:04:41,881 [INFO] RTX A5000: 19 offers available 2026-03-13 15:04:41,881 [INFO] Provisioning 30 instances (8 at a time)... 2026-03-13 15:04:42,810 [INFO] Created instance 32798085: RTX 4090 @ $0.162/hr (BS=4) 2026-03-13 15:04:42,820 [INFO] Created instance 32798089: RTX 4090 @ $0.201/hr (BS=4) 2026-03-13 15:04:42,823 [INFO] Created instance 32798086: RTX 4090 @ $0.169/hr (BS=4) 2026-03-13 15:04:42,880 [INFO] Created instance 32798088: L40S @ $0.601/hr (BS=8) 2026-03-13 15:04:42,888 [INFO] Created instance 32798091: L40S @ $0.468/hr (BS=8) 2026-03-13 15:04:42,910 [INFO] Created instance 32798090: L40S @ $0.604/hr (BS=8) 2026-03-13 15:04:42,916 [INFO] Created instance 32798087: RTX 4090 @ $0.189/hr (BS=4) 2026-03-13 15:04:42,926 [INFO] Created instance 32798092: L40S @ $0.601/hr (BS=8) 2026-03-13 15:04:43,344 [INFO] Instance 32798085: pending [0s] 2026-03-13 15:04:43,352 [INFO] Instance 32798086: pending [0s] 2026-03-13 15:04:43,385 [INFO] Instance 32798089: pending [0s] 2026-03-13 15:04:43,561 [INFO] Instance 32798088: pending [0s] 2026-03-13 15:04:43,563 [INFO] Instance 32798091: pending [0s] 2026-03-13 15:04:43,586 [INFO] Instance 32798090: pending [0s] 2026-03-13 15:04:43,602 [INFO] Instance 32798087: pending [0s] 2026-03-13 15:04:43,626 [INFO] Instance 32798092: pending [0s] 2026-03-13 15:04:58,710 [INFO] Instance 32798085: loading [15s] 2026-03-13 15:04:58,712 [INFO] Instance 32798086: pending [15s] 2026-03-13 15:04:58,724 [INFO] Instance 32798089: loading [15s] 2026-03-13 15:04:59,006 [INFO] Instance 32798091: loading [16s] 2026-03-13 15:04:59,015 [INFO] Instance 32798088: loading [16s] Removing login credentials for https://index.docker.io/v1/ 2026-03-13 15:04:59,058 [INFO] Instance 32798092: loading [16s] 2026-03-13 15:04:59,090 [INFO] Instance 32798087: pending [16s] 2026-03-13 15:04:59,104 [INFO] Instance 32798090: loading [16s] latest: Pulling from bharathkumar192/codecbench-sft 2026-03-13 15:05:14,117 [INFO] Instance 32798085: loading [31s] 808d41145975: Verifying Checksum 808d41145975: Download complete 2026-03-13 15:05:14,132 [INFO] Instance 32798089 running at ssh5.vast.ai:38088 — onstart worker auto-launching 2026-03-13 15:05:14,153 [INFO] Instance 32798086: pending [31s] 2026-03-13 15:05:14,319 [INFO] Instance 32798088: loading [31s] WARNING! Your credentials are stored unencrypted in 'configs/C.32798088/config. 2026-03-13 15:05:14,357 [INFO] Instance 32798091: loading [31s] WARNING! Your credentials are stored unencrypted in 'configs/C.32798091/config. 2026-03-13 15:05:14,412 [INFO] Instance 32798092: loading [31s] Removing login credentials for https://index.docker.io/v1/ 2026-03-13 15:05:14,531 [INFO] Instance 32798087: pending [31s] 2026-03-13 15:05:14,564 [INFO] Instance 32798090 running at ssh9.vast.ai:38090 — onstart worker auto-launching 2026-03-13 15:05:15,057 [INFO] Created instance 32798105: RTX 4090 @ $0.202/hr (BS=4) 2026-03-13 15:05:15,368 [INFO] Instance 32798105: pending [0s] 2026-03-13 15:05:15,476 [INFO] Created instance 32798102: RTX 4090 @ $0.202/hr (BS=4) 2026-03-13 15:05:15,770 [INFO] Instance 32798102: pending [0s] 2026-03-13 15:05:29,451 [INFO] Instance 32798085: loading [46s] 8a62ad9335d7: Pull complete 2026-03-13 15:05:29,458 [INFO] Instance 32798086: pending [46s] 2026-03-13 15:05:29,631 [INFO] Instance 32798088 running at ssh5.vast.ai:38088 — onstart worker auto-launching 2026-03-13 15:05:29,702 [INFO] Instance 32798091: loading [46s] 0f48b7ff7db5: Download complete 2026-03-13 15:05:29,737 [INFO] Instance 32798092: loading [46s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:05:29,849 [INFO] Instance 32798087: pending [46s] 2026-03-13 15:05:30,258 [INFO] Created instance 32798108: RTX 4090 @ $0.207/hr (BS=4) 2026-03-13 15:05:30,572 [INFO] Instance 32798108: pending [0s] 2026-03-13 15:05:30,709 [INFO] Instance 32798105: loading [15s] docker --config=configs/C.32798105 pull 'bharathkumar192/codecbench-sft:latest' 2026-03-13 15:05:31,111 [INFO] Instance 32798102: pending [15s] 2026-03-13 15:05:44,812 [INFO] Instance 32798085: loading [61s] 8a62ad9335d7: Pull complete 2026-03-13 15:05:44,815 [INFO] Instance 32798086: pending [61s] 2026-03-13 15:05:45,029 [INFO] Instance 32798091: loading [62s] 8a62ad9335d7: Pull complete 2026-03-13 15:05:45,052 [INFO] Instance 32798092: loading [62s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:05:45,152 [INFO] Instance 32798087: pending [62s] 2026-03-13 15:05:45,950 [INFO] Instance 32798108: loading [15s] 2026-03-13 15:05:46,002 [INFO] Instance 32798105: loading [30s] docker --config=configs/C.32798105 pull 'bharathkumar192/codecbench-sft:latest' 2026-03-13 15:05:46,436 [INFO] Instance 32798102: loading [30s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:06:00,238 [INFO] Instance 32798086: pending [77s] 2026-03-13 15:06:00,244 [INFO] Instance 32798085: loading [77s] 8a62ad9335d7: Pull complete 2026-03-13 15:06:00,345 [INFO] Instance 32798091: loading [77s] 8a62ad9335d7: Pull complete 2026-03-13 15:06:00,389 [INFO] Instance 32798092: loading [77s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:06:00,444 [INFO] Instance 32798087: pending [77s] 2026-03-13 15:06:01,393 [INFO] Instance 32798108: loading [31s] 2a5ee6fadd42: Download complete 2026-03-13 15:06:01,413 [ERROR] Instance 32798105 failed: offline / docker --config=configs/C.32798105 pull 'bharathkumar192/codecbench-sft:latest' 2>&1 2026-03-13 15:06:03,933 [INFO] Destroyed instance 32798105 2026-03-13 15:06:04,174 [INFO] Instance 32798102 running at ssh2.vast.ai:38102 — onstart worker auto-launching 2026-03-13 15:06:06,527 [INFO] Created instance 32798130: RTX 4090 @ $0.213/hr (BS=4) 2026-03-13 15:06:06,829 [INFO] Created instance 32798131: RTX 4090 @ $0.214/hr (BS=4) 2026-03-13 15:06:07,420 [INFO] Instance 32798130: pending [0s] 2026-03-13 15:06:07,692 [INFO] Instance 32798131: pending [0s] 2026-03-13 15:06:15,617 [INFO] Instance 32798086: pending [92s] 2026-03-13 15:06:15,627 [INFO] Instance 32798085: loading [92s] 8a62ad9335d7: Pull complete 2026-03-13 15:06:15,697 [INFO] Instance 32798092: loading [92s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:06:15,707 [INFO] Instance 32798091: loading [92s] 8a62ad9335d7: Pull complete 2026-03-13 15:06:15,780 [INFO] Instance 32798087: pending [92s] 2026-03-13 15:06:16,746 [INFO] Instance 32798108: loading [46s] 8a62ad9335d7: Download complete 2026-03-13 15:06:22,756 [INFO] Instance 32798130: pending [16s] 2026-03-13 15:06:23,001 [INFO] Instance 32798131: pending [16s] 2026-03-13 15:06:30,990 [INFO] Instance 32798086: pending [108s] 2026-03-13 15:06:30,993 [INFO] Instance 32798085: loading [108s] 8a62ad9335d7: Pull complete 2026-03-13 15:06:31,096 [INFO] Instance 32798091: loading [108s] 8a62ad9335d7: Pull complete 2026-03-13 15:06:31,111 [INFO] Instance 32798092: loading [108s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:06:31,140 [INFO] Instance 32798087: pending [108s] 2026-03-13 15:06:32,092 [INFO] Instance 32798108: loading [61s] 8a62ad9335d7: Download complete 2026-03-13 15:06:38,119 [INFO] Instance 32798130: loading [31s] 8a62ad9335d7: Pull complete 2026-03-13 15:06:38,306 [INFO] Instance 32798131: pending [31s] 2026-03-13 15:06:46,322 [INFO] Instance 32798086: pending [123s] 2026-03-13 15:06:46,344 [INFO] Instance 32798085: loading [123s] 8a62ad9335d7: Pull complete 2026-03-13 15:06:46,447 [INFO] Instance 32798091: loading [123s] 8a62ad9335d7: Pull complete 2026-03-13 15:06:46,501 [INFO] Instance 32798092: loading [123s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:06:46,507 [INFO] Instance 32798087: pending [123s] 2026-03-13 15:06:47,407 [INFO] Instance 32798108: loading [77s] 8a62ad9335d7: Download complete 2026-03-13 15:06:53,429 [INFO] Instance 32798130: loading [46s] 8a62ad9335d7: Pull complete 2026-03-13 15:06:53,621 [INFO] Instance 32798131: pending [46s] 2026-03-13 15:07:01,728 [INFO] Instance 32798085: loading [138s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:07:01,744 [INFO] Instance 32798086: pending [138s] 2026-03-13 15:07:01,839 [INFO] Instance 32798091: loading [138s] 8a62ad9335d7: Pull complete 2026-03-13 15:07:02,056 [INFO] Instance 32798087: pending [139s] 2026-03-13 15:07:02,088 [INFO] Instance 32798092: loading [139s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:07:02,830 [INFO] Instance 32798108: loading [92s] 8a62ad9335d7: Download complete 2026-03-13 15:07:08,786 [INFO] Instance 32798130: loading [62s] 8a62ad9335d7: Pull complete 2026-03-13 15:07:08,935 [INFO] Instance 32798131: pending [62s] 2026-03-13 15:07:17,125 [INFO] Instance 32798085: loading [154s] #0 building with "default" instance using docker driver #1 [internal] load buil 2026-03-13 15:07:17,148 [INFO] Instance 32798086: pending [154s] 2026-03-13 15:07:17,183 [INFO] Instance 32798091: loading [154s] 8a62ad9335d7: Pull complete 2026-03-13 15:07:17,384 [INFO] Instance 32798087: pending [154s] 2026-03-13 15:07:17,448 [INFO] Instance 32798092: loading [154s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:07:18,125 [INFO] Instance 32798108: loading [107s] 8a62ad9335d7: Download complete 2026-03-13 15:07:24,143 [INFO] Instance 32798130: loading [77s] 8a62ad9335d7: Pull complete 2026-03-13 15:07:24,265 [INFO] Instance 32798131: pending [77s] 2026-03-13 15:07:32,448 [INFO] Instance 32798086: pending [169s] 2026-03-13 15:07:32,468 [INFO] Instance 32798085: loading [169s] #6 13.29 Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Pack 2026-03-13 15:07:32,576 [INFO] Instance 32798091: loading [169s] 8a62ad9335d7: Pull complete 2026-03-13 15:07:32,708 [INFO] Instance 32798087: pending [169s] 2026-03-13 15:07:32,772 [INFO] Instance 32798092: loading [169s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:07:33,479 [INFO] Instance 32798108: loading [123s] bfce1374bac7: Download complete 2026-03-13 15:07:39,487 [INFO] Instance 32798130: loading [92s] 8a62ad9335d7: Pull complete 2026-03-13 15:07:39,648 [INFO] Instance 32798131: pending [92s] 2026-03-13 15:07:47,774 [INFO] Instance 32798086: pending [184s] 2026-03-13 15:07:47,819 [INFO] Instance 32798085: loading [185s] #6 25.00 Get:14 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd6 2026-03-13 15:07:47,908 [INFO] Instance 32798091: loading [185s] 8a62ad9335d7: Pull complete 2026-03-13 15:07:48,068 [INFO] Instance 32798092: loading [185s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:07:48,164 [INFO] Instance 32798087: pending [185s] 2026-03-13 15:07:48,779 [INFO] Instance 32798108: loading [138s] 7d61afc7a3ac: Pull complete 2026-03-13 15:07:54,841 [INFO] Instance 32798130: loading [108s] 8a62ad9335d7: Pull complete 2026-03-13 15:07:54,992 [INFO] Instance 32798131: pending [108s] 2026-03-13 15:08:03,214 [INFO] Instance 32798086: pending [200s] 2026-03-13 15:08:03,266 [INFO] Instance 32798085: loading [200s] #6 25.00 Get:14 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd6 2026-03-13 15:08:03,284 [INFO] Instance 32798091: loading [200s] 8a62ad9335d7: Pull complete 2026-03-13 15:08:03,398 [INFO] Instance 32798092: loading [200s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:08:03,484 [INFO] Instance 32798087: pending [200s] 2026-03-13 15:08:04,121 [INFO] Instance 32798108: loading [153s] 8a62ad9335d7: Pull complete 2026-03-13 15:08:10,130 [INFO] Instance 32798130: loading [123s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:08:10,327 [INFO] Instance 32798131: pending [123s] 2026-03-13 15:08:18,559 [INFO] Instance 32798086: pending [215s] 2026-03-13 15:08:18,570 [INFO] Instance 32798085: loading [215s] #7 6.658 Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjson 2026-03-13 15:08:18,643 [INFO] Instance 32798091: loading [215s] 8a62ad9335d7: Pull complete 2026-03-13 15:08:18,748 [INFO] Instance 32798092: loading [215s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:08:18,836 [INFO] Instance 32798087: pending [215s] 2026-03-13 15:08:19,455 [INFO] Instance 32798108: loading [169s] 8a62ad9335d7: Pull complete 2026-03-13 15:08:25,479 [INFO] Instance 32798130: loading [138s] #7 0.927 curl is already the newest version (7.81.0-1ubuntu1.23). #7 0.927 git 2026-03-13 15:08:25,630 [INFO] Instance 32798131: pending [138s] 2026-03-13 15:08:33,937 [INFO] Instance 32798086: pending [231s] 2026-03-13 15:08:33,942 [INFO] Instance 32798085: loading [231s] #7 21.98 Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd 2026-03-13 15:08:33,974 [INFO] Instance 32798091: loading [231s] 8a62ad9335d7: Pull complete 2026-03-13 15:08:34,053 [INFO] Instance 32798092: loading [231s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:08:34,151 [INFO] Instance 32798087: pending [231s] 2026-03-13 15:08:34,780 [INFO] Instance 32798108: loading [184s] 8a62ad9335d7: Pull complete 2026-03-13 15:08:40,810 [INFO] Instance 32798130 running at ssh3.vast.ai:38130 — onstart worker auto-launching 2026-03-13 15:08:40,972 [INFO] Instance 32798131: pending [154s] 2026-03-13 15:08:41,314 [INFO] Created instance 32798203: RTX 4090 @ $0.214/hr (BS=4) 2026-03-13 15:08:41,609 [INFO] Instance 32798203: pending [0s] 2026-03-13 15:08:49,298 [INFO] Instance 32798085: loading [246s] #7 37.33 Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 lsb-release al 2026-03-13 15:08:49,304 [INFO] Instance 32798086: pending [246s] 2026-03-13 15:08:49,329 [INFO] Instance 32798091: loading [246s] 8a62ad9335d7: Pull complete 2026-03-13 15:08:49,388 [INFO] Instance 32798092: loading [246s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:08:49,476 [INFO] Instance 32798087: pending [246s] 2026-03-13 15:08:50,092 [INFO] Instance 32798108: loading [199s] #7 6.414 Setting up systemd-sysv (249.11-0ubuntu3.17) ... #7 6.423 Setting up p 2026-03-13 15:08:56,289 [INFO] Instance 32798131: pending [169s] 2026-03-13 15:08:56,920 [INFO] Instance 32798203: loading [15s] 2026-03-13 15:09:04,736 [INFO] Instance 32798086: pending [261s] 2026-03-13 15:09:04,747 [INFO] Instance 32798091: loading [261s] 8a62ad9335d7: Pull complete 2026-03-13 15:09:04,809 [INFO] Instance 32798092: loading [261s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:09:04,814 [INFO] Instance 32798085: loading [262s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:09:04,832 [INFO] Instance 32798087: pending [261s] 2026-03-13 15:09:05,541 [INFO] Instance 32798108 running at ssh3.vast.ai:38108 — onstart worker auto-launching 2026-03-13 15:09:06,077 [INFO] Created instance 32798215: RTX 4090 @ $0.242/hr (BS=4) 2026-03-13 15:09:06,377 [INFO] Instance 32798215: pending [0s] 2026-03-13 15:09:11,616 [INFO] Instance 32798131: pending [184s] 2026-03-13 15:09:12,258 [INFO] Instance 32798203: loading [30s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:09:20,191 [INFO] Instance 32798086: pending [277s] 2026-03-13 15:09:20,207 [INFO] Instance 32798091: loading [277s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:09:20,274 [INFO] Instance 32798085 running at ssh8.vast.ai:38084 — onstart worker auto-launching 2026-03-13 15:09:20,278 [INFO] Instance 32798087: pending [277s] 2026-03-13 15:09:20,285 [INFO] Instance 32798092: loading [277s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:09:21,296 [INFO] Created instance 32798224: RTX 4090 @ $0.268/hr (BS=4) 2026-03-13 15:09:21,589 [INFO] Instance 32798224: pending [0s] 2026-03-13 15:09:22,373 [INFO] Instance 32798215: loading [16s] 2026-03-13 15:09:27,006 [INFO] Instance 32798131: pending [200s] 2026-03-13 15:09:27,576 [INFO] Instance 32798203: created [46s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:09:35,550 [INFO] Instance 32798086: pending [292s] 2026-03-13 15:09:35,554 [INFO] Instance 32798091: loading [292s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:09:35,617 [INFO] Instance 32798092: loading [292s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:09:35,644 [INFO] Instance 32798087: pending [292s] 2026-03-13 15:09:36,901 [INFO] Instance 32798224: loading [15s] latest: Pulling from bharathkumar192/codecbench-sft aece8493d397: Already exists 2026-03-13 15:09:37,690 [INFO] Instance 32798215: loading [31s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:09:42,340 [INFO] Instance 32798131: pending [215s] 2026-03-13 15:09:42,876 [INFO] Instance 32798203: created [61s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:09:50,994 [INFO] Instance 32798091: loading [308s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:09:51,023 [INFO] Instance 32798086: pending [308s] 2026-03-13 15:09:51,052 [INFO] Instance 32798087: pending [308s] 2026-03-13 15:09:51,063 [INFO] Instance 32798092: loading [308s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:09:52,247 [INFO] Instance 32798224: loading [30s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:09:53,000 [INFO] Instance 32798215 running at ssh5.vast.ai:38214 — onstart worker auto-launching 2026-03-13 15:09:53,481 [INFO] Created instance 32798234: RTX 4090 @ $0.269/hr (BS=4) 2026-03-13 15:09:54,459 [INFO] Instance 32798234: pending [0s] 2026-03-13 15:09:57,678 [INFO] Instance 32798131: pending [230s] 2026-03-13 15:09:58,237 [INFO] Instance 32798203: created [76s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:10:06,441 [INFO] Instance 32798091: loading [323s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:10:06,469 [INFO] Instance 32798087: pending [323s] 2026-03-13 15:10:06,496 [INFO] Instance 32798086: pending [323s] 2026-03-13 15:10:06,498 [INFO] Instance 32798092: loading [323s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:10:07,588 [INFO] Instance 32798224: loading [46s] 8a62ad9335d7: Pull complete 2026-03-13 15:10:09,773 [INFO] Instance 32798234: loading [16s] 2026-03-13 15:10:13,051 [INFO] Instance 32798131: pending [246s] 2026-03-13 15:10:13,549 [INFO] Instance 32798203: created [92s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:10:21,887 [INFO] Instance 32798087: pending [338s] 2026-03-13 15:10:21,903 [INFO] Instance 32798091: loading [339s] #7 8.293 Generating locales (this might take a while)... 2026-03-13 15:10:21,962 [INFO] Instance 32798092: loading [339s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:10:21,982 [INFO] Instance 32798086: pending [339s] 2026-03-13 15:10:22,902 [INFO] Instance 32798224: loading [61s] 8a62ad9335d7: Pull complete 2026-03-13 15:10:25,159 [INFO] Instance 32798234: loading [31s] 2026-03-13 15:10:28,411 [INFO] Instance 32798131: pending [261s] 2026-03-13 15:10:28,898 [INFO] Instance 32798203: created [107s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:10:37,297 [INFO] Instance 32798091: created [354s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:10:37,347 [INFO] Instance 32798086: pending [354s] 2026-03-13 15:10:37,382 [INFO] Instance 32798092: loading [354s] bfce1374bac7: Retrying in 2 seconds 2026-03-13 15:10:37,994 [INFO] Instance 32798087: pending [355s] 2026-03-13 15:10:38,230 [INFO] Instance 32798224: loading [76s] 8a62ad9335d7: Pull complete 2026-03-13 15:10:40,458 [INFO] Instance 32798234: loading [46s] 8a62ad9335d7: Download complete 2026-03-13 15:10:43,786 [INFO] Instance 32798131: pending [276s] 2026-03-13 15:10:44,222 [INFO] Instance 32798203: created [122s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:10:52,619 [INFO] Instance 32798091: created [369s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:10:52,720 [INFO] Instance 32798092: loading [369s] bfce1374bac7: Verifying Checksum 2026-03-13 15:10:52,913 [INFO] Instance 32798086: pending [370s] 2026-03-13 15:10:53,316 [INFO] Instance 32798087: pending [370s] 2026-03-13 15:10:53,561 [INFO] Instance 32798224: loading [92s] 8a62ad9335d7: Pull complete 2026-03-13 15:10:55,776 [INFO] Instance 32798234: loading [62s] 8a62ad9335d7: Pull complete 2026-03-13 15:10:59,091 [INFO] Instance 32798131: pending [292s] 2026-03-13 15:10:59,552 [INFO] Instance 32798203: created [138s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:11:07,918 [INFO] Instance 32798091: created [385s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:11:08,074 [INFO] Instance 32798092: loading [385s] bfce1374bac7: Verifying Checksum 2026-03-13 15:11:08,242 [INFO] Instance 32798086: pending [385s] 2026-03-13 15:11:08,649 [INFO] Instance 32798087: pending [385s] 2026-03-13 15:11:08,870 [INFO] Instance 32798224: loading [107s] 8a62ad9335d7: Pull complete 2026-03-13 15:11:11,133 [INFO] Instance 32798234: loading [77s] d37d3e41b908: Pull complete 2026-03-13 15:11:14,416 [INFO] Instance 32798131: pending [307s] 2026-03-13 15:11:14,852 [INFO] Instance 32798203: created [153s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:11:23,292 [INFO] Instance 32798091: created [400s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:11:23,398 [INFO] Instance 32798092: loading [400s] bfce1374bac7: Verifying Checksum 2026-03-13 15:11:23,605 [INFO] Instance 32798086: pending [400s] 2026-03-13 15:11:23,956 [INFO] Instance 32798087: pending [401s] 2026-03-13 15:11:24,276 [INFO] Instance 32798224: loading [122s] 8a62ad9335d7: Pull complete 2026-03-13 15:11:26,436 [INFO] Instance 32798234: loading [92s] d37d3e41b908: Pull complete 2026-03-13 15:11:29,739 [INFO] Instance 32798131: pending [322s] 2026-03-13 15:11:30,204 [INFO] Instance 32798203: created [168s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:11:38,637 [INFO] Instance 32798091: created [415s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:11:38,723 [INFO] Instance 32798092: loading [415s] #6 3.931 Get:12 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Pack 2026-03-13 15:11:38,909 [INFO] Instance 32798086: pending [416s] 2026-03-13 15:11:39,256 [INFO] Instance 32798087: pending [416s] 2026-03-13 15:11:39,589 [INFO] Instance 32798224: loading [138s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:11:41,787 [INFO] Instance 32798234: loading [108s] d37d3e41b908: Pull complete 2026-03-13 15:11:45,080 [INFO] Instance 32798131: pending [338s] 2026-03-13 15:11:45,541 [INFO] Instance 32798203: created [184s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:11:54,007 [INFO] Instance 32798091: created [431s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:11:54,046 [INFO] Instance 32798092: loading [431s] #7 10.40 Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-lazr.u 2026-03-13 15:11:54,209 [INFO] Instance 32798086: pending [431s] 2026-03-13 15:11:54,575 [INFO] Instance 32798087: pending [431s] 2026-03-13 15:11:54,909 [INFO] Instance 32798224: loading [153s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:11:57,113 [INFO] Instance 32798234: loading [123s] 14a6217b9850: Download complete 2026-03-13 15:12:00,424 [INFO] Instance 32798131: pending [353s] 2026-03-13 15:12:00,861 [INFO] Instance 32798203: created [199s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:12:09,356 [INFO] Instance 32798091: created [446s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:12:09,439 [INFO] Instance 32798092 running at ssh3.vast.ai:38092 — onstart worker auto-launching 2026-03-13 15:12:09,576 [INFO] Instance 32798086: pending [446s] 2026-03-13 15:12:09,885 [INFO] Instance 32798087: pending [446s] 2026-03-13 15:12:10,109 [INFO] Created instance 32798284: RTX 4090 @ $0.269/hr (BS=4) 2026-03-13 15:12:10,261 [INFO] Instance 32798224: loading [168s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:12:10,435 [INFO] Instance 32798284: pending [0s] 2026-03-13 15:12:12,420 [INFO] Instance 32798234: loading [138s] 8a62ad9335d7: Download complete 2026-03-13 15:12:15,719 [INFO] Instance 32798131: pending [368s] 2026-03-13 15:12:16,189 [INFO] Instance 32798203: created [214s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:12:24,707 [INFO] Instance 32798091: created [461s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:12:24,928 [INFO] Instance 32798086: pending [462s] 2026-03-13 15:12:25,200 [INFO] Instance 32798087: pending [462s] 2026-03-13 15:12:25,617 [INFO] Instance 32798224: loading [184s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:12:25,723 [INFO] Instance 32798284: loading [15s] WARNING! Your credentials are stored unencrypted in 'configs/C.32798284/config. 2026-03-13 15:12:27,743 [INFO] Instance 32798234: loading [154s] 4ea2ff3b062b: Download complete 2026-03-13 15:12:31,051 [INFO] Instance 32798131: pending [384s] 2026-03-13 15:12:31,499 [INFO] Instance 32798203: created [230s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:12:40,019 [INFO] Instance 32798091: created [477s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:12:40,267 [INFO] Instance 32798086: pending [477s] 2026-03-13 15:12:40,507 [INFO] Instance 32798087: pending [477s] 2026-03-13 15:12:40,919 [INFO] Instance 32798224: loading [199s] Removing login credentials for https://index.docker.io/v1/ 2026-03-13 15:12:41,017 [INFO] Instance 32798284: loading [30s] 8a62ad9335d7: Pull complete 2026-03-13 15:12:43,048 [INFO] Instance 32798234: loading [169s] 4ea2ff3b062b: Download complete 2026-03-13 15:12:46,395 [INFO] Instance 32798131: pending [399s] 2026-03-13 15:12:46,808 [INFO] Instance 32798203: created [245s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:12:55,345 [INFO] Instance 32798091: created [492s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:12:55,591 [INFO] Instance 32798086: pending [492s] 2026-03-13 15:12:55,829 [INFO] Instance 32798087: pending [492s] 2026-03-13 15:12:56,262 [INFO] Instance 32798224: loading [214s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:12:56,341 [INFO] Instance 32798284: loading [46s] 8a62ad9335d7: Pull complete 2026-03-13 15:12:58,372 [INFO] Instance 32798234: loading [184s] 4ea2ff3b062b: Download complete 2026-03-13 15:13:01,796 [INFO] Instance 32798131: pending [414s] 2026-03-13 15:13:02,462 [INFO] Instance 32798203: created [261s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:13:10,650 [INFO] Instance 32798091: created [507s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:13:10,899 [INFO] Instance 32798086: pending [508s] 2026-03-13 15:13:11,151 [INFO] Instance 32798087: pending [508s] 2026-03-13 15:13:11,580 [INFO] Instance 32798224: loading [230s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:13:11,674 [INFO] Instance 32798284: loading [61s] 8a62ad9335d7: Pull complete 2026-03-13 15:13:13,691 [INFO] Instance 32798234: loading [200s] 14a6217b9850: Download complete 2026-03-13 15:13:17,120 [INFO] Instance 32798131: pending [430s] 2026-03-13 15:13:17,765 [INFO] Instance 32798203: created [276s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:13:25,953 [INFO] Instance 32798091: created [523s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:13:26,206 [INFO] Instance 32798086: pending [523s] 2026-03-13 15:13:26,479 [INFO] Instance 32798087: pending [523s] 2026-03-13 15:13:26,886 [INFO] Instance 32798224: loading [245s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:13:26,985 [INFO] Instance 32798284: loading [76s] 8a62ad9335d7: Pull complete 2026-03-13 15:13:29,023 [INFO] Instance 32798234: loading [215s] d37d3e41b908: 2026-03-13 15:13:32,439 [INFO] Instance 32798131: pending [445s] 2026-03-13 15:13:33,092 [INFO] Instance 32798203: created [291s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:13:41,265 [INFO] Instance 32798091: created [538s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:13:41,480 [INFO] Instance 32798086: pending [538s] 2026-03-13 15:13:41,795 [INFO] Instance 32798087: pending [538s] 2026-03-13 15:13:42,201 [INFO] Instance 32798224: loading [260s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:13:42,293 [INFO] Instance 32798284: loading [92s] 8a62ad9335d7: Pull complete 2026-03-13 15:13:44,349 [INFO] Instance 32798234: loading [230s] 8a62ad9335d7: Pull complete 2026-03-13 15:13:47,786 [INFO] Instance 32798131: pending [460s] 2026-03-13 15:13:48,427 [INFO] Instance 32798203: created [307s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:13:56,576 [INFO] Instance 32798091: created [553s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:13:56,820 [INFO] Instance 32798086: pending [553s] 2026-03-13 15:13:57,118 [INFO] Instance 32798087: pending [554s] 2026-03-13 15:13:57,517 [INFO] Instance 32798224: loading [276s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:13:57,627 [INFO] Instance 32798284: loading [107s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:13:59,679 [INFO] Instance 32798234: loading [246s] 8a62ad9335d7: Pull complete 2026-03-13 15:14:03,145 [INFO] Instance 32798131: pending [476s] 2026-03-13 15:14:03,891 [INFO] Instance 32798203: created [322s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:14:11,908 [INFO] Instance 32798091: created [569s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:14:12,133 [INFO] Instance 32798086: pending [569s] 2026-03-13 15:14:12,439 [INFO] Instance 32798087: pending [569s] 2026-03-13 15:14:12,832 [INFO] Instance 32798224: loading [291s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:14:12,977 [INFO] Instance 32798284: loading [122s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:14:14,970 [INFO] Instance 32798234: loading [261s] 8a62ad9335d7: Pull complete 2026-03-13 15:14:18,498 [INFO] Instance 32798131: pending [491s] 2026-03-13 15:14:19,211 [INFO] Instance 32798203: created [337s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:14:27,227 [INFO] Instance 32798091: created [584s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:14:27,464 [INFO] Instance 32798086: pending [584s] 2026-03-13 15:14:27,754 [INFO] Instance 32798087: pending [584s] 2026-03-13 15:14:28,135 [INFO] Instance 32798224: loading [306s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:14:28,348 [INFO] Instance 32798284: loading [138s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:14:30,280 [INFO] Instance 32798234: loading [276s] 8a62ad9335d7: Pull complete 2026-03-13 15:14:33,817 [INFO] Instance 32798131: pending [506s] 2026-03-13 15:14:34,517 [INFO] Instance 32798203: created [353s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:14:42,562 [INFO] Instance 32798091: created [599s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:14:42,799 [INFO] Instance 32798086: pending [599s] 2026-03-13 15:14:43,083 [INFO] Instance 32798087: pending [600s] 2026-03-13 15:14:43,457 [INFO] Instance 32798224: loading [322s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:14:43,641 [INFO] Instance 32798284: loading [153s] #6 2.149 Get:10 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 2026-03-13 15:14:45,591 [INFO] Instance 32798234: loading [292s] 8a62ad9335d7: Download complete 2026-03-13 15:14:49,141 [INFO] Instance 32798131: pending [522s] 2026-03-13 15:14:49,843 [INFO] Instance 32798203: created [368s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:14:58,331 [INFO] Destroyed instance 32798086 2026-03-13 15:14:58,387 [INFO] Destroyed instance 32798091 2026-03-13 15:14:58,672 [INFO] Destroyed instance 32798087 2026-03-13 15:14:58,774 [INFO] Instance 32798224: loading [337s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:14:59,020 [INFO] Instance 32798284: loading [168s] #7 6.289 Unpacking python3-wadllib (1.3.6-1) ... #7 6.331 Selecting previously 2026-03-13 15:14:59,177 [INFO] Created instance 32798420: RTX 4090 @ $0.270/hr (BS=4) 2026-03-13 15:14:59,215 [INFO] Created instance 32798419: RTX 4090 @ $0.270/hr (BS=4) 2026-03-13 15:14:59,229 [INFO] Created instance 32798421: RTX 4090 @ $0.276/hr (BS=4) 2026-03-13 15:14:59,494 [INFO] Instance 32798420: pending [0s] 2026-03-13 15:14:59,579 [INFO] Instance 32798419: pending [0s] 2026-03-13 15:14:59,587 [INFO] Instance 32798421: pending [0s] 2026-03-13 15:15:00,924 [INFO] Instance 32798234: loading [307s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:15:04,471 [INFO] Instance 32798131: pending [537s] 2026-03-13 15:15:05,163 [INFO] Instance 32798203: created [383s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:15:14,086 [INFO] Instance 32798224: loading [352s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:15:14,344 [INFO] Instance 32798284: loading [184s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:15:14,825 [INFO] Instance 32798420: pending [15s] 2026-03-13 15:15:14,905 [INFO] Instance 32798419: pending [15s] 2026-03-13 15:15:14,954 [INFO] Instance 32798421: loading [15s] 2026-03-13 15:15:16,274 [INFO] Instance 32798234: loading [322s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:15:19,809 [INFO] Instance 32798131: pending [552s] 2026-03-13 15:15:20,503 [INFO] Instance 32798203: created [399s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:15:29,404 [INFO] Instance 32798224: loading [368s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:15:29,668 [INFO] Instance 32798284: loading [199s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:15:30,229 [INFO] Instance 32798420: loading [31s] 4ea2ff3b062b: Verifying Checksum 4ea2ff3b062b: Download complete 2026-03-13 15:15:30,250 [INFO] Instance 32798419: loading [31s] WARNING! Your credentials are stored unencrypted in 'configs/C.32798419/config. 2026-03-13 15:15:30,294 [INFO] Instance 32798421: loading [31s] b0d7cc89b769: Download complete 2026-03-13 15:15:31,595 [INFO] Instance 32798234: loading [338s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:15:35,114 [INFO] Instance 32798131: pending [568s] 2026-03-13 15:15:35,833 [INFO] Instance 32798203: created [414s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:15:44,724 [INFO] Instance 32798224: loading [383s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:15:45,177 [INFO] Instance 32798284: loading [215s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:15:45,564 [INFO] Instance 32798420: loading [46s] 8a62ad9335d7: Download complete 2026-03-13 15:15:45,617 [INFO] Instance 32798419: loading [46s] 8a62ad9335d7: Pull complete 2026-03-13 15:15:45,654 [INFO] Instance 32798421: loading [46s] 8a62ad9335d7: Download complete 2026-03-13 15:15:46,962 [INFO] Instance 32798234: loading [353s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:15:50,442 [INFO] Instance 32798131: pending [583s] 2026-03-13 15:15:51,166 [INFO] Instance 32798203: created [429s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:16:00,094 [INFO] Instance 32798224: loading [398s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:16:00,481 [INFO] Instance 32798284: loading [230s] Removing login credentials for https://index.docker.io/v1/ 2026-03-13 15:16:00,903 [INFO] Instance 32798420: loading [61s] 8a62ad9335d7: Pull complete 2026-03-13 15:16:00,973 [INFO] Instance 32798419: loading [61s] 8a62ad9335d7: Pull complete 2026-03-13 15:16:00,979 [INFO] Instance 32798421: loading [61s] 8bd2762ffdd9: Pull complete 2026-03-13 15:16:02,410 [INFO] Instance 32798234: loading [368s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:16:05,742 [INFO] Instance 32798131: pending [598s] 2026-03-13 15:16:06,495 [INFO] Instance 32798203: created [445s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:16:15,445 [INFO] Instance 32798224: loading [414s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:16:15,799 [INFO] Instance 32798284: loading [245s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:16:16,198 [INFO] Instance 32798420: loading [77s] 8a62ad9335d7: Pull complete 2026-03-13 15:16:16,286 [INFO] Instance 32798421: loading [77s] d37d3e41b908: Pull complete 2026-03-13 15:16:16,313 [INFO] Instance 32798419: loading [77s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:16:17,746 [INFO] Instance 32798234: loading [384s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:16:21,238 [INFO] Destroyed instance 32798131 2026-03-13 15:16:21,703 [INFO] Created instance 32798520: RTX 4090 @ $0.276/hr (BS=4) 2026-03-13 15:16:21,815 [INFO] Instance 32798203: created [460s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:16:21,997 [INFO] Instance 32798520: pending [0s] 2026-03-13 15:16:30,793 [INFO] Instance 32798224: loading [429s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:16:31,100 [INFO] Instance 32798284: loading [260s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:16:31,503 [INFO] Instance 32798420: loading [92s] 8a62ad9335d7: Pull complete 2026-03-13 15:16:31,623 [INFO] Instance 32798421: loading [92s] d37d3e41b908: Pull complete 2026-03-13 15:16:31,654 [INFO] Instance 32798419: loading [92s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:16:33,073 [INFO] Instance 32798234: loading [399s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:16:37,153 [INFO] Instance 32798203: created [475s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:16:37,332 [INFO] Instance 32798520: pending [15s] 2026-03-13 15:16:46,123 [INFO] Instance 32798224: loading [444s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:16:46,401 [INFO] Instance 32798284: loading [276s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:16:46,816 [INFO] Instance 32798420: loading [107s] 8a62ad9335d7: Pull complete 2026-03-13 15:16:46,986 [INFO] Instance 32798421: loading [107s] d37d3e41b908: Pull complete 2026-03-13 15:16:46,988 [INFO] Instance 32798419: loading [107s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:16:48,389 [INFO] Instance 32798234: loading [414s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:16:52,475 [INFO] Instance 32798203: created [491s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:16:52,686 [INFO] Instance 32798520: loading [30s] 8a62ad9335d7: Download complete 2026-03-13 15:17:01,443 [INFO] Instance 32798224: loading [460s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:17:01,807 [INFO] Instance 32798284: loading [291s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:17:02,214 [INFO] Instance 32798420: loading [123s] 8a62ad9335d7: Pull complete 2026-03-13 15:17:02,456 [INFO] Instance 32798421: loading [123s] bfce1374bac7: Download complete 2026-03-13 15:17:02,478 [INFO] Instance 32798419: loading [123s] #8 4.384 Preparing to unpack .../07-iso-codes_4.9.0-1_all.deb ... #8 4.386 Unpa 2026-03-13 15:17:03,732 [INFO] Instance 32798234: loading [430s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:17:07,790 [INFO] Instance 32798203: created [506s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:17:08,003 [INFO] Instance 32798520: loading [46s] febeb34b3674: Pull complete 2026-03-13 15:17:16,792 [INFO] Instance 32798224: loading [475s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:17:17,124 [INFO] Instance 32798284: loading [307s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:17:17,523 [INFO] Instance 32798420: loading [138s] 8a62ad9335d7: Pull complete 2026-03-13 15:17:17,740 [INFO] Instance 32798421: loading [138s] #6 1.961 Get:12 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Pack 2026-03-13 15:17:17,830 [INFO] Instance 32798419 running at ssh9.vast.ai:38418 — onstart worker auto-launching 2026-03-13 15:17:18,394 [INFO] Created instance 32798547: RTX 4090 @ $0.281/hr (BS=4) 2026-03-13 15:17:18,688 [INFO] Instance 32798547: pending [0s] 2026-03-13 15:17:19,043 [INFO] Instance 32798234: loading [445s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:17:23,109 [INFO] Instance 32798203: created [521s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:17:23,338 [INFO] Instance 32798520: loading [61s] febeb34b3674: Pull complete 2026-03-13 15:17:32,127 [INFO] Instance 32798224: loading [490s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:17:32,425 [INFO] Instance 32798284: loading [322s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:17:32,831 [INFO] Instance 32798420: loading [153s] 8a62ad9335d7: Pull complete 2026-03-13 15:17:33,059 [INFO] Instance 32798421: loading [153s] #7 10.08 Setting up packagekit (1.2.5-2ubuntu3) ... #7 10.09 invoke-rc.d: could 2026-03-13 15:17:34,009 [INFO] Instance 32798547: loading [15s] 2026-03-13 15:17:34,373 [INFO] Instance 32798234: loading [460s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:17:38,460 [INFO] Instance 32798203: created [537s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:17:38,745 [INFO] Instance 32798520: loading [77s] febeb34b3674: Pull complete 2026-03-13 15:17:47,458 [INFO] Instance 32798224: loading [506s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:17:47,744 [INFO] Instance 32798284: loading [337s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:17:48,150 [INFO] Instance 32798420: loading [168s] 8a62ad9335d7: Pull complete 2026-03-13 15:17:48,395 [INFO] Instance 32798421 running at ssh6.vast.ai:38420 — onstart worker auto-launching 2026-03-13 15:17:48,948 [INFO] Created instance 32798580: RTX 4090 @ $0.294/hr (BS=4) 2026-03-13 15:17:49,223 [INFO] Instance 32798580: pending [0s] 2026-03-13 15:17:49,311 [INFO] Instance 32798547: loading [30s] 4ea2ff3b062b: Download complete 2026-03-13 15:17:49,654 [INFO] Instance 32798234: loading [476s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:17:53,771 [INFO] Instance 32798203: created [552s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:17:54,089 [INFO] Instance 32798520: loading [92s] febeb34b3674: Pull complete 2026-03-13 15:18:04,262 [INFO] Instance 32798224: loading [522s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:18:04,441 [INFO] Instance 32798284: loading [354s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:18:04,466 [INFO] Instance 32798420: loading [185s] 8a62ad9335d7: Pull complete 2026-03-13 15:18:05,209 [INFO] Instance 32798580: loading [16s] 2026-03-13 15:18:05,478 [INFO] Instance 32798547: loading [47s] febeb34b3674: Pull complete 2026-03-13 15:18:06,022 [INFO] Instance 32798234: loading [492s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:18:09,114 [INFO] Instance 32798203: created [567s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:18:09,438 [INFO] Instance 32798520: loading [107s] febeb34b3674: Pull complete 2026-03-13 15:18:19,564 [INFO] Instance 32798224: loading [538s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:18:19,809 [INFO] Instance 32798420: loading [200s] 8a62ad9335d7: Pull complete 2026-03-13 15:18:19,836 [INFO] Instance 32798284: loading [369s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:18:20,512 [INFO] Instance 32798580: loading [31s] 2a5ee6fadd42: Download complete 2026-03-13 15:18:20,793 [INFO] Instance 32798547: loading [62s] febeb34b3674: Pull complete 2026-03-13 15:18:21,326 [INFO] Instance 32798234: loading [507s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:18:24,444 [INFO] Instance 32798203: created [583s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:18:24,739 [INFO] Instance 32798520: loading [123s] febeb34b3674: Pull complete 2026-03-13 15:18:34,910 [INFO] Instance 32798224: loading [553s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:18:35,160 [INFO] Instance 32798420: loading [215s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:18:35,171 [INFO] Instance 32798284: loading [385s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:18:35,866 [INFO] Instance 32798580: loading [46s] d37d3e41b908: Retrying in 3 seconds 2026-03-13 15:18:36,111 [INFO] Instance 32798547: loading [77s] febeb34b3674: Pull complete 2026-03-13 15:18:36,677 [INFO] Instance 32798234: loading [523s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:18:39,752 [INFO] Instance 32798203: created [598s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-13 15:18:40,049 [INFO] Instance 32798520: loading [138s] bfce1374bac7: Download complete 2026-03-13 15:18:50,240 [INFO] Instance 32798224: loading [568s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:18:50,541 [INFO] Instance 32798420: loading [231s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:18:50,566 [INFO] Instance 32798284: loading [400s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:18:51,178 [INFO] Instance 32798580: loading [62s] d37d3e41b908: Retrying in 3 seconds 2026-03-13 15:18:51,474 [INFO] Instance 32798547: loading [93s] bfce1374bac7: Download complete 2026-03-13 15:18:52,156 [INFO] Instance 32798234: loading [538s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:18:55,249 [INFO] Destroyed instance 32798203 2026-03-13 15:18:55,382 [INFO] Instance 32798520: loading [153s] bfce1374bac7: Download complete 2026-03-13 15:18:55,734 [INFO] Created instance 32798636: RTX 4090 @ $0.296/hr (BS=4) 2026-03-13 15:18:56,041 [INFO] Instance 32798636: pending [0s] 2026-03-13 15:19:05,603 [INFO] Instance 32798224: loading [584s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:19:05,865 [INFO] Instance 32798420: loading [246s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:19:05,902 [INFO] Instance 32798284: loading [415s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:19:06,532 [INFO] Instance 32798580: loading [77s] 808d41145975: Download complete 2026-03-13 15:19:06,798 [INFO] Instance 32798547: loading [108s] bfce1374bac7: Download complete 2026-03-13 15:19:07,478 [INFO] Instance 32798234: loading [553s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:19:10,691 [INFO] Instance 32798520: loading [168s] #7 2.131 Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libargon2-1 amd 2026-03-13 15:19:11,359 [INFO] Instance 32798636: loading [15s] 2026-03-13 15:19:20,907 [INFO] Instance 32798224: loading [599s] failed to create task for container: failed to create shim task: OCI runtime cre 2026-03-13 15:19:21,218 [INFO] Instance 32798420: loading [262s] #5 DONE 4.7s 2026-03-13 15:19:21,236 [INFO] Instance 32798284: loading [431s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:19:21,876 [INFO] Instance 32798580: loading [92s] 0f48b7ff7db5: Retrying in 3 seconds 2026-03-13 15:19:22,169 [INFO] Instance 32798547: loading [123s] bfce1374bac7: Download complete 2026-03-13 15:19:22,810 [INFO] Instance 32798234: loading [569s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:19:26,004 [INFO] Instance 32798520: loading [184s] success, running bharathkumar192/codecbench-sft_latest/ssh 2026-03-13 15:19:26,694 [INFO] Instance 32798636: loading [30s] 8a62ad9335d7: Pull complete 2026-03-13 15:19:36,427 [INFO] Destroyed instance 32798224 2026-03-13 15:19:36,590 [INFO] Instance 32798420: loading [277s] #8 10.12 Setting up policykit-1 (0.105-33) ... 2026-03-13 15:19:36,616 [INFO] Instance 32798284: loading [446s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:19:36,912 [INFO] Created instance 32798666: RTX 4090 @ $0.296/hr (BS=4) 2026-03-13 15:19:37,208 [INFO] Instance 32798666: pending [0s] 2026-03-13 15:19:37,512 [INFO] Instance 32798547: loading [139s] bfce1374bac7: Download complete 2026-03-13 15:19:38,078 [INFO] Instance 32798580: loading [109s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:19:38,142 [INFO] Instance 32798234: loading [584s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:19:41,303 [INFO] Instance 32798520 running at ssh9.vast.ai:38520 — onstart worker auto-launching 2026-03-13 15:19:41,968 [INFO] Created instance 32798670: RTX 4090 @ $0.309/hr (BS=4) 2026-03-13 15:19:41,993 [INFO] Instance 32798636: loading [46s] 8a62ad9335d7: Pull complete 2026-03-13 15:19:42,282 [INFO] Instance 32798670: pending [0s] 2026-03-13 15:19:51,986 [INFO] Instance 32798284: loading [461s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:19:52,021 [INFO] Instance 32798420 running at ssh2.vast.ai:38420 — onstart worker auto-launching 2026-03-13 15:19:52,515 [INFO] Instance 32798666: loading [15s] WARNING! Your credentials are stored unencrypted in 'configs/C.32798666/config. 2026-03-13 15:19:52,539 [INFO] Created instance 32798678: RTX 4090 @ $0.309/hr (BS=4) 2026-03-13 15:19:52,883 [INFO] Instance 32798547: loading [154s] #6 5.174 Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 Packages [1792 2026-03-13 15:19:52,917 [INFO] Instance 32798678: pending [0s] 2026-03-13 15:19:53,437 [INFO] Instance 32798580: loading [124s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:19:53,468 [INFO] Instance 32798234: loading [599s] failed to extract layer (application/vnd.docker.image.rootfs.diff.tar.gzip sha25 2026-03-13 15:19:57,301 [INFO] Instance 32798636: loading [61s] bfce1374bac7: Verifying Checksum 2026-03-13 15:19:57,593 [INFO] Instance 32798670: loading [15s] 2026-03-13 15:20:07,339 [INFO] Instance 32798284: loading [477s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:20:07,822 [INFO] Instance 32798666: loading [30s] d37d3e41b908: Verifying Checksum 2026-03-13 15:20:08,199 [INFO] Instance 32798547: loading [169s] #7 11.38 Setting up python3-jwt (2.3.0-1ubuntu0.2) ... #7 11.52 Setting up liby 2026-03-13 15:20:08,238 [INFO] Instance 32798678: loading [15s] 2026-03-13 15:20:08,800 [INFO] Instance 32798580: loading [139s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:20:09,095 [INFO] Destroyed instance 32798234 2026-03-13 15:20:09,706 [INFO] Created instance 32798707: RTX 4090 @ $0.309/hr (BS=4) 2026-03-13 15:20:09,996 [INFO] Instance 32798707: pending [0s] 2026-03-13 15:20:12,627 [INFO] Instance 32798636: loading [76s] #0 building with "default" instance using docker driver #1 [internal] load buil 2026-03-13 15:20:12,938 [INFO] Instance 32798670: loading [30s] d37d3e41b908: Download complete 2026-03-13 15:20:22,667 [INFO] Instance 32798284: loading [492s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:20:23,126 [INFO] Instance 32798666: loading [46s] 8a62ad9335d7: Verifying Checksum 8a62ad9335d7: Download complete 2026-03-13 15:20:23,545 [INFO] Instance 32798547 running at ssh3.vast.ai:38546 — onstart worker auto-launching 2026-03-13 15:20:23,575 [INFO] Instance 32798678: loading [31s] 2026-03-13 15:20:24,101 [INFO] Instance 32798580: loading [155s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:20:24,221 [INFO] Created instance 32798722: RTX 4090 @ $0.309/hr (BS=4) 2026-03-13 15:20:24,520 [INFO] Instance 32798722: pending [0s] 2026-03-13 15:20:25,309 [INFO] Instance 32798707: loading [15s] latest: Pulling from bharathkumar192/codecbench-sft 2026-03-13 15:20:27,967 [INFO] Instance 32798636: loading [92s] #7 9.304 Preparing to unpack .../11-libpam-systemd_249.11-0ubuntu3.17_amd64.deb 2026-03-13 15:20:28,269 [INFO] Instance 32798670: loading [46s] d37d3e41b908: Download complete 2026-03-13 15:20:37,965 [INFO] Instance 32798284: loading [507s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:20:38,455 [INFO] Instance 32798666: loading [61s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:20:38,907 [INFO] Instance 32798678: loading [46s] 0f48b7ff7db5: Download complete 2026-03-13 15:20:39,481 [INFO] Instance 32798580: loading [170s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:20:39,908 [INFO] Instance 32798722: loading [15s] 2026-03-13 15:20:40,643 [INFO] Instance 32798707: loading [30s] 8a62ad9335d7: Pull complete 2026-03-13 15:20:43,303 [INFO] Instance 32798636: loading [107s] success, running bharathkumar192/codecbench-sft_latest/ssh 2026-03-13 15:20:43,598 [INFO] Instance 32798670: loading [61s] d37d3e41b908: Download complete 2026-03-13 15:20:53,276 [INFO] Instance 32798284: loading [523s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:20:53,785 [INFO] Instance 32798666: loading [76s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:20:54,236 [INFO] Instance 32798678: loading [61s] 8a62ad9335d7: Download complete 2026-03-13 15:20:54,792 [INFO] Instance 32798580: loading [185s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:20:55,259 [INFO] Instance 32798722: loading [31s] Removing login credentials for https://index.docker.io/v1/ 2026-03-13 15:20:55,969 [INFO] Instance 32798707: loading [46s] 8a62ad9335d7: Pull complete 2026-03-13 15:20:58,727 [INFO] Instance 32798636 running at ssh7.vast.ai:38636 — onstart worker auto-launching 2026-03-13 15:20:58,931 [INFO] Instance 32798670: loading [76s] 8a62ad9335d7: Pull complete 2026-03-13 15:21:08,637 [INFO] Instance 32798284: loading [538s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:21:09,105 [INFO] Instance 32798666: loading [92s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:21:09,523 [INFO] Instance 32798678: loading [76s] febeb34b3674: Pull complete 2026-03-13 15:21:10,113 [INFO] Instance 32798580: loading [201s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:21:10,595 [INFO] Instance 32798722: loading [46s] 0f48b7ff7db5: Download complete 2026-03-13 15:21:11,300 [INFO] Instance 32798707: loading [61s] 8a62ad9335d7: Pull complete 2026-03-13 15:21:14,280 [INFO] Instance 32798670: loading [92s] 0f48b7ff7db5: Download complete 2026-03-13 15:21:23,925 [INFO] Instance 32798284: loading [553s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:21:24,450 [INFO] Instance 32798666: loading [107s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:21:24,821 [INFO] Instance 32798678: loading [92s] febeb34b3674: Pull complete 2026-03-13 15:21:25,439 [INFO] Instance 32798580: loading [216s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:21:25,882 [INFO] Instance 32798722: loading [61s] a14a8a8a6ebc: Verifying Checksum 2026-03-13 15:21:26,628 [INFO] Instance 32798707: loading [76s] 8a62ad9335d7: Pull complete 2026-03-13 15:21:29,575 [INFO] Instance 32798670: loading [107s] 0f48b7ff7db5: Download complete 2026-03-13 15:21:39,226 [INFO] Instance 32798284: loading [569s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:21:39,743 [INFO] Instance 32798666: loading [122s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:21:40,149 [INFO] Instance 32798678: loading [107s] febeb34b3674: Pull complete 2026-03-13 15:21:40,755 [INFO] Instance 32798580: loading [231s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:21:41,194 [INFO] Instance 32798722: loading [76s] 8a62ad9335d7: Pull complete 2026-03-13 15:21:41,930 [INFO] Instance 32798707: loading [92s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:21:44,895 [INFO] Instance 32798670: loading [122s] 0f48b7ff7db5: Download complete 2026-03-13 15:21:55,079 [INFO] Instance 32798666: loading [138s] a14a8a8a6ebc: Verifying Checksum a14a8a8a6ebc: Download complete 2026-03-13 15:21:55,424 [INFO] Instance 32798284: loading [585s] docker: invalid hostPort: -1 Run 'docker create --help' for more information 2026-03-13 15:21:55,474 [INFO] Instance 32798678: loading [122s] febeb34b3674: Pull complete 2026-03-13 15:21:56,116 [INFO] Instance 32798580: loading [247s] 0f48b7ff7db5: Verifying Checksum 2026-03-13 15:21:56,532 [INFO] Instance 32798722: loading [92s] 8a62ad9335d7: Pull complete 2026-03-13 15:21:57,504 [INFO] Instance 32798707: loading [107s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:22:00,241 [INFO] Instance 32798670: loading [138s] 0f48b7ff7db5: Download complete 2026-03-13 15:22:10,446 [INFO] Instance 32798666: loading [153s] 8a62ad9335d7: Pull complete 2026-03-13 15:22:10,803 [INFO] Instance 32798678: loading [138s] febeb34b3674: Pull complete 2026-03-13 15:22:11,052 [INFO] Destroyed instance 32798284 2026-03-13 15:22:11,381 [INFO] Instance 32798580: loading [262s] a14a8a8a6ebc: Verifying Checksum 2026-03-13 15:22:11,876 [INFO] Instance 32798722: loading [107s] bfce1374bac7: Verifying Checksum bfce1374bac7: 2026-03-13 15:22:12,814 [INFO] Instance 32798707: loading [123s] bfce1374bac7: Verifying Checksum bfce1374bac7: Download complete 2026-03-13 15:22:15,559 [INFO] Instance 32798670: loading [153s] 0f48b7ff7db5: Download complete 2026-03-13 15:22:25,764 [INFO] Instance 32798666: loading [168s] 8a62ad9335d7: Pull complete 2026-03-13 15:22:26,119 [INFO] Instance 32798678: loading [153s] febeb34b3674: Pull complete 2026-03-13 15:22:26,682 [INFO] Instance 32798580: loading [277s] a14a8a8a6ebc: Pull complete 2026-03-13 15:22:27,179 [INFO] Instance 32798722: loading [122s] bfce1374bac7: Verifying Checksum bfce1374bac7: 2026-03-13 15:22:28,128 [INFO] Instance 32798707: loading [138s] #5 DONE 7.1s 2026-03-13 15:22:30,888 [INFO] Instance 32798670: loading [168s] 0f48b7ff7db5: Download complete 2026-03-13 15:22:41,106 [INFO] Instance 32798666: loading [184s] 8a62ad9335d7: Pull complete 2026-03-13 15:22:41,443 [INFO] Instance 32798678: loading [168s] febeb34b3674: Pull complete 2026-03-13 15:22:42,007 [INFO] Instance 32798580: loading [293s] 8a62ad9335d7: Pull complete 2026-03-13 15:22:42,517 [INFO] Instance 32798722: loading [138s] #0 building with "default" instance using docker driver #1 [internal] load buil 2026-03-13 15:22:43,448 [INFO] Instance 32798707: loading [153s] #7 4.955 Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libargon2-1 amd 2026-03-13 15:22:46,184 [INFO] Instance 32798670: loading [184s] bfce1374bac7: Download complete 2026-03-13 15:22:56,415 [INFO] Instance 32798666: loading [199s] 8a62ad9335d7: Pull complete 2026-03-13 15:22:56,806 [INFO] Instance 32798678: loading [184s] bfce1374bac7: Download complete 2026-03-13 15:22:57,339 [INFO] Instance 32798580: loading [308s] 8a62ad9335d7: Pull complete 2026-03-13 15:22:57,829 [INFO] Instance 32798722: loading [153s] #7 6.907 Preparing to unpack .../14-lsb-release_11.1.0ubuntu4_all.deb ... #7 6. 2026-03-13 15:22:58,760 [INFO] Instance 32798707: loading [169s] #8 DONE 0.3s 2026-03-13 15:23:01,993 [INFO] Instance 32798670: loading [200s] bfce1374bac7: Download complete 2026-03-13 15:23:11,720 [INFO] Instance 32798666: loading [214s] 8a62ad9335d7: Pull complete 2026-03-13 15:23:12,137 [INFO] Instance 32798678: loading [199s] bfce1374bac7: Download complete 2026-03-13 15:23:12,645 [INFO] Instance 32798580: loading [323s] 8a62ad9335d7: Pull complete 2026-03-13 15:23:13,142 [INFO] Instance 32798722 running at ssh2.vast.ai:38722 — onstart worker auto-launching 2026-03-13 15:23:14,098 [INFO] Instance 32798707 running at ssh7.vast.ai:38706 — onstart worker auto-launching 2026-03-13 15:23:17,309 [INFO] Instance 32798670: loading [215s] bfce1374bac7: Download complete 2026-03-13 15:23:27,055 [INFO] Instance 32798666: loading [230s] 8a62ad9335d7: Pull complete 2026-03-13 15:23:27,470 [INFO] Instance 32798678: loading [214s] bfce1374bac7: Download complete 2026-03-13 15:23:27,961 [INFO] Instance 32798580: loading [339s] 8a62ad9335d7: Pull complete 2026-03-13 15:23:32,645 [INFO] Instance 32798670: loading [230s] #6 3.225 Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packag 2026-03-13 15:23:42,344 [INFO] Instance 32798666: loading [245s] 8a62ad9335d7: Pull complete 2026-03-13 15:23:42,802 [INFO] Instance 32798678: loading [230s] #6 3.268 Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd6 2026-03-13 15:23:43,301 [INFO] Instance 32798580: loading [354s] 8a62ad9335d7: Pull complete 2026-03-13 15:23:47,980 [INFO] Instance 32798670: loading [246s] #7 14.31 Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2026-03-13 15:23:57,680 [INFO] Instance 32798666: loading [260s] 8a62ad9335d7: Pull complete 2026-03-13 15:23:58,104 [INFO] Instance 32798678: loading [245s] #7 13.85 Setting up python3-keyring (23.5.0-1) ... 2026-03-13 15:23:58,646 [INFO] Instance 32798580: loading [369s] 8a62ad9335d7: Pull complete 2026-03-13 15:24:04,321 [INFO] Instance 32798670 running at ssh4.vast.ai:38670 — onstart worker auto-launching 2026-03-13 15:24:13,056 [INFO] Instance 32798666: loading [276s] 8a62ad9335d7: Pull complete 2026-03-13 15:24:13,419 [INFO] Instance 32798678 running at ssh3.vast.ai:38678 — onstart worker auto-launching 2026-03-13 15:24:14,014 [INFO] Instance 32798580: loading [385s] 8a62ad9335d7: Pull complete 2026-03-13 15:24:28,403 [INFO] Instance 32798666: loading [291s] 8a62ad9335d7: Pull complete 2026-03-13 15:24:29,334 [INFO] Instance 32798580: loading [400s] 8a62ad9335d7: Pull complete 2026-03-13 15:24:43,703 [INFO] Instance 32798666: loading [306s] 8a62ad9335d7: Pull complete 2026-03-13 15:24:44,686 [INFO] Instance 32798580: loading [415s] 8a62ad9335d7: Pull complete 2026-03-13 15:24:59,024 [INFO] Instance 32798666: loading [322s] 8a62ad9335d7: Pull complete 2026-03-13 15:25:00,015 [INFO] Instance 32798580: loading [431s] 8a62ad9335d7: Pull complete 2026-03-13 15:25:14,345 [INFO] Instance 32798666: loading [337s] 8a62ad9335d7: Pull complete 2026-03-13 15:25:15,340 [INFO] Instance 32798580: loading [446s] 8a62ad9335d7: Pull complete 2026-03-13 15:25:29,661 [INFO] Instance 32798666: loading [352s] 8a62ad9335d7: Pull complete 2026-03-13 15:25:30,639 [INFO] Instance 32798580: loading [461s] 8a62ad9335d7: Pull complete 2026-03-13 15:25:44,964 [INFO] Instance 32798666: loading [368s] 8a62ad9335d7: Pull complete 2026-03-13 15:25:45,967 [INFO] Instance 32798580: loading [477s] 8a62ad9335d7: Pull complete 2026-03-13 15:26:00,296 [INFO] Instance 32798666: loading [383s] 8a62ad9335d7: Pull complete 2026-03-13 15:26:01,448 [INFO] Instance 32798580: loading [492s] 8a62ad9335d7: Pull complete 2026-03-13 15:26:15,623 [INFO] Instance 32798666: loading [398s] 8a62ad9335d7: Pull complete 2026-03-13 15:26:16,773 [INFO] Instance 32798580: loading [507s] 8a62ad9335d7: Pull complete 2026-03-13 15:26:30,979 [INFO] Instance 32798666: loading [414s] 8a62ad9335d7: Pull complete 2026-03-13 15:26:32,123 [INFO] Instance 32798580: loading [523s] 8a62ad9335d7: Pull complete 2026-03-13 15:26:46,292 [INFO] Instance 32798666: loading [429s] 8a62ad9335d7: Pull complete 2026-03-13 15:26:47,475 [INFO] Instance 32798580: loading [538s] 8a62ad9335d7: Pull complete 2026-03-13 15:27:01,764 [INFO] Instance 32798666: loading [444s] 8a62ad9335d7: Pull complete 2026-03-13 15:27:02,849 [INFO] Instance 32798580: loading [553s] 8a62ad9335d7: Pull complete 2026-03-13 15:27:17,077 [INFO] Instance 32798666: loading [460s] 8a62ad9335d7: Pull complete 2026-03-13 15:27:18,189 [INFO] Instance 32798580: loading [569s] 8a62ad9335d7: Pull complete 2026-03-13 15:27:32,418 [INFO] Instance 32798666: loading [475s] 8a62ad9335d7: Pull complete 2026-03-13 15:27:33,480 [INFO] Instance 32798580: loading [584s] 8a62ad9335d7: Pull complete 2026-03-13 15:27:47,762 [INFO] Instance 32798666: loading [490s] 8a62ad9335d7: Pull complete 2026-03-13 15:27:48,780 [INFO] Instance 32798580: loading [599s] 8a62ad9335d7: Pull complete 2026-03-13 15:28:03,311 [INFO] Instance 32798666: loading [506s] 8a62ad9335d7: Pull complete 2026-03-13 15:28:04,273 [INFO] Destroyed instance 32798580 2026-03-13 15:28:18,674 [INFO] Instance 32798666: loading [521s] 8a62ad9335d7: Pull complete 2026-03-13 15:28:33,993 [INFO] Instance 32798666: loading [537s] 8a62ad9335d7: Pull complete 2026-03-13 15:28:49,343 [INFO] Instance 32798666: loading [552s] 8a62ad9335d7: Pull complete 2026-03-13 15:29:04,711 [INFO] Instance 32798666: loading [567s] 8a62ad9335d7: Pull complete 2026-03-13 15:29:20,039 [INFO] Instance 32798666: loading [583s] 8a62ad9335d7: Pull complete 2026-03-13 15:29:35,381 [INFO] Instance 32798666: loading [598s] 8a62ad9335d7: Pull complete 2026-03-13 15:29:50,909 [INFO] Destroyed instance 32798666 ====================================================================== FLEET DEPLOYMENT PLAN (30 GPUs) ====================================================================== 1. L40S 45GB VRAM BS=8 $0.468/hr machine=27249 rel=0.999 2. L40S 45GB VRAM BS=8 $0.601/hr machine=39312 rel=0.999 3. L40S 45GB VRAM BS=8 $0.601/hr machine=41600 rel=0.999 4. L40S 45GB VRAM BS=8 $0.604/hr machine=27442 rel=0.993 5. RTX 4090 24GB VRAM BS=1 $0.162/hr machine=56616 rel=0.976 6. RTX 4090 22GB VRAM BS=1 $0.169/hr machine=54561 rel=0.993 7. RTX 4090 24GB VRAM BS=1 $0.189/hr machine=45335 rel=0.997 8. RTX 4090 24GB VRAM BS=1 $0.201/hr machine=56333 rel=0.986 9. RTX 4090 24GB VRAM BS=1 $0.202/hr machine=27450 rel=0.997 10. RTX 4090 24GB VRAM BS=1 $0.202/hr machine=37440 rel=0.960 11. RTX 4090 24GB VRAM BS=1 $0.207/hr machine=49235 rel=0.998 12. RTX 4090 24GB VRAM BS=1 $0.213/hr machine=34876 rel=0.999 13. RTX 4090 24GB VRAM BS=1 $0.214/hr machine=56181 rel=0.982 14. RTX 4090 24GB VRAM BS=1 $0.214/hr machine=33298 rel=0.976 15. RTX 4090 24GB VRAM BS=1 $0.242/hr machine=53248 rel=0.995 16. RTX 4090 24GB VRAM BS=1 $0.268/hr machine=12341 rel=0.998 17. RTX 4090 24GB VRAM BS=1 $0.269/hr machine=55142 rel=0.992 18. RTX 4090 24GB VRAM BS=1 $0.269/hr machine=55762 rel=0.969 19. RTX 4090 24GB VRAM BS=1 $0.270/hr machine=5629 rel=0.995 20. RTX 4090 24GB VRAM BS=1 $0.270/hr machine=2217 rel=0.998 21. RTX 4090 24GB VRAM BS=1 $0.276/hr machine=53212 rel=0.941 22. RTX 4090 24GB VRAM BS=1 $0.276/hr machine=54447 rel=0.973 23. RTX 4090 24GB VRAM BS=1 $0.281/hr machine=53500 rel=0.996 24. RTX 4090 24GB VRAM BS=1 $0.294/hr machine=41846 rel=0.989 25. RTX 4090 24GB VRAM BS=1 $0.296/hr machine=54431 rel=0.996 26. RTX 4090 24GB VRAM BS=1 $0.296/hr machine=53123 rel=0.996 27. RTX 4090 24GB VRAM BS=1 $0.309/hr machine=51616 rel=0.994 28. RTX 4090 24GB VRAM BS=1 $0.309/hr machine=51520 rel=0.996 29. RTX 4090 24GB VRAM BS=1 $0.309/hr machine=41977 rel=0.998 30. RTX 4090 24GB VRAM BS=1 $0.309/hr machine=9586 rel=0.992 Total fleet cost: $8.789/hr ($210.94/day) ====================================================================== ====================================================================== DEPLOYMENT RESULT: 19/30 workers running ====================================================================== Instance 32798089: RTX 4090 BS=4 $0.201/hr PID=0 ssh5.vast.ai:38088 Instance 32798090: L40S BS=8 $0.604/hr PID=0 ssh9.vast.ai:38090 Instance 32798088: L40S BS=8 $0.601/hr PID=0 ssh5.vast.ai:38088 Instance 32798102: RTX 4090 BS=4 $0.202/hr PID=0 ssh2.vast.ai:38102 Instance 32798130: RTX 4090 BS=4 $0.213/hr PID=0 ssh3.vast.ai:38130 Instance 32798108: RTX 4090 BS=4 $0.207/hr PID=0 ssh3.vast.ai:38108 Instance 32798085: RTX 4090 BS=4 $0.162/hr PID=0 ssh8.vast.ai:38084 Instance 32798215: RTX 4090 BS=4 $0.242/hr PID=0 ssh5.vast.ai:38214 Instance 32798092: L40S BS=8 $0.601/hr PID=0 ssh3.vast.ai:38092 Instance 32798419: RTX 4090 BS=4 $0.270/hr PID=0 ssh9.vast.ai:38418 Instance 32798421: RTX 4090 BS=4 $0.276/hr PID=0 ssh6.vast.ai:38420 Instance 32798520: RTX 4090 BS=4 $0.276/hr PID=0 ssh9.vast.ai:38520 Instance 32798420: RTX 4090 BS=4 $0.270/hr PID=0 ssh2.vast.ai:38420 Instance 32798547: RTX 4090 BS=4 $0.281/hr PID=0 ssh3.vast.ai:38546 Instance 32798636: RTX 4090 BS=4 $0.296/hr PID=0 ssh7.vast.ai:38636 Instance 32798722: RTX 4090 BS=4 $0.309/hr PID=0 ssh2.vast.ai:38722 Instance 32798707: RTX 4090 BS=4 $0.309/hr PID=0 ssh7.vast.ai:38706 Instance 32798670: RTX 4090 BS=4 $0.309/hr PID=0 ssh4.vast.ai:38670 Instance 32798678: RTX 4090 BS=4 $0.309/hr PID=0 ssh3.vast.ai:38678 11 instance(s) failed to provision ======================================================================