--- pid: 1640797 cwd: "/home/ubuntu/bench-codecs" command: "sleep 60 && cd /home/ubuntu/bench-codecs && export $(grep -v '^#' .env | xargs) && export VAST_KEY=\"$VAST_API\" && python3 scripts/deploy_fleet.py --deploy --num-gpus 15 --max-price 1.00" started_at: 2026-03-14T07:27:36.502Z running_for_seconds: 720 --- 2026-03-14 07:28:37,076 [INFO] RTX 4090: 49 offers available 2026-03-14 07:28:37,540 [INFO] RTX 3090: 48 offers available 2026-03-14 07:28:37,877 [INFO] RTX 3090 Ti: 9 offers available 2026-03-14 07:28:38,219 [INFO] L40S: 7 offers available 2026-03-14 07:28:38,529 [INFO] L40: 3 offers available 2026-03-14 07:28:38,873 [INFO] RTX 4080: 6 offers available 2026-03-14 07:28:39,209 [INFO] RTX 4080S: 13 offers available 2026-03-14 07:28:39,569 [INFO] RTX A6000: 10 offers available 2026-03-14 07:28:39,931 [INFO] RTX A5000: 24 offers available 2026-03-14 07:28:39,931 [INFO] Provisioning 15 instances (8 at a time)... 2026-03-14 07:28:40,866 [INFO] Created instance 32835629: RTX 4090 @ $0.207/hr (BS=4) 2026-03-14 07:28:40,918 [INFO] Created instance 32835630: RTX 4090 @ $0.202/hr (BS=4) 2026-03-14 07:28:40,925 [INFO] Created instance 32835632: RTX 4090 @ $0.162/hr (BS=4) 2026-03-14 07:28:40,942 [INFO] Created instance 32835631: RTX 4090 @ $0.202/hr (BS=4) 2026-03-14 07:28:40,974 [INFO] Created instance 32835627: RTX 4090 @ $0.201/hr (BS=4) 2026-03-14 07:28:40,976 [INFO] Created instance 32835634: RTX 4090 @ $0.189/hr (BS=4) 2026-03-14 07:28:40,993 [INFO] Created instance 32835633: RTX 4090 @ $0.169/hr (BS=4) 2026-03-14 07:28:41,034 [INFO] Created instance 32835628: RTX 4090 @ $0.202/hr (BS=4) 2026-03-14 07:28:41,159 [INFO] Instance 32835629: pending [0s] 2026-03-14 07:28:41,464 [INFO] Instance 32835630: pending [0s] 2026-03-14 07:28:41,512 [INFO] Instance 32835632: pending [0s] 2026-03-14 07:28:41,621 [INFO] Instance 32835634: pending [0s] 2026-03-14 07:28:41,630 [INFO] Instance 32835631: pending [0s] 2026-03-14 07:28:41,640 [INFO] Instance 32835628: pending [0s] 2026-03-14 07:28:41,663 [INFO] Instance 32835633: pending [0s] 2026-03-14 07:28:41,716 [INFO] Instance 32835627: pending [0s] 2026-03-14 07:28:56,452 [INFO] Instance 32835629 running at ssh7.vast.ai:35628 — onstart worker auto-launching 2026-03-14 07:28:56,768 [INFO] Instance 32835630: loading [15s] 2026-03-14 07:28:56,825 [INFO] Instance 32835632: loading [15s] 2026-03-14 07:28:56,986 [INFO] Created instance 32835647: RTX 4090 @ $0.213/hr (BS=4) 2026-03-14 07:28:57,038 [INFO] Instance 32835634: pending [16s] 2026-03-14 07:28:57,112 [INFO] Instance 32835628: loading [16s] 2026-03-14 07:28:57,117 [INFO] Instance 32835631: pending [16s] 2026-03-14 07:28:57,120 [INFO] Instance 32835633: pending [16s] 2026-03-14 07:28:57,138 [INFO] Instance 32835627: loading [16s] WARNING! Your credentials are stored unencrypted in 'configs/C.32835627/config. 2026-03-14 07:28:57,265 [INFO] Instance 32835647: pending [0s] 2026-03-14 07:29:12,075 [INFO] Instance 32835630: loading [31s] 2026-03-14 07:29:12,132 [INFO] Instance 32835632: loading [31s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:29:12,345 [INFO] Instance 32835634: pending [31s] 2026-03-14 07:29:12,485 [INFO] Instance 32835628 running at ssh7.vast.ai:35628 — onstart worker auto-launching 2026-03-14 07:29:12,496 [INFO] Instance 32835631: loading [31s] d37d3e41b908: Verifying Checksum 2026-03-14 07:29:12,502 [INFO] Instance 32835627 running at ssh5.vast.ai:35626 — onstart worker auto-launching 2026-03-14 07:29:12,504 [INFO] Instance 32835633: pending [31s] 2026-03-14 07:29:12,591 [INFO] Instance 32835647: pending [15s] 2026-03-14 07:29:12,974 [INFO] Created instance 32835660: RTX 4090 @ $0.214/hr (BS=4) 2026-03-14 07:29:13,053 [INFO] Created instance 32835661: RTX 4090 @ $0.216/hr (BS=4) 2026-03-14 07:29:13,261 [INFO] Instance 32835660: pending [0s] 2026-03-14 07:29:13,367 [INFO] Instance 32835661: pending [0s] 2026-03-14 07:29:27,368 [INFO] Instance 32835630: loading [46s] success, running bharathkumar192/codecbench-sft_latest/ssh 2026-03-14 07:29:27,443 [INFO] Instance 32835632 running at ssh1.vast.ai:35632 — onstart worker auto-launching 2026-03-14 07:29:27,681 [INFO] Instance 32835634: pending [46s] 2026-03-14 07:29:27,857 [INFO] Instance 32835631: loading [46s] 0f48b7ff7db5: Verifying Checksum 2026-03-14 07:29:27,860 [INFO] Instance 32835633: pending [46s] 2026-03-14 07:29:27,916 [INFO] Instance 32835647 running at ssh5.vast.ai:35646 — onstart worker auto-launching 2026-03-14 07:29:27,960 [INFO] Created instance 32835668: RTX 4090 @ $0.227/hr (BS=4) 2026-03-14 07:29:28,263 [INFO] Instance 32835668: pending [0s] 2026-03-14 07:29:28,463 [INFO] Created instance 32835669: RTX 4090 @ $0.228/hr (BS=4) 2026-03-14 07:29:28,554 [INFO] Instance 32835660: loading [15s] WARNING! Your credentials are stored unencrypted in 'configs/C.32835660/config. 2026-03-14 07:29:28,682 [INFO] Instance 32835661: pending [15s] 2026-03-14 07:29:28,772 [INFO] Instance 32835669: pending [0s] 2026-03-14 07:29:42,702 [INFO] Instance 32835630 running at ssh8.vast.ai:35630 — onstart worker auto-launching 2026-03-14 07:29:42,970 [INFO] Instance 32835634: pending [61s] 2026-03-14 07:29:43,196 [INFO] Created instance 32835687: RTX 4090 @ $0.241/hr (BS=4) 2026-03-14 07:29:43,211 [INFO] Instance 32835631: loading [62s] 0f48b7ff7db5: Verifying Checksum 2026-03-14 07:29:43,213 [INFO] Instance 32835633: pending [62s] 2026-03-14 07:29:43,473 [INFO] Instance 32835687: pending [0s] 2026-03-14 07:29:43,568 [INFO] Instance 32835668: loading [15s] 2026-03-14 07:29:43,851 [INFO] Instance 32835660: created [30s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:29:43,998 [INFO] Instance 32835661 running at ssh3.vast.ai:35660 — onstart worker auto-launching 2026-03-14 07:29:44,071 [INFO] Instance 32835669: loading [15s] WARNING! Your credentials are stored unencrypted in 'configs/C.32835669/config. 2026-03-14 07:29:44,574 [INFO] Created instance 32835688: RTX 4090 @ $0.249/hr (BS=4) 2026-03-14 07:29:44,874 [INFO] Instance 32835688: pending [0s] 2026-03-14 07:29:58,285 [INFO] Instance 32835634: pending [77s] 2026-03-14 07:29:58,522 [INFO] Instance 32835633: pending [77s] 2026-03-14 07:29:58,589 [INFO] Instance 32835631: loading [77s] 0f48b7ff7db5: Verifying Checksum 2026-03-14 07:29:58,753 [INFO] Instance 32835687: loading [15s] 2026-03-14 07:29:58,847 [INFO] Instance 32835668: loading [30s] Removing login credentials for https://index.docker.io/v1/ 2026-03-14 07:29:59,144 [INFO] Instance 32835660: created [46s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:29:59,397 [INFO] Instance 32835669 running at ssh5.vast.ai:35668 — onstart worker auto-launching 2026-03-14 07:30:00,223 [INFO] Instance 32835688: loading [15s] 2026-03-14 07:30:13,582 [INFO] Instance 32835634: pending [92s] 2026-03-14 07:30:13,834 [INFO] Instance 32835633: pending [92s] 2026-03-14 07:30:13,896 [INFO] Instance 32835631: loading [92s] a14a8a8a6ebc: Verifying Checksum 2026-03-14 07:30:14,073 [INFO] Instance 32835687 running at ssh9.vast.ai:35686 — onstart worker auto-launching 2026-03-14 07:30:14,162 [INFO] Instance 32835668: loading [46s] docker login failed! 2026-03-14 07:30:14,454 [INFO] Instance 32835660: created [61s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:30:15,539 [INFO] Instance 32835688 running at ssh1.vast.ai:35688 — onstart worker auto-launching 2026-03-14 07:30:28,887 [INFO] Instance 32835634: pending [107s] 2026-03-14 07:30:29,159 [INFO] Instance 32835633: pending [108s] 2026-03-14 07:30:29,209 [INFO] Instance 32835631: loading [108s] 8a62ad9335d7: Pull complete 2026-03-14 07:30:29,451 [INFO] Instance 32835668: loading [61s] docker login failed! 2026-03-14 07:30:29,808 [INFO] Instance 32835660: created [76s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:30:44,206 [INFO] Instance 32835634: pending [123s] 2026-03-14 07:30:44,464 [INFO] Instance 32835633: pending [123s] 2026-03-14 07:30:44,517 [INFO] Instance 32835631: loading [123s] 8a62ad9335d7: Pull complete 2026-03-14 07:30:44,759 [INFO] Instance 32835668: loading [76s] docker login failed! 2026-03-14 07:30:45,137 [INFO] Instance 32835660: created [92s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:30:59,512 [INFO] Instance 32835634: pending [138s] 2026-03-14 07:30:59,768 [INFO] Instance 32835633: pending [138s] 2026-03-14 07:30:59,816 [INFO] Instance 32835631: loading [138s] bfce1374bac7: Verifying Checksum 2026-03-14 07:31:00,106 [INFO] Instance 32835668: loading [92s] Removing login credentials for https://index.docker.io/v1/ 2026-03-14 07:31:00,433 [INFO] Instance 32835660: created [107s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:31:14,826 [INFO] Instance 32835634: pending [153s] 2026-03-14 07:31:15,062 [INFO] Instance 32835633: pending [154s] 2026-03-14 07:31:15,131 [INFO] Instance 32835631: loading [154s] bfce1374bac7: Verifying Checksum 2026-03-14 07:31:15,423 [INFO] Instance 32835668: loading [107s] docker login failed! 2026-03-14 07:31:15,756 [INFO] Instance 32835660: created [122s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:31:30,152 [INFO] Instance 32835634: pending [169s] 2026-03-14 07:31:30,376 [INFO] Instance 32835633: pending [169s] 2026-03-14 07:31:30,438 [INFO] Instance 32835631: loading [169s] bfce1374bac7: Verifying Checksum 2026-03-14 07:31:30,734 [INFO] Instance 32835668: loading [122s] docker login failed! 2026-03-14 07:31:31,063 [INFO] Instance 32835660: created [138s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:31:45,531 [INFO] Instance 32835634: pending [184s] 2026-03-14 07:31:45,689 [INFO] Instance 32835633: pending [184s] 2026-03-14 07:31:45,753 [INFO] Instance 32835631: loading [184s] Reading package lists... 2026-03-14 07:31:46,042 [INFO] Instance 32835668: loading [138s] docker login failed! 2026-03-14 07:31:46,363 [INFO] Instance 32835660: created [153s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:32:00,846 [INFO] Instance 32835634: pending [199s] 2026-03-14 07:32:00,996 [INFO] Instance 32835633: pending [200s] 2026-03-14 07:32:01,069 [INFO] Instance 32835631 running at ssh7.vast.ai:35630 — onstart worker auto-launching 2026-03-14 07:32:01,469 [INFO] Instance 32835668: loading [153s] Removing login credentials for https://index.docker.io/v1/ 2026-03-14 07:32:01,886 [INFO] Instance 32835660: created [168s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:32:16,141 [INFO] Instance 32835634: pending [215s] 2026-03-14 07:32:16,293 [INFO] Instance 32835633: pending [215s] 2026-03-14 07:32:16,758 [INFO] Instance 32835668: loading [168s] Removing login credentials for https://index.docker.io/v1/ 2026-03-14 07:32:17,201 [INFO] Instance 32835660: created [184s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:32:31,451 [INFO] Instance 32835634: pending [230s] 2026-03-14 07:32:31,578 [INFO] Instance 32835633: pending [230s] 2026-03-14 07:32:32,057 [INFO] Instance 32835668: loading [184s] docker login failed! 2026-03-14 07:32:32,523 [INFO] Instance 32835660: created [199s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:32:46,762 [INFO] Instance 32835634: pending [245s] 2026-03-14 07:32:46,896 [INFO] Instance 32835633: pending [245s] 2026-03-14 07:32:47,350 [INFO] Instance 32835668: loading [199s] docker login failed! 2026-03-14 07:32:47,838 [INFO] Instance 32835660: created [214s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:33:02,356 [INFO] Instance 32835633: pending [261s] 2026-03-14 07:33:02,361 [INFO] Instance 32835634: pending [261s] 2026-03-14 07:33:02,693 [INFO] Instance 32835668: loading [214s] docker login failed! 2026-03-14 07:33:03,165 [INFO] Instance 32835660: created [230s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:33:17,695 [INFO] Instance 32835633: pending [276s] 2026-03-14 07:33:17,698 [INFO] Instance 32835634: pending [276s] 2026-03-14 07:33:18,007 [INFO] Instance 32835668: loading [230s] Removing login credentials for https://index.docker.io/v1/ 2026-03-14 07:33:18,475 [INFO] Instance 32835660: created [245s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:33:33,067 [INFO] Instance 32835633: pending [292s] 2026-03-14 07:33:33,071 [INFO] Instance 32835634: pending [292s] 2026-03-14 07:33:33,328 [INFO] Instance 32835668: loading [245s] docker login failed! 2026-03-14 07:33:33,759 [INFO] Instance 32835660: created [260s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:33:48,375 [INFO] Instance 32835634: pending [307s] 2026-03-14 07:33:48,378 [INFO] Instance 32835633: pending [307s] 2026-03-14 07:33:48,642 [INFO] Instance 32835668: loading [260s] docker login failed! 2026-03-14 07:33:49,058 [INFO] Instance 32835660: created [276s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:34:03,692 [INFO] Instance 32835633: pending [322s] 2026-03-14 07:34:03,701 [INFO] Instance 32835634: pending [322s] 2026-03-14 07:34:03,960 [INFO] Instance 32835668: loading [275s] docker login failed! 2026-03-14 07:34:04,369 [INFO] Instance 32835660: created [291s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:34:19,059 [INFO] Instance 32835634: pending [338s] 2026-03-14 07:34:19,066 [INFO] Instance 32835633: pending [338s] 2026-03-14 07:34:19,250 [INFO] Instance 32835668: loading [291s] docker login failed! 2026-03-14 07:34:19,696 [INFO] Instance 32835660: created [306s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:34:34,413 [INFO] Instance 32835634: pending [353s] 2026-03-14 07:34:34,416 [INFO] Instance 32835633: pending [353s] 2026-03-14 07:34:34,563 [INFO] Instance 32835668: loading [306s] docker login failed! 2026-03-14 07:34:35,003 [INFO] Instance 32835660: created [322s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:34:49,784 [INFO] Instance 32835634: pending [368s] 2026-03-14 07:34:49,798 [INFO] Instance 32835633: pending [368s] 2026-03-14 07:34:49,855 [INFO] Instance 32835668: loading [321s] docker login failed! 2026-03-14 07:34:50,298 [INFO] Instance 32835660: created [337s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:35:05,162 [INFO] Instance 32835634: pending [384s] 2026-03-14 07:35:05,168 [INFO] Instance 32835633: pending [384s] 2026-03-14 07:35:05,180 [INFO] Instance 32835668: loading [337s] docker login failed! 2026-03-14 07:35:05,624 [INFO] Instance 32835660: created [352s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:35:20,534 [INFO] Instance 32835633: pending [399s] 2026-03-14 07:35:20,535 [INFO] Instance 32835634: pending [399s] 2026-03-14 07:35:20,547 [INFO] Instance 32835668: loading [352s] docker login failed! 2026-03-14 07:35:20,912 [INFO] Instance 32835660: created [367s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:35:35,878 [INFO] Instance 32835634: pending [414s] 2026-03-14 07:35:35,900 [INFO] Instance 32835633: pending [414s] 2026-03-14 07:35:35,919 [INFO] Instance 32835668: loading [367s] docker login failed! 2026-03-14 07:35:36,212 [INFO] Instance 32835660: created [383s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:35:51,196 [INFO] Instance 32835634: pending [430s] 2026-03-14 07:35:51,301 [INFO] Instance 32835668: loading [383s] docker login failed! 2026-03-14 07:35:51,310 [INFO] Instance 32835633: pending [430s] 2026-03-14 07:35:51,498 [INFO] Instance 32835660: created [398s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:36:06,530 [INFO] Instance 32835634: pending [445s] 2026-03-14 07:36:06,640 [INFO] Instance 32835668: loading [398s] docker login failed! 2026-03-14 07:36:06,665 [INFO] Instance 32835633: pending [445s] 2026-03-14 07:36:06,808 [INFO] Instance 32835660: created [413s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:36:21,845 [INFO] Instance 32835634: pending [460s] 2026-03-14 07:36:21,967 [INFO] Instance 32835668: loading [414s] docker login failed! 2026-03-14 07:36:21,983 [INFO] Instance 32835633: pending [460s] 2026-03-14 07:36:22,119 [INFO] Instance 32835660: created [429s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:36:37,159 [INFO] Instance 32835634: pending [476s] 2026-03-14 07:36:37,329 [INFO] Instance 32835668: loading [429s] docker login failed! 2026-03-14 07:36:37,360 [INFO] Instance 32835633: pending [476s] 2026-03-14 07:36:37,405 [INFO] Instance 32835660: created [444s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:36:52,451 [INFO] Instance 32835634: pending [491s] 2026-03-14 07:36:52,669 [INFO] Instance 32835668: loading [444s] docker login failed! 2026-03-14 07:36:52,740 [INFO] Instance 32835633: pending [491s] 2026-03-14 07:36:52,756 [INFO] Instance 32835660: created [459s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:37:07,777 [INFO] Instance 32835634: pending [506s] 2026-03-14 07:37:07,983 [INFO] Instance 32835668: loading [460s] docker login failed! 2026-03-14 07:37:08,056 [INFO] Instance 32835633: pending [507s] 2026-03-14 07:37:08,096 [INFO] Instance 32835660: created [475s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:37:23,088 [INFO] Instance 32835634: pending [522s] 2026-03-14 07:37:23,289 [INFO] Instance 32835668: loading [475s] docker login failed! 2026-03-14 07:37:23,377 [INFO] Instance 32835633: pending [522s] 2026-03-14 07:37:23,446 [INFO] Instance 32835660: created [490s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:37:38,391 [INFO] Instance 32835634: pending [537s] 2026-03-14 07:37:38,600 [INFO] Instance 32835668: loading [490s] docker login failed! 2026-03-14 07:37:38,674 [INFO] Instance 32835633: pending [537s] 2026-03-14 07:37:38,768 [INFO] Instance 32835660: created [505s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:37:53,688 [INFO] Instance 32835634: pending [552s] 2026-03-14 07:37:53,918 [INFO] Instance 32835668: loading [505s] docker login failed! 2026-03-14 07:37:53,985 [INFO] Instance 32835633: pending [552s] 2026-03-14 07:37:54,070 [INFO] Instance 32835660: created [521s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:38:09,008 [INFO] Instance 32835634: pending [568s] 2026-03-14 07:38:09,221 [INFO] Instance 32835668: loading [521s] docker login failed! 2026-03-14 07:38:09,282 [INFO] Instance 32835633: pending [568s] 2026-03-14 07:38:09,396 [INFO] Instance 32835660: created [536s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:38:24,315 [INFO] Instance 32835634: pending [583s] 2026-03-14 07:38:24,534 [INFO] Instance 32835668: loading [536s] docker login failed! 2026-03-14 07:38:24,592 [INFO] Instance 32835633: pending [583s] 2026-03-14 07:38:24,731 [INFO] Instance 32835660: created [551s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:38:39,616 [INFO] Instance 32835634: pending [598s] 2026-03-14 07:38:39,831 [INFO] Instance 32835668: loading [551s] docker login failed! 2026-03-14 07:38:39,896 [INFO] Instance 32835633: pending [598s] 2026-03-14 07:38:40,063 [INFO] Instance 32835660: created [567s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:38:55,141 [INFO] Instance 32835668: loading [567s] docker login failed! 2026-03-14 07:38:55,196 [INFO] Destroyed instance 32835634 2026-03-14 07:38:55,364 [INFO] Instance 32835660: created [582s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:38:55,385 [INFO] Destroyed instance 32835633 2026-03-14 07:39:10,469 [INFO] Instance 32835668: loading [582s] docker login failed! 2026-03-14 07:39:10,704 [INFO] Instance 32835660: created [597s] Successfully loaded bharathkumar192/codecbench-sft:latest 2026-03-14 07:39:25,767 [INFO] Instance 32835668: loading [597s] docker login failed! 2026-03-14 07:39:26,262 [INFO] Destroyed instance 32835660 2026-03-14 07:39:41,287 [INFO] Destroyed instance 32835668 ====================================================================== FLEET DEPLOYMENT PLAN (15 GPUs) ====================================================================== 1. RTX 4090 24GB VRAM BS=1 $0.162/hr machine=53250 rel=0.996 2. RTX 4090 22GB VRAM BS=1 $0.169/hr machine=54561 rel=0.993 3. RTX 4090 24GB VRAM BS=1 $0.189/hr machine=45335 rel=0.997 4. RTX 4090 24GB VRAM BS=1 $0.201/hr machine=56333 rel=0.988 5. RTX 4090 24GB VRAM BS=1 $0.202/hr machine=27450 rel=0.997 6. RTX 4090 24GB VRAM BS=1 $0.202/hr machine=28080 rel=0.976 7. RTX 4090 24GB VRAM BS=1 $0.202/hr machine=46798 rel=0.968 8. RTX 4090 24GB VRAM BS=1 $0.207/hr machine=49235 rel=0.998 9. RTX 4090 24GB VRAM BS=1 $0.213/hr machine=34876 rel=0.999 10. RTX 4090 24GB VRAM BS=1 $0.214/hr machine=33298 rel=0.977 11. RTX 4090 24GB VRAM BS=1 $0.216/hr machine=52890 rel=0.980 12. RTX 4090 24GB VRAM BS=1 $0.227/hr machine=23341 rel=0.994 13. RTX 4090 24GB VRAM BS=1 $0.228/hr machine=57277 rel=0.947 14. RTX 4090 24GB VRAM BS=1 $0.241/hr machine=53303 rel=0.997 15. RTX 4090 24GB VRAM BS=1 $0.249/hr machine=57276 rel=0.947 Total fleet cost: $3.122/hr ($74.93/day) ====================================================================== ====================================================================== DEPLOYMENT RESULT: 11/15 workers running ====================================================================== Instance 32835629: RTX 4090 BS=4 $0.207/hr PID=0 ssh7.vast.ai:35628 Instance 32835628: RTX 4090 BS=4 $0.202/hr PID=0 ssh7.vast.ai:35628 Instance 32835627: RTX 4090 BS=4 $0.201/hr PID=0 ssh5.vast.ai:35626 Instance 32835632: RTX 4090 BS=4 $0.162/hr PID=0 ssh1.vast.ai:35632 Instance 32835647: RTX 4090 BS=4 $0.213/hr PID=0 ssh5.vast.ai:35646 Instance 32835630: RTX 4090 BS=4 $0.202/hr PID=0 ssh8.vast.ai:35630 Instance 32835661: RTX 4090 BS=4 $0.216/hr PID=0 ssh3.vast.ai:35660 Instance 32835669: RTX 4090 BS=4 $0.228/hr PID=0 ssh5.vast.ai:35668 Instance 32835687: RTX 4090 BS=4 $0.241/hr PID=0 ssh9.vast.ai:35686 Instance 32835688: RTX 4090 BS=4 $0.249/hr PID=0 ssh1.vast.ai:35688 Instance 32835631: RTX 4090 BS=4 $0.202/hr PID=0 ssh7.vast.ai:35630 4 instance(s) failed to provision ====================================================================== --- exit_code: 0 elapsed_ms: 724836 ended_at: 2026-03-14T07:39:41.338Z ---