o ۾iT@sUddlZddlmZmZmZddlmZeeZda da e e d<deddfdd Z deddfd d Zd aee d <dddZdeddfddZdS)N)CompilationConfigCompilationMode VllmConfig) init_loggergtorch_compile_start_time vllm_configreturncCsjta|j}|}|jtjkr1|r3ddl}|jdddt d|| | a t dSdSdS)NrT)parentsexist_okzDumping depyf output to %s)timercompilation_configcompile_debug_dump_pathmoder VLLM_COMPILEdepyfmkdirloggerdebug prepare_debugas_posixcontext_manager __enter__)rr pathrrL/home/ubuntu/.local/lib/python3.10/site-packages/vllm/compilation/monitor.pystart_monitoring_torch_compiles  rcCsJ|j}|jtjkr!tjd|jddtdur#tddddadSdSdS)Nz#torch.compile takes %.2f s in totallocal)scope) r rrrr info_oncecompilation_timer__exit__)rr rrrend_monitoring_torch_compiles r!Tcudagraph_capturing_enabledcCststddS)Nz]CUDA graph capturing detected at an inappropriate time. This operation is currently disabled.)r" RuntimeErrorrrrr$validate_cudagraph_capturing_enabled0s r$enabledcCs|adS)N)r")r%rrrset_cudagraph_capturing_enabled<sr&)rN)r vllm.configrrr vllm.loggerr__name__rrrfloat__annotations__rr!r"boolr$r&rrrrs