o پiN@sdZddlZddlZeddlmmZddlm Z m Z dZ dZ ej jZddZeej _eZdd ed ed efd d ZdS)z Do some monkey patch to make the documentation compilation faster and more reliable. - Avoid port conflicts - Reduce the server launch time N)execute_shell_command reserve_portiPcCs2t||jdur t|_|jdurt|_d|_dS)N)_original_post_initmax_running_requestsDEFAULT_MAX_RUNNING_REQUESTSmax_total_tokensDEFAULT_MAX_TOTAL_TOKENScuda_graph_max_bs)selfr I/home/ubuntu/.local/lib/python3.10/site-packages/sglang/test/doc_patch.pypatched_post_inits    r0.0.0.0commandhostportcCs`|dur t|\}}nd}dtdtd}|d|d|}t|}|dur,|t|<||fS)zj Launch the server using the given command. If no port is specified, a free port is reserved. Nz--max-running-requests z --max-total-tokens z --cuda-graph-max-bs 4z --port  )rrr rprocess_socket_map)rrr lock_socket extra_flags full_commandprocessr r rlaunch_server_cmd%sr)rN)__doc__weakref nest_asyncioapplysglang.srt.server_argssrt server_argsserver_args_mod sglang.utilsrrrr ServerArgs __post_init__rrWeakKeyDictionaryrstrintrr r r rs