o پiH"@s0ddlZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl Z ddl Z ddl Z e eZd&dedefddZded ed efd d Zd ed efddZddZddZ d'de jde jdededed ee jeff ddZe ddd efddZd d!ZeZ d(ded#ed efd$d%Z!dS))N) lru_cacheTinclude_parentskip_pidc Cstturttjtj|durt}d}zt |}Wn tj y,YdSw|j dd}|D]}|j |kr=q5z| Wq5tj yMYq5w|rxz|tkr`| td| |tjWdStj ywYdSwdS)z-Kill the process and all its child processes.NFT) recursiver) threadingcurrent_thread main_threadsignalSIGCHLDSIG_DFLosgetpidpsutilProcess NoSuchProcesschildrenpidkillsysexit send_signalSIGQUIT) parent_pidrritselfrchildr^/home/ubuntu/.local/lib/python3.10/site-packages/sglang/multimodal_gen/runtime/utils/common.pykill_process_trees<     rnameprefixreturncCs|s|S|d|S)aAdd a weight path prefix to a module name. Args: name: base module name. prefix: weight prefix str to added to the front of `name` concatenated with `.`. Returns: The string `prefix.name` if prefix is non-empty, otherwise just `name`. .r)rrrrr add_prefix<s r"addresscCs&zt|WdStyYdSw)NTF) ipaddress IPv6Address ValueError)r#rrris_valid_ipv6_addressIs   r'cCs|}|d}|dkrtd|d|d}t|d|s&td|d}t||dkrE||ddkrA||dd}ntd|sKtd z t|}W||fStyctd |d w) N]z(invalid IPv6 address format: missing ']'zinvalid IPv6 address: :z4received IPv6 address format: expected ':' after ']'z>a port must be specified in IPv6 address (format: [ipv6]:port)zinvalid port in IPv6 address: '')findr&r'lenint)dist_init_addraddrendhostport_strportrrrconfigure_ipv6Qs,   r7c Csttjtj@}z|tjtjd|d|f|dWWddStjy8YWddSt yGYWddSw1sKwYdS)z#Return whether a port is available.r*NTF) socketAF_INET SOCK_STREAM setsockopt SOL_SOCKET SO_REUSEADDRbindlistenerror OverflowError)r6srrris_port_availableqs  rD context socket_typeendpointr?max_bind_retriescspt}|jd}|jd}|dkr|dkrtdnd|||ddkr0tj dfdd }fd d } |tj krG|n#|tj krP| n|tj tj tjtjfvrc|| ntd ||r/d dl} | d|} | r&|dkr&t| d} d} t|D]}zQ|}|d kr| |d}| dd||}td| |ddd|d|dd|d ||d krtd|d|dd| d|fWStjy}z/|} |jtjkr||dkrWYd}~q||dkrtd|d|d| |dd}~ww| r"| |fS||fS||fS)a Create and configure a ZMQ socket. Args: context: ZMQ context socket_type: Type of ZMQ socket endpoint: Endpoint string (e.g., "tcp://localhost:5555") bind: Whether to bind (True) or connect (False) max_bind_retries: Maximum number of retries if bind fails due to address already in use Returns: A tuple of (socket, actual_endpoint). The actual_endpoint may differ from the requested endpoint if bind retry was needed. i@ gAr)[r*c tjdtjdSNr)r<zmqSNDHWMSNDBUFrbuf_sizer9rr set_send_optz$get_zmq_socket..set_send_optcrMrN)r<rORCVHWMRCVBUFrrRrr set_recv_optrUz$get_zmq_socket..set_recv_optzUnsupported socket type: rNz:(\d+)$*r+zZMQ bind failed for port z, retrying with port z (attempt /)z!Successfully bound ZMQ socket to z after z attempts. Original port z was unavailable.z Failed to bind ZMQ socket after z attempts. Original endpoint: z, Last tried port: )rvirtual_memorytotal availabler0r9r.r<rOIPV6PUSHPULLDEALERREQREPROUTERr&researchgrouprangesubloggerinfor?warningZMQErrorerrno EADDRINUSErAconnect)rFrGrHr?rImem total_mem available_memrTrXrf port_match original_portlast_exceptionattemptcurrent_endpoint current_porterrRrget_zmq_sockets               r|r*)maxsizecCs(t}|dvottdotjS)N)x86_64amd64i386i686cpu)platformmachinelowerhasattrtorchr is_available)rrrris_host_cpu_x86s rcCsBtj}|dd|d}||dkrdndtjd<dS)Nrr!r*z9.0z+PTXr8TORCH_CUDA_ARCH_LIST)rcudaget_device_capabilityr environ) capabilityarchrrr set_cuda_archs "rfalsedefaultcCsnt||}t|}hd}hd}||vr3||vr3|tvr.td|d|dt|||vS)N>1tyonyestrue>r80fnnooffrzget_bool_env_var(z) see non-understandable value=z and treat as false) r getenvstrstripr_warned_bool_env_var_keysrkrmadd)rrvalue truthy_values falsy_valuesrrrget_bool_env_var s  r)TN)rE)r)"r$loggingr rr r9rr functoolsrrrrO getLogger__name__rkboolr0rrr"r'r7rDContext SocketTypetupleSocketr|rrsetrrrrrrsJ  '    v