o ٷiA@sddlmZmZddlmZddlmZddlmZm Z ddl m Z ddl m Z ddlmZddlmZe eZdd d Zd d ZeGddde ZeGdddeZdS)) dataclassfield)AnyN)AsyncEngineArgs EngineArgs) init_logger)is_gguf)OmniModelConfig)load_omni_general_pluginsreturnc Csxzddlm}ddlm}Wnty'}z td|WYd}~dSd}~wwz |d|WdSty;YdSw)Nr) AutoConfig)Qwen3TTSConfigzPzOmniEngineArgs.__post_init__cCt|drdStd|_dSN_omni_models_registeredThasattrr(rFr?rrr_ensure_omni_models_registeredT z-OmniEngineArgs._ensure_omni_models_registeredcCt|jr d|_|_tjstd|j| t |di}t |dd}t |dd}t |di}t |dd}t |d d }t |d d }t |d d }t |dd} t |dd} t |dd} t |dd } t |dd} |j dd|j di d}|j|dd<tdKid|jd|jd|jd|jd|jd |jd!|jd"|jd#|jd$|jd%|jd&|jd'|jd(|jd)|jd*|jd+|jd,|jd-|jd.|j d/|j!d0|j"d1|j#d2|j$d3|j%d4|j&d5|j'd6|j(d7|j)d|d|d|d|d|d8|j*d |d |d |d| d| d| d| d9|j+d:|j,d;|j-d<|j.d=|j/d>|j0d?|j1d@|j2d| dA|j3d|jdB|j4dC|j5dD|j6dE|j7dF|j8dG|j9dH|j:dI|dJ|j;}|j<|j=_<|SLzCreate an OmniModelConfig from these engine arguments. Returns: OmniModelConfig instance with all configuration fields set ggufzThe global random seed is set to %d. Since VLLM_ENABLE_V1_MULTIPROCESSING is set to False, this may affect the random state of the Python process that launched vLLM.limit_mm_per_promptenable_mm_embedsFinterleave_mm_stringsmedia_io_kwargsskip_mm_profilingmm_processor_kwargsNmm_processor_cache_gbmm_processor_cache_typemm_shm_cache_max_object_size_mbmm_encoder_onlymm_encoder_tp_modeweightsmm_encoder_attn_backendvideo_pruning_rategnameSharedMemoryConnectorextra)r^r`r+model model_weightshf_config_pathrunnerconvert tokenizertokenizer_modetrust_remote_codeallowed_local_media_pathallowed_media_domainsdtypeseedrevision code_revisionhf_token hf_overridestokenizer_revision max_model_len quantizationallow_deprecated_quantization enforce_eagerenable_return_routed_experts max_logprobs logprobs_modedisable_sliding_windowdisable_cascade_attnskip_tokenizer_initenable_prompt_embedsserved_model_name config_format pooler_configlogits_processor_patterngeneration_configoverride_generation_configenable_sleep_mode model_imploverride_attention_dtypelogits_processorsio_processor_pluginr6r-r/r9r0r1r2stage_connector_configr7r>rrars load_formatenvsVLLM_ENABLE_V1_MULTIPROCESSINGrrrlrIgetattrr5getcopyr+r rbrcrdrerfrgrhrirjrkrmrnrorprqrrrtrurvrwrxryrzr{r|r}r~rrrrrrrrrr6r-r/r9r0r1r2r7 architectures hf_configr@rNrOrPrQrRrSrTrVrWrYrZr\r]r omni_configrrrcreate_model_config[0                      !"#$%&'()*+,-./012345789:;<=>?@ Bz"OmniEngineArgs.create_model_configr N__name__ __module__ __qualname____doc__r+int__annotations__r-strr/r0r1r2rdictr5rr6boolr7r8r9r>rIr r __classcell__rrrArr*.s     r*cr))AsyncOmniEngineArgsa_Async engine arguments for omni models, extending base AsyncEngineArgs. Adds omni-specific configuration fields for multi-stage pipeline processing and output type specification in async contexts. Args: stage_id: Identifier for the stage in a multi-stage pipeline (default: 0) model_stage: Stage type identifier, e.g., "thinker" or "talker" (default: "thinker") model_arch: Model architecture name (default: "Qwen2_5OmniForConditionalGeneration") engine_output_type: Optional output type specification for the engine. Used to route outputs to appropriate processors (e.g., "image", "audio", "latents"). If None, output type is inferred. stage_connector_spec: Extra configuration for stage connector worker_type: Model Type, e.g., "ar" or "generation" rr+r,r-r.r/Nr0r1r2r3r5Fr6r7r8r9r cr:r;r<r?rArrr>rCz!AsyncOmniEngineArgs.__post_init__cCrDrErGr?rrrrIrJz2AsyncOmniEngineArgs._ensure_omni_models_registeredcCrKrLrrrrrrrz'AsyncOmniEngineArgs.create_model_configrrrrrArrs     rr) dataclassesrrtypingr vllm.envsrvllm.engine.arg_utilsrr vllm.loggerr"vllm.transformers_utils.gguf_utilsrvllm_omni.configr vllm_omni.pluginsr rrrr(r*rrrrrs         !