o i:@s ddlZddlZddlmZddlmZmZmZmZm Z ddl m Z m Z m Z mZddlmZddlmZddlmZddlmZdd lmZdd lmZdd lmZdd lmZer`dd lm Z edeedZ!edeedZ"Gddde#Z$Gddde%Z&de'e(e'dfBfddZ)ede'de*e+fddZ,ddde'e(e'dfBfdd Z-dd!ed"d#e+d$ed%e+dBd&e.de'e!e(e'e!dfBd'ede!fd(d)Z/ee/Z0ed*e!de*e+fd+d,Z1dd!ed"d#e+d$ed%e+dBd&e.de'e!e(e'e!dfBd'ede!fd-d.Z2efddde'e!e(e'e!dfBd'ede!fd/d0Z3dd!d1d#e+d$ed%e+dBd&e.d'ef d2d3Z4ee4Z5ddd'efd4d5Z6dd!d1d#e+d$ed%e+dBd&e.d'ef d6d7Z7ee7Z8ddd'efd8d9Z9dd!dd:d#e+d$ed%e+dBd&e.d;e'e"dBd'ef dd?Zr3r6r4r5)setradd)r2dynamic_kwargskwargs_type_annotationskw_typekw_annotationskw_namer"r"r#,_collect_dynamic_keys_from_processing_kwargs=s   r> model_configrc Ksl|}||}t|}t||ddd}|D]\}}t|tr(t|||<t|tr3t |||<q|S)NFT)requires_kw_onlyallow_var_kwargs) get_multimodal_configmerge_mm_processor_kwargsr1rrr/dictrlistr+) r?r-kwargs mm_config merged_kwargsfactoryallowed_kwargskeyvaluer"r"r#_merge_mm_kwargsNs      rMFrevisiontrust_remote_coder-processor_nameargsrOrPrFc Os|durd}z;t|}t|ts|tkr$tj|g|R||d|}nt|tr9|j|g|R||d|}n||i|}WntyX}z |sRd}t|||d}~wwt||sjt d|dt ||S)z:Load a processor for the given model name via HuggingFace.NmainrOrPzFailed to load the processor. If the processor is a custom processor not yet available in the HuggingFace transformers library, consider setting `trust_remote_code=True` in LLM or using the `--trust-remote-code` flag in the CLI.z6Invalid type of HuggingFace processor. Expected type: z, but found type: ) rr/r,rr r. issubclass ValueError RuntimeError TypeErrortype) rQrOrPr-rRrF processoreerr_msgr"r"r# get_processorjsZ     r]rZcCszItt|jjd}|r|jnd}|dtjfvr$tt |dWSt|j }t |}t }t|D]\}}|drF|t|B}q7|WStyUt YSw)NrFrProcessingKwargs)inspect signaturerY__call__ parametersget annotation_emptyr>rr' importlib import_moduler7varsrendswith Exception)rZ call_kwargscall_kwargs_annotations module_namemodprocessor_kwargsnameobjr"r"r##get_processor_kwargs_from_processors.      rrc sJt||||d}t|fdd|D}t|f|||d|}|S)NrNcsi|] \}}|vr||qSr"r").0kv dynamic_keysr"r# sz?cached_get_processor_without_dynamic_kwargs..)cached_get_processorrrr) rQrOrPr-rRrFrZfiltered_kwargsfinal_processorr"rvr#+cached_get_processor_without_dynamic_kwargss$ r|cKs^t|jrt|jrJd|j}|j}n|j}|j}t|f||j|dt||fi|S)Nz^For multimodal GGUF models, the original tokenizer should be used to correctly load processor.rN)rmodel tokenizertokenizer_revisionrOr|rPrM)r?r-rFr}rOr"r"r#cached_processor_from_configs"  rrTc Odzt|}tj|g|R||d|}Wnty,}z |s&d}t|||d}~wwtt|S)zMLoad an audio feature extractor for the given model name via HuggingFace.rTzFailed to load the feature extractor. If the feature extractor is a custom extractor not yet available in the HuggingFace transformers library, consider setting `trust_remote_code=True` in LLM or using the `--trust-remote-code` flag in the CLI.N)rrr.rVrWrr )rQrOrPrRrFfeature_extractorr[r\r"r"r#get_feature_extractors*    rcKs*t|jf|j|jdt|tfi|S)NrT)cached_get_feature_extractorr}rOrPrMr)r?rFr"r"r#$cached_feature_extractor_from_config+src Or)zALoad an image processor for the given model name via HuggingFace.rTzFailed to load the image processor. If the image processor is a custom processor not yet available in the HuggingFace transformers library, consider setting `trust_remote_code=True` in LLM or using the `--trust-remote-code` flag in the CLI.N)rr r.rVrWrr )rQrOrPrRrFrZr[r\r"r"r#get_image_processor7s*   rcKs\t|jrt|jrJd|j}|j}n|j}|j}t|f||jdt|tfi|S)NzdFor multimodal GGUF models, the original tokenizer should be used to correctly load image processor.rT) rr}r~rrOcached_get_image_processorrPrMr )r?rFr}rOr"r"r#"cached_image_processor_from_config^s  rrOrPprocessor_cls_overridesrc Oslzt|}|pt}|j|g|R||d|}Wnty0}z |s*d} t| ||d}~wwtt|S)z@Load a video processor for the given model name via HuggingFace.rTzFailed to load the video processor. If the video processor is a custom processor not yet available in the HuggingFace transformers library, consider setting `trust_remote_code=True` in LLM or using the `--trust-remote-code` flag in the CLI.N)rr r.rVrWrr) rQrOrPrrRrFr-rZr[r\r"r"r#get_video_processorts,    rcKs,t|jf|j|j|dt|tfi|S)Nr)cached_get_video_processorr}rOrPrMr )r?r-rFr"r"r#"cached_video_processor_from_configsrr)=rfr_ functoolsrtypingrrrrr transformersrr r r %transformers.feature_extraction_utilsr #transformers.image_processing_utilsr transformers.processing_utilsr#transformers.video_processing_utilsrtyping_extensionsr"vllm.transformers_utils.gguf_utilsrvllm.transformers_utils.utilsrvllm.utils.func_utilsr vllm.configrrrrDrrEr+rYr,r1r7strr>rMboolr]ryrrr|rrrrrrrrrrr"r"r"r#s               :$ $  $  $   &