o پiu@s@ddlmZmZddlmZddlmZmZGdddeZdS))ListUnion)Llama4ForConditionalGeneration)BaseMultimodalProcessorMultimodalSpecialTokenscs<eZdZegZfddZdeeee ffddZ Z S)Mllama4ImageProcessorcsbtj|||g|Ri||j|_|j|_|j|_|j|_|j|_ t |j |j d ||_ dS)N) image_tokenimage_token_id)super__init__ vision_config text_configboi_token_indexIM_START_TOKEN_IDeoi_token_indexIM_END_TOKEN_IDimage_token_index IM_TOKEN_IDrrbuild mm_tokens)self hf_config server_args _processorargskwargs __class__\/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/multimodal/processors/mllama4.pyr szMllama4ImageProcessor.__init__ image_datac sB|j|||jd}|||j\}}}|||j|j|jdS)N)promptr multimodal_tokens) input_idsmm_items im_start_id im_end_id im_token_id) load_mm_datarprocess_and_combine_mm_datatolistrrr) rr input_textrr base_outputr$r#_rrrprocess_mm_data_asyncs z+Mllama4ImageProcessor.process_mm_data_async) __name__ __module__ __qualname__rmodelsr rrstrbytesr. __classcell__rrrrr s   rN) typingrrsglang.srt.models.mllama4r/sglang.srt.multimodal.processors.base_processorrrrrrrrs