o ۾i@s@dZddlmZddlmZGdddeZGdddeZdS) z Kimi-K2.5 Model Configuration. This configuration supports video-chunk as an internal modality type. A video-chunk is the smallest independently processable unit of video. )DeepseekV3Config)PretrainedConfigc!seZdZdZ           d#dedededededededededeeefdededededBded ef fd!d" ZZ S)$KimiK25VisionConfigkimi_k25_vision@ divided_fixedrspatial_temporal sd2_tpool patchmergerNgeluh㈵> patch_sizeinit_pos_emb_heightinit_pos_emb_widthinit_pos_emb_time pos_emb_typenum_attention_headsnum_hidden_layers hidden_sizeintermediate_sizemerge_kernel_sizevideo_attn_type merge_typemm_projector_typemm_hidden_sizeprojector_hidden_actprojector_ln_epsc stjdi|||_||_||_||_||_||_||_||_ | |_ | |_ | |_ | |_ | |_|dur8||_n||_||_||_dS)N)super__init__rrrrrrrrrrrr r!r"r#r$)selfrrrrrrrrrrrr r!r"r#r$kwargs __class__r%\/home/ubuntu/.local/lib/python3.10/site-packages/vllm/transformers_utils/configs/kimi_k25.pyr's& zKimiK25VisionConfig.__init__)rrrrr r r r r rrrrNrr) __name__ __module__ __qualname__ model_typeintstrtuplefloatr' __classcell__r%r%r*r,rsf     rcseZdZdZdZ       dd eeBdBd eeBdBd ed ed ede de ffdd Z e defddZ e defddZZS) KimiK25Configa*Kimi-K2.5 model configuration. Kimi-K2.5 extends Kimi-K2 with vision support using video-chunks. A video-chunk consists of multiple consecutive frames that are processed together with temporal pooling. Args: vision_config: Configuration for the vision tower and projector. text_config: Configuration for the text model (DeepseekV3). ignore_index: The ignore index for the loss function. media_placeholder_token_id: The token ID for media placeholders. pad_token_id: The token ID for padding. kimi_k25NrF<|kimi_k25_video_placeholder|> vision_config text_config ignore_indexmedia_placeholder_token_id pad_token_iduse_unified_vision_chunkvideo_placeholderc  s|durt}n t|trtdi|}||_|durt}n t|tr+tdi|}||_|jj|jjkr<|jj|j_||_||_ ||_ ||_ t |jdddurV|jj |_ tjdd|i|dS)Nquantization_configr?r%)r isinstancedictr;rr<r"rr=r>r@rAgetattrrBr&r') r(r;r<r=r>r?r@rAr)r*r%r,r'Ps&     zKimiK25Config.__init__returncC|jjS)z3Get hidden size from text config for compatibility.)r<rr(r%r%r,ryzKimiK25Config.hidden_sizecCrG)z2Get vocab size from text config for compatibility.)r< vocab_sizerHr%r%r,rJ~rIzKimiK25Config.vocab_size)NNr8r9rFr:)r-r.r/__doc__r0rDrrr1boolr2r'propertyrrJr5r%r%r*r,r6?s:  )r6N)rK transformersr transformers.configuration_utilsrrr6r%r%r%r,s   1