o ÔÙ¾iã@s@dZddlmZddlmZGdd„deƒZGdd„deƒZdS) z Kimi K25 Model Configuration. é)ÚDeepseekV3Config)ÚPretrainedConfigc#sšeZdZdZdZ            d&dedededededededededeeefdededed edBd!ed"ed#ef"‡fd$d%„ Z ‡Z S)'ÚKimiK25VisionConfiga›Vision configuration for K2-VL (vision tower + mm projector). Args: Vision Tower Parameters: patch_size: Patch size for vision tower. init_pos_emb_height: Initial position embedding height. init_pos_emb_width: Initial position embedding width. init_pos_emb_time: Initial position embedding time dimension. pos_emb_type: Type of position embedding. num_attention_heads: Number of attention heads in vision tower. num_hidden_layers: Number of hidden layers in vision tower. hidden_size: Hidden size of vision tower. intermediate_size: Intermediate size in vision tower FFN. merge_kernel_size: Kernel size for spatial patch merging. video_attn_type: Type of video attention. merge_type: Type of merge operation. MM Projector Parameters: mm_projector_type: Type of multimodal projector. mm_hidden_size: Hidden size for projector (defaults to hidden_size). projector_hidden_act: Activation function for projector. projector_ln_eps: Layer norm epsilon for projector. Úkimi_k25éé@éÚ divided_fixedééé€éЩérÚspatial_temporalÚ sd2_tpoolÚ patchmergerNÚgeluçñh㈵øä>éÚ patch_sizeÚinit_pos_emb_heightÚinit_pos_emb_widthÚinit_pos_emb_timeÚ pos_emb_typeÚnum_attention_headsÚnum_hidden_layersÚ hidden_sizeÚintermediate_sizeÚmerge_kernel_sizeÚvideo_attn_typeÚ merge_typeÚmm_projector_typeÚmm_hidden_sizeÚprojector_hidden_actÚprojector_ln_epsÚtext_hidden_sizec sŒtƒjdi|¤Ž||_||_||_||_||_||_||_||_ | |_ | |_ | |_ | |_ | |_|dur8||_n||_||_||_||_dS)N©)ÚsuperÚ__init__rrrrrrrrrrr r!r"r#r$r%r&)Úselfrrrrrrrrrrr r!r"r#r$r%r&Úkwargs©Ú __class__r'úO/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/configs/kimi_k25.pyr)$s( zKimiK25VisionConfig.__init__)rrrrr r r r r rrrrNrrr) Ú__name__Ú __module__Ú __qualname__Ú__doc__Ú model_typeÚintÚstrÚtupleÚfloatr)Ú __classcell__r'r'r,r.r snìýüûúùø ÷ ö õ ô óòðïîíìrcs†eZdZdZdZ       dd eeBdBd eeBdBd ed ed ede de f‡fdd„ Z e defdd„ƒZ e defdd„ƒZ‡ZS)Ú KimiK25ConfigapK2-VL model configuration. K2-VL extends Kimi-VL with video support using video-chunks. A video-chunk consists of multiple consecutive frames (default: 4) that are processed together with temporal pooling. Args: text_config: Configuration for the text model (DeepseekV3). Vision Tower Parameters: patch_size: Patch size for vision tower. init_pos_emb_height: Initial position embedding height. init_pos_emb_width: Initial position embedding width. init_pos_emb_time: Initial position embedding time dimension. pos_emb_type: Type of position embedding. vt_num_attention_heads: Number of attention heads in vision tower. vt_num_hidden_layers: Number of hidden layers in vision tower. vt_hidden_size: Hidden size of vision tower. vt_intermediate_size: Intermediate size in vision tower FFN. merge_kernel_size: Kernel size for spatial patch merging. video_attn_type: Type of video attention. merge_type: Type of merge operation. Video-Chunk Parameters: temporal_merge_kernel_size: Number of frames per video chunk. Default is 4, meaning 4 frames are merged into 1 chunk. sample_fps: Video sampling frame rate. timestamp_mode: Format for chunk timestamps. MM Projector Parameters: mm_projector_type: Type of multimodal projector. mm_hidden_size: Hidden size from vision tower. projector_hidden_act: Activation function for projector. projector_ln_eps: Layer norm epsilon for projector. Other Parameters: ignore_index: The ignore index for the loss function. media_placeholder_token_id: The token ID for media placeholders. pad_token_id: The token ID for padding. rNéœÿÿÿérFú<|kimi_k25_video_placeholder|>Ú text_configÚ vision_configÚ ignore_indexÚmedia_placeholder_token_idÚ pad_token_idÚuse_unified_vision_chunkÚvideo_placeholderc  sª|durtƒ}n t|tƒrtdi|¤Ž}|durtƒ}n t|tƒr(tdi|¤Ž}||_||_||_||_||_||_ t |jddƒdurH|jj |_ t ƒj dd|i|¤ŽdS)NÚquantization_configrAr')rÚ isinstanceÚdictrr>r=r?r@rBrCÚgetattrrDr(r)) r*r=r>r?r@rArBrCr+r,r'r.r)€s"    zKimiK25Config.__init__ÚreturncCó|jjS)z3Get hidden size from text config for compatibility.)r=r©r*r'r'r.r£ózKimiK25Config.hidden_sizecCrI)z2Get vocab size from text config for compatibility.)r=Ú vocab_sizerJr'r'r.rL¨rKzKimiK25Config.vocab_size)NNr:r;rFr<)r/r0r1r2r3rFrrr4Úboolr5r)ÚpropertyrrLr8r'r'r,r.r9Ts:)÷ þ ýûúùø ÷#r9N)r2Ú transformersrÚ transformers.configuration_utilsrrr9r'r'r'r.Ús   K