o Û¾iŸã@sDddlmZmZGdd„deƒZGdd„deƒZGdd„deƒZdS) é)ÚDeepseekV2ConfigÚPretrainedConfigcs*eZdZUdZeed<dZeed<dZeed<dZ eed<d Z eed <d Z eed <dZ eed <dZ eed<dZeed<dZeed<dZeed<dZeed<dZeed<dZeed<dZeed<dZeed<          ddededed ed ed ededededededef‡fdd„ Z‡ZS) ÚVisionEncoderConfigÚvisionÚ model_typeú#vit_so400m_patch14_siglip_384.webliÚ model_nameé€Ú image_sizeéÚ patch_sizeéÚwidthéÚlayersÚheadséÚ mlp_ratioÚmapÚ global_poolTÚ ignore_headFÚ class_tokenrÚ num_classesÚuse_checkpointÚskipÚ weight_initÚ deterministicÚnum_recomputing_layersc  s^||_||_||_||_||_||_||_||_| |_| |_ | |_ | |_ t ƒj di| ¤ŽdS©N©)rr r rrrrrrrrrÚsuperÚ__init__)Úselfrr r rrrrrrrrrÚkwargs©Ú __class__rú`/home/ubuntu/.local/lib/python3.10/site-packages/vllm/transformers_utils/configs/deepseek_vl2.pyr!szVisionEncoderConfig.__init__) rr r r rr rrTFrF)Ú__name__Ú __module__Ú __qualname__rÚstrÚ__annotations__rr Úintr rrrrrrÚboolrrrrrrr!Ú __classcell__rrr$r&r sl                óþýüûúùø ÷ ö õ ô órc sžeZdZUdZdZeed<dZeed<dZ eed<dZ eed <d Z eed <dZ eed <d Z eed<     ddededed ed ed ef ‡fdd„ Z‡ZS)ÚMlpProjectorConfigÚ mlp_projectorÚdownsample_mlp_geluÚprojector_typeé€Ú input_diméÚn_embedéÚdepthérÚdownsample_ratioFÚ token_poolingc s:||_||_||_||_||_||_tƒjdi|¤ŽdSr)r2r4r6r8rr:r r!)r"r2r4r6r8rr:r#r$rr&r!Fs zMlpProjectorConfig.__init__)r1r3r5r7r9r7)r'r(r)rr2r*r+r4r,r6r8rr:r;r-r!r.rrr$r&r/<s8        ùþýüûúùr/c s„eZdZUdZeed<eed<dZeed<dZ eed<dZ e e e e fed <   d deded e e e e ff‡fd d „ Z ‡ZS) ÚDeepseekVLV2ConfigÚdeepseek_vl_v2Ú vision_configÚprojector_configÚ2DÚtile_tagÚheadÚglobal_view_pos©)r r Úcandidate_resolutionsc  s¼tƒjd i|¤Ž| di¡}td i|¤Ž|_| di¡}td i|¤Ž|_| di¡}td i|¤Ž|_||_ ||_ ||_ |jj |_ |j pI| dg¡}d|vrSd|_dSd|vr\d|_dSdS) Nr>r?Úlanguage_configÚ architecturesÚDeepseekOCRForCausalLMÚ deepseek_ocrÚDeepseekOCR2ForCausalLMÚ deepseek_ocr2r)r r!Úgetrr>r/r?rÚ text_configrArCrEÚ vocab_sizerGr) r"rArCrEr#r>r?rFrGr$rr&r!cs"      ÿzDeepseekVLV2Config.__init__)rArBrD)r'r(r)rrr+r/rAr*rCrEÚtupler,r!r.rrr$r&r<Zs"   üþýür<N)Ú transformersrrrr/r<rrrr&Ús3