o ۾i @sHddlmZddlmZddlmZGdddeZGdddeZdS) )Any)PretrainedConfig) Qwen2ConfigcseZdZUdZeed<           ddededededededededededede ffdd Z Z S)DotsVisionConfigdots_vit model_type* h㈵>Fflash_attention_2{Gz?T embed_dim hidden_sizeintermediate_sizenum_hidden_layersnum_attention_heads num_channels patch_sizespatial_merge_sizetemporal_patch_size rms_norm_epsuse_biaskwargsc s|tjdi|||_||_||_||_||_||_||_||_ | |_ | |_ | |_ | |_ | |_||_||_||_||_dSN)super__init__rrrrrrrrrrrattn_implementationinitializer_rangeinit_merger_std is_causal post_normgradient_checkpointing)selfrrrrrrrrrrrr#r$r%r&r'r(r __class__r [/home/ubuntu/.local/lib/python3.10/site-packages/vllm/transformers_utils/configs/dotsocr.pyr" s$ zDotsVisionConfig.__init__)rrr r r r r rrrFrrrFTF) __name__ __module__ __qualname__rstr__annotations__intfloatboolrr" __classcell__r r r*r,r sX     rcs>eZdZdZ   d dedBffdd Zfdd ZZS) DotsOCRConfigdots_ocrqPhPN vision_configcs6tj|i|||_||_tdi|pi|_dSr)r!r"image_token_idvideo_token_idrr:)r)r;r<r:argsrr*r r,r"8szDotsOCRConfig.__init__c sd|_tj|fi|dS)N) _auto_classr!save_pretrained)r)save_directoryrr*r r,r?EszDotsOCRConfig.save_pretrained)r8r9N)r-r.r/rdictr"r?r5r r r*r,r65s r6N)typingr transformers.configuration_utilsrtransformers.models.qwen2rrr6r r r r,s   ,