o -i@szUdZddlmZddlmZddlmZeeZ ddddd Z e e e eeeeffed <d Zd ZGd ddeZdS)z Radio vision model configuration)Any)PretrainedConfig)logging)i i)irri )ii)i ri)vit_small_patch16_224vit_base_patch16_224vit_large_patch16_224vit_huge_patch16_224VIT_TIMM_DIM_BY_NAME)g3<4'?gwg M?gy{ ?)gB91?gwt.?g U?c seZdZdZdZddddddd d d eed d dfd ededede de dede de dedede e e e fe Bde e e e fe Bded Bde e eefd Bde ffdd ZZS) RadioConfiga> This is the configuration class to store the configuration of a Radio vision model. It is used to instantiate a Radio model according to the specified arguments, defining the model architecture. Args: model_name: Name of the vision transformer model (e.g., "vit_base_patch16_224"). Used to determine architecture dimensions from `VIT_TIMM_DIM_BY_NAME`. image_size: The size (resolution) of each image. patch_size: The size (resolution) of each patch. qkv_bias: Whether to add a bias to the queries, keys and values. qk_normalization: Whether to apply normalization to queries and keys. norm_type: The normalization type to use. layer_norm_eps: The epsilon used by the layer normalization layers. initializer_factor: A factor for initializing all weight matrices. hidden_act: The non-linear activation function in the encoder. cpe_max_size: Maximum image size for position embeddings. norm_mean: Mean values for image normalization (RGB channels). Defaults to (0.48145466, 0.4578275, 0.40821073)). norm_std: Standard deviation values for image normalization (RGB channels). Defaults to (0.26862954, 0.26130258, 0.27577711)). register_multiple: Number of register tokens to use. teachers: A list of teacher model configurations. Each teacher configuration is a dict with keys like "name" and some may have "use_summary". cls_token_per_teacher: Whether to use a separate CLS token for each teacher. radiorTF layer_normgư>g?geluiN model_name image_size patch_sizeqkv_biasqk_normalization norm_typelayer_norm_epsinitializer_factor hidden_act cpe_max_size norm_meannorm_stdregister_multipleteacherscls_token_per_teacherc s||_t|\|_|_|_|_||_||_||_||_ ||_ ||_ ||_ | |_ | |_t| ttfr5t| n| |_t| ttfrCt| n| |_| |_|durO|ng|_||_tjdi|dS)N)rr hidden_sizenum_hidden_layersnum_attention_headsintermediate_sizerrrrrrrrr isinstancetuplelistrrr r!r"super__init__)selfrrrrrrrrrrrrr r!r"kwargs __class__r#b/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/vllm/transformers_utils/configs/radio.pyr,6s0zRadioConfig.__init__)__name__ __module__ __qualname____doc__ model_typeOPENAI_CLIP_MEANOPENAI_CLIP_STDstrintboolfloatr)r*dictrr, __classcell__r#r#r/r1rs`     rN)r5typingr transformers.configuration_utilsrtransformers.utilsr get_loggerr2loggerrr=r9r)r:__annotations__r7r8rr#r#r#r1s    "