o پi@snUdZddlmZddlmZeeZdddddZe e e e e e e ffe d <d Zd ZGd d d eZdS)z Radio vision model configuration)PretrainedConfig)logging)i i)irri )ii)i ri)vit_small_patch16_224vit_base_patch16_224vit_large_patch16_224vit_huge_patch16_224VIT_TIMM_DIM_BY_NAME)g3<4'?gwg M?gy{ ?)gB91?gwt.?g U?cseZdZdZdZddddddd d d eed d d fdededede de dede de dedede e e e fe Bde e e e fe Bded Bde de ffdd Z ZS) RadioConfiga@ This is the configuration class to store the configuration of a Radio vision model. It is used to instantiate a Radio model according to the specified arguments, defining the model architecture. Args: model_name: Name of the vision transformer model (e.g., "vit_base_patch16_224"). Used to determine architecture dimensions from `VIT_TIMM_DIM_BY_NAME`. image_size: The size (resolution) of each image. patch_size: The size (resolution) of each patch. qkv_bias: Whether to add a bias to the queries, keys and values. qk_normalization: Whether to apply normalization to queries and keys. norm_type: The normalization type to use. layer_norm_eps: The epsilon used by the layer normalization layers. initializer_factor: A factor for initializing all weight matrices. hidden_act: The non-linear activation function in the encoder. max_img_size: Maximum image size for position embeddings. norm_mean: Mean values for image normalization (RGB channels). Defaults to (0.48145466, 0.4578275, 0.40821073)). norm_std: Standard deviation values for image normalization (RGB channels). Defaults to (0.26862954, 0.26130258, 0.27577711)). reg_tokens: Number of register tokens to use. radiorTF layer_normgư>g?geluiNg model_name image_size patch_sizeqkv_biasqk_normalization norm_typelayer_norm_epsinitializer_factor hidden_act max_img_size norm_meannorm_std reg_tokensdrop_path_ratedropoutc s||_t|\|_|_|_|_||_||_||_||_ ||_ ||_ ||_ | |_ | |_t| ttfr5t| n| |_t| ttfrCt| n| |_| |_||_||_tjdi|dS)N)rr hidden_sizenum_hidden_layersnum_attention_headsintermediate_sizerrrrrrrrr isinstancetuplelistrrrr r!super__init__)selfrrrrrrrrrrrrrr r!kwargs __class__r"L/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/configs/radio.pyr+>s0zRadioConfig.__init__)__name__ __module__ __qualname____doc__ model_typeOPENAI_CLIP_MEANOPENAI_CLIP_STDstrintboolfloatr(r)r+ __classcell__r"r"r.r0r"s`     rN)r4 transformers.configuration_utilsrtransformers.utilsr get_loggerr1loggerr dictr8r(r9__annotations__r6r7rr"r"r"r0s   "