o ˜à·iWã@s<ddlmZddlmZGdd„deƒZGdd„deƒZdS)é)Ú annotations)ÚPretrainedConfigcsReZdZdZ                  d4d5‡fd2d3„ Z‡ZS)6ÚFunAudioChatAudioEncoderConfigÚfunaudiochat_audio_encoderNé€é éééçÚgeluFç{®Gáz”?éÜédéÚreplaceéTÚ_attn_implementationú str | NoneÚ num_mel_binsÚintÚencoder_layersÚencoder_attention_headsÚencoder_ffn_dimÚd_modelÚdropoutÚfloatÚattention_dropoutÚactivation_functionÚstrÚactivation_dropoutÚscale_embeddingÚboolÚinitializer_rangeÚmax_source_positionsÚn_windowÚ output_dimÚ bos_token_idú int | NoneÚ codebook_sizeÚcontinuous_features_modeÚcrq_transformer_configú dict | NoneÚ eos_token_idÚ group_sizeÚenable_audio_invert_towerÚ pad_token_idÚreturnÚNonec sº| dd¡p|}tƒjdi|¤Ž|pd|_||_||_||_||_||_||_ ||_ | |_ | |_ ||_ | |_| |_| |_||_||_||_||_||_||_||_||_||_||_dS)NrÚsdpa©)ÚpopÚsuperÚ__init__rrrrrrrrrr Únum_hidden_layersr#r!r$r%r&r'r)r*r+r-r.r/r0)Úselfrrrrrrrrrr r!r#r$r%r&r'r)r*r+r-r.r/r0ÚkwargsÚ attn_impl©Ú __class__r4úb/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/transformers_utils/configs/funaudiochat.pyr7s4  z'FunAudioChatAudioEncoderConfig.__init__)Nrrrr r r r r r Fr rrrNNrNNrTN)0rrrrrrrrrrrrrrrrrrr rr!r"r#rr$rr%rr&rr'r(r)r(r*rr+r,r-r(r.rr/r"r0r(r1r2)Ú__name__Ú __module__Ú __qualname__Ú model_typer7Ú __classcell__r4r4r<r>rs4èrcs6eZdZdZddiZ     dd‡fdd„ Z‡ZS)ÚFunAudioChatConfigÚ funaudiochatÚaudio_token_idÚaudio_token_indexNé^PéœÿÿÿÚ audio_configúPretrainedConfig | dict | NoneÚ text_configrÚ ignore_indexÚ hidden_sizer(r1r2c  sÚ||_||_t|tƒr| dtj¡tdi|¤Ž}n|dur!tƒ}||_t|tƒrB| dd¡ddl}|j |d}|di|¤Ž}n|durPddl}|j dƒ}||_ |dur]t |j j ƒnt |ƒ|_ t ƒjdi|¤ŽdS)NrBÚqwen2rr4)rGrMÚ isinstanceÚdictÚ setdefaultrrBrJÚ transformersÚCONFIG_MAPPINGrLrrNr6r7) r9rJrLrGrMrNr:rSÚtext_clsr<r4r>r7Ss0  ÿ    ÿýzFunAudioChatConfig.__init__)NNrHrIN) rJrKrLrKrGrrMrrNr(r1r2)r?r@rArBÚ attribute_mapr7rCr4r4r<r>rDMsÿúrDN)Ú __future__rrSrrrDr4r4r4r>Ús   =