o iq@sdZddlZddlZddlZddlmZddlmZmZm Z m Z m Z ddl Z ddlZddlZddlmZmZdedefd d Zd e e ede e eeeefffd d ZdedejfddZddZdejfddZdejdefddZdejdeeeffddZd.ddZdede e ej e!ffddZ"d ej d!e!de e!ej ffd"d#Z#d$ed%edefd&d'Z$d%ed$ed(eeefde j%fd)d*Z&d/de!fd+d,Z'e(d-kre)e'dS)0z% A gradio demo for Qwen3 TTS models. Nasdict)AnyDictListOptionalTuple) Qwen3TTSModelVoiceClonePromptItemsreturncCs0|pd}|dd}ddd|DS)N_ cSs0g|]}|r|dd|ddndqS)Nr)upper).0wrE/home/ubuntu/.local/lib/python3.10/site-packages/qwen_tts/cli/demo.py $s0z'_title_case_display..)stripreplacejoinsplitr rrr_title_case_display!s  ritemscCs6|sgifSdd|D}ddt||D}||fS)NcSg|]}t|qSr)rrxrrrr*z*_build_choices_and_map..cSsi|]\}}||qSrr)rdrrrr +sz*_build_choices_and_map..)zip)rdisplaymappingrrr_build_choices_and_map's r)cCsJ|pd}|dvrtjS|dvrtjS|dvrtjStd|d)Nr)bf16bfloat16)fp16float16half)fp32float32zUnsupported torch dtype: z. Use bfloat16/float16/float32.)rlowertorchr+r-r0 ValueErrorrrrr_dtype_from_str/sr4cCs|dur|StSN)grupdate)vrrr_maybe:sr9cCstjddtjdd}|jddddd|jd d dd d |jd ddd |jddgddd|jdddtjdd|jdddd |jdtddd|jd d!d"tjd#d|jd$td%d&d|jd'dd(d |jd)dd*d |jd+d,dtjd-d|jd.tdd/d|jd0tdd1d|jd2tdd3d|jd4tdd5d|jd6tdd7d|jd8tdd9d|jd:tdd;d|jdNz qwen-tts-demoasLaunch a Gradio demo for Qwen3 TTS models (CustomVoice / VoiceDesign / Base). Examples: qwen-tts-demo Qwen/Qwen3-TTS-12Hz-1.7B-CustomVoice qwen-tts-demo Qwen/Qwen3-TTS-12Hz-1.7B-VoiceDesign --port 8000 --ip 127.0.0.01 qwen-tts-demo Qwen/Qwen3-TTS-12Hz-1.7B-Base --device cuda:0 qwen-tts-demo Qwen/Qwen3-TTS-12Hz-1.7B-CustomVoice --dtype bfloat16 --no-flash-attn T)prog descriptionformatter_classadd_helpcheckpoint_pos?z:Model checkpoint path or HuggingFace repo id (positional).)nargsdefaulthelpz-cz --checkpointzRModel checkpoint path or HuggingFace repo id (optional if positional is provided).)rArBz--devicezcuda:0z@Device for device_map, e.g. cpu, cuda, cuda:0 (default: cuda:0).z--dtyper+)r+r*r-r,r0r/z6Torch dtype for loading the model (default: bfloat16).)rAchoicesrBz--flash-attn/--no-flash-attn flash_attnz+Enable FlashAttention-2 (default: enabled).)destrAactionrBz--ipz0.0.0.0z-Server bind IP for Gradio (default: 0.0.0.0).z--porti@z'Server port for Gradio (default: 8000).)typerArBz--share/--no-shareshareFz;Whether to create a public Gradio link (default: disabled).z --concurrencyz'Gradio queue concurrency (default: 16).z--ssl-certfilez2Path to SSL certificate file for HTTPS (optional).z --ssl-keyfilez*Path to SSL key file for HTTPS (optional).z--ssl-verify/--no-ssl-verify ssl_verifyz5Whether to verify SSL certificate (default: enabled).z--max-new-tokensz)Max new tokens for generation (optional).z --temperaturez Sampling temperature (optional).z--top-kzTop-k sampling (optional).z--top-pzTop-p sampling (optional).z--repetition-penaltyzRepetition penalty (optional).z--subtalker-top-kz2Subtalker top-k (optional, only for tokenizer v2).z--subtalker-top-pz2Subtalker top-p (optional, only for tokenizer v2).z--subtalker-temperaturez8Subtalker temperature (optional, only for tokenizer v2).)argparseArgumentParserRawTextHelpFormatter add_argumentBooleanOptionalActionintfloat)parserrrr build_parser>s  rSargscCs|jp|j}|s td|S)Nr) checkpointr> SystemExit)rTckptrrr_resolve_checkpoints rXc Cs8|j|j|j|j|j|j|j|jd}dd|DS)N)max_new_tokens temperaturetop_ktop_prepetition_penaltysubtalker_top_ksubtalker_top_psubtalker_temperaturecSsi|] \}}|dur||qSr5r)rkr8rrrr%sz'_collect_gen_kwargs..) rYrZr[r\r]r^r_r`r)rTr(rrr_collect_gen_kwargss rb-q=TcCst|}t|jtjr:t|j}|jdkr(|tjt t |j|j }nA|j dd}|tj||}n/t|jtj ra|tj}|j rSt t |nd}|dkrZn|||}nt d|j|rrt|dd}|jdkrtj|d d tj}|S) Nrrg@gg zo ?zUnsupported dtype: gg?)axis)npasarray issubdtypedtypeintegeriinfominastyper0maxabsfloatingsize TypeErrorclipndimmean)wavepsrsr!infoymidmrrr_normalize_audios&      r|audiocCs|durdSt|tr&t|dkr&t|dtr&|\}}t|}|t|fSt|trCd|vrCd|vrCt|d}t|d}||fSdS)Nr r sampling_ratedata) isinstancetuplelenrPr|dict)r}srrvrrr_audio_to_tuples$   rrvrcCstj|tjd}||fS)N)ri)rfrgr0)rvrrrr_wav_to_gradio_audiosrrWttscCs(t|jdd}|dvr |Std|)Ntts_model_type) custom_voice voice_designbasezUnknown Qwen-TTS model type: )getattrmodelr3)rWrmtrrr_detect_model_kindsrgen_kwargs_defaultc& st|}d}ttjddrj}d}ttjddr%j}tdd|p,gD\}tdd|p9gD\}dttt fffdd t j j t j d d d gd }d } t j|| dQ} t d|d|d|dkr#t t jddEt jdddd} t t jd|ddd} t jd|ddd} Wdn1swYt jddd d}t jd!d"d#}Wdn1swYt jd$dt jd%d&d'}t jd(dd)}Wdn1swYWdn1swYd*td+td,td-tffd.d/ }|j|| | | |g||gd0n|d1krt yt jdd=t jddd2d3} t t jd|ddd} Wdn 1sUwYt jd4d$d5d3}t jd!d"d#}Wdn 1stwYt jd$dt jd%d&d'}t jd(dd)}Wdn 1swYWdn 1swYd*td+td6tffd7d8 }|j|| | |g||gd0nt t d9t t jddt jd:d;}t jdd?d@}Wdn 1swYt jdd t jdAddd} t jd|ddd} t jd!d"d#}Wdn 1s3wYt jd$dt jd%d&d'}t jd(dd)}Wdn 1sXwYWdn 1shwYdBtdCtd*td+tffdDdE }|j||||| | g||gd0Wdn 1swYt dFt t jdd0t dGt jd:d&d'}t jdd?d@}t jdHd"d#}t jdId;}Wdn 1swYt jdd+t dJt jdKd;}t jdAddd}t jd|ddd} t jd!d"d#}!Wdn 1swYt jd$dt jd%d&d'}"t jd(dd)}#Wdn 1sAwYWdn 1sQwYdBtdCtffdLdM }$d*td+tffdNdO }%|j|$|||g||#gd0|!j|%||| g|"|#gd0Wdn 1swYWdn 1swYt dPWd| S1swY| S)QNget_supported_languagesget_supported_speakerscSg|]}|qSrrr rrrr zbuild_demo..cSrrrr rrrr rr cstSr5)rr)rrr_gen_common_kwargs sz&build_demo.._gen_common_kwargszSource Sans ProArialz sans-serif)fontz/.gradio-container {max-width: none !important;})themecssz# # Qwen3 TTS Demo **Checkpoint:** `z` **Model Type:** `z` rr )scaleuText (待合成文本)u4Enter text to synthesize (输入要合成的文本).)labellines placeholderuLanguage (语种)AutoT)rrCvalue interactiveuSpeaker (说话人)Vivianu4Instruction (Optional) (控制指令，可不输入)uHe.g. Say it in a very angry tone (例如：用特别伤心的语气说).uGenerate (生成)primary)variantuOutput Audio (合成结果)numpy)rrGuStatus (状态))rrtext lang_dispspk_dispinstructc sz>|r|s WdS|sWdS|d}||}}jd ||||p)dp-dd|\}}t|d|dfWSty\} zdt| jd| fWYd} ~ Sd} ~ ww) NNu&Text is required (必须填写文本).)Nu,Speaker is required (必须选择说话人).rr)rlanguagespeakerrrFinished. (生成完成): r)rgetgenerate_custom_voicer ExceptionrG__name__) rrrrrrkwargswavsre)rlang_mapspk_maprrr run_instruct=s*    $z build_demo..run_instruct)inputsoutputsrz_It's in the top drawer... wait, it's empty? No way, that's impossible! I'm sure I put it there!)rrru'Voice Design Instruction (音色描述)zZSpeak in an incredulous tone, but with a hint of panic beginning to creep into your voice.designc sz7|r|s WdS|r|sWdS|d}}jd|||d|\}}t|d|dfWStyU}zdt|jd|fWYd}~Sd}~ww) Nr)Nu@Voice design instruction is required (必须填写音色描述).r)rrrrrrr)rrgenerate_voice_designrrrGr)rrrrrrrrrrrrrrun_voice_designls&    $z$build_demo..run_voice_designu"Clone & Generate (克隆并合成)uReference Audio (参考音频))ru#Reference Text (参考音频文本)uLRequired if not set use x-vector only (不勾选use x-vector only时必填).u\Use x-vector only (仅用说话人向量，效果有限，但不用传入参考音频文本)F)rruTarget Text (待合成文本)ref_txtuse_xvecc szL|r|s WdSt|}|durWdS|s |r|s WdS|d}}jd ||||r7|ndt|d|\}} t|d| dfWStyj} zdt| jd| fWYd} ~ Sd} ~ ww) NNu6Target text is required (必须填写待合成文本).Nu7Reference audio is required (必须上传参考音频).NuReference text is required when use x-vector only is NOT enabled. (未勾选 use x-vector only 时，必须提供参考音频文本；否则请勾选 use x-vector only，但效果会变差.)r)rr ref_audioref_textx_vector_only_moderrrr) rrrgenerate_voice_cloneboolrrrGr) ref_audrrrratrrrrrrrrrun_voice_clones0   $z#build_demo..run_voice_cloneu-Save / Load Voice (保存/加载克隆音色)u ### Save Voice (保存音色) Upload reference audio and text, choose use x-vector only or not, then save a reusable voice prompt file. (上传参考音频和参考文本，选择是否使用 use x-vector only 模式后保存为可复用的音色文件) u$Save Voice File (保存音色文件)uVoice File (音色文件)u ### Load Voice & Generate (加载音色并合成) Upload a previously saved voice file, then synthesize new text. (上传已保存提示文件后，输入新文本进行合成) u'Upload Prompt File (上传提示文件)c szHt|}|dur WdS|s|r|sWdSj||r |ndt|d}ddd|Di}tjddd \}}t|t |||d fWSt yf}zdt |j d |fWYd}~Sd}~ww) Nrr)rrrrcSrrr)ritrrrrr"z3build_demo..save_prompt..voice_clone_prompt_z.pt)prefixsuffixrr) rrcreate_voice_clone_promptrtempfilemkstemposcloser2saverrGr) rrrrrpayloadfdout_pathr)rrr save_prompts*   $zbuild_demo..save_promptcsz|durWdS|r|sWdSt|ddp t|ddp t|}tj|ddd}t|tr2d|vr5Wd S|d}t|trDt|d krGWd Sg}|D]Z}t|tsVWd S| d d}|durjt |sjt |}| dd} | durxWdSt | st | } | t || t| ddt| dt| dd | dddqK |d} } jd|| |d| \} } t| d | dfWSty}zddt|jd|fWYd}~Sd}~ww)N)Nu2Voice file is required (必须上传音色文件).rnamepathcpuT) map_location weights_onlyr)Nu,Invalid file format (文件格式不正确).r)Nu!Empty voice items (音色为空).)Nu7Invalid item format in file (文件内部格式错误).ref_coderef_spk_embedding)Nu2Missing ref_spk_embedding (缺少说话人向量).rFicl_moder)rrrrrr)rrvoice_clone_promptruFailed to read or use voice file. Check file format/content. (读取或使用音色文件失败，请检查文件格式或内容) rr)rrstrr2loadrrlistrr is_tensortensorappendr rrrrrGr)file_objrrrr items_rawrr#rref_spkrrrrrrrrload_prompt_and_gensj           z'build_demo..load_prompt_and_genu, **Disclaimer (免责声明)** - The audio is automatically generated/synthesized by an AI model solely to demonstrate the model’s capabilities; it may be inaccurate or inappropriate, does not represent the views of the developer/operator, and does not constitute professional advice. You are solely responsible for evaluating, using, distributing, or relying on this audio; to the maximum extent permitted by applicable law, the developer/operator disclaims liability for any direct, indirect, incidental, or consequential damages arising from the use of or inability to use the audio, except where liability cannot be excluded by law. Do not use this service to intentionally generate or replicate unlawful, harmful, defamatory, fraudulent, deepfake, or privacy/publicity/copyright/trademark‑infringing content; if a user prompts, supplies materials, or otherwise facilitates any illegal or infringing conduct, the user bears all legal consequences and the developer/operator is not responsible. - 音频由人工智能模型自动生成/合成，仅用于体验与展示模型效果，可能存在不准确或不当之处；其内容不代表开发者/运营方立场，亦不构成任何专业建议。用户应自行评估并承担使用、传播或依赖该音频所产生的一切风险与责任；在适用法律允许的最大范围内，开发者/运营方不对因使用或无法使用本音频造成的任何直接、间接、附带或后果性损失承担责任（法律另有强制规定的除外）。严禁利用本服务故意引导生成或复制违法、有害、诽谤、欺诈、深度伪造、侵犯隐私/肖像/著作权/商标等内容；如用户通过提示词、素材或其他方式实施或促成任何违法或侵权行为，相关法律后果由用户自行承担，与开发者/运营方无关。 )rcallablerrrrr)rrrr6themesSoft GoogleFontBlocksMarkdownRowColumnTextboxDropdownButtonAudioclickTabsTabCheckboxrFile)&rrWr model_kindsupported_langs_rawsupported_spks_rawlang_choices_dispspk_choices_disprrdemotext_inlang_inspk_in instruct_inbtn audio_outerrr design_inrrr xvec_onlyr ref_audio_s ref_text_s xvec_only_ssave_btnprompt_file_outprompt_file_intext_in2lang_in2gen_btn2 audio_out2err2rrr)rrrrrr build_demos       $       "!  B  07H ==rc Cst}||}|js|js|dSt|}t|j}|jr"dnd}t j ||j ||d}t |}t |||}t|j|j|j|jrDdndd} |jdurR|j| d<|jdur\|j| d<|jt|jd jd i| dS) Nrflash_attention_2) device_mapriattn_implementationTF) server_name server_portrHrJ ssl_certfile ssl_keyfile)default_concurrency_limitr)rS parse_argsrUr> print_helprXr4rirDr from_pretraineddevicerbrripportrHrJrr queuerP concurrencylaunch) argvrRrTrWri attn_implrrr launch_kwargsrrrmainSs8         r.__main__)rcTr5)*__doc__rKrr dataclassesrtypingrrrrrgradior6rrfr2rr r rrr)rir4r9rLrS NamespacerXrbr|ndarrayrPrrrrrr.rrVrrrrs8 . m  "$W&