o
㥵iK @ s d dl Z d dlmZ d dlmZmZ d dlmZ d dlm Z m
Z
dd Z de d e d
e
fd d Zd
ed
e fddZd
efddZdS ) N)partial)AnyCallable)i18n)ServeReferenceAudioServeTTSRequestc C s |rt ||} ng } t| |r|nd| |||||| r t| nd|
d
}
| |
D ] }|j dkr7 |jdf S dkrEdtt|jf S q'dtdfS )zO
Wrapper for the inference function.
Used in the Gradio interface.
N)
text reference_id
referencesmax_new_tokens chunk_lengthtop_prepetition_penalty temperatureseeduse_memory_cachefinalerrorzNo audio generated) get_reference_audior int inferencecodeaudiobuild_html_error_messager r )r r reference_audioreference_textr r r
r r r r enginer
reqresult r I/home/ubuntu/.local/lib/python3.10/site-packages/tools/webui/inference.pyinference_wrapper s0
r! r r returnc C s@ t | d }| }W d n1 sw Y t||dgS )z(
Get the reference audio bytes.
rbN)r r )openreadr )r r
audio_file audio_bytesr r r r : s
r r c C s, t | tr| ntd} dtt| dS )Nz
Unknown errorz?
z
)
isinstance Exceptionhtmlescapestr)r r r r r E s r c C s t t| dS )zB
Get the inference function with the immutable arguments.
r )r r! r- r r r get_inference_wrapperQ s r. )r* functoolsr typingr r fish_speech.i18nr fish_speech.utils.schemar r r! r, listr r r. r r r r s 1