o i @sddlmZddlmZmZmZmZmZddlm Z m Z m Z ddl m Z ddZdd d d ed eeeefd eeedfdedef ddZed ed eedfdefddZdS)) lru_cache)CallableDictListOptionalUnion)HfHubHTTPErrorRepositoryNotFoundError TemplateError)is_minijinja_availablecCststdddl}|S)NzOCannot render template. Please install minijinja using `pip install minijinja`.r)r ImportError minijinja)rrc/home/ubuntu/SoloSpeech/.venv/lib/python3.10/site-packages/huggingface_hub/inference/_templating.py_import_minijinjasrNT)tokenadd_generation_promptmodel_idmessagesrrreturnc KsZt}t||d}z |d||d|WS|jy,}z td|d||d}~ww)aRender a chat prompt using a model's chat template. Args: model_id (`str`): The model id. messages (`List[Dict[str, str]]`): The list of messages to render. token (`str` or `bool`, *optional*): Hugging Face token. Will default to the locally saved token if not provided. Returns: `str`: The rendered chat prompt. Raises: `TemplateError`: If there's any issue while fetching, compiling or rendering the chat template. )rr)rrz4Error while trying to render chat prompt for model '': Nr)r_fetch_and_compile_templater )rrrrkwargsrtemplateerrrrender_chat_prompts rc sddlm}t}z ||d|j}Wn+ty)}z td|d|d}~wty?}z td|d||d}~ww|durLtd |d |d }|dur]td |d |d durltd|d |d }t |t stdt |d|di| D]%\}} d|vrt | t r| |<qt | t r| ddkr| d|<q|zd |Wn|jy}z td|d||d}~wwfddS)aFetch and compile a model's chat template. Method is cached to avoid fetching the same model's config multiple times. Args: model_id (`str`): The model id. token (`str` or `bool`, *optional*): Hugging Face token. Will default to the locally saved token if not provided. Returns: `Callable`: A callable that takes a list of messages and returns the rendered chat prompt. r)HfApi)rz$Cannot render chat template: model 'z ' not found.Nz5Error while trying to fetch chat template for model 'rzConfig not found for model 'z'.tokenizer_configz&Tokenizer config not found for model ' chat_templatez7Chat template not found in tokenizer_config for model 'z%Chat template must be a string, not 'z ' (model: z).r__type AddedTokencontentz7Error while trying to compile chat template for model 'csjdi|S)Nr)r)render_template)renvspecial_tokensrrfsz-_fetch_and_compile_template..)huggingface_hub.hf_apirr model_infoconfigr r r get isinstancestrtypeitemsdict Environment add_template) rrrrr*rrrkeyvaluerr$rr1sJ     r) functoolsrtypingrrrrrerrorsr r r utilsr rr-boolrrrrrrs(     !$