o پi4@sdZddlZddlZddlZddlZddlmZmZddlm Z ddl m Z m Z m Z mZddlmZmZmZmZmZddlmZeeZGdd d ZdS) z Centralized template management for chat templates and completion templates. This module provides a unified interface for managing both chat conversation templates and code completion templates, eliminating global state and improving modularity. N)DictOptional)TokenizerManager)CompletionTemplate FimPositioncompletion_template_existsregister_completion_template) ConversationSeparatorStylechat_template_existsget_conv_template_by_model_pathregister_conv_template)$detect_jinja_template_content_formatc @speZdZdZddZedeefddZedeefddZ edeefd d Z ede fd d Z d ede fddZ dedeededdfddZdededdfddZdeddfddZdeddfddZ  d-dededeedeeddf dd Zded!eddfd"d#Zd!eddfd$d%Zd!eddfd&d'Zdedeefd(d)Zd*eeefdedefd+d,ZdS).TemplateManagerz Centralized manager for chat and completion templates. This class encapsulates all template-related state and operations, eliminating the need for global variables and providing a clean interface for template management. cCsd|_d|_d|_d|_dS)NopenaiF)_chat_template_name_completion_template_name_jinja_template_content_format_force_reasoningselfrX/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/managers/template_manager.py__init__7s zTemplateManager.__init__returncC|jS)z#Get the current chat template name.)rrrrrchat_template_name=z"TemplateManager.chat_template_namecCr)z)Get the current completion template name.)rrrrrcompletion_template_nameBrz(TemplateManager.completion_template_namecCr)zHGet the detected template content format ('string' or 'openai' or None).)rrrrrjinja_template_content_formatGrz-TemplateManager.jinja_template_content_formatcCr)z Check if the current chat template enforces reasoning/thinking. Returns: True if the template contains reasoning patterns like tags )rrrrrforce_reasoningLszTemplateManager.force_reasoningtemplatecCs2|durdSd}t||du}|rtd|S)zS Detect if the chat template contains reasoning/thinking patterns. NFz$<\|im_start\|>assistant\\n\\nz6Detected the force reasoning pattern in chat template.)researchloggerinfo)rr!force_reasoning_pattern has_reasoningrrr_detect_reasoning_patternVs z)TemplateManager._detect_reasoning_patterntokenizer_managerchat_template_arg model_pathNcCs|r |||n/|||jdur8||}|r0|jr!||j_t||_t d|jnd|_t d|jrE| |jj|_ dSdS)a Load a chat template from various sources. Args: tokenizer_manager: The tokenizer manager instance chat_template_arg: Template name, file path, or None to auto-detect model_path: Path to the model NzFUsing default HuggingFace chat template with detected content format: stringz=No chat template found, defaulting to 'string' content format) _load_explicit_chat_template#guess_chat_template_from_model_pathr_resolve_hf_chat_template tokenizer chat_templaterrr$r%r(r)rr)r*r+ hf_templaterrrload_chat_templatefs,     z"TemplateManager.load_chat_templatecCsftd|t|r||_dStj|std|d|dr,| ||dS| |dS)z(Load explicitly specified chat template.z%Loading chat template from argument: NzChat template zD is not a built-in template name or a valid chat template file path.z.jinja) r$r%r rospathexists RuntimeErrorendswith_load_jinja_template_load_json_chat_template)rr)r*rrrr-s   z,TemplateManager._load_explicit_chat_templatecCs.t|}|durtd|||_dSdS)zt Infer chat template name from model path. Args: model_path: Path to the model Nz(Inferred chat template from model path: )r r$r%r)rr+ template_namerrrr.s  z3TemplateManager.guess_chat_template_from_model_pathcompletion_template_argcCsLtd|t|s!tj|std|d||dS||_dS)z Load completion template for code completion. Args: completion_template_arg: Template name or file path zLoading completion template: zCompletion template zJ is not a built-in template name or a valid completion template file path.N) r$r%rr4r5r6r7_load_json_completion_templater)rr<rrrload_completion_templates   z(TemplateManager.load_completion_templater1completion_templatecCs$|||||r||dSdS)aF Initialize all templates based on provided configuration. Args: tokenizer_manager: The tokenizer manager instance model_path: Path to the model chat_template: Optional chat template name/path completion_template: Optional completion template name/path N)r3r>)rr)r+r1r?rrrinitialize_templatessz$TemplateManager.initialize_templates template_pathcCstt|d}d|d}Wdn1swY|dd|j_d|_t||_ t d|j dS)zLoad a Jinja template file.r Nz\nzADetected user specified Jinja chat template with content format: ) openjoin readlinesstripreplacer0r1rrrr$r%)rr)rAfr1rrrr9s  z$TemplateManager._load_jinja_templatec Cs|ds Jdt|dL}t|}zt|d}Wnty-td|ddwtt|d|dd | d d |d |d f|| dd|ddddWdn1s]wY|d|_ dS)zLoad a JSON chat template file..jsonz)unrecognized format of chat template filerB sep_stylezUnknown separator style: Nnamesystemz {system_message}system_messagerCuser assistantseprDstop_str)rMsystem_templaterOrolesrLrRrSToverride) r8rEjsonloadr KeyError ValueErrorr r getr)rrAfilepr!rLrrrr:s<        z(TemplateManager._load_json_chat_templatec Cs|ds Jdt|d<}t|}zt|d}Wnty-td|ddwtt|d|d|d |d |d d d Wdn1sMwY|d|_ dS)z%Load a JSON completion template file.rKz/unrecognized format of completion template filerB fim_positionzUnknown fim position: NrMfim_begin_tokenfim_middle_token fim_end_token)rMr_r`rar^TrV) r8rErXrYrrZr[rrr)rrAr]r!r^rrrr=s8    z.TemplateManager._load_json_completion_templatec Csz3|jr t|jddndp|jrt|jddnd}|dur%tdWdSt|tr1|||WS|WStyN}ztd|WYd}~dSd}~ww)Nr1z"No HuggingFace chat template foundzError getting chat template: ) processorgetattrr0r$warning isinstancedict_select_named_template Exception)rr)r!errrr/)s(  z)TemplateManager._resolve_hf_chat_template templatescCs|stdt|}td||jj}r5||vr(td|d|td|d||S|d}td|d||S) NzEmpty templates dict providedz/Multiple HuggingFace chat templates available: zSpecified template 'z"' not found. Available templates: z Using specified chat template: ''rz!Using first available template: ')r[listkeysr$r% server_argshf_chat_template_name)rrjr)available_namespreferred_name first_namerrrrgGs   z&TemplateManager._select_named_template)NN)__name__ __module__ __qualname____doc__rpropertyrstrrrrboolr r(rr3r-r.r>r@r9r:r=r/rrgrrrrr.s  /      r)rvrXloggingr4r"typingrr%sglang.srt.managers.tokenizer_managerr(sglang.srt.parser.code_completion_parserrrrrsglang.srt.parser.conversationr r r r r &sglang.srt.parser.jinja_template_utilsr getLoggerrsr$rrrrrs