o i)@sddlmZddlZddlZddlmZddlmZddlm Z ddl m Z ddl m Z er@ddlmZdd lmZdd lmZe eZGd d d ZdS) ) annotationsN)Callable) TYPE_CHECKING) init_logger) is_list_of)import_from_pathParser)ReasoningParser) ToolParserc@seZdZUdZiZded<iZded<ed4d d Zed4d d Z e  d5d6ddZ ed7ddZ e   d8d9ddZ ed:d!d"Z ed;d$d%Ze  & dd0d1Ze   & d?d@d2d3ZdS)A ParserManagerz Central registry for Parser implementations. Supports two registration modes: - Eager registration via `register_module` - Lazy registration via `register_lazy_module` zdict[str, type[Parser]]parserszdict[str, tuple[str, str]] lazy_parsersnamestrreturn type[Parser]cCsJ||jvr |j|S||jvr||Sd|}td|d|)a Retrieve a registered or lazily registered Parser class. Args: name: The registered name of the parser. Returns: The Parser class. Raises: KeyError: If no parser is found under the given name. z, zParser 'z ' not found. Available parsers: )r r_load_lazy_parserjoinlist_registeredKeyError)clsr registeredrP/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/parser/parser_manager.pyget_parser_internal#s    z!ParserManager.get_parser_internalc Csddlm}|j|\}}z!t|}t||}t||s't|d|d||j|<|WSt yC}z t d|||d}~ww)z+Import and register a lazily loaded parser.rrz in z is not a Parser subclass.z-Failed to import lazy parser '%s' from %s: %sN) vllm.parser.abstract_parserr r importlib import_modulegetattr issubclass TypeErrorr Exceptionlogger exception)rrr module_path class_namemod parser_clserrrr:s*     zParserManager._load_lazy_parserNTmodule module_namestr | list[str] | NoneforceboolNonecCsddlm}t||stdt||dur|jg}nt|tr&|g}n t|tr.|}ntd|D]}|sL||j vrL|j |}t |d|j ||j |<q4dS)z$Register a Parser class immediately.rrz+module must be subclass of Parser, but got Nz,module_name must be str, list[str], or None.z is already registered at ) rr r r!type__name__ isinstancerrr r __module__)rr*r+r-r module_namesrexistedrrr_register_moduleRs$        zParserManager._register_moduler%r&cCs||f|j|<dS)a" Register a lazy module mapping for delayed import. Example: ParserManager.register_lazy_module( name="minimax_m2", module_path="vllm.parser.minimax_m2_parser", class_name="MiniMaxM2Parser", ) N)r)rrr%r&rrrregister_lazy_moduleps z"ParserManager.register_lazy_moduletype[Parser] | None5type[Parser] | Callable[[type[Parser]], type[Parser]]csLt|tstdt||durj||d|Sd fdd }|S) a* Register a Parser class. Can be used as a decorator or called directly. Usage: @ParserManager.register_module("my_parser") class MyParser(Parser): ... Or: ParserManager.register_module(module=MyParser) z!force must be a boolean, but got N)r*r+r-objrrcsP|j}|j}ttrg}n ttr}n|g}|D] }||fj|<q|S)N)r3r1r2rrr)r:r%r&namesnrrrr _decorators  z1ParserManager.register_module.._decorator)r:rrr)r2r.r!r0r6)rrr-r*r>rr=rregister_module~s zParserManager.register_module list[str]cCs tt|jt|jBS)z'Return names of all registered parsers.)sortedsetr keysr)rrrrrs zParserManager.list_registered plugin_pathcCsLtjtj|d}zt||WdSty%td||YdSw)z4Import a user-defined parser from an arbitrary path.rz#Failed to load module '%s' from %s.N)ospathsplitextbasenamerr"r#r$)rrDr+rrr import_parsers  zParserManager.import_parserFtool_parser_name str | Noneenable_auto_tools model_nametype[ToolParser] | Nonec Csddlm}d}|r|dur|Stdz|dkr&|r&|dr&td||}W|StyB}z td|d |d}~ww) z&Get the tool parser based on the name.r)ToolParserManagerNz$"auto" tool choice has been enabled.pythoniczmeta-llama/Llama-3.2z>Llama3.2 models may struggle to emit valid pythonic tool callsz7Error: --enable-auto-tool-choice requires tool_parser:'z' which has not been registered) vllm.tool_parsersrOr#info startswithwarningget_tool_parserr"r!)rrJrLrMrOparserr)rrrrUs4    zParserManager.get_tool_parserreasoning_parser_nametype[ReasoningParser] | Nonec Cs`ddlm}d}|s dSz||}|dusJW|Sty/}z td|d|d}~ww)z+Get the reasoning parser based on the name.r)ReasoningParserManagerNzreasoning_parser_name=z has not been registered)vllm.reasoningrYget_reasoning_parserr"r!)rrWrYrVr)rrrr[s  z"ParserManager.get_reasoning_parserc Csddlm}|s |s dS|r*||kr*z||}td||WSty)Ynw||fD]}|rLz||}td||WStyKYq.wq.||}||||} |durc| durcdS||_| |_ |S)a Get a unified Parser that handles both reasoning and tool parsing. This method checks if a unified Parser exists that can handle both reasoning extraction and tool call parsing. If no unified parser exists, it creates a DelegatingParser that wraps the individual reasoning and tool parsers. Args: tool_parser_name: The name of the tool parser. reasoning_parser_name: The name of the reasoning parser. enable_auto_tools: Whether auto tool choice is enabled. model_name: The model name for parser-specific warnings. Returns: A Parser class, or None if neither parser is specified. r)_WrappedParserNz>Using unified parser '%s' for both reasoning and tool parsing.z9Using unified parser '%s' for reasoning and tool parsing.) rr\rr#rRrr[rUreasoning_parser_clstool_parser_cls) rrJrWrLrMr\rVrr]r^rrr get_parsersH         zParserManager.get_parser)rrrr)NT)r*rr+r,r-r.rr/)rrr%rr&rrr/)NTN)rr,r-r.r*r8rr9)rr@)rDrrr/)NFN)rJrKrLr.rMrKrrN)rWrKrrX)NNFN) rJrKrWrKrLr.rMrKrr8)r1r3 __qualname____doc__r __annotations__r classmethodrrr6r7r?rrIrUr[r_rrrrr sH       .    r ) __future__rrrEcollections.abcrtypingr vllm.loggerrvllm.utils.collection_utilsrvllm.utils.import_utilsrrr rZr rQr r1r#r rrrrs