o پi%@s~ddlZddlZddlZddlmZddlmZddlmZddl m Z ddl m Z m Z mZmZeeZGddde ZdS) N)List)Tool)envs)BaseFormatDetector)StreamingParseResult StructureInfo ToolCallItem _GetInfoFunccs|eZdZdZfddZdedefddZdd Zded e e de fd d Z d ed e e de fddZ defddZZS)InternlmDetectora Detector for InternLM2/Intern-S1 model function call format. The InternLM format uses special tokens to delimit function calls with JSON for arguments. Format Structure: ``` text<|action_start|> <|plugin|> {json}<|action_end|> ``` Examples: ``` What's the weather like?<|action_start|> <|plugin|> {"name": "get_weather", "parameters": {"location": "Tokyo"}}<|action_end|> ``` Key Components: - Tool Call Start: `<|action_start|> <|plugin|>` - Tool Call End: `<|action_end|>` - Arguments: JSON object with `name` and `parameters`/`arguments` - Supports multiple sequential tool calls in both streaming and non-streaming modes cs td|_d|_d|_dS)N<|action_start|> <|plugin|>z<|action_end|>r)super__init__ bot_token eot_tokenpositionself __class__^/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/function_call/internlm_detector.pyr 0s  zInternlmDetector.__init__textreturncCs|j|v}|S)z8Check if the text contains an InternLM format tool call.)r)rrhas_callrrr has_tool_call6s zInternlmDetector.has_tool_callcCs(d|vr |dSd|vr|dSdS)zQExtract arguments from object, supporting both 'parameters' and 'arguments' keys. parameters argumentsN)get)robjrrr get_arguments;s   zInternlmDetector.get_argumentstoolsc Cs4||j}|dkr|d|n|}|j|vr$tdt|gdSt|jdt|j}t ||tj }|sHtdt|gdSt dt |dg}| |}zt|D]\}} | } zYt| } | d } || } | s{i} t d |d d | d tj| dd| r| |vstd| dt|tjsWq_t|| | tj| ddd} || Wq_tjy}ztd|d d|WYd}~q_d}~wwt dt |dt |t||dWSty}ztjd|ddt|gdWYd}~Sd}~ww)as One-time parsing: Detects and parses tool calls in the provided text. Supports multiple tool calls in the format: <|action_start|> <|plugin|> {JSON}<|action_end|> :param text: The complete text to parse. :param tools: List of available tools. :return: StreamingParseResult with normal text and parsed tool calls. Nz7[InternLM Tool Call] No tool call markers found in text) normal_textcallsz\s*(.*?)z7[InternLM Tool Call] No complete tool call blocks foundznternLM Tool Call] Found z tool call(s)namez'[InternLM Tool Call] Parsed tool call #z: name=z , parameters=F) ensure_asciizA[InternLM Tool Call] Model attempted to call undefined function: z, available_tools=) tool_indexr$rz9[InternLM Tool Call] Failed to parse JSON for tool call #z: z)[InternLM Tool Call] Successfully parsed z" tool call(s), normal_text_length=z0[InternLM Tool Call] Error in detect_and_parse: T)exc_info)findrstriploggerwarningrreescaperfindallDOTALLinfolen_get_tool_indices enumeratejsonloadsrrdumpslistkeysrSGLANG_FORWARD_UNKNOWN_TOOLSrappendJSONDecodeErrorerror Exception)rrr idxr"tool_call_patternmatchesr# tool_indices action_json action_dictr$r tool_callerrrdetect_and_parseCs|                  z!InternlmDetector.detect_and_parsenew_textc Cs|j|7_|j}||j}|dkrA|jdkr!d|_tddS|||js>|}d|_|j|vr9||jd}t|dStS||j}|dkr|jdkrZd|_g|_dg|_ t |j|jkrp|j it |j|jksbt |j |jkr|j dt |j |jksx|d|t |j}|j ||d}|j r|j|j d_|j djt|j djd|j|j<|j dj|j |j<|jd7_||t |jd|_|S|d|}||d|_t|dS) z| Streaming incremental parsing for InternLM format. Supports a single tool call in streaming mode. r!r)r"N)r )r$rr%)_bufferr)rcurrent_tool_idr_ends_with_partial_tokenrreplaceprev_tool_call_arrstreamed_args_for_toolr2r;rGr#r'r$r5r6r) rrHr current_textstartr"endcomplete_sectionresultrrrparse_streaming_incrementsX             z*InternlmDetector.parse_streaming_incrementcCsddS)z Return structure information for constrained generation. For InternLM format, the structure is: - begin: <|action_start|> <|plugin|> - end: <|action_end|> - trigger: the begin token cSstd|ddddS)Nz&<|action_start|> <|plugin|> {"name": "z", "parameters": z}<|action_end|>r )beginrRtrigger)r)r$rrrsz1InternlmDetector.structure_info..rrrrrstructure_infos zInternlmDetector.structure_info)__name__ __module__ __qualname____doc__r strboolrrrrrrGrUr rY __classcell__rrrrr s X Nr )r5loggingr-typingr&sglang.srt.entrypoints.openai.protocolrsglang.srt.environr-sglang.srt.function_call.base_format_detectorr#sglang.srt.function_call.core_typesrrrr getLoggerrZr+r rrrrs