o پi/@sddlZddlZddlmZmZmZmZddlmZddl m Z ddl m Z m Z mZmZddlmZeeZGddde ZdS) N)AnyListOptionalTuple)Tool)BaseFormatDetector)StreamingParseResult StructureInfo ToolCallItem _GetInfoFunc)_is_complete_jsoncseZdZdZfddZdedefddZdedee de fd d Z d edee de ffd d Z dede eeeeffddZdededee eeffddZdedefddZdefddZZS)MistralDetectora Detector for Mistral tool/function call formats. Supported formats: 1) JSON-array format: `[TOOL_CALLS] [{"name": "...", "arguments": {...}}, ...]` 2) Compact format (common in newer templates/models, especially in streaming): `[TOOL_CALLS]tool_name[ARGS]{...}` (also tolerates missing delimiters like `]` after `[TOOL_CALLS` and/or `[ARGS]` while streaming) Reference: https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3?chat_template=default cs&td|_d|_d|_d|_dS)z&Initialize tokens and streaming state.z[TOOL_CALLS] [z [TOOL_CALLS]z, N)super__init__ bot_token_tool_calls_marker eot_tokentool_call_separatorself __class__]/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/function_call/mistral_detector.pyr"s  zMistralDetector.__init__textreturncCs |j|vS)zCReturn True if the text contains either supported tool-call marker.)r)rrrrr has_tool_call,s zMistralDetector.has_tool_calltoolsc Cs||j}|dkrt|gdS|d|}||d}|j|vr||}|s0t|gdSg}zt|}t|t s@|g}| ||}Wn tj yg} zt d|dt| WYd} ~ nd} ~ ww|ro||nd} | dkr|| t|dnd} | r|d| n|} t| |dS||} | st|gdS| \}}}| ||d|}||d} | r|d| n|} t| |dS) a$ One-time parsing: Detects and parses tool calls in the provided text. :param text: The complete text to parse. :param tools: List of available tools. :return: ParseResult indicating success or failure, consumed text, leftover text, and parsed calls.  normal_textcallsNzFailed to parse JSON part: z, JSON parse error:  name arguments)findrrstripr_extract_json_arrayjsonloads isinstancelistparse_base_jsonJSONDecodeErrorloggerwarningstrlen_try_parse_compact_args_format)rrr marker_idxr! tool_partjson_array_strr"function_call_arrejson_pos trailing_textcombined_normalparsed func_nameargs_objconsumedrrrdetect_and_parse0sT             z MistralDetector.detect_and_parsenew_textc s|j|7_|j}|j|vr1||j|js.|j}d|_|j|vr)||jd}t|dStS||j}|dkrM|d|}||d|_t|dSt|dsX|||_ | |}|r|\}}} ||j vrt|j}d|_t|dS|j dkrd|_ g|_ g|_ tj|dd} |j } t|j | kr|j it|j | kst|j | kr|j dt|j | ks||d |j | <| |j | <t| |dd t| d| d g} || d|_|j d 7_ d|_td| d S|j|vrtjd|d StS)a. Streaming parsing for both JSON-array and compact formats. For the compact format, this buffers until the JSON arguments payload is complete, then emits two items: tool name (with empty parameters) and a full arguments JSON chunk (OpenAI streaming semantics). r#)r!rN _tool_indicesrF) ensure_asciir%) tool_indexr& parametersr )rCr)_bufferr_ends_with_partial_tokenrreplacerr(hasattr_get_tool_indicesrDr5current_tool_idprev_tool_call_arrstreamed_args_for_toolr+dumpsr4appendr current_tool_name_sentrrparse_streaming_increment) rrCr current_textr! marker_poscompactr?r@rA args_jsontool_idr"rrrrTksd                     z)MistralDetector.parse_streaming_incrementc Cs||j}|dkr dS|t|j}|t|kr#||dkr#|d7}|t|kr?||r?|d7}|t|kr?||s/d}|||}|dkrMdS|||}|sYdS|t|}|t|kro||dkro|d7}|t|kr||r|d7}|t|kr||s{|t|ks||dvrdS|||\}} |sdSt|sdSzt|} Wn tj yYdSw|| | fS)av Parse the compact tool call format: `[TOOL_CALLS]tool_name[ARGS]{...}` Tolerates common streaming variants where delimiters are missing: `[TOOL_CALLStool_name[ARGS{...}` Returns: (tool_name, arguments_obj, consumed_end_index) if a complete JSON arguments payload is present; otherwise None. rNrrHz[ARGS{[) r(rr4isspacer)_extract_json_valuer r+r,r0) rrstarti args_markerargs_posr?jjson_strend_idxr@rrrr5sF    z.MistralDetector._try_parse_compact_args_format json_startc Cs|t|ks ||dvrd|fS||}|dkrdnd}d}d}d}t|t|D]B}||} |r4d}q)| dkr;d }q)| d krE|sE| }q)|rHq)| |krQ|d 7}q)| |krk|d 8}|dkrk|||d |d fSq)d|fS) z Extract a JSON value (object or array) starting at json_start using bracket counting, robust to nested braces/brackets inside strings. Returns: (json_str_or_None, end_index_exclusive) rZN{}rrF\T"rH)r4range) rrrdopeningclosingdepth in_string escape_nextkchrrrr\s8   z#MistralDetector._extract_json_valuec Cs||j}|dkr dS|t|jd}d}d}d}t|t|D]=}||}|r-d}q"|dkr4d}q"|dkr>|s>| }q"|s_|d krI|d7}q"|d kr_|d8}|dkr_|||dSq"dS) z Extract the JSON array part using bracket counting to handle nested brackets. :param text: The complete text containing [TOOL_CALLS] [...] :return: The JSON array string or None if not found rNrHrFrgTrh[r)r(rr4ri) rr start_idxrd bracket_countrmrnr^charrrrr*s8   z#MistralDetector._extract_json_arraycCsddS)NcSstd|ddddS)Nz[TOOL_CALLS] [{"name":"z", "arguments":z}]z [TOOL_CALLS])beginendtrigger)r )r&rrrKs  z0MistralDetector.structure_info..rrrrrstructure_infoJszMistralDetector.structure_info)__name__ __module__ __qualname____doc__rr3boolrrrrrBrTrrrintr5r\r*r ry __classcell__rrrrr s4  ;S 7 ),r )r+loggingtypingrrrr&sglang.srt.entrypoints.openai.protocolr-sglang.srt.function_call.base_format_detectorr#sglang.srt.function_call.core_typesrr r r sglang.srt.function_call.utilsr getLoggerrzr1r rrrrs