o io@sddlZddlmZddlmZddlZddlmZddl m Z ddl m Z m Z mZmZmZmZddlmZddlmZdd lmZdd lmZeeZGd d d eZdS) N)Sequence)Any)make_tool_call_id)ChatCompletionRequest)DeltaFunctionCall DeltaMessage DeltaToolCallExtractedToolCallInformation FunctionCallToolCall) init_logger) TokenizerLike) ToolParser)extract_intermediate_diffcsdeZdZdeffdd ZdedefddZdedefd d Zd edefd d Zdede de fddZ deddfddZ dede fddZd ede fddZd edeeeffddZdedefddZdKddZdKd d!Zd"eddfd#d$Zdefd%d&Zd'edefd(d)Zd'eddfd*d+Zdedefd,d-Zdedeeeeffd.d/Zd0ed1ejedefd2d3Zded4edeedBedBffd5d6Z d0ed'ede!dBfd7d8Z"d0ed'ede!dBfd9d:Z#d;ede fded;ed ed?e%ed@e%edAe%ede de!dBfdBdCZ&d;ededBfdDdEZ'd;ed edFededBfdGdHZ(d;edFedefdIdJZ)Z*S)LMinimaxToolParser tokenizercst|dggd|_d|_d|_tdtj|_d|_ td|_ td|_ d |_ d |_ |js7td |j|j|_|j|j|_|jdusQ|jdurXtd dSdS) Ncurrent_tool_indextool_ids sent_toolsz z z/(.*?)|(.*)(.*?)z"name":\s*"([^"]+)"z"arguments":\s*FzUThe model tokenizer must be passed to the ToolParser constructor during construction.zrMinimax Tool parser could not locate tool call start/end tokens in the tokenizer. Falling back to string matching.)super__init__streaming_statetool_call_start_tokentool_call_end_tokenrecompileDOTALLtool_call_regexthinking_tag_patterntool_name_patterntool_args_patternpending_bufferin_thinking_tagmodel_tokenizer ValueErrorvocabgettool_call_start_token_idtool_call_end_token_idloggerwarning)selfr __class__[/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/tool_parsers/minimax_tool_parser.pyr!s4   zMinimaxToolParser.__init__ model_outputreturncCsdd}tj|j||tjdS)z Preprocess model output by removing tool calls from thinking tags. Args: model_output: Raw model output string Returns: Preprocessed model output with tool calls removed from thinking tags cSs*|d}tjdd|tjd}d|dS)Nz.*?rflags)grouprsubr )match think_contentcleaned_contentr2r2r3remove_tool_calls_from_thinkTs   zOMinimaxToolParser.preprocess_model_output..remove_tool_calls_from_thinkr7)rr<r"r )r/r4r@r2r2r3preprocess_model_outputIs z)MinimaxToolParser.preprocess_model_output args_textcCs|}|s|Szt||WStjyYnw|dr@|dd}zt||WStjy:|}Ynw|ds |S)z Clean duplicate closing braces from arguments text. Args: args_text: Raw arguments text Returns: Cleaned arguments text with proper JSON formatting z}}Nr)stripjsonloadsJSONDecodeErrorendswith)r/rB candidater2r2r3_clean_duplicate_bracesbs&      z)MinimaxToolParser._clean_duplicate_braces delta_textcCsN|s|S|}|r%tdd|Dr%|d}|dkr%|dr#dSdS|S)z Clean delta text by removing excessive closing braces. Args: delta_text: Delta text to clean Returns: Cleaned delta text css|]}|dvVqdS)z} Nr2).0cr2r2r3 sz8MinimaxToolParser._clean_delta_braces..}r6 z} )rCallcountrG)r/rJdelta_stripped brace_countr2r2r3_clean_delta_bracess  z%MinimaxToolParser._clean_delta_bracesrequestc Cs||}|j|vrtdg|dSz|j|}g}|D]E}|dr&|dn|d}|ra|d}|D])} | } | r`| dr`| dr`z t | } | | Wq7t j y_Yq7wq7qg} |D] } d| vrd | vr| t d t| dt j| d dd d d qf||j} | dkr|d| }|r|d}t|D]} | } | r|| }|dkr|d|t| }nqd}nd}n|}tt| dk| |r|dWSddWStytdtdg|dYSw)a Extract tool calls from model output for non-streaming mode. Args: model_output: Complete model output request: Chat completion request Returns: ExtractedToolCallInformation containing tool calls and content F) tools_called tool_callscontentrr6rO{rNname argumentsfunction) ensure_ascii)rZr[)typer\rNrz9An unexpected error occurred during tool call extraction.)rArr r!findallrCsplit startswithrGrDrEappendrFr r dumpsfindreversedlen Exceptionr- exception)r/r4rUprocessed_outputfunction_call_tuplesraw_function_callsr=tool_call_contentlinesline parsed_callrW function_call processed_posprocessed_contentposrXr2r2r3extract_tool_callss           z$MinimaxToolParser.extract_tool_callstextNcCs4|d}|d}||kp||ko|d|_dS)z Update the thinking tag state based on text content. Args: text: Text to analyze for thinking tags r9r:N)rQrGr&)r/ru open_count close_countr2r2r3_update_thinking_states  z(MinimaxToolParser._update_thinking_statec sL|j|jfD]tfddtdttdtDr#dSqdS)z Check if text might be the start of a tool call tag. Args: text: Text to check Returns: True if text could be the start of a tool call tag c3s$|] }| dVqdSN)ra)rKitagrur2r3rMs  z.r6TF)rranyrangeminrf)r/rur2r{r3_is_potential_tag_starts z)MinimaxToolParser._is_potential_tag_startcCs2|jrdSt|jp|j|vp|j|vp|dS)z Determine if content should be buffered for later processing. Args: delta_text: Delta text to check Returns: True if content should be buffered F<)r&boolr%rrra)r/rJr2r2r3_should_buffer_content s z(MinimaxToolParser._should_buffer_contentcCs|jr|dfS|j|jfD]4}tdt|D]*}|d|}||}|dkr@|||dr@|d|||dfSqq |dfS)z Split delta text into safe content and potential tag content. Args: delta_text: Delta text to split Returns: Tuple of (safe_content, potential_tag_content) rr6Nr)r&rrr~rfrfindra)r/rJr|rz tag_prefixrsr2r2r3_split_content_for_buffering s    z.MinimaxToolParser._split_content_for_buffering new_contentcCs|j|7_d}|jr|j}d|_|S|jrq|j|j}|j|j}|dkr:|dks1||kr:|t|j}}n!|dkrG|t|j}}n||jrP |S||j7}d|_ |S||jd|7}|j||d|_|js|S)z Process buffered content and return output content. Args: new_content: New content to add to buffer Returns: Processed output content rrN)r%r&rdrrrfr)r/routput_content start_posend_postag_postag_lenr2r2r3_process_buffer5s0   z!MinimaxToolParser._process_buffercCsdggd|_dS)z,Reset the streaming state to initial values.rrNrr/r2r2r3_reset_streaming_state[s z(MinimaxToolParser._reset_streaming_statecCst|jdd|jd<dS)z3Advance to the next tool in the streaming sequence.rr6Nintrrr2r2r3_advance_to_next_toolcs z'MinimaxToolParser._advance_to_next_toolindexcCs||jd<dS)za Set the current tool index. Args: index: Tool index to set rNr)r/rr2r2r3_set_current_tool_indexiz)MinimaxToolParser._set_current_tool_indexcCst|jdS)z^ Get the current tool index. Returns: Current tool index rrrr2r2r3_get_current_tool_indexrrz)MinimaxToolParser._get_current_tool_index tool_countcCsHt|jd}t|D]}|t|kr||ds|Sq |SdS)z Get the index of the next unsent tool. Args: tool_count: Total number of tools Returns: Index of next unsent tool, or -1 if all tools sent r sent_namer)listrr~rf)r/rrrzr2r2r3_get_next_unsent_tool_index{s   z-MinimaxToolParser._get_next_unsent_tool_indexcCst|jd}t|jd}t||kr$|ddtdt||kst||kr5|dt||ks*||jd<||jd<dS)z Ensure state arrays have sufficient capacity for tool_count tools. Args: tool_count: Number of tools to prepare for rrFr)rsent_argumentsidN)rrrfrbr)r/rrrr2r2r3_ensure_state_arrayss   z&MinimaxToolParser._ensure_state_arrayscCs|j|}t|S)z Detect the number of tools in text by counting name patterns. Args: text: Text to analyze Returns: Number of tools detected )r#r_rf)r/rumatchesr2r2r3_detect_tools_in_texts z'MinimaxToolParser._detect_tools_in_textc Cs"g}d}|t|kr||dkr|}d}d}d}|t|krw||dkr)|d7}n(||dkrQ|d8}|dkrQ|d}|||} d| vrPd| vrP|||fn&|s_d|||dvr_d}|smd|||dvrmd}|d7}|t|ks|dkr|r|||fn|d7}|t|ks |S) z Find the boundaries of tool calls in text. Args: text: Text to analyze Returns: List of (start, end) positions for tool calls rrYFr6rNz"name"z "arguments"T)rfrb) r/ru boundariesrzstartdepthhas_name has_argumentsendsegmentr2r2r3_find_tool_boundariess>          z'MinimaxToolParser._find_tool_boundaries tool_content args_matchc Cs|}||d}|drdS) NFrTrr6r7c3$|] \}}|ko |kVqdSryr2rKt_startt_endrsr2r3rM z7MinimaxToolParser._is_end_tool_calls..) rrdrbrfinditerr"r rrr})r/rend_token_positions search_start think_regionsr=in_thinkr2rr3_is_end_tool_callss0     z$MinimaxToolParser._is_end_tool_calls previous_textprevious_token_idscurrent_token_idsdelta_token_idscCs|||jr t|dS||r ||}|rt|dSdS||r*t|dS||\} } | rC|j| 7_| rAt| dSdS||} |j | vrz|j |vrY|j |vrYdS| dkrf|j |vrfdS| dkru|j |vru| t|dS|jdur|j|vrt|dkrdS||} | durdS|||| } | rt| dSz.||| }||}|dkrWdS| dkr| |||||p|||WStytddYdSw)N)rXrrr6rzAn unexpected error occurred z$during streaming tool call handling.)rxr&rrrrrr%rArrrCrrr+rf!_find_tool_start_outside_thinking_extract_content_before_tools_extract_tool_contentrrrrrgr-rh)r/rrrJrrrrUbuffered_output safe_content potential_tagprocessed_current_textoriginal_tool_startcontent_before_toolsrcurrent_tools_countr2r2r3extract_tool_calls_streamingsl                        z.MinimaxToolParser.extract_tool_calls_streamingcsdd} ||j|dkrdSddtjd|tjdD}tfd d |D}|s-Sd }q) z Find the start position of tool calls outside of thinking tags. Args: current_text: Current text to search Returns: Position of tool call start or None if not found rTrNcSsg|] }||fqSr2)rr)rKmr2r2r3 szGMinimaxToolParser._find_tool_start_outside_thinking..rr7c3rryr2rrr2r3rM!rzFMinimaxToolParser._find_tool_start_outside_thinking..r6)rdrrrr r})r/rrrrr2rr3r s"  z3MinimaxToolParser._find_tool_start_outside_thinking tool_startcCsT|dkr(t|t|}||kr(|}|t||kr"|d||}|r&|SdSdS)a Extract content that appears before tool calls. Args: current_text: Current text delta_text: Delta text tool_start: Start position of tools Returns: Content before tools or None rN)rf)r/rrJrdelta_start_pos content_partr2r2r3r*s z/MinimaxToolParser._extract_content_before_toolscCs>|t|j}||d}||j}|dkr|d|}|S)z Extract tool content from current text starting at tool_start. Args: current_text: Current text tool_start: Start position of tool calls Returns: Extracted tool content Nr)rfrrdr)r/rrtool_content_startrrr2r2r3rAs    z'MinimaxToolParser._extract_tool_content)r5N)+__name__ __module__ __qualname__r rstrrArIrTrr rtrxrrrtuplerrrrrrrrrrrrrMatchrrrrrrrrrrr __classcell__r2r2r0r3r s( X  &    , $ 2 H S r)rDcollections.abcrtypingrregexrvllm.entrypoints.chat_utilsr0vllm.entrypoints.openai.chat_completion.protocolr'vllm.entrypoints.openai.engine.protocolrrrr r r vllm.loggerr vllm.tokenizersr &vllm.tool_parsers.abstract_tool_parserrvllm.tool_parsers.utilsrrr-rr2r2r2r3s