o
۾i{ @ s d dl Z d dlZd dlmZ d dlmZ d dlZd dlm Z d dl
m Z m Z m
Z
mZmZmZ d dlmZ d dlmZ d dlmZ eeZG d d
d
eZdS ) N)Sequence)Any)ChatCompletionRequest)DeltaFunctionCall DeltaMessage
DeltaToolCall ExtractedToolCallInformation FunctionCallToolCall) init_logger)
TokenizerLike)
ToolParserc s e Zd Zdef fdd ZdefddZdd Zd edefd
d Zd ed
ede fddZ
de de e fddZ d ede e de fddZ
dedede e fddZdede d B ded B fd d Zd ed edefd!d"Zd#ed$ed%ed&ee d'ee d(ee d eded B fd)d*Z ZS )+MinimaxM2ToolParser tokenizerc s> t | g | _d| _d| _d| _d| _d| _d| _d| _ d | _
g | _ d| _ d| _
d| _d| _d| _d | _d | _d | _d| _d| _d| _d | _d| _d| _i | _d | _| t d
t j | _ t d t j | _!t d t j | _"| j#swt$d
| j%&| j| _'| j%&| j| _(| j'd u s| j(d u rt)dt*+d| j,j- d S )Nzzz
zFr z,(.*?)zz!zUThe model tokenizer must be passed to the ToolParser constructor during construction.zTMiniMax M2 Tool parser could not locate tool call start/end tokens in the tokenizer!z)vLLM Successfully import tool parser %s !).super__init__prev_tool_call_arrtool_call_start_tokentool_call_end_tokeninvoke_start_prefixinvoke_end_tokenparameter_prefixparameter_end_tokencurrent_tool_name_sentcurrent_tool_idstreamed_args_for_toolis_tool_call_started failed_countcurrent_tool_index invoke_index header_sentcurrent_function_namecurrent_param_namecurrent_param_value param_countin_param in_functionaccumulated_text json_started json_closedaccumulated_paramsstreaming_request_reset_streaming_staterecompileDOTALLtool_call_complete_regexinvoke_complete_regexparameter_complete_regexmodel_tokenizer
ValueErrorvocabgettool_call_start_token_idtool_call_end_token_id RuntimeErrorloggerdebug __class____name__)selfr r= \/home/ubuntu/.local/lib/python3.10/site-packages/vllm/tool_parsers/minimax_m2_tool_parser.pyr sd z MinimaxM2ToolParser.__init__returnc C s dt jdd S )z Generate a unique tool call ID.call_N )uuiduuid4hexr? rA rA rB _generate_tool_call_idf s z*MinimaxM2ToolParser._generate_tool_call_idc C sx d| _ d| _d| _d| _d| _d| _d| _d| _d| _d| _ d| _
d| _ d| _ d| _
i | _d| _| j | j dS )zReset all streaming state.r FNr )r r r r! r r" r# r$ r% r& r' r( r) r* r+ r, r clearr rI rA rA rB r- j s$
z*MinimaxM2ToolParser._reset_streaming_statename_strc C s@ | }|dr|ds|dr |dr |dd S |S )z Extract name from quoted string."' )strip
startswithendswith)r? rL rA rA rB
_extract_name s z!MinimaxM2ToolParser._extract_namevalue
param_typec C s | ||gS )zIConvert parameter value to the correct type (legacy single-type version).) _convert_param_value_with_types)r? rU rV rA rA rB _convert_param_value s z(MinimaxM2ToolParser._convert_param_valueschemac C s |du rdgS t |tsdgS t }d|v r9|d }t |tr%|| nt |tr9|D ] }t |tr8|| q,d|v rt |d tr|d r|d D ]M}|du rX|d qLt |trc|d qLt |trn|d qLt |try|d qLt |tr|d qLt |tr|d qLt |tr|d
qLd D ] }||v rt || tr|| D ] }| |}|
| qq|sdgS t|S ) a5
Extract all possible types from a JSON schema definition.
Handles anyOf, oneOf, allOf, type arrays, and enum fields.
Args:
schema: The JSON schema definition for a parameter
Returns:
List of type strings (e.g., ["string", "integer", "null"])
Nstringtypeenumnullbooleanintegernumberarrayobject)anyOfoneOfallOf)
isinstancedictsetstraddlistboolintfloat_extract_types_from_schemaupdate) r? rY types
type_valuetrU choice_fieldchoice extractedrA rA rB ro sP
z.MinimaxM2ToolParser._extract_types_from_schema param_typesc
C sJ | dv rdS dd |D }g d}|D ]|}||vr q|dv r$| S |dv r;zt|W S ttfy: Y qw |dv razt|}|t|krO|W S t|W S ttfy` Y qw |d v rz| }|d
v rr d S |d v ry d
S q|dv rzt|W S tjy Y qw qzt|W S tjy | Y S w )a<
Convert parameter value to the correct type based on a list of possible types.
Tries each type in order until one succeeds.
Args:
value: The string value to convert
param_types: List of possible type strings
Returns:
The converted value
)r] nonenilNc S s g | ]}| qS rA )lower).0rs rA rA rB
s zGMinimaxM2ToolParser._convert_param_value_with_types..) r_ rm r` rn r^ rl rb ra rZ ri text)rZ ri r} )r_ rm )r` rn )r^ rl )true1yesonT)false0nooffF)rb ra ) rz rm r5 TypeErrorrn rQ jsonloadsJSONDecodeError)r? rU rw normalized_types
type_priorityrV val lower_valrA rA rB rW sR $ z3MinimaxM2ToolParser._convert_param_value_with_types
param_name param_configc C s0 ||vrdgS || }t |tsdgS | |S )a<
Get parameter types from parameter configuration.
Handles anyOf, oneOf, allOf, and direct type definitions.
Args:
param_name: The name of the parameter
param_config: The properties dict from the tool schema
Returns:
List of type strings
rZ )rf rg ro )r? r r param_schemarA rA rB _get_param_types_from_config s
z0MinimaxM2ToolParser._get_param_types_from_config
invoke_strtoolsNc C s, t d|}|s
dS | |d}i }|r?|D ]&}t|dr>|jj|kr>t|jdr>|jj}t|t r block.z^([^>]+)NrO function
parameters
propertiesz
^([^>]+)>(.*)
rP F ensure_asciiname arguments)r[ r )r. searchrT grouphasattrr r r rf rg r3 findallr0 rQ rR rS r rW r
r r dumps)r? r r
name_match
function_namer toolparams
param_dictmatch param_matchr param_valuerV rA rA rB _parse_single_invoke. sN
z(MinimaxM2ToolParser._parse_single_invoke model_outputrequestc C s | j |vr tdg |dS zag }| j|D ] }| j|D ]}| ||r'|jnd}|r1|| q q|s=tdg |dW S | j |D ]}| j|j
j |j
j d qD|
| j }|dkrd|d| nd}td||dW S ty td tdg |d Y S w )z>Extract tool calls from complete model output (non-streaming).F) tools_called
tool_callscontentNr r TzError extracting tool calls)r r r1 r r2 r r appendr rK r r r find Exceptionr; exception) r? r r r tool_call_match invoke_match tool_callfirst_tool_idxr rA rA rB extract_tool_callsc sJ
z&MinimaxM2ToolParser.extract_tool_calls
previous_text current_text
delta_textprevious_token_idscurrent_token_idsdelta_token_idsc / C sn |r| j |v r| || _|sM|rK| j|vrKt| j|}|dkrAt| jdkrA|| j || j } | dkr?t
ddS dS | j sK|rKt
ddS dS || _ | j
r|| js||| j}
|
| jkr|| jd7 _d| _d| _d| _d| _
d| _i | _dS | j s| j|v s| j |v rd| _ | j |v r|d|| j } | rt
| dS dS | | j r| dkrdS t
|dS || j} | j| krdS g }
d} || j|}|dkrn
|
| |t| j7 }q| jt|
krdS |
| j }|| j|}|dkr||d }n |||t| j }| js~| j|v r||| jt| j }|d |}|dkr|||| }| || _ | | _ d| _d| _t| j| jkri| j | j i d
t| j!| jkri| j! d t
t"| j| j t#| j dd
d d gd
S dS | jr| jr| jsd| _| jt| j!k r| j!| j d7 < t
t"| jt#dddgd
S | jsd| _| j
sT| j|v rT|| j$}| j|krRd| _
|| jt| j }|| j|}|dkr!||| }z+| %|| jr| jj&nd}|r| jt| jk r|j'j(}t)*|| j| j d< W n
t+y Y nw t
t"| jt#dddgd
}| jt| j!k rB| j!| j d7 < d| _
d| _i | _t,-d |S dS g } d} || j$|}|dkrfn| | |t| j$7 }qY| j.s| jt| k rt| | jkr| | j } | t| j$ } || d } d | v r| d } | d| }!| |!| _/| | d }"||"d }#|#0dr|#dd }#|#| j1}$|$dkr|#| j$}%|#| j}&|%dkr|&dks|%|&k r|%}$n|&dkr|&}$n
| j|v rt|#}$ndS |$dkr|#d|$ }'|'dr |'dd }'|'| j| j/< i }(| jr`| jj&r`| jj&D ]-})t2|)d r^|)j'j3| j kr^t2|)j'dr^|)j'j4}*t5|*t6r\d|*v r\|*d }( nq2| 7| j/|(}+| 8|'|+},t)j9|,dd}-| jdkrd| j/ d|- }.n d| j/ d|- }.| jd7 _| jt| j!k r| j!| j |.7 < t
t"| jt#|.ddgd
S dS )z/Extract tool calls from streaming model output.r r )r NrO FTrP >r r )indexidr r[ )r {)r )r r r }z"[M2_STREAMING] Tool call completedr r r r rM z": z, "):r r- r, r9 lenr1 r r countr r r r( r* r' r r r! r% r) r+ r8 r rstriprS rQ r r r rT r" rJ r r r r r r r r r r r r r; r< r& r# rR r r r r rf rg r rW r )/r? r r r r r r r complete_calls
open_calls invoke_endscontent_beforeinvoke_starts_countinvoke_start_positionsidxinvoke_start_idxinvoke_end_idx tool_text
func_startfunc_endfunction_name_rawtotal_param_count invoke_startinvoke_content_endinvoke_content parsed_toolargsresult param_starts param_idx param_start remainingname_endparam_name_raw value_start
value_text
param_end_idxnext_param_idx func_end_idxr r r r rV converted_valueserialized_value
json_fragmentrA rA rB extract_tool_calls_streaming s
z0MinimaxM2ToolParser.extract_tool_calls_streaming)r>
__module__ __qualname__r r ri rJ r- rT r rX rk ro rW rg r r
r r r r r rm r r
__classcell__rA rA r@ rB r sh F <
I
5
6 r )r rF collections.abcr typingr regexr. 0vllm.entrypoints.openai.chat_completion.protocolr 'vllm.entrypoints.openai.engine.protocolr r r r r r
vllm.loggerr vllm.tokenizersr &vllm.tool_parsers.abstract_tool_parserr
r> r; r rA rA rA rB s