o
ia @ s d dl Z d dlZd dlmZ d dlmZ d dlmZ d dlZ d dl
m Z d dl m
Z
mZ d dlmZmZmZmZmZmZ d dlmZ d d lmZ d d
lmZ ee Z G d d d Z G d
d deZ dS ) N)Sequence)Any) ParserCreate)make_tool_call_id)ChatCompletionRequestChatCompletionToolsParam)DeltaFunctionCall DeltaMessage
DeltaToolCall ExtractedToolCallInformation FunctionCallToolCall) init_logger)
TokenizerLike)
ToolParserc @ s e Zd ZdZdd Zdd Zdedefdd Zd
edefd d Z de
fd
dZ dede
fddZ de
deedB e
f fddZde
defddZdedefddZd efd d ZdBd edB fd d!Zd"ed#eeef fd$d%Zd&efd'd(Zd"efd)d*Zd+d, Zd-ee dB fd.d/Zd"ed#eeef dedB fd0d1Z d"ed#eeef dedB fd2d3Z d4edefd5d6Z d7edefd8d9Z d:ed7ede fd;d<Z!d=e d7edefd>d?Z"d@dA Z#dS )CStreamingXMLToolCallParserze
Simplified streaming XML tool call parser
Supports streaming input, parsing, and output
c C s6 | d | _d| _d| _d| _d| _d| _d| _d S )N z
z )reset_streaming_statetoolstool_call_start_tokentool_call_end_tokenfunction_start_tokenfunction_end_tokenparameter_start_tokenparameter_end_tokenself r \/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/tool_parsers/qwen3xml_tool_parser.py__init__' s
z#StreamingXMLToolCallParser.__init__c C s g | _ d| _d| _d| _d| _d| _i | _d| _d| _d| _ d| _
d| _ d| _ d| _
d| _d| _d| _d| _d| _d| _d| _t | _| dS )z Reset streaming parsing stater NF )deltastool_call_indexcurrent_call_idlast_completed_call_idcurrent_function_namecurrent_function_open
parameterscurrent_param_namecurrent_param_value current_param_value_convertedcurrent_param_is_firstshould_emit_end_newlinestart_quote_emittedstreaming_bufferlast_processed_postext_content_buffer_pre_inside_parameter_pre_param_buffer_pre_current_param_namedefer_current_parameterdeferred_param_raw_valuer parser setup_parserr r r r r 3 s. z0StreamingXMLToolCallParser.reset_streaming_state xml_chunkreturnc
s t j} j|7 _ }|rz\ j|d } jdurA j|v rAt fdd|D }|sA jr9 d j rA d jdurm j
|v rmt fdd|D }|sm jr` d j rh d d W n t y } z t
d| W Y d}~nd}~ww |}|S jr jd krt jd
} | d _| S jdurۈ j|v s j
|v rۈ jr d j|v rʈ j rʈ d j
|v rԈ d |}|S tdd
S ) a
Parse single streaming XML chunk and return Delta response
This is the actual streaming interface that receives chunks
one by one and maintains internal state
Args:
xml_chunk: Single XML chunk string
Returns:
DeltaMessage: Contains delta information generated by this chunk,
returns empty response if no complete elements
Nc 3 . | ]}|j ot fd d|j D V qdS )c 3 s< | ]}|j o|j jkot|j jto|j jd v V qdS ))}{}N)functionidr%
isinstance argumentsstr.0tcr r r x s
UStreamingXMLToolCallParser.parse_single_streaming_chunks...N
tool_callsanyrE tdr r r rG u
zKStreamingXMLToolCallParser.parse_single_streaming_chunks.. parameterr? c 3 r< )c 3 s8 | ]}|j d ko|jo|jjdko|j jkV qdS )r? r" N)typer? rB r@ r% rD r r r rG s
rH NrI rL r r r rG rN tool_callz Error with fallback parsing: %sr contentr" )lenr# r0 _process_complete_xml_elementsr% r rK r* _end_elementr' r Exceptionloggerwarning$_merge_new_deltas_to_single_responser2 r$ r _emit_delta)
r r: initial_delta_countfound_elements
new_deltashas_function_closehas_toolcall_closee result_delta
text_deltar r r parse_single_streaming_chunksU sn
z8StreamingXMLToolCallParser.parse_single_streaming_chunkstextc C s2 dddddd}| D ]
\}}|||}q |S )z
Escape XML special characters
Args:
text: Original text
Returns:
Escaped text
z&z<z>z"z')&<>"')itemsreplace)r re xml_escapescharescaper r r _escape_xml_special_chars s z4StreamingXMLToolCallParser._escape_xml_special_charsc C s| d}| j t| jk r| | j \}}|du r |S | |r"|| _ qzv| |}| ds6| drL| jdkrL| j rLt
| j d}| | d| _ | dr| jdkr| j r| j
rc| d | jsi| jrn| d t
dddt| jd
| j d tddd d gd
}| | | | j|d d}W n ty } z td| W Y d}~nd}~ww || _ | j t| jk s
|S )z
Process complete XML elements in buffer
Returns:
bool: Whether complete elements were found and processed
FNr z]+)>zz]+)>zr r" Nstring)object)arrayarrsequencedictlist[{(rj zrq )r| r r r r r r resubr3 r4 r6 r7 r5 rp _get_param_typematchgroup)
r r is_tool_call processedoriginal_chunk body_text safe_text
param_typeis_object_typeis_complex_typehas_container_hint
need_defermr r r rz s
z0StreamingXMLToolCallParser._preprocess_xml_chunkr c C s | j | dS )z&Emit Delta response (streaming output)N)r# r )r r r r r r[ O s z&StreamingXMLToolCallParser._emit_delta incoming_tagc C sL | j r| d |dv r| jr| d |dkr"| jr$| d dS dS dS )a Before starting to process new elements,
if there are unclosed tags from before,
automatically complete their endings to the parser.
- If there are unclosed parameters,
it's equivalent to feeding ``
- When about to start a new function or tool_call,
if there are unclosed functions, complete ``.
- When about to start a new tool_call,
if there are unclosed tool_calls, complete ``.
rO )r? rQ r? rQ N)r* rV r' r% )r r r r r $_auto_close_open_parameter_if_neededS s
z?StreamingXMLToolCallParser._auto_close_open_parameter_if_neededrs attrsc C s |dkrdS |dkr"| d i | _t | _d| _| jd7 _dS |ds+|dkrd| js4| di | d | ||}|| _ d| _
|rbt t | jd | jdt
|ddd gd
}| | dS dS |d sm|d kr| d | ||}|| _d| _d| _d | _|r| jsd
| d}t t | jd | jdt
d|dd gd
}| | d| _dS d| d}t t | jd | jdt
d|dd gd
}| | d | _dS dS dS )z Handle XML start element eventsrootNrQ Trq r? r" rr rt rJ rO Fz{"z": z, ")r r) r r% r- r$ r| _start_element_extract_function_namer' r( r r
r r[ _extract_parameter_namer* r+ r, r/ )r rs r
function_namer
param_name
json_start
json_continuer r r r l s
z)StreamingXMLToolCallParser._start_elementdatac C s~ |r| j r| jr+|}| jrd| }d| _|dr"d| _|dd }| j|7 _dS | | j }| js?|dr?|dd }|dv rb| jsbtt | j
d | j dt dd d
d gd }|
| d| _|sfdS |}| jrrd| }d| _|drd| _|dd }| j|7 _| | j|}| ||}|t| jd }|| _tt | j
d | j dt d|d
d gd }|
| dS dS dS )
z Handle XML character data events
FTNr rq r rC re varcharrn enumr? ri rr rt r )r* r6 r. endswithr+ r r| r/ r r
r$ r% r r[ _convert_param_value_convert_for_json_streamingrT r, ) r r
original_datar quote_deltaconverted_value output_data
delta_datar r r r
_char_data sn
z%StreamingXMLToolCallParser._char_datac C s |dkrdS | ds|dks|dkr| jr| | ds#|dkr| jr| j}| j}| jr| jr5| jn|}d}d}z| jrD|d }n|}t|}t j
|dd}W n t ye t j
|dd}|}Y nw t t
| jd | jdtd|d
d gd }| | d| _|| j|< d| _d
| _d
| _d| _d| _d
| _dS | |} | || }
| dv r|s| jst t
| jd | jdtddd
d gd }| | nt t
| jd | jdtddd
d gd }| | d| _|
| j|< d| _d
| _d
| _d| _dS | ds|dkr?| jr!t t
| jd | jdtddd
d gd }| | nt t
| jd | jdtddd
d gd }| | d| _dS |dkr| jrV| jrQ| d | d t t
| jd | jdtdd
d
d gd }| | | j rt | jd} | | | dS dS )z Handle XML end element eventsr Nr? rQ rO r F ensure_asciirq rr rt r r" r z""ri r= r> rR ) r| r* r r+ r6 r7 r. ast literal_evaljsondumpsrW r r
r$ r% r r[ r) r, r/ r r r( rV r2 r{ r} ) r rs r param_valueraw_text parsed_valueoutput_arguments
raw_for_parser r r rc r r r rV s
z'StreamingXMLToolCallParser._end_elementc C s* d| j _| j| j _| j| j _| j| j _dS )z Set up XML parser event handlersTN)r8 buffer_textr StartElementHandlerrV EndElementHandlerr CharacterDataHandlerr r r r r9 s
z'StreamingXMLToolCallParser.setup_parserr c C s
|| _ dS )z"Set tool configuration informationN)r )r r r r r set_tools s
z$StreamingXMLToolCallParser.set_toolsc C L |r
d|v r
|d S d|v r$| dd}t|dkr$|d dkr$|d S dS )z*Extract function name from various formatsrs =rq r r? NsplitrT r rs r partsr r r r z1StreamingXMLToolCallParser._extract_function_namec C r )z+Extract parameter name from various formatsrs r rq r r rO Nr r r r r r r z2StreamingXMLToolCallParser._extract_parameter_namer c C s | j r| jsdS | j D ]x}t|dr t|dr t|jds q |jdkr|jj| jkrt|jds3 dS |jj}t|trad|v ra|d }||v r^t|| tr^| t
|| dd S dS t|tr||v r|| }t|tr| t
| dd S dS q dS )zGet parameter type based on tool configuration, defaults to string
Args:
param_name: Parameter name
Returns:
Parameter type
r rP r? rs r)
properties) r r' hasattrr? rP rs r) rA r repair_param_typerC get)r r toolparamsr param_configr r r r sD
z*StreamingXMLToolCallParser._get_param_typer c C sz |dv s9| ds9| ds9| ds9| ds9| ds9| ds9| ds9|d v s9|d
v s9| d s9| d r;|S d
S )zRepair unknown parameter types by treating them as string
Args:
param_type: Parameter type
Returns:
Repaired parameter type
r intuintlongshortunsignednumfloatbooleanboolbinary)r r r r r r r )r| )r r r r r r s. z,StreamingXMLToolCallParser.repair_param_typer c C s | dkrdS | }|dv r|S |ds-|ds-|ds-|ds-|drEzt|W S ttfyD td | Y |S w |d
sO|d rvzt|}|t| d kr_|W S t|W S ttfyu td
| Y |S w |dv r| }|dkS |S )zConvert value based on parameter type
Args:
param_value: Parameter value
param_type: Parameter type
Returns:
Converted value
nullNr r r r r r z[Parsed value '%s' of parameter '%s' is not an integer in tool '%s', degenerating to string.r r r zXParsed value '%s' of parameter '%s' is not a float in tool '%s', degenerating to string.r true) lowerr{ r| r
ValueError TypeErrorrX rY r )r r r float_param_valuer r r r $ sV
z/StreamingXMLToolCallParser._convert_param_valuer c C sN |du s|dkr
dS |dv rt j|dddd S t|ts%t j|ddS |S )a Convert converted_value based on
whether it's empty and if type is string
Args:
converted_value: Converted value
param_type: Parameter type
Returns:
Converted string for streaming output
Nr" r Fr rq r )r r rA rC )r r r r r r r X s
z6StreamingXMLToolCallParser._convert_for_json_streamingc C s t | _| | jr| j| _d| _d| _d| _i | _d| _d| _ d| _
d| _ d| _ d| _
d| _d| _d| _d| _d| _d| _dS )z
Each tool_call is treated as a separate XML document,
so we need to reset the parser after each tool_call.
NFr" )r r8 r9 r% r& r' r( r) r* r+ r, r- r. r/ r2 r3 r4 r5 r6 r7 r r r r r} p s(
z s. x