o
پi @ sn d dl Z d dlZd dlZd dlmZ d dlmZ d dlmZ d dl m
Z
m Z m Z e
eZG dd deZdS ) N)List)Tool)BaseFormatDetector)StreamingParseResult
StructureInfo _GetInfoFuncc sx e Zd ZdZ fddZdedefddZdedee de
fd d
Z d edee de
f fd d
Z de
fddZ ZS )Qwen25Detectora
Detector for Qwen 2.5 and Qwen 3 model function call format.
Format Structure:
```
{"name":"func1", "arguments":{...}}
{"name":"func2", "arguments":{...}}
```
Key Components:
- Tool Call Tags: `` and `` wrap each individual call
- Function Call Object: JSON object with "name" and "arguments" fields
Reference: https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct?chat_template=default
c s& t d| _d| _d| _d| _dS )zJ
Initializes the detector with necessary state variables.
z
z
N)super__init__ bot_token eot_tokentool_call_separator_normal_text_bufferself __class__ \/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/function_call/qwen25_detector.pyr ! s
zQwen25Detector.__init__textreturnc C s
| j |v S )z7Check if the text contains a Qwen 2.5 format tool call.)r
)r r r r r
has_tool_call+ s
z Qwen25Detector.has_tool_calltoolsc C s | | j}|dkr|d| n|}| j|vr t|g dS t| j dt| j }t||tj}g }|D ]4}zt
| } | | | | W q: t j
yn }
ztd| dt|
W Y d}
~
q:d}
~
ww t||dS )a$
One-time parsing: Detects and parses tool calls in the provided text.
:param text: The complete text to parse.
:param tools: List of available tools.
:return: ParseResult indicating success or failure, consumed text, leftover text, and parsed calls.
N) normal_textcallsz(.*?)zFailed to parse JSON part: z, JSON parse error: )findr
stripr reescaper findallDOTALLjsonloadsextendparse_base_jsonJSONDecodeErrorloggerwarningstr) r r r idxr patternmatch_result_listr match_result parsed_caller r r detect_and_parse/ s&
z Qwen25Detector.detect_and_parsenew_textc s t ||}|jrQ| j|j7 _| jdd }|| jv r-| j|d}d| _||_|S | | j|}|rJ| jd| |_| j| d | _|S | j|_d| _|S )z
Streaming incremental parsing for Qwen 2.5 tool calls.
Uses base class implementation with buffering to handle partial end tokens.
Nr
)r parse_streaming_incrementr r r replace_ends_with_partial_token)r r3 r resultend_token_without_newline cleaned_textpartial_match_lenr r r r5 K s.
z(Qwen25Detector.parse_streaming_incrementc C s dd S )Nc S s t d| d dddS )Nz
{"name":"z", "arguments":z}
z )beginendtrigger)r )namer r r t s
z/Qwen25Detector.structure_info..r r r r r structure_infos s z Qwen25Detector.structure_info)__name__
__module__ __qualname____doc__r r+ boolr r r r r2 r5 r rA
__classcell__r r r r r s
(r )r$ loggingr typingr &sglang.srt.entrypoints.openai.protocolr -sglang.srt.function_call.base_format_detectorr #sglang.srt.function_call.core_typesr r r getLoggerrB r) r r r r r s