o
۾i @ s d dl mZ d dlmZ d dlmZmZ d dlmZ d dl m
Z
d dl m Z er5d dl
mZ d dlmZ neZeZG d d
d
e
Zd S ) )abstractmethod)Sequence)
TYPE_CHECKINGAny) DeltaMessage)ReasoningParser)
TokenizerLike)ChatCompletionRequest)ResponsesRequestc s e Zd ZdZeedefddZeedefddZde f fdd Z
d
e e de
fd d Zd
e e d
e e de
fddZd
ee dee fddZdededede e de e de e dedB fddZded eeB deedB edB f fd d Z ZS ) BaseThinkingReasoningParseraU
Base class for reasoning parsers that use thinking tokens.
This class provides common functionality for parsers that use start and end
tokens to delimit reasoning content (
e.g., ..., ...).
Subclasses must implement the start and end tokens via abstract
properties.
returnc C t )z(The token that starts reasoning content.NotImplementedErrorself r P/home/ubuntu/.local/lib/python3.10/site-packages/vllm/reasoning/basic_parsers.py start_token$ z'BaseThinkingReasoningParser.start_tokenc C r
)z&The token that ends reasoning content.r r r r r end_token* r z%BaseThinkingReasoningParser.end_token tokenizerc s t j|g|R i | | jstd| jr| js td| j| j| _| j| j| _ | jd u s8| j d u rAt
| j j dd S )NzZThe model tokenizer must be passed to the ReasoningParser constructor during construction.z7start_token and end_token must be defined in subclasseszK reasoning parser could not locate think start/end tokens in the tokenizer!)
super__init__model_tokenizer
ValueErrorr r vocabgetstart_token_id end_token_id RuntimeError __class____name__)r r argskwargsr! r r r 0 s z$BaseThinkingReasoningParser.__init__ input_idsc C sN | j }| j}tt|d ddD ]}|| |kr dS || |kr$ dS qdS )N FT)r r rangelen)r r& r r ir r r is_reasoning_endD s z,BaseThinkingReasoningParser.is_reasoning_end delta_idsc C s | j }||v S )N)r )r r& r- r r r r is_reasoning_end_streamingO s z6BaseThinkingReasoningParser.is_reasoning_end_streamingc C s. | j |dd vr g S ||| j d d S )z:
Extract the content after the end tokens
Nr( r' )r index)r r& r r r extract_content_idsU s z/BaseThinkingReasoningParser.extract_content_ids
previous_text current_text
delta_textprevious_token_idscurrent_token_idsdelta_token_idsNc C s t |dkr|d | j| jfv rdS | j|v rN| j|v r?|| j}|d| }||t | j d } t|| r;| dS ddS | j|v rIt|dS t|dS | j|v r| j|v r|| j}
|| j}||
t | j | }||t | j d } t|| r| dS ddS t|dS t|dS )z
Extract reasoning content from a delta message.
Handles streaming output where previous + delta = current.
Uses token IDs for faster processing.
r' r N) reasoningcontent)r8 )r7 )r* r r findr r r ) r r1 r2 r3 r4 r5 r6 end_indexr7 r8 start_indexr r r extract_reasoning_streaming^ s:
z7BaseThinkingReasoningParser.extract_reasoning_streaming model_outputrequestc C sX | | j}|d r|d n|d }| j|vr|dfS | | j\}}}|p'd}||fS )z
Extract reasoning content from the model output.
This is the base implementation that works for most models.
Subclasses can override this method for specific behavior.
r' r N) partitionr r )r r= r> model_output_partsr7 _r8
final_contentr r r extract_reasoning s
z-BaseThinkingReasoningParser.extract_reasoning)r"
__module__ __qualname____doc__propertyr strr r r r r intboolr, r. listr0 r r< r r
tuplerD
__classcell__r r r% r r sP
;r N)abcr collections.abcr typingr r 'vllm.entrypoints.openai.engine.protocolr $vllm.reasoning.abs_reasoning_parsersr vllm.tokenizersr 0vllm.entrypoints.openai.chat_completion.protocolr *vllm.entrypoints.openai.responses.protocolr
r r r r r s