o
is+ @ s d dl Zd dlZd dlmZ d dlmZ d dlZer d dl m
Z
d dl m Z d dl
mZ d dlmZ d dlmZ d d lmZ eeZG d
d d ejZejd d
G dd dZdedede edB edB f fddZ ejG dd dZ G dd deZ dS ) N)Sequence)
TYPE_CHECKING)
TokenizerLike)ChatCompletionRequest) DeltaMessage)ResponsesRequest) init_logger)ReasoningParserc @ s e Zd ZdZdZdS )Olmo3ReasoningState N)__name__
__module__ __qualname__ REASONINGCONTENT r r [/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/reasoning/olmo3_reasoning_parser.pyr
s r
T)frozenc @ s& e Zd ZU eed< eed< dd ZdS )Indicesstartendc C s | j | j S N)r r selfr r r __len__& s zIndices.__len__N)r
r r int__annotations__r r r r r r ! s
r abreturnc C sV t | t |k r
| |dfn|| df\} }}| |v r9tdt | }t|| || t | }|r5||fS ||fS tt | d ddD ]-}| | d |d| krptt | | t | }td|}|rj||f S ||f S qCtt | d ddD ]-}|| d | d| krtd|}tt || t |}|r||f S ||f S q{dS )a.
Find the longest overlap where the end of string a matches the start
of string b.
Args:
a: First string
b: Second string
Returns:
Tuple of IndicesTuples representing the overlapping portions in each
string, or a tuple of None if no overlap exists
FTr r N)NN)lenr indexrange)r r swapind_aind_bir r r string_overlap* s$ *
r) c @ sp e Zd ZU dZeed< dZeed< dZeed< ej Z
eed< de d B fd
d Z d d
Z
dede d B fddZd S )Olmo3ReasoningBuffer think_start think_end bufferstater Nc C s | j | j}|dkr-tj| _| j d | | j |t| j d }| _ |dkr-t|dS | j | j }|dkrZtj
| _| j d | | j |t| j d }| _ |dkrZt|dS | jtjkrm| j d }| _ t|dS | jtj
kr| j d }| _ t|dS d S )Nr )content) reasoningr/ ) r0 findr, r
r r1 r" r rfindr. r )r start_think_idxpretext
end_think_idx text_bufferr r r process_buffer` s:
z#Olmo3ReasoningBuffer.process_bufferc C s
t | jS r )r" r0 r r r r r s
z Olmo3ReasoningBuffer.__len__
delta_textc C s | j |7 _ d }t|| j\}}t|| j\}}|d uo%t|t| jk }|d uo2t|t| jk }|rC| j| j v rC|sC| }|S |rQ| j| j v rQ| }|S |sU|rWd S | }|S r )r0 r) r, r. r" r: )r r;
delta_message_overlap_think_startoverlap_think_endpartial_overlap_startpartial_overlap_endr r r add_text s8
z Olmo3ReasoningBuffer.add_text)r
r r r, strr r. r0 r
r r1 r r: r rB r r r r r* T s
0r* c s e Zd ZdZd fdd Zdee defdd Zde e de e fd
d Z
d e d
e e
B dee dB e dB f fddZde de de dee dee dee dedB fddZ ZS )Olmo3ReasoningParsera
Reasoning parser for Olmo 3 model
Olmo3ReasoningParser
This class implements a reasoning parser specifically designed for the
Olmo 3 family of models. Olmo 3 models do not use special tokens to
indicate reasoning; rather, reasoning trace is wrapped in `` and
``, which are tokenized using standard vocabulary entries.
Because of this, the parser operates in string space, accumulating the
characters in a buffer until it sees `` or ``. tokens
to switch modes.
Key Features:
- For non-stream output, Recognizes and extracts reasoning (text
bracketed by `` and ``) and content (everything
after the first ``).
- For stream process, it uses a buffer to accumulate delta text,
and output progressive delta messages as soon as thinking starts
or ends.
- For reliability, some Olmo 3 models may hardcode the first
`` token is the input text (similar to Deepseek R1,
or reasoning-only Qwen models). To support such variants, the
parser can optionally work in cases where the first ``
token is missing from generation.
tokenizerr c sb t j|g|R i | d| _d| _d| j d| j d}t|tj| _t| j| jd| _ d S )Nr+ r- z^(?:z)?(?P.*?)z(?P.*)$)r, r. )
super__init__r, r. recompileDOTALLreasoning_regexr* r0 )r rE argskwargsreasoning_expr __class__r r rG s
z Olmo3ReasoningParser.__init__ input_idsr c C s | j |}| j|v S r )model_tokenizerdecoder. )r rQ textr r r is_reasoning_end s
z%Olmo3ReasoningParser.is_reasoning_endc C s g S r r )r rQ r r r extract_content_ids s z(Olmo3ReasoningParser.extract_content_ids model_outputrequestNc C s< | j |}|r|dpd}|dpd}||fS d|fS )a1 Extract the reasoning content & content sections, respectively.
If the sequence doesn't match what we expect, i.e., the model generates
something else, all content is considered non-reasoning content.
Args:
model_output (str): Output of the model to be parsed.
request (ChatCompletionRequest | ResponsesRequest): Request being
processed.
Returns:
tuple[Optional[str], Optional[str]]: Tuple pair containing the
reasoning content and non-reasoning content.
r3 Nr2 )rK matchgroup)r rW rX re_matchr3 r2 r r r extract_reasoning s z&Olmo3ReasoningParser.extract_reasoning
previous_text current_textr; previous_token_idscurrent_token_idsdelta_token_idsc C s2 | j |}|du r| j j| j j v r| j }|S )z5Extract content using token ID sequence state machineN)r0 rB r. r: )r r] r^ r; r_ r` ra r< r r r extract_reasoning_streaming s
z0Olmo3ReasoningParser.extract_reasoning_streaming)rE r )r
r r __doc__rG r r boolrU listrV rC r r tupler\ r rb
__classcell__r r rO r rD s6
rD ) dataclassesdtenumcollections.abcr typingr regexrH vllm.tokenizersr 0vllm.entrypoints.openai.chat_completion.protocolr 'vllm.entrypoints.openai.engine.protocolr *vllm.entrypoints.openai.responses.protocolr vllm.loggerr vllm.reasoningr r
loggerEnumr
dataclassr rC rf r) r* rD r r r r s(
&*q