o
i @ sd d dl mZ d dlmZ d dlmZ d dlmZ d dlm Z d dl
m Z e e Z
G dd de Zd S )
)Sequence)PreTrainedTokenizerBase)ChatCompletionRequest) DeltaMessage) init_logger)BaseThinkingReasoningParserc s e Zd ZU dZdZeed< dZeed< dZeed< e defd d
Z
e defd d Z d
e f fdd Z
dedededee dee dee dedB fddZdededeedB edB f f fdd Z ZS ) Ernie45ReasoningParserz
Reasoning parser for Ernie45 thinking model.
The Ernie45 thinking model ouput format is
abc
def
or abc
def
z
response_start_tokenz response_end_tokenz<0x0A>
newline_tokenreturnc C dS )z(The token that starts reasoning content.z selfr r ]/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/reasoning/ernie45_reasoning_parser.py start_token z"Ernie45ReasoningParser.start_tokenc C r
)z&The token that ends reasoning content.zr r r r r end_token# r z Ernie45ReasoningParser.end_token tokenizerc s t j|g|R i | | jstd| j| j| _| j| j| _ | j| j
| _ | j| j | _
| j| j| _| j | j
g| _| jd u sM| j d u rQtdd S )NzZThe model tokenizer must be passed to the ReasoningParser constructor during construction.zRErnie45 reasoning parser could not locate think start/end tokens in the tokenizer!)super__init__model_tokenizer
ValueErrorvocabgetr start_token_idr end_token_idr response_start_token_idr
response_end_token_idr newline_token_idparser_token_ids RuntimeError)r r argskwargs __class__r r r ( s z Ernie45ReasoningParser.__init__
previous_text current_text
delta_textprevious_token_idscurrent_token_idsdelta_token_idsNc C s t |dkr|d | j| j| j| jfv rdS | j|v rh|| j}|d| }||t | j d } | d} | | j}
| | j
} |
dkrR| |
t | j d } | dkr\| d| } t || rd| dS ddS | j|v r|} | j|v r| d} | | j}
| |
t | j d } | | j
} | dkr| d| } n| j|v r| | j
} | d| } |d | j v rt |dkr|d | j
kr| d} t |dkr|d | jkrt |dkr|d | j
kr| d} t | r| dS ddS t |d S )
az
Extract reasoning content from a delta message.
Handles streaming output where previous + delta = current.
Uses token IDs for faster processing.
The Ernie45 thinking model ouput format is
abc
def
or abc
def
- 'abc' goes to reasoning
- 'def' goes to content
r N
) reasoningcontent)r1 )r0 )lenr r r r findr lstripr rfindr
r r! r ) r r' r( r) r* r+ r, think_end_indexr0 r1 response_start_idxresponse_end_idxr r r extract_reasoning_streaming? s`
z2Ernie45ReasoningParser.extract_reasoning_streaming model_outputrequestc sl t ||\}}|r.|| j}|| j}|dkr.|dkr.||k r.||t| j | }|p1d}||fS )ak
Extract reasoning content from the model output.
The Ernie45 thinking model ouput format is
abc
def
or abc
def
- 'abc' goes to reasoning
- 'def' goes to content
Returns:
tuple[Optional[str], Optional[str]]: reasoning content and content
r/ N)r extract_reasoningr4 r r6 r
r3 )r r; r< r0 r1 start_idxend_idx
final_contentr% r r r= s
z(Ernie45ReasoningParser.extract_reasoning)__name__
__module__ __qualname____doc__r str__annotations__r
r propertyr r r r r intr r: r tupler=
__classcell__r r r% r r s@
Sr N)collections.abcr transformersr 0vllm.entrypoints.openai.chat_completion.protocolr 'vllm.entrypoints.openai.engine.protocolr vllm.loggerr vllm.reasoning.basic_parsersr rA loggerr r r r r s