o
-i% @ sl d dl mZ d dlZd dlmZ d dlmZ d dlm Z d dl
m Z d dl m
Z
e eZG dd d e
ZdS )
)SequenceN)PreTrainedTokenizerBase)ChatCompletionRequest) DeltaMessage) init_logger)ReasoningParserc s e Zd ZdZdef fdd Zdee defddZ de
e de
e fd d
Z d e d e
dee d
B e d
B f fddZdee dee defddZde de de dee dee dee ded
B fddZ ZS ) HunyuanA13BReasoningParserah
Reasoning parser for Hunyuan A13B Model
HunyuanReasoningParser
This class implements a reasoning parser specifically designed
for the Hunyuan A13B Model. It is responsible for parsing and
extracting structured reasoning and answer segments from model
outputs that follow a specific pattern.
Key Features:
- For non-stream output , Recognizes and extracts reasoning ("think")
and answer ("answer") sections from text using regular expressions.
- For stream process, it requires a token id sequences to change the
reasoning state and other state so it maintains internal state to
manage parsing across multiple token.
think start: "
": [14023, 771, 397]
think ends: "
": [198, 524, 27963, 397, 27, 9399, 397]
response ends: "
": [524, 9399, 29]
tokenizerc s t j|g|R i | d| _d| _d| _d| _td| j d| j d| j tj| _ t| j d| j dtj| _
g d | _ g d
| _ g d | _
g d | _g d
| _g d| _g | _g | _d| _ddg| _d| _| j | _| j | _d| _g | _d| _d S )Nz \nz \n\nz\n\n\nz \nz(?:z(.*?)z)?(.*?)z(.*))6 )r
r S ) ;m r $ r )r r r r r r )r r r ) r
r r
r r r r r r reasoningresponseidler )super__init__think_start_exprthink_end_exprresponse_start_exprresponse_end_exprrecompileDOTALLfull_match_reasoning_regexhalf_match_reasoning_regexthink_start_idsthink_start_ids_fastresponse_start_idsresponse_start_ids_fastresponse_end_idsfast_think_ids
buffered_text buffered_ids
current_state
all_statesexpected_sequenceexpected_sequence_sidesequence_index token_buffer text_buffer)selfr argskwargs __class__ i/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/vllm/reasoning/hunyuan_a13b_reasoning_parser.pyr + s8
z#HunyuanA13BReasoningParser.__init__ input_idsreturnc C s
| j dkS )Nr )r+ r2 r9 r7 r7 r8 is_reasoning_endR s
z+HunyuanA13BReasoningParser.is_reasoning_endc C s g S )Nr7 r; r7 r7 r8 extract_content_idsU s z.HunyuanA13BReasoningParser.extract_content_ids model_outputrequestNc C s | j |}|r"|d \}}t|dkrd}t|dkr d}||fS | j}||}|rV|d \}}|| jrB|dt| j }t|dkrJd}t|dkrRd}||fS d|fS )a Extract the reasoning content & content sections, respectively.
If the sequence doesn't match what we expect, i.e., the model generates
something else, all content is considered non-reasoning content.
Args:
model_output (str): Output of the model to be parsed.
request (ChatCompletionRequest): Request being processed.
Returns:
tuple[Optional[str], Optional[str]]: Tuple pair containing the
reasoning content and non-reasoning content.
r N)r! findalllenr" endswithr )r2 r> r? re_matchr response_contentfallback_regexfallback_matchr7 r7 r8 extract_reasoning\ s(
z,HunyuanA13BReasoningParser.extract_reasoning subsequencesequencec C sB |sdS d}|D ]}|t |k r||| kr|d7 }q|t |kS )NFr )rA )r2 rH rI sub_idxnumr7 r7 r8 !_is_strict_increasing_subsequence s z.check_token_with_sequencec sl j dks
j dkr. jd t jk r&| j jd kr& jt jkS jt jkS jt jkS )Nr rT rJ )r+ r/ rA r. r- rU rW r7 r8 check_last_token s zPHunyuanA13BReasoningParser.extract_reasoning_streaming..check_last_tokenr rT r r N)r content)r# r% r' rA r0 appendr1 r/ r+ r- r& r. r$ r )r2 rN rO rP rQ rR rS think_start_sequenceresponse_start_sequenceresponse_end_sequencerV rX rY token_in_state_seqbuffered_contentr7 rW r8 extract_reasoning_streaming sN
z6HunyuanA13BReasoningParser.extract_reasoning_streaming)__name__
__module__ __qualname____doc__r r r intboolr< listr= strr tuplerG rM r ra
__classcell__r7 r7 r5 r8 r sD '
*
r )collections.abcr regexr transformersr 0vllm.entrypoints.openai.chat_completion.protocolr 'vllm.entrypoints.openai.engine.protocolr vllm.loggerr vllm.reasoningr rb loggerr r7 r7 r7 r8 s