o ÔÙ¾i`<ã@s¾ddlmZmZmZmZddlmZddlmZGdd„dƒZ Gdd„dƒZ Gdd „d e ƒZGd d„de ƒZGdd „d e ƒZ Gdd„de ƒZGdd„de ƒZGdd„de ƒZGdd„dƒZdS)é)ÚDictÚOptionalÚTupleÚType)ÚChatCompletionRequest)Ú HarmonyParserc@s0eZdZdZ ddeedeefdd„ZdS)ÚStreamingParseResultz(Result of streaming incremental parsing.NÚnormal_textÚreasoning_textcCs|pd|_|pd|_dS)NÚ©r r )Úselfr r ©rúV/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/parser/reasoning_parser.pyÚ__init__ s zStreamingParseResult.__init__)NN)Ú__name__Ú __module__Ú__qualname__Ú__doc__rÚstrrrrrrrsýþýrc @s`eZdZdZ ddedededed ed efdd„Zd edefdd„Zdedefdd„Z dS)ÚBaseReasoningFormatDetectorzPBase class providing two sets of interfaces: one-time and streaming incremental.FTrÚthink_start_tokenÚthink_end_tokenÚforce_reasoningÚstream_reasoningÚcontinue_final_messageÚprevious_contentcCsz||_||_||_||_d|_d|_||_|jr!||_t|ƒ|_ nd|_d|_ |j|jvr0d|_|j|jvr;d|_dSdS)NrFrT) rrÚ _in_reasoningrÚ_bufferÚstripped_think_startrrÚlenÚprevious_count)r rrrrrrrrrrs" ÿz$BaseReasoningFormatDetector.__init__ÚtextÚreturncCs”|jp|j|v}|st|dS| |jd¡ ¡}|j|vr(|j|jvr(t|dS|j|vrE|j|jdd}|d}|d ¡}t||dSt|dS)z¢ One-time parsing: Detects and parses reasoning sections in the provided text. Returns both reasoning content and normal text separately. ©r r©r é)Úmaxsplitrr)rrrÚreplaceÚstriprrÚsplit)r r"Úin_reasoningÚprocessed_textÚsplitsr r rrrÚdetect_and_parse4s ÿ z,BaseReasoningFormatDetector.detect_and_parseÚnew_textcsú|j|7_|j‰t‡fdd„|j|jfDƒƒrtƒS|js1|jˆvr1ˆ |jd¡‰d|_d|_|jr^|jˆvr^ˆ |j¡}ˆd|…}d|_d|_ˆ|t |jƒd…}t|| ¡dS|jro|jrld|_tˆdStƒS|jszd|_tˆd StƒS) a? Streaming incremental parsing for reasoning content. Handles partial reasoning tags and content. If stream_reasoning is False: Accumulates reasoning content until the end tag is found If stream_reasoning is True: Streams reasoning content as it arrives c3s"|]}| ˆ¡o|ˆkVqdS)N)Ú startswith)Ú.0Útoken©Úcurrent_textrrÚ cs €ÿ ÿzHBaseReasoningFormatDetector.parse_streaming_increment..rTNFrr%r$)rÚanyrrrrr(rÚfindr Úrstripr)r r/Úend_idxr r rr3rÚparse_streaming_incrementUs8 þÿ z5BaseReasoningFormatDetector.parse_streaming_incrementN)FTFr) rrrrrÚboolrrr.r:rrrrrs*ùþýüûú ù!rc s<eZdZdZ ddedededef‡fd d „ Z‡ZS)ÚDeepSeekR1Detectoraï Detector for DeepSeek-R1 model. Assumes reasoning format: ()*(.*) Returns all the text before the tag as `reasoning_text` and the rest of the text as `normal_text`. Supported models: - DeepSeek-R1: Always generates thinking content without start tag - DeepSeek-R1-0528: Generates thinking content with start tag Format patterns: - DeepSeek-R1: "I need to think about this...The answer is 42." - DeepSeek-R1-0528: "I need to think about this...The answer is 42." Args: stream_reasoning (bool): If False, accumulates reasoning content until the end tag. If True, streams reasoning content as it arrives. TFrrrrrcótƒjddd|||ddS)NúúT©rrrr©Úsuperr©r rrrr©Ú __class__rrr£s úzDeepSeekR1Detector.__init__©TTFr©rrrrr;rrÚ __classcell__rrrDrr<Žsûþýüûr<c ó<eZdZdZ ddedededef‡fd d „ Z‡ZS)Ú Qwen3Detectora^ Detector for Qwen3 models (e.g., Qwen/Qwen3-235B-A22B). Assumes reasoning format: ()*(.*) Qwen3 models released before 07/2025 supports switching between thinking mode and normal mode using `enable_thinking` parameter in the request parameter. - enable_thinking=True: "reasoning contentThe answer is 42." - enable_thinking=False: "The answer is 42." (no thinking tokens) Args: stream_reasoning (bool): If False, accumulates reasoning content until the end tag. If True, streams reasoning content as it arrives. TFrrrrrcótƒjdd||||ddS©Nr>r?r@rArCrDrrrÆó úzQwen3Detector.__init__©TFFrrGrrrDrrJ¶sûþýüûrJc rI)ÚKimiDetectoruä Detector for Kimi Thinking model. Assumes reasoning format: â—thinkâ–·*(.*)â—/thinkâ–· Returns all the text before the â—/thinkâ–· tag as `reasoning_text` and the rest of the text as `normal_text`. TFrrrrrcr=)Nuâ—thinkâ–·uâ—/thinkâ–·Fr@rArCrDrrràrMzKimiDetector.__init__rNrGrrrDrrO×s ûþýüûrOc s`eZdZdZ ddedededef‡fd d „ Zdedefd d„Zdedefdd„Z ‡Z S)ÚGptOssDetectorzT Detector for T4-style reasoning format (GPT-OSS), using the HarmonyParser. TFrrrrrcs$tƒjdd||||dtƒ|_dS)Nz<|channel|>analysis<|message|>z<|end|>r@)rBrrÚparserrCrDrrrösúzGptOssDetector.__init__r"r#cCsŽ|j |¡}||j d¡7}d dd„|Dƒ¡}g}|D]}|jdkr*| |j¡q|jdkr;| |jr7|jn|j¡qd |¡}t||dS)NrcSóg|] }|jdkr|j‘qS©Ú reasoning©Ú event_typeÚcontent©r1ÚerrrÚ óz3GptOssDetector.detect_and_parse..ÚnormalÚ tool_callr©rQÚparseÚjoinrVÚappendrWÚraw_textr)r r"Úeventsr Únormal_partsrYr rrrr.s"ÿ € þzGptOssDetector.detect_and_parser/cCs~|j |¡}d dd„|Dƒ¡}g}|D]}|jdkr"| |j¡q|jdkr3| |jr/|jn|j¡qd |¡}t||dS)NrcSrRrSrUrXrrrrZ"r[z.r\r]rr^)r r/rcr rdrYr rrrr:s ÿ € þz(GptOssDetector.parse_streaming_incrementrF)rrrrr;rrrr.r:rHrrrDrrPñs"ûþýüûrPc s`eZdZdZ ddedededef‡fd d „ Zdedefd d„Zdedefdd„Z ‡Z S)ÚMiniMaxAppendThinkDetectorz> Append `` token to the beginning of the text. TFrrrrrcs"tƒjdd||||dd|_dS)Nr>r?r@F)rBrÚis_first_chunkrCrDrrr8sú z#MiniMaxAppendThinkDetector.__init__r/r#cCs |jsd|_|j|}t|dS)NTr$)rfrr)r r/rrrr:Js z4MiniMaxAppendThinkDetector.parse_streaming_incrementr"cCst|j|dS)Nr$)rr)r r"rrrr.Psz+MiniMaxAppendThinkDetector.detect_and_parserN)rrrrr;rrrr:r.rHrrrDrre3s"ûþýüûrec rI)ÚNanoV3Detectorzo Detector for NanoV3 model. Uses the same reasoning format as DeepSeek-R1: ()*(.*) TFrrrrrcrKrLrArCrDrrr[rMzNanoV3Detector.__init__rNrGrrrDrrgTsûþýüûrgc@s¸eZdZUdZeeeeeeeeeeeee edœZ eee efed< ddeededeed efd d„Zded eeeeeffdd„Zded eeeeeffdd„ZdS)ÚReasoningParserac Parser that handles both streaming and non-streaming scenarios for extracting reasoning content from model outputs. Args: model_type (str): Type of model to parse reasoning from stream_reasoning (bool): If False, accumulates reasoning content until complete. If True, streams reasoning content as it arrives. )zdeepseek-r1zdeepseek-v3Úglm45úgpt-ossÚkimiÚkimi_k2Úqwen3úqwen3-thinkingÚminimaxzminimax-append-thinkÚstep3Ústep3p5Únano_v3Úinterns1ÚDetectorMapNTÚ model_typerrÚrequestcCsª|stdƒ‚|j | ¡¡}|std|›ƒ‚| ¡dvrd}d|i}|dur+||d<|durKt|tƒrK|jrK|jdjdkrKd|d <|jdj |d <|di|¤Ž|_ dS)NzModel type must be specifiedzUnsupported model type: >rorjrnTrréÿÿÿÿÚ assistantrrr)Ú ValueErrorrtÚgetÚlowerÚ isinstancerrÚmessagesÚrolerWÚdetector)r rurrrvÚdetector_classÚkwargsrrrrˆs&ÿþzReasoningParser.__init__Ú full_textr#cCó|j |¡}|j|jfS)z$Non-streaming call: one-time parsing)rr.r r )r r‚ÚretrrrÚparse_non_streamªsz ReasoningParser.parse_non_streamÚ chunk_textcCrƒ)z#Streaming call: incremental parsing)rr:r r )r r†r„rrrÚparse_stream_chunk¯sz"ReasoningParser.parse_stream_chunk)NTNN)rrrrr<rJrPrOrergrtrrrrÚ__annotations__rr;rrrr…r‡rrrrrhlsH òûþýü û""ÿþrhN)ÚtypingrrrrÚ&sglang.srt.entrypoints.openai.protocolrÚ sglang.srt.parser.harmony_parserrrrr<rJrOrPrergrhrrrrÚs{(!B!