o ۾i @sdZddlmZddlmZddlmZddlmZm Z m Z GdddeZ ded e e d e d Bd ed ee d Beff ddZd S)z Harmony-specific streaming delta extraction for chat completions. This module handles the extraction of DeltaMessage objects from harmony parser state during streaming chat completions. ) NamedTuple)StreamableParser)make_tool_call_id)DeltaFunctionCall DeltaMessage DeltaToolCallc@s.eZdZUedBed<edBed<eed<dS) TokenStateNchannel recipienttext)__name__ __module__ __qualname__str__annotations__rrj/home/ubuntu/.local/lib/python3.10/site-packages/vllm/entrypoints/openai/chat_completion/stream_harmony.pyrs   rharmony_parser token_statesprev_recipientNinclude_reasoningreturnc Cs|sdSd}g}|dj}|dj}|dj}tdt|D](} || } | j|kr4| j|kr4|| j7}q|t|||| j}| j}| j}q|t|||d} d} d} g}d}d}|jD]}|jdksk|jdkrx|jrx|jd rx|d7}q_|r|d r|d}|}n|}d}|D]}|jd kr| |j7} d }q|jdks|jdkr|jr|jd rd}||jkr|j d dd}|t t d t |dd |dd }|j}|d7}|jr|r|d}n|dur|n|}|t |t |jddq|jdkr| |j7} d }q|jdkr|r| |j7} q|s| s|rBi}|r'| |d<| r.| |d<|r7||d<d }t di|} | |fSd} | |fS)a Extract a DeltaMessage from harmony parser state during streaming. Args: harmony_parser: The StreamableParser instance tracking parse state token_states: List of TokenState tuples for each token prev_recipient: Previous recipient for detecting tool call transitions include_reasoning: Whether to include reasoning content Returns: A tuple of (DeltaMessage or None, tools_streamed_flag) )NFFrN commentaryanalysisz functions.finalTfunction)name arguments)idtyperindex)r)r"rcontent reasoning tool_callsr)r r r rangelenappendrmessages startswithsplitrrrr)rrrrtools_streamedgroupscurrent_channelcurrent_recipient current_textistate delta_messagecombined_contentcombined_reasoning tool_messagescontent_encountered base_indexmsgnext_tool_indexongoing_tool_indexgroupopened_new_call tool_nametool_call_index delta_kwargsrrrextract_harmony_streaming_deltas                rA)__doc__typingropenai_harmonyrvllm.entrypoints.chat_utilsr'vllm.entrypoints.openai.engine.protocolrrrrlistrbooltuplerArrrrs"