o پi6@sdZddlZddlZddlZddlZddlmZmZmZm Z m Z ddl m Z ddl mZddlmZddlmZmZmZmZeeZGdd d eZdS) a Detector for LFM2 (Liquid Foundation Model 2) function call format. Format Structure (Pythonic style): ``` <|tool_call_start|>[function_name(arg1="value1", arg2="value2")]<|tool_call_end|> ``` Multiple tool calls: ``` <|tool_call_start|>[func1(arg="val"), func2(arg="val")]<|tool_call_end|> ``` Also supports JSON format: ``` <|tool_call_start|>[{"name": "func_name", "arguments": {...}}]<|tool_call_end|> ``` N)AnyDictListOptionalTuple)Tool)envs)BaseFormatDetector)StreamingParseResult StructureInfo ToolCallItem _GetInfoFuncc s:eZdZdZfddZdedefddZdej de fd d Z d ej d e d eee fdeefddZdedeedeeeeffddZdedeedeeeeffddZdedeedeefddZdedeedefddZdedefddZdedeedefddZdefdd Zdefd!d"ZZS)# Lfm2Detectorae Detector for LFM2 (Liquid Foundation Model 2) function call format. Supports both Pythonic and JSON formats: Pythonic: ``` <|tool_call_start|>[calculator(expression="5 * 7")]<|tool_call_end|> ``` JSON: ``` <|tool_call_start|>[{"name": "calculator", "arguments": {"expression": "5 * 7"}}]<|tool_call_end|> ``` cs td|_d|_d|_dS)zJ Initializes the detector with necessary state variables. <|tool_call_start|>z<|tool_call_end|>N)super__init__ bot_token eot_tokentool_call_separatorself __class__Z/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/function_call/lfm2_detector.pyr8s  zLfm2Detector.__init__textreturncCs |j|vS)z4Check if the text contains an LFM2 format tool call.)rrrrrr has_tool_callAs zLfm2Detector.has_tool_callvalcs t|tjr |jSt|tjrfddt|j|jDSt|tjr-fdd|j DSt|tj r?t fdd|j DSt|tj rb|j dkrLdS|j d krSd S|j d krZd Std |j t|tjrt|jtjr|j}t|ttfr| Std|tdt|j)z Extract Python literal value from AST node. Handles constants, dicts, and lists recursively. Reuses pattern from PythonicDetector. cs*i|]\}}|dur||qSN_get_parameter_value).0kvrrr Os z5Lfm2Detector._get_parameter_value..csg|]}|qSrr"r$r&rrr Usz5Lfm2Detector._get_parameter_value..c3s|]}|VqdSr!r"r(rrr Wsz4Lfm2Detector._get_parameter_value..TrueTFalseFNoneNzUnsupported name reference: z!Cannot negate non-numeric value: z+Tool call arguments must be literals, got: ) isinstanceastConstantvaluerzipkeysvaluesreltsrtupleNameid ValueErrorUnaryOpopUSubr#operandintfloattype__name__)rr innerrrrr#Es4           z!Lfm2Detector._get_parameter_valuecall call_index tool_indicesc Cst|jtjstdt|jjdS|jj}||vr,td|t j s,dSi}|j D]8}|j dur>tdq1z ||j||j <Wq1tyi}ztd|j d|WYd}~dSd}~wwt||tj|ddd S) am Parse a single AST Call node into a ToolCallItem. Args: call: AST Call node representing a function call call_index: Index of this call in the list of calls tool_indices: Mapping of tool names to their indices Returns: ToolCallItem if successful, None if the call should be skipped z/Tool call function must be a simple name, got: Nz,Model attempted to call undefined function: z2Tool call with **kwargs unpacking is not supportedzFailed to parse argument z: F) ensure_ascii) tool_indexname parameters)r.funcr/r7loggerwarningr@rAr8rSGLANG_FORWARD_UNKNOWN_TOOLSgetkeywordsargr#r1r9r jsondumps)rrCrDrE function_name argumentskeyworderrr_parse_pythonic_callms:     z!Lfm2Detector._parse_pythonic_callcontenttoolsc CsR|}||}zit|}|jrt|jdddnd}|dur&gdfWSt|tjr0|j}nt|tj r:|g}n gdt |j fWSt dd|DsSgdfWSg}t |D]\}} || ||} | durm|| qY|d fWSty} z gd | fWYd} ~ Sd} ~ wty} ztd gd | fWYd} ~ Sd} ~ ww) a Parse Pythonic format tool calls using AST. Args: content: The content between tool call tags (without the tags) tools: List of available tools Returns: Tuple of (list of parsed calls, error message if any) rr1Nz"Empty or invalid Python expressionz%Expected function call or list, got: css|] }t|tjVqdSr!)r.r/Call)r$rVrrrr*sz7Lfm2Detector._parse_pythonic_content..z+Not all elements in list are function callsrzPython syntax error: z.Unexpected error in pythonic tool call parsingzUnexpected error: )strip_get_tool_indicesr/parsebodygetattrr.rr5rZr@rAall enumeraterWappend SyntaxError ExceptionrK exception) rrXrYrEmoduleparsed call_nodescallsrDrCitemrVrrr_parse_pythonic_contents>         z$Lfm2Detector._parse_pythonic_contentc Cs^|}zt|}|||}|dfWStjy.}z gd|fWYd}~Sd}~ww)a Parse JSON format tool calls. Uses parse_base_json from BaseFormatDetector for consistent handling of SGLANG_FORWARD_UNKNOWN_TOOLS and tool validation. Args: content: The content between tool call tags (without the tags) tools: List of available tools Returns: Tuple of (list of parsed calls, error message if any) rzJSON parse error: N)r[rQloadsparse_base_jsonJSONDecodeError)rrXrYrgrirVrrr_parse_json_contents   z Lfm2Detector._parse_json_contentcCsz|}|ds|dr%|||\}}|r|S|r%td|d|||\}}|r1|S|r;td|gS)zk Parse the content between tool call tags. Handles both JSON and Pythonic formats. z[{{zJSON parsing failed: z, trying Pythonic formatzFailed to parse tool calls: )r[ startswithrorKdebugrkrL)rrXrYrierrorrrr_parse_tool_calls_contentsz&Lfm2Detector._parse_tool_calls_contentc Cs||j}|dkr|d|n|}|j|vrt|gdSt|jdt|j}t||tj}g}|D] }| ||} | | q:t||dS)zW One-time parsing: Detects and parses tool calls in the provided text. N) normal_textriz(.*?)) findrr[r reescaperfindallDOTALLrtextend) rrrYidxrvpatternmatch_result_listri match_result parsed_callsrrrdetect_and_parse s      zLfm2Detector.detect_and_parsecCs||jd|jdS)z Remove special tokens from text.r)replacerrrrrr_strip_special_tokenssz"Lfm2Detector._strip_special_tokensnew_textc Csz|j|7_||j|j}||j|j}|j|j}|dkrH|r:|jd| }|j| d|_t|dS||j}d|_t|dS|dkrS|jd|nd}|j|j|t|j} | dkr|r||rw|j|d|_t|dStddS|r|j|d|_t|dStddS|j|| t|j} |j| t|jd} || |} | |_|r|| j pd| _ | S)a Streaming incremental parsing for LFM2 tool calls. This implementation properly handles Pythonic format by: 1. Buffering until we see complete <|tool_call_start|>[...]<|tool_call_end|> 2. Emitting normal text before tool calls immediately 3. Parsing complete tool call blocks using detect_and_parse Based on PythonicDetector streaming logic. ruN)rvrr) _buffer_ends_with_partial_tokenrrrwr rlenrrv) rrrY partial_bot partial_eotbot_pos safe_textrvnormal_text_beforeeot_postool_call_block remainingresultrrrparse_streaming_increment#s>         z&Lfm2Detector.parse_streaming_incrementcCsdS)a Return False because LFM2 uses Pythonic format which is not JSON-compatible. structural_tag only supports JSON-compatible content between begin and end, so it cannot parse Pythonic function call syntax like `func(arg="val")`. Frrrrrsupports_structural_tagosz$Lfm2Detector.supports_structural_tagcCsddS)z Return structure info for constrained generation. Note: This is provided for completeness but won't be used since supports_structural_tag() returns False. cSstd|ddddS)Nz<|tool_call_start|>[(z)]<|tool_call_end|>r)beginendtrigger)r )rHrrrs  z-Lfm2Detector.structure_info..rrrrrstructure_infoxszLfm2Detector.structure_info) rA __module__ __qualname____doc__rstrboolrr/ASTrr#rZr>rrr rWrrrrkrortr rrrrr r __classcell__rrrrr's\  (  1 4   L r)rr/rQloggingrxtypingrrrrr&sglang.srt.entrypoints.openai.protocolrsglang.srt.environr-sglang.srt.function_call.base_format_detectorr #sglang.srt.function_call.core_typesr r r r getLoggerrArKrrrrrs