o پi5 @sXUdZddlZddlZddlZddlZddlmZmZddlm Z m Z m Z m Z m Z mZddlmZddlmZddlmZmZGdd d eZejGd d d ZiZe eefed <gZe e ed <ddedefddZddZddZ dedefddZ!de ede ede edede ef ddZ"d hZ#d!ed"e$d#edefd$d%Z%d&ededefd'd(Z&eed)d*d+ej'd,d-gd.d/eed0d1d+ej'd,d-gd2d3d4eed5d1ed6d+ej'd,d-gd2d3d7 eed8d9d:ej(d;gd<d=d>eed?d;d@dAej)dBdBdCdDdE eedFdGdHdIej*dJdKdJgdLeedMdGdHdIej*dJdKdJgdLeedNdOdPej+d,dQdReedSdTdUd:ej,d;dVdWgd=dXeedYdTdUd:ej,d;dVdWgdZeed[dGdId\dJd]gd^eed_dGd`daej-dbdJd]gdcddde eedfdHdGdIdbej.dJgdgdhdi eedjd;d;dkd;ej)dlgdmdddn eedod;dpdqdrej/drgdsdteed d@d;dudvdej0dwdldxdlgdy eedzdHd{d|d}ej1d~gddd eeddHdGdIdbej2dKdgdteeddddIdbej.ddddi eeddddqdwdlej+ddlgdd eedddGdIdbej.dddd eeddddgdJej)dJdd eeddGdHdIdbej3dJgddeedd;d;dIdbej.dJgdgdhdi d_d dd?dddjdodZ4edefddZ5dede efddZ6edefddZ7edefddZ8edefddZ9edefddZ:edefddZ;edefddZedefddZ?dS)aConversation chat templates. This module provides conversation template definitions, data structures, and utilities for managing chat templates across different model types in SGLang. Key components: - Conversation class: Defines the structure and behavior of chat templates - SeparatorStyle enum: Different conversation formatting styles - Template registry: Functions to register and retrieve templates by name or model path - Built-in templates: Pre-defined templates for popular models N)IntEnumauto)CallableDictListOptionalTupleUnion)Literal)ChatCompletionRequest) ImageDataread_system_prompt_from_filec@seZdZdZeZeZeZeZeZ eZ eZ eZ eZ eZeZeZeZeZeZeZeZeZeZeZeZeZeZeZeZeZdS)SeparatorStylezSeparator styles.N)__name__ __module__ __qualname____doc__rADD_COLON_SINGLE ADD_COLON_TWOADD_COLON_SPACE_SINGLENO_COLON_SINGLE NO_COLON_TWOADD_NEW_LINE_SINGLELLAMA2LLAMA3LLAMA4CHATGLMCHATML CHATINTERNDOLLYRWKVPHOENIXROBIN FALCON_CHATCHATGLM3 DEEPSEEK_CHATMETAMATH DeepSeekVL2QWEN2_VL_EMBED QWEN2_AUDIOGEMMA3MPT PADDLE_OCRr-r-R/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/parser/conversation.pyr)s8 rc@seZdZUdZeed<dZeed<dZeed<dZe eed<d Z e e eed <d Z e ed <ejZeed <dZeed<dZeed<dZeee efed<dZeed<dZeed<dZeed<dZee eed<dZee eed<dZee eed<dZee ed<dZee eed<dZe ed<d efd!d"Z!defd#d$Z"d%ed&efd'd(Z#d)ed*e$d+fd,d-Z%d.efd/d0Z&d1efd2d3Z'd&efd4d5Z(d6d7Z)d8d9Z*d:d;Z+d ConversationzIA class that manages prompt templates and keeps all conversation history.name{system_message}system_templatesystem_messageUSER ASSISTANTrolesr-messagesroffset sep_style sepNsep2stop_str image_tokenz