o ̳i @s0ddlmZddlmZmZGdddeZdS))List)MessagePromptTemplateInterfacec@s8eZdZdZdddddZdeedeefdd Zd S) Llama2ChatTemplatea  Prompt template that formats chat data of human and system prompts with appropriate tags used in Llama2 pre-training. Taken from Meta's official `Llama inference repository `_. .. code-block:: text "[INST] <> You are a helpful, respectful and honest assistant. <>" I am going to Paris, what should I see? [/INST] Paris, the capital of France, is known for its stunning architecture..." )z<> z <> )z[INST] z [/INST] )r)systemuser assistantipythonmessagesreturnc Csg}g}|D]Z}|jdkr'd|jdddg|jd|jdddg}q|jdkrHd|jdddg||jd|jdddg}n|jdkrP|j}|t|j||j|j|jdq|S) a  Format user and system messages with appropriate tags. Args: messages (List[Message]): a single conversation, structured as a list of `Message` objects Returns: The formatted list of messages rtextr)typecontentrr )rolermaskedr eot)rtemplaterappendrrr r)selfr system_messageformatted_dialoguemessagerr\/home/ubuntu/.local/lib/python3.10/site-packages/torchtune/models/llama2/_prompt_template.py__call__#s@    zLlama2ChatTemplate.__call__N)__name__ __module__ __qualname____doc__rrrrrrrrr srN)typingrtorchtune.datarrrrrrrs