o c۷iPX@s\ddlZddlmZddlmZddlmZmZddlm Z ddl m Z m Z m Z mZmZmZmZmZddlmZmZddlmZmZmZmZmZmZmZmZmZm Z dd l!m"Z"dd l#m$Z$m%Z%m&Z&m'Z'dd l(m)Z)Gd d d e*eZ+Gdddee eeefZ,Gddde,Z-Gddde-Z.Gddde.Z/Gddde/Z0de)de+de,fddZ1dS)N)Enum)Generic)Draft7Validator SchemaError) assert_never) InvalidAssistantMessageExceptionInvalidFunctionCallException InvalidMessageStructureExceptionInvalidRequestExceptionInvalidSystemPromptExceptionInvalidToolExceptionInvalidToolMessageExceptionInvalidToolSchemaException) AudioChunk AudioURLChunk) UATSAssistantMessageAssistantMessageTypeFinetuningAssistantMessageRoles SystemMessageSystemMessageTypeToolMessageType UserMessageUserMessageType)ChatCompletionRequest)Function FunctionCallToolToolCall)TokenizerVersionc@seZdZdZdZdZdZdS)ValidationModezEnum for the validation mode. Attributes: serving: The serving mode. finetuning: The finetuning mode. test: The test mode. Examples: >>> mode = ValidationMode.serving serving finetuningtestN)__name__ __module__ __qualname____doc__r"r#r$r)r)`/home/ubuntu/vllm_env/lib/python3.10/site-packages/mistral_common/protocol/instruct/validator.pyr!)s  r!c@seZdZUdZdZeed<ejfdefddZ e defdd Z d e e d edd fd dZdedee fddZdedd fddZde edd fddZdedd fddZdedd fddZdedd fddZdedd fd d!Zd"ed#edd fd$d%Zd4ded#edd fd&d'Z d e e dd fd(d)Z!d e e dd fd*d+Z"de d edd fd,d-Z#d e e d edd fd.d/Z$d e e dd fd0d1Z%dedd fd2d3Z&d S)5MistralRequestValidatoraValidator for Mistral requests. This class validates the structure and content of Mistral requests. Examples: >>> from mistral_common.protocol.instruct.messages import UserMessage, AssistantMessage >>> validator = MistralRequestValidator() >>> messages = [UserMessage(content="Hello how are you ?")] >>> validator.validate_messages(messages, False) F_allow_tool_call_and_contentmodecCs ||_dS)zInitializes the `MistralRequestValidator`. Args: mode: The validation mode. Defaults to ValidationMode.test. N_mode)selfr-r)r)r*__init__Hs z MistralRequestValidator.__init__returncCs|jSNr.)r0r)r)r*r-PszMistralRequestValidator.modemessagescontinue_final_messageNcCs|j||d||dS)aValidates the list of messages. Args: messages: The list of messages to validate. continue_final_message: Whether to continue the final message. Examples: >>> from mistral_common.protocol.instruct.messages import UserMessage, AssistantMessage >>> validator = MistralRequestValidator() >>> messages = [AssistantMessage(content="Hi"), UserMessage(content="Hello")] >>> validator.validate_messages(messages, False) r5N) _validate_message_list_structure_validate_message_list_contentr0r4r5r)r)r*validate_messagesTs z)MistralRequestValidator.validate_messagesrequestcCsN|jtjkr|jdurtd|j|j|jd||j pg| ||S)aValidates the request Args: request: The request to validate. Returns: The validated request. Examples: >>> from mistral_common.protocol.instruct.messages import UserMessage >>> validator = MistralRequestValidator() >>> request = ChatCompletionRequest(messages=[UserMessage(content="Hello")]) >>> validated_request = validator.validate_request(request) Nz1Model name parameter is required for serving moder6) r/r!r"modelr r:r4r5_validate_toolstools_validate_model_settingsr0r;r)r)r*validate_requestds   z(MistralRequestValidator.validate_requestfunctionc Cs^zt|jWnty}ztd|jd}~wwtd|js-t d|jddS)zE Checks: - That the function schema is valid zInvalid tool schema: N^[a-zA-Z0-9_-]{1,64}$Function name was [ but must be a-z, A-Z, 0-9, or contain underscores and dashes, with a maximum length of 64.) r check_schema parametersrrmessagerematchnamer )r0rBer)r)r*_validate_functions z*MistralRequestValidator._validate_functionr>cCs|D]}||jqdS)zC Checks: - That the tool schemas are valid N)rMrB)r0r>toolr)r)r*r=sz'MistralRequestValidator._validate_toolsrHcCdSr3r)r0rHr)r)r*_validate_user_messagez.MistralRequestValidator._validate_user_messagecCs2|jdurtd|jstd|jddSdS)z: Checks: - The tool name is valid NrCrDrE)rKrIrJr rPr)r)r*_validate_tool_messages  z.MistralRequestValidator._validate_tool_messagecCs|jdur tddS)zF Checks: - That the system prompt has content NzSystem prompt must have content)contentr rPr)r)r*_validate_system_messages z0MistralRequestValidator._validate_system_message function_callcCs$td|jstd|jddS)zK Checks: - That the function call has a valid name rCrDrEN)rIrJrKr)r0rVr)r)r*_validate_function_calls  z/MistralRequestValidator._validate_function_call tool_callis_last_messagecCs||jdS)zK Checks: - That the tool call has a valid function N)rWrB)r0rXrYr)r)r*_validate_tool_callsz+MistralRequestValidator._validate_tool_callcCs|jst|jt|jkrtd|jdur#|jD] }|j||dq|jtjkr assistant -> user -> assistant -> ... NzUnexpected role 'z' after role '')rersystemuserrfrNr )r0r4 previous_rolerH current_roleexpected_rolesr)r)r*_validate_message_orders$     z/MistralRequestValidator._validate_message_ordercCs|j}|jtjkr|tjkrtd||rtddSt|to(|j o(| }|jtj tj hv}|r=|r=td||rN|tjksG|j rPtd|dSdS)Nz4Expected last role Assistant for finetuning but got z0Cannot continue final message in finetuning modezuExpected last role User or Tool (or Assistant with prefix or continue_final_message set to True) for serving but got zkExpected last role Assistant with prefix False for serving with continue_final_message set to True but got ) rer/r!r#rrfr r_rrarmrN)r0rHr5last_message_role bad_assistantbad_roler)r)r*_validate_last_messages0  z.MistralRequestValidator._validate_last_messagecCst|dkr tdt|dkr|djtjtjhvrtd|jtjks+t|dkr4|j |d|d| || |dS)z Validates the structure of the list of messages For example the messages must be in the correct order of user/assistant/tool rz+Conversation must have at least one messager\z=Conversation must start with a user message or system messager6N) rgr rerrmrlr/r!r#rurqrjr9r)r)r*r73s   z8MistralRequestValidator._validate_message_list_structurecCst|D]D\}}|jtjkr||q|jtjkr(|j||t|dkdq|jtjkr4| |q|jtj kr@| |qt dt |dS)z7 Validates the content of the messages r\r[zUnsupported message type N) enumeratererrmrQrfrbrgrNrSrlrUr type)r0r4idxrHr)r)r*r8Is       z6MistralRequestValidator._validate_message_list_contentcCs"|j}durtd|ddS)Nzreasoning_effort=z is not supported for this model)reasoning_effortr )r0r;rzr)r)r*r?Zsz0MistralRequestValidator._validate_model_settings)F)'r%r&r'r(r,r]__annotations__r!r$r1propertyr-listrr:rrArrMrr=rrQrrSrrUrrWrrZrrbrjrqrur7r8r?r)r)r)r*r+:s,      r+csVeZdZdZdeddfddZdededdfd d Zde d eddffd d Z Z S)MistralRequestValidatorV3zValidator for v3 Mistral requests. This validator adds additional validation for tool call IDs. Examples: >>> validator = MistralRequestValidatorV3() rHr2NcCs`|jdurtd|jstd|jd|jdurtdtd|js.td|jddS) zZ Checks: - The tool name is valid - Tool call id is valid NrCrDrEzTool call id has to be defined.^[a-zA-Z0-9]{9}$Tool call id was / but must be a-z, A-Z, 0-9, with a length of 9.)rKrIrJr tool_call_idr rPr)r)r*rShs    z0MistralRequestValidatorV3._validate_tool_messagerXrYcCs~|jdkrtd|jstd|jd|jtjkr(|s(|jdkr(d}t||jtjkr7|jdkr7td||j dS)z< Validate that the tool call has a valid ID nullrrrzXTool call id of assistant message that is not last has to be defined in finetuning mode.z/Tool call id has to be defined in serving mode.N) idrIrJrr/r!r#r"rWrB)r0rXrY err_messager)r)r*rZ}s  z-MistralRequestValidatorV3._validate_tool_callr5csJt|||jtjkr|jdur!|jD] }|j|ddqdSdSdS)NTr[)superrur/r!r#r^rZ)r0rHr5rX __class__r)r*rus   z0MistralRequestValidatorV3._validate_last_message) r%r&r'r(rrSrr]rZrru __classcell__r)r)rr*r~_s "r~csVeZdZUdZdZeed<deeddfddZ deed eddffd d Z Z S) MistralRequestValidatorV5a*Validator for v5 Mistral requests. This validator allows for both tool calls and content in the assistant message. Note: For requests containing audio, this validator ensures that no system prompt is present. Examples: >>> validator = MistralRequestValidatorV5() Tr,r4r2Ncsdtdtfdddtdtfddtfdd|D}|o)tfd d|D}|rMfd d t|D}fd d t|D}td |d|ddS)zKValidates that system prompts and audio chunks are not used together in v5.rHr2cSs t|tSr3)r_rrHr)r)r* _is_systems zOMistralRequestValidatorV5._validate_system_prompt_and_audio.._is_systemcSs*t|tot|jtotdd|jDS)Ncss|] }t|ttfVqdSr3)r_rr).0chunkr)r)r* szbMistralRequestValidatorV5._validate_system_prompt_and_audio.._has_audio..)r_rrTr}anyrr)r)r* _has_audios  zOMistralRequestValidatorV5._validate_system_prompt_and_audio.._has_audioc3|]}|dVqdSrNr)rrHrr)r*rzNMistralRequestValidatorV5._validate_system_prompt_and_audio..c3rrr)rrr)r*rrcg|] \}}|dr|qSrr)rirHrr)r* zOMistralRequestValidatorV5._validate_system_prompt_and_audio..crrr)rrr)r*rrz!Found system messages at indexes z) and audio chunks in messages at indexes z8. This is not allowed prior to the tokenizer version 13.N)rr]rrw ValueError)r0r4has_sphas_sp_and_audio sp_indexes audio_indexesr))rrr*!_validate_system_prompt_and_audiosz;MistralRequestValidatorV5._validate_system_prompt_and_audior5cstj||d||dS)N)r4r5)rr7rr9rr)r*r7sz:MistralRequestValidatorV5._validate_message_list_structure) r%r&r'r(r,r]r{r}rrr7rr)r)rr*rs  &rc@s<eZdZdZdeeddfddZdeeddfddZdS) MistralRequestValidatorV13zValidator for v13 Mistral requests. This validator extends v5 functionality by: - Adding stricter tool call ID validation: they should be distinct and called. - Allowing system prompts with audio chunks r4r2NcCs@d}t}t}|D]m}|dur|j}q |jtjkr;|j}||vr)td|d||vr5td|d||n9|jtjkrtt|t|krMtd| | |j durt|j D]}|j |vrmtd|j d||j q]|j}q t|t|kr|j t jkrtdt|t|kr|j t jkrtddSdS)z Checks: - That the number and ids of tool calls and tool messages are the same - That the tool calls are followed by tool messages - That tool calls have distinct ids for a given assistant message NzDuplicate tool call id z in tool resultszUnexpected tool call id rcz in assistant messagerd)setrerrNrr addrfrgclearr^rr/r!r"r#)r0r4rhexpected_tool_idsobserved_tool_idsrHrrXr)r)r*rjs@       zIMistralRequestValidatorV13._validate_tool_calls_followed_by_tool_messagescCsdS)z9Allows system prompts and audio chunks to coexist in v13.Nr))r0r4r)r)r*rszs(   ( 0  ';+<