o *i:@sddlmZddlmZmZddlmZddlmZddl m Z ddl m Z m Z mZmZddlmZmZddlmZmZmZGd d d eeZGd d d eZGd dde eeZGdddeeeefZdS))Enum)AnyGeneric)Field) MistralBase)BaseCompletionRequest)_check_openai_fields_names_is_openai_field_nameconvert_openai_messagesconvert_openai_tools) ChatMessageChatMessageType)Tool ToolChoiceToolTypec@seZdZdZdZdZdS)ResponseFormatszEnum of the different formats of an instruct response. Attributes: text: The response is a plain text. json: The response is a JSON object. Examples: >>> response_format = ResponseFormats.text text json_objectN)__name__ __module__ __qualname____doc__rjsonrre/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/mistral_common/protocol/instruct/request.pyrs rc@s eZdZUdZejZeed<dS)ResponseFormatzThe format of the response. Attributes: type: The type of the response. Examples: >>> response_format = ResponseFormat(type=ResponseFormats.text) typeN)rrrrrrr__annotations__rrrrr$s  rc@seZdZUdZdZedBed<eeed<e e dZ e ed<dZ ee dBed<ejZeed<d Zeed <d Zeed <d ed eeeeeefffddZe  ddeeeeeeeeeeefBfBfdeeeefdBd ed ed df ddZdS)ChatCompletionRequestaRequest for a chat completion. Attributes: model: The model to use for the chat completion. messages: The messages to use for the chat completion. response_format: The format of the response. tools: The tools to use for the chat completion. tool_choice: The tool choice to use for the chat completion. truncate_for_context_length: Whether to truncate the messages for the context length. continue_final_message: Whether to continue the final message. Examples: >>> from mistral_common.protocol.instruct.messages import UserMessage, AssistantMessage >>> from mistral_common.protocol.instruct.tool_calls import ToolTypes, Function >>> request = ChatCompletionRequest( ... messages=[ ... UserMessage(content="Hello!"), ... AssistantMessage(content="Hi! How can I help you?"), ... ], ... response_format=ResponseFormat(type=ResponseFormats.text), ... tools=[Tool(type=ToolTypes.function, function=Function(name="get_weather", parameters={}))], ... tool_choice=ToolChoice.auto, ... truncate_for_context_length=True, ... ) Nmodelmessages)default_factoryresponse_formattools tool_choiceFtruncate_for_context_lengthcontinue_final_messagekwargsreturncKs|jhddd}|dd}|dur||d<|jrtd|D]&}||vr-td||tjvr:td |d t|sFtd |d q g}|jD] }| | qL||d <|j duridd|j D|d<| ||S)a Convert the request messages and tools into the OpenAI format. Args: kwargs: Additional parameters to be added to the request. Returns: The request in the OpenAI format. Examples: >>> from mistral_common.protocol.instruct.messages import UserMessage >>> from mistral_common.protocol.instruct.tool_calls import Tool, Function >>> request = ChatCompletionRequest(messages=[UserMessage(content="Hello, how are you?")], temperature=0.15) >>> request.to_openai(stream=True) {'temperature': 0.15, 'top_p': 1.0, 'response_format': {'type': 'text'}, 'tool_choice': 'auto', 'continue_final_message': False, 'messages': [{'role': 'user', 'content': 'Hello, how are you?'}], 'stream': True} >>> request = ChatCompletionRequest(messages=[UserMessage(content="Hello, how are you?")], tools=[ ... Tool(function=Function( ... name="get_current_weather", ... description="Get the current weather in a given location", ... parameters={ ... "type": "object", ... "properties": { ... "location": { ... "type": "string", ... "description": "The city and state, e.g. San Francisco, CA", ... }, ... "unit": {"type": "string", "enum": ["celsius", "fahrenheit"]}, ... }, ... "required": ["location"], ... }, ... ), ... )]) >>> request.to_openai() {'temperature': 0.7, 'top_p': 1.0, 'response_format': {'type': 'text'}, 'tool_choice': 'auto', 'continue_final_message': False, 'messages': [{'role': 'user', 'content': 'Hello, how are you?'}], 'tools': [{'type': 'function', 'function': {'name': 'get_current_weather', 'description': 'Get the current weather in a given location', 'parameters': {'type': 'object', 'properties': {'location': {'type': 'string', 'description': 'The city and state, e.g. San Francisco, CA'}, 'unit': {'type': 'string', 'enum': ['celsius', 'fahrenheit']}}, 'required': ['location']}}}]} >r#r r%Texclude exclude_none random_seedNseedzETruncating for context length is not implemented for OpenAI requests.Duplicate keyword argument: Keyword argument  is already set in the request.Invalid keyword argument: $, it should be an OpenAI field name.r cSg|]}|qSr to_openai.0toolrrr z3ChatCompletionRequest.to_openai..r#) model_dumppopr%NotImplementedError ValueErrorr model_fieldsr r appendr5r#update)selfr'openai_requestr-kwargopenai_messagesmessagerrrr5Ts0%     zChatCompletionRequest.to_openaicKsd|vr d|vr td|ddp|dd}tt|jt|t|}|dur2t|nd}|d||||d|S)aCreate a chat completion request from the OpenAI format. Args: messages: The messages in the OpenAI format. tools: The tools in the OpenAI format. continue_final_message: Whether to continue the final message. **kwargs: Additional keyword arguments to pass to the constructor. These should be the same as the fields of the request class or the OpenAI API equivalent. Returns: The chat completion request. r-r,z-Cannot specify both `seed` and `random_seed`.N)r r#r,r&r)r>r<rsetr?keysr r )clsr r#r&r'r,converted_messagesconverted_toolsrrr from_openaisz!ChatCompletionRequest.from_openaiNF)rrrrrstrrlistr rrr"r#rrautor$r%boolr&rdictr5 classmethodrLrrrrr1s0    &I*rc@seZdZUdZeeed<dZedBed<dZ ee dBed<dZ e dBed<dZ eed<d ed eeeeeefffd d Ze  ddeeeeeeeeeeefBfBfd eeeefdBded ed df ddZdS)InstructRequestaA valid Instruct request to be tokenized. Attributes: messages: The history of the conversation. system_prompt: The system prompt to be used for the conversation. available_tools: The tools available to the assistant. truncate_at_max_tokens: The maximum number of tokens to truncate the conversation at. continue_final_message: Whether to continue the final message. Examples: >>> from mistral_common.protocol.instruct.messages import UserMessage, SystemMessage >>> request = InstructRequest( ... messages=[UserMessage(content="Hello, how are you?")], system_prompt="You are a helpful assistant." ... ) r N system_promptavailable_toolstruncate_at_max_tokensFr&r'r(cKs|jhddd}|D]&}||vrtd||tjvr%td|dt|s1td|dq g}|jd urB|d |jd |jD] }||qE||d <|j d urbd d|j D|d<|j d urkt d| ||S)aConvert the request messages and tools into the OpenAI format. Args: kwargs: Additional parameters to be added to the request. Returns: The request in the OpenAI format. Examples: >>> from mistral_common.protocol.instruct.messages import UserMessage >>> from mistral_common.protocol.instruct.tool_calls import Tool, Function >>> request = InstructRequest(messages=[UserMessage(content="Hello, how are you?")]) >>> request.to_openai(temperature=0.15, stream=True) {'continue_final_message': False, 'messages': [{'role': 'user', 'content': 'Hello, how are you?'}], 'temperature': 0.15, 'stream': True} >>> request = InstructRequest( ... messages=[UserMessage(content="Hello, how are you?")], ... available_tools=[ ... Tool(function=Function( ... name="get_current_weather", ... description="Get the current weather in a given location", ... parameters={ ... "type": "object", ... "properties": { ... "location": { ... "type": "string", ... "description": "The city and state, e.g. San Francisco, CA", ... }, ... "unit": {"type": "string", "enum": ["celsius", "fahrenheit"]}, ... }, ... "required": ["location"], ... }, ... ), ... )]) >>> request.to_openai() {'continue_final_message': False, 'messages': [{'role': 'user', 'content': 'Hello, how are you?'}], 'tools': [{'type': 'function', 'function': {'name': 'get_current_weather', 'description': 'Get the current weather in a given location', 'parameters': {'type': 'object', 'properties': {'location': {'type': 'string', 'description': 'The city and state, e.g. San Francisco, CA'}, 'unit': {'type': 'string', 'enum': ['celsius', 'fahrenheit']}}, 'required': ['location']}}}]} >r rVrWTr)r.r/r0r1r2Nsystem)rolecontentr cSr3rr4r6rrrr9r:z-InstructRequest.to_openai..r#z@Truncating at max tokens is not implemented for OpenAI requests.) r;r>rTr?r rUr@r r5rVrWr=rA)rBr'rCrDrErFrrrr5s.'      zInstructRequest.to_openair#cKsrd|vr|dur|d}ntdtt|jt|t|}|dur,t|nd}|d|||d|S)aCreate an instruct request from the OpenAI format. Args: messages: The messages in the OpenAI format. tools: The tools in the OpenAI format. continue_final_message: Whether to continue the final message. **kwargs: Additional keyword arguments to pass to the constructor. These should be the same as the fields of the request class or the OpenAI API equivalent. Returns: The instruct request. rVNz2Cannot specify both `tools` and `available_tools`.)r rVr&r)r<r>rrGr?rHr r )rIr r#r&r'rJrKrrrrL's zInstructRequest.from_openairM)rrrrrOr rrUrNrVrrWintr&rQrrRr5rSrLrrrrrTs,   &J*rTN)enumrtypingrrpydanticrmistral_common.basermistral_common.protocol.baser+mistral_common.protocol.instruct.convertersrr r r )mistral_common.protocol.instruct.messagesr r +mistral_common.protocol.instruct.tool_callsrrrrNrrrrTrrrrs