o i$@sdZddlZddlZddlmZddlmZmZmZm Z m Z ddl m Z ddl mZddlmZddlmZmZdd lmZmZdd lmZGd d d e ZGd ddeZdS)zGrok Realtime LLM adapter for Pipecat. Converts Pipecat's tool schemas and context into the format required by Grok's Voice Agent API. N) dataclass)AnyDictListOptional TypedDict)logger)BaseLLMAdapter)FunctionSchema) AdapterType ToolsSchema) LLMContextLLMContextMessage)eventsc@s@eZdZUdZeeed<eej ed<ee ee fed<dS)GrokRealtimeLLMInvocationParamsa7Context-based parameters for invoking Grok Realtime API. Attributes: system_instruction: System prompt/instructions for the session. messages: List of conversation items formatted for Grok Realtime. tools: List of tool definitions (function, web_search, x_search, file_search). system_instructionmessagestoolsN) __name__ __module__ __qualname____doc__rstr__annotations__rrConversationItemrrrrc/home/ubuntu/.local/lib/python3.10/site-packages/pipecat/adapters/services/grok_realtime_adapter.pyrs  rc@seZdZdZedefddZdedefddZ de e ee ffdd Z eGd d d Zd e edefd dZdedejfddZedede ee ffddZdede e ee ffddZdS)GrokRealtimeLLMAdapterzLLM adapter for Grok Voice Agent API. Converts Pipecat's universal context and tool schemas into the specific format required by Grok's Voice Agent Realtime API. returncCsdS)zJGet the identifier used in LLMSpecificMessage instances for Grok Realtime.z grok-realtimerselfrrrid_for_llm_specific_messages0sz3GrokRealtimeLLMAdapter.id_for_llm_specific_messagescontextcCs,|||}|j|j||jpgdS)a Get Grok Realtime-specific LLM invocation parameters from a universal LLM context. Args: context: The LLM context containing messages, tools, etc. Returns: Dictionary of parameters for invoking Grok's Voice Agent API. )rrr) _from_universal_context_messages get_messagesrrfrom_standard_toolsr)r r"rrrrget_llm_invocation_params5s  z0GrokRealtimeLLMAdapter.get_llm_invocation_paramscCs|g}||D]4}t|}d|vr6t|dtr6|dD]}|ddkr*d|d<|ddkr5d|d<q||q|S)aGet messages from context in a format safe for logging. Removes or truncates sensitive data like audio content. Args: context: The LLM context containing messages. Returns: List of messages with sensitive data redacted. contenttype input_audioz...audio)r$copydeepcopy isinstancelistgetappend)r r"msgsmessagemsgitemrrrget_messages_for_loggingEs    z/GrokRealtimeLLMAdapter.get_messages_for_loggingc@s0eZdZUdZeejed<dZe e ed<dS)z(GrokRealtimeLLMAdapter.ConvertedMessageszGContainer for Grok-formatted messages converted from universal context.rNr) rrrrrrrrrrrrrrrConvertedMessages]s r6universal_context_messagesc Cs|s|jgdSt|}d}|dddkr?|d}|d}t|tr*|}n t|tr6|dd}|s?|jg|dSt|d kr[|ddd kr[|j| |dg|dSd }d }|jt j d d t j dd |tj|dd|gdgdg|dS)aConvert universal context messages to Grok Realtime format. Similar to OpenAI Realtime, we pack conversation history into a single user message since the realtime API doesn't support loading long histories. Args: universal_context_messages: List of messages in universal format. Returns: ConvertedMessages with Grok-formatted messages and system instruction. )rNrrolesystemr'text)rruserz This is a previously saved conversation. Please treat this conversation history as a starting point for the current conversation.aS This is the end of the previously saved conversation. Please continue the conversation from here. If the last message is a user instruction or question, act on that instruction or answer the question. If the last message is an assistant response, simply say that you are ready to continue the conversation.r2 input_textz )indentr(r:r8r(r')r6r+r,r/popr-rr.len_from_universal_context_messagerr ItemContentjoinjsondumps)r r7rrr9r' intro_text trailing_textrrrr#dsL       z7GrokRealtimeLLMAdapter._from_universal_context_messagesr2cCs|ddkrI|d}t|tr;d}|D]!}|ddkr(|d|d7}qtd|dd |q|}tjdd tjd |d gd S|ddkro|dro|dd}tjd|d|dd|dddStd|dS)zConvert a single universal context message to Grok format. Args: message: Message in universal format. Returns: ConversationItem formatted for Grok Realtime API. r8r<r'r(r: z+Unhandled content type in context message: z - r2r=r@rA assistant tool_callsr function_callidfunctionname arguments)r(call_idrRrSz;Unhandled message type in _from_universal_context_message: N) r/r-r.rerrorstriprrrE)r r2r' text_contentctcrrrrDs2    z6GrokRealtimeLLMAdapter._from_universal_context_messagerQcCsd|j|jd|j|jddS)zConvert a function schema to Grok Realtime function format. Args: function: The function schema to convert. Returns: Dictionary in Grok Realtime function format. rQobject)r( propertiesrequired)r(rR description parameters)rRr]r[r\)rQrrr_to_grok_function_formats z/GrokRealtimeLLMAdapter._to_grok_function_format tools_schemacs:|j}fdd|D}g}|jr|jtjg}||S)aUConvert tool schemas to Grok Realtime format. Supports both standard function tools and Grok-specific tools (web_search, x_search, file_search). Args: tools_schema: The tools schema containing functions to convert. Returns: List of tool definitions in Grok Realtime format. csg|]}|qSr)r_).0funcrrr szCGrokRealtimeLLMAdapter.to_provider_tools_format..)standard_tools custom_toolsr/r SHIM)r r`functions_schemard shimmed_toolsrrrto_provider_tools_formats  z/GrokRealtimeLLMAdapter.to_provider_tools_formatN)rrrrpropertyrr!r rr&rrrr5rr6rr#rrrD staticmethodr r_r rirrrrr)s* G ("r)rr+rG dataclassesrtypingrrrrrlogurur!pipecat.adapters.base_llm_adapterr (pipecat.adapters.schemas.function_schemar %pipecat.adapters.schemas.tools_schemar r *pipecat.processors.aggregators.llm_contextr rpipecat.services.grok.realtimerrrrrrrs