o i @sjdZddlmZddlmZddlmZddlmZddl m Z eGdddej Z Gd d d e Z d S) z;OLLama LLM service implementation for Pipecat AI framework.) dataclass)Optional)logger)BaseOpenAILLMService)OpenAILLMServicec@seZdZdZdS)OllamaLLMSettingszSettings for OLLamaLLMService.N)__name__ __module__ __qualname____doc__r r O/home/ubuntu/.local/lib/python3.10/site-packages/pipecat/services/ollama/llm.pyrsrcs\eZdZUdZeZeed<dddddeededeeffd d Z d fd d Z Z S)OLLamaLLMServicezOLLama LLM service that provides local language model capabilities. This service extends OpenAILLMService to work with locally hosted OLLama models, providing a compatible interface for running large language models locally. _settingsNzhttp://localhost:11434/v1)modelbase_urlsettingsrrrc sV|jdd}|dur|dd||_|dur||tjd|d|d|dS)aWInitialize OLLama LLM service. Args: model: The OLLama model to use. Defaults to "llama2". .. deprecated:: 0.0.105 Use ``settings=OLLamaLLMService.Settings(model=...)`` instead. base_url: The base URL for the OLLama API endpoint. Defaults to "http://localhost:11434/v1". settings: Runtime-updatable settings. When provided alongside deprecated parameters, ``settings`` values take precedence. **kwargs: Additional keyword arguments passed to OpenAILLMService. llama2)rNrollama)rapi_keyrr )Settings"_warn_init_param_moved_to_settingsr apply_updatesuper__init__)selfrrrkwargsdefault_settings __class__r r r#s   zOLLamaLLMService.__init__c s&td|tjdd|i|S)aCCreate OpenAI-compatible client for Ollama. Args: base_url: The base URL for the API. If None, uses instance base_url. **kwargs: Additional keyword arguments passed to the parent create_client method. Returns: An OpenAI-compatible client configured for Ollama. z Creating Ollama client with api rNr )rdebugr create_client)rrrrr r r!Is zOLLamaLLMService.create_client)N) rr r r rr__annotations__rstrrr! __classcell__r r rr rs &rN)r dataclassesrtypingrlogurur pipecat.services.openai.base_llmrpipecat.services.openai.llmrrrrr r r r s