o پi1# @sBdZddlZddlZddlmZmZmZmZddlm Z m Z m Z m Z m Z mZddlZddlmZddlmZgdZedd Gd d d ZGd d d Zejedddedeedfdede ejeeffddZde de fddZejddZe e d!dede efddZ!  d"dede ede efdd Z"dS)#zIntegration with OpenAI's API.N)asdict dataclassfieldreplace)CallableDictListOptionalTupleUnion) vectorize)cache)OpenAIopenai azure_openaiT)frozenc@seZdZUdZdZeed<dZeed<e e dZ e e e fed<dZee ed <d Ze ed <dZeed <dZee eefed <dZee ed<dZeeeeefed<dZeed<d Ze ed<e edZeed<dS) OpenAIConfigasRepresents the parameters of the OpenAI API. The information was last fetched on 2023/11/20. We document below the properties that are specific to the OpenAI API. Not all these properties are supported by Outlines. Properties ---------- model The name of the model. Available models can be found on OpenAI's website. frequence_penalty Number between 2.0 and -2.0. Positive values penalize new tokens based on their existing frequency in the text, logit_bias Modifies the likelihood of specified tokens to appear in the completion. Number between -100 (forbid) and +100 (only allows). n The number of completions to return for each prompt. presence_penalty Similar to frequency penalty. response_format Specifies the format the model must output. `{"type": "json_object"}` enables JSON mode. seed Two completions with the same `seed` value should return the same completion. This is however not guaranteed. stop Up to 4 words where the API will stop the completion. temperature Number between 0 and 2. Higher values make the output more random, while lower values make it more deterministic. top_p Number between 0 and 1. Parameter for nucleus sampling. user A unique identifier for the end-user. modelrfrequency_penalty)default_factory logit_biasN max_tokensnpresence_penaltyresponse_formatseedstopg? temperaturetop_puser)__name__ __module__ __qualname____doc__rstr__annotations__rfloatrdictrrintrr rrrrrr rrr r!r+r+J/home/ubuntu/.local/lib/python3.10/site-packages/outlines/models/openai.pyrs  &     rc@seZdZdZ ddeefddZ  ddddddeeeefdee d eeeeefdeed ee d ee d e j fd dZ ddZddZddZddZdS)rz)An object that represents the OpenAI API.N system_promptcCs&||_||_d|_d|_dd|_dS)aCreate an `OpenAI` instance. This class supports the standard OpenAI API, the Azure OpeanAI API as well as compatible APIs that rely on the OpenAI client. Parameters ---------- client An instance of the API's async client. config An instance of `OpenAIConfig`. Can be useful to specify some parameters that cannot be set by calling this class' methods. rcSs|SNr+)seqr+r+r,esz!OpenAI.__init__..N)clientconfig prompt_tokenscompletion_tokensformat_sequence)selfr1r2r-r+r+r,__init__Hs zOpenAI.__init__)r-rsamplespromptrstop_atrr8returnc Cs|dur|jj}|dur|jj}|dur|jj}|dur |jj}t|j||||d}t|||j|\}} } |j| 7_|j | 7_ | |S)aCall the OpenAI API to generate text. Parameters ---------- prompt A string or list of strings that will be used to prompt the model max_tokens The maximum number of tokens to generate stop_at A string or array of strings which, such that the generation stops when they are generated. system_prompt The content of the system message that precedes the user's prompt. temperature The value of the temperature used to sample tokens samples The number of completions to generate for each prompt stop_at Up to 4 words where the API will stop the completion. N)rrrr) r2rrrrr generate_chatr1r3r4r5) r6r9rr:r-rr8r2responser3r4r+r+r,__call__gs   zOpenAI.__call__cOstd)Nz7Streaming is currently not supported for the OpenAI API)NotImplementedError)r6argskwargsr+r+r,streamsz OpenAI.streamcKs"t|}t|jfi||_|Sr.)copyrr2)r6rA new_instancer+r+r,new_with_replacementss zOpenAI.new_with_replacementscCs |jjdS)Nz API) __class__r"r6r+r+r,__str__s zOpenAI.__str__cCs t|jSr.)r&r2rGr+r+r,__repr__s zOpenAI.__repr__r.NN)r"r#r$r%r r&r7r rr*r(npndarrayr>rBrErHrIr+r+r+r,rEs> " 2 rz(),(),(),()->(s),(),()) signaturer9r-r2r;csttfdd}|rd|dgngd|dg||||IdHtfddt|jD}d }||d |d fS) aCall OpenAI's Chat Completion API. Parameters ---------- prompt The prompt we use to start the generation. Passed to the model with the "user" role. system_prompt The system prompt, passed to the model with the "system" role before the prompt. client The API client config An `OpenAIConfig` instance. Returns ------- A tuple that contains the model's response(s) and usage statistics. cs0jjjddit|IdH}|S)Nmessagesr+)chat completionscreater model_dump)r9r-r2 responses)r1system_message user_messager+r,call_apis  zgenerate_chat..call_apisystem)rolecontentr!Ncs g|] }d|ddqS)choicesmessagerYr+).0i)rSr+r, s z!generate_chat..usager3r4) error_handlerr rKarrayranger)r9r-r1r2rVresultsr_r+)r1rSrTrUr,r<s r< api_call_fncsfdd}|S)z-Handle OpenAI API errors and missing API key.c s~ddl}z|i|WS|j|j|jfy%}ztd|d}~w|j|j|j|j|j |j fy>}z|d}~ww)Nrz%Could not connect to the OpenAI API: ) rAPITimeoutErrorInternalServerErrorRateLimitErrorOSErrorAuthenticationErrorBadRequestError ConflictErrorPermissionDeniedError NotFoundErrorUnprocessableEntityError)r@rArerdr+r,calls*  zerror_handler..callr+)rdrqr+rpr,r`s r`cOst|g|Ri|Sr.)r)model_or_clientr@rAr+r+r,rsr model_namecKs`zddlm}Wn tytdw|durt||d}nt|d}|di|}t||S)Nr) AsyncOpenAIzXThe `openai` library needs to be installed in order to use Outlines' OpenAI integration.rr+)rrt ImportErrorrrr)rsr2openai_client_paramsrtr1r+r+r, openai_models   rxdeployment_namecKsfzddlm}Wn tytdw|durt||d}|dur't|d}|di|}t||S)Nr)AsyncAzureOpenAIz^The `openai` library needs to be installed in order to use Outlines' Azure OpenAI integration.rur+)rrzrvrrr)ryrsr2azure_openai_client_paramsrzr1r+r+r,rs    rr.rJ)#r%rC functools dataclassesrrrrtypingrrrr r r numpyrK outlines.baser outlines.cachingr __all__rrpartialr&rLr*r<r`singledispatchrregisterrxrr+r+r+r,sR   5 e  3