o ^۷i^@snddlmZddlZddlZddlmZmZddlmZm Z m Z m Z m Z m Z mZmZmZmZmZddlmZmZddlmZmZddlZddlmZmZmZmZdd lm Z m!Z!dd l"m#Z#m$Z$d d l%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,d dl-m.Z.d dl/m0Z0m1Z1m2Z2d dl3m4Z4m5Z5ddl6m7Z7m8Z8m9Z9ddl:m;Z;ddlm?Z?m@Z@e de e'e e)e e+e,fdZAe dZBeCeDZEGdddeddZFGddde eAe7fZGGdddeGe(e7fe eBe7feZHGd d!d!eHe8e7e7fZIGd"d#d#eHe4e7e7fZJGd$d%d%eGe*e7fe eBe7feZKGd&d'd'eKe8e7e7fZLGd(d)d)eKe5e7e7fZMdS)*) annotationsN)ABCabstractmethod) TYPE_CHECKINGAnyListUnionGenericTypeVarCallableIterableIterator Coroutine AsyncIterator)contextmanagerasynccontextmanager) TypedDictoverride)BodyQueryHeadersNotGiven)consume_sync_iteratorconsume_async_iterator) BetaMessageBetaMessageParam) ToolErrorBetaFunctionToolBetaRunnableToolBetaAsyncFunctionToolBetaAsyncRunnableToolBetaBuiltinFunctionToolBetaAsyncBuiltinFunctionTool)stainless_helper_header)DEFAULT_THRESHOLDDEFAULT_SUMMARY_PROMPTCompactionControl)BetaMessageStreamBetaAsyncMessageStream)ResponseFormatTParsedBetaMessageParsedBetaContentBlock)ParseMessageCreateParamsBase)BetaToolResultBlockParam) AnthropicAsyncAnthropicAnyFunctionToolT)bound RunnerItemTc@s.eZdZUded<ded<ded<ded<d S) RequestOptionszHeaders | None extra_headersz Query | None extra_queryz Body | None extra_bodyz'float | httpx.Timeout | None | NotGiventimeoutN)__name__ __module__ __qualname____annotations__r?r?V/home/ubuntu/vllm_env/lib/python3.10/site-packages/anthropic/lib/tools/_beta_runner.pyr6:s  r6F)totalc@s<eZdZddddddZdddZdddZdddZdS)BaseToolRunnerNmax_iterationscompaction_controlparams-ParseMessageCreateParamsBase[ResponseFormatT]optionsr6toolsIterable[AnyFunctionToolT]rD int | NonerECompactionControl | NonereturnNonecCsdd|D|_i|ddd|dDi|_t|j|dd}|r9i||dp/i}i|d|i}||_d|_d|_||_d |_ ||_ dS) NcSsi|]}|j|qSr?)name).0toolr?r?r@ Ksz+BaseToolRunner.__init__..messagescSsg|]}|qSr?r?rPmessager?r?r@ Nsz+BaseToolRunner.__init__..)rIrSr7Fr) _tools_by_name_paramsr&valuesget_options_messages_modified_cached_tool_call_response_max_iterations_iteration_count_compaction_control)selfrFrHrIrDrE helper_headermerged_headersr?r?r@__init__Bs&  zBaseToolRunner.__init__ParseMessageCreateParamsBase[ResponseFormatT] | Callable[[ParseMessageCreateParamsBase[ResponseFormatT]], ParseMessageCreateParamsBase[ResponseFormatT]]cCst|r ||j}||_dS)a  Update the parameters for the next API call. This invalidates any cached tool responses. Args: params (ParsedMessageCreateParamsBase[ResponseFormatT] | Callable): Either new parameters or a function to mutate existing parameters N)callablerX)rarFr?r?r@set_messages_params^s  z"BaseToolRunner.set_messages_paramsrS5BetaMessageParam | ParsedBetaMessage[ResponseFormatT]cs2dd|Dd_fddd_dS)zAdd one or more messages to the conversation history. This invalidates the cached tool response, i.e. if tools were already called, then they will be called again on the next loop iteration. cSs(g|]}t|tr|j|jdn|qS)rolecontent) isinstancerrjrkrTr?r?r@rVssz2BaseToolRunner.append_messages..Tcsi|dgjdiS)NrS)rXrFmessage_paramsrar?r@xsz0BaseToolRunner.append_messages..N)r\rgr])rarSr?rnr@append_messagesms  zBaseToolRunner.append_messagesboolcCs|jdur |j|jkr dSdS)NTF)r^r_rar?r?r@ _should_stop{szBaseToolRunner._should_stop) rFrGrHr6rIrJrDrKrErLrMrN)rFrerMrN)rSrhrMrNrMrr)r;r<r=rdrgrqrtr?r?r?r@rBAs  rBcseZdZdddd.fddZd/ddZd0ddZeed0ddZd1ddZ d0ddZ d2d!d"Z d3d$d%Z d3d&d'Z d4d)d*Zd5d,d-ZZS)6BaseSyncToolRunnerNrCrFrGrHr6rIIterable[BetaRunnableTool]clientr1rDrKrErLrMrNc0tj|||||d||_||_d|_dSN)rFrHrIrDrEsuperrd_client__run__ _iterator _last_messagerarFrHrIrxrDrE __class__r?r@rds  zBaseSyncToolRunner.__init__r5cCs |jSN)r__next__rsr?r?r@rs zBaseSyncToolRunner.__next__Iterator[RunnerItemT]ccs|jD]}|VqdSrrraitemr?r?r@__iter__s zBaseSyncToolRunner.__iter__ccstrNotImplementedErrorrsr?r?r@_handle_requestz"BaseSyncToolRunner._handle_requestrrc sv|jdus |jds dS|}d}|dur,|jj|jjpd|jjp$d}||jj}|jdt}||kr9dSt d|d|d|jd |j d }t |j d }|d d d krvdd|d dD}|rr||d d<n| g|td|jdtd}|jjjj|||j dddid}t d|jjt |jdjdkrtd|fdddS) Check token usage and compact messages if threshold exceeded. Returns True if compaction was performed, False otherwise. NenabledFrcontext_token_threshold Token usage  has exceeded the threshold of . Performing compaction.modelrSrj assistantcS(g|]}t|tr|ddkr|qStypetool_userldictrZrPblockr?r?r@rVz9BaseSyncToolRunner._check_and_compact..rkusersummary_promptri max_tokensX-Stainless-Helper compactionrrSrr7&Compaction complete. New token usage: text1Compaction response content is not of type 'text'c"i|dddjdgdgiSNrSrr)rrrirrm first_contentr?r@rpz7BaseSyncToolRunner._check_and_compact..Tr`_get_last_messageusage input_tokenscache_creation_input_tokenscache_read_input_tokens output_tokensrZr'loginforXlistpoprr(r}betarScreaterkr ValueErrorrg rarU tokens_usedtotal_input_tokens thresholdrrSnon_tool_blocksresponser?rr@_check_and_compacts^        z%BaseSyncToolRunner._check_and_compactccs|sU|}|V|}|dusJWdn1s!wY|jd7_|sI|}|dur@tddS|jsI| ||d|_d|_ |rdSdSNrz;Tool call was not requested, exiting from tool runner loop.F rtrrr_rgenerate_tool_call_responserdebugr\rqr]rarrUrr?r?r@r~s$   zBaseSyncToolRunner.__run__"ParsedBetaMessage[ResponseFormatT]cCs t||}|dusJ|Sz Consumes the tool runner stream and returns the last message if it has not been consumed yet. If it has, it simply returns the last message. N)rrra last_messager?r?r@ until_dones zBaseSyncToolRunner.until_doneBetaMessageParam | NonecCs,|jdur td|jS|}||_|SaGenerate a MessageParam by calling tool functions with any tool use blocks from the last message. Note the tool call response is cached, repeated calls to this method will return the same response. None can be returned if no tool call was applicable. Nz$Returning cached tool call response.r]rr_generate_tool_call_responserarr?r?r@rs  z.BaseSyncToolRunner.generate_tool_call_responsec CsR|}|sdSdd|D}|sdSg}|D]}|j|j}|durJtjd|jdt|jdtdd| d|j d |jd d d qz| |j }| d|j |d Wqt yz}z| d|j |jd d WYd}~qd}~wty}ztjd|j|d| d|j t|d d WYd}~qd}~wwd|dS)NcSg|] }|jdkr|qSrrrr?r?r@rV.zCBaseSyncToolRunner._generate_tool_call_response..Tool '-' not found in tool runner. Available tools: z. If using a raw tool definition, handle the tool call manually and use `append_messages()` to add the result. Otherwise, pass the tool using `beta_tool(func)` or a `@beta_tool` decorated function.r stacklevel tool_result Error: Tool ' ' not foundTr tool_use_idrkis_errorrrrk#Error occurred while calling tool: exc_inforri#_get_last_assistant_message_contentrWrZrOwarningswarnrkeys UserWarningappendidcallinputrrk Exceptionr exceptionreprrarktool_use_blocksresultsrrQresultexcr?r?r@r)sb     z/BaseSyncToolRunner._generate_tool_call_response)ParsedBetaMessage[ResponseFormatT] | NonecCst|jr |S|jSrrfrrsr?r?r@rbs z$BaseSyncToolRunner._get_last_message4list[ParsedBetaContentBlock[ResponseFormatT]] | NonecCs*|}|dus|jdks|jsdS|jSNrrrjrkrr?r?r@rgsz6BaseSyncToolRunner._get_last_assistant_message_content)rFrGrHr6rIrwrxr1rDrKrErLrMrNrMr5)rMrrurMrrMrrMrrMr)r;r<r=rdrrrrrrr~rrrrr __classcell__r?r?rr@rvs     T   9rvc@eZdZeedddZdS)BetaToolRunnerrM,Iterator[ParsedBetaMessage[ResponseFormatT]]ccs0|jjjjdi|j|j}||_|VdSNr?r}rrSparserXr[rrarUr?r?r@rps zBetaToolRunner._handle_requestN)rMrr;r<r=rrrr?r?r?r@rorc@r)BetaStreamingToolRunnerrM,Iterator[BetaMessageStream[ResponseFormatT]]ccsT|jjjjdi|j|j}|j|_|VWddS1s#wYdSrr}rrSstreamrXr[get_final_messagerrarr?r?r@rys  "z'BetaStreamingToolRunner._handle_requestN)rMr r r?r?r?r@r xr r cseZdZdddd.fddZd/ddZd0ddZeed0ddZd1ddZ d0ddZ d2d!d"Z d3d$d%Z d4d'd(Z d5d*d+Zd3d,d-ZZS)6BaseAsyncToolRunnerNrCrFrGrHr6rIIterable[BetaAsyncRunnableTool]rxr2rDrKrErLrMrNcryrzr{rrr?r@rds  zBaseAsyncToolRunner.__init__r5cs|jIdHSr)r __anext__rsr?r?r@rszBaseAsyncToolRunner.__anext__AsyncIterator[RunnerItemT]cCs"|j2z 3dHW}|Vq6dSrrrr?r?r@ __aiter__szBaseAsyncToolRunner.__aiter__cCstrrrsr?r?r@rrz#BaseAsyncToolRunner._handle_requestrrc s|jdus |jds dS|IdH}d}|dur0|jj|jjp"d|jjp(d}||jj}|jdt}||kr=dSt d|d|d|jd |j d }t |j d }|d d d krzdd|d dD}|rv||d d<n| g|j d td|jdtd}|jjjj|||j dddidIdH}t d|jjt |jdjdkrtd|fdddS)rNrFrrrrrrrSrrjrcSrrrrr?r?r@rVrz:BaseAsyncToolRunner._check_and_compact..rkrrrirrrrrrrcrrrrmrr?r@rprz8BaseAsyncToolRunner._check_and_compact..Trrr?rr@rs`         z&BaseAsyncToolRunner._check_and_compactc Cs|sh|4IdH}|V|IdH}|dusJWdIdHn 1IdHs.wY|jd7_|IdHs\|IdH}|durStddS|js\| ||d|_d|_ |rdSdSrrrr?r?r@r~s$(  zBaseAsyncToolRunner.__run__rcs.t|IdH|IdH}|dusJ|Sr)rrrr?r?r@rs  zBaseAsyncToolRunner.until_donercs4|jdurtd|jS|IdH}||_|Srrrr?r?r@rs  z/BaseAsyncToolRunner.generate_tool_call_responsercs t|jr |IdHS|jSrrrsr?r?r@r.s z%BaseAsyncToolRunner._get_last_messagercs2|IdH}|dus|jdks|jsdS|jSrrrr?r?r@r3s z7BaseAsyncToolRunner._get_last_assistant_message_contentc s`|IdH}|s dSdd|D}|sdSg}|D]}|j|j}|durNtjd|jdt|jdtdd| d|j d |jd d d qz| |j IdH}| d|j |d Wqt y}z| d|j |jd d WYd}~qd}~wty}ztjd|j|d| d|j t|d d WYd}~qd}~wwd|dS)NcSrrrrr?r?r@rV?rzDBaseAsyncToolRunner._generate_tool_call_response..rrz. If using a raw tool definition, handle the tool call manually and use `append_messages()` to add the result. Otherwise, pass the tool using `beta_async_tool(func)` or a `@beta_async_tool` decorated function.rrrrrTrrrrrrirrr?r?r@r:sd    z0BaseAsyncToolRunner._generate_tool_call_response)rFrGrHr6rIrrxr2rDrKrErLrMrNr)rMrrurrrr)r;r<r=rdrrrrrrr~rrrrrrr?r?rr@rs      T   rc@r)BetaAsyncToolRunnerrM1AsyncIterator[ParsedBetaMessage[ResponseFormatT]]cCs6|jjjjdi|j|jIdH}||_|VdSrrr r?r?r@rus$ z#BetaAsyncToolRunner._handle_requestN)rMrr;r<r=rrrr?r?r?r@rtr rc@r)BetaAsyncStreamingToolRunnerrM6AsyncIterator[BetaAsyncMessageStream[ResponseFormatT]]c Csh|jjjjdi|j|j4IdH}|j|_|VWdIdHdS1IdHs-wYdSrrrr?r?r@r~s (.z,BetaAsyncStreamingToolRunner._handle_requestN)rMrrr?r?r?r@r}r r)N __future__rloggingrabcrrtypingrrrrr r r r r rr contextlibrrtyping_extensionsrrhttpx_typesrrrr_utilsrr types.betarr_beta_functionsrrr r!r"r#r$_stainless_helpersr&_beta_compaction_controlr'r(r)streaming._beta_messagesr*r+types.beta.parsed_beta_messager,r-r. types.beta.message_create_paramsr/'types.beta.beta_tool_result_block_paramr0r}r1r2r3r5 getLoggerr;rr6rBrvrr rrrr?r?r?r@sP 4 $    $@o t