o i?I@sddlmZddlmZddlmZddlmZddlmZddlm Z ddl m Z ddl m Z dd l mZdd l mZdd l mZdd l mZdd l mZddl mZddl mZddl mZddl mZddl mZddl mZddl mZddl mZddl mZddlmZddlmZddlm Z ddlm!Z!ddl"m#Z#ddl$m%Z%ddl$m&Z&ddl$m'Z'ddl(m)Z)dd l*m+Z+dd!l,m-Z-dd"l.m/Z/dd#l.m0Z0dd$l1m2Z2ee3Z4Gd%d&d&eZ5d'S)()Any) Generator)Optional)core) get_logger)get_argument_value)LLMObs)"CACHE_READ_INPUT_TOKENS_METRIC_KEY)#CACHE_WRITE_INPUT_TOKENS_METRIC_KEY)INPUT_MESSAGES) INPUT_VALUE) INTEGRATION)METADATA)METRICS) MODEL_NAME)MODEL_PROVIDER)OUTPUT_MESSAGES) OUTPUT_VALUE) PROXY_REQUEST) SPAN_KIND)TAGS)TOOL_DEFINITIONS)BaseLLMIntegration))_create_or_update_bedrock_trace_step_span)_extract_trace_step_id)translate_bedrock_trace)normalize_input_tokens))get_final_message_converse_stream_message)"get_messages_from_converse_content)(update_proxy_workflow_input_output_value)'record_bedrock_agent_span_event_created) _get_attr)LLMObsSpanEvent)Message)ToolDefinition)Spanc @seZdZUdZiZeeefed<iZ eeefed<  d%de de e deee fd e e d ed df d d ZddZd&ddZede eee fd e efddZed eee ffddZed edeee fee eeeefeeeffffddZed e efddZed e efddZdeee fd e efddZdejd dfd d!Zd"eee fd e efd#d$Z dS)'BedrockIntegrationbedrock_spans_active_span_by_step_idNspanargskwargsresponse operationreturncCsx|dkr |||||Si}i}|d}|trdnd} |dp#i} |dr/|d|d<|dr8|d}t|d |vrVd |vsHd |vrV|d d|d d|d <d | vrl| d d krlt| d phd|d <d| vr| dd krt| dp~d|d<| dd } | di} || } | r|t | |ddv}|r| | n| | }t d dg}|j s |dur |ddkr||}nD|ddkr z&z|dWnty}z |j\}}}WYd}~nd}~wwW|n|w||||n||}|t| t|dpd t|dp d t|t|t| dkr,|nit|t|jit|| dS)aExtract prompt/response attributes from an execution context. ctx is a required argument of the shape: { "resource": str, # oneof("Converse", "ConverseStream", "InvokeModel") "model_name": str, "model_provider": str, "llmobs.request_params": {"prompt": str | list[dict], "temperature": Optional[float], "max_tokens": Optional[int] "top_p": Optional[int]} "llmobs.usage": Optional[dict], "llmobs.stop_reason": Optional[str], "llmobs.proxy_request": Optional[bool], } agentrworkflowllmzllmobs.request_paramszllmobs.stop_reason stop_reasonz llmobs.usage total_tokens input_tokens output_tokens temperaturer*g max_tokensprompt tool_configresource)ConverseConverseStreamcontentNr=r> model_namemodel_provider) _llmobs_set_tags_agentget_itemrrgetfloatint_extract_tool_definitions _set_ctx_itemr#_extract_input_message_for_converse_extract_input_messager#error$_extract_output_message_for_conversesend StopIterationvaluecloseupdate_extract_output_message_set_ctx_itemsrrrr rrrr _integration_namer)selfr+r,r-r.r/metadata usage_metricsctx span_kindrequest_paramsr:r;tool_definitions is_converseinput_messagesoutput_messageseadditional_metadatastreamed_usage_metricsrcX/home/ubuntu/.local/lib/python3.10/site-packages/ddtrace/llmobs/_integrations/bedrock.py_llmobs_set_tags0sp               z#BedrockIntegration._llmobs_set_tagsc Cs|jr|sdSt||ddddpi}|dd}|dd}|dd}|d d} |td tt|td | it||d t d i|sDdS| t t|dS)N inputArgsT)optional inputTextr*agentId agentAliasId sessionIdr1 session_id)agent_idagent_alias_idbedrock_agents) llmobs_enabledrrErTrr strrrr rIr) rVr+r,r-r. input_args input_valuernrormrcrcrdrCs$       z)BedrockIntegration._llmobs_set_tags_agentc Cs|r|jsdS|D]/}t|}|j|d}t||||\}}|r/||j|d<|s/||j|<t|||||jq |jD]\}} tj j | t | q>|j |j dS)z5Translate bedrock agent traces to LLMObs span events.Nspan_id)rqrr)poprr(ritemsr _instance_llmobs_span_writerenqueuer clear) rVtraces root_spantrace trace_step_idcurrent_active_span_eventtranslated_span_eventfinished_ span_eventrcrcrdtranslate_bedrock_tracess(     z+BedrockIntegration.translate_bedrock_tracesr:cCsxt|tstdtddgSg}|D]%}t|tsqt|dd}|dd}|r1t|ts2q|t||7}q|S)aExtract input messages from the stored prompt for converse `prompt` is an array of `message` objects. Each `message` has a role and content field. The content field stores a list of `ContentBlock` objects. For more info, see bedrock converse request syntax: https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_Converse.html#API_runtime_Converse_RequestSyntax 4Bedrock input is not a list of messages or a string.r*r?roler@N) isinstancelistlogwarningr#dictrrrEr)r:r^messagerr@rcrcrdrJs    z6BedrockIntegration._extract_input_message_for_conversecCs\tddg}|didi}|s|S|dd}|dd}|r't|ts)|St||S) aExtract output messages from the stored prompt for converse `response` contains an `output` field that stores a nested `message` field. `message` has a `content` field that `ContentBlock` objects. For more info, see bedrock converse response syntax: https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_Converse.html#API_runtime_Converse_ResponseSyntax r*r?outputrr assistantr@N)r#rErrr)r.default_contentrrr@rcrcrdrMs    z7BedrockIntegration._extract_output_message_for_converseccsi}i}g}i}i}d}dV}|durd|vred|dvre|dd}dD]}d||vr<|d||d|<q'|ddpH|dd} |d dpT|d d} | dur]| |t<| dure| |t<d |vrv|d } | d d gd}|durd gd}d|vr|d} | d} | dur|d| d| vrd| dvr| dd|| <d|vr|d}|d} | durd|vr| |dgvr|d| |d}|| d|dd|| <|didr|| i|| <|| dd|dd|| d<d|vr|t|||d}dV}|dus|dur1|dr1|t||||s=|tdd dt||||fS)a Listens for output chunks from a converse streamed response and builds a list of output messages, usage metrics, and metadata. Converse stream response comes in chunks. The chunks we care about are: - a message start/stop event, or - a content block start/stop event (for tool calls only currently) - a content block delta event (for chunks of text in a message or tool call arg) - usage metric information For more info, see bedrock converse response stream response syntax: https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_ConverseStream.html#API_runtime_ConverseStream_ResponseSyntax NrWusage)inputrtotalz{}Tokensz {}_tokenscacheReadInputTokenCountcacheReadInputTokenscacheWriteInputTokenCountcacheWriteInputTokens messageStartrr)rcontent_block_indiciescontentBlockStartcontentBlockIndexrstarttoolUsecontentBlockDeltadeltar*textr messageStopr@r)formatrEr r appendrr#r)rXrWmessagestext_content_blockstool_content_blockscurrent_messagechunkr token_typecache_read_tokenscache_write_tokens message_data block_startindexcontent_block_delta delta_contentrcrcrd!_converse_output_stream_processors        >  z4BedrockIntegration._converse_output_stream_processorc Cst|tr t|dgSt|tstdtddgSg}|D]\}|dd}t|trjt|dtrj|D]3}|ddkrR|t|ddt|ddd q5|dd krh|td t|ddd q5q|tt|t|ddd q|S) zExtract input messages from the stored prompt. Anthropic allows for messages and multiple texts in a message, which requires some special casing. r?rr*r@rtyperrrimagez([IMAGE DETECTED])) rrrr#rrrrErr)r:r^pr@entryrcrcrdrKUs$      ($z)BedrockIntegration._extract_input_messagecCsv|dd}t|trt|dgS|r9t|tr9t|dtr&dd|DSt|dtr9t|ddddgSgS)zExtract output messages from the stored response. Anthropic allows for chat messages, which requires some special casing. rr*r?rcSsg|] }tt|dqS)r?)r#rr).0r@rcrcrd wsz>BedrockIntegration._extract_output_message..)rErrrr#rr)r. resp_textrcrcrdrSms   z*BedrockIntegration._extract_output_messagecKs:|d}t|dd}|rt|ddnd}|rt|SdS)Ninstance _endpointhost)rEgetattrrr)rVr-rendpoint endpoint_hostrcrcrd _get_base_url|s  z BedrockIntegration._get_base_urlrYcCs0|j|dd}||r|tddSdS)Nr)rT)r find_item_is_instrumented_proxy_urlset_itemr)rVrYbase_urlrcrcrd_tag_proxy_requests z%BedrockIntegration._tag_proxy_requestr;cCsbt|dg}g}|D]$}t|di}ttt|ddtt|ddt|did}||q |S)z5Extract tool definitions from the stored tool config.toolstoolSpecnamer* description inputSchema)rrschema)r!r$rrr)rVr;rr\tool tool_spectool_definition_inforcrcrdrHs    z,BedrockIntegration._extract_tool_definitions)Nr*)r0N)!__name__ __module__ __qualname__rUr(rrrr"__annotations__r)r%rrrrerCr staticmethodr#rJrMrtuplerGrrKrSrrExecutionContextrr$rHrcrcrcrdr&+sN   d $  f"r&N)6typingrrrddtrace.internalrddtrace.internal.loggerrddtrace.internal.utilsrddtrace.llmobsrddtrace.llmobs._constantsr r r r r rrrrrrrrrrddtrace.llmobs._integrationsr+ddtrace.llmobs._integrations.bedrock_agentsrrr*ddtrace.llmobs._integrations.bedrock_utilsr"ddtrace.llmobs._integrations.utilsrrrddtrace.llmobs._telemetryr ddtrace.llmobs._utilsr!ddtrace.llmobs._writerr"ddtrace.llmobs.typesr#r$ ddtrace.tracer%rrr&rcrcrcrdsL