o iHV @sddlmZddlmZddlmZddlmZddlmZddlmZddlm Z ddl m Z dd l m Z dd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlm Z ddlm!Z!ddl"m#Z#ddl$m%Z%e e&Z'dZ(dZ)gdZ*GdddeZ+de,ee-ee-e.e-efffd d!Z/dee-fd"d#Z0de.e-effd$d%Z1dee-fd&d'Z2d(edee3e.e-effd)d*Z4dee.e-effd+d,Z5d-d.Z6de3fd/d0Z7d(eede3e.e-effd1d2Z8d3e.e-e3ee-e,e-e-fffde3e-fd4d5Z9d6e3e,e-e-fde:fd7d8Z;d9e.e-efde.e-e3ee-e,e-e-ffffd:d;Zd?Z=d@e%de#fdAdBZ>dCS)D)Any)Iterable)Optional)Union)cast)WeakKeyDictionary) get_logger)get_argument_value)format_trace_id)LLMObs)AGENT_MANIFEST) INPUT_VALUE)NAME) OUTPUT_VALUE) PARENT_ID_KEY)ROOT_PARENT_ID) SPAN_KIND) SPAN_LINKS)BaseLLMIntegration)LANGGRAPH_ASTREAM_OUTPUTformat_langchain_io _get_attr)_get_nearest_llmobs_ancestor) _SpanLink)Span __pregel_push__pregel_tasks) max_tokens temperaturetop_ptop_kfrequency_penaltypresence_penaltystopnlogprobsecho logit_biasc seZdZUdZeZeeeee ffe d<eZ ee eee ffe d<eZ eee fe d<  d-dede d effd d Z  d.d edee deee fdee def ddZdeee fd eeee ffddZd eded eee ffddZdedefddZ d/dedede de fd d!Zd"edeee fde fd#d$Zd"ededefd%d&Zd"ed'eeeeeeeefffd eefd(d)Zd"edeee fd*eefd+d,ZZS)0LangGraphIntegration langgraph!_graph_nodes_for_graph_by_task_id_agent_manifests_graph_spans_to_graph_instancesFN operation_idsubmit_to_llmobsreturnc s(tj||fi|}|r||j|<|SN)supertracer.)selfr/r0instancekwargsspan __class__Z/home/ubuntu/.local/lib/python3.10/site-packages/ddtrace/llmobs/_integrations/langgraph.pyr48s zLangGraphIntegration.tracer8argsr7response operationc CsB|jsdSt||dd}t||ddddpi}t|di}|dd d d } |did d } |dks8| r>||| ni} t|g} | dpKg} | rP| } |tpVg}dd}| t |dkrddndt t |t ||pt||tt| dp|d|jt|| i|dkr|j|}||||}|t|dSdS)NrinputconfigT)optionalmetadatalanggraph_checkpoint_nsr=:z _dd.subgraphFnode span_linkscSs|durdSt|Sr2r)messagesr;r;r<maybe_format_langchain_ioaszHLangGraphIntegration._llmobs_set_tags..maybe_format_langchain_iographagenttaskname)llmobs_enabledr rgetsplit_get_node_metadata_from_span_default_span_link _get_ctx_itemr_set_ctx_itemsrr rrrrrPr._get_agent_manifest _set_ctx_itemr )r5r8r>r7r?r@inputsrCrE instance_id is_subgraph invoked_noderJinvoked_node_span_linkscurrent_span_linksrLrNagent_manifestr;r;r<_llmobs_set_tagsFs:     z%LangGraphIntegration._llmobs_set_tagsrCcCs|durdS|j|}|dur!t|}|jpd|d}||j|<d|vr)d|d<d|vr5t|dd|d<d|vrUt|trUt|d krUt|d trUt |d  |d<|S) zFGets the agent manifest for a given agent at the end of its execution.N LangGraph)rPtools frameworkmax_iterationsrecursion_limit dependenciesr) r-rR_get_tools_from_graphrPr isinstancetuplelendictlistkeys)r5rNr>rCr`rcr;r;r<rXvs&    z(LangGraphIntegration._get_agent_manifestr[cCsDt|}|r|j|i|ini}t|jt|jd|d<|S)z Get the node metadata for a given span and its node instance id. Additionally, set the span and trace ids on its metadata should another node in a later tick of the graph need to be linked to this node. )trace_idspan_idr8)rr, setdefaultr rpstrrq)r5r8r[ parent_spanr]r;r;r<rTsz1LangGraphIntegration._get_node_metadata_from_spanc Cs|jsdSt||ddd}t|\}}}t||dddpg}t|} t|d} |d} i} |r6|| d<|r<|| d <|rB|| d <| rH| | d<| rN| | d <| rT| | d<| |j|<dS) z Handles the agent manifest for a given react agent (defined through `langgraph.prebuilt.create_react_agent`), and caches it for use when tagging the graph/agent span in the `_get_agent_manifest`. NrmodelTrBrcpromptrPmodel_providermodel_settings instructions)rQr _get_model_info_get_tools_from_react_agent#_get_system_prompt_from_react_agentrRr-) r5rNr>r7ru model_namerwrx agent_toolsrc system_promptrPr`r;r;r<llmobs_handle_agent_manifests2  z1LangGraphIntegration.llmobs_handle_agent_manifestfinished_tasks next_tasks more_tasksis_subgraph_nodec Csz(|jsWdStj}|durWdS|s||||WdS||||WdStyB}ztjd|dWYd}~dSd}~ww)zp Compute incoming and outgoing span links between finished tasks and queued tasks in the graph. Nz)Error in LangGraph span linking operation)exc_info) rQr _instance _current_span_handle_finished_graph_handle_intermediary_graph_tick Exceptionloggerdebug)r5rrrr graph_spaner;r;r<llmobs_handle_pregel_loop_ticksz3LangGraphIntegration.llmobs_handle_pregel_loop_tickrc srtnd}fdd|D}tpg}t|||durK|sK|tp/g}ttjp7dtj ddddg}|t||dS)aCreate the span links for a finished pregel graph from all finished tasks as the graph span's outputs. Generate the output-to-output span links for the last nodes in a pregel graph. If the graph isn't a subgraph, add a span link from the graph span to the calling LLMObs parent span. Note: is_subgraph_node denotes whether the graph is a subgraph node, not whether it is a standalone graph (called internally during a node execution). NcsDg|]}tj|ddj|ddddddqS)r8rqrpoutputfromtorqrp attributes)rr,).0task_idrr5r;r< sz?LangGraphIntegration._handle_finished_graph.. undefinedrrr) rrorVrrYrrsrqr rp) r5rrrgraph_caller_spanoutput_span_linksgraph_span_span_linksgraph_caller_span_linksrJr;rr<rs    z+LangGraphIntegration._handle_finished_graphc Csrt|}t}|D]$\}}|j|i|i}t|dd|d<|||||} || q ||||dS)a- Handle graph ticks that aren't at the end of the graph execution. Link all next tasks to their trigger tasks from the dict of finished tasks. Any finished tasks that do not trigger any queued tasks should be linked as output --> output links for the outer graph span. rPr=N) )_map_channel_writes_to_finished_tasks_idssetitemsr,rrr_link_task_to_triggersupdate_link_standalone_terminal_tasks) r5rrr'task_trigger_channels_to_finished_tasksused_finished_task_idsrrO queued_node trigger_idsr;r;r<rs z4LangGraphIntegration._handle_intermediary_graph_tickrc Cs~t||}|D]5}|durq|j|i|id}|sqt|dd|dddddd }|d g} | |q|S) z Create the span links for a queued task from its triggering trigger tasks. Returns the finished task ids used as trigger tasks. Nr8rqr=rprrArrrJ)$_get_trigger_ids_from_finished_tasksr,rRrrrappend) r5rOrrrrnode_idtrigger_node_span span_linkrJr;r;r<rs     z+LangGraphIntegration._link_task_to_triggersused_finished_tasks_idsc Cst||}|tpg}|D]0}|j|i|}|dur"q|d}|dur,q|t|dd|ddddddq|t|dS) z~ Default handler that links any finished tasks not used as triggers for queued tasks to the outer graph span. Nr8rqr=rprrr) rrorVrr,rRrrrY) r5rrrstandalone_terminal_task_idsgraph_span_linksfinished_task_idrIr8r;r;r<r/s"   z4LangGraphIntegration._link_standalone_terminal_tasks)FN)Nr=)F)__name__ __module__ __qualname___integration_namerr,rrmrsr__annotations__r-r.boolr4rnrrarXrTrkrrrrrrrr __classcell__r;r;r9r<r*2sp   &0'    r*r1cCsLt|tr|jddd\}}||ifSt|dd}t|}t|}|||fS)z?Get the model name, provider, and settings from a langchain llmrGrB)maxsplitr}N)rjrsrSr_get_model_provider_get_model_settings)rumodel_provider_strmodel_name_strr}rwrxr;r;r<rzJs    rzcCs2t|dd}|dust|sdS|}|ddS)z+Get the model provider from a langchain llm_get_ls_paramsN ls_provider)rcallablerR)rumodel_provider_info_fnmodel_provider_infor;r;r<rWs  rcCs:t|dd}|dust|siS|}dd|DS)z+Get the model settings from a langchain llmrmNcSs"i|] \}}|tvr|r||qSr;)ALLOWED_MODEL_SETTINGS_KEYS)rkeyvaluer;r;r< hs"z'_get_model_settings..)rrrmr)ru model_dict_fn model_dictr;r;r<ras rcCs&|durdSt|tr |St|ddS)a! Get the system prompt from a react agent. The system prompt can be: - a string - a dict with a "content" key - a Callable that returns a string or dict In the case of a Callable (which is dynamic as a function of state and config), we end up returning None. Ncontent)rjrsr)rr;r;r<r|ks    r|rccCs(t|rt|di}t|}t|S)a: Get the tools for the agent manifest passed into the react agent. Tools can be: - a ToolNode - a list of BaseTools (langchain tools) - a list of Callables - a list of dicts In the case of a Callable (which is dynamic as a function of state and config), we end up returning None. tools_by_name) _is_tool_noderrnvalues_extract_tools)rcrr;r;r<r{s  r{cCs:|dus t|tr dSt|ddt|ddt|didS)z6Get the tool representation from a langchain base toolNrPr= descriptionr>)rPr parameters)rjrmr)toolr;r;r<'_get_tool_repr_from_langchain_base_tools    rcCst|ddduS)z@Check if a node is a tool node without a specific instance checkrNr)maybe_tool_noder;r;r<rsrcCsg}|dur|St|dd}|dur|St|dd}|dus#t|ts%|S|D]!}t|dd}|dur6q)t|s;q)t|di}|t|q)|S)z4Get the tools from the ToolNode(s) of an agent/graphNbuildernodesrunnabler)rrjrmrrextendr)rN graph_toolsrrrIrrr;r;r<ris$     ricCs(g}|D] }t|}|r||q|S)z5Extract the tool representations from a list of tools)rr)rc tools_reprr tool_reprr;r;r<rs rrc Cst|dg}|p g}g}|D]:}|tkr9tttttf|tg}t||}|dkr8| |\}} | | q| ttt||pFgq|S)a Return the set of task ids that are responsible for triggering the queued task, returning all the trigger nodes that wrote to the channel that the queued task consumes from. The one caveat is nodes queued up via `Send` commands. These nodes will have a `__pregel_push` as their trigger, and consume from the `__pregel_tasks` channel. We want to pop these instances and associate them one at a time with each of the queued tasks. triggersrH) r PREGEL_PUSHrrnrkrsrR PREGEL_TASKS_find_pregel_push_indexpoprr) queued_tasksrtask_triggers_from_task task_triggersrtrigger pregel_pushespregel_push_index_ trigger_idr;r;r<rs    rrcCs2t|D]\}\}}|t|ddkr|SqdS)zX Find the index of a specific pregel push node in the list of pregel push nodes rPr=rH) enumerater)rOripregel_push_noderr;r;r<rs rrcCs<i}|D]\}}t|dg}|D]}t|||qq|S)a Maps channel writes for finished tasks to the list of finished tasks ids that wrote to that channel. For `__pregel_tasks` writes, we append both the node name for the `Send` object, and the finished task id to be used in `_get_trigger_ids_from_finished_tasks`. writes)rr+_append_finished_task_to_channel_writes_map)r#channel_names_to_finished_tasks_idsr finished_taskrwriter;r;r<rs rrrcCsnt|tr t|dkr dS|\}}||g}|tkr0t|dd}|dur'dS|||fdS||dS)aM Appends the finished task id to the map of channel names to finished tasks ids. If the write represents a `__pregel_tasks` write, then append both the node name it's writing to, and the finished task id. Otherwise, just append the finished task id to the list of channel writes that the finished task is writing to. NrI)rjrkrlrrrrr)rrrchannel_write_namechannel_write_argtasks_for_triggerpregel_task_noder;r;r<rs  rr8cCs$t|tptt|jddddS)z Create a default input-to-input span link for a given span, if there are no referenced spans that represent the causal link. In this case, we assume the span is linked to its parent's input. rArr)rrVrrr rp)r8r;r;r<rUs  rUN)?typingrrrrrweakrefrddtrace.internal.loggerrddtrace.internal.utilsr ddtrace.internal.utils.formatsr ddtrace.llmobsr ddtrace.llmobs._constantsr r rrrrrr!ddtrace.llmobs._integrations.baser&ddtrace.llmobs._integrations.constantsr"ddtrace.llmobs._integrations.utilsrddtrace.llmobs._utilsrrddtrace.llmobs.typesr ddtrace.tracerrrrrrr*rkrsrmrzrrr|rnr{rrrirrintrrrrUr;r;r;r<st                        (   " "