o i@sddlmZddlmZmZmZddlmZddlm Z m Z m Z ddl m Z ddlmZddlmZedZeGd d d Zd S) )cached_property)AnyLiteralcastparse)Fieldfield_validatormodel_validator)version)config) safe_hash)modelworkerallc@seZdZUdZdZedBed< edefddZ dZ edBed< dZ e e dBed< d Zeed < ed d d dZeed< d Zeed< d Zeed< d Zeed< d Zeed< d Zeed< edefddZedefddZdefddZedededBdedBfddZedededBdedBfddZedede e dBde e dBfd d!Zed"d#d$d%Z dS)&ObservabilityConfigz6Configuration for observability - metrics and tracing.Nshow_hidden_metrics_for_versionreturncCs|jdurdSt|jS)z,Check if the hidden metrics should be shown.NF)rr _prev_minor_version_wasselfrO/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/config/observability.pyshow_hidden_metricss  z'ObservabilityConfig.show_hidden_metricsotlp_traces_endpointcollect_detailed_tracesFkv_cache_metricsg{Gz?r)defaultgtlekv_cache_metrics_samplecudagraph_metricsenable_layerwise_nvtx_tracingenable_mfu_metricsenable_mm_processor_stats enable_logging_iteration_detailscC|jduod|jvpd|jvS)z6Whether to collect model forward time for the request.Nrrrrrrrcollect_model_forward_timeO  z.ObservabilityConfig.collect_model_forward_timecCr')z6Whether to collect model execute time for the request.Nrrr(rrrrcollect_model_execute_timeWr*z.ObservabilityConfig.collect_model_execute_timecCs g}tt|dd}|S)a WARNING: Whenever a new field is added to this config, ensure that it is included in the factors list if it affects the computation graph. Provide a hash that uniquely identifies all the configs that affect the structure of the computation graph from input ids/embeddings to the final hidden states, excluding anything before input ids/embeddings and after the final hidden states. F)usedforsecurity)r strencode hexdigest)rfactorshash_strrrr compute_hash_sz ObservabilityConfig.compute_hashvaluecCs|durt||S)Nrclsr3rrr)_validate_show_hidden_metrics_for_versionqsz=ObservabilityConfig._validate_show_hidden_metrics_for_versioncCs0|durddlm}m}|std||S)Nr)is_tracing_availableotel_import_error_tracebackzOpenTelemetry is not available. Unable to configure 'otlp_traces_endpoint'. Ensure OpenTelemetry packages are installed. Original error: ) vllm.tracingr7r8 ValueError)r5r3r7r8rrr_validate_otlp_traces_endpointysz2ObservabilityConfig._validate_otlp_traces_endpointcCs<|durt|dkrd|dvrttt|dd}|S)zoHandle the legacy case where users might provide a comma-separated string instead of a list of strings.Nr,r)lenrlistDetailedTraceModulessplitr4rrr!_validate_collect_detailed_tracess z5ObservabilityConfig._validate_collect_detailed_tracesafter)modecCs|jr |js td|S)NzDcollect_detailed_traces requires `--otlp-traces-endpoint` to be set.)rrr:rrrr_validate_tracing_configs z,ObservabilityConfig._validate_tracing_config)!__name__ __module__ __qualname____doc__rr-__annotations__rboolrrrr>r?rrr!floatr"r#r$r%r&r)r+r2r classmethodr6r;rAr rDrrrrrsX           rN) functoolsrtypingrrrpackaging.versionrpydanticrr r vllmr vllm.config.utilsr vllm.utils.hashingr r?rrrrrs