o -i2@sddlmZddlmZmZmZddlmZddlm Z m Z m Z ddl m Z ddlmZddlmZddlmZed Zee Gd d d Zd S) )cached_property)AnyLiteralcastparse)Fieldfield_validatormodel_validator) dataclass)version)config) safe_hash)modelworkerallc@seZdZUdZdZedBed< edefddZ dZ edBed< dZ e e dBed< d Zeed < ed d d dZeed< d Zeed< d Zeed< d Zeed< d Zeed< d Zeed< edefddZedefddZdefddZedededBdedBfddZedededBdedBfddZedede e dBde e dBfd d!Zed"d#d$d%Z dS)&ObservabilityConfigz6Configuration for observability - metrics and tracing.Nshow_hidden_metrics_for_versionreturncCs|jdurdSt|jS)z,Check if the hidden metrics should be shown.NF)rr _prev_minor_version_wasselfrV/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/vllm/config/observability.pyshow_hidden_metricss  z'ObservabilityConfig.show_hidden_metricsotlp_traces_endpointcollect_detailed_tracesFkv_cache_metricsg{Gz?r)defaultgtlekv_cache_metrics_samplecudagraph_metricsenable_layerwise_nvtx_tracingenable_mfu_metricsenable_mm_processor_stats enable_logging_iteration_detailscC|jduod|jvpd|jvS)z6Whether to collect model forward time for the request.Nrrrrrrrcollect_model_forward_timeQ  z.ObservabilityConfig.collect_model_forward_timecCr()z6Whether to collect model execute time for the request.Nrrr)rrrrcollect_model_execute_timeYr+z.ObservabilityConfig.collect_model_execute_timecCs g}tt|dd}|S)a WARNING: Whenever a new field is added to this config, ensure that it is included in the factors list if it affects the computation graph. Provide a hash that uniquely identifies all the configs that affect the structure of the computation graph from input ids/embeddings to the final hidden states, excluding anything before input ids/embeddings and after the final hidden states. F)usedforsecurity)rstrencode hexdigest)rfactorshash_strrrr compute_hashasz ObservabilityConfig.compute_hashvaluecCs|durt||S)Nrclsr4rrr)_validate_show_hidden_metrics_for_versionssz=ObservabilityConfig._validate_show_hidden_metrics_for_versioncCs0|durddlm}m}|std||S)Nr)is_otel_availableotel_import_error_tracebackzOpenTelemetry is not available. Unable to configure 'otlp_traces_endpoint'. Ensure OpenTelemetry packages are installed. Original error: ) vllm.tracingr8r9 ValueError)r6r4r8r9rrr_validate_otlp_traces_endpoint{sz2ObservabilityConfig._validate_otlp_traces_endpointcCs<|durt|dkrd|dvrttt|dd}|S)zoHandle the legacy case where users might provide a comma-separated string instead of a list of strings.Nr,r)lenrlistDetailedTraceModulessplitr5rrr!_validate_collect_detailed_tracess z5ObservabilityConfig._validate_collect_detailed_tracesafter)modecCs|jr |js td|S)NzDcollect_detailed_traces requires `--otlp-traces-endpoint` to be set.)rrr;rrrr_validate_tracing_configs z,ObservabilityConfig._validate_tracing_config)!__name__ __module__ __qualname____doc__rr.__annotations__rboolrrrr?r@rrr"floatr#r$r%r&r'r*r,r3r classmethodr7r<rBr rErrrrrsX           rN) functoolsrtypingrrrpackaging.versionrpydanticrr r pydantic.dataclassesr vllmr vllm.config.utilsr vllm.utils.hashingrr@rrrrrs