o i@sddlZddlmZmZddlmZmZddlmZddl m Z ddl m Z ddl mZe eZedZd ed efd d Ze Gd ddZdS)N)AnyLiteral)Fieldmodel_validator)Self)config) init_logger) safe_hash)torchcudapathreturncCs&d|vr|dd}t|dkSdS)zCheck if path is a URI (scheme://...), excluding Windows drive letters. Supports custom URI schemes like gs://, s3://, hdfs://, etc. These paths should not be converted to absolute paths. z://rF)splitlen)r schemerJ/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/config/profiler.py _is_uri_paths rc@seZdZUdZdZedBed< dZeed< dZ e ed< dZ e ed < dZ e ed < dZ e ed < dZe ed < dZe ed < dZe ed< edddZeed< edddZeed< defddZedddefddZdS)ProfilerConfigz8Dataclass which contains profiler config for the engine.Nprofilertorch_profiler_dirTtorch_profiler_with_stackFtorch_profiler_with_flopstorch_profiler_use_gzip#torch_profiler_dump_cuda_time_totaltorch_profiler_record_shapestorch_profiler_with_memoryignore_frontendr)defaultgedelay_iterationsmax_iterationsr cCs g}tt|dd}|S)a WARNING: Whenever a new field is added to this config, ensure that it is included in the factors list if it affects the computation graph. Provide a hash that uniquely identifies all the configs that affect the structure of the computation graph from input ids/embeddings to the final hidden states, excluding anything before input ids/embeddings and after the final hidden states. F)usedforsecurity)r strencode hexdigest)selffactorshash_strrrr compute_hashTszProfilerConfig.compute_hashafter)modecCs|jdkp |jdk}|jdkr|r|jstd|j}|r'|jdkr'td|jdkr2|s2td|rCt|sCt j t j ||_|S)Nrr zzUsing 'torch' profiler with delay_iterations or max_iterations while ignore_frontend is False may result in high overhead.zEtorch_profiler_dir is only applicable when profiler is set to 'torch'z7torch_profiler_dir must be set when profiler is 'torch') r"r#rrlogger warning_oncer ValueErrorrosr abspath expanduser)r(has_delay_or_limit profiler_dirrrr_validate_profiler_configfs z(ProfilerConfig._validate_profiler_config)__name__ __module__ __qualname____doc__r ProfilerKind__annotations__rr%rboolrrrrrrrr"intr#r+rrr6rrrrr!s6         r)r1typingrrpydanticrrtyping_extensionsrvllm.config.utilsr vllm.loggerrvllm.utils.hashingr r7r.r;r%r=rrrrrrs