o -i @sddlmZddlmZmZddlZddlmZmZddl m Z ddl m Z ddl mZedZe e ed d dGd d d ZdS) )field)AnyLiteralN) ConfigDictSkipValidation) dataclass)config) safe_hash)autocudacputpuxpuT)arbitrary_types_allowedc@sXeZdZUdZdZeeejBdBed< e ddZ e ed< de fd d Z d d Z dS) DeviceConfigz7Configuration for the device to use for vLLM execution.r NdeviceF)init device_typereturncCs g}tt|dd}|S)a WARNING: Whenever a new field is added to this config, ensure that it is included in the factors list if it affects the computation graph. Provide a hash that uniquely identifies all the configs that affect the structure of the computation graph from input ids/embeddings to the final hidden states, excluding anything before input ids/embeddings and after the final hidden states. F)usedforsecurity)r strencode hexdigest)selffactorshash_strrO/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/vllm/config/device.py compute_hash szDeviceConfig.compute_hashcCs|jdkrddlm}|j|_|jstdnt|jtr"|j|_n t|jtjr.|jj|_|jdvr8d|_dSt|j|_dS)Nr r)current_platformzFailed to infer device type, please set the environment variable `VLLM_LOGGING_LEVEL=DEBUG` to turn on verbose logging to help debug the issue.)r ) rvllm.platformsrr RuntimeError isinstancertorchtype)rrrrr __post_init__3s       zDeviceConfig.__post_init__)__name__ __module__ __qualname____doc__rrDevicer#__annotations__rrrrr%rrrrrs  r) dataclassesrtypingrrr#pydanticrrpydantic.dataclassesrvllm.config.utilsrvllm.utils.hashingr r*rrrrrs