o -iw@sddlmZmZddlmZmZddlmZddlm Z ddl m Z ddl m Z er7ddlmZddlmZneZeZe eZe eGd d d Zd S) ) TYPE_CHECKINGAny)Fieldfield_validator) dataclass)config) init_logger) safe_hash) LoadFormats)TensorizerConfigc@seZdZUdZdZeeBed< dZedBed< dZ eed< e e dZ e e Bed < dZedBed < e d d dZeeeBed < dZeed< dZee eefBed< defddZeddddedefddZed ddd eeeBdeeeBfddZdS) LoadConfigz,Configuration for loading the model weights.auto load_formatN download_dirlazysafetensors_load_strategy)default_factorymodel_loader_extra_configdevicecCsdgS)N original/**/*rrrM/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/vllm/config/load.pyKszLoadConfig.ignore_patternsTuse_tqdm_on_loadcpupt_load_map_locationreturncCs g}tt|dd}|S)a WARNING: Whenever a new field is added to this config, ensure that it is included in the factors list if it affects the computation graph. Provide a hash that uniquely identifies all the configs that affect the structure of the computation graph from input ids/embeddings to the final hidden states, excluding anything before input ids/embeddings and after the final hidden states. F)usedforsecurity)r strencode hexdigest)selffactorshash_strrrr compute_hash\szLoadConfig.compute_hashafter)modecCs|S)N)lower)clsrrrr_lowercase_load_formatnsz!LoadConfig._lowercase_load_formatcCs&|dgkrt|dkrtd||S)Nrrzs