o i3@sdZddlZddlZddlZddlZddlZddlZddlZddlm Z m Z m Z m Z ddl mZmZmZmZmZddlmZddlmZmZmZmZmZddlZddlmZddlmZdd l mZ!dd l m"Z"dd l#m$Z$m%Z%dd l&m'Z'e'e(Z)erdd l*m+Z+neZ+e,e+Z-ede+dZ.e$e!fd d?ddde,e.dBdedBdede,e.e e,e.ge,e.fBfddZ/de-de0defddZ1de-de0de2fddZ3de.de.fddZ4   d@d e5d!e e0d"edBd#e gefdBd$e2def d%d&Z6de,ede7e0e0ffd'd(Z8e%Gd)d*d*eZ9Gd+d,d,eZ:de.d-e7e0efde.fd.d/Z;d0d1Zd5e7e0e5fde0fd6d7Z?eGd8d9d9Z@de.d:e0d;e0eAe0BdZBdS)Az.Utility functions for vLLM config dataclasses.N)CallableMappingSequenceSet)MISSINGFieldfieldfields is_dataclass)pairwise) TYPE_CHECKINGAnyProtocolTypeVarcast) ConfigDict dataclass)r) FieldInfo)dataclass_transformruntime_checkable) init_logger)DataclassInstanceConfigT)bound)field_specifiers)configclsrkwargsreturnc s>tdd|dur|fdd}|dur|S||S)aDecorator to create a pydantic dataclass with default config. The default config for the dataclass forbids extra fields. All config classes in vLLM should use this decorator. Args: cls: The class to decorate config: The pydantic ConfigDict to use. If provided, it will be merged with the default config. **kwargs: Additional arguments to pass to pydantic.dataclass.forbid)extraNcst|fdiS)Nrrrr merged_configG/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/config/utils.py decorator;szconfig..decorator)rupdate)rrrr'r%r#r&r%s  namec st|stdztfddt|D}Wnty0}z tdd|jd|d}~ww|j}|j}|j }t |t r\|j durG|j }|jdurYt t gtf|j}t}n|j}|turl|turltd|jt|||d S) zrGet the default factory field of a dataclass by name. Used for getting default factory fields in `EngineArgs`.z#The given class is not a dataclass.c3s|] }|jkr|VqdSNr).0fr+r%r& Kszget_field..zField 'z' not found in .Nz(%s.%s has no default or default factory.)defaultdefault_factoryinit)r TypeErrornextr StopIteration ValueError__name__r1r2r3 isinstancerrrr rlogger warning_oncer)rr) named_fielder1r2r3r%r+r& get_fieldEs.   r>cCs t||jSr*)r>r3)rr)r%r%r& is_init_fielde r?dataclass_instancec s<t||j}fdd|D}||di|S)zLike [`dataclasses.replace`](https://docs.python.org/3/library/dataclasses.html#dataclasses.replace), but compatible with Pydantic dataclasses which use `pydantic.fields.Field` instead of `dataclasses.field`cs i|] \}}t|r||qSr%)r?r-kvr"r%r& os zreplace..Nr%)type__dict__itemsr()rArdataclass_dictr%r"r&replaceis  rJFobjectnamesr1r2warncCsbt|D]#\}}t||r'|r |dkr tdt|j||dt||Sq|dur/|S|S)a A helper function that retrieves an attribute from an object which may have multiple possible names. This is useful when fetching attributes from arbitrary `transformers.PretrainedConfig` instances. In the case where the first name in `names` is the preferred name, and any other names are deprecated aliases, setting `warn=True` will log a warning when a deprecated name is used. rzc%s contains a deprecated attribute name '%s'. Please use the preferred attribute name '%s' instead.N) enumeratehasattrr:r;rFr8getattr)rKrLr1r2rMir)r%r%r& getattr_iterts   rRcCsttt|jd}t|tjst di}t |jD]G\}}t|tj tj fr@t|tj r@t|jtjr@t|jjtsAqt|jj}t|tj rQ|jn|jg}|D]}t|tjs`qW|||j<qWq|S)zw Get any docstrings placed after attribute assignments in a class body. https://davidism.com/mit-license/ rzGiven object was not a class.)astparsetextwrapdedentinspect getsourcebodyr9ClassDefr4r Assign AnnAssignExprvalueConstantstrcleandoctargetstargetNameid)rcls_nodeoutabdocrbrcr%r%r& get_attr_docss,      rkc@seZdZdefddZdS) SupportsHashrcCdSr*r%selfr%r%r& compute_hashzSupportsHash.compute_hashN)r8 __module__ __qualname__r`rpr%r%r%r&rlsrlc@s"eZdZdeeeffddZdS)SupportsMetricsInforcCrmr*r%rnr%r%r& metrics_inforqz SupportsMetricsInfo.metrics_infoN)r8rrrsdictr`rur%r%r%r&rtsrt overridesc Csi}|D]F\}}t||sJt|d|dt||}t|rHt|sHt|tsCJdt|d|dt|dt|t||}|||<qt|fi|S)Nz has no field ``z Overrides to r0z must be a dict or z , but got ) rHrOrFrPr r9rv update_configrJ)rrwprocessed_overrides field_namer^ current_valuer%r%r&rys(    rycs dus tttttfrSttjr'jjdjj }|t j fStt rLt dd}t dt dd}ddd||fDpKtStd r]tt d dr]Stretd ttjrotStttfrzSttjrz tWStytYSwtrjjdjj }tfd d t t!d ddD}||fStt"rtt dd #DStt$rtt dd DStt%rttttfstdd DStdrtj&r&Stdt j'd)zReturn a stable, JSON-serializable canonical form for hashing. Order: primitives, special types (Enum, callable, torch.dtype, Path), then generic containers (Mapping/Set/Sequence) with recursion. Nr0rrrsr8cSsg|]}|r|qSr%r%)r-pr%r%r& sz#normalize_value..uuidz:normalize_value: function or callable instance unsupportedc3s&|]}|jtt|jfVqdSr*)r)normalize_valuerPr,xr%r&r/s  z"normalize_value..cSs|jSr*r+)r.r%r%r&sz!normalize_value..)keycss$|] \}}t|t|fVqdSr*)r`rrBr%r%r&r/s"css|] }tt|VqdSr*)reprrr-rDr%r%r&r/scss|]}t|VqdSr*)rrr%r%r&r/sto_json_stringz#normalize_value: unsupported type 'zi'. Ensure config values use supported primitives/containers or add a stable representation for this type.)(r9boolintfloatr`enumEnum __class__rrrsrr^rFrPjoinrrOcallablerr4torchdtypebytes bytearrayhexpathlibPath expanduserresolve Exceptionr tuplesortedr rrHrrrr8)r enum_typemodulequaltype_fqnrHr%rr&rsP          rignored_factorsc Csxi}t|D]3}|j}||vrqt||d}zt|||<Wqty9}ztd|dt|jd|d}~ww|S)zGets the factors used for hashing a config class. - Includes all dataclass fields not in `ignored_factors`. - Errors on non-normalizable values. Nz,get_hash_factors: unsupported type for key 'z' ())r r)rPrr4rFr8)rrfactorsdc_fieldfactorr^r=r%r%r&get_hash_factors.s&  rrHcCsttj|ddS)z=Return a SHA-256 hex digest of the canonical items structure.T) sort_keys)hashlibsha256jsondumpsencode hexdigest)rHr%r%r& hash_factorsCrc@s~eZdZUdZeed<eed<defddZdedefdd Zd e defd d Z defd dZ de fddZ de fddZdS)RangezG A range of numbers. Inclusive of start, inclusive of end. startendrcCs |j|jkSr*rrrnr%r%r&is_single_sizeRr@zRange.is_single_sizesizecCs|j|ko |jkSSr*r)rorr%r%r& __contains__UrzRange.__contains__othercCs&t|tsdS|j|jko|j|jkS)NF)r9rrr)rorr%r%r&__eq__Ys z Range.__eq__cCst|j|jfSr*)hashrrrnr%r%r&__hash__^szRange.__hash__cCsd|jd|jdS)N(, rrrnr%r%r&__str__asz Range.__str__cCs|Sr*)rrnr%r%r&__repr__dszRange.__repr__N)r8rrrs__doc__r__annotations__rrrrKrrr`rrr%r%r%r&rHs rold_namenew_name_or_namesremoval_versioncCslt||}|dur dSt|tr|g}n|}|d|dd|d}t||D]}t|||q+dS)Nz& is deprecated and will be removed in z. Use rz instead.)rPr9r`rr:warningsetattr)rrrrold_val new_namesmsgnew_namer%r%r&handle_deprecatedhs    rr*)NNF)CrrSrrrWrrrUcollections.abcrrrr dataclassesrrrr r itertoolsr typingr r rrrrpydanticrpydantic.dataclassesrpydantic.fields PydanticFieldrtyping_extensionsrr vllm.loggerrr8r: _typeshedrrF ConfigTyperrr`r>rr?rJrKrRrvrkrlrtryrsetrrrlistrr%r%r%r&s            )"V