o -ik1 @sdZddlZddlZddlZddlZddlZddlZddlZddlm Z m Z m Z m Z m Z ddlmZmZmZmZmZmZmZddlmZddlmZmZmZmZddlZddlZddl m!Z!ddl"m#Z#dd l$m%Z%e%e&Z'erwdd l(m)Z)neZ)e*e)Z+ed e+d Z,d e,de,fddZ-d e+de.defddZ/   d;de0de e.dedBde gefdBde1def ddZ2de.de1fddZ3de.de1fdd Z4d e*ede5e.e.ffd!d"Z6d e+de.de1fd#d$Z7e#Gd%d&d&eZ8Gd'd(d(eZ9de,d)e5e.efde,fd*d+Z:d,d-Z;de,d.ede,d4e.d5e.e?e.Bd6e.ddf d7d8Z@eGd9d:d:ZAdS)8zget_field..zField 'z' not found in .)default_factoryN)defaultz. must have a default value or default factory.) r TypeErrorr ValueError__name__r&rr r' isinstancer)rr cls_fields named_fieldr&r'rrr get_field3s"     r.Fobjectnamesr'r&warncCsbt|D]#\}}t||r'|r |dkr tdt|j||dt||Sq|dur/|S|S)a A helper function that retrieves an attribute from an object which may have multiple possible names. This is useful when fetching attributes from arbitrary `transformers.PretrainedConfig` instances. In the case where the first name in `names` is the preferred name, and any other names are deprecated aliases, setting `warn=True` will log a warning when a deprecated name is used. rzc%s contains a deprecated attribute name '%s'. Please use the preferred attribute name '%s' instead.N) enumeratehasattrlogger warning_oncetyper*getattr)r/r0r'r&r1irrrr getattr_iterLs   r9textcCsd}t||}|duS)ak Check if the text looks like a printed Python object, e.g. contains any substring matching the pattern: "at 0xFFFFFFF>" We match against 0x followed by 2-16 hex chars (there's a max of 16 on a 64-bit system). Args: text (str): The text to check Returns: result (bool): `True` if a match is found, `False` otherwise. zat 0x[a-fA-F0-9]{2,16}>N)research)r:patternmatchrrrcontains_object_printjs r?cCst|sdStd|)NTzvLLM tried to hash some configs that may have Python objects ids in them. This is a bug, please file an issue. Text being hashed: )r?AssertionError)r:rrrassert_hashable|srAcCsttt|jd}t|tjst di}t |jD]G\}}t|tj tj fr@t|tj r@t|jtjr@t|jjtsAqt|jj}t|tj rQ|jn|jg}|D]}t|tjs`qW|||j<qWq|S)zw Get any docstrings placed after attribute assignments in a class body. https://davidism.com/mit-license/ rzGiven object was not a class.)astparsetextwrapdedentinspect getsourcebodyr+ClassDefr(rAssign AnnAssignExprvalueConstantstrcleandoctargetstargetNameid)rcls_nodeoutabdocrQrRrrr get_attr_docss,      rZcstfddt|DjS)Nc3s|] }|jkr|VqdSNrr rrr sz is_init_field..)nextr init)rrrrr is_init_fieldsr_c@seZdZdefddZdS) SupportsHashrcCdSr[rselfrrr compute_hashzSupportsHash.compute_hashN)r* __module__ __qualname__rOrdrrrrr`sr`c@s"eZdZdeeeffddZdS)SupportsMetricsInforcCrar[rrbrrr metrics_inforez SupportsMetricsInfo.metrics_infoN)r*rfrgdictrOrirrrrrhsrh overridesc Csi}|D]F\}}t||sJt|d|dt||}t|rHt|sHt|tsCJdt|d|dt|dt|t||}|||<qt|fi|S)Nz has no field ``z Overrides to r%z must be a dict or z , but got ) itemsr3r6r7r r+rj update_configr )rrkprocessed_overrides field_namerM current_valuerrrrns(    rncs dus tttttfrSttjr'jjdjj }|t j fStt rLt dd}t dt dd}ddd||fDpKtStd r]tt d dr]Stretd ttjrotStttfrzSttjrz tWStytYSwtrjjdjj }tfd d t t!d ddD}||fStt"rtt dd #DStt$rtt dd DStt%rttttfstdd DStdrtj&r&Stdt j'd)zReturn a stable, JSON-serializable canonical form for hashing. Order: primitives, special types (Enum, callable, torch.dtype, Path), then generic containers (Mapping/Set/Sequence) with recursion. Nr%rfrgr*cSsg|]}|r|qSrr)r!prrr r$z#normalize_value..uuidz:normalize_value: function or callable instance unsupportedc3s&|]}|jtt|jfVqdSr[)rnormalize_valuer7r xrrr\s  z"normalize_value..cSs|jSr[r)r"rrr sz!normalize_value..)keycss$|] \}}t|t|fVqdSr[)rOrv)r!kvrrrr\s"css|] }tt|VqdSr[)reprrvr!r|rrrr\scss|]}t|VqdSr[)rvr~rrrr\sto_json_stringz#normalize_value: unsupported type 'zi'. Ensure config values use supported primitives/containers or add a stable representation for this type.)(r+boolintfloatrOenumEnum __class__rfrgrvrMr6r7joinr}r3callablerur(torchdtypebytes bytearrayhexpathlibPath expanduserresolve Exceptionr tuplesortedr rrmrrrr*)rx enum_typemodulequaltype_fqnrmrrwrrvsP          rvignored_factorsc Csxi}t|D]3}|j}||vrqt||d}zt|||<Wqty9}ztd|dt|jd|d}~ww|S)zGets the factors used for hashing a config class. - Includes all dataclass fields not in `ignored_factors`. - Errors on non-normalizable values. Nz,get_hash_factors: unsupported type for key 'z' ())r rr7rvr(r6r*)rrfactorsdc_fieldfactorrMerrrget_hash_factors&s&  rrmcCsttj|ddS)z=Return a SHA-256 hex digest of the canonical items structure.T) sort_keys)hashlibsha256jsondumpsencode hexdigest)rmrrr hash_factors;rold_namenew_name_or_namesremoval_versioncCslt||}|dur dSt|tr|g}n|}|d|dd|d}t||D]}t|||q+dS)Nz& is deprecated and will be removed in z. Use , z instead.)r7r+rOrr4warningsetattr)rrrrold_val new_namesmsgnew_namerrrhandle_deprecated@s    rc@s~eZdZUdZeed<eed<defddZdedefdd Zd e defd d Z defd dZ de fddZ de fddZdS)RangezG A range of numbers. Inclusive of start, inclusive of end. startendrcCs |j|jkSr[rrrbrrris_single_sizecs zRange.is_single_sizesizecCs|j|ko |jkSSr[r)rcrrrr __contains__frzRange.__contains__othercCs&t|tsdS|j|jko|j|jkS)NF)r+rrr)rcrrrr__eq__js z Range.__eq__cCst|j|jfSr[)hashrrrbrrr__hash__oszRange.__hash__cCsd|jd|jdS)N(rrrrbrrr__str__rsz Range.__str__cCs|Sr[)rrbrrr__repr__uszRange.__repr__N)r*rfrg__doc__r__annotations__rrrr/rrrOrrrrrrrYs r)NNF)BrrBrrrFrrrDcollections.abcrrrrr dataclassesrrr r r r r itertoolsrtypingrrrrregexr;rpydantic.fieldsrtyping_extensionsr vllm.loggerrr*r4 _typeshedrr6 ConfigTyperrrOr.r/rr9r?rArjrZr_r`rhrnrvsetrrlistrrrrrrs$       )"V