o eib' @s,ddlZddlZddlZddlZddlmZmZddlmZddl m Z e dZ de de fdd Zd/d eede fd d Zdee e fdee e ffddZe dZde de fddZddZddZdddddddd d!Zd"d#Zd0d%d&ZeGd'd(d(Z d1d)e d*ed+ed,ejdBfd-d.ZdS)2N) OrderedDict defaultdict) dataclass)Anyz(?<=\.)(\d+)(?=\.|$)keyreturncCs td|S)zBReplace every dot-delimited integer with '*' to get the structure.*) _DIGIT_RXsub)rr _/home/ubuntu/transcripts/venv/lib/python3.10/site-packages/transformers/utils/loading_report.py _pattern_ofs r valuescCsRt|dkr t|dSt|}t||kr!|dd|dSdtt|S)zEFormat a list of ints as single number, {a, ..., b}, or first...last.rz...z, )lenstrsortedjoinmap)rcutoffr r r _fmt_indicess   rmappingcCsd}t|tsdd|D}d}tt}|D]8\}}t|}t|}t|D]\}}t |||kr=|| t ||| t |q)|| |qi} |D]`\}} | dd| d} }|d} | d} td t | D]<}|d t | kr| |d rtt| |d }t | |d d kr| d |d 7} n | |7} n| d7} | | |7} qv|| | <qWt| }|r|S|S) z Merge keys like 'layers.0.x', 'layers.1.x' into 'layers.{0, 1}.x' BUT only merge together keys that have the exact same value. Returns a new dict {merged_key: value}. FcSsi|]}||qSr r .0kr r r 2sz#update_key_name..TNrrrr{}) isinstancedictrlistitemsr findallr enumeraterappendsetaddintsplitrangerrrkeys)r not_mappingbucketrvaldigspattid out_itemsrsetspartsfinalinsertoutr r r update_key_name)s>     r:z\x1b\[[0-9;]*mscCstdt|S)N)_ansi_rer r)r;r r r _strip_ansiYsr>cCs*t|}td|tt|}|d|S)Nr )rmaxrr>)textwidthtpadr r r _pad]s rEcs||r tt|g|n|g}dd|Ddddt|D}dddD}fdd|D}d ||g|S) NcSsg|] }tdd|DqS)css|] }tt|VqdSN)rr>)rxr r r fs)_make_table...)r@)rcolr r r fsz_make_table.. | cs|] \}}t||VqdSrFrE)rhwr r r rHgz_make_table..z-+-css|]}d|VqdS)-Nr )rrPr r r rHhscs&g|]}dddt|DqS)rLcsrMrFrN)rcrPr r r rHirQrI)rzip)rrwidthsr r rKis& )r"rTr)rowsheaderscols header_linesep_linebodyr rVr _make_tablecs r_zzzz zzzz)resetredyelloworangepurplebolditalicdimcCs&tjrt||tdS|S)z^Return color-formatted input `s` if `sys.stdout` is interactive, e.g. connected to a terminal.r`)sysstdoutisattyPALETTE)r;colorr r r _colorys rmPcCs$ztjWSty|YSwrF)shutilget_terminal_sizecolumns Exception)defaultr r r _get_terminal_widths   rtc@seZdZUdZeeed<eeed<eeeeeeefed<e eed<e eefed<ddZ d d Z d ed Bfd dZ d S)LoadStateDictInfoaj Mutable container for state-dict loading results and diagnostics. Each entry in this structure is mutable, and will usually be mutated in-place during the loading pipeline. Attributes: missing_keys (`set[str]`): Keys that are missing from the loaded checkpoints but expected in the model's architecture. unexpected_keys (`set[str]`): Keys that are found in the checkpoints, but not expected in the model's architecture. mismatched_keys (`set[tuple[str, tuple[int], tuple[int]]]`): Keys that are found in the checkpoints and are expected in the model's architecture, but with a different shape. error_msgs ( `list[str]`): Some potential error messages. conversion_errors (`dict[str, str]`): Errors happening during the on-the-fly weight conversion process. missing_keysunexpected_keysmismatched_keys error_msgsconversion_errorscCs|jdd|jDBS)zMReturn all effective missing keys, including `missing` and `mismatched` keys.cSsh|]}|dqS)rr rr r r sz;LoadStateDictInfo.missing_and_mismatched..)rvrxselfr r r missing_and_mismatchedsz(LoadStateDictInfo.missing_and_mismatchedcCs|j|j|j|jdS)Nrvrwrxryrr|r r r to_dicts zLoadStateDictInfo.to_dictrNcCst}g}d}|jr/|dtddtdd7}t|jD]}tdd}|||ddgq|jrV|dtddtdd 7}t|jD]}tdd}|||dgqF|jr|dtd d tdd 7}d d|jD}t|D]\}\}} td d }||dt |dt | g} || qv|j r|dtddtdd7}t|j D]\}} tdd}d| d} |||| gqt |dkrdSddg} |dkr| dg7} n| ddg7} t || d}dtdd|td}||}|S)z/Generate the minimal table of a loading report.r<z - UNEXPECTEDrcrfzd :can be ignored when loading from different task/architecture; not ok if you expect identical arch.MISSINGrazu :those params were newly initialized because missing from the checkpoint. Consider training on your downstream task.MISMATCHrbzT :ckpt weights were loaded, but they did not match the original empty weight shapes.cSsi|] \}}}|||fqSr r )rabrSr r r rsz;LoadStateDictInfo.create_loading_report..z$Reinit due to size mismatch - ckpt: z vs model: CONVERSIONrdz& :originate from the conversion schemez rNKeyStatusDetails)rZzNotes:r`) rtrwrmrkr:r&rvrxr#rrzrr_)r}term_wrYtipsrstatusiteratorr shape_ckpt shape_modeldatav_detailsrZtablereportr r r create_loading_reportsZ          z'LoadStateDictInfo.create_loading_report)__name__ __module__ __qualname____doc__r'r__annotations__tupler)r"r!r~rrr r r r rus     rupretrained_model_name_or_pathignore_mismatched_sizes loading_infologgercCs|dur tt}|jr&d|j}d|vr|d7}td|jjd||}|dur0dStd|jjdtd d |d }| |||j rQtd |sZ|j r\td dSdS)z Log a readable report about state_dict loading issues. This version is terminal-size aware: for very small terminals it falls back to a compact Key | Status view so output doesn't wrap badly. Nz z size mismatchzb You may consider adding `ignore_mismatched_sizes=True` to `from_pretrained(...)` if appropriate.z#Error(s) in loading state_dict for z: rez LOAD REPORTr`z from: rXzWe encountered some issues during automatic conversion of the weights. For details look at the `CONVERSION` entries of the above report!zjYou set `ignore_mismatched_sizes` to `False`, thus raising an error. For details look at the above report!) logging getLoggerrryr RuntimeError __class__rrkwarningrzrx)modelrrrr error_msgrpreluder r r log_state_dict_reports.  & r)r)rnrF)rrerorh collectionsrr dataclassesrtypingrcompiler rr r"r)rr!r:r=r>rEr_rkrmrtruboolLoggerrr r r r sL    " -  h