o 8wik# @sddlZddlZddlZddlZddlZddlZddlmZmZddl m Z m Z ddl m Z ddlmZddlZddlmZddlmZddlmZdd lmZdd lmZdd lmZeeZ e!e"e fZ#e$Z% d&d e#d e e"de&e#e!e"e'e"fffddZ(GdddZ)d&d e#de ede#fddZ*d e#de"fddZ+d e#de"ddfddZ,d e#de"ddfddZ-d&d e#de"de e"de.fdd Z/Gd!d"d"ej0Z1d#e"de"fd$d%Z2dS)'N) ModuleType TracebackType)AnyOptional)Version)override) LightningEnum) _IS_WINDOWS)_PATH)PossibleUserWarning)_migration_index)rank_zero_warn checkpointtarget_versionreturncCst|}t|ttjkrtd|dtjtd|ifSt}i}|D]\}}t|||s2q'|D]}||}q4dd|D||<q'|tjkrOt ||t |tj||fS)a1Applies Lightning version migrations to a checkpoint dictionary. Args: checkpoint: A dictionary with the loaded state from the checkpoint file. target_version: Run migrations only up to this version (inclusive), even if migration index contains migration functions for newer versions than this target. Mainly useful for testing. Note: The migration happens in-place. We specifically avoid copying the dict to avoid memory spikes for large checkpoints and objects that do not support being deep-copied. z3The loaded checkpoint was produced with Lightning vz7, which is newer than your current Lightning version: v)categorycSsg|]}|jqS)__name__).0fnrrh/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/pytorch_lightning/utilities/migration/utils.py Gsz&migrate_checkpoint..) _get_versionrpl __version__r r r items_should_upgrade_set_legacy_version _set_version)rr ckpt_versionindexapplied_migrationsmigration_versionmigration_functionsmigration_functionrrrmigrate_checkpoint's*     r%c@sDeZdZdZd ddZdeeedeedeeddfd d Z dS) pl_legacy_patchaRegisters legacy artifacts (classes, methods, etc.) that were removed but still need to be included for unpickling old checkpoints. The following patches apply. 1. ``pytorch_lightning.utilities.argparse._gpus_arg_default``: Applies to all checkpoints saved prior to version 1.2.8. See: https://github.com/Lightning-AI/pytorch-lightning/pull/6898 2. ``pytorch_lightning.utilities.argparse_utils``: A module that was deprecated in 1.2 and removed in 1.4, but still needs to be available for import for legacy checkpoints. 3. ``pytorch_lightning.utilities.enums._FaultTolerantMode``: This enum was removed in 2.0 but was pickled into older checkpoints. 4. In legacy versions of Lightning, callback classes got pickled into the checkpoint. These classes have a module import path under ``pytorch_lightning`` and must be redirected to the ``pytorch_lightning``. Example: with pl_legacy_patch(): torch.load("path/to/legacy/checkpoint.ckpt") rcCs^ttd}|tjd<dd|_ddtjj_Gdddt }|tjj _ t j |_tt _ |S)N*pytorch_lightning.utilities.argparse_utilscS|SNrxrrrjz+pl_legacy_patch.__enter__..cSr(r)rr*rrrr,kr-c@seZdZdZdZdZdS)z5pl_legacy_patch.__enter__.._FaultTolerantModedisabled automaticmanualN)r __module__ __qualname__DISABLED AUTOMATICMANUALrrrr_FaultTolerantModensr6)_lockacquirersysmodules_gpus_arg_defaultr utilitiesargparserenumsr6pickle Unpickler_old_unpickler_RedirectingUnpickler)selflegacy_argparse_moduler6rrr __enter__cs   zpl_legacy_patch.__enter__exc_type exc_value exc_tracebackNcCsTttjjdrttjjdtjd=ttjjdr ttjjd|jt _ t dS)Nr;r'r6) hasattrrr<r=delattrr9r:r>rAr?r@r7release)rCrFrGrHrrr__exit__zs zpl_legacy_patch.__exit__)rr&) rr1r2__doc__rErtype BaseExceptionrrLrrrrr&Os  r&checkpoint_pathc Cstt|}t|\}}t|}|r|dur|Sts!tj|tntj|}t d|d|dt |d|S)zApplies Lightning version migrations to a checkpoint dictionary and prints infos for the user. This function is used by the Lightning Trainer when resuming from a checkpoint. Nz>Lightning automatically upgraded your loaded checkpoint from vz to vzp. To apply the upgrade to your files permanently, run `python -m pytorch_lightning.utilities.upgrade_checkpoint `) rr%r ospathrelpathgetcwdabspath_loginfostr)rrP old_version migrations new_version path_hintrrr_pl_migrate_checkpoints  "r^cCs|dS)z*Get the version of a Lightning checkpoint.pytorch-lightning_versionr)rrrrrsrversioncCs ||d<dS)z*Set the version of a Lightning checkpoint.r_Nrrr`rrrrs rcCs|d|dS)zXSet the legacy version of a Lightning checkpoint if a legacy version is not already set.z legacy_pytorch-lightning_versionN) setdefaultrarrrrsrtarget max_versioncCs0t|}|dup |t|k}|ott||kS)zfReturns whether a checkpoint qualifies for an upgrade when the version is lower than the given target.N)rr)rrcrdris_lte_max_versionrrrrsrcs2eZdZdZedededeffdd ZZS)rBaRedirects the unpickling of `pytorch_lightning` classes to `pytorch_lightning`. In legacy versions of Lightning, callback classes got pickled into the checkpoint. These classes are defined in the `pytorch_lightning` but need to be loaded from `pytorch_lightning`. modulenamerc s@t|}||krtd|d|d|d|t||S)NzRedirecting import of .z to ) _patch_pl_to_mirror_if_necessarywarningswarnsuper find_class)rCrfrg new_module __class__rrrms"z _RedirectingUnpickler.find_class) rr1r2rMrrYrrm __classcell__rrrorrBs$rBrfcCs&d}||rd|t|dS|S)Npytorch_lightning) startswithlen)rf_plrrrris rir))3loggingrRr?r9 threadingrjtypesrrtypingrrpackaging.versionrtyping_extensionsrrrr lightning_fabric.utilities.enumsr"lightning_fabric.utilities.importsr lightning_fabric.utilities.typesr #lightning_fabric.utilities.warningsr /pytorch_lightning.utilities.migration.migrationr %pytorch_lightning.utilities.rank_zeror getLoggerrrWdictrY _CHECKPOINTLockr7tuplelistr%r&r^rrrboolr _UnpicklerrBrirrrrsH            (: