o zi|# @sddlZddlZddlZddlZddlZddlZddlmZmZddl m Z m Z m Z m Z mZmZddlmZddlmZddlZddlmZddlmZddlmZdd lmZdd lmZdd l m!Z!e"e#Z$e e%e fZ&e'Z( d&d e&d e e%dee&e e%e e%fffddZ)GdddZ*d&d e&de ede&fddZ+d e&de%fddZ,d e&de%ddfddZ-d e&de%ddfddZ.d&d e&de%de e%de/fdd Z0Gd!d"d"ej1Z2d#e%de%fd$d%Z3dS)'N) ModuleType TracebackType)AnyDictListOptionalTupleType)Version)override) LightningEnum) _IS_WINDOWS)_PATH)PossibleUserWarning)_migration_index)rank_zero_warn checkpointtarget_versionreturncCst|}t|ttjkrtd|dtjtd|ifSt}i}|D]\}}t|||s2q'|D]}||}q4dd|D||<q'|tjkrOt ||t |tj||fS)a1Applies Lightning version migrations to a checkpoint dictionary. Args: checkpoint: A dictionary with the loaded state from the checkpoint file. target_version: Run migrations only up to this version (inclusive), even if migration index contains migration functions for newer versions than this target. Mainly useful for testing. Note: The migration happens in-place. We specifically avoid copying the dict to avoid memory spikes for large checkpoints and objects that do not support being deep-copied. z3The loaded checkpoint was produced with Lightning vz7, which is newer than your current Lightning version: v)categorycSsg|]}|jqS)__name__).0fnrr_/home/ubuntu/.local/lib/python3.10/site-packages/pytorch_lightning/utilities/migration/utils.py Gsz&migrate_checkpoint..) _get_versionr pl __version__rrritems_should_upgrade_set_legacy_version _set_version)rr ckpt_versionindexapplied_migrationsmigration_versionmigration_functionsmigration_functionrrrmigrate_checkpoint's*     r)c@sDeZdZdZd ddZdeeedeedeeddfd d Z dS) pl_legacy_patchaRegisters legacy artifacts (classes, methods, etc.) that were removed but still need to be included for unpickling old checkpoints. The following patches apply. 1. ``pytorch_lightning.utilities.argparse._gpus_arg_default``: Applies to all checkpoints saved prior to version 1.2.8. See: https://github.com/Lightning-AI/lightning/pull/6898 2. ``pytorch_lightning.utilities.argparse_utils``: A module that was deprecated in 1.2 and removed in 1.4, but still needs to be available for import for legacy checkpoints. 3. ``pytorch_lightning.utilities.enums._FaultTolerantMode``: This enum was removed in 2.0 but was pickled into older checkpoints. 4. In legacy versions of Lightning, callback classes got pickled into the checkpoint. These classes have a module import path under ``pytorch_lightning`` and must be redirected to the ``pytorch_lightning``. Example: with pl_legacy_patch(): torch.load("path/to/legacy/checkpoint.ckpt") rcCs^ttd}|tjd<dd|_ddtjj_Gdddt }|tjj _ t j |_tt _ |S)N*pytorch_lightning.utilities.argparse_utilscS|SNrxrrrjz+pl_legacy_patch.__enter__..cSr,r-rr.rrrr0kr1c@seZdZdZdZdZdS)z5pl_legacy_patch.__enter__.._FaultTolerantModedisabled automaticmanualN)r __module__ __qualname__DISABLED AUTOMATICMANUALrrrr_FaultTolerantModensr:)_lockacquirersysmodules_gpus_arg_defaultr utilitiesargparser enumsr:pickle Unpickler_old_unpickler_RedirectingUnpickler)selflegacy_argparse_moduler:rrr __enter__cs   zpl_legacy_patch.__enter__exc_type exc_value exc_tracebackNcCsTttjjdrttjjdtjd=ttjjdr ttjjd|jt _ t dS)Nr?r+r:) hasattrrr@rAdelattrr=r>rBrErCrDr;release)rGrJrKrLrrr__exit__zs zpl_legacy_patch.__exit__)rr*) rr5r6__doc__rIrr BaseExceptionrrPrrrrr*Os  r*checkpoint_pathc Cstt|}t|\}}t|}|r|dur|Sts!tj|tntj|}t d|d|dt |d|S)zApplies Lightning version migrations to a checkpoint dictionary and prints infos for the user. This function is used by the Lightning Trainer when resuming from a checkpoint. Nz>Lightning automatically upgraded your loaded checkpoint from vz to vzp. To apply the upgrade to your files permanently, run `python -m pytorch_lightning.utilities.upgrade_checkpoint `) rr)r ospathrelpathgetcwdabspath_loginfostr)rrS old_version migrations new_version path_hintrrr_pl_migrate_checkpoints  "racCs|dS)z*Get the version of a Lightning checkpoint.pytorch-lightning_versionr)rrrrrsrversioncCs ||d<dS)z*Set the version of a Lightning checkpoint.rbNrrrcrrrr"s r"cCs|d|dS)zXSet the legacy version of a Lightning checkpoint if a legacy version is not already set.z legacy_pytorch-lightning_versionN) setdefaultrdrrrr!sr!target max_versioncCs0t|}|dup |t|k}|ott||kS)zfReturns whether a checkpoint qualifies for an upgrade when the version is lower than the given target.N)r r)rrfrgris_lte_max_versionrrrr sr cs2eZdZdZedededeffdd ZZS)rFaRedirects the unpickling of `pytorch_lightning` classes to `pytorch_lightning`. In legacy versions of Lightning, callback classes got pickled into the checkpoint. These classes are defined in the `pytorch_lightning` but need to be loaded from `pytorch_lightning`. modulenamerc s@t|}||krtd|d|d|d|t||S)NzRedirecting import of .z to ) _patch_pl_to_mirror_if_necessarywarningswarnsuper find_class)rGrirj new_module __class__rrrps"z _RedirectingUnpickler.find_class) rr5r6rQr r\rrp __classcell__rrrrrrFs$rFricCs&d}||rd|t|dS|S)Npytorch_lightning) startswithlen)ri_plrrrrls rlr-)4loggingrUrCr= threadingrmtypesrrtypingrrrrrr packaging.versionr typing_extensionsr rur lightning_fabric.utilities.enumsr "lightning_fabric.utilities.importsr lightning_fabric.utilities.typesr#lightning_fabric.utilities.warningsr/pytorch_lightning.utilities.migration.migrationr%pytorch_lightning.utilities.rank_zeror getLoggerrrZr\ _CHECKPOINTLockr;r)r*rarr"r!boolr _UnpicklerrFrlrrrrsH             (: