o oi @sddlZddlZddlmZmZmZmZddlmZddl m Z ddl m Z m Z ddl mZddlmZeeZGdd d e ZdS) N)AnyCallableDictOptional)override) CheckpointIO) _atomic_saveget_filesystem)_load)_PATHc @seZdZdZeddeeefdede eddfddZ ed d fded e e deeeffd d Z ededdfddZ dS)TorchCheckpointIOzCheckpointIO that utilizes :func:`torch.save` and :func:`torch.load` to save and load checkpoints respectively, common for most use cases. .. warning:: This is an :ref:`experimental ` feature. N checkpointpathstorage_optionsreturncCsH|durtd|jjdt|}|jtj|ddt||dS)a~Save model/training states as a checkpoint file through state-dump and file-write. Args: checkpoint: dict containing model and trainer state path: write-target path storage_options: not used in ``TorchCheckpointIO.save_checkpoint`` Raises: TypeError: If ``storage_options`` arg is passed in Nze`Trainer.save_checkpoint(..., storage_options=...)` with `storage_options` arg is not supported for `za`. Please implement your custom `CheckpointIO` to define how you'd like to use `storage_options`.T)exist_ok) TypeError __class____name__r makedirsosrdirnamer)selfr rrfsrX/home/ubuntu/.local/lib/python3.10/site-packages/lightning/fabric/plugins/io/torch_io.pysave_checkpoint$sz!TorchCheckpointIO.save_checkpointcCs|SNr)storagelocrrr>szTorchCheckpointIO. map_locationcCs,t|}||std|t||dS)aLoads checkpoint using :func:`torch.load`, with additional handling for ``fsspec`` remote loading of files. Args: path: Path to checkpoint map_location: a function, :class:`torch.device`, string or a dict specifying how to remap storage locations. Returns: The loaded checkpoint. Raises: FileNotFoundError: If ``path`` is not found by the ``fsspec`` filesystem zCheckpoint file not found: )r!)r existsFileNotFoundErrorpl_load)rrr!rrrrload_checkpoint<s  z!TorchCheckpointIO.load_checkpointcCs8t|}||r|j|ddtd|dSdS)ziRemove checkpoint file from the filesystem. Args: path: Path to checkpoint T) recursivezRemoved checkpoint: N)r r"rmlogdebug)rrrrrrremove_checkpointUs  z#TorchCheckpointIO.remove_checkpointr)r __module__ __qualname____doc__rrstrrr rrrr%r*rrrrr s*  r )loggingrtypingrrrrtyping_extensionsr)lightning.fabric.plugins.io.checkpoint_ior#lightning.fabric.utilities.cloud_iorr r r$ lightning.fabric.utilities.typesr getLoggerrr(r rrrrs