o 8wi"$@sddlmZmZmZddlmZeGdddZeGdddeZeGdddeZeGd d d eZ eGd d d eZ eGd dde Z eGddde Z eGdddeZ eGdddeZdS))asdict dataclassfield)overridec@sPeZdZdZdefddZdeddfddZededdfd d Zd d d Z dS) _BaseProgressz>Mixin that implements state-loading utilities for dataclasses.returncCst|SN)rselfr ]/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/pytorch_lightning/loops/progress.py state_dictsz_BaseProgress.state_dictr NcCs|j|dSr)__dict__updater r r r r load_state_dictsz_BaseProgress.load_state_dictcCs|}|||Sr)r)clsr objr r r from_state_dicts z_BaseProgress.from_state_dictcCst)zReset the object's state.)NotImplementedErrorr r r r reset#sz_BaseProgress.resetrN) __name__ __module__ __qualname____doc__dictr r classmethodrrr r r r rsrc@sTeZdZUdZdZeed<dZeed<edddZ dd d Z d eddfd d Z dS)_ReadyCompletedTrackeraFTrack an event's progress. Args: ready: Intended to track the number of events ready to start. completed: Intended to be incremented after the event completes (e.g. after ``on_*_end`` runs). These attributes should be increased in order, that is, :attr:`ready` first and :attr:`completed` last. rready completedrNcCsd|_d|_dS)zReset the state.rNrr r r r r r7s z_ReadyCompletedTracker.resetcCs |j|_dS)zReset the progress on restart. If there is a failure before all attributes are increased, restore the attributes to the last fully completed value. N)r rr r r r reset_on_restart=s z'_ReadyCompletedTracker.reset_on_restartncCs |j|7_|j|7_dSrr!r r#r r r increment_byFsz#_ReadyCompletedTracker.increment_byr) rrrrrint__annotations__r rrr"r%r r r r r(s     rc`eZdZUdZdZeed<ed fdd Zed fdd Z ed eddffd d Z Z S)_StartedTrackeraTrack an event's progress. Args: ready: Intended to track the number of events ready to start. started: Intended to be incremented after the event is started (e.g. after ``on_*_start`` runs). completed: Intended to be incremented after the event completes (e.g. after ``on_*_end`` runs). These attributes should be increased in order, that is, :attr:`ready` first and :attr:`completed` last. rstartedrNctd|_dSNr)superrr*r  __class__r r rZ  z_StartedTracker.resetct|j|_dSr)r-r"r r*r r.r r r"_  z _StartedTracker.reset_on_restartr#ct||j|7_dSr)r-r%r*r$r.r r r%d z_StartedTracker.increment_byr) rrrrr*r&r'rrr"r% __classcell__r r r.r r)Ks   r)cr()_ProcessedTrackeraTrack an event's progress. Args: ready: Intended to track the number of events ready to start. started: Intended to be incremented after the event is started (e.g. after ``on_*_start`` runs). processed: Intended to be incremented after the event is processed. completed: Intended to be incremented after the event completes (e.g. after ``on_*_end`` runs). These attributes should be increased in order, that is, :attr:`ready` first and :attr:`completed` last. r processedrNcr+r,)r-rr7r r.r r rzr0z_ProcessedTracker.resetcr1r)r-r"r r7r r.r r r"r2z"_ProcessedTracker.reset_on_restartr#cr3r)r-r%r7r$r.r r r%r4z_ProcessedTracker.increment_byr) rrrrr7r&r'rrr"r%r5r r r.r r6js   r6c@seZdZUdZeedZeed<eedZ eed<d!ddZ d!d d Z d!d d Z d!d dZ d!ddZedeededdfddZed!ddZd!ddZd!ddZdeddfddZededdfdd ZdS)" _ProgresszTrack aggregated and current progress. Args: total: Intended to track the total progress of an event. current: Intended to track the current progress of an event. default_factorytotalcurrentrNcCs|jj|jjur tddS)Nz?The `total` and `current` instances should be of the same class)r;r/r< ValueErrorr r r r __post_init__sz_Progress.__post_init__cC$|jjd7_|jjd7_dSN)r;rr<r r r r increment_readyz_Progress.increment_readycCFt|jtstd|jjjd|jjd7_|jjd7_dS)N`z$` doesn't have a `started` attributerA) isinstancer;r) TypeErrorr/rr*r<r r r r increment_started z_Progress.increment_startedcCrD)NrEz&` doesn't have a `processed` attributerA)rFr;r6rGr/rr7r<r r r r increment_processedrIz_Progress.increment_processedcCr?r@)r;r r<r r r r increment_completedrCz_Progress.increment_completed tracker_clskwargscKs ||di||di|dS)zZUtility function to easily create an instance from keyword arguments to both ``Tracker``s.)r;r<Nr r )rrLrMr r r from_defaultss z_Progress.from_defaultscC|j|jdSr)r;rr<r r r r r z_Progress.resetcC|jdSr)r<rr r r r reset_on_runz_Progress.reset_on_runcCrQr)r<r"r r r r r"rSz_Progress.reset_on_restartr#cCs|j||j|dSr)r;r%r<r$r r r r%s z_Progress.increment_byr cC$|j|d|j|ddS)Nr;r<)r;rr<rr r r rz_Progress.load_state_dictr)rrrrrr6r;rr'r<r>rBrHrJrKrtyper&rNrrrRr"r%rrr r r r r8s$         r8cs|eZdZUdZdZeed<edfdd Zedfdd Z dd e deddffd d Z ed e ddffdd Z ZS)_BatchProgressaWTracks batch progress. These counters are local to a trainer rank. By default, they are not globally synced across all ranks. Args: total: Tracks the total batch progress. current: Tracks the current batch progress. is_last_batch: Whether the batch is the last one. This is useful for iterable datasets. F is_last_batchrNcr+NF)r-rrXr r.r r rr0z_BatchProgress.resetcr+rY)r-rRrXr r.r r rRr0z_BatchProgress.reset_on_runr#cst|||_dSr)r-r%rX)r r#rXr.r r r%s  z_BatchProgress.increment_byr cst||d|_dS)NrX)r-rrXrr.r r rs z_BatchProgress.load_state_dictr)F)rrrrrXboolr'rrrRr&r%rrr5r r r.r rWs   rWc@s6eZdZUdZeedZeed<eedZeed<dS)_SchedulerProgressaTracks scheduler progress. These counters are local to a trainer rank. By default, they are not globally synced across all ranks. Args: total: Tracks the total scheduler progress. current: Tracks the current scheduler progress. r9r;r<N) rrrrrrr;r'r<r r r r r[s  r[c@sveZdZUdZedddZeed<edddZeed<e dd d Z dd d Z dddZ e de dd fddZd S)_OptimizerProgresszTrack optimizer progress. Args: step: Tracks ``optimizer.step`` calls. zero_grad: Tracks ``optimizer.zero_grad`` calls. cC ttSr)r8rNrr r r r  z_OptimizerProgress.r9stepcCr]r)r8rNr)r r r r r^r_ zero_gradrNcCrOr)r`rrar r r r r rPz_OptimizerProgress.resetcCrOr)r`rRrar r r r rR z_OptimizerProgress.reset_on_runcCrOr)r`r"rar r r r r"rbz#_OptimizerProgress.reset_on_restartr cCrT)Nr`ra)r`rrarr r r rrUz"_OptimizerProgress.load_state_dictr)rrrrrr`r8r'rarrrRr"rrr r r r r\s    r\c@sneZdZUdZeedZeed<ede fddZ e ddd Z dd d Z dd d Ze deddfddZdS)_OptimizationProgressz[Track optimization progress. Args: optimizer: Tracks optimizer progress. r9 optimizerrcCs |jjjjSr)rdr`r;r r r r r optimizer_steps's z%_OptimizationProgress.optimizer_stepsNcCrQr)rdrr r r r r+sz_OptimizationProgress.resetcCrQr)rdrRr r r r rR/rSz"_OptimizationProgress.reset_on_runcCrQr)rdr"r r r r r"2rSz&_OptimizationProgress.reset_on_restartr cCs|j|ddS)Nrd)rdrrr r r r5sz%_OptimizationProgress.load_state_dictr)rrrrrr\rdr'propertyr&rerrrRr"rrr r r r rcs    rcN) dataclassesrrrtyping_extensionsrrrr)r6r8rWr[r\rcr r r r s( ">"