o }oi9@sRdZddlZddlmZddlZddlZddgZGdddeZ GdddZ dS)z, This module support timing of code blocks. N)Optional NamedTimer SimpleTimerc@seZdZdZgdZdddZdd Zed d Zed d Z dddZ d ddZ d ddZ d ddZ ddZd ddZddZdS)!ra  A timer class that supports multiple named timers. A named timer can be used multiple times, in which case the average dt will be returned. A named timer cannot be started if it is already currently running. Use case: measuring execution of multiple code blocks. )meansumminmaxnonerFcCs>||jvrtd|d|j||_||_||_|dS)ac Args: reduction (str): reduction over multiple timings of the same timer (none - returns the list instead of a scalar) sync_cuda (bool): if True torch.cuda.synchronize() is called for start/stop buffer_size (int): if positive, limits the number of stored measures per name zUnknown reduction=z please use one of N)_REDUCTION_TYPE ValueError _reduction _sync_cuda _buffer_sizereset)self reduction sync_cuda buffer_sizerE/home/ubuntu/.local/lib/python3.10/site-packages/nemo/utils/timers.py__init__&s  zNamedTimer.__init__cCs ||SN)get)rkrrr __getitem__7s zNamedTimer.__getitem__cCs|jSr)rrrrrr:szNamedTimer.buffer_sizecCs&|jdkr dd}|Stt|j}|S)Nr cSs|Srr)xrrrAsz*NamedTimer._reduction_fn..)r getattrnp)rfnrrr _reduction_fn>s  zNamedTimer._reduction_fnNcCs |dur i|_dSi|j|<dS)z Resents all / specific timer Args: name (str): timer name to reset (if None all timers are reset) N)timers)rnamerrrrGs zNamedTimer.resetcCsZ|j|i}d|vrtd|d|jr tjr tjt|d<||j|<dS)zl Starts measuring a named timer. Args: name (str): timer name to start startzCannot start timer = 'z' since it is already activeN) r#r RuntimeErrorrtorchcudais_initialized synchronizetimerr$ timer_datarrrr&Ss  zNamedTimer.startcCs|j|d}|dusd|vrtd|d|jr$tjr$tjt| d}|dg|g|d<|j dkrI|d|j d|d<||j|<dS)zj Stops measuring a named timer. Args: name (str): timer name to stop Nr&zCannot end timer = 'z' since it is not activedtr) r#rr'rr(r)r*r+r,popr)rr$r.r/rrrstopgs  zNamedTimer.stopcCs|j|i}d|vr dSdS)Nr&TF)r#rr-rrr is_activeszNamedTimer.is_activecCsdd|jDS)z8 Return list of all active named timers cSsg|] \}}d|vr|qS)r&r.0rvrrr sz,NamedTimer.active_timers..)r#itemsrrrr active_timersszNamedTimer.active_timerscCs|j|dg}||S)zp Returns the value of a named timer Args: name (str): timer name to return r/)r#rr")rr$dt_listrrrrs zNamedTimer.getcs"|jfdd|jD}|S)zJ Exports a dictionary with average/all dt per named timer cs&i|]\}}d|vr||dqS)r/rr3r!rr s&z%NamedTimer.export..)r"r#r7)rdatarr:rexportszNamedTimer.export)rFr r)r%)__name__ __module__ __qualname____doc__r rrpropertyrr"rr&r1r2r8rr=rrrrrs         c@s\eZdZdZdddZddZddeejfd d Z ddeejfd d Z d e fddZ dS)rzU Simple Timer with maximum possible resolution, uses `time.perf_counter_ns`. TcCsd|_d|_||_dS)z Args: sync_cuda: synchronize CUDA device. The synchronization is done only if the device for start/stop is None or CUDA device. rN) total_time _start_timer)rrrrrrs zSimpleTimer.__init__cCsd|_d|_dS)z Reset timerrN)rCrDrrrrrs zSimpleTimer.resetNdevicecCsP|jrtjr|dus|jdkrtjj|d|jdur!tdt |_dS)zh Start timer. Args: device: CUDA device to synchronize (optional). Nr)rEzTimer already started) rr(r)r*typer+rDr'r,perf_counter_nsrrErrrr&s " zSimpleTimer.startcCsd|jrtjr|dus|jdkrtjj|d|jdur!td|jt |j7_d|_dS)zh Stop device. Args: device: CUDA device to synchronize (optional). Nr)rFzTimer not started) rr(r)r*rGr+rDr'rCr,rHrIrrrr1s "  zSimpleTimer.stopreturncCs |jdS)zReturn total time in secondsgeA)rCrrrr total_secs zSimpleTimer.total_sec)Tr) r>r?r@rArrrr(rEr&r1floatrKrrrrrs   ) rAr,typingrnumpyr r(__all__objectrrrrrrs