o ॵiv @sddlmZddlmZddlmZejejdGdddeZejejdGdd d eZejej dGd d d eZ d S) ) LR_Schedulers) LR_SCHEDULER) BaseWarmup) module_namec.eZdZdZ  dfdd ZddZZS) ConstantWarmupaJLinear warmup scheduler. Args: base_scheduler (torch.optim._LRScheduler): an instance of torch.optim._LRScheduler type warmup_ratio (float): Lr used at warmup stage equals to warmup_ratio * initial_lr warmup_iters (int | list): Warmup iterations last_epoch (int): The index of last epoch. 皙?c ||_tt|j|||ddSN) warmup_iters last_epoch) warmup_ratiosuperr__init__selfbase_schedulerr rr __class__a/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/trainers/lrscheduler/warmup/warmup.pyr  zConstantWarmup.__init__cCs||jkrdS|jS)Ng?r r)rcur_iterrrrget_warmup_scales zConstantWarmup.get_warmup_scaler r __name__ __module__ __qualname____doc__rr __classcell__rrrrr   rcr) LinearWarmupaULinear warmup scheduler. Args: base_scheduler (torch.optim._LRScheduler): an instance of torch.optim._LRScheduler type warmup_iters (int | list): Warmup iterations warmup_ratio (float): Lr used at the beginning of warmup equals to warmup_ratio * initial_lr last_epoch (int): The index of last epoch. r r cr r )rrr%rrrrrr,rzLinearWarmup.__init__cCs d||jd|j}d|SNrrrrkrrrr5szLinearWarmup.get_warmup_scalerrrrrrr%!r$r%cr) ExponentialWarmupaZExponential warmup scheduler. Args: base_scheduler (torch.optim._LRScheduler): an instance of torch.optim._LRScheduler type warmup_iters (int | list): Warmup iterations warmup_ratio (float): Lr used at the beginning of warmup equals to warmup_ratio * initial_lr last_epoch (int): The index of last epoch. r r cr r )rrr)rrrrrrErzExponentialWarmup.__init__cCs|jd||j}|Sr&)rr r'rrrrNsz"ExponentialWarmup.get_warmup_scalerrrrrrr):r$r)N) modelscope.metainfor'modelscope.trainers.lrscheduler.builderrbaserregister_modulerr%r)rrrrs