o i@sdZddlmZddlZddlmZeddeded eed eefd d Z ed ded eefddZ eddddededed eefddZ eddddedededed eef ddZ dededed efdd Z ed!d"d#d$dd%d&ed'ed(ed)ededed eefd*d+Zed,d-ed.ed/ed eefd0d1Zed2d3ed4ed5ed eefd6d7Zgd8ZdS)9zEGenerators that provide different rates, schedules, decays or series.)IterableN)registryzconstant_then.v1ratestepsschedulereturnccs*t|D]}|Vq|D]}|Vq dS)z>Yield a constant rate for N steps, before starting a schedule.N)range)rrrivaluer C/home/ubuntu/.local/lib/python3.10/site-packages/thinc/schedules.py constant_then s  rz constant.v1ccs |Vq)zYield a constant rate.r )rr r r constantsrz decaying.v1)t base_ratedecayrccs$ |dd||V|d7}q)aYield an infinite series of linearly decaying values, following the schedule: base_rate * 1 / (1 + decay * t) EXAMPLE: >>> learn_rates = decaying(0.001, 1e-4) >>> next(learn_rates) 0.001 >>> next(learn_rates) 0.00999 T?rr )rrrr r r decayings  rzcompounding.v1startstopcompoundccs$t|} t|||V||9}q)adYield an infinite series of compounding values. Each time the generator is called, a value is produced by multiplying the previous value by the compound rate. EXAMPLE: >>> sizes = compounding(1.0, 10.0, 1.5) >>> assert next(sizes) == 1. >>> assert next(sizes) == 1 * 1.5 >>> assert next(sizes) == 1.5 * 1.5 )float_clip)rrrrcurrr r r compounding,s rr cCs||kr t||St||S)N)maxmin)r rrr r r r@srzslanted_triangular.v1g? r)cut_fracratiorrmax_rate num_stepsr r!c csjt||} |d7}||kr||}nd|||d|d}|d||dd|}|Vq)zxYield an infinite series of values according to Howard and Ruder's "slanted triangular learning rate" schedule. Tr)int) r"r#r r!rrcutp learn_rater r r slanted_triangularDs  r(zwarmup_linear.v1 initial_rate warmup_steps total_stepsccsPd} ||kr|td|}ntd||td||}||V|d7}q)zGenerate a series, starting from an initial rate, and then with a warmup period, and then a linear decline. Used for learning rates. rTrrr)r)r)r*r+stepfactorr r r warmup_linear\s r.zcyclic_triangular.v1min_lrmax_lrperiodccsbd} td|d|}t||d|d}tdd|}||||V|d7}q)NrTr)numpyfloorabsr)r/r0r1itcyclexrelativer r r cyclic_triangularosr:)r:r.rrrr.r(r)__doc__typingrr3configr schedulesrr$rrrrrr(r.r:__all__r r r r s    &