o i @sddlZddlmZddlmZmZmZmZmZddl Z ddl m Z er*ddl m Z e jjddd e jZd eed efd d Zde deeefdeeeffddZde deeefdefddZdeeefd ee eeefgdffddZdS)N)partial) TYPE_CHECKINGAnyCallableDictIterable)LanguageCuratedTransformer model_loadersT) entry_pointsiterablereturncCs t|}t|dot|d S)ztReturn True if all the elements are equal to each other (or if the input is an empty sequence), False otherwise.TF) itertoolsgroupbynext)rgrS/home/ubuntu/.local/lib/python3.10/site-packages/spacy_curated_transformers/util.py all_equals rnlp callback_args freeze_paramscCs`|d}ddlm}|jD] \}}||}|durq t||s(td|d||k|_q dS)Nstepr r zEAttempting to perform gradual unfreezing of a non-transformer pipe ('z.'. Only transformer pipes support this feature)pipeline.transformerr componentsget isinstance TypeErrorfrozen)rrr current_stepr namepipe unfreeze_steprrr'gradual_transformer_unfreezing_per_pipes    r%r$cCs>|d}ddlm}|jD]\}}t||sq ||k|_q dS)Nrr r )rr rrr )rrr$r!r _r#rrr(gradual_transformer_unfreezing_all_pipes-s   r' target_pipescCsP|d}|durt|dkrtd|durtt|dStt|t|dS)aConstruct a callback that can be used to gradually unfreeze the weights of one or more Transformer components during training. This can be used to prevent catastrophic forgetting during fine-tuning. target_pipes (Dict[str, int]): A dictionary whose keys and values correspond to the names of Transformer components and the training step at which they should be unfrozen respectively. *Nr zThe target pipe names for gradual transformer unfreezing contain both the wild-card operator ('*') and individual names. Use either of the two but not both)r$)rlast_unfreeze_step)rlen ValueErrorrr'r%maxvalues)r(unfreeze_step_all_pipesrrr%create_gradual_transformer_unfreezing<s  r0)r functoolsrtypingrrrrrthincspacy.languagerrr registrycreateboolrstrintr%r'r0rrrrs: