o ziU@s<ddlmZmZmZmZmZddlmZGdddeZ dS))AnyCallableDictListOptional)overridec @seZdZdZ   ddedeedeededed ef d d Z e dded eed efd dZ ded dfddZ d e fddZd efddZdS)_StrategyRegistrya>This class is a Registry that stores information about the Training Strategies. The Strategies are mapped to strings. These strings are names that identify a strategy, e.g., "deepspeed". It also returns Optional description and parameters to initialize the Strategy, which were defined durng the registration. The motivation for having a StrategyRegistry is to make it convenient for the Users to try different Strategies by passing just strings to the strategy flag to the Trainer. Example:: @StrategyRegistry.register("lightning", description="Super fast", a=1, b=True) class LightningStrategy: def __init__(self, a, b): ... or StrategyRegistry.register("lightning", LightningStrategy, description="Super fast", a=1, b=True) NFnamestrategy descriptionr init_paramsreturnc sdusttstdvr|stddi|dur&|ndd<|d<dtd tffd d }|durC||S|S) aRegisters a strategy mapped to a name and with required metadata. Args: name : the name that identifies a strategy, e.g. "deepspeed_stage_3" strategy : strategy class description : strategy description override : overrides the registered strategy, if True init_params: parameters to initialize the strategy Nz`name` must be a str, found 'z@' is already present in the registry. HINT: Use `override=True`.r r r r cs|d<d<<|S)Nr strategy_name)r datar selfrX/home/ubuntu/.local/lib/python3.10/site-packages/lightning_fabric/strategies/registry.py do_registerIsz/_StrategyRegistry.register..do_register) isinstancestr TypeError ValueErrorr)rr r r rr rrrrregister,s z_StrategyRegistry.registerdefaultcCs\||vr||}|ddi|dS|dur|Sd}dt|p%d}t|||)zCalls the registered strategy with the required parameters and returns the strategy object. Args: name (str): the name that identifies a strategy, e.g. "deepspeed_stage_3" r r Nz/'{}' not found in registry. Available names: {}, noner)joinsortedkeysKeyErrorformat)rr rrerr_msgavailable_namesrrrgetTsz_StrategyRegistry.getcCs||dS)z(Removes the registered strategy by name.N)pop)rr rrrremovegsz_StrategyRegistry.removecCs t|S)z(Returns a list of registered strategies.)listr!rrrravailable_strategiesks z&_StrategyRegistry.available_strategiescCsdd|S)NzRegistered Strategies: {}r)r#rr!r*rrr__str__osz_StrategyRegistry.__str__)NNF)N)__name__ __module__ __qualname____doc__rrrboolrrrr&r(rr+r,rrrrrs. (rN) typingrrrrrtyping_extensionsrdictrrrrrs