o zi @s(ddlZddlZddlZddlmZddlmZddlmZm Z m Z m Z ddl Z ddl mZddlmZmZmZmZeeZdZdZd!d e ed ed ed efddZd"ddZd#dede ed dfddZdedededed e ef ddZd$ded e eeffddZ de eefd dfdd Z!dS)%N)getstate)setstate)AnyDictListOptional)_NUMPY_AVAILABLE) _get_rankrank_prefixed_messagerank_zero_onlyrank_zero_warnFTseedworkersverbosereturncCs|dur6tjd}|durd}td|n'zt|}Wn ty5d}tdt|d|Yn wt|ts?t|}t|krIt ksXnt|dtdt d}|rft t d |t t|tjd<t|tr~ddl}|j|t|t|tjd <|S) aFunction that sets the seed for pseudo-random number generators in: torch, numpy, and Python's random module. In addition, sets the following environment variables: - ``PL_GLOBAL_SEED``: will be passed to spawned subprocesses (e.g. ddp_spawn backend). - ``PL_SEED_WORKERS``: (optional) is set to 1 if ``workers=True``. Args: seed: the integer value seed for global random state in Lightning. If ``None``, it will read the seed from ``PL_GLOBAL_SEED`` env variable. If ``None`` and the ``PL_GLOBAL_SEED`` env variable is not set, then the seed defaults to 0. workers: if set to ``True``, will properly configure all dataloaders passed to the Trainer with a ``worker_init_fn``. If the user already provides such a function for their dataloaders, setting this argument will have no influence. See also: :func:`~lightning_fabric.utilities.seed.pl_worker_init_function`. verbose: Whether to print a message on each rank with the seed being set. NPL_GLOBAL_SEEDrzNo seed found, seed set to zInvalid seed found: z, seed set to z& is not in bounds, numpy accepts from z to z Seed set to PL_SEED_WORKERS)osenvirongetr int ValueErrorrepr isinstancemin_seed_valuemax_seed_valueloginfor r strrandomrrnumpytorch manual_seed)rrrenv_seednpr&S/home/ubuntu/.local/lib/python3.10/site-packages/lightning_fabric/utilities/seed.pyseed_everythings4       r(cCsFtjdd}|dur dStjdd}tt|tt|dddS)zReset the seed to the value that :func:`~lightning_fabric.utilities.seed.seed_everything` previously set. If :func:`~lightning_fabric.utilities.seed.seed_everything` is unused, this function will do nothing. rNr0F)rr)rrrr(rbool)rrr&r&r' reset_seedHs r+ worker_idrankcCs|dur|ntj}t}||}td|d|d|t|||dd}t|dt |dd >|d Bt rMddl }|j |d d @dSdS) a.The worker_init_fn that Lightning automatically adds to your dataloader if you previously set the seed with ``seed_everything(seed, workers=True)``. See also the PyTorch documentation on `randomness in DataLoaders `_. Nz1Initializing random number generators of process z worker z with base seed )countr r ) r r-r" initial_seedrdebug_generate_seed_sequencer#r rrr!)r,r- global_rank process_seed base_seed seed_sequencer%r&r&r'pl_worker_init_functionUs r;r9r7r/cCsD|d>|d>B|B}g}t|D]}|ddd@}||q|S)zGenerates a sequence of seeds from a base seed, worker id and rank using the linear congruential generator (LCG) algorithm.r1l-*PBr0l)rangeappend)r9r,r7r/ combined_seedseeds_r&r&r'r6ns   r6 include_cudacCsNttd}trddl}|j|d<|r%tjr!tj ng|d<|S)z\Collect the global random state of :mod:`torch`, :mod:`torch.cuda`, :mod:`numpy` and Python.)r"pythonrNr! torch.cuda) r" get_rng_statepython_get_rng_staterr!r get_statecuda is_availableget_rng_state_all)rBstatesr%r&r&r'_collect_rng_states{srLrng_state_dictcCsnt|dd|vrtj|dtr%d|vr%ddl}|j|d|d\}}}t|t ||fdS)zsSet the global random state of :mod:`torch`, :mod:`torch.cuda`, :mod:`numpy` and Python in the current process.r"rDr!rNrC) r" set_rng_staterHset_rng_state_allrr!r set_statepython_set_rng_statetuple)rMr%versionstategaussr&r&r'_set_rng_statess rV)NFT)rN)N)T)"loggingrr rrFrrQtypingrrrrr""lightning_fabric.utilities.importsr$lightning_fabric.utilities.rank_zeror r r r getLogger__name__rrrrr*r(r+r;r6rrLrVr&r&r&r's$      4 "