o $i< @sddlZddlmZddlmZddlmZmZmZm Z m Z m Z ddl Z ddl mZddlmZmZmZddlmZddlmZdd lmZmZmZmZdd lmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&dd l'm(Z(m)Z)m*Z*m+Z+m,Z,dd l-m.Z.m/Z/m0Z0dd l1m2Z2m3Z3ed"ddZ4e d#de ede5de ee ffddZ6ed$dee7efdee7effddZ8ed%dee7efdee7effddZ9eGdddej:Z;ee6dd Z.new_baseN__name__ __module__ __qualname__r.r.U/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/ray/rllib/utils/__init__.pynew_base6r0c@r(r)r*r.r.r.r/r0;r1)listpop)basemixinsreversedr0r.r.r/ add_mixins-s  r7elementsto_tuplereturncCsDt}|durt}|dur|St|ttttfvr||S||gS)a; Makes sure `elements` is returned as a list, whether `elements` is a single item, already a list, or a tuple. Args: elements: The inputs as a single item, a list/tuple/deque of items, or None, to be converted to a list/tuple. If None, returns empty list/tuple. to_tuple: Whether to use tuple (instead of list). Returns: The provided item in a list of size 1, or the provided items as a list. If `elements` is None, returns an empty list. If `to_tuple` is True, returns a tuple instead of a list. TN)r2tupletypesetr)r8r9ctorr.r.r/ force_listCsr?/nestedcCs4i}t|D]\}}|tt|}|||<q|S)a  Flattens a nested dict into a flat dict with joined keys. Note, this is used for better serialization of nested dictionaries in `OfflinePreLearner.__call__` when called inside `ray.data.Dataset.map_batches`. Note, this is used to return a `Dict[str, numpy.ndarray] from the `__call__` method which is expected by Ray Data. Args: nested: A nested dictionary. sep: Separator to use when joining keys. Returns: A flat dictionary where each key is a path of keys in the nested dict. )treeflatten_with_pathjoinmapstr)rAsep env_stepsflatpathleafkeyr.r.r/ flatten_dictas  rMrIcCs^i}|D]&\}}||}|}|ddD]}||vr!i||<||}q|||d<q|S)a Reconstructs a nested dict from a flat dict with joined keys. Note, this is used for better deserialization ofr nested dictionaries in `Learner.update' calls in which a `ray.data.DataIterator` is used. Args: flat: A flat dictionary with keys that are paths joined by `sep`. sep: The separator used in the flat dictionary keys. Returns: A nested dictionary. N)itemssplit)rIrGrA compound_keyvaluekeyscurrentrLr.r.r/unflatten_dict~s  rUc@s(eZdZdZddZddZddZdS) NullContextManagerzNo-op context managercCdSNr.selfr.r.r/__init__zNullContextManager.__init__cCrWrXr.rYr.r.r/ __enter__r\zNullContextManager.__enter__cGrWrXr.)rZargsr.r.r/__exit__r\zNullContextManager.__exit__N)r+r,r-__doc__r[r]r_r.r.r.r/rVs  rVT)r9)#r7r#r$r%r&r rr? force_tuplerMrUrr'rr rrrrrrrrr rrrrr rrr!r"r r)F)NF)r@r)r@)> contextlib collectionsr functoolsrtypingrrrrrr rBray._common.deprecationr ray.rllib.utils.annotationsr r r ray.rllib.utils.filterrray.rllib.utils.filter_managerrray.rllib.utils.frameworkrrrrray.rllib.utils.numpyrrrrrrrrrrray.rllib.utils.schedulesrrr r!r"ray.rllib.utils.test_utilsr#r$r%ray.tune.utilsr&r'r7boolr?rFrMrUAbstractContextManagerrVra__all__r.r.r.r/sB      0    &&