o `۷i5 @sddlZddlZddlZddlZddlmZddlmZmZm Z m Z m Z m Z ddl ZddlZddlZddlmZddlmZddlmZddlmZddlmZd Zed efd d Zd ejdefddZ dedejfddZ!edej"j#defddZ$edej"j#defddZ%ededej"j#fddZ&ededej"j#fddZ'ede edeeeffd d!Z(ed"e e efdefd#d$Z)e %d*d&e ee fd'e*de e ee ffd(d)Z+dS)+N) OrderedDict)AnyDictOptionalSequenceTypeUnion) DeveloperAPI)NotSerializable)FlexDict)RepeatedSimplex__not_serializable__objcCst|trdd|DSt|trtdd|DSt|tr(dd|DSt|tjr2t|St|tjrsz6convert_numpy_to_python_primitives..css|]}t|VqdS)Nrrrrrr #sz5convert_numpy_to_python_primitives..cSg|]}t|qSrrrrrr %z6convert_numpy_to_python_primitives..) isinstancedictitemstuplelistnpintegerintfloatingfloatbool_boolstr_strndarraytolist enumerater)rretivrrrrs,        rarrayreturncCs.t}t||tt| dS)zPack numpy ndarray into Base64 encoded strings for serialization. This function uses numpy.save() instead of pickling to ensure compatibility. Args: array: numpy ndarray. Returns: b64 escaped string. ascii) ioBytesIOr$savebase64 b64encodezlibcompressgetvaluedecode)r3bufrrr_serialize_ndarray7s r@ b64_stringcCs tjttt|ddS)zUnpack b64 escaped string into numpy ndarray. This function assumes the unescaped bytes are of npy format. Args: b64_string: Base64 escaped string. Returns: numpy ndarray. T) allow_pickle)r$loadr6r7r; decompressr9 b64decode)rArrr_deserialize_ndarrayHs rFspacec Cs|durdSdtjjdtfdd}dtjjdtfdd}dtjjdtfdd }dtjjdtfd d }dtjjdtfd d }dtjjdtfdd}dtdtfdd}dt dtfdd}dt dtfdd} dddtfdd} t |tjjrw||St |tjjr||St |tjjr||St |tjjr||St |tjjr||St |tjjr||St |tjj r| |St |tr||St |t r||St |t r| |St dt|)zSerialize a gym Space into a JSON-serializable dict. Args: space: gym.spaces.Space Returns: Serialized JSON string. Nspr4cSs"dt|jt|j|j|jjdS)Nbox)rGlowhighshapedtype)r@rJrK_shaperMr,rHrrr_boxes zgym_space_to_dict.._boxcSs,dt|jd}t|drt|j|d<|S)NdiscreterGnstart)r&rShasattrrT)rHdrrr _discretens  z$gym_space_to_dict.._discretecSs d|jdS)N multi-binaryrR)rSrOrrr _multi_binaryxsz(gym_space_to_dict.._multi_binarycSsdt|j|jjdS)Nmulti-discrete)rGnvecrM)r@r[rMr,rOrrr_multi_discrete~sz*gym_space_to_dict.._multi_discretecSsddd|jDdS)Nr"cSrrgym_space_to_dictrrHrrrrrz5gym_space_to_dict.._tuple..rGspacesrarOrrr_tuplesz!gym_space_to_dict.._tuplecSsddd|jDdS)Nr cSrrr]rkrHrrrrz4gym_space_to_dict.._dict..r`)rar!rOrrr_dictsz gym_space_to_dict.._dictcSsd|j|j|jjdS)Nsimplex)rGrL concentrationrM)rNrirMr,rOrrr_simplexs z#gym_space_to_dict.._simplexcSsdt|j|jdS)Nrepeated)rG child_spacemax_len)r^rlrmrOrrr _repeatedsz$gym_space_to_dict.._repeatedcSs(ddi}|jD] \}}t|||<q|S)NrG flex_dict)rar^)rHrVresrrr _flex_dicts z%gym_space_to_dict.._flex_dictgym.spaces.TextcSsBt|dd}|durt|dd}|durtdd|j|j|dS)N character_setcharsetz9Text space must have a character_set or charset attributetext)rG min_length max_lengthrt)getattr ValueErrorrvrw)rHrtrrr_texts  z gym_space_to_dict.._textz&Unknown space type for serialization, )gymraBoxrDiscrete MultiBinary MultiDiscreteTuplerr r rTextrytype) rGrPrWrYr\rcrgrjrnrqrzrrrr^XsB      r^cCs(dt|i}d|jvrt|j|d<|SNrGoriginal_space)r^__dict__ space_to_dictr)rGrVrrrrs  rrVc s>|durdSdtfdddtdtjjffdd }dtdtjjffdd }dtdtjjffd d }dtdtjjffd d }dtdtjjfdd}dtdtjjfdd}dtdtffdd }dtdtfdd}dtdt fdd} dtddffdd } ||||||||| | d } |d} | | vrt d| | | |S)zDe-serialize a dict into gym Space. Args: str: serialized JSON str. Returns: De-serialized gym space. NrVcSs,|}|d=d|vrt|d|d<|S)z?Common updates to the dict before we use it to construct spacesrGrM)copyr$rMrVr0rrr__commons z%gym_space_from_dict..__commonr4cs>|}|t|dt|ddtjjdi|S)NrJrK)rJrKr)rupdaterFr{rar|rrrrrPs  z!gym_space_from_dict.._boxctjjdi|SNr)r{rar}rVrrrrWz&gym_space_from_dict.._discretecrr)r{rar~rrrrrYrz*gym_space_from_dict.._multi_binarycs4|}|dt|ditjjdi|S)Nr[r)rrrFr{rarrrrrr\s  z,gym_space_from_dict.._multi_discretecSs dd|dD}tjj|dS)NcSrrgym_space_from_dictr_rrrrrz7gym_space_from_dict.._tuple..rarb)r{rarrVrarrrrcsz#gym_space_from_dict.._tuplecSs(tdd|dD}tjj|dS)NcSrrrrdrrrrrfz6gym_space_from_dict.._dict..rarb)rr!r{rarrrrrrg s z"gym_space_from_dict.._dictcstdi|Srr rrrrrjsz%gym_space_from_dict.._simplexcSst|d}t||ddS)Nrlrm)rlrm)rr )rVrlrrrrns z&gym_space_from_dict.._repeatedcSsdd|D}t|dS)NcSs"i|] \}}|dkr|t|qS)rGr)rrerprrrr!s"z;gym_space_from_dict.._flex_dict..rb)r!r rrrrrq s z'gym_space_from_dict.._flex_dictrrcrr)r{rarrrrrrz$rz"gym_space_from_dict.._text) rIrQrXrZr"r rhrkrorurGz)Unknown space type for de-serialization, ) rr{rar|r}r~rrr r ry) rVrPrWrYr\rcrgrjrnrqrz space_map space_typerrrrs8      rcCsZt|d}d|vr+d|dvsJt|ddtr$t|d|_|St|d|_|Sr)rrr,rspace_from_dict)rVrGrrrr;s rargskwargsc Cs|D]"}z tt|Wqty$}z td|d|d}~ww|D]'\}}z tt|Wq)tyP}z td|d|d|d}~wwdS)a Check if parameters to a function are serializable by ray. Args: args: arguments to be checked. kwargs: keyword arguments to be checked. Raises: NoteSerializable if either args are kwargs are not serializable by ray. zVRLModule constructor arguments must be serializable. Found non-serializable argument: z . Original serialization error: Nz^RLModule constructor arguments must be serializable. Found non-serializable keyword argument: z = )raygetput TypeErrorr r!)rrargerer2rrr!check_if_args_kwargs_serializableJs: rtype_cCst|tr|S|jd|jS)zConverts a type into its full classpath ([module file] + "." + [class name]). Args: type_: The type to convert. Returns: The full classpath of the given type, e.g. "ray.rllib.algorithms.ppo.PPOConfig". .)rr, __module__ __qualname__)rrrrserialize_typens rFmoduleerrorc Cst|tr|St|trBz|dd\}}t|}t||WSttt t fyA}z|r6t d|d|WYd}~|Sd}~wwt d|d)aVResolves a class path to a class. If the given module is already a class, it is returned as is. If the given module is a string, it is imported and the class is returned. Args: module: The classpath (str) or type to resolve. error: Whether to throw a ValueError if `module` could not be resolved into a class. If False and `module` is not resolvable, returns None. Returns: The resolved class or `module` (if `error` is False and no resolution possible). Raises: ValueError: If `error` is True and `module` cannot be resolved. rz2Could not deserialize the given classpath `module=z` into a valid python class! Make sure you have all necessary pip packages installed and all custom modules are in your `PYTHONPATH` env variable.Nz `module` (z$ must be type or string (classpath)!) rrr,rsplit importlib import_modulerxModuleNotFoundError ImportErrorAttributeErrorry)rr module_path class_namerrrrdeserialize_types&        r)F),r9rr6r; collectionsrtypingrrrrrr gymnasiumr{numpyr$rray.rllib.utils.annotationsr ray.rllib.utils.errorr ray.rllib.utils.spaces.flexdictr ray.rllib.utils.spaces.repeatedr ray.rllib.utils.spaces.simplexrNOT_SERIALIZABLErr-r,r@rFraSpacer^rrrrrr*rrrrrsP       !wb #