o `۷ib*@sdZddlZddlmZmZddlZddlZddl Z ddl m Z ddl m Z mZddlmZddlmZer9sz1check_multiagent_environments..z&get_action_space(agent_id=..).sample()z6In particular, the `step()` method seems to be faulty.zstep, next_obsz step, rewardz step, donezstep, truncatedz step, infoT) allow_common dummy_env_id)base_env agent_ids) ray.rllib.envr isinstance ValueErrorhasattrrloggerwarningreset Exceptionrformat"_check_if_element_multi_agent_dictkeysstep _check_rewardagents_check_done_and_truncated _check_info) r r obs_and_infose reset_obs reset_infossampled_actionresultsnext_obsrewarddone truncatedinforrrcheck_multiagent_environmentssx         r;FcCs|rO|D]F\}}|D]=\}}t|r,t|ts,t|s:t|tjr,|jdks:d|dt|}t |||vsK|dksKd|}t |qqdSt|rit|tsit|stt|tjri|jdksvd t|}t |dSdS)NrzJYour step function must return rewards that are integer or float. reward: z. Instead it was a __all__zrYour reward dictionary must have agent ids that belong to the environment. AgentIDs received from env.agents are: zUYour step function must return a reward that is integer or float. Instead it was a {}) itemsnpisrealr!boolisscalarndarrayshapetyper"r()r7rr_multi_agent_dictagent_idrewerrorrrrr,YsV     r,c CsdD]]}|dkr |n|}|rI|D]5\}}|D],\}} t| ttjfs2td|dt|||vsF|dksFd|d|} t| qqqt|ttjfs_d|d t|} t| qdS) N)r8r9r8z Your step function must return `z's` that are boolean. But instead was a r<zYour `zis` dictionary must have agent ids that belong to the environment. AgentIDs received from env.agents are: z"Your step function must return a `z'` that is a boolean. But instead was a )r=r!r@r>bool_r"rD) r8r9rrwhatdatarErFrGdone_rIrrrr.s8r.cCs|r<|D]3\}}|D]*\}}t|ts#tdt|d|||vs8|dks8|dks8d|}t|qqdSt|tsOdt|d|}t|dS)NzDYour step function must return infos that are a dict. instead was a z : element: r< __common__zqYour dones dictionary must have agent ids that belong to the environment. AgentIDs received from env.agents are: zDYour step function must return a info that is a dict. element type: z . element: )r=r!dictr"rD)r:rrrErFrGinfrIrrrr/s>  r/c Cs.d|d|d|d|d|d|d }|S)NzThe z collected from z% was not contained within your env's z@ space. Its possible that there was a typemismatch (for example z)s of np.float32 and a space ofnp.float64 zs), or that one of the sub-zs wasout of boundsr) func_name_type_errorrrr_not_contained_errorsrTcst|ts#|rd|dt|}t|d|dt|}t|t|jd|r4dtfdd|Dsj|rUd|dt| d |j}t|d|d t| d |jd }t|dS) NzThe element returned by zJ contains values that are not MultiAgentDicts. Instead, they are of type: z3 is not a MultiAgentDict. Instead, it is of type: r<rNc3s|]}|vVqdSNr)rkrrr sz5_check_if_element_multi_agent_dict..z_ has agent_ids that are not the names of the agents in the env.agent_ids in this MultiEnvDict: z AgentIDs in this env: zb has agent_ids that are not the names of the agents in the env. AgentIDs in this MultiAgentDict: z. You likely need to add the attribute `agents` to your env, which is a list containing the IDs of agents currently in your env/episode, as well as, `possible_agents`, which is a list of all possible agents that could ever show up in your env.) r!rOrDr"setr-addalllistr*)r elementfunction_stringrrrIrrWrr)sB        r)c Cst|tjjtjjfsd||j|t|fSt|}dd}z t |||WdSt yZ}z'|j dd|j dd}}d |j dd||j|t|fWYd}~Sd}~ww) aCReturns error, value, and space when offending `space.contains(value)` fails. Returns only the offending sub-value/sub-space in case `space` is a complex Tuple or Dict space. Args: space: The gym.Space to check. value: The actual (numpy) value to check for matching `space`. Returns: Tuple consisting of 1) key-sequence of the offending sub-space or the empty string if `space` is not complex (Tuple or Dict), 2) the offending sub-space, 3) the offending sub-space's dtype, 4) the offending sub-value, 5) the offending sub-value's dtype. .. testcode:: :skipif: True path, space, space_dtype, value, value_dtype = _find_offending_sub_space( gym.spaces.Dict({ -2.0, 1.5, (2, ), np.int8), np.array([-1.5, 3.0]) ) NcSs||s t|||fdSrU)containsr)psvrrrmap_fns z)_find_offending_sub_space..map_fnrz->)NNNNN) r!gymspacesDictTupledtype _get_typertreemap_structure_with_pathrargsjoin)spacevaluestructured_spacercr1rrr_find_offending_sub_spaces0rscCst|dr|jSt|S)Nrj)r#rjrD)varrrrrksrk)r r r N)FN)FF) __doc__loggingtypingrr gymnasiumrfnumpyr>rlray.rllib.utils.annotationsrray.rllib.utils.errorrr"ray.rllib.utils.spaces.space_utilsrray.utilrr r getLogger__name__r$r;r,r.r/rTr)rsrkrrrrs0       D (  1 ,