o ci @s|ddlZddlZddlmZmZddlmZddlmZddl m Z m Z er,ddl m Z eeZGdddeejd ZdS) N)Any TYPE_CHECKING)FaultAwareApply) MetricsLogger) DeviceType TensorType)AlgorithmConfigcseZdZdfdd ZejddZejddZejd efd d Z ejd efd d Z ejdddZ e ejd e fddZejdddZejdddZejd efddZZS)Runnerconfigrc sF|d|_|jdd|_||d|_t|_t dS)zInitializes a `Runner` instance. Args: config: The `AlgorithmConfig` to use to setup this `Runner`. **kwargs: Forward compatibility `kwargs`. worker_indexF) copy_frozenrN) getr copyr set_device make_module_weights_seq_normetricssuper__init__)selfr kwargs __class__R/home/ubuntu/.local/lib/python3.10/site-packages/ray/rllib/utils/runners/runner.pyrs zRunner.__init__cCdS)aDChecks that self.__init__() has been completed properly. Useful in case an `Runner` is run as @ray.remote (Actor) and the owner would like to make sure the Ray Actor has been properly initialized. Raises: AssertionError: If the `Runner` Actor has NOT been properly initialized. Nrrrrrassert_healthy&zRunner.assert_healthycCr)a*Creates the `RLModule` for this `Runner` and assigns it to `self.module`. Note that users should be able to change the `Runner`'s config (e.g. change `self.config.rl_module_spec`) and then call this method to create a new `RLModule` with the updated configuration. Nrrrrrr1szRunner.make_modulereturncKr)zRuns the `Runner`. The exact logic of this method could have very different forms. Args: **kwargs: Forward compatibility kwargs. Returns: Anything. Nr)rrrrrrun;rz Runner.runcCr)z|Returns metrics (in any form) of the logic run in this `Runner`. Returns: Metrics of any form. Nrrrrr get_metricsHrzRunner.get_metricsNcCr)zReleases all resources used by this `Runner`. For example, when using a `gym.Env` in this `Runner`, you should make sure that its `close()` method is called. NrrrrrstopPrz Runner.stopcCr)z$Returns the device of this `Runner`.Nrrrrr_deviceXszRunner._devicecCr)z"Sets the device for this `Runner`.Nrrrrrr^szRunner.set_devicecCr)z:If this Actor is deleted, clears all resources used by it.Nrrrrr__del__crzRunner.__del__cCr)z0Converts structs to a framework-specific tensor.Nr)rstructrrr_convert_to_tensorgrzRunner._convert_to_tensor)r r)rN)__name__ __module__ __qualname__rabcabstractmethodrrrr r!r"propertyrr#rr$rr& __classcell__rrrrr s*       r ) metaclass)r*loggingtypingrrray.rllib.utils.actor_managerr&ray.rllib.utils.metrics.metrics_loggerrray.rllib.utils.typingrr%ray.rllib.algorithms.algorithm_configr getLoggerr'loggerABCMetar rrrrs