o `۷i @sddlZddlZddlmZmZmZddlmZddlm Z ddl m Z m Z er.ddl mZeeZGdddeejd ZdS) N) TYPE_CHECKINGAnyUnion)FaultAwareApply) MetricsLogger) DeviceType TensorType)AlgorithmConfigcseZdZdfdd ZejddZejddZejd efd d Z ejd efd d Z ejdddZ e ejd e edffddZejdddZejdddZejd efddZZS)Runnerconfigr c sN|d|_|jdd|_||d|_t|jdd|_ t dS)zInitializes a `Runner` instance. Args: config: The `AlgorithmConfig` to use to setup this `Runner`. **kwargs: Forward compatibility `kwargs`. worker_indexF) copy_frozenr)stats_cls_lookuprootN) getr copyr set_device make_module_weights_seq_norrmetricssuper__init__)selfr kwargs __class__T/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/rllib/utils/runners/runner.pyrs zRunner.__init__cCdS)aDChecks that self.__init__() has been completed properly. Useful in case an `Runner` is run as @ray.remote (Actor) and the owner would like to make sure the Ray Actor has been properly initialized. Raises: AssertionError: If the `Runner` Actor has NOT been properly initialized. Nrrrrrassert_healthy(zRunner.assert_healthycCr)a*Creates the `RLModule` for this `Runner` and assigns it to `self.module`. Note that users should be able to change the `Runner`'s config (e.g. change `self.config.rl_module_spec`) and then call this method to create a new `RLModule` with the updated configuration. Nrrrrrr3szRunner.make_modulereturncKr)zRuns the `Runner`. The exact logic of this method could have very different forms. Args: **kwargs: Forward compatibility kwargs. Returns: Anything. Nr)rrrrrrun=r!z Runner.runcCr)z|Returns metrics (in any form) of the logic run in this `Runner`. Returns: Metrics of any form. Nrrrrr get_metricsJr!zRunner.get_metricsNcCr)zReleases all resources used by this `Runner`. For example, when using a `gym.Env` in this `Runner`, you should make sure that its `close()` method is called. NrrrrrstopRr!z Runner.stopcCr)zHReturns the device of this `Runner`. None if framework is not supported.Nrrrrr_deviceZszRunner._devicecCr)z"Sets the device for this `Runner`.Nrrrrrr`szRunner.set_devicecCr)z:If this Actor is deleted, clears all resources used by it.Nrrrrr__del__er!zRunner.__del__cCr)z0Converts structs to a framework-specific tensor.Nr)rstructrrr_convert_to_tensorir!zRunner._convert_to_tensor)r r )r"N)__name__ __module__ __qualname__rabcabstractmethodr rrr#r$r%propertyrrr&rr'rr) __classcell__rrrrr s*       r ) metaclass)r-loggingtypingrrrray.rllib.utils.actor_managerr&ray.rllib.utils.metrics.metrics_loggerrray.rllib.utils.typingrr%ray.rllib.algorithms.algorithm_configr getLoggerr*loggerABCMetar rrrrs