o `Û·i³ã@sœddlmZddlmZmZmZddlZddlm Z m Z ddl m Z e ƒ\Z Ze ƒ\ZZZe dd„ƒZe dd „ƒZe d eeeefd eefd d „ƒZdS)é)Údeque)ÚAnyÚListÚUnionN)Ú try_import_tfÚtry_import_torch)Ú DeveloperAPIcCs<tr t |¡r t |¡Strt |¡rtj |¡St |¡S)zŒCheck if a value is NaN. Args: value: The value to check. Returns: True if the value is NaN, False otherwise. )ÚtorchÚ is_tensorÚisnanÚtfÚmathÚis_nanÚnp©Úvalue©rúY/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/rllib/utils/metrics/stats/utils.pyÚ safe_isnan s    rcCs:trt|tjƒr| ¡ ¡ ¡Strt |¡r| ¡S|S)z®Convert a single value to CPU if it's a tensor. TensorFlow tensors are always converted to numpy/python values. PyTorch tensors are converted to python scalars. ) r Ú isinstanceÚTensorÚdetachÚcpuÚitemr r ÚnumpyrrrrÚsingle_value_to_cpus rÚvaluesÚreturncCsF|sgStrt|dtjƒrt t|ƒ¡}| ¡ ¡}| ¡St|ƒS)aµConvert a list or deque of GPU tensors to CPU scalars in a single operation. This function efficiently processes multiple PyTorch GPU tensors together by stacking them and performing a single .cpu() call. Assumes all values are either PyTorch tensors (on same device) or already CPU values. Args: values: A list or deque of values that may be GPU tensors. Returns: A list of CPU scalar values. r)r rrÚstackÚlistrrÚtolist)rÚstackedÚ cpu_tensorrrrÚbatch_values_to_cpu,s r#)Ú collectionsrÚtypingrrrrrÚray.rllib.utils.frameworkrrÚray.util.annotationsrr Ú_r rrr#rrrrÚs       (