o $i@sddlmZddlmZmZmZddlZddlm Z m Z ddl m Z e \Z Ze \ZZZe ddZe dd Ze d eeeefd eefd d ZdS))deque)AnyListUnionN) try_import_tftry_import_torch) DeveloperAPIcCs<tr t|r t|Strt|rtj|St|S)zCheck if a value is NaN. Args: value: The value to check. Returns: True if the value is NaN, False otherwise. )torch is_tensorisnantfmathis_nannpvaluer`/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/ray/rllib/utils/metrics/stats/utils.py safe_isnan s    rcCs:trt|tjr|Strt|r|S|S)zConvert a single value to CPU if it's a tensor. TensorFlow tensors are always converted to numpy/python values. PyTorch tensors are converted to python scalars. ) r isinstanceTensordetachcpuitemr r numpyrrrrsingle_value_to_cpus rvaluesreturncCsF|sgStrt|dtjrtt|}|}|St|S)aConvert a list or deque of GPU tensors to CPU scalars in a single operation. This function efficiently processes multiple PyTorch GPU tensors together by stacking them and performing a single .cpu() call. Assumes all values are either PyTorch tensors (on same device) or already CPU values. Args: values: A list or deque of values that may be GPU tensors. Returns: A list of CPU scalar values. r)r rrstacklistrrtolist)rstacked cpu_tensorrrrbatch_values_to_cpu,s r#) collectionsrtypingrrrrrray.rllib.utils.frameworkrrray.util.annotationsrr _r rrr#rrrrs       (