o oi@sdUdZddlmZddlmZddlmZmZmZm Z m Z m Z ddl Z ddl mZddl mZddlmZdd lmZerAddlZd Zd d d edefddZeee je jdfeee je jdfeee je jdfgZe e eeeegeffed<erddlZeej efGdddeZ!ded edefddZ"ded edefddZ#dedefddZ$dS)zUtilities used for collections.)ABC)partial) TYPE_CHECKINGAnyCallableListTupleUnionN)apply_to_collection)Tensor)_NUMPY_AVAILABLE)_DEVICE)cpumpsvaluez np.ndarraydevicereturncCst||S)N)torch from_numpyto)rrrY/home/ubuntu/.local/lib/python3.10/site-packages/lightning/fabric/utilities/apply_func.py _from_numpy!sr)dtypeCONVERSION_DTYPESc@s.eZdZdZededeeeffddZdS)_TransferableDataTypea"A custom type for data that can be moved to a torch device via ``.to(...)``. Example: >>> isinstance(dict, _TransferableDataType) False >>> isinstance(torch.rand(2, 3), _TransferableDataType) True >>> class CustomObject: ... def __init__(self): ... self.x = torch.rand(2, 2) ... def to(self, device): ... self.x = self.x.to(device) ... return self >>> isinstance(CustomObject(), _TransferableDataType) True subclassrcCs |turt|dd}t|StS)Nr)rgetattrcallableNotImplemented)clsrrrrr__subclasshook__Fs z&_TransferableDataType.__subclasshook__N) __name__ __module__ __qualname____doc__ classmethodrr boolr!rrrrr2s rbatchcs8ttr tdtdtffdd }t|t|dS)akTransfers a collection of data to the given device. Any object that defines a method ``to(device)`` will be moved and all other objects in the collection will be left untouched. Args: batch: A tensor or collection of tensors or anything that has a method ``.to(...)``. See :func:`apply_to_collection` for a list of supported collection types. device: The device to which the data should be moved Return: the same collection but with all contained tensors residing on the new device. See Also: - :meth:`torch.Tensor.to` - :class:`torch.device` datarcsNi}t|trttjrjtvrd|d<|jfi|}|dur%|S|S)NT non_blocking) isinstancer rrtype_BLOCKING_DEVICE_TYPESr)r)kwargs data_outputrrrbatch_tobs z%move_data_to_device..batch_to)rfunction)r+strrrrr r)r(rr1rr0rmove_data_to_deviceNs   r4r)cCs(tD] \}}t||||d}qt||S)Nr0)rr r4)r)r src_dtypeconversion_funcrrrconvert_to_tensorsqs  r7cCs(dtdttttffdd}t|t|S)zRecursively walk through a collection and convert single-item tensors to scalar values. Raises: ValueError: If tensors inside ``metrics`` contains multiple elements, hence preventing conversion to a scalar. rrcSs$|dkrtd|d|S)Nz The metric `zM` does not contain a single element, thus it cannot be converted to a scalar.)numel ValueErroritem)rrrrto_items  z+convert_tensors_to_scalars..to_item)r r intfloatr'r )r)r<rrrconvert_tensors_to_scalarsxs r?)%r%abcr functoolsrtypingrrrrrr r#lightning_utilities.core.apply_funcr r "lightning.fabric.utilities.importsr lightning.fabric.utilities.typesr numpynpr-rr'tensoruint8r=r>r__annotations__appendndarrayrr4r7r?rrrrs0       $#