o 8wi@s\UdZddlmZddlmZddlmZmZmZm Z ddl Z ddl m Z ddl m Z ddlmZdd lmZer=ddlZd Zd d d ede fddZeee je jdfeee je jdfeee je jdfgZeeeeeege ffed<erddlZeej efGdddeZ!ded edefddZ"ded edefddZ#dedefddZ$dS)zUtilities used for collections.)ABC)partial) TYPE_CHECKINGAnyCallableUnionN)apply_to_collection)Tensor)_NUMPY_AVAILABLE)_DEVICE)cpumpsvaluez np.ndarraydevicereturncCst||S)N)torch from_numpyto)rrrb/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/lightning_fabric/utilities/apply_func.py _from_numpy!sr)dtypeCONVERSION_DTYPESc@s.eZdZdZededeeeffddZdS)_TransferableDataTypea"A custom type for data that can be moved to a torch device via ``.to(...)``. Example: >>> isinstance(dict, _TransferableDataType) False >>> isinstance(torch.rand(2, 3), _TransferableDataType) True >>> class CustomObject: ... def __init__(self): ... self.x = torch.rand(2, 2) ... def to(self, device): ... self.x = self.x.to(device) ... return self >>> isinstance(CustomObject(), _TransferableDataType) True subclassrcCs |turt|dd}t|StS)Nr)rgetattrcallableNotImplemented)clsrrrrr__subclasshook__Fs z&_TransferableDataType.__subclasshook__N) __name__ __module__ __qualname____doc__ classmethodrrboolrrrrrr2s rbatchcs8ttr tdtdtffdd }t|t|dS)akTransfers a collection of data to the given device. Any object that defines a method ``to(device)`` will be moved and all other objects in the collection will be left untouched. Args: batch: A tensor or collection of tensors or anything that has a method ``.to(...)``. See :func:`apply_to_collection` for a list of supported collection types. device: The device to which the data should be moved Return: the same collection but with all contained tensors residing on the new device. See Also: - :meth:`torch.Tensor.to` - :class:`torch.device` datarcsNi}t|trttjrjtvrd|d<|jfi|}|dur%|S|S)NT non_blocking) isinstancer rrtype_BLOCKING_DEVICE_TYPESr)r'kwargs data_outputrrrbatch_tobs z%move_data_to_device..batch_to)rfunction)r)strrrrrr)r&rr/rr.rmove_data_to_deviceNs   r2r'cCs(tD] \}}t||||d}qt||S)Nr.)rrr2)r'r src_dtypeconversion_funcrrrconvert_to_tensorsqs  r5cCs(dtdttttffdd}t|t|S)zRecursively walk through a collection and convert single-item tensors to scalar values. Raises: ValueError: If tensors inside ``metrics`` contains multiple elements, hence preventing conversion to a scalar. rrcSs$|dkrtd|d|S)Nz The metric `zM` does not contain a single element, thus it cannot be converted to a scalar.)numel ValueErroritem)rrrrto_items  z+convert_tensors_to_scalars..to_item)r rintfloatr%r)r'r:rrrconvert_tensors_to_scalarsxs r=)%r#abcr functoolsrtypingrrrrr#lightning_utilities.core.apply_funcrr "lightning_fabric.utilities.importsr lightning_fabric.utilities.typesr numpynpr+rr%tensoruint8r;r<rlisttuple__annotations__appendndarrayrr2r5r=rrrrs0      $#