o ॵi@s.ddlmZddlZddlmZdddZdS))MappingN)ModelOutputBaseFcst|trtt|D] }t||||<q |St|ts#t|trIt|dr:|D] \}}t|||<q,|St |fdd|DSt|t t fr]t |fdd|DSt|t j rj|j|dS|S)aPut the data to the target cuda device just before the forward function. Args: batch: The batch data out of the dataloader. device: (str | torch.device): The target device for the data. Returns: The data to the target device. __setitem__csi|] \}}|t|qS to_device).0kvdevicerO/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/utils/data_utils.py szto_device..c3s|]}t|VqdS)Nr)rr r rr !szto_device..) non_blocking) isinstancerrangelenrdictrhasattritemstypetuplelisttorchTensorto)batchr ridxr r rr r r s&    r)F)collections.abcrrmodelscope.outputsrrrrrr s