o iy @s6ddlZddlZddlZddlZdddZddZdS)NFcst|trfdd|DSt|r0t|ts0t|fddt|DSt|trKt|turKt|fdd|DSt|ttfrbt|fdd|DSt|t j rst t |St|t jr|S|S)z'Change the device of object recursivelyc s"i|] \}}|t|qS to_device.0kvcopydevicedtype non_blockingrT/home/ubuntu/.local/lib/python3.10/site-packages/espnet2/torch_utils/device_funcs.py szto_device..cg|] }t|qSrrrrr rr szto_device..crrrror rrrc3s |] }t|VqdSNrrr rr szto_device..) isinstancedictitems dataclasses is_dataclasstypeastupletuplelistnpndarrayrtorch from_numpyTensorto)datar r r r rr rrs*    rcs t|trfdd|DSt|tr(t|tur(t|fdd|DSt|tttfr=t|fdd|DSt|tjrKt t |St|t j r`| dkr[|d}|St|trot j|gt jd St|tr~t j|gt jd S|durdStt|d |S) aChange object to gatherable in torch.nn.DataParallel recursively The difference from to_device() is changing to torch.Tensor if float or int value is found. The restriction to the returned value in DataParallel: The object must be - torch.cuda.Tensor - 1 or more dimension. 0-dimension-tensor sends warning. or a list, tuple, dict. csi|] \}}|t|qSrforce_gatherablerr rrr2rz$force_gatherable..csg|]}t|qSrr(rr*rrr5sz$force_gatherable..c3s|]}t|VqdSrr(rr*rrr7sz#force_gatherable..rN)r r z& may not be gatherable by DataParallel)rrrrrr setr!r"r)r#r$r%dimr&floattensorintlongwarningswarn)r'r rr*rr)$s(       r))NNFF)rr1numpyr!r#rr)rrrrs