o 闦iw@sddlmZmZmZmZmZmZmZmZm Z ddl m Z ddl Z ddl mZmZgdZe dedded efd d Zded efd d ZedeeeZe dde jdee ee jfded ee jdffddZe ddedee ee jfded eefddZdddZ ddeedfdeeeefdee ee jfded eeedfeeeefdfff ddZddede ee jfded efddZdS) ) AnyDictListOptionaloverloadSequenceTupleTypeVarUnion) deprecatedN)GatherScatter)scatterscatter_kwargsgatherzC`is_namedtuple` is deprecated, please use the python checks instead)categoryobjreturncCst|SN)_is_namedtuplerr^/home/ubuntu/transcripts/venv/lib/python3.10/site-packages/torch/nn/parallel/scatter_gather.py is_namedtuple srcCst|tot|dot|dS)N_asdict_fields) isinstancetuplehasattrrrrrrsrT.inputs target_gpusdimcCdSrrr r!r"rrrr rcCr#rrr$rrrr)r%c*fddz |}Wd|Sdw)zSlice tensors into approximately equal chunks and distributes them across given GPUs. Duplicates references to objects that are not tensors. csttjrtdStr fddttDSttr4t dkr4t ttStt rKt dkrKddttDStt rft dkrffddtt DSfddDS)Ncsg|]}t|qSrtype).0argsrrr <z0scatter..scatter_map..rcSsg|]}t|qSr)listr)irrrr+@csg|]}t|qSrr'r.rrrr+Br,csg|]}qSrrr)_rrrr+Cs) rtorchTensorr applyrzipmaprlenr-dictitemsrr" scatter_mapr!rrr<8s  zscatter..scatter_mapNr)r r!r"resrr;rr2s  kwargscCs|rt|||ng}|rt|||ng}t|t|kr/|ddtt|t|Dnt|t|krI|ddtt|t|Dt|t|fS)z+Scatter with support for kwargs dictionary.css|]}dVqdS)rNrr1rrr [ z!scatter_kwargs..css|]}iVqdSrrr1rrrr?_r@)rr8extendranger)r r>r!r"scattered_inputsscattered_kwargsrrrrQs   routputs target_devicecr&)aGather tensors from different GPUs on a specified device. This function is useful for gathering the results of a distributed computation. It takes a sequence of objects, one for each GPU, and returns a single object on the specified device. Args: outputs (Any): A sequence of objects (potentially tensors) to gather. target_device (Union[int, torch.device]): The device to gather the tensors to. Use 'cpu' for CPU to avoid a deprecation warning. dim (int, optional): The dimension along which to gather. Default: 0. Returns: Any: A gathered object (potentially tensor) on the specified device. csdttjrtjgRSdurdSttr.gather_map..z+All dicts must have the same number of keysc3s*|]fddDfVqdS)csg|]}|qSrrrGkrrr+r0z8gather..gather_map...Nr)r)) gather_maprErJrr?s() rr3r4r r5r9all ValueErrorr(r_maker7r6)rEr"rLrF)rIrErrLvs  zgather..gather_mapNr)rErFr"r=rrPrres  r).)r) typingrrrrrrrr r typing_extensionsr r3torch.nn.parallel._functionsr r __all__ FutureWarningboolrrr9r-rrr4intdevicerstrrrrrrrs`,    # " *