o ß—¦i ã @sjUddlmZmZddlmZgZeeed<dedefdd„Zded ed eee e e e ffd d „Z d S)é)ÚListÚTuple)ÚChunkStorageMetadataÚ__all__Úshard1Úshard2cCsdt|jƒ}t|ƒD]&}|j||j||j|krdS|j||j||j|kr/dSq dS)zCheck if two shards overlap.FT)ÚlenÚoffsetsÚrangeÚsizes)rrÚndimsÚi©rúe/home/ubuntu/transcripts/venv/lib/python3.10/site-packages/torch/distributed/checkpoint/resharding.pyÚ"_check_shard_metadata_pair_overlap s  ÿrÚ saved_shardÚ current_shardÚreturnc Csˆg}tt|j|j|j|jƒƒD]2\}\}}}}t||||ƒ}|t||ƒ} ||kr2d} ||} n||} d} | || | | f¡q|S)a[ Return the overlapping region between saved_shard and current_shard. There returned list has the same number of elements as the tensor's dimension. For each element, we produce a tuple with the following contents: (dimension, `saved_shard` offset, `current_shard` offset, length) Offsets are relative to each shard. r)Ú enumerateÚzipr r ÚminÚmaxÚappend) rrÚnarrowsÚdimÚsaved_shard_offsetÚcurrent_shard_offsetÚsaved_shard_sizeÚcurrent_shard_sizeÚ min_range_endÚlengthÚoffset_for_saved_tensorÚoffset_for_current_tensorrrrÚ+_shards_get_overlap_region_wrt_saved_tensors8 üÿ û þ  ÿr#N) ÚtypingrrÚ%torch.distributed.checkpoint.metadatarrÚstrÚ__annotations__rÚintr#rrrrÚs ÿ ÿÿÿþ