o .ip@sVddlmZddlZddlmZGdddeeZGdddeZGdd d eZdS) )ABCN) LoadStoreSpecc@s0eZdZdZdeefddZdefddZdS) BlockIDsLoadStoreSpeczF Spec for loading/storing KV blocks from given block numbers. block_idscCstj|tjd|_dS)N)dtype)nparrayint64r)selfrr W/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/vllm/v1/kv_offload/mediums.py__init__szBlockIDsLoadStoreSpec.__init__returncCs t|jS)N)reprr)r r r r __repr__s zBlockIDsLoadStoreSpec.__repr__N) __name__ __module__ __qualname____doc__listintr strrr r r r r src@"eZdZdZedefddZdS)GPULoadStoreSpecz< Spec for loading/storing a KV block to GPU memory. rcCdS)NGPUr r r r r mediumzGPULoadStoreSpec.mediumNrrrr staticmethodrrr r r r rrc@r)CPULoadStoreSpecz< Spec for loading/storing a KV block to CPU memory. rcCr)NCPUr r r r r r%rzCPULoadStoreSpec.mediumNrr r r r r! r r!) abcrnumpyrvllm.v1.kv_offload.abstractrrrr!r r r r s