o ۾i@sUddlmZddlmZddlmZddlmZmZer)ddl m Z ddl m Z da edBed<d efd d Zd efd d ZddedBd efddZ d    dddZdddZdS)) TYPE_CHECKING)KVConnectorBaseType)KVConnectorFactory)KVConnectorBase_V1KVConnectorRole) VllmConfig) KVCacheConfigN_KV_CONNECTOR_AGENTreturncCstdusJdtS)NzAdisaggregated KV cache transfer parallel group is not initializedr r r b/home/ubuntu/.local/lib/python3.10/site-packages/vllm/distributed/kv_transfer/kv_transfer_state.pyget_kv_transfer_groups rcCstduSNr r r r r has_kv_transfer_groupsr connectorcCs"|durt}|dur dSt|tS)a\Check if the KV connector is the v1 connector. If the argument is None, it will check the global KV connector Args: connector: The KV connector to check. If None, it will check the global KV connector. Note: This function will no-longer be needed after the v1 KV connector becomes the default. NF)r isinstancer)rr r r is_v1_kv_transfer_groups   r vllm_configrkv_cache_configKVCacheConfig | NonecCs<|jdurdS|jjrtdurtj|tj|dadSdSdS)z6 Initialize KV cache transfer parallel group. N)configroler)kv_transfer_configis_kv_transfer_instancer rcreate_connectorrWORKER)rrr r r ensure_kv_transfer_initialized3s  rcCstdur tdadSdSr)r shutdownr r r r ensure_kv_transfer_shutdownJsrr)rrrrr N)r N)typingr.vllm.distributed.kv_transfer.kv_connector.baser1vllm.distributed.kv_transfer.kv_connector.factoryr,vllm.distributed.kv_transfer.kv_connector.v1rr vllm.configrvllm.v1.kv_cache_interfacerr __annotations__rboolrrrrr r r r s(