o ۾i@sdZddlZddlmZddlmZddlmZddlm Z er,ddl m Z ddl m Z e eZGd d d Zed d d dS)z6Factory for weight transfer engines with lazy loading.N)Callable) TYPE_CHECKING)WeightTransferEngine) init_logger)ParallelConfig)WeightTransferConfigc @szeZdZUdZiZeeegee ffe d<e ddedeee BdedBddfdd Z e d d d d de fddZ dS)WeightTransferEngineFactorya[Factory for creating weight transfer engines with lazy loading. This factory implements a registry pattern that supports: - Lazy loading: Engine modules are only imported when actually needed - Extensibility: Custom engines can be registered at runtime - Centralized registration: All built-in engines registered in one place _registryNnamemodule_path_or_cls class_namereturncsx||jvr td|dt|tr/|durtddttffdd }||j|<dS|fdd |j|<dS) a{Register an engine with lazy-loading or direct class reference. Supports two calling conventions: 1. Lazy loading: register_engine(name, module_path, class_name) 2. Direct class: register_engine(name, engine_cls) Args: name: The name to register the engine under (e.g., "nccl") module_path_or_cls: Either a module path string for lazy loading, or the engine class directly class_name: Name of the engine class (required if module_path is string) Raises: ValueError: If an engine with the same name is already registered zWeight transfer engine 'z' is already registered.Nz8class_name is required when registering with module pathr cst}t|SN) importlib import_modulegetattr)module)r module_path\/home/ubuntu/.local/lib/python3.10/site-packages/vllm/distributed/weight_transfer/factory.pyloader?s  z;WeightTransferEngineFactory.register_engine..loadercsSrrr) engine_clsrrGsz=WeightTransferEngineFactory.register_engine..)r ValueError isinstancestrtyper)clsr r r rr)r rrrregister_engines  z+WeightTransferEngineFactory.register_engineconfigrparallel_configrcCsV|j}||jvrt|j}td|d||j|}td|j|||S)aiCreate a weight transfer engine instance. Args: config: Weight transfer configuration containing the backend name parallel_config: Parallel configuration for the engine Returns: An initialized weight transfer engine instance Raises: ValueError: If the backend is not registered z!Invalid weight transfer backend: z. Available engines: z#Creating weight transfer engine: %s)backendr listkeysrloggerinfo__name__)rrr r! availablerrrr create_engineIs   z)WeightTransferEngineFactory.create_enginer)r& __module__ __qualname____doc__r dictrrrr__annotations__ classmethodrr(rrrrrs,    *rncclz,vllm.distributed.weight_transfer.nccl_engineNCCLWeightTransferEngine)r+rcollections.abcrtypingr%vllm.distributed.weight_transfer.baser vllm.loggerrvllm.config.parallelrvllm.config.weight_transferrr&r$rrrrrrs       ]