o áÙ·ic ã@sTddlmZddlZddlmZGdd„deƒZGdd„deƒZGdd „d eƒZdS) é)ÚEnumN)ÚPlatformc@s$eZdZdZdZdZdZdZdZdS)ÚOmniPlatformEnumz"Enum for supported Omni platforms.ÚcudaÚrocmÚnpuÚxpuÚ unspecifiedN) Ú__name__Ú __module__Ú __qualname__Ú__doc__ÚCUDAÚROCMÚNPUÚXPUÚ UNSPECIFIED©rrúQ/home/ubuntu/.local/lib/python3.10/site-packages/vllm_omni/platforms/interface.pyr src@s<eZdZUdZeed<defdd„Zdefdd„Zdefdd „Z defd d „Z e de fd d „ƒZ e de fdd„ƒZe de fdd„ƒZe de dBdede fdd„ƒZe defdd„ƒZe d'dedBdejfdd„ƒZe defdd„ƒZe de dBfdd„ƒZe d(d d!„ƒZe d'd"ejdBdefd#d$„ƒZe defd%d&„ƒZdS))Ú OmniPlatformzÖ Abstract base class for vllm-omni Platform. Inherits from vLLM's Platform and adds Omni-specific interfaces. This gives OmniPlatform all vLLM Platform capabilities plus Omni-specific methods. Ú _omni_enumÚreturncCó |jtjkS©N)rrr©ÚselfrrrÚis_npuó zOmniPlatform.is_npucCrr)rrrrrrrÚis_xpu"rzOmniPlatform.is_xpucCrr)rrrrrrrÚis_cuda%rzOmniPlatform.is_cudacCrr)rrrrrrrÚis_rocm(rzOmniPlatform.is_rocmcCót‚r©ÚNotImplementedError©ÚclsrrrÚget_omni_ar_worker_cls+óz#OmniPlatform.get_omni_ar_worker_clscCr!rr"r$rrrÚget_omni_generation_worker_cls/r'z+OmniPlatform.get_omni_generation_worker_clscCr!rr"r$rrrÚget_default_stage_config_path3r'z*OmniPlatform.get_default_stage_config_pathÚselected_backendNÚ head_sizecCr!)aGet the diffusion attention backend class path for this platform. This method selects the appropriate attention backend for diffusion models based on platform capabilities and user preferences. Args: selected_backend: User-selected backend name (e.g., "FLASH_ATTN", "TORCH_SDPA", "SAGE_ATTN"). If None, uses platform default. head_size: Attention head size. Returns: Fully qualified class path of the selected backend. r")r%r*r+rrrÚget_diffusion_attn_backend_cls7sz+OmniPlatform.get_diffusion_attn_backend_clscCr!)zCCheck if the platform supports torch.compile with inductor backend.r"r$rrrÚsupports_torch_inductorLsz$OmniPlatform.supports_torch_inductorÚ local_rankcCr!rr")r%r.rrrÚget_torch_deviceQr'zOmniPlatform.get_torch_devicecCr!rr"r$rrrÚget_device_countUr'zOmniPlatform.get_device_countcCr!rr"r$rrrÚget_device_versionYr'zOmniPlatform.get_device_versioncCr!rr"r$rrrÚ synchronize]r'zOmniPlatform.synchronizeÚdevicecCr!rr")r%r3rrrÚget_free_memoryar'zOmniPlatform.get_free_memorycCsdS)NTrr$rrrÚsupports_cpu_offloader'z!OmniPlatform.supports_cpu_offloadr)rN)r r r r rÚ__annotations__Úboolrrrr Ú classmethodÚstrr&r(r)Úintr,r-Útorchr3r/r0r1r2r4r5rrrrrsF þý ü rc@seZdZejZdZdS)ÚUnspecifiedOmniPlatformÚN)r r r rrrÚ device_typerrrrr<jsr<)Úenumrr;Úvllm.platformsrrrr<rrrrÚs   V