o ˜à·igã @sFddlmZddlmZddlmZeeƒZdZe  ¡r+ddl m Z ddl m Z mZnQe ¡rEddlmZddlmZej Z ej Z ejZn7e ¡r|z dd lm Z d ZWneygd ed ed efdd„Z Ynwd ed ed dfdd„ZddlmZej Z dded edBfdd„Zd efdd„Zd efdd„Zdd„Zd efdd„ZdS)é)ÚAny)Ú init_logger©Úcurrent_platformF)Úreshape_and_cache_flash)Úflash_attn_varlen_funcÚget_scheduler_metadata)Ú _custom_ops)Úxpu_ops)rTÚargsÚkwargsÚreturncOstdƒ‚)Nz\ROCm platform requires upstream flash-attn to be installed. Please install flash-attn first.)Ú ImportError©r r ©rúY/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/v1/attention/backends/fa_utils.pyr'sÿrNcOsdS)Nrrrrrr.srÚrequires_alibic Csddlm}| ¡r dS| ¡rdSziddlm}m}| ¡}|dus%J‚|jdkr0|dƒr0dnd}ddl m }|ƒ}|durI|j j durI|j j }|jdkrY|dkrYt  d ¡d}|rf|dkrft  d ¡d}||ƒsst  d |||ƒ¡||ƒsyJ‚|WSttfy‡YdSw) Nrré)Úfa_version_unsupported_reasonÚis_fa_version_supportedé é)Úget_current_vllm_config_or_noneé zJCannot use FA version 3 on Blackwell platform, defaulting to FA version 2.z?Cannot use FA version 3 with ALiBi, defaulting to FA version 2.z3Cannot use FA version %d is not supported due to %s)Úvllm.platformsrÚis_xpuÚis_rocmÚ)vllm.vllm_flash_attn.flash_attn_interfacerrÚget_device_capabilityÚmajorÚ vllm.configrÚattention_configÚflash_attn_versionÚloggerÚ warning_onceÚerrorrÚAssertionError)rrrrÚdevice_capabilityÚ fa_versionrÚ vllm_configrrrÚget_flash_attn_version7sJ  ÿ  ÿ ÿý ÿr*cCstƒdko t d¡S)NréZ)r*rÚis_device_capability_familyrrrrÚflash_attn_supports_fp8ts þr-cCst ¡rdStƒdkS)NTr)rrr*rrrrÚflash_attn_supports_sinks{s r.c CsRddlm}| ¡r'zddlm}|dƒo| d¡WSttfy&YdSwdS)Nrr)rrr+F)rrÚis_cudarrr,rr&)rrrrrÚflash_attn_supports_mla‚s  ÿþþr0cCs$t ¡st ¡r dSt ¡rtSdS)aÑCheck if flash_attn_varlen_func is available. This function determines whether the flash_attn_varlen_func imported at module level is a working implementation or a stub. Platform-specific sources: - CUDA: vllm.vllm_flash_attn.flash_attn_varlen_func - XPU: xpu_ops.flash_attn_varlen_func - ROCm: upstream flash_attn.flash_attn_varlen_func (if available) Note: This is separate from the AITER flash attention backend (rocm_aiter_fa.py) which uses rocm_aiter_ops.flash_attn_varlen_func. The condition to use AITER is handled separately via _aiter_ops.is_aiter_found_and_supported(). Returns: bool: True if a working flash_attn_varlen_func implementation is available. TF)rr/rrÚ_ROCM_FLASH_ATTN_AVAILABLErrrrÚ#is_flash_attn_varlen_func_available“s r2)F)ÚtypingrÚ vllm.loggerrrrÚ__name__r#r1r/Úvllm._custom_opsrÚvllm.vllm_flash_attnrrrÚvllmr ÚopsÚ vllm._xpu_opsr rÚ flash_attnrÚboolÚintr*r-r.r0r2rrrrÚs:        þ =