o i@sXddlmZmZddlmZddlZddlmZddlm Z eddGdddZ dS) )TupleOptional) dataclassN) SeqlenInfoT)frozenc @seZdZUejeed<ejeed<ejeed<dZejeed<dZ e ej ed<dZ e ej ed<d Z ejeed <ejd ed ej d eej ej ffddZejd ed ej dej d ej fddZejd ed ej dej d ej fddZdS) BlockInfo m_block_size n_block_size is_causalFis_localNwindow_size_leftwindow_size_rightqhead_per_kvhead_packgqa seqlen_infom_blockreturnc Cst|j|j}t|jp|jo|jdurK|d|j }t|j dkr,t||j }||j|j }t|jr<|n||j}t |t||j}d}t|joV|j dur||j }t|j dkrj||j }||j|j }||j } t| |jd}||fS)Nrr)cuteceil_divseqlen_kr cutlass const_exprr r r rrseqlen_qminr max) selfrr n_block_max m_idx_maxn_idx n_idx_right n_block_min m_idx_min n_idx_leftr#P/home/ubuntu/vllm_env/lib/python3.10/site-packages/flash_attn/cute/block_info.pyget_n_block_min_maxs&   zBlockInfo.get_n_block_min_maxr cCsl||j}t|jdkr||j}||j|j}t|j p$|jdur(|n||j}t|||j S)zZIf we have separate iterations with causal or local masking at the start, where do we stoprN) rrrrrrr r rr )rrrr r!rrr#r#r$!get_n_block_min_causal_local_mask-s  z+BlockInfo.get_n_block_min_causal_local_maskcCsxt|j p |jdur|S|d|j}t|jdkr$t||j}||j|j }||j}t |t||j S)zhIf we have separate iterations with local masking at the end, where do we stop the non-masked iterationsNr) rrr r rrrrrrrr )rrrr rrr"r#r#r$!get_n_block_min_before_local_mask@s z+BlockInfo.get_n_block_min_before_local_mask)__name__ __module__ __qualname__r Constexprint__annotations__boolr r rInt32r rrjitrrr%r&r'r#r#r#r$r sH   r) typingrr dataclassesrr cutlass.cuterflash_attn.cute.seqlen_inforrr#r#r#r$s