o پi@shddlmZmZddlmZddlZddlmZddlmZm Z ddl m Z eddGdd d Z dS) )TupleOptional) dataclassN)Int32 const_expr) SeqlenInfoQKT)frozenc@s(eZdZUejeed<ejeed<ejeed<dZejeed<dZ ejeed<dZ e e ed<dZ e e ed <d Zejeed <ej dd ede dej dej dee e ff ddZejd ede dee e ffddZejd ede de de fddZejd ede de de fddZdS) BlockInfotile_mtile_n is_causalFis_local is_split_kvNwindow_size_leftwindow_size_rightqhead_per_kvhead_packgqar seqlen_infom_block split_idx num_splitsreturnc CsLt|j|j}t|jp|jo|jdurH|d|j}t|j dkr*t||j }||j|j }t|jr9|n||j}t |t||j}d} t|joR|j dur{||j} t|j dkre| |j } | |j|j }||j } t | |jd} t |jr|| krt dn || |d|} | || } t | | |}| |fS)Nrr)cuteceil_divseqlen_kr rr r rr rseqlen_qminrcutlassmaxrr) selfrrrr n_block_max m_idx_maxn_idx n_idx_right n_block_min m_idx_min n_idx_leftnum_n_blocks_per_splitr(U/home/ubuntu/.local/lib/python3.10/site-packages/flash_attn_origin/cute/block_info.pyget_n_block_min_maxs0      zBlockInfo.get_n_block_min_maxn_blockc Cst|j|j}d}t|jp|jo|jdur8||j}||j|j }t|jr+|n||j}t |||j}t|jo@|j dur`|d|j}||j|j }||j } t |t| |j}||fS)Nrr) rrrr rr r rr rrrr) rrr+ m_block_max m_block_min n_idx_minm_idx m_idx_right n_idx_max m_idx_leftr(r(r)get_m_block_min_max9s  zBlockInfo.get_m_block_min_maxr$cCsh||j}t|jdkr||j}||j|j}t|j p"|jdur&|n||j}t|||j S)zZIf we have separate iterations with causal or local masking at the start, where do we stoprN) r rrrrr rrrr )rrrr$r%r"r#r(r(r)!get_n_block_min_causal_local_maskIs  z+BlockInfo.get_n_block_min_causal_local_maskcCstt|j p |jdur |S|d|j}t|jdkr"t||j}||j|j}||j}t |t||j S)zhIf we have separate iterations with local masking at the end, where do we stop the non-masked iterationsNr) rr rr rrrrrrrr )rrrr$r!r"r&r(r(r)!get_n_block_min_before_local_mask\s z+BlockInfo.get_n_block_min_before_local_mask)rr)__name__ __module__ __qualname__r Constexprint__annotations__boolr rrrrrrrjitrrr*r3r4r5r(r(r(r)r sZ   !  r ) typingrr dataclassesrr cutlass.cuterrr"flash_attn_origin.cute.seqlen_inforr r(r(r(r)s