o i @sZdZddlZddlZddlZddlmZddlmZm Z m Z ddl m Z defdd Z dS) a3 Copyright (c) 2025 by FlashInfer team. Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. N)env)JitSpec gen_jit_specsm90a_nvcc_flags)write_if_differentreturnc Csjd}tj|}tj|ddg}ttjd}t|}Wdn1s)wYddg}|D]Z\}}t j ddgd d D]L\}} } } |d t |d t | d t | dt |  } d| d} || }| ||j |t|t| t| t| d}t||qAq4dD]} tj| }||j}| |t||qt||tddgdS)uGGenerate JIT module for GDN prefill kernel with separate compilation. This generates 32 separate kernel instantiation files (2 dtypes × 16 boolean combinations) plus the original launcher file. The separate files enable parallel compilation by ninja, significantly reducing build time on multi-core machines. gdn_prefill_sm90T)exist_okz"gdn_prefill_sm90_kernel_inst.jinjaN)halfr )bf16 nv_bfloat16F)repeat_gbaigdn_prefill_kernel_z.cu)dtypeis_gva needs_beta needs_alpha init_state)zgdn_prefill_launcher.cuz!prefill_kernel_delta_rule_sm90.cuz-DFLAT_SM90A_ENABLEDz -std=c++20)extra_cuda_cflags)jit_envFLASHINFER_GEN_SRC_DIRosmakedirsopenFLASHINFER_CSRC_DIRjinja2Templateread itertoolsproductintappendrenderstrlowerrname read_textrr)uri gen_directory source_pathsfkernel_inst_templdtypes dtype_namerrrrrsuffixfilename dest_pathsourcesrc_pathr9H/home/ubuntu/vllm_env/lib/python3.10/site-packages/flashinfer/jit/gdn.pygen_gdn_prefill_sm90_modulesF  0           r;)__doc__r$rr!rrcorerrrutilsrr;r9r9r9r:s