o i @stddlmZddlmZddlZddlZddlmZ   d dejdeejdeejdeej d ejf d d Z dS) )Mapping)OptionalN)silu_and_mul_kernelxx_scaleo_scaledtypereturnc s|j\}|ddks J|d|p|j}tjf||jd}dtttfdtttfffdd }t ||| d||| d|d|d u|d ud |S) aSigmoid Linear Unit and Multiplication Computes `silu(x[:,:d]) * x[:, d:]`, where `d = x.shape[-1] // 2. If the scale of `x` is `x_scale`, the scale applied to the output is the square of that, as the sigmoid function ranges in (0, 1). Args: x: The input tensor, of shape `(b, 2 * d)`. x_scale: An optional scale which was applied to `x`. o_scale: The scale to apply to the output. dtype: The desired output dtype. Returns: The output activation, of shape `(b, d)`. r)rdevicemetar cst|dfS)N BLOCK_SIZE)tritoncdiv)r bdR/home/ubuntu/vllm_env/lib/python3.10/site-packages/flashinfer/triton/activation.pygrid)szsilu_and_mul..gridiN) o_ptro_stride o_scale_ptrx_ptrx_stride x_scale_ptrrr HAS_X_SCALE HAS_O_SCALE) shapertorchemptyr rstrinttuplerstride)rrrrno_dtypeorrrr silu_and_mul s&  ( r()NNN) collections.abcrtypingrrr$flashinfer.triton.kernels.activationrTensorrr(rrrrs&