o _۷is@s<dZddlZddlmZejdejdejdefddZdS)z'MLX kernel for applying token bitmasks.Nbitmasklogits vocab_sizecCsdtjddtjtddggdD|jd}|tj}|dd|f||d dd|fS) aApply a token bitmask to logits using MLX for Metal GPUs. Args: bitmask: A tensor of shape (batch_size, (vocab_size + 31) // 32) containing the bitmask. Each bit in the bitmask determines whether the corresponding token is allowed (1) or not (0). logits: A tensor of shape (batch_size, vocab_size) containing the logits. Returns: The logits with -inf for tokens that are not allowed. cSsg|] }|dddqS)N).0lrr^/home/ubuntu/vllm_env/lib/python3.10/site-packages/xgrammar/kernels/apply_token_bitmask_mlx.py sz+apply_token_bitmask_mlx..z-infr)dtype.N) mxarray itertoolsproductfloatr viewuint8flatten)rrrbitmaprrr apply_token_bitmask_mlxs  $ *r) __doc__rmlx.corecorercompilerintrrrrr s