o ۾i @sddlmZz ddlZddlZWn"ey2Zzdeevr dndZededededZ[wwde d ej fd d Z ej d d Z dej dej d dfddZdedej d dfddZdS))GuideNnumbanumpyz6To use the kernels in `outlines_core.kernels.numpy`, `z:` must be installed. You can install it with `pip install ` vocab_sizereturncCstjd|ddfdtjdS)N )dtype)npfullint32)rrO/home/ubuntu/.local/lib/python3.10/site-packages/outlines_core/kernels/numpy.pyallocate_token_bitmask s rc Cs|jd}d|}|jd|kr&tj |dd|df<|ddd|f}|j\}}t|D]4}t|D]-}|||f}|d} tdD]} | | } | |krQn|| ?d@dkratj ||| f<qEq5q/dS)Nrr r)shaper infrange) logitsmaskmask_lencutoffn_rowsn_colsimimvalbasebitjrrr#_apply_token_bitmask_inplace_kernels&      r"rrcCs|jdkr|ntj|dd}|jdkr|ntj|dd}|jtjkr+td|jd|jdkr9td|jd|jdkrGtd |jd|jd|jdkrbtd |jdd |jdd t||d S)ae Apply a logits bitmask inplace, setting the probability of invalid tokens to -infinity. Arguments: logits (np.ndarray): The logits tensor. mask (np.ndarray): The token bitmask representing the validity of each token in the logits tensor. Raises: ValueError: If any of the following conditions are not met: - `mask.dtype` is not `np.int32` - `mask` is not a 2D array - `logits` is not a 2D array - `mask.shape`shape does not match `logits.shape` Returns: None: Modifies the mask array in place. rr)axis2Invalid mask dtype: Expected `np.int32`, but got ``.6Invalid mask dimensions: Expected a 2D array, but got D.z8Invalid logits dimensions: Expected a 2D array, but got z.Invalid batch size: Expected `mask.shape[0]` (z) to match `logits.shape[0]` (z).N)ndimr expand_dimsr r ValueErrorrr")rrrrrapply_token_bitmask_inplace.s&      r,guidecCs|jtjkrtd|jd|jdkrtd|jd|jddkr-td|jd |jd s6td ||jj |j |j S) am Writes a bitmask to represent the tokens permissible by the current state of the `guide`. Each bit in the bitmask corresponds to a token ID, with a bit value of 1 indicating that the token is allowed and 0 indicating that it is disallowed. This function directly modifies the `mask` array in-place. Arguments: guide (Guide): An instance of the `Guide` class that provides the current guidance state. mask (np.ndarray): A 2D tensor of type `torch.int32` where the bitmask will be written. The tensor must be contiguous, have a single batch dimension (shape[0] == 1), and reside on the CPU. Raises: ValueError: If any of the following conditions are not met: - `mask.dtype` is not `torch.int32` - `mask` is not a 2D tensor - `mask` does not have a single batch dimension (shape[0] != 1) - `mask` is not contiguous in memory - `mask` is not on the CPU device Returns: None: Modifies the `mask` array in-place. r$r%r&r'r(rrz_Invalid batch size: Batch mask writes are not supported. Expected shape[0] == 1, but got shape . C_CONTIGUOUSzJMask array must be contiguous in memory. Use `np.ascontiguousarray(mask)`.) r r rr+r)rflagswrite_mask_intoctypesdatasizeitemsize)r-rrrrfill_next_token_bitmaskYs"      r6) outlines_corerrrr ImportErrorestr missing_depintndarrayrnjitr"r,r6rrrrs$   +