o ۾i@sUddlmZmZddlmZddlZddlmZeee ej gej feee ee ej gej fBZ ee d< dee dedee fd d ZGd d d ZdS) )CallableSequence) TypeAliasN) TokenizerLikeLogitsProcessor bad_words tokenizerreturncCst}|D]7}dD]2}|rdnd}||}|j|dd}|r6|r;|d|ddkr;t|t|dkr;||q qt|dgS) N)FT F)textadd_special_tokensr) bad_words_ids)listlstripencodelenappendNoBadWordsLogitsProcessor)rrrbad_wordadd_prefix_spaceprefixpromptprompt_token_idsrG/home/ubuntu/.local/lib/python3.10/site-packages/vllm/logits_process.pyget_bad_words_logits_processorss    rc@sreZdZedZdZdeeefddZde ede j de j fd d Z de j dd fd d Zdedd fddZd S)rz-infgrcCs||_d|_dS)N)r word_bias)selfrrrr__init__4s z"NoBadWordsLogitsProcessor.__init__past_tokens_idslogitsr c Cs|jdur |j|dt|}|jD]K}t|dkrqt|t|dkr'qt|d}|d}|| d}|d|}t|t|ksHJt|t|k} ||| rY|jn|j7<q||j|}|S)N)r"r) r_init_word_biastorch zeros_likerrtuple_SMALLEST_LOGIT_NEUTRAL_LOGIT) rr!r"last_token_bias bad_word_ids prefix_length last_token_id actual_prefixexpected_prefixis_matchrrr__call__8s&       z"NoBadWordsLogitsProcessor.__call__NcCs^|jd}|j|dtj|ftj|jd|_|jD]}t|dkr,|d}|j |j|<qdS)Nr) vocab_size)dtypedevicer#) shape_check_token_ids_boundsr%zerosfloatr4rrrr()rr"r2r+ bad_word_idrrrr$Ys      z)NoBadWordsLogitsProcessor._init_word_biasr2cCs`g}|jD]}|D]}|dks||kr||q qt|dkr.td|d|d|ddS)NrzThe model vocabulary size is z2, but the following tokens were specified as bad: zE. All token id values should be integers satisfying: 0 <= token_id < .)rrr ValueError)rr2invalid_token_idsr+token_idrrrr6js    z1NoBadWordsLogitsProcessor._check_token_ids_bounds)__name__ __module__ __qualname__r8r(r)rintr rr% FloatTensorTensorr1r$r6rrrrr0s !r)collections.abcrrtypingrr%vllm.tokenizersrrrArCr__annotations__strrrrrrrs"