o i6 @sZdZddlmZddlmZmZddlZddlmm Z dd d Z ddd dddZ dS)z1.0). ?r.)numeluniquetorchwhere)rrr unique_toks tok_logitsrM/home/ubuntu/.local/lib/python3.10/site-packages/faster_qwen3_tts/sampling.pyapply_repetition_penalty s   r) suppress_masksuppress_tokens temperaturetop_kinttop_p do_sampleboolrOptional[torch.Tensor]rOptional[Iterable[int]]cCs,|}|durtd|d|f<|rtd|dt|f<|s%tj|ddS||}|dkrPt|t||d\}}t||dddfkt |td|}|dkrtj |dd \} } t j | dd} tj | dd} | |k} d | d <td| | <t |td}|d| | tt j |ddd dS) zlSample a token from logits. Mirrors HF order: suppress -> temperature -> top-k -> top-p -> sample. Nz-inf.)dimrr T) descendingF).r)cloner listrargmaxtopkminsizer full_likesortFsoftmaxcumsumscatter_ multinomialsqueeze)rrrrrrr topk_vals_ sorted_logitssorted_indicesprobscumulative_probssorted_indices_to_removerrr sample_logits s** r8)rrrrrr r r)rrrr rrrr rrrrrrr r) __doc__ __future__rtypingrrrtorch.nn.functionalnn functionalr+rr8rrrrs