o i @sddlmZmZddlmZmZddlZddlmZ ddlm Z ddlm Z GdddeZ Gdd d e Z dd e d eed efd dZGdddeZddZddZGdddeZdS))ABCabstractmethod)DictListN)Tensor) TokenSpanc@s.eZdZedeedeeefddZdS) ITokenizer transcriptreturncCdS)a Tokenize the given transcript (list of word) .. note:: The toranscript must be normalized. Args: transcript (list of str): Transcript (list of word). Returns: (list of int): List of token sequences Nselfr r r \/home/ubuntu/vllm_env/lib/python3.10/site-packages/torchaudio/pipelines/_wav2vec2/aligner.py__call__ zITokenizer.__call__N)__name__ __module__ __qualname__rrstrrr r r rr s$rc@s@eZdZdeeeffddZdeedeeefddZdS) Tokenizer dictionarycC ||_dSNr)rrr r r__init__ zTokenizer.__init__r r csfdd|DS)Ncsg|] }fdd|DqS)csg|]}j|qSr r).0crr r sz1Tokenizer.__call__...r )rwordrr rr sz&Tokenizer.__call__..r r r rrrszTokenizer.__call__N) rrrrrintrrrr r r rrs"remissiontokensblankcCsZ|j}|d}tj|gtj|d}tj|||d\}}|}|d|d}}||fS)Nr)dtypedevicer%)r' unsqueezetorchtensorint32F forced_alignexp)r#r$r%r'targetsaligned_tokensscoresr r r_align_emission_and_tokens#s r3c @s6eZdZededeeedeeefddZdS)IAlignerr#r$r cCr )aGenerate list of time-stamped token sequences Args: emission (Tensor): Sequence of token probability distributions in log-domain. Shape: `(time, tokens)`. tokens (list of integer sequence): Tokenized transcript. Output from :py:class:`torchaudio.pipelines.Wav2Vec2FABundle.Tokenizer`. Returns: (list of TokenSpan sequence): Tokens with time stamps and scores. Nr )rr#r$r r rr0rzIAligner.__call__N) rrrrrrr"rrr r r rr4/s,r4cCsHt|t|ks Jd}g}|D]}|||||||7}q|S)Nr)lensumappend)list_lengthsiretlr r r _unflatten?s r=cCsdd|DS)NcSsg|] }|D]}|qqSr r )rr8itemr r rr Jsz_flatten..r ) nested_listr r r_flattenIsr@c@s:eZdZddZdedeeedeeefddZdS) AlignercCrrr()rr%r r rrNrzAligner.__init__r#r$r cCsP|jdkr td|jt|t||j\}}t||}t|dd|DS)Nz&The input emission must be 2D. Found: cSsg|]}t|qSr )r5)rtsr r rr Wsz$Aligner.__call__..) ndim ValueErrorshaper3r@r%r- merge_tokensr=)rr#r$r1r2spansr r rrQs  zAligner.__call__N) rrrrrrr"rrr r r rrAMs*rA)r)abcrrtypingrrr*torchaudio.functional functionalr-rrrrr"r3r4r=r@rAr r r rs