o ´©iY#ã@sjddlZddlZdd„Zdejfdd„Zddd„Zdd d „Zdd d„Zdd„Z ddd„Z ddd„Z dS)éNcCsT| d¡rd}n| d¡rd}nd|d ¡>}t|dƒd}d|d|}|S)NÚlogmel23éÚlogmelé(éé)Ú startswithÚ bit_lengthÚint)Ú frame_sizeÚ context_sizeÚtransform_typeÚfft_sizeÚ input_dim©rúT/home/ubuntu/.local/lib/python3.10/site-packages/funasr/models/eend/utils/feature.pyÚ get_input_dim s  rc CsÐt |¡}|s nZ|dkrt t |d¡¡}nK|dkrEd|jdd}d}d}tj |||¡}t |d|j ¡}t  t |d¡¡}n|dkrqd|jdd}d }d }tj |||¡}t |d|j ¡}t  t |d¡¡}nò|d kr¨d|jdd}d }d }tj |||¡}t |d|j ¡}t  t |d¡¡}tj |d d }||}n»|dkrd|jdd}d }d }tj |||¡}t |d|j ¡}t  t |d¡¡}tj |dd }t  |¡t |¡d} tdƒD]} t  ||| k¡t  ||| k¡d} qëtj ||| kdd…fd d }||}nM|dkr]d|jdd}d }d }tj |||¡}t |d|j ¡}t  t |d¡¡}tj |d d }||}t tj|d d d¡} || }ntd|ƒ‚| |¡S)aTransform STFT feature Args: Y: STFT (n_frames, n_bins)-shaped np.complex array transform_type: None, "log" dtype: output data type np.float32 is expected Returns: Y (numpy.array): transformed feature Úlogg»½×Ùß|Û=rrri€>rri@rÚ logmel23_mnr)ÚaxisÚ logmel23_swng@é NÚ logmel23_mvnzUnknown transform_type: %s)ÚnpÚabsrÚmaximumÚshapeÚlibrosaÚfiltersÚmelÚdotÚTÚlog10ÚmeanÚsumÚmaxÚminÚrangeÚstdÚ ValueErrorÚastype) ÚYr ÚdtypeÚn_fftÚsrÚn_melsÚ mel_basisr#ÚpowersÚthÚir(rrrÚ transformsl    *     r4rcCs$|dd|…}|dd|…}||fS)zFrame subsamplingNr)r+r!Ú subsamplingÚY_ssÚT_ssrrrÚ subsampledsr8cCsdt |||fdgd¡}tjjjt |¡|jd|jdd|df|j|jd|jfdd}|S)acFrame splicing Args: Y: feature (n_frames, n_featdim)-shaped numpy array context_size: number of frames concatenated on left-side if context_size = 5, 11 frames are concatenated. Returns: Y_spliced: spliced feature (n_frames, n_featdim * (2 * context_size + 1))-shaped )rrÚconstantrrrF)Ú writeable)rÚpadÚlibÚ stride_tricksÚ as_stridedÚascontiguousarrayrÚitemsize)r+r ÚY_padÚ Y_splicedrrrÚspliceksürCéécCsPd|d ¡>}t|ƒ|dkrtj||||djdd…Stj||||djS)aRCompute STFT features Args: data: audio signal (n_samples,)-shaped np.float32 array frame_size: number of samples in a frame (must be a power of two) frame_shift: number of samples between frames Returns: stft: STFT frames (n_frames, n_bins)-shaped np.complex64 array rr)r-Ú win_lengthÚ hop_lengthNéÿÿÿÿ)r ÚlenrÚstftr!)Údatar Ú frame_shiftrrrrrJƒs ÿrJcCs(dt||ƒ}||dkr|d}|S)Nrr)r )Údata_lenÚsizeÚshiftÚn_framesrrrÚ _count_framesœs rQcsLˆjˆjd|k}t ‡fdd„|Dƒ¡ ¡}|dur t|ƒ}|dur(||nd} ˆ |||| ¡\} } tt| ƒ||ƒ} tj| |ftjd} |durM| }|D]T}|  ˆj |d¡}t  |d| |¡  t ¡}t  |d| |¡  t ¡}d}}||kr‡||kr‡||}||kr“||kr“||}|dus›|dur£d | ||…|f<qO| S) aGet frame-aligned labels of given recording Args: kaldi_obj (KaldiData) rec (str): recording id start (int): start frame index end (int): end frame index None means the last frame of recording frame_size (int): number of frames in a frame frame_shift (int): number of shift samples n_speakers (int): number of speakers if None, the value is given from data Returns: T: label (n_frames, n_speakers)-shaped np.int32 array Úreccóg|] }ˆj|d‘qS©Úutt©Úutt2spk©Ú.0Úseg©Ú kaldi_objrrÚ ·óz$get_frame_labels..N©r,rUÚstÚetr)ÚsegmentsrÚuniqueÚtolistrIÚload_wavrQÚzerosÚint32ÚindexrWÚrintr*r )r\rRÚstartÚendr rLÚ n_speakersÚfiltered_segmentsÚspeakersÚesrKÚraterPr!rZÚ speaker_indexÚ start_frameÚ end_frameÚ rel_startÚrel_endrr[rÚget_frame_labels¤s.€rvFcs–ˆ |||||¡\}} t|||ƒ} ˆj|} t ‡fdd„| Dƒ¡ ¡} |dur.t| ƒ}tj| jd|ftj d} |rSt ˆj   ¡ƒ}tj| jdt|ƒftj d}| D]j}|   ˆj|d¡}|rm|  ˆj|d¡}t |d| |¡ t¡}t |d| |¡ t¡}d}}||kr™||kr™||}||kr¥||kr¥||}|dus­|dur¿d | ||…|f<|r¿d |||…|f<qU|rÇ| | |fS| | fS) aExtracts STFT and corresponding labels Extracts STFT and corresponding diarization labels for given recording id and start/end times Args: kaldi_obj (KaldiData) rec (str): recording id start (int): start frame index end (int): end frame index frame_size (int): number of samples in a frame frame_shift (int): number of shift samples n_speakers (int): number of speakers if None, the value is given from data Returns: Y: STFT (n_frames, n_bins)-shaped np.complex64 array, T: label (n_frmaes, n_speakers)-shaped np.int32 array. crSrTrVrXr[rrr]êr^z#get_labeledSTFT..Nrr_rUr`rar)rerJrbrrcrdrIrfrrgÚsortedÚspk2uttÚkeysrhrWrir*r )r\rRrjrkr rLrlÚuse_speaker_idrKrpr+rmrnr!Ú all_speakersÚSrZrqÚall_speaker_indexrrrsrtrurr[rÚget_labeledSTFTÏs:  € r~)r)r)rDrE)rNrDrEN)NF) ÚnumpyrrrÚfloat32r4r8rCrJrQrvr~rrrrÚs J   ÿ,ÿ