o Xi@sddlZddlmZddlmZddlZddlZddlZddl m m Z ddl mZdZdZdZd Zd ZeeZeeeZefd ed efd dZefdddedefddZeddefdedejfddZefdeeejejfdefddZdS)N) lru_cache)Union) exact_divi>iPfilesrc Csztj|ddjdddd|djdd gd d d \}}Wntjy3}z td |j|d }~wwt |tj  tj dS)a? Open an audio file and read as mono waveform, resampling as necessary Parameters ---------- file: str The audio file to open sr: int The sample rate to resample the audio if necessary Returns ------- A NumPy array containing the audio waveform, in float32 dtype. r)threads-s16le pcm_s16ler)formatacodecacarffmpegz-nostdinT)cmdcapture_stdoutcapture_stderrzFailed to load audio: Ng@)rinputoutputrunError RuntimeErrorstderrdecodenp frombufferint16flattenastypefloat32)r r out_er'A/home/ubuntu/.local/lib/python3.10/site-packages/whisper/audio.py load_audios    r))axislengthr+cCst|rC|j||kr|j|tj||jdd}|j||krAdg|j}d||j|f||<t|dd|dddD}|S|j||krS|j t ||d }|j||krqdg|j}d||j|f||<t ||}|S) zO Pad or trim the audio array to N_SAMPLES, as expected by the encoder. )device)dimindex)rrrcSsg|] }|D]}|qqSr'r').0sizespadr'r'r( ?szpad_or_trim..Nr*)indicesr+) torch is_tensorshape index_selectaranger-ndimFr2takeranger)arrayr,r+ pad_widthsr'r'r( pad_or_trim4s      r@)maxsizen_melsreturncCsr|dks Jd|ttjtjtdd}t|d| |WdS1s2wYdS)a load the mel filterbank matrix for projecting STFT into a Mel spectrogram. Allows decoupling librosa dependency; saved using: np.savez_compressed( "mel_filters.npz", mel_80=librosa.filters.mel(sr=16000, n_fft=400, n_mels=80), ) rzUnsupported n_mels: assetszmel_filters.npzmel_N) rloadospathjoindirname__file__r5 from_numpyto)r-rBfr'r'r( mel_filtersLs $rOaudiocCst|st|trt|}t|}tt|j }tj |tt |dd}|ddddf d}t |j |}||}tj|dd}t||d}|d d }|S) a Compute the log-Mel spectrogram of Parameters ---------- audio: Union[str, np.ndarray, torch.Tensor], shape = (*) The path to audio or either a NumPy array or Tensor containing the audio waveform in 16 kHz n_mels: int The number of Mel-frequency filters, only 80 is supported Returns ------- torch.Tensor, shape = (80, n_frames) A Tensor that contains the Mel spectrogram T)windowreturn_complexNr*g|=)ming @g@)r5r6 isinstancestrr)rL hann_windowN_FFTrMr-stft HOP_LENGTHabsrOclamplog10maximummax)rPrBrQrY magnitudesfiltersmel_speclog_specr'r'r(log_mel_spectrogram\s     rd)rG functoolsrtypingrrnumpyrr5torch.nn.functionalnn functionalr;utilsr SAMPLE_RATErXN_MELSrZ CHUNK_LENGTH N_SAMPLESN_FRAMESrVintr)r@TensorrOndarrayrdr'r'r'r(s(    (