o wik@sddlZddlZddlZddlmZmZmZmZddlZddl Z ddl mZ ddl ZddlmZdZzddlmZddlmZddiZWn eyOdZYnweZd d eDZeeeeefZdd e jd eed e jfddZ ddededefddZ!Gddde"ZdS)N)IterableListOptionalUnion)loggingT) AudioSegment)CouldntDecodeErroropusFcCsg|]}d|qS).)lower).0irm/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/nemo/collections/asr/parts/preprocessing/segment.py >rsignalchannel_selectorreturncCs|jdkr|dvrtdt||S|jd}|j|}||kr'td|||dur. |S|dkr;tj|dd}|St |t rW||krOtd |d |d |d |f}|St |t rt ||krmtd |d |d |d |f}t |dkrtj|dd}|Std|d)a Convert a multi-channel signal to a single-channel signal by averaging over channels or selecting a single channel, or pass-through multi-channel signal when channel_selector is `None`. Args: signal: numpy array with shape (..., num_channels) channel selector: string denoting the downmix mode, an integer denoting the channel to be selected, or an iterable of integers denoting a subset of channels. Channel selector is using zero-based indexing. If set to `None`, the original signal will be returned. Uses zero-based indexing. Returns: numpy array NraverageJInput signal is one-dimensional, channel selector (%s) cannot not be used.zjNumber of channels (%d) is greater or equal than number of samples (%d). Check for possible transposition.NraxiszCannot select channel z from a signal with z channels..zCannot select channel subset z'Unexpected value for channel_selector ())ndim ValueErrorstrshapesizerwarningnpmean isinstanceintrmaxlensqueeze)rr num_channels num_samplesrrrselect_channelsDsF        r,>float32 audio_file target_srdtypecCsdt|d"}|j|d}|j|krtjj||j|d}|}Wd|S1s+wY|S)a Read the samples from the given audio_file path. If not specified, the input audio file is automatically resampled to 16kHz. Args: audio_file (str): Path to the input audio file target_sr (int): Targeted sampling rate Returns: samples (numpy.ndarray): Time-series sample data from the given audio file rr1orig_srr0N)sf SoundFileread sampleratelibrosacoreresample transpose)r/r0r1fsamplesrrr get_sampless    r@c@seZdZdZddejddddddddddf deedeed ee e e e fd eed eef d d Z ddZ ddZddZeddZedddddejdddddddf ddZe      d;ddZe       dd7d8Z#d?d9d:Z$dS)@ra Audio segment abstraction. :param samples: Audio samples [num_samples x num_channels]. :type samples: ndarray.float32 :param sample_rate: Audio sample rate. :type sample_rate: int :raises TypeError: If the sample data type is not float or int. NF<ii normalize_db ref_channelr/offsetdurationcCs||}|jdkr| dvrtdt| |jdkr t|| }n |jdkr)td|durD||krD|}tjj |||d}|}|}|r[|}tj j |||||d \}}|}||_ ||_ | durg| n||_| |_| |_| |_||_||_| dur|| | dSdS) zwCreate audio segment from samples. Samples are convert float32 internally, with int scaled to [-1, 1]. rrrzTSignals with more than two dimensions (sample, channel) are currently not supported.Nr4)top_dbref frame_length hop_length)_convert_samples_to_float32rrrr,NotImplementedErrorr=r:r;r<effectstrim_samples _sample_rate_orig_sr _ref_channel _normalize_db _audio_file_offset _durationrB)selfr? sample_rater0rOtrim_ref trim_top_dbtrim_frame_lengthtrim_hop_lengthr5rrBrCr/rDrE_rrr__init__sB      zAudioSegment.__init__cCsRt|t|ur dS|j|jkrdS|jj|jjkrdSt|j|jkr'dSdS)z%Return whether two objects are equal.FT)typerQrPr r#anyr?rXotherrrr__eq__s zAudioSegment.__eq__cCs || S)z'Return whether two objects are unequal.)rdrbrrr__ne__s zAudioSegment.__ne__cCs^|jdkrdt||j|j|j|jfSddd|jD}dt||j|j|j|j|fS)z0Return human-readable representation of segment.rz@%s: num_samples=%d, sample_rate=%d, duration=%.2fsec, rms=%.2fdBz, cSsg|]}|ddqS)z.2fdBr)r rmsrrrrrz(AudioSegment.__str__..zO%s: num_samples=%d, sample_rate=%d, duration=%.2fsec, num_channels=%d, rms=[%s])r*r`r+rYrErms_dbjoin)rX rms_db_strrrr__str__s" zAudioSegment.__str__cCst|d}|jtjtjtjtjfvr%t|jj}|dd|d9}|S|jtj tj tj fvr3 |St d|j)zConvert sample type to float32. Audio sample type is usually integer or float-point. Integers will be scaled to [-1, 1] in float32. r.g?rFrzUnsupported sample type: %s.) astyper1r#int8int16int32int64iinfobitsfloat16r.float64 TypeError)r?float32_samplesrrrrrrLs z(AudioSegment._convert_samples_to_float32rcCsd}t|tr|j||||||||| | | | | |dSt|tr)tj|dtvrzLt |d<}|r5dnd}|j }|durK|dkrK| t |||dur_|dkr_|j t |||d}n|j |d}Wdn1sowYWn(ty}ztd |d |d t|d r| dWYd}~nd}~wwtr|durzStj|ttj|dd }|j}|j}|dur|dkr|d}|t |d}|dur|dkr|d}|dt |}t|}|dkrt|d|f}Wnty}ztd |d|dWYd}~nd}~ww|dur0tr#dnd}td|d|d|||||||| | | | | ||||dS)a Load a file supported by librosa and return as an AudioSegment. :param audio_file: path of file to load. Alternatively, a list of paths of single-channel files can be provided to form a multichannel signal. :param target_sr: the desired sample rate :param int_values: if true, load samples as 32-bit integers :param offset: offset in seconds when loading audio :param duration: duration in seconds when loading audio :param trim: if true, trim leading and trailing silence from an audio signal :param trim_ref: the reference amplitude. By default, it uses `np.max` and compares to the peak amplitude in the signal :param trim_top_db: the threshold (in decibels) below reference to consider as silence :param trim_frame_length: the number of samples per analysis frame :param trim_hop_length: the number of samples between analysis frames :param orig_sr: the original sample rate :param channel selector: string denoting the downmix mode, an integer denoting the channel to be selected, or an iterable of integers denoting a subset of channels. Channel selector is using zero-based indexing. If set to `None`, the original signal will be used. :param normalize_db (Optional[float]): if not None, normalize the audio signal to a target RMS value :param ref_channel (Optional[int]): channel to use as reference for normalizing multi-channel audio, set None to use max RMS across channels :return: AudioSegment instance N)audio_file_listr0 int_valuesrDrErOrZr[r\r]r5rrBrCrr2ror.rr3Loading % via SoundFile raised RuntimeError: `z+`. NeMo will fallback to loading via pydub.seek)codecirz' via pydub raised CouldntDecodeError: ``.zsoundfile, and pydub soundfilezYour audio file z& could not be decoded. We tried using r ) r0rOrZr[r\r]r5rrBrCr/rDrE)r%listfrom_file_listrospathsplitextsf_supported_formatsr6r7r9r{r&r8 RuntimeErrorrerrorhasattr HAVE_PYDUBAudio from_file ffmpeg_codecsget frame_ratechannelsr#arrayget_array_of_samplesreshaper Exception)clsr/r0rxrDrErOrZr[r\r]r5rrBrCr?r>r1rYer*secondserrlibsrrrrs*        $ zAudioSegment.from_filec Os"t|tr|t|krtd|dt|||g}d}d} |D]V} |j|| ||||ddd| } | jdkrDtd| jd| |durK| j}| jdddf} | dur[| } q"t| t| krotd | jd | jt j | | gdd } q"t | } |}|| |g|R||||d | S) a Function wrapper for `from_file` method. Load a list of files from `audio_file_list`. The length of each audio file is unified with the duration item in the input manifest file. See `from_file` method for arguments. If a list of files is provided, load samples from individual single-channel files and concatenate them along the channel dimension. z-Channel cannot be selected: channel_selector=z, num_audio_files=NF)r/r0rxrDrErrOrz4Expecting a single-channel audio signal, but loaded z channels from file z.Loaded samples need to have identical length: z != r)r0rOrr/) r%r&r(rrr*rYr?r r# concatenater))rrwr0rxrDrErOrargskwargsr?a_file a_segment a_samplesrYrrrrsl       zAudioSegment.from_file_listr.c  Csd} zt|d} | j} |durt|| |} n|} d| kr)t| krann6t| | } |durrYn_segments_at_original_srmax_audio_start audio_startr?rfeaturesrrrsegment_from_filesV     zAudioSegment.segment_from_filecCs |jS)zReturns a copy of the samples.)rPcopyrXrrrr?/s zAudioSegment.samplescC|jS)z'Returns the sample rate of the segment.)rQrrrrrY4zAudioSegment.sample_ratecCs|jjdkrdS|jjdS)z.Returns the number of channels in the segment.rr)rPrr rrrrr*9s  zAudioSegment.num_channelscCs |jjdS)z-Returns the number of samples in the segment.r)rPr rrrrr+As zAudioSegment.num_samplescCs|jt|jS)z/Returns the duration of the segment in seconds.)r+floatrQrrrrrEFszAudioSegment.durationcCs"tj|jddd}dt|S)zReturn per-channel RMS value.rFrr )r#r$rPlog10rX mean_squarerrrrhKszAudioSegment.rms_dbcCr)z0Returns the original sample rate of the segment.)rRrrrrr5QrzAudioSegment.orig_srcC|jdur t|jSdS)z(Returns the offset used for the segment.N)rVrrrrrrDVzAudioSegment.offsetcCr)z8Returns the audio file that the segment was loaded from.N)rUrrrrrr/[rzAudioSegment.audio_filecCs,ttj|jddd}|jdkp|dkS)zChecks if the segment is empty.rFrr)r#sumr$rPr+rrrris_empty`szAudioSegment.is_emptycCs|jd|d9_dS)zReturns the gain in decibels.g$@g4@N)rP)rXgainrrrgain_dbeszAudioSegment.gain_dbcCs>|j}|jdkr|durt|n||}||}||dS)zNormalize the signal to a target RMS value in decibels. For multi-channel audio, the RMS value is determined by the reference channel (if not None), otherwise it will be the maximum RMS across all channels. rN)rhr*r'r)rX target_dbrCrhrrrrrBis  zAudioSegment.normalize_dbcCsp|jj}|dkr|r |nd|f}n|dkr$|r||fdfnd|fdf}ntd|dtj|j|dd|_d S) zAdd zero padding to the sample. The pad size is given in number of samples. If symmetric=True, `pad_size` will be added to both sides. If false, `pad_size` zeros will be added only to the end. rrrF)rrz\Padding not implemented for signals with more that 2 dimensions. Current samples dimension: r constant)modeN)rPrrMr#pad)rXpad_size symmetric samples_ndim pad_widthrrrrts zAudioSegment.padcCs|durdn|}|dur|jn|}|dkr|j|}|dkr#|j|}|dkr-td||dkr7td|||krCtd||f||jkrQtd||jftt||j}tt||j}|j|||_dS)aCut the AudioSegment between given boundaries. Note that this is an in-place transformation. :param start_time: Beginning of subsegment in seconds. :type start_time: float :param end_time: End of subsegment in seconds. :type end_time: float :raise ValueError: If start_time or end_time is incorrectly set, e.g. out of bounds in time. Ngz1The slice start position (%f s) is out of bounds.z/The slice end position (%f s) is out of bounds.zFThe slice start position (%f s) is later than the end position (%f s).z7The slice end position (%f s) is out of bounds (> %f s))rErr&roundrQrP)rX start_timeend_time start_sample end_samplerrr subsegments&       zAudioSegment.subsegment)NFrrFN)NrFNNNr.)rN)F)NN)%__name__ __module__ __qualname____doc__r#r'rrr&rrrr_rdrerk staticmethodrL classmethodrrrpropertyr?rYr*r+rErhr5rDr/rrrBrrrrrrrs    <   y Y G           r)N)r-r.)#rrrtypingrrrrr:numpyr# numpy.typingnptr~r6 nemo.utilsrrpydubrrpydub.exceptionsrrModuleNotFoundErroravailable_formatskeysrr&rChannelSelectorTypeNDArrayr,r@objectrrrrs.#       ?