o zi@s`ddlZddlmmZddlmZddlmZddlmZddlmZGdddej Z dS) N)nn) AudioSignal) STFTParams)utilc sXeZdZdZddedeffdd Z  dd ed ededededef ddZZ S) SpectralGateaSpectral gating algorithm for noise reduction, as in Audacity/Ocenaudio. The steps are as follows: 1. An FFT is calculated over the noise audio clip 2. Statistics are calculated over FFT of the the noise (in frequency) 3. A threshold is calculated based upon the statistics of the noise (and the desired sensitivity of the algorithm) 4. An FFT is calculated over the signal 5. A mask is determined by comparing the signal FFT to the threshold 6. The mask is smoothed with a filter over frequency and time 7. The mask is appled to the FFT of the signal, and is inverted Implementation inspired by Tim Sainburg's noisereduce: https://timsainburg.com/noise-reduction-python.html Parameters ---------- n_freq : int, optional Number of frequency bins to smooth by, by default 3 n_time : int, optional Number of time bins to smooth by, by default 5 rn_freqn_timec sttttdd|dddtdd|dgdddfttdd|dddtdd|dgdddf}||}|dd}|d|dS)Nr.smoothing_filter) super__init__torchoutercatlinspacesum unsqueezeregister_buffer)selfr r r __class__V/home/ubuntu/.local/lib/python3.10/site-packages/audiotools/ml/layers/spectral_gate.pyr%s(    zSpectralGate.__init__?@ audio_signal nz_signaldenoise_amountn_std win_length hop_lengthcCs<t||d}|}d|_||_|}||_d|jd}|jddd} |jddd} | | |} d|jd} | j \} }}}| | |d|}| |k }|j }| | |d||}|j j d d |j j dd f}tj||j |d }|j |}|tj||jd |j9}d|}|j|9_||S) aPerform noise reduction. Parameters ---------- audio_signal : AudioSignal Audio signal that noise will be removed from. nz_signal : AudioSignal, optional Noise signal to compute noise statistics from. denoise_amount : float, optional Amount to denoise by, by default 1.0 n_std : float, optional Number of standard deviations above which to consider noise, by default 3.0 win_length : int, optional Length of window for STFT, by default 2048 hop_length : int, optional Hop length for STFT, by default 512 Returns ------- AudioSignal Denoised audio signal. sqrt_hannNg-C6?Tr )keepdimdimr r )padding)ndim)rclone stft_data stft_params magnitudeclamplog10meanstdshapeexpandfloatreshaperFconv2dr ensure_tensorr-todeviceistft)rr!r"r#r$r%r&r0 nz_stft_db nz_freq_mean nz_freq_std nz_threshstft_dbnbnacnfnt db_thresh stft_maskr6 pad_tuplerrrforward:s8    zSpectralGate.forward)rr)rrrr ) __name__ __module__ __qualname____doc__intrrr8rL __classcell__rrrrr s(r) rtorch.nn.functionalr functionalr:corerrrModulerrrrrs