o pi@sddlmZddlZddlmZddlmZddlmZ ddej dej de fd d Z ddej de fd d Z edd ede fddZ Gdddej Ze jdded ede fddZdS))singledispatchN)BaseWaveformTransform)Modelinput augmentationmodulewhencst|||dt|dst|_t|_||jvr t||d|j|<|dkr5fdd}||}n|dkrDfdd}| |}||j|<d S) uJRegister augmentation Parameters ---------- augmentation : nn.Module Augmentation module. module : nn.Module Module whose input or output should be augmented. when : {'input', 'output'} Whether to apply augmentation on the input or the output. Defaults to 'input'. Usage ----- class Net(nn.Module): def __init__(self): super().__init__() self.spectogram = Spectrogram() self.other_layers = nn.Identity() def forward(self, waveforms): spectrogram = self.spectrogram(waveforms) return self.other_layers = other_layers net = Net() class AddNoise(nn.Module): def forward(self, waveforms): if not self.training: return waveforms augmented_waveforms = ... return augmented_waveforms # AddNoise will be automatically applied to `net` input register_augmentation(AddNoise(), net, when='input') class SpecAugment(nn.Module): def forward(self, spectrograms): if not self.training: return spectrograms augmented_spectrograms = ... return augmented_spectrograms # SpecAugment will be automatically applied to `net.spectrogram` output register_augmentation(SpecAugment(), net.spectrogram, when='output') # deactivate augmentations net.eval() # or net.train(mode=False) # reactivate augmentations net.train() # unregister "AddNoise" augmentation unregister_augmentation(net, when='input') r__augmentationrcs|SN)augmented_modulerwrapped_augmentationr X/home/ubuntu/.local/lib/python3.10/site-packages/pyannote/audio/augmentation/registry.py input_hookoz)register_augmentation..input_hookoutputcs|Sr r )r rrrr r output_hookvrz*register_augmentation..output_hookN) wrap_augmentationhasattrnn ModuleDictr dict__augmentation_handleunregister_augmentationregister_forward_pre_hookregister_forward_hook)rrrrhandlerr rrregister_augmentation sA         rcCsDt|dr ||jvrtd|d|j|=|j|}|dS)adUnregister augmentation Parameters ---------- module : nn.Module Module whose augmentation should be removed. when : {'input', 'output'} Whether to remove augmentation of the input or the output. Defaults to 'input'. Raises ------ ValueError if module has no corresponding registered augmentation. r zModule has no registered u augmentation.N)rr ValueErrorrpopremove)rrrr r rr~s   rmodelcCs|Sr r rr#rr r rrsrcsDeZdZ d dededeffdd Zdejdejfd d Z Z S) ,TorchAudiomentationsWaveformTransformWrapperrrr#rcsTt||_t|tstd|jjd|dkr#td|d|j j |_ dS)Nzttorch-audiomentations waveform transforms can only be applied to `pyannote.audio.Model` instances: you tried with a z instance.rzetorch-audiomentations waveform transforms can only be applied to the model input: you tried with the .) super__init__r isinstancer TypeError __class____name__r audio sample_rate sample_rate_)selfrr#rr+r rr(s  z5TorchAudiomentationsWaveformTransformWrapper.__init__ waveformsreturncCs|j||jdjS)N)samplesr.)rr/r4)r0r2r r rforwards z4TorchAudiomentationsWaveformTransformWrapper.forwardr) r, __module__ __qualname__rrstrr(torchTensorr5 __classcell__r r r1rr%sr%cCst|||dS)Nr )r%r$r r r_sr=r6) functoolsrr:torch.nnr/torch_audiomentations.core.transforms_interfacerpyannote.audio.core.modelrModuler9rrrr%registerr=r r r rs&     ^