o }oi{ @s,ddlmZddlZGdddejjZdS))OptionalNcspeZdZdZ    ddededed ed ed eef fd d Ze ddZ ddee j de j fddZ ZS)MultiLayerPerceptrona A simple MLP that can either be used independently or put on top of pretrained models (such as BERT) and act as a classifier. Args: hidden_size (int): the size of each layer num_classes (int): number of output classes num_layers (int): number of layers activation (str): type of activations for layers in between log_softmax (bool): whether to add a log_softmax layer before output reluTN hidden_size num_classes num_layers activation log_softmax channel_idxc std|_t|dD])}tj||}t|d|j|t|d|jdtt||jd7_qtj||}t|d|j||jd7_||_ ||_ dS)Nrlayerr) super__init__layersrangetorchnnLinearsetattrgetattrr r ) selfrrrr r r _r  __class__h/home/ubuntu/.local/lib/python3.10/site-packages/nemo/collections/common/parts/multi_layer_perceptron.pyrs  zMultiLayerPerceptron.__init__cCst|d|jdS)Nr r )rr)rrrrlast_linear_layer5sz&MultiLayerPerceptron.last_linear_layer hidden_statesreturncKs|durd|vr |d}n d|vr|d}ntd|jdur'|d|j}n|}t|jD] }t|d||}q.|jrEtj|dd}|jdurQ|d|j}|S)zs Multi-layer perceptron forward function compatible with multiple types of input keyword arguments N audio_signalencoder_outputzNo input tensor foundr )dim) ValueErrorr transposerrrr r)rrkwargs output_statesirrrforward9s     zMultiLayerPerceptron.forward)rrTN)N)__name__ __module__ __qualname____doc__intstrboolrrpropertyrrTensorr) __classcell__rrrrrs, $r)typingrrrModulerrrrrs