o }oi$ @sNddlmZddlmZmZddlmZmZmZm Z dgZ GdddeZ dS))nn)Loss typecheck) ChannelType LogitsTypeLossType NeuralType SpanningLosscsFeZdZdZeddZeddZfddZedd Z Z S) r zN implements start and end loss of a span e.g. for Question Answering. cCs,tdtttdtttdtdS)z3Returns definitions of module input ports. )BTDr )logitsstart_positions end_positions)rrtuplerselfr`/home/ubuntu/.local/lib/python3.10/site-packages/nemo/collections/common/losses/spanning_loss.py input_typess zSpanningLoss.input_typescCs$ttdtdttdtdS)z4Returns definitions of module output ports. ) elements_type)r r )loss start_logits end_logits)rrrrrrr output_types&s   zSpanningLoss.output_typescstdS)N)super__init__r __class__rrr0szSpanningLoss.__init__c Cs|jddd\}}|d}|d}t|dkr |d}t|dkr-|d}|d}|d||d|tj|d}|||}|||} || d} | ||fS)a0 Args: logits: Output of question answering head, which is a token classfier. start_positions: Ground truth start positions of the answer w.r.t. input sequence. If question is unanswerable, this will be pointing to start token, e.g. [CLS], of the input sequence. end_positions: Ground truth end positions of the answer w.r.t. input sequence. If question is unanswerable, this will be pointing to start token, e.g. [CLS], of the input sequence. )dimr) ignore_index)splitsqueezelensizeclamp_rCrossEntropyLoss) rr rrrr ignored_indexloss_fct start_lossend_loss total_lossrrrforward3s            zSpanningLoss.forward) __name__ __module__ __qualname____doc__propertyrrrrr/ __classcell__rrrrr s   N) torchrnemo.core.classesrrnemo.core.neural_typesrrrr__all__r rrrrs