o i@s^ddlmZmZmZmZddlmZddlZddlmZddl m Z ej j GdddZ dS) )ListOptionalTypeVarGeneric) dataclassN)Tensor)Errorsc@seZdZUdZeeed<dedeeddfddZedefd d Z d e defd d Z edefddZ edeefddZ dS)PyTorchTransformerOutputz2Padded output of the PyTorch Transformer encoders. all_outputsembedding_outputlayer_hidden_statesreturnNcCs|g|_|j|dS)N)r extend)selfr r rV/home/ubuntu/.local/lib/python3.10/site-packages/curated_transformers/models/output.py__init__sz!PyTorchTransformerOutput.__init__cC |jdS)Nrr rrrrembedding_layer z(PyTorchTransformerOutput.embedding_layeridxcCsNd|krt|jdkrnn|j|dStd|dt|jd)z1'idx' must be in the range [0, num_hidden_layers)rzOAttempting to select a transformer output tensor using an invalid layer index (z). Expected range: 0<= idx < )lenr ValueError)rrrrrhidden_layer_statess" z,PyTorchTransformerOutput.hidden_layer_statescCr)Nrrrrrlast_hidden_layer_states&rz1PyTorchTransformerOutput.last_hidden_layer_statescCs|jddS)Nrrrrrrall_hidden_layer_states*sz0PyTorchTransformerOutput.all_hidden_layer_states)__name__ __module__ __qualname____doc__rr__annotations__rpropertyrintrrr rrrrr s"    r )typingrrrr dataclassesrtorchrerrorsr jitscriptr rrrrs