o æS™igã@sdddlmZddlmZmZmZmZddlZddl m Z eGdd„de ƒƒZ eGdd„de ƒƒZ dS) é)Ú dataclass)ÚAnyÚDictÚOptionalÚUnionN)ÚCustomFieldMixinc@sZeZdZUdZeed<dZeej ed<dZ ee ee fed<e deefdd„ƒZdS) Ú TextExamplezN Represents a single text example. Useful e.g. for language modeling. ÚtextNÚtokensÚcustomÚreturncCs|jdurdSt|jƒS©N)r Úlen©Úself©rúC/home/ubuntu/.local/lib/python3.10/site-packages/lhotse/cut/text.pyÚ num_tokenss  zTextExample.num_tokens)Ú__name__Ú __module__Ú __qualname__Ú__doc__ÚstrÚ__annotations__r rÚnpÚndarrayr rrÚpropertyÚintrrrrrr s rc@sPeZdZUdZeed<eed<dZeee e fed<e dee fdd„ƒZ dS) ÚTextPairExamplezY Represents a pair of text examples. Useful e.g. for sequence-to-sequence tasks. ÚsourceÚtargetNr r cCs|jjSr )rrrrrrr$szTextPairExample.num_tokens)rrrrrrr rrrrrrrrrrrrs r) Ú dataclassesrÚtypingrrrrÚnumpyrÚ lhotse.customrrrrrrrÚs