o Ni @s^dZddlmZddlmZddlmZddlmZddlm Z dZ dZ Gd d d e j Z dS) AThe WMT EnDe Translate dataset used by the Tensor2Tensor library.)absolute_import)division)print_functionN)wmtzghttps://github.com/tensorflow/tensor2tensor/blob/master/tensor2tensor/data_generators/translate_ende.pya @InProceedings{bojar-EtAl:2014:W14-33, author = {Bojar, Ondrej and Buck, Christian and Federmann, Christian and Haddow, Barry and Koehn, Philipp and Leveling, Johannes and Monz, Christof and Pecina, Pavel and Post, Matt and Saint-Amand, Herve and Soricut, Radu and Specia, Lucia and Tamchyna, Ale {s}}, title = {Findings of the 2014 Workshop on Statistical Machine Translation}, booktitle = {Proceedings of the Ninth Workshop on Statistical Machine Translation}, month = {June}, year = {2014}, address = {Baltimore, Maryland, USA}, publisher = {Association for Computational Linguistics}, pages = {12--58}, url = {http://www.aclweb.org/anthology/W/W14/W14-3302} } c@s:eZdZdZejdeedej ddgZ e ddZ dS) WmtT2tTranslaterz&WMT T2T EnDe translation task dataset.)deenz1.0.0) descriptionurlcitation language_pairversioncCs$tjjgdtjjdgtjjdgiS)N) europarl_v7 commoncrawlnewscommentary_v13 newstest2013 newstest2014)tfdsSplitTRAIN VALIDATIONTEST)selfrY/home/ubuntu/.local/lib/python3.10/site-packages/tensorflow_datasets/translate/wmt_t2t.py_subsets7s zWmtT2tTranslate._subsetsN)__name__ __module__ __qualname____doc__r WmtConfig_URL _CITATIONrcoreVersionBUILDER_CONFIGSpropertyrrrrrr*s  r)r __future__rrrtensorflow_datasets.public_api public_apirtensorflow_datasets.translaterr"r# WmtTranslaterrrrrs