o  ¢i+ã@sfddlZdddgfdgd¢fgZddgfddgfd d gfd d gfgZeeZej d e¡d d „ƒZdS)éNztel.ÚtelÚ.u 0 zÅ‚ 99 gr)Ú0uzÅ‚Ú99Úgrzcztero-zjedno-zdwu-ztrzy-ztext,expected_tokenscCs&||ƒ}dd„|Dƒ}||ksJ‚dS)NcSsg|]}|js|j‘qS©)Úis_spaceÚtext)Ú.0ÚtokenrrúV/home/ubuntu/.local/lib/python3.10/site-packages/spacy/tests/lang/pl/test_tokenizer.pyÚ sz4test_tokenizer_handles_testcases..r)Ú pl_tokenizerr Úexpected_tokensÚtokensÚ token_listrrr Ú test_tokenizer_handles_testcasessr)ÚpytestÚ DOT_TESTSÚ HYPHEN_TESTSÚ TESTCASESÚmarkÚ parametrizerrrrr Ús  þü