o i@s,ddlZddlmZejdddZdS)NHindii)cCs0t}|d}gd}dd|D|ksJdS)zGTest that default punctuation rules applies to hindi unicode charactersu-hi. how हुए. होटल, होटल)hi.howu हुएr होटल,rcSsg|]}|jqS)text).0tokenr r Q/home/ubuntu/.local/lib/python3.10/site-packages/spacy/tests/lang/hi/test_text.py sz"test_issue3625..Nr)nlpdocexpectedr r r test_issue3625sr)pytest spacy.lang.hirmarkissuerr r r r s