o Lεi@sdZddlZddlZddZedkr=dZedZeeeeZ e dd d d e e j d d D]\Z Ze e ejd d q0dSdS)zX Example of pySBD as a sentencizer component for spaCy Installation: pip install spacy Ncs^tjdddd}|j}fdd|D}dd|D}D] }|j|vr)dnd|_q S)NenFT)languageclean char_spancsg|] }|j|jqS)rstartend).0 sent_spandocrU/home/ubuntu/.local/lib/python3.10/site-packages/examples/pysbd_as_spacy_component.py sz-pysbd_sentence_boundaries..cSsg|] }|dur|djqS)Nr)idx)r spanrrr rs)pysbd Segmentersegmenttextr is_sent_start)r segsents_char_spans char_spansstart_token_idstokenrr r pysbd_sentence_boundaries s r__main__z9My name is Jonas E. Smith. Please turn to p. 55.rsent_idsentencez | )sep)r)__doc__rspacyr__name__rblanknlpadd_piper print enumeratesentsrsentrrrr s