o i(@sdZddlZddlmZmZmZmZmZmZddl m Z m Z ddl m Z mZddlmZmZdd lmZmZmZiZdad d d did fd eeee eefe eefd edededeedeeefdedefddZd dd id ddd fd eee e fd edededeeefdededededdfddZddZifd ee efdeeefdeeeffd!d"Zifd#e deeefdeeeffd$d%Zifd#e deeefdeeeffd&d'Z d(eegefddfd)d*Z!d#e deeeffd+d,Z"dS)-z spaCy's built in visualization suite for dependencies and named entities. DOCS: https://spacy.io/api/top-level#displacy USAGE: https://spacy.io/usage/visualizers N)AnyCallableDictIterableOptionalUnion)ErrorsWarnings)DocSpan)find_available_port is_in_jupyter)DependencyRendererEntityRenderer SpanRendererdepFdocsstylepageminifyjupyteroptionsmanualreturncsLttfttfttfd}||vrttjj |dt |t t t fr$|g}dd|D}tdd|Ds9ttj||\}|d} |sPfdd|Dn|} |rn|D]} t | t rmd | vrmt| d d d d | d <qV| j| ||d td<td} tdurt| } |s|durtrddlm} ddlm}|| d | S| S)aRender displaCy visualisation. docs (Union[Iterable[Union[Doc, Span, dict]], Doc, Span, dict]]): Document(s) to visualise. a 'dict' is only allowed here when 'manual' is set to True style (str): Visualisation style, 'dep' or 'ent'. page (bool): Render markup as full HTML page. minify (bool): Minify HTML markup. jupyter (bool): Override Jupyter auto-detection. options (dict): Visualiser-specific options, e.g. colors. manual (bool): Don't parse `Doc` and instead expect a dict/list of dicts. RETURNS (str): Rendered SVG or HTML markup. DOCS: https://spacy.io/api/top-level#displacy.render USAGE: https://spacy.io/usage/visualizers )rentspan)rcSs"g|] }t|ts |n|qS) isinstancer as_doc.0objrrK/home/ubuntu/.local/lib/python3.10/site-packages/spacy/displacy/__init__.py 5s"zrender..css |] }t|tttfVqdS)N)rr r dictr!rrr$ 6szrender..)rcsg|]}|qSrr)r"doc converterrrr$r%:sentscSs|d|dfS)Nstartendr)xrrr$>szrender..)key)rrparsedNr)HTML)displayz&{})r parse_depsr parse_entsr parse_spans ValueErrorr E087formatrr r r&allE096sortedrenderstrip_htmlRENDER_WRAPPERrIPython.core.displayr2IPython.displayr3)rrrrrrr factories renderer_funcrendererr1r(htmlr2r3rr)r$r=s8     r=Tiz0.0.0.0porthostauto_select_portc Csddlm} t|||}trttjt||||||d| ||t } t d|dt d|d|dz&z| Wnt yQt d |d YnwW| d SW| d S| w) aServe displaCy visualisation. docs (list or Doc): Document(s) to visualise. style (str): Visualisation style, 'dep' or 'ent'. page (bool): Render markup as full HTML page. minify (bool): Minify HTML markup. options (dict): Visualiser-specific options, e.g. colors. manual (bool): Don't parse `Doc` and instead expect a dict/list of dicts. port (int): Port to serve visualisation. host (str): Host to serve visualisation. auto_select_port (bool): Automatically select a port if the specified port is in use. DOCS: https://spacy.io/api/top-level#displacy.serve USAGE: https://spacy.io/usage/visualizers r) simple_server)rrrrrz Using the 'z ' visualizerzServing on http://:z ... zShutting down server on port .N)wsgirefrJr rwarningswarnr W011r= make_serverappprint serve_foreverKeyboardInterrupt server_close) rrrrrrrGrHrIrJhttpdrrr$serveMs"      rXcCs&dg}|d|tdjdd}|gS)N)z Content-typeztext/html; charset=utf-8z200 OKr1zutf-8)encoding)r?encode)environstart_responseheadersresrrr$rRys rRorig_doccs@t|tr |}t|j|jddgd}|ds"t t j | ddrW| #}t|jD]}|jj|jj|jjd}|j||dq2Wd n1sRwY| d d rg}|d d D]@}|jsp|d jsqqe|j}|jd } | t|kr|| jr| d 7} | t|kr|| js||| } || |j|j|jfqe| }|D]\} } } } | | | d}|j| |dqWd n1swY| d| dfdd|D}g}|D]/}|j|jjkr||j|jj|jddq|j|jjkr||jj|j|jddq||t|dS)aGenerate dependency parse in {'words': [], 'arcs': []} format. orig_doc (Union[Doc, Span]): Document to parse. options (Dict[str, Any]): Dependency parse specific visualisation options. RETURNS (dict): Generated dependency parse keyed by words and arcs. user_data user_hooks)excludeDEPcollapse_phrasesF)taglemmaent_type)attrsNcollapse_punctTr fine_grained add_lemmacs0g|]}|jr |jn|jr|jnddqS)N)textrerf)rmtag_pos_lemma_)r"wrlrkrr$r%s zparse_deps..left)r,r-labeldirright)wordsarcssettings)rr r r vocab from_bytesto_byteshas_annotationrNrOr W005get retokenizelist noun_chunksrootrnrp ent_type_mergeis_punctnborilenappendheaddep_get_doc_settings)r_rr( retokenizernprhspanswordr,r-rrerfrgrwrxrrrr$r4sp              r4r(csd|ddfdd|jD}|sttjt|dr$|jddnd}t|}|j |||dS)aGenerate named entities in [{start: i, end: i, label: 'label'}] format. doc (Doc): Document to parse. options (Dict[str, Any]): NER-specific visualisation options. RETURNS (dict): Generated entities keyed by text (original text) and ents. kb_url_templateNc s>g|]}|j|j|j|jr|jndr|jnddqS)#)r,r-rtkb_idkb_url) start_charend_charlabel_kb_id_r9)r"rrrr$r%szparse_ents..r`title)rmr+rry) rr+rNrOr W006hasattrr`rrm)r(rr+rryrrr$r5s   r5cs|dd|dd}fdd|j|gD}dd|D}|s5t|j}ttjj||dt |d rA|j d dnd}t |}|j ||||d S) aGenerate spans in [{start_token: i, end_token: i, label: 'label'}] format. doc (Doc): Document to parse. options (Dict[str, any]): Span-specific visualisation options. RETURNS (dict): Generated span types keyed by text (original text) and spans. rN spans_keyscc sFg|]}|j|j|j|j|j|jr|jndr|jnddqS)rr)r,r- start_token end_tokenrtrr)rrr,r-rrr9)r"rrrr$r%s zparse_spans..cSsg|]}|jqSr)rm)r"tokenrrr$r%s)rkeysr`r)rmrrrytokens) rrrrrNrOr W117r9rr`rrm)r(rrrrrrryrrr$r6s"     r6funccCs(t|dsttjjt|d|adS)a4Set an optional wrapper function that is called around the generated HTML markup on displacy.render. This can be used to allow integration into other platforms, similar to Jupyter Notebooks that require functions to be called around the HTML. It can also be used to implement custom callbacks on render, or to embed the visualization in a custom page. func (callable): Function to call around markup before rendering it. Needs to take one argument, the HTML markup, and should return the desired output of displacy.render. __call__)r#N)rr7r E110r9typer@)rrrr$set_render_wrappers rcCs|j|jjdddS)N directionltr)langr)lang_rzwriting_systemr)r(rrr$rsr)#__doc__rNtypingrrrrrrerrorsr r rr r utilr rr=rrrr?r@r&strboolintrXrRr4r5r6rrrrrr$s   ;   ,    *D*%