o i@" @sddlZddlmZmZddlmZejdddZddZ ej d d d id fd ddddgdid fdddddgdidfdddddgddddgdddgdddfgddZ ddZ dS)N)Span SpanGroup) SpanGroupsi)cs|dtjdks JjjtjdksJtdddgdjd<tdddgdjd<fdd }|jj|d S) z"Test `SpanGroups` de/serializationWill it blend?rtestnamespanstest2cs~tjdks JjdjdksJjdjdksJtjdddgks-Jtjdddgks=JdS)Nr rr rr)lenr r listdocrd/home/ubuntu/.local/lib/python3.10/site-packages/spacy/tests/serialize/test_serialize_span_groups.pyassert_spangroupss  $z*test_issue10685..assert_spangroupsN)r r from_bytesto_bytesr) en_tokenizerrrrrtest_issue10685s  rcCsp|d}|j}t|d|dd|ddgd|d<t|d|dd |d d gd|d <t|d|dd|ddgd|d <t|d |ddgd|d <t|d |ddgd|d<t|d|ddgd}||d<||d<t|d|ddgd}||d<||d<t||}||ksJ|D]\}}|j||jksJt|t||ksJqdS)zVTest the serialization of multiple mismatching `SpanGroups` keys and `SpanGroup.name`sHow now, brown cow?key1rrr rtookey2key3key4key5key6key7alsokey8key9N) r rrrrkeysitemsr r)rrgroupssg6sg8regroupskeyregrouprrr)test_span_groups_serialization_mismatches&s&&&&r/z9spans_bytes,doc_text,expected_spangroups,expected_warningFsFCnametestattrsspans(rr)rrrsCnametestattrsspans(Cnametestattrsspans()rr Tsmnamekey1attrsspans((lnametooattrsspans( (lnametooattrsspans((Cnamekey4attrsspans(Cnamekey4attrsspans(rrrr )rrr cs|||r"ttj|Wdn1swYnj|j|ks3J|D]&\}}j|j|dksGJfdd|dD}tj||ks]Jq7dS)aTest backwards-compatibility of `SpanGroups` deserialization. This uses serializations (bytes) from a prior version of spaCy (before 3.3.1). spans_bytes (bytes): Serialized `SpanGroups` object. doc_text (str): Doc text. expected_spangroups (dict): Dict mapping every expected (after deserialization) `SpanGroups` key to a SpanGroup's "args", where a SpanGroup's args are given as a dict: {"name": span_group.name, "spans": [(span0.start, span0.end), ...]} expected_warning (bool): Whether a warning is to be expected from .from_bytes() --i.e. if more than 1 SpanGroup has the same .name within the `SpanGroups`. Nr csg|] \}}t||qSr)r).0startendrrr sz7test_deserialize_span_groups_compat..r ) pytestwarns UserWarningr rr'r(r r)r spans_bytesdoc_textexpected_spangroupsexpected_warningr spangroup_argsr rrr#test_deserialize_span_groups_compatFs=  r>cCs|d}t|}|dd|ddg}t||d}||d<||d<g|d <t||}||ks9J|D]\}}td d t||||DsSJq=dS) Nz 0 1 2 3 4 5 6rr rr)r rrrcss|] \}}||kVqdS)Nr)r2span reloaded_spanrrr s  z1test_span_groups_serialization..)rrrrr'r(allzip)rr span_groupsr sg1reloaded_span_groupsr-valuerrrtest_span_groups_serializations rH) r6 spacy.tokensrrspacy.tokens._dict_proxiesrmarkissuerr/ parametrizer>rHrrrrs>          -