o %ݫi@s6dZddlZddlmZddlmZGdddZdS)zSDictionary utilities, e.g. synonym dictionaries. Authors * Sylvain de Langen 2024N) defaultdict)Iterablec@sreZdZdZddZedddZedddZd ee dd fd d Z d e de de fddZ de de fddZd S)SynonymDictionaryaLoads sets of synonym words and lets you look up if two words are synonyms. This could, for instance, be used to check for equality in the case of two spellings of the same word when normalization might be unsuitable. Synonyms are not considered to be transitive: If A is a synonym of B and B is a synonym of C, then A is NOT considered a synonym of C unless they are added in the same synonym set.cCstt|_dS)N)rsetword_map)selfrR/home/ubuntu/.local/lib/python3.10/site-packages/speechbrain/utils/dictionaries.py__init__szSynonymDictionary.__init__returncCsFt|}t}|D]}t|tr||q tdt|d|S)aParses an opened file as JSON, where the top level structure is a list of sets of synonyms (i.e. words that are all synonyms with each other), e.g. `[ ["hello", "hi"], ["say", "speak", "talk"] ]`. Arguments --------- file : file object File object that supports reading (e.g. an `open`ed file) Returns ------- SynonymDictionary Synonym dictionary frm the parsed JSON file with all synonym sets added. zUnexpected entry type z! in synonyms JSON (expected list))jsonloadr isinstancelistadd_synonym_set ValueErrortype)filed synonym_dictentryrrr from_json_files   z SynonymDictionary.from_json_filecCs<t|ddd }t|WdS1swYdS)aOpens a file and parses it as JSON, with otherwise the same semantics as :meth:`~SynonymDictionary.from_json_file`, which uses an opened file. Arguments --------- path : str Path to the JSON file Returns ------- SynonymDictionary Synonym dictionary frm the parsed JSON file with all synonym sets added. rutf8)encodingN)openrr)pathfrrr from_json_path8s$z SynonymDictionary.from_json_pathwordsNcCs,t|}|D] }|j|||hqdS)zAdd a set of words that are all synonyms with each other. Arguments --------- words : Iterable[str] List of words that should be defined as synonyms to each otherN)rrupdate)rrword_setwordrrr rKsz!SynonymDictionary.add_synonym_setabcCs||kp ||j|vS)aCheck for the equality or synonym equality of two words. Arguments --------- a : str First word to compare. May be outside of the known dictionary. b : str Second word to compare. May be outside of the known dictionary. The order of arguments does not matter. Returns ------- bool Whether `a` and `b` should be considered synonyms. Not transitive, see the main class documentation.)r)rr#r$rrr __call__XszSynonymDictionary.__call__r"cCs|j|tS)aReturns the set of synonyms for a given word. Arguments --------- word : str The word to look up the synonyms of. May be outside of the known dictionary. Returns ------- set of str Set of known synonyms for this word. Do not mutate (or copy it prior). May be empty if the word has no known synonyms.)rgetr)rr"rrr get_synonyms_forksz"SynonymDictionary.get_synonyms_for)r r)__name__ __module__ __qualname____doc__r staticmethodrrrstrrboolr%rr'rrrr r s    r)r+r collectionsrtypingrrrrrr s