o 8wiE>@sdZddlmZddlZddlmZddlmZddl Z ddl m Z ddl m Z mZmZmZmZddlZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZmZz ddeddDZ Wne!y{dde"dgDZ Ynwde dedeegeffddZ#ddZ$dededefddZ%de de d e d!ed"edef d#d$Z&d%edede'fd&d'Z(      d7d(e d)e d*e d+ed%edef d,d-Z)      d7d(e d)e d*e d+ed%edef d.d/Z*d0d1Z+d(e d)e d*e fd2d3Z,d(e d)e d*e d4ededee-dff d5d6Z.dS)8zCustom protocols Protocols: MyDatabase: Collection: MyProtocol: train: uris: xxx.lst annotation: xxx.rttm annotated: xxx.uem )PathN)protocol ProtocolFile)Number)TextDictCallableAnyUnion)Subset)SegmentationProtocol)SpeakerDiarizationProtocol) entry_points) get_annotated)load_lst load_trialcCi|]}|j|qSname.0eprrU/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/pyannote/database/custom.py Hrzpyannote.database.loader)groupcCrrrrrrrrNrtemplate database_ymlreturncsPt}|jtvrd|jd}t|t|jdtffdd }|S)afGet data loader based on template Parameters ---------- template : str Path format template (e.g. "/path/to/{uri}.csv"). Extension (here ".csv") determined which data loader to use. database_yml : Path Path to YAML configuration file, to which `template` is relative. Defaults to assume that `template` is absolute or relative to current working directory. Returns ------- data_loader : Callable[[ProtocolFile], Any] Callable that takes a ProtocolFile and returns some data. See also -------- pyannote.database.loader zNo loader for files with '' suffix current_filecsPttjdit|}|s d|dd}t||}||S)NNo such file or directory: 'z' (via 'z ' template).r) resolve_pathrformatabsis_fileFileNotFoundError)r#pathmsgloaderLoaderr rrrloadrs zTemplate..load)rsuffixLOADERS ValueErrorr/r)rr r*r+r/rr-rTemplateTs  r3csdtffdd }|S)Nr#csSNr)r#valuerrr/szNumericValue..loadr)r6r/rr5r NumericValuesr7r*cCs>|}|r |S|j|}|r|Sd|d}t|)aVResolve path Parameters ---------- path : `Path` Path. Can be either absolute, relative to current working directory, or relative to `database_yml` parent directory. database_yml : `Path` Path to YAML configuration file. Returns ------- resolved_path: `Path` Resolved path. zCould not find file "z".) expanduserr(parentr))r*r relative_pathr+rrrr%s  r% meta_database meta_task meta_protocol meta_subsetsubset_entriesc csZddlm}|D]\}}||} |D]} | d} t| | D]} | Vq#qq dS)a8Meta-protocol method that iterates over a subset Parameters ---------- meta_database : str "X" meta_task : str Task name (e.g. SpeakerDiarization, SpeakerVerification) meta_protocol : str Protocol name (e.g. MyProtocol) meta_subset : {"train", "development", "test"} Subset subset_entries : dict Subset entries. Etape.SpeakerDiarization.TV: [train] REPERE.SpeakerDiarization.Phase1: [train, development] REPERE.SpeakerDiarization.Phase2: [train, development] r)registry_iterN)r@items get_protocolgetattr) r;r<r=r>r?r r@rsubsetspartial_protocolsubset method_namefilerrrmeta_subset_iters   rKentriesc Cst}|D]\}}|dks|dkrqt|tr t|||<qtt|\}}}}t t |t dgdk}|rV| drNd}t ||dd}t||||<qtt||} | skd| d }t|| jtvr{d | jd }t|t| j} | | ||<q|S) aLoads all Loaders for data type specified in 'entries' into a dict. Parameters ---------- entries : Dict, optional Subset entries (eg 'uri', 'annotated', 'annotation', ...) database_yml : Path, optional Path to the 'database.yml' file Returns ------- dict A dictionary mapping each key of entry (except 'uri' and 'trial') to a function that given a ProtocolFile returns the data type related to this entry. uritrialNr_zSince version 4.1, pyannote.database is smart enough to know when paths defined in 'database.yml' contains placeholders. Remove the underscore (_) prefix to get rid of this warning.rr$'zNo loader for file with 'r")dictrC isinstancerr7zipstring Formatterparselenset startswithwarningswarnr3r%rr(r)r0r1 TypeErrorr/) rLr lazy_loaderkeyr6rO placeholders is_templater+r*r.rrrgather_loaderss4        radatabasetaskrrHc ksd|vr |d}n3d|vr+|d}d|d|d|d|d|d } t| tnd|d|d|d|} t| ttt||} t||d} | D]}t|||d || d VqNd S) a  Parameters ---------- database : str Database name (e.g. MyDatabase) task : str Task name (e.g. SpeakerDiarization, SpeakerVerification) protocol : str Protocol name (e.g. MyProtocol) subset : {"train", "development", "test"} Subset entries : dict Subset entries. database_yml : `Path` Path to the 'database.yml' file metadata : dict Additional metadata to be added to each ProtocolFile (such as "scope" or "classes") rMurisz!Found deprecated 'uris' entry in .z+. Please use 'uri' (singular) instead, in 'z'.z!Missing mandatory 'uri' entry in rLr rMrbrHlazyN) rZr[DeprecationWarningr2rr%rrar) selfrbrcrrHrLr metadatarMr+rdr]rrr subset_iters&   rmc cst||d}t|d<t}ttt|d|D]>} | d| d} } | |vr7|t| ||d|d|| <| |vrJ|t| ||d|d|| <| d|| || d Vqd S) a Parameters ---------- database : str Database name (e.g. MyDatabase) task : str Task name (e.g. SpeakerDiarization, SpeakerVerification) protocol : str Protocol name (e.g. MyProtocol) subset : {"train", "development", "test"} Subset entries : dict Subset entries. database_yml : `Path` Path to the 'database.yml' file rftry_withrNuri1uri2rgrh reference)rqfile1file2N)rarrQrr%r preprocessr) rkrbrcrrHrLr r]filesrNrorprrr subset_trialQs2    rvcsfdd}|S)Ncs(t|j|D]}|j|q dSr4)super __class____init__register_protocol)rkr protocolsrrinits zget_init..initr)r|r}rr{rget_inits r~cCs|d|d|S)N__r)rbrcrrrrget_custom_protocol_class_namesrprotocol_entriescCsztt|dkr dn|d}Wnty-d|d|d|d|d }t|YdSw|dkr6d |i}t}t|trId |vrI|d |d <t|trx|d d}|durt|d krtd |d|d|d|d }t|d|d <n||d <t} | D]c\} } | dvrd|d|d|d| d|d| d }t |q| d} |d krt t|||| | || | <qt jtf|||| | |d|| | <d| vrt jt|||| | |d| | d<qt|||} t| |f| }|t| <|S)zCreate new protocol class Parameters ---------- database : str task : str protocol : str protocol_entries : dict Returns ------- CustomProtocol : type or None Protocolz Ignoring 'rez' protocols found in z because 'z' tasks are not supported yet.N CollectionruclassesscopeXrPz ' found in za does not define the 'scope' of speaker labels (file, database, or global). Setting it to 'file'.rJ)rutrain developmenttest train_trialdevelopment_trial test_trialz ' entries are not supported yet.rA)rbrcrrHrLr rN_trial)rEprotocol_moduleAttributeErrorprintrQ issubclassrpoprrCrZr[ functoolspartialrK partialmethodrmkeysrvrtypeglobals)rbrcrrr base_classr+rlrmethodsrHr?rIcustom_protocol_class_nameCustomProtocolClassrrrcreate_protocols             r)NNNNNN)/__doc__pathlibrrTrBrr#pyannote.database.protocol.protocolrrZnumbersrtypingrr r r r rprotocol.protocolr protocol.segmentationrprotocol.speaker_diarizationrimportlib.metadatarutilrr,rrr1r\getr3r7r%rKrQrarmrvr~rrrrrrrs             , & Q 9 ;