o piz=@sdZddlmZddlZddlmZddlmZddl Z ddl m Z ddl m Z mZmZmZmZddlZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZmZddeddDZ de dedeegeffddZ!ddZ"dededefddZ#de de de d ed!edef d"d#Z$d$edede%fd%d&Z&      d6d'e d(e d)e d*ed$edef d+d,Z'      d6d'e d(e d)e d*ed$edef d-d.Z(d/d0Z)d'e d(e d)e fd1d2Z*d'e d(e d)e d3ededee+dff d4d5Z,dS)7zCustom protocols Protocols: MyDatabase: Collection: MyProtocol: train: uris: xxx.lst annotation: xxx.rttm annotated: xxx.uem )PathN)protocol ProtocolFile)Number)TextDictCallableAnyUnion)Subset)SegmentationProtocol)SpeakerDiarizationProtocol) entry_points) get_annotated)load_lst load_trialcCsi|]}|j|qS)name).0eprrL/home/ubuntu/.local/lib/python3.10/site-packages/pyannote/database/custom.py Fsrzpyannote.database.loader)grouptemplate database_ymlreturncsPt}|jtvrd|jd}t|t|jdtffdd }|S)afGet data loader based on template Parameters ---------- template : str Path format template (e.g. "/path/to/{uri}.csv"). Extension (here ".csv") determined which data loader to use. database_yml : Path Path to YAML configuration file, to which `template` is relative. Defaults to assume that `template` is absolute or relative to current working directory. Returns ------- data_loader : Callable[[ProtocolFile], Any] Callable that takes a ProtocolFile and returns some data. See also -------- pyannote.database.loader zNo loader for files with '' suffix current_filecsPttjdit|}|s d|dd}t||}||S)NNo such file or directory: 'z' (via 'z ' template).r) resolve_pathrformatabsis_fileFileNotFoundError)rpathmsgloaderLoaderrrrrloadjs zTemplate..load)rsuffixLOADERS ValueErrorr+r)rrr&r'r+rr)rTemplateLs  r/csdtffdd }|S)NrcsSNr)rvaluerrr+yszNumericValue..loadr)r2r+rr1r NumericValuexsr3r&cCs>|}|r |S|j|}|r|Sd|d}t|)aVResolve path Parameters ---------- path : `Path` Path. Can be either absolute, relative to current working directory, or relative to `database_yml` parent directory. database_yml : `Path` Path to YAML configuration file. Returns ------- resolved_path: `Path` Resolved path. zCould not find file "z".) expanduserr$parentr%)r&r relative_pathr'rrrr!~s  r! meta_database meta_task meta_protocol meta_subsetsubset_entriesc csZddlm}|D]\}}||} |D]} | d} t| | D]} | Vq#qq dS)a8Meta-protocol method that iterates over a subset Parameters ---------- meta_database : str "X" meta_task : str Task name (e.g. SpeakerDiarization, SpeakerVerification) meta_protocol : str Protocol name (e.g. MyProtocol) meta_subset : {"train", "development", "test"} Subset subset_entries : dict Subset entries. Etape.SpeakerDiarization.TV: [train] REPERE.SpeakerDiarization.Phase1: [train, development] REPERE.SpeakerDiarization.Phase2: [train, development] r)registry_iterN)r<items get_protocolgetattr) r7r8r9r:r;rr<rsubsetspartial_protocolsubset method_namefilerrrmeta_subset_iters   rGentriesc Cst}|D]\}}|dks|dkrqt|tr t|||<qtt|\}}}}t t |t dgdk}|rV| drNd}t ||dd}t||||<qtt||} | skd| d }t|| jtvr{d | jd }t|t| j} | | ||<q|S) aLoads all Loaders for data type specified in 'entries' into a dict. Parameters ---------- entries : Dict, optional Subset entries (eg 'uri', 'annotated', 'annotation', ...) database_yml : Path, optional Path to the 'database.yml' file Returns ------- dict A dictionary mapping each key of entry (except 'uri' and 'trial') to a function that given a ProtocolFile returns the data type related to this entry. uritrialNr_zSince version 4.1, pyannote.database is smart enough to know when paths defined in 'database.yml' contains placeholders. Remove the underscore (_) prefix to get rid of this warning.rr 'zNo loader for file with 'r)dictr? isinstancerr3zipstring Formatterparselenset startswithwarningswarnr/r!rr$r%r,r- TypeErrorr+) rHr lazy_loaderkeyr2rK placeholders is_templater'r&r*rrrgather_loaderss4        r]databasetaskrrDc ksd|vr |d}n3d|vr+|d}d|d|d|d|d|d } t| tnd|d|d|d|} t| ttt||} t||d} | D]}t|||d || d VqNd S) a  Parameters ---------- database : str Database name (e.g. MyDatabase) task : str Task name (e.g. SpeakerDiarization, SpeakerVerification) protocol : str Protocol name (e.g. MyProtocol) subset : {"train", "development", "test"} Subset entries : dict Subset entries. database_yml : `Path` Path to the 'database.yml' file metadata : dict Additional metadata to be added to each ProtocolFile (such as "scope" or "classes") rIurisz!Found deprecated 'uris' entry in .z+. Please use 'uri' (singular) instead, in 'z'.z!Missing mandatory 'uri' entry in rHrrIr^rDlazyN) rVrWDeprecationWarningr.rr!rr]r) selfr^r_rrDrHrmetadatarIr'r`rYrrr subset_iters&   ric cst||d}t|d<t}ttt|d|D]>} | d| d} } | |vr7|t| ||d|d|| <| |vrJ|t| ||d|d|| <| d|| || d Vqd S) a Parameters ---------- database : str Database name (e.g. MyDatabase) task : str Task name (e.g. SpeakerDiarization, SpeakerVerification) protocol : str Protocol name (e.g. MyProtocol) subset : {"train", "development", "test"} Subset entries : dict Subset entries. database_yml : `Path` Path to the 'database.yml' file rbtry_withrJuri1uri2rcrd reference)rmfile1file2N)r]rrMrr!r preprocessr) rgr^r_rrDrHrrYfilesrJrkrlrrr subset_trialIs2    rrcsfdd}|S)Ncs(t|j|D]}|j|q dSr0)super __class____init__register_protocol)rgr protocolsrrinits zget_init..initr)rxryrrwrget_inits rzcCs|d|d|S)N__r)r^r_rrrrget_custom_protocol_class_namesr|protocol_entriescCsztt|dkr dn|d}Wnty-d|d|d|d|d }t|YdSw|dkr6d |i}t}t|trId |vrI|d |d <t|trx|d d}|durt|d krtd |d|d|d|d }t|d|d <n||d <t} | D]c\} } | dvrd|d|d|d| d|d| d }t |q| d} |d krt t|||| | || | <qt jtf|||| | |d|| | <d| vrt jt|||| | |d| | d<qt|||} t| |f| }|t| <|S)zCreate new protocol class Parameters ---------- database : str task : str protocol : str protocol_entries : dict Returns ------- CustomProtocol : type or None Protocolz Ignoring 'raz' protocols found in z because 'z' tasks are not supported yet.N CollectionrqclassesscopeXrLz ' found in za does not define the 'scope' of speaker labels (file, database, or global). Setting it to 'file'.rF)rqtrain developmenttest train_trialdevelopment_trial test_trialz ' entries are not supported yet.r=)r^r_rrDrHrrJ_trial)rAprotocol_moduleAttributeErrorprintrM issubclassrpoprr?rVrW functoolspartialrG partialmethodrikeysrrr|typeglobals)r^r_rr}r base_classr'rhrmethodsrDr;rEcustom_protocol_class_nameCustomProtocolClassrrrcreate_protocols             r)NNNNNN)-__doc__pathlibrrPr>rr#pyannote.database.protocol.protocolrrVnumbersrtypingrr r r r rprotocol.protocolr protocol.segmentationrprotocol.speaker_diarizationrimportlib.metadatarutilrr(rrr-r/r3r!rGrMr]rirrrzr|rrrrrrs          , & Q 9 ;