o piM@sddlmZmZmZmZmZddlmZddlm Z ddlm Z ddlm Z ddlm Z ddl mZdd lZdd lZdd lmZdd lmZdd lmZGd ddZd S))OptionalTextIOUnionDictAny)Path) OrderedDict) PipelineInput)PipelineOutput) Direction)FileLockN)Timeline) Annotation)Trialc @seZdZdZddZeddZejddZddZd d Z d d Z d dZ dBde e de e defddZdedefddZdedefddZ   dCde ede e de e defddZdd Zd!eddfd"d#Zd!eddfd$d%Zed&d'Z  dDd(ed!e ed)e edefd*d+Zd(eddfd,d-Zd.edefd/d0ZdEd2d3Z de!fd4d5Z"d.ed6edefd7d8Z#ed9d:Z$d;e%d6efdd?Z*d;e%d6e'e(e)ffd@dAZ+dS)FPipelinezBase tunable pipelinecCs"t|_t|_t|_d|_dS)NF)r _parameters _instantiated _pipelinestrainingselfrN/home/ubuntu/.local/lib/python3.10/site-packages/pyannote/pipeline/pipeline.py__init__0s zPipeline.__init__cCs|jSN) _trainingrrrrr>szPipeline.trainingcCs$||_|jD]\}}||_qdSr)rritemsr)rr_pipelinerrrrBscCs&|jdd}ttt||S)NT)frozen) parametershashtuplesorted_flattenr)rr rrr__hash__Is zPipeline.__hash__cCsd|jvr|jd}||vr||Sd|jvr$|jd}||vr$||Sd|jvr6|jd}||vr6||Sdt|j|}t|)z(Advanced) attribute getterrrrz!'{}' object has no attribute '{}')__dict__formattype__name__AttributeError)rnamerrrmsgrrr __getattr__Ns      zPipeline.__getattr__c sddlm}fdd}|jd}|jd}|jd}t||r:|dur-d }t|||j||||<dSt|trV|durId }t|||j||||<dS|durd|vrd||<dSt||dS) a?(Advanced) attribute setter If `value` is an instance of `Parameter`, store it in `_parameters`. elif `value` is an instance of `Pipeline`, store it in `_pipelines`. elif `value` isn't an instance of `Parameter` and `name` is in `_parameters`, store `value` in `_instantiated`. r ) Parametercs|D] }|vr |=qdSrr)dictsdr,rr remove_fromrs z)Pipeline.__setattr__..remove_fromrrrNz>cannot assign hyper-parameters before Pipeline.__init__() callz;cannot assign sub-pipelines before Pipeline.__init__() call) parameterr/r'get isinstancer+robject __setattr__) rr,valuer/r3rrrr-rr2rr8fs0      zPipeline.__setattr__cCsR||jvr |j|=dS||jvr|j|=dS||jvr!|j|=dSt||dSr)rrrr7 __delattr__)rr,rrrr:s      zPipeline.__delattr__Fr instantiatedreturnc sddlm|r|rd}t||rt|j}n|r'fdd|jD}nt|j}|jD]\}}|j||d}|D] \}} | ||d|<q@q1|S)awGet flattened dictionary of parameters Parameters ---------- frozen : `bool`, optional Only return value of frozen parameters. instantiated : `bool`, optional Only return value of instantiated parameters. Returns ------- params : `dict` Flattened dictionary of parameters. r Frozenz4one must choose between `frozen` and `instantiated`.cs"i|] \}}t|r||jqSr)r6r9).0npr=rr s z2Pipeline._flattened_parameters..r r;>) r4r> ValueErrordictrrrr_flattened_parameters) rr r;r-params pipeline_namerpipeline_paramsr,r9rr=rrGs&    zPipeline._flattened_parameters nested_paramscCsZt}|D]#\}}t|tr&||D] \}}|||d|<qq|||<q|S)aConvert nested dictionary to flattened dictionary For instance, a nested dictionary like this one: ~~~~~~~~~~~~~~~~~~~~~ param: value1 pipeline: param: value2 subpipeline: param: value3 ~~~~~~~~~~~~~~~~~~~~~ becomes the following flattened dictionary: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ param : value1 pipeline>param : value2 pipeline>subpipeline>param : value3 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Parameter --------- nested_params : `dict` Returns ------- flattened_params : `dict` rD)rFrr6r%)rrKflattened_paramsr,r9subnamesubvaluerrrr%s  zPipeline._flattenrLc Csi}dd|jD}|D]'\}}|d}t|dkr1|d}d|dd}||||<q|||<q|jD] \}} | ||||<q;|S)aConvert flattened dictionary to nested dictionary For instance, a flattened dictionary like this one: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ param : value1 pipeline>param : value2 pipeline>subpipeline>param : value3 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ becomes the following nested dictionary: ~~~~~~~~~~~~~~~~~~~~~ param: value1 pipeline: param: value2 subpipeline: param: value3 ~~~~~~~~~~~~~~~~~~~~~ Parameter --------- flattened_params : `dict` Returns ------- nested_params : `dict` cSsi|]}|iqSrr)r?r,rrrrBsz'Pipeline._unflatten..rDr rN)rrsplitlenjoin _unflatten) rrLrKrJr,r9tokensrI param_namerrrrrRs   zPipeline._unflattenNtrialcsR|s|rdurd}t||j||d}dur$fdd|D}||S)agReturns nested dictionary of (optionnaly instantiated) parameters. For a pipeline with one `param`, one sub-pipeline with its own param and its own sub-pipeline, it will returns something like: ~~~~~~~~~~~~~~~~~~~~~ param: value1 pipeline: param: value2 subpipeline: param: value3 ~~~~~~~~~~~~~~~~~~~~~ Parameter --------- trial : `Trial`, optional When provided, use trial to suggest new parameter values and return them. frozen : `bool`, optional Return frozen parameter value instantiated : `bool`, optional Return instantiated parameter values. Returns ------- params : `dict` Nested dictionary of parameters. See above for the actual format. Nz.)rErGrrR)rrUr r;r-rHrrWrr!2s# zPipeline.parameterscCdS)z8Instantiate root pipeline with current set of parametersNrrrrr initializeczPipeline.initializerHcCsddlm}|D]8\}}||jvr+t|ts"d|d}t||j||q ||jvr9t ||||q d|d}t||S)zRecursively freeze pipeline parameters Parameters ---------- params : `dict` Nested dictionary of parameters. Returns ------- self : `Pipeline` Pipeline. r r=only parameters of 'z1' pipeline can be frozen (not the whole pipeline) parameter '' does not exist) r4r>rrr6rFrEfreezersetattr)rrHr>r,r9r-rrrr^gs      zPipeline.freezecCsddlm}|D]Z\}}||jvr+t|ts"d|d}t||j||q ||jvr[t ||}t||rT|j |krTd|d|j d|d}t ||j }t |||q d |d }t|||S) zRecursively instantiate all pipelines Parameters ---------- params : `dict` Nested dictionary of parameters. Returns ------- self : `Pipeline` Instantiated pipeline. r r=r[z7' pipeline can be instantiated (not the whole pipeline)z Parameter 'z%' is frozen: using its frozen value (z) instead of the one provided (z).r\r])r4r>rrr6rFrE instantiatergetattrr9warningswarnr_rY)rrHr>r,r9r-rVrrrr`s4         zPipeline.instantiatecCs0t||}t||jdd}||kS)zEWhether pipeline has been instantiated (and therefore can be applied)Tr;)setr%r!)rr!r;rrrr;szPipeline.instantiated params_ymllossc Cs|dur |jdd}d|i}|dur||d<tj|dd}t|d,t|d d  }||Wdn1s;wYWd|SWd|S1sSwY|S) aDump parameters to disk Parameters ---------- params_yml : `Path` Path to YAML file. params : `dict`, optional Nested Parameters. Defaults to pipeline current parameters. loss : `float`, optional Loss value. Defaults to not write loss to file. Returns ------- content : `str` Content written in `param_yml`. NTrdrHrgF)default_flow_stylez.lockwmode)r!yamldumpr with_suffixopenwrite)rrfrHrgcontent content_ymlfprrr dump_paramss"    zPipeline.dump_paramscCsJt|dd}tj|tjd}Wdn1swY||dS)zInstantiate pipeline using parameters from disk Parameters ---------- param_yml : `Path` Path to YAML file. Returns ------- self : `Pipeline` Instantiated pipeline rrj)LoaderNrH)rorlload SafeLoaderr`)rrfrsrHrrr load_paramsszPipeline.load_paramsinputcCst)z-Apply pipeline on input and return its outputNotImplementedError)rrzrrr__call__rZzPipeline.__call__ pyannote.metrics.base.BaseMetriccCt)aReturn new metric (from pyannote.metrics) When this method is implemented, the returned metric is used as a replacement for the loss method below. Returns ------- metric : `pyannote.metrics.base.BaseMetric` r{rrrr get_metrics zPipeline.get_metriccCrX)Nminimizerrrrr get_directionszPipeline.get_directionoutputcCr)aCompute loss for given input/output pair Parameters ---------- input : object Pipeline input. output : object Pipeline output Returns ------- loss : `float` Loss value r{)rrzrrrrrgsz Pipeline.losscCrX)Nrttmrrrrr write_format(rZzPipeline.write_formatfilecCst|d|j||S)zWrite pipeline output to file Parameters ---------- file : file object output : object Pipeline output write_)rar)rrrrrrrp,s zPipeline.writec Cst|tr |jdd}t|tr7|jddD]\}}}d|jd|jdd|jdd |d }||qd Sd |j j d }t |)zWrite pipeline output to "rttm" file Parameters ---------- file : file object output : `pyannote.core.Timeline` or `pyannote.core.Annotation` Pipeline output string) generatorT yield_labelzSPEAKER z 1 .3f z z NDumping z, instances to "rttm" files is not supported.) r6r to_annotationr itertracksuristartdurationrp __class__r*r|)rrrstlliner-rrr write_rttm8s   zPipeline.write_rttmc Cst|tr!|D]}|jd|jdd|jdd}||qdSt|trO|jddD] \}}}|jd|jdd|jdd|d|d }||q,dSd|jj d}t |) zWrite pipeline output to "txt" file Parameters ---------- file : file object output : `pyannote.core.Timeline` or `pyannote.core.Annotation` Pipeline output rr NTrrz+ instances to "txt" files is not supported.) r6rrrendrprrrr*r|)rrrrrrrr-rrr write_txtTs    , zPipeline.write_txt)FF)NFF)NN)r<r~),r* __module__ __qualname____doc__rpropertyrsetterr&r.r8r:rboolrFrGr%rRrr!rYr^r`r;rfloatstrrtryr r r}rr rrgrrrprrrrrrrrrr-sv  1 /&: 1(3   (    r)typingrrrrrpathlibr collectionsrr r r filelockr rlrb pyannote.corerr optuna.trialrrrrrrs