o pi$@sjddlZddlmZmZddlmZmZmZmZddl Z ddl Z ddl Z ddlmmZddlmZddlmZeddeed Bd efd d Zd dZddZej  dde jde jdeed Bd edee jeeeff ddZej  dde jde jdeed Bd edee jeeeff ddZdefdede dee je jge jfde j!fddZ"dS)N)partialsingledispatch)CallableListLiteralTuple)SlidingWindowFeature)linear_sum_assignmentmseF cost_func)r mae return_costcCst)aFind cost-minimizing permutation Parameters ---------- y1 : np.ndarray or torch.Tensor (batch_size, num_samples, num_classes_1) y2 : np.ndarray or torch.Tensor (num_samples, num_classes_2) or (batch_size, num_samples, num_classes_2) cost_func : callable or {"mse", "mae"}, optional Can be either "mse" (mean squared error) or "mae" (mean absolute error) or a callable. When callable, takes two (num_samples, num_classes) sequences and returns (num_classes, ) pairwise cost. Defaults to computing mean squared error ("mse"). return_cost : bool, optional Whether to return cost matrix. Defaults to False. Returns ------- permutated_y2 : np.ndarray or torch.Tensor (batch_size, num_samples, num_classes_1) permutations : list of tuple List of permutations so that permutation[i] == j indicates that jth speaker of y2 should be mapped to ith speaker of y1. permutation[i] == None when none of y2 speakers is mapped to ith speaker of y1. cost : np.ndarray or torch.Tensor, optional (batch_size, num_classes_1, num_classes_2) ) TypeError)y1y2r r rT/home/ubuntu/.local/lib/python3.10/site-packages/pyannote/audio/utils/permutation.py permutate%srcKstjtj||ddddS)zCompute class-wise mean-squared error Parameters ---------- Y, y : (num_frames, num_classes) torch.tensor Returns ------- mse : (num_classes, ) torch.tensor Mean-squared error none) reductionraxis)torchmeanFmse_lossYykwargsrrr mse_cost_funcEs r cKstjt||ddS)zCompute class-wise mean absolute difference error Parameters ---------- Y, y: (num_frames, num_classes) torch.tensor Returns ------- mae : (num_classes, ) torch.tensor Mean absolute difference error rr)rrabsrrrr mae_cost_funcTs r"rrreturnc sB|j\}}}t|jdkr||dd}t|jdkr!d}t||j\}} ||ks/|| krBdt|jdt|jd}t|durHdg} g} |rPg} tj|j|j|jd } t t ||D]\} \t Jdkr d d }tj ||d d }n*d kr d d }tj t|d d }ntfddt|D}Wdn1swY|krt|d d d |fdt|d }n|}dg|}t t|D]\}}||kr|||<dd|f| | dd|f<q| t||r| |qb|r| | t| fS| | fS)NzAIncorrect shape: should be (batch_size, num_frames, num_classes).zShape mismatch: z vs. .r )devicedtyper)dimr c s2g|]}dd||dfdqS)Nr*r%)expand).0ir num_classes_2y1_y2_rr s$z#permutate_torch..constant)shapelenr, ValueErrortuplerzerosr(r) enumeratezipno_grad unsqueezerr!stackrangerpadmaxr cpuappend)rrr r batch_size num_samples num_classes_1msg batch_size_ num_samples_ permutations permutated_y2costsbdiffcost padded_cost permutationk1k2rr/rpermutate_torchcsj       rTcCsPtt|t|||d}|r|\}}}|||fS|\}}||fS)Nr r )rr from_numpynumpy)rrr r outputrKrJrLrrrpermutate_numpys  rYg? segmentationsonsetc Cst||d}|j}|jj\}}}t|j|jd}d|f}t } t |D]\} \} } t t d| |dt || |ddD]} | | krJqCt| | ||j|j}|dkrp| }| |d}|| d||f}n| d||}|| |df}t|tj||dd\}\}\}t |D]D\}}t|dd|f|k}t|dd|f|k}|r| | |f|r| | |f|r|r| j| |f| |f|||fdqqCq(| S) aaBuild permutation graph Parameters ---------- segmentations : (num_chunks, num_frames, local_num_speakers)-shaped SlidingWindowFeature Raw output of segmentation model. onset : float, optionan Threshold above which a speaker is considered active. Defaults to 0.5 cost_func : callable Cost function used to find the optimal bijective mapping between speaker activations of two overlapping chunks. Expects two (num_frames, num_classes) torch.tensor as input and returns cost as a (num_classes, ) torch.tensor. Defaults to mae_cost_func. Returns ------- permutation_graph : nx.Graph Nodes are (chunk_idx, speaker_idx) tuples. An edge between two nodes indicate that those are likely to be the same speaker (the lower the value of "cost" attribute, the more likely). )r[r*r$rNTrU)rO)rsliding_windowdatar5mathfloordurationstepnxGraphr:r?rAminroundrnpnewaxisanyadd_nodeadd_edge)rZr[r chunks num_chunks num_frames_ max_lookahead lookaheadpermutation_graphCchunk segmentationcshiftthis_segmentationsthat_segmentationsrQrOthisthatthis_is_activethat_is_activerrrbuild_permutation_graphsL  . (r})r F)#r^ functoolsrrtypingrrrrnetworkxrbrWrfrtorch.nn.functionalnn functionalr pyannote.corerscipy.optimizer boolrr r"registerTensorintrTndarrayrYfloatrcr}rrrrsh    L