o Si @slddlmZmZddlmZddlmZddlmZGdddZ dd eed ed eed efd dZ dS))OptionalSequence)CutSet)Cut)Secondsc @sHeZdZdZ   d dededeeddfdd Zd edefd d Z dS)CutConcatenateaE A transform on batch of cuts (``CutSet``) that concatenates the cuts to minimize the total amount of padding; e.g. instead of creating a batch with 40 examples, we will merge some of the examples together adding some silence between them to avoid a large number of padding frames that waste the computation. ?Ngapduration_factor max_durationreturncCs||_||_||_dS)a\ CutConcatenate's constructor. :param gap: The duration of silence in seconds that is inserted between the cuts; it's goal is to let the model "know" that there are separate utterances in a single example. :param duration_factor: Determines the maximum duration of the concatenated cuts; by default it's 1, setting the limit at the duration of the longest cut in the batch. :param max_duration: If a value is given (in seconds), the maximum duration of concatenated cuts is fixed to the value while duration_factor is ignored. N)r r r )selfr r r r]/home/ubuntu/.local/lib/python3.10/site-packages/lhotse/dataset/cut_transforms/concatenate.py__init__s zCutConcatenate.__init__cutscCs8|jdd}t||j|jr|jdS|dj|jdS)NF) ascendingr)r r )sort_by_duration concat_cutsr r durationr )r rrrr__call__#s zCutConcatenate.__call__)rrN) __name__ __module__ __qualname____doc__rfloatrrrrrrrrrs rrNrr r r cCst|dkr t|St|dddd}|dur|djn|}d} d}|d }t|t|dD]+}||}|j||j|k}|rX||j||||<|dd }n|d7}q1|s`nq"t|S) a We're going to concatenate the cuts to minimize the amount of total padding frames used. This means that some samples in the batch will be merged together into one sample, separated by an interval of silence. This is actually solving a knapsack problem. In this initial implementation we're using a greedy approach: going from the back (i.e. the shortest cuts) we'll try to concat them to the longest cut that still has some "space" at the end. :param cuts: a list of cuts to pack. :param gap: the duration of silence inserted between concatenated cuts. :param max_duration: the maximum duration for the concatenated cuts (by default set to the duration of the first cut). :return a list of packed cuts. cSs|jS)N)r)crrrCszconcat_cuts..T)keyreverseNrF)lenr from_cutssortedrrangepadappend)rr r current_idxcan_fitshortestidxcutrrrr.s(     r)rN) typingrrlhotser lhotse.cutr lhotse.utilsrrrrrrrs   '