o SiES @sUddlZddlmZmZddlmZddlmZmZm Z m Z m Z m Z m Z ddlZddlmZmZddlmZmZmZddlmZmZmZmZmZddlmZmZdd l m!Z!m"Z"dd l#m$Z$m%Z%m&Z&iZ'e e(efe)d <dd&ede*d'e ej3ddfd(d)Z4e0dBz fix_manifests..rz.No recordings left after fixing the manifests.csr-r.r/r2sr(r(r)r4Gr5z0No supervisions left after fixing the manifests.)*remove_missing_recordings_and_supervisionslen frozensettrim_supervisions_to_recordings)r+r,r(r(r) fix_manifests*s r<c Cszt|tr t|g}t|trt|g}|}|}t||dt|dd|D}|D]Z}||j}|dusGJd|j d|jd|j kr[|j kr[|j dksqnJd|j d |j d |j d |j d t |j|jsJd|j d |jd|jdq/|}tdd|D}||}|rtdt|d||} | rtdt| ddSdS)aG Validate the recording and supervision manifests separately, and then check if they are consistent with each other. This method will emit warnings, instead of errors, when some recordings or supervisions are missing their counterparts. These items will be discarded by default when creating a CutSet. r!cSi|]}|j|qSr(r/r1r(r(r) ez8validate_recordings_and_supervisions..N Supervision z# references non-existent recording gMbPgMbP?zI: exceeded the bounds of its corresponding recording (supervision spans [z, z]; recording spans [0, z])z : channel zD does not exist in its corresponding Recording (recording channels: )csr-r. recording_idr6r(r(r)r4ur5z7validate_recordings_and_supervisions..z There are zR recordings that do not have any corresponding supervisions in the SupervisionSet.zR supervisions that are missing their corresponding recordings in the RecordingSet.)r"rrrrto_eagerr*getrCr0startenddurationr channel_idschannelkeysr:loggingwarningr9) r+r,rid2recr7r3 recording_idsrecording_ids_in_supsonly_in_recordingsonly_in_supervisionsr(r(r)$validate_recordings_and_supervisionsMsR      , rScstdd|D}tdd|D}||r,|fdd}tdtd||rctdd|D}|fd d}td d|D}t|t|}td|d td ||fS) a? Fix the recording and supervision manifests by removing all entries that miss their counterparts. :param recordings: a :class:`RecordingSet` object. :param supervisions: a :class:`RecordingSet` object. :return: A pair of :class:`RecordingSet` and :class:`SupervisionSet` with removed entries. csr-r.r/r1r(r(r)r4r5z=remove_missing_recordings_and_supervisions..csr-r.rBr6r(r(r)r4r5c |jvSr.r/)r3)rQr(r) z.Removed z/ recordings with no corresponding supervisions.csr-r.r/r6r(r(r)r4r5crTr.rB)r7)rRr(r)rUrVcsr-r.r/r6r(r(r)r4r5z? supervisions with no corresponding recordings (for a total of z recording IDs).)r:filterrLrMr9)r+r,rOrPsupervision_idssupervision_ids_aftern_removed_supsr()rQrRr)r8s,  r8Tverbosec Cst|tr t|g}dd|D}g}d}d}|D]&}||jj}|j|kr+|d7}q|j|kr:|d7}|j|d}||q|rM|rMt d|d|rZ|rZt d|d t |S) z Return a new :class:`~lhotse.supervision.SupervisionSet` with supervisions that are not exceeding the duration of their corresponding :class:`~lhotse.audio.Recording`. cSr=r(r/r1r(r(r)r>r?z3trim_supervisions_to_recordings..r)rGrWz6 supervisions starting after the end of the recording.zTrimmed z1 supervisions exceeding the end of the recording.) r"rrrCrHrFrGtrimappendrLrMr from_segments) r+r,r\rNsupsremovedtrimmedr7rGr(r(r)r;s0         r;cCstt|j}|t|<|S)z~ Decorator registers the function to be invoked inside ``validate()`` when the first argument's type is matching. )nextiter__annotations__valuesr)fnfirst_arg_typer(r(r)register_validatorsrjr3cCs|jdksJd|jd|jd|j|j}|jdks&Jd|jdt||jtks@Jd|jd|jd|d|rs|}|j\}}|j|ks_Jd|jd |jd ||j|ksuJd|jd |jd |dSdS) Nrz Recording (: duration has to be greater than 0 (is rAz: no channels availablez : mismatched declared duration (z$) with num_samples / sampling_rate (). : expected z channels, got  samples, got ) rHr0 num_samples sampling_rate num_channelsabsr load_audioshape)r3rexpected_durationsamplesn_chn_sr(r(r)validate_recordings*     ryr7cKs|jdksJd|jd|jd|jdurkt|jts&Jd|jd|jD]A\}}t|tr;t||dq+t|trjt ||dt |j|jsjt d|jd|jd |d |j d |jd |jd q+dSdS)Nrr@rkrAzSupervisionSegment /: custom field has to be set to a dict or None.r!z4: possibly mismatched duration between supervision ('s) and temporal array in custom field '' (num_frames= * frame_shift= == duration=rl)rHr0customr"dictitemsr validate_arrayr validate_temporal_arrayrrLrM num_frames frame_shift)r7rkwargskeyvaluer(r(r)validate_supervisions>       rf feats_datac Cs|jdksJd|jd|jdksJd|jd|jdks*Jd|jd|jdks8Jd|jd|jdksFJd|jd|jdksTJd|jdt|j|jd d }tt||ksvJd |jd |jd |dt |j|j|jd}||jksJd|jd|jd|jd|d |s|dur|r| }|j \}}|j|ksJd|jd||j|ksJd|jd|dSdS)Nrz-Features: start has to be greater than 0 (is rAz0Features: duration has to be greater than 0 (is z2Features: num_frames has to be greater than 0 (is z4Features: num_features has to be greater than 0 (is z5Features: sampling_rate has to be greater than 0 (is z3Features: frame_shift has to be greater than 0 (is )ndigitszFeatures: frame_shift of zX is incorrect because it is physically impossible; multiplying it by a sampling rate of z' results in a fractional window hop of z samples.)rHrrpz;Features: manifest is inconsistent: declared num_frames is z, but duration (zs) / frame_shift (zs) results in z frames. If you're using a custom feature extractor, you might need to ensure that it preserves this relationship between duration, frame_shift and num_frames (use rounding up if needed - see lhotse.utils.compute_num_frames).zFeatures: expected num_frames: , actual: z!Features: expected num_features: ) rFrHr num_featuresrprroundfloatintrloadrt)rrr window_hopexpected_num_framesn_frn_ftr(r(r)validate_features s`                  rarrcCs$|r|}|j|jksJdSdSr.)rrtrrdatar(r(r)r:s rcCs|jdks Jd|j|jksJd|jd|jd|jdks%Jd|jdks.Jd|r<|}|j|jks>JdSdS)Nrz/TemporalArray: temporal_dim cannot be negative.zTemporalArray: temporal_dim z canot be greater than ndim .z,TemporalArray: frame_shift must be positive.z*TemporalArray: start must be non-negative.) temporal_dimndimrrFrrtrr(r(r)rAs rcc Cst|tr9t|jdksJd|jdt|jD]\}}t|j|d|jdks6Jd|jd|dqdS|j dksKJd|jd|j d |j dks]Jd|jd |j d |j dksoJd|jd |j d |j s~|j s~Jd|jd t|trdS|j rt|j|j|jjksJ|r|}|j\}}|j|ksJd|jd |jd||j|ksJd|jd|jd||j rt|jt|jj|jsJ|r|}|j|jdksJd|jd|jd|jdt|trM|jD]H}t||j |j ks&Jd|jd|jd|j d|j d t|j|jr6t|j|jsKJd|jd|jd|jd|jd q|j!durt|j!t"scJd|jd|j!#D]h\} } t| t$rzt%| |dqht| t&rt'| |dt(|j | j st)*d|jd|j d| d| jd| j+d| j d t,|| sJd|jd| d| j d | j-d!|j d |j-d" qhdSdS)#NrzMonoCut z): Mixed cut must have at least one track.r!z MonoCut: z: track z has a negative offset.z": start must be 0 or greater (got rAz': duration must be greater than 0 (got z,: sampling_rate must be greater than 0 (got z2: must have either Features or Recording attached.z: expected num_frames: rz: expected num_features: r]rmrnz: supervision z) has a mismatched recording_id (expected z, supervision has z$ has a mismatched channel (expected rzz,: possibly mismatched duration between cut (r{r|r}r~rlz!: TemporalArray at custom field 'z@' seems to have incorrect start time (the array with time span [zs - z-s] does not overlap with cut with time span [zs]).).r"rr9tracksr0 enumerate validate_cutcutoffsetrFrHrp has_features has_recordingrrfeaturesrJchannels load_featuresrtrrry recordingrrIrsrorr,rrCrrrr rr rrrLrMrrrG) rridxtrackfeatsrrrvr7rrr(r(r)rOs   $                 rcCst}t}|D]}t||d||j||jd7<qt|dkr/td|d| ddddks>JddS)Nr!r]z@RecordingSet contains recordings with different sampling rates (z$). Make sure that this was intended.rz0RecordingSet has recordings with duplicated IDs.) setrryaddrpr0r9rLrM most_common)r+rratesidsr3r(r(r)validate_recording_sets    rc Kst}|D]}t|||jd7<q|ddddks$Jd||jD]D\}}tt}|D]}t |j trB|j nt |j }||t|j dk7<q7|D]\}} | dkrpt d| d|d|dqYq-dS)Nr]rz4SupervisionSet has supervisions with duplicated IDs.zSupervisionSet contains z, supervisions that start at 0 for recording z (channel z1). Did you forget to set supervision start times?)rrr0r _index_by_recording_id_and_cache_segments_by_recording_idrrrr"rJtuplerFrLrM) r,rrr7ridracntr_per_channelrrJcountr(r(r)validate_supervision_sets.rrc Cstt|}|j}|j}|j}t|D]F\}}t||d|j|ks1Jd|d|jd|d|j|ksEJd|d|jd|d|j|ksYJd|d|jd|dqdS)Nr!zFFeatureSet: mismatched sampling rate (the first Features manifest had z, got z in Features at index rAzEFeatureSet: mismatched num_features (the first Features manifest had zEFeatureSet: mismatched feature_type (the first Features manifest had )rdrerprr$rr)rrfirstrpr features_typerrr(r(r)validate_feature_sets8     rcutscCs|D]}t||dqdS)Nr!)r)rrrr(r(r)validate_cut_setsr)F)T)FN)s  $  &   7  &  $   / g