o 2wiZ@sddlZddlZddlZddlmZddlmZddlmZddl m Z m Z m Z m Z mZddlmZmZmZmZddlmZmZddlmZmZdd lmZmZmZmZmZm Z m!Z!d e"d e"fd d Z#ded e e"fddZ$     d3dede%de ede e&de'de%de&d eee ee effddZ(  d4dededed e e&d!e e'f d"d#Z)   d5d$ed%ede ed e edffd&d'Z* d6ded(e'd)e'd e e&e e&ffd*d+Z+d,e e&e fdefd-d.Z, d7d/ede%d0e e e d e e%e&ffd1d2Z-dS)8N) defaultdict)ProcessPoolExecutor)Path)AnyDictListOptionalTuple) AudioSource Recording RecordingSetinfo)Features FeatureSet)SupervisionSegmentSupervisionSet)PathlikeSeconds add_durationscompute_num_samplesfastcopyis_module_availableto_listdurationreturncCstd|dS)a Floor the duration to multiplies of 0.001 seconds. This is to avoid float precision problems with workflows like: lhotse kaldi import ... lhotse fix ... ./local/compute_fbank_imported.py (from icefall) lhotse cut trim-to-supervisions ... ./local/validate_manifest.py ... (from icefall) Without flooring, there were different lengths: Supervision end time 1093.33995833 is larger than cut end time 1093.3399375 This is still within the 2ms tolerance in K2SpeechRecognitionDataset::validate_for_asr(): https://github.com/lhotse-speech/lhotse/blob/master/lhotse/dataset/speech_recognition.py#L201 i)mathfloor)rrI/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/lhotse/kaldi.pyfloor_duration_to_millisecondssrpathcCst|}|dr Load a Kaldi data directory and convert it to a Lhotse RecordingSet and SupervisionSet manifests. For this to work, at least the wav.scp file must exist. SupervisionSet is created only when a segments file exists. reco2dur is used by default when exists (to enforce reading the duration from the audio files themselves, please set use_reco2dur = False. All the other files (text, utt2spk, etc.) are optional, and some of them might not be handled yet. In particular, feats.scp files are ignored. :param path: Path to the Kaldi data directory. :param sampling_rate: Sampling rate of the recordings. :param frame_shift: Optional, if specified, we will create a Features manifest and store the frame_shift value in it. :param map_string_to_underscores: optional string, when specified, we will replace all instances of this string in SupervisonSegment IDs to underscores. This is to help with handling underscores in Kaldi (see :func:`.export_to_kaldi`). This is also done for speaker IDs. :param use_reco2dur: If True, we will use the reco2dur file to read the durations of the recordings. If False, we will read the durations from the audio files themselves. :param num_jobs: Number of parallel jobs to use when reading the audio files. trcsdur|S|dS)N_)replace)r5)r1rrfix_idns z#load_kaldi_data_dir..fix_idwav.scpT) must_existreco2dur) float_valszMThe duration file reco2dur does not have the same length as the wav.scp filer# ) max_workers) chunksizeN[z5] Could not get duration. Failed to read audio from `z(`. Dropping the recording from manifest.g?z9Failed to load more than 20% utterances of the dataset: ""c 3sf|].\}}t|t|drdnddg|dr|ddn|dgt||dVqdS)r!commandfilerN)typechannelssource)idsourcesr/ num_samplesr)r r r&r).0 recording_id path_or_cmd) durationsr/rr s$  z&load_kaldi_data_dir..segmentsutt2spkz feats.scp) segments_path feats_pathr0cSsg|]}|qSrr%split)rK sup_stringrrr sz'load_kaldi_data_dir..text spk2genderutt2langz-1)r/r rHrLstartrchannelrXlanguagespeakergenderc 3sF|]\}}t||d|d||||d VqdS)grr[N)r)rKrec_idspkr)rNr8genders languagestextsrrrOs  r") KaldiReadermaxsplit) rE num_frames num_featuresr0r/r\r storage_type storage_path storage_keyrLrFzcFailed to import Kaldi 'feats.scp' to Lhotse: frame_shift must be not None. Feature import omitted.)/ris_dirr$load_kaldi_text_mappingis_filelenmaxrlistmapr-valuesdictzipkeysitemsloggingwarning RuntimeErrorr from_recordingsload_start_and_durationopenrfloatappendrr from_segmentsexistsrr"lhotse.features.iorfr%rU MatrixShapereadnum_rowsrnum_colsnamerLr from_featureswarningswarn)%r r/r0r1r2r3r4 recordingsr;r?exdur_valsrL dur_value recording_setsupervision_setrP utt2spk_f feats_scputt_id_to_start_and_duration supervisionsfsupervision_segmentsspeakers segment_idr\endr6r feature_setr"rffeatureslineutt_idark mat_shaper)rNr8rcrdr1r/rerload_kaldi_data_dirLs                           rFrr output_dirmap_underscores_to prefix_spk_idcsPt|}|jddddur|fdd}|r!|dd}tdd|Drtd d |D|d d td d |D|dd tdd |D|dd tdd |D|dd tdd |D|dd tdd |D|dd tdd|Drtdd |D|dd tdd|Drtdd |D|dd dSdStdd |D|d d tdd |D|dd tdd |D|dd td d |D|dd td!d |D|dd td"d |D|dd td#d|Dr td$d |D|dd td%d|Dr&td&d |D|dd dSdS)'a Export a pair of ``RecordingSet`` and ``SupervisionSet`` to a Kaldi data directory. It even supports recordings that have multiple channels but the recordings will still have to have a single ``AudioSource``. The ``RecordingSet`` and ``SupervisionSet`` must be compatible, i.e. it must be possible to create a ``CutSet`` out of them. :param recordings: a ``RecordingSet`` manifest. :param supervisions: a ``SupervisionSet`` manifest. :param output_dir: path where the Kaldi-style data directory will be created. :param map_underscores_to: optional string with which we will replace all underscores. This helps avoid issues with Kaldi data dir sorting. :param prefix_spk_id: add speaker_id as a prefix of utterance_id (this is to ensure correct sorting inside files which is required by Kaldi) .. note:: If you export a ``RecordingSet`` with multiple channels, then the resulting Kaldi data directory may not be back-compatible with Lhotse (i.e. you won't be able to import it back to Lhotse in the same form). This is because Kaldi does not inherently support multi-channel recordings, so we have to break them down into single-channel recordings. T)parentsexist_okNcs"t||jd|jddS)Nr6rHr_)rrHr7r_srrrIs   z!export_to_kaldi..cSst||jd|jdS)N-)rH)rr_rHrrrrrQcss|]}|jdkVqdS)r#N) num_channels)rKrrrrrOSz"export_to_kaldi..c Ss2i|]}|jD]}|jt||j|jddqqS)r/ transformsr)rIrHmake_wavscp_channel_string_mapr/r)rK recordingrGrrr [sz#export_to_kaldi..r9)r)r cSs*i|]}|j|jd|jd|jqS) )rHrLr\rrKsuprrrrhsrPcSi|]}|j|jqSrrHr)rKrrrrrpr;cSrr)rHrXrrrrrvrrXcSrrrrrrrr{rrQcSrrrrrrrrrutt2durcs|]}|jduVqdSNr^rKrrrrrOrcSrr)rHr^rrrrrrrZcsrrr`rrrrrOrcSrr)rHr`rrrrrr utt2genderc SsHi|] }|jD]}|jD]}|jd|t||j|jd|q qqS)r6r)rIrFrHrr/rrKrrGr]rrrrs  cSs8i|]}|jD]}|jD] }|jd||jq qqS)r6)rIrFrHrrrrrrs c SsJi|]!}t|jD]}|jd||jd|d|jd|jq qS)rr6r)rr]rHrLr\rrKrr]rrrrscS0i|]}t|jD] }|jd||jq qSr)rr]rHrXrrrrrcSrr)rr]rHr_rrrrrrcSrr)rr]rHrrrrrrrcsrrrrrrrrOrcSrr)rr]rHr^rrrrrrcsrrrrrrrrOrcSrr)rr]rHr`rrrrrr)rmkdirrtallsave_kaldi_text_mapping)rrrrrrrrexport_to_kaldi's                  rrRrSc Csi}|r|rtdr|durddl}|d}|G}t||D]9\}}|\} } } } |jdd\} } | | krKt|d|d|j | }|j |}t | |f|| <q%Wdn1siwYWd|SWd|S1swY|S)zt Load start time from segments and duration from feats, when both segments and feats.scp are available. r"Nrr#rgz and z not aligned.) rprr"rrwr%rUr'rrrr)rRrSr0rr" segments_ffeats_f segments_line feats_linerr6r\rrrrrrrr~s6    ( r~r:r<cCs~tdd}|r4|}tdd|D}Wdn1s"wY|r2dd|D}|S|r=td||S) zCLoad Kaldi files such as utt2spk, spk2gender, text, etc. as a dict.cSsdSrrrrrrrsz)load_kaldi_text_mapping..css |] }|jddVqdS)r#rgNrT)rKrrrrrOsz*load_kaldi_text_mapping..NcSsi|] \}}|t|qSr)r)rKkeyvalrrrrrz+load_kaldi_text_mapping..zNo such file: )rrprrvryr')r r:r<mappingrrrrro s  ror)cCsT|d}t|D] \}}t|||dq WddS1s#wYdS)zFSave flat dicts to Kaldi files such as utt2spk, spk2gender, text, etc.w)rCN)rsortedryprint)r)r rrvaluerrrrs "rrGrcCsF|jdkr td|jdkr!t|jdkrtdd|jdiS|jdkrt|jjd krIt|jdkrI|durIt}|jD]}|j||<q?|St|jjd krmt}|jD]}d |jd |dd |d||<qW|St}|jD]%}t|jdkrd|jd|d||<qsd|jd|d|d||<qs|Std|j)Nurlz-URL audio sources are not supported by Kaldi.rBr#z9Command audio multichannel sources are not supported yet.rz |rCz.wavz.sphz sph2pipe z -f wav -c z& -p | ffmpeg -threads 1 -i pipe:0 -ar z -f wav -threads 1 pipe:1 |zffmpeg -threads 1 -i z -ar z/ -map_channel 0.0.0 -f wav -threads 1 pipe:1 |z -map_channel 0.0.z -f wav -threads 1 pipe:1 |zUnknown AudioSource type: )rEr'rqrFrGrsuffixrv)rGr/raudiosr]rrrr sF       r)NNTr#r.)NF)NNN)FFr).rzrr collectionsrconcurrent.futuresrpathlibrtypingrrrrr lhotse.audior r r r lhotse.featuresrrlhotse.supervisionrr lhotse.utilsrrrrrrrrrr-intr$boolrrr~rorrrrrrs   $   # ` B  $