o Si]@sddlZddlZddlZddlmZddlmZddlmZddl m Z m Z m Z m Z mZddlmZmZmZmZddlmZmZddlmZmZdd lmZmZmZmZmZm Z m!Z!d e"d e"fd d Z#ded e e"fddZ$     d6dede%de ede e&de'de%de&d eee ee effddZ(  d7dededed e e&d!e e'f d"d#Z)   d8d$ed%ede ed e edffd&d'Z*d9ded(e'fd)d*Z+ d:ded+e'd,e'd e e&e e&ffd-d.Z,d/e e&e fdefd0d1Z- d;d2ede%d3e e e d e e%e&ffd4d5Z.dS)<N) defaultdict)ProcessPoolExecutor)Path)AnyDictListOptionalTuple) AudioSource Recording RecordingSetinfo)Features FeatureSet)SupervisionSegmentSupervisionSet)PathlikeSeconds add_durationscompute_num_samplesfastcopyis_module_availableto_listdurationreturncCstd|dS)a Floor the duration to multiplies of 0.001 seconds. This is to avoid float precision problems with workflows like: lhotse kaldi import ... lhotse fix ... ./local/compute_fbank_imported.py (from icefall) lhotse cut trim-to-supervisions ... ./local/validate_manifest.py ... (from icefall) Without flooring, there were different lengths: Supervision end time 1093.33995833 is larger than cut end time 1093.3399375 This is still within the 2ms tolerance in K2SpeechRecognitionDataset::validate_for_asr(): https://github.com/lhotse-speech/lhotse/blob/master/lhotse/dataset/speech_recognition.py#L201 i)mathfloor)rr@/home/ubuntu/.local/lib/python3.10/site-packages/lhotse/kaldi.pyfloor_duration_to_millisecondssrpathcCst|}|dr Load a Kaldi data directory and convert it to a Lhotse RecordingSet and SupervisionSet manifests. For this to work, at least the wav.scp file must exist. SupervisionSet is created only when a segments file exists. reco2dur is used by default when exists (to enforce reading the duration from the audio files themselves, please set use_reco2dur = False. All the other files (text, utt2spk, etc.) are optional, and some of them might not be handled yet. In particular, feats.scp files are ignored. :param path: Path to the Kaldi data directory. :param sampling_rate: Sampling rate of the recordings. :param frame_shift: Optional, if specified, we will create a Features manifest and store the frame_shift value in it. :param map_string_to_underscores: optional string, when specified, we will replace all instances of this string in SupervisonSegment IDs to underscores. This is to help with handling underscores in Kaldi (see :func:`.export_to_kaldi`). This is also done for speaker IDs. :param use_reco2dur: If True, we will use the reco2dur file to read the durations of the recordings. If False, we will read the durations from the audio files themselves. :param num_jobs: Number of parallel jobs to use when reading the audio files. trcsdur|S|dS)N_)replace)r5)r1rrfix_idns z#load_kaldi_data_dir..fix_idwav.scpT) must_existreco2dur) float_valszMThe duration file reco2dur does not have the same length as the wav.scp filer# ) max_workers) chunksizeN[z5] Could not get duration. Failed to read audio from `z(`. Dropping the recording from manifest.g?z9Failed to load more than 20% utterances of the dataset: ""c 3sf|].\}}t|t|drdnddg|dr|ddn|dgt||dVqdS)r!commandfilerN)typechannelssource)idsourcesr/ num_samplesr)r r r&r).0 recording_id path_or_cmd) durationsr/rr s   z&load_kaldi_data_dir..segmentsutt2spkz feats.scp) segments_path feats_pathr0cSsg|]}|qSrr%split)rK sup_stringrrr sz'load_kaldi_data_dir..text)allow_empty_ref spk2genderutt2langz-1)r/r rHrLstartrchannelrXlanguagespeakergenderc 3sF|]\}}t||d|d||||d VqdS)grr\N)r)rKrec_idspkr)rNr8genders languagestextsrrrOs  r") KaldiReadermaxsplit) rE num_frames num_featuresr0r/r]r storage_type storage_path storage_keyrLrFzcFailed to import Kaldi 'feats.scp' to Lhotse: frame_shift must be not None. Feature import omitted.)0ris_dirr$load_kaldi_text_mappingis_filelenmaxrlistmapr-valuesdictzipkeysitemsloggingwarning RuntimeErrorr from_recordingsload_start_and_durationopenload_kaldi_text_filerfloatappendrr from_segmentsexistsrr"lhotse.features.iorgr%rU MatrixShapereadnum_rowsrnum_colsnamerLr from_featureswarningswarn)%r r/r0r1r2r3r4 recordingsr;r?exdur_valsrL dur_value recording_setsupervision_setrP utt2spk_f feats_scputt_id_to_start_and_duration supervisionsfsupervision_segmentsspeakers segment_idr]endr6r feature_setr"rgfeatureslineutt_idark mat_shaper)rNr8rdrer1r/rfrload_kaldi_data_dirLs                          rFrr output_dirmap_underscores_to prefix_spk_idcsPt|}|jddddur|fdd}|r!|dd}tdd|Drtd d |D|d d td d |D|dd tdd |D|dd tdd |D|dd tdd |D|dd tdd |D|dd tdd|Drtdd |D|dd tdd|Drtdd |D|dd dSdStdd |D|d d tdd |D|dd tdd |D|dd td d |D|dd td!d |D|dd td"d |D|dd td#d|Dr td$d |D|dd td%d|Dr&td&d |D|dd dSdS)'a Export a pair of ``RecordingSet`` and ``SupervisionSet`` to a Kaldi data directory. It even supports recordings that have multiple channels but the recordings will still have to have a single ``AudioSource``. The ``RecordingSet`` and ``SupervisionSet`` must be compatible, i.e. it must be possible to create a ``CutSet`` out of them. :param recordings: a ``RecordingSet`` manifest. :param supervisions: a ``SupervisionSet`` manifest. :param output_dir: path where the Kaldi-style data directory will be created. :param map_underscores_to: optional string with which we will replace all underscores. This helps avoid issues with Kaldi data dir sorting. :param prefix_spk_id: add speaker_id as a prefix of utterance_id (this is to ensure correct sorting inside files which is required by Kaldi) .. note:: If you export a ``RecordingSet`` with multiple channels, then the resulting Kaldi data directory may not be back-compatible with Lhotse (i.e. you won't be able to import it back to Lhotse in the same form). This is because Kaldi does not inherently support multi-channel recordings, so we have to break them down into single-channel recordings. T)parentsexist_okNcs"t||jd|jddS)Nr6rHr`)rrHr7r`srrrKs   z!export_to_kaldi..cSst||jd|jdS)N-)rH)rr`rHrrrrrScss|]}|jdkVqdS)r#N) num_channels)rKrrrrrOUz"export_to_kaldi..c Ss2i|]}|jD]}|jt||j|jddqqS)r/ transformsr)rIrHmake_wavscp_channel_string_mapr/r)rK recordingrGrrr ]sz#export_to_kaldi..r9)r)r cSs*i|]}|j|jd|jd|jqS) )rHrLr]rrKsuprrrrjsrPcSi|]}|j|jqSrrHr)rKrrrrrrr;cSrr)rHrXrrrrrxrrXcSrrrrrrrr}rrQcSrrrrrrrrrutt2durcs|]}|jduVqdSNr_rKrrrrrOrcSrr)rHr_rrrrrrr[csrrrarrrrrOrcSrr)rHrarrrrrr utt2genderc SsHi|] }|jD]}|jD]}|jd|t||j|jd|q qqS)r6r)rIrFrHrr/rrKrrGr^rrrrs  cSs8i|]}|jD]}|jD] }|jd||jq qqS)r6)rIrFrHrrrrrrs c SsJi|]!}t|jD]}|jd||jd|d|jd|jq qS)rr6r)rr^rHrLr]rrKrr^rrrrscS0i|]}t|jD] }|jd||jq qSr)rr^rHrXrrrrrcSrr)rr^rHr`rrrrrrcSrr)rr^rHrrrrrrrcsrrrrrrrrOrcSrr)rr^rHr_rrrrrrcsrrrrrrrrOrcSrr)rr^rHrarrrrrr)rmkdirruallsave_kaldi_text_mapping)rrrrrrrrexport_to_kaldi)s                  rrRrSc Csi}|r|rtdr|durddl}|d}|G}t||D]9\}}|\} } } } |jdd\} } | | krKt|d|d|j | }|j |}t | |f|| <q%Wdn1siwYWd|SWd|S1swY|S)zt Load start time from segments and duration from feats, when both segments and feats.scp are available. r"Nrr#rhz and z not aligned.) rqrr"rrxr%rUr'rrrr)rRrSr0rr" segments_ffeats_f segments_line feats_linerr6r]rrrrrrrrs6    ( rrYcCs|s td|t}|6}|D]*}|}d|vr,|jdd\}}|||<q|r5|}d||<qtd|d|dWd |S1sKwY|S) z[ Load Kaldi file `text` as a dict. Allow entry with empty ref. text (default). No such file: rr#rhzEmpty ref. text in: z ()N)rqr'rwrr%rU)r rYmappingrrkeyvaluerrrr s$      rr:r<cCs~tdd}|r4|}tdd|D}Wdn1s"wY|r2dd|D}|S|r=td||S) z=Load Kaldi files such as utt2spk, spk2gender, etc. as a dict.cSsdSrrrrrrr(sz)load_kaldi_text_mapping..css |] }|jddVqdS)r#rhNrT)rKrrrrrO+sz*load_kaldi_text_mapping..NcSsi|] \}}|t|qSr)r)rKrvalrrrr-rz+load_kaldi_text_mapping..r)rrqrrwrzr')r r:r<rrrrrrp$s  rpr)cCsT|d}t|D] \}}t|||dq WddS1s#wYdS)zFSave flat dicts to Kaldi files such as utt2spk, spk2gender, text, etc.w)rCN)rsortedrzprint)r)r rrrrrrr3s "rrGrcCsF|jdkr td|jdkr!t|jdkrtdd|jdiS|jdkrt|jjd krIt|jdkrI|durIt}|jD]}|j||<q?|St|jjd krmt}|jD]}d |jd |dd |d||<qW|St}|jD]%}t|jdkrd|jd|d||<qsd|jd|d|d||<qs|Std|j)Nurlz-URL audio sources are not supported by Kaldi.rBr#z9Command audio multichannel sources are not supported yet.rz |rCz.wavz.sphz sph2pipe z -f wav -c z& -p | ffmpeg -threads 1 -i pipe:0 -ar z -f wav -threads 1 pipe:1 |zffmpeg -threads 1 -i z -ar z/ -map_channel 0.0.0 -f wav -threads 1 pipe:1 |z -map_channel 0.0.z -f wav -threads 1 pipe:1 |zUnknown AudioSource type: )rEr'rrrFrGrsuffixrw)rGr/raudiosr^rrrr:sF       r)NNTr#r.)NF)NNN)T)FFr)/r{rr collectionsrconcurrent.futuresrpathlibrtypingrrrrr lhotse.audior r r r lhotse.featuresrrlhotse.supervisionrr lhotse.utilsrrrrrrrrrr-intr$boolrrrrrprrrrrrs   $   # b B  #