o 2wi!@sddlmZddlmZddlZddlmZddlmZe ddZ e j dd ej d ejd d d dej de dej dedejddeddejdddeddejddde ddejdddd edd gd!d"ejd#d$d d d ed%d&d ede ded'ed(eed)e d*ed+efd,d-Ze ej d.ejd d d/dej d0ejd d d/dej d1edejdd2edd3d4ejd5d6d d7d8 d=d.ed0ed1ed9eed:eef d;d<ZdS)>)Path)OptionalN)cli)PathlikecCsdS)z%Kaldi import/export related commands.NrrrS/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/lhotse/bin/modes/kaldi.pykaldi srimport)namedata_dirTF)exists file_okay)type sampling_rate manifest_dirz-fz --frame-shiftzBFrame shift (in seconds) is required to support reading feats.scp.)rhelpz-uz--map-string-to-underscoreszWhen specified, we will replace all instances of this string in SupervisonSegment IDs to underscores. This is to help with handling underscores in Kaldi (see 'export_to_kaldi').)defaultrrz-jz --num-jobsz1Number of jobs for computing recording durations.z-tz--feature-typez kaldi-fbankz kaldi-mfccz?Feature type when importing precomputed features from feats.scp)r show_defaultrrz-dz--compute-durationszJCompute durations by reading the whole file instead of using reco2dur file)ris_flagrrr frame_shiftmap_string_to_underscoresnum_jobs feature_typecompute_durationsc Csddlm}ddlm} | |||||| |d\} } } t|}|jddd| |d| dur8| |d | durC| |d |j| | | d d |d dS)z Convert a Kaldi data dir DATA_DIR into a directory MANIFEST_DIR of lhotse manifests. Ignores feats.scp. The SAMPLING_RATE has to be explicitly specified as it is not available to read from DATA_DIR. r)CutSet)load_kaldi_data_dir)pathrrrr use_reco2durrT)parentsexist_okzrecordings.jsonl.gzNzsupervisions.jsonl.gzzfeatures.jsonl.gzg?) recordings supervisionsfeatures tolerancez cuts.jsonl.gz)lhotser lhotse.kaldirrmkdirto_filefrom_manifests) r rrrrrrrrr recording_setmaybe_supervision_setmaybe_feature_setrrrimport_s2 9   r-r!)r dir_okayr" output_dirz--map-underscores-tozoOptional string with which we will replace all underscores.This helps avoid issues with Kaldi data dir sorting.)rrrz-pz--prefix-spk-idzZPrefix utterance ids with speaker ids.This helps avoid issues with Kaldi data dir sorting.)rrmap_underscores_to prefix_spk_idcCs~ddlm}ddlm}t|}||||||||dtjddddtjd |d |d dd tjd |dd dS)zp Convert a pair of ``RecordingSet`` and ``SupervisionSet`` manifests into a Kaldi-style data directory. r)export_to_kaldi)load_manifest_lazy_or_eager)r!r"r/r0r1zFExport completed! You likely need to run the following Kaldi commands:Tyellow)boldfgz utils/utt2spk_to_spk2utt.pl z /utt2spk > z/spk2utt)r6z utils/fix_data_dir.sh N)r&r2lhotse.serializationr3rclicksecho)r!r"r/r0r1r2r3rrrexportds( ! r:)F)pathlibrtypingrr8lhotse.bin.modes.cli_baser lhotse.utilsrgrouprcommandargumentintoptionfloatstrChoiceboolr-r:rrrrs         )