o }oi@sDddlZddlmZmZddlmZddlmZGdddeZdS)N) DataLoaderIterableDataset)MegatronDataSampler)loggingcs0eZdZdZddededeffdd ZZS) SpeechLMDataSamplerzk Overwrite the default MegatronDataSampler to not add batch sampler when iteralbe dataset is used. r dataloaderconsumed_samplesreturncst|dd}t|tjjjjrtd|d|Sz t |j}d}Wn t y.d}Ynw|s=td|jd|St|jt rOtd|jd |St ||S) zT Overwrites the MegatronDataSampler.transform_dataloader() function samplerNz$Using Lhotse sampler for dataloader z!. Skipping Megatron data sampler.TFzDataset z> does not have __len__ method. Skipping Megatron data sampler.z7 is an IterableDataset. Skipping Megatron data sampler.)getattr isinstancelhotsedatasetsamplingbase CutSamplerrinfolen TypeErrorrsupertransform_dataloader)selfrrr _has_len __class___/home/ubuntu/.local/lib/python3.10/site-packages/nemo/collections/speechlm/data/data_sampler.pyrs"    z(SpeechLMDataSampler.transform_dataloader)r)__name__ __module__ __qualname____doc__rintr __classcell__rrrrrs$r) r torch.utils.datarrnemo.lightning.pytorch.pluginsr nemo.utilsrrrrrrs