o wiS@s.ddlZddlmZGdddejjjZdS)N)loggingc@s(eZdZdZddZddZddZdS) FallbackDataseta FallbackDataset is a wrapper on an existing map-style ``torch.utils.data.Dataset``. It's used to return the previous item (or batch, depending on Dataset) whenever the underlying ``Dataset`` returns ``None``. This is useful when ``Dataset`` returns a full batch (as e.g. Lhotse datasets typically do), and wasn't able to read any of the items in that batch. Example:: >>> dataset = AudioToTextLhotseDataset(...) ... dataset = FallbackDataset(dataset) cCs||_d|_dSN)dataset _fallback)selfrrb/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/nemo/collections/common/data/fallback.py__init__!s zFallbackDataset.__init__cCs@|j|}|dur|jdurtd|jd|j}||_|S)Nz#FallbackDataset received None from z} on the first call to __getitem__, and must return None instead of an actual batch.This indicates an issue with data reading.)rrrwarning)ritemansrrr __getitem__%s   zFallbackDataset.__getitem__cCs t|jSr)lenr)rrrr __len__2s zFallbackDataset.__len__N)__name__ __module__ __qualname____doc__r rrrrrr rs   r)torch nemo.utilsrutilsdataDatasetrrrrr s