o ̳i@sRddlZddlmZmZmZmZmZeeZ edddZ Gdddee Z dS)N)AnyDictIteratorOptionalTypeVarTT) covariantc@sveZdZdZddZddZddeefdd Zd e e e ffd d Z d e fd dZddZd e e e ffddZdS)BaseNodeaBaseNodes are the base class for creating composable dataloading DAGs in ``torchdata.nodes``. Most end-users will not iterate over a BaseNode instance directly, but instead wrap it in a :class:`torchdata.nodes.Loader` which converts the DAG into a more familiar Iterable. .. code-block:: python node = MyBaseNodeImpl() loader = Loader(node) # loader supports state_dict() and load_state_dict() for epoch in range(5): for idx, batch in enumerate(loader): ... # or if using node directly: node = MyBaseNodeImpl() for epoch in range(5): node.reset() for idx, batch in enumerate(loader): ... cO d|_dS)zPSubclasses must implement this method and call super().__init__(*args, **kwargs)FN_BaseNode__initialized)selfargskwargsrM/home/ubuntu/.local/lib/python3.10/site-packages/torchdata/nodes/base_node.py__init__(s zBaseNode.__init__cCs|SNrr rrr__iter__,szBaseNode.__iter__N initial_statecCr )aResets the iterator to the beginning, or to the state passed in by initial_state. Reset is a good place to put expensive initialization, as it will be lazily called when ``next()`` or ``state_dict()`` is called. Subclasses must call ``super().reset(initial_state)``. Args: initial_state: Optional[dict] - a state dict to pass to the node. If None, reset to the beginning. TNr )r rrrrreset/s zBaseNode.resetreturncC tt|)zSubclasses must implement this method, instead of ``state_dict()``. Should only be called by BaseNode. Returns: Dict[str, Any] - a state dict that may be passed to ``reset()`` at some point in the future NotImplementedErrortyperrrr get_state; zBaseNode.get_statecCr)zSubclasses must implement this method, instead of ``__next__``. Should only be called by BaseNode. Returns: T - the next value in the sequence, or throw StopIteration rrrrrnextCrz BaseNode.nextcCs\z|jWntytdt|w|js*|d|js*tdt||S)NJself.__initialized not found, did you call super().__init__()? type(self)=fFailed to initialize after .reset(), did you call super().reset() in your .reset() method? type(self)=)r AttributeErrorrrrrrrrr__next__Ks    zBaseNode.__next__cCs\z|jWntytdt|w|js*|d|js*tdt||S)zGet a state_dict for this BaseNode. Returns: Dict[str, Any] - a state dict that may be passed to ``reset()`` at some point in the future. r Nr!)r r"rrrrrrrr state_dictXs    zBaseNode.state_dictr)__name__ __module__ __qualname____doc__rrrdictrrstrrrrrr#r$rrrrr s  r ) loggingtypingrrrrr getLoggerr%loggerrr rrrrs