o }oi @sBddlZddlmZddlmZddlmZGdddejZdS)N)Optional)loggingc@sheZdZdZed dejdeefddZ ed dejdeefddZ e j d d Z e j d d ZdS)WithOptionalCudaGraphszo Abstract interface for modules with CUDA graphs. Allows to enable/disable CUDA graphs on the fly. Nmoduleattribute_pathc C|r|dng}|D]7\}}|}z |D]}t||}qWn ty(Yq wt||rD|tdt|d |g|q dS)av Disable CUDA graphs Enable CUDA graphs, finding submodule recursively. Args: module: instance of nn.Module attribute_path: field containing instance of WithOptionalCudaGraphs E.g., "decoding.decoding" means that ".decoding.decoding" are checked. If None, "" is checked. .z Disabled CUDA graphs for module N) split named_modulesgetattrAttributeError isinstancedisable_cuda_graphsrinfotypejoinclsrr attributesname submoduleobject_to_check attributerf/home/ubuntu/.local/lib/python3.10/site-packages/nemo/collections/common/parts/optional_cuda_graphs.pydisable_cuda_graphs_recursive    $z4WithOptionalCudaGraphs.disable_cuda_graphs_recursivec Cr)aa Enable CUDA graphs, finding submodule recursively Args: module: instance of nn.Module attribute_path: field containing instance of WithOptionalCudaGraphs E.g., "decoding.decoding" means that ".decoding.decoding" are checked. If None, "" is checked. rzEnabled CUDA graphs for module N) r r r r r maybe_enable_cuda_graphsrrrrrrrrenable_cuda_graphs_recursive7rz3WithOptionalCudaGraphs.enable_cuda_graphs_recursivecCt)z%Disable (maybe temporary) CUDA graphsNotImplementedErrorselfrrrrQz*WithOptionalCudaGraphs.disable_cuda_graphscCr)z(Enable CUDA graphs if all conditions metr r"rrrrVr$z/WithOptionalCudaGraphs.maybe_enable_cuda_graphs)N)__name__ __module__ __qualname____doc__ classmethodnnModulerstrrrabcabstractmethodrrrrrrrs r) r-typingrtorch.nnr* nemo.utilsrABCrrrrrs