o ԰ih @sddlZddlmZddlmZmZmZmZddlm Z ddl Z dddZ ej j fdeeej ej fd efd d Zed ejjejjejjfd ededejdejdejd ejf ddZdS)N)contextmanager)OptionalListUnionCallablewrapscsfdd}|S)zCustom caching decorator that uses a provided key function Args: key_fn: Function that generates cache key from the input arguments maxsize: Maximum size of the cache cs"itfdd}|S)NcsV|i|}|vr|S|i|}tkr%tt||<|S)N)lenpopnextiter)argskwargskeyresult)cachefunckey_fnmaxsize?/home/ubuntu/.local/lib/python3.10/site-packages/cudnn/graph.pywrappers z/graph_cache..decorator..wrapperrrrrr)rrr decorators zgraph_cache..decoratorr)rrrrrr graph_cachesr heur_modesreturnc s ttsgfdd}|S)a Decorator that automatically builds a graph with specified heuristic modes. Args: heur_modes: Single heuristic mode or list of modes for graph building. **kwargs: Additional configuration options for graph building. Returns: Callable: Decorated context manager function that returns (graph, tensor_uids). Example: >>> handle = cudnn.create_handle() >>> @cudnn.jit(heur_modes=[cudnn.heur_mode.A, cudnn.heur_mode.B]) ... def my_graph(): ... with graph(handle) as g: ... X = g.tensor(name="X", dim=[8, 64, 56, 56], ... stride=[56*56*64, 1, 56*64, 64]) ... return g, [X] # Return graph and list of tensors to get UIDs for cstfdd}|S)Ncs:|i|\}}|dkr||dd|DfS)NrcSsg|]}|qSr)get_uid).0trrr Esz;jit..decorator..wrapper..)get_execution_plan_countbuild)rrgtensors)rrrrr@s  z'jit..decorator..wrapperrrr)rrr?szjit..decorator) isinstancelist)rrrrr'rjit%s   r* cudnn_graphhandlename io_data_typeintermediate_data_typecompute_data_typeccs$tj|||||d}|gfVdS)a Context manager for creating and managing a CUDNN graph object. Args: handle: CUDNN handle created with cudnn.create_handle(). name: Name of the graph for debugging purposes. io_data_type: Data type for input/output tensors. compute_data_type: Data type for computation. Yields: Tuple[cudnn.pygraph, List]: (graph object, list of tensors to get UIDs for) )r,r-r.r/r0N)cudnnpygraph)r,r-r.r/r0r%rrrgraphLsr3)r )r1 contextlibrtypingrrrr functoolsrwarningsr heur_modeAr* data_typeHALFFLOATobjectstrr2r3rrrrs<    '