o X۷i@sRddlmZddlZddlmZddlmZddl m Z ej ddZ dd Z dS) ) annotationsN)runtime) benchmark) time_rangeccs*tz dVWtdStw)aEnable CUDA profiling during with statement. This function enables profiling on entering a with statement, and disables profiling on leaving the statement. >>> with cupyx.profiler.profile(): ... # do something you want to measure ... pass .. note:: When starting ``nvprof`` from the command line, manually setting ``--profile-from-start off`` may be required for the desired behavior. Likewise, when using ``nsys profile`` setting ``-c cudaProfilerApi`` may be required. .. seealso:: :func:`cupy.cuda.runtime.profilerStart`, :func:`cupy.cuda.runtime.profilerStop` N)_runtime profilerStart profilerStopr r M/home/ubuntu/vllm_env/lib/python3.10/site-packages/cupyx/profiler/__init__.pyprofile s r cCsddlm}||dS)zLoad the %gpu_timeit magic. This function is called when the extension is loaded via: %load_ext cupyx.profiler r)GPUTimeitMagicsN)cupyx.profiler._timeit_magicr register_magics)ipythonr r r r load_ipython_extension$s r) __future__r contextlib _contextlib cupy.cudarrcupyx.profiler._timercupyx.profiler._time_rangercontextmanagerr rr r r r s