o پi @sdZddlZddlmZmZmZddlZddlZej Z dZ gdZ de fddZd ed edefd d Z dd edeedeeeeffddZdS)z0Common utilities for jit_kernel benchmark files.N)CallableListTuplecuda)g?g?g?returncCs(tdddkptdddkS)z#Check if running in CI environment.CIfalsetrueGITHUB_ACTIONS)osgetenvlowerrrU/home/ubuntu/.local/lib/python3.10/site-packages/sglang/jit_kernel/benchmark/utils.pyis_in_cisr full_rangeci_rangecCstr|S|S)z;Return appropriate benchmark range based on CI environment.)r)rrrrrget_benchmark_rangesrfn quantilescCs4|pt}tjj||d\}}}d|d|d|fS)zExecute benchmark using CUDA graph and return times in microseconds. Args: fn: Function to benchmark quantiles: Quantiles for timing measurements [median, min, max] Returns: Tuple of (median_us, max_us, min_us) )ri)DEFAULT_QUANTILEStritontestingdo_bench_cudagraph)rrmsmin_msmax_msrrr run_benchmarks r)N)__doc__r typingrrrtorchtriton.testingrbfloat16 DEFAULT_DTYPEDEFAULT_DEVICErboolrrfloatrrrrrs$