o پi @szdZddlZddlZddlmZddlmZmZmZddl m Z da ddZ da dd ed eed ed effd dZdS)z' Records the latency of some functions N)wraps)AnyCallableOptional)exponential_bucketsFcCs0ddlm}da|ddtdddd d gd adS) Nr HistogramTzsglang:func_latency_secondszFunction latency in secondsg?g?)startwidthlengthname)buckets labelnames)prometheus_clientrenable_metricsr FUNC_LATENCYrrQ/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/metrics/func_timer.pyenable_func_timers   rfuncr return.cs6dtdtfdtdtfffdd }|r||S|S)a A decorator to observe the latency of a function's execution. Supports both sync and async functions. NOTE: We use our own implementation of a timer decorator since prometheus_client does not support async context manager yet. Overhead: The overhead introduced here in case of an async function could likely be because of `await` introduced which will return in another coroutine object creation and under heavy load could see longer wall time (scheduling delays due to introduction of another awaitable). r.rcsHpjtfdd}tfdd}tr"|S|S)Nc sts |i|IdHSt}t}|i|}t|tjs%t|rIz|IdH}W|jd t||S|jd t|w|SNr ) rrtime monotonic isinstanceasyncioFuture iscoroutinelabelsobserveargskwargsmetricr retrr rr async_wrapperBs z9time_func_latency..measure..async_wrapperc sjts |i|St}t}z|i|}W|jdt||S|jdt|wr)rrrrr r!r"r'rr sync_wrapperQsz8time_func_latency..measure..sync_wrapper)__name__rriscoroutinefunction)rr(r)r)rrmeasure=s  z"time_func_latency..measure)rr)rr r,rrrtime_func_latency/s&%r-)NN)__doc__rr functoolsrtypingrrrsglang.srt.metrics.utilsrrrrstrr-rrrrs"