o ۾i@sddlmZmZmZddlmZddlmZddlm Z ddl m Z e e Z eZdede fdd Zed d efd d Zedd efddZdefddZdS)) APIRouterFastAPIRequest)Response)ProfilerConfig) EngineClient) init_loggerrequestreturncCs |jjjS)N)appstate engine_client)r r]/home/ubuntu/.local/lib/python3.10/site-packages/vllm/entrypoints/serve/profile/api_router.pyr s r z/start_profile raw_requestc2tdt|IdHtdtddS)NzStarting profiler...zProfiler started. status_code)loggerinfor start_profilerrrrrr    rz /stop_profilecr)NzStopping profiler...zProfiler stopped.rr)rrr stop_profilerrrrrrrrr cCs\t|jjdd}|dust|tsJ|dur*|jdur,td|j|t dSdSdS)Nprofiler_configzeProfiler with mode '%s' is enabled in the API server. This should ONLY be used for local development!) getattrr args isinstancerprofilerr warning_onceinclude_routerrouter)r rrrr attach_router%sr#N)fastapirrrfastapi.responsesr vllm.configrvllm.engine.protocolr vllm.loggerr__name__rr"r postrrr#rrrrs