o -i@sddlmZmZmZmZddlmZddlmZddl m Z ddl m Z e e ZeZdede fdd Zed ed d ed d fd ededefddZedd efddZdefddZdS)) APIRouterFastAPIQueryRequest)ResponseN) EngineClient) init_loggerrequestreturncCs |jjjSN)appstate engine_client)r rd/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/vllm/entrypoints/serve/cache/api_router.pyrs rz/reset_prefix_cacheF)default raw_requestreset_running_requestsreset_externalcs,tdt|||IdHtddS)aP Reset the local prefix cache. Optionally, if the query parameter `reset_external=true` also resets the external (connector-managed) prefix cache. Note that we currently do not check if the prefix cache is successfully reset in the API server. Example: POST /reset_prefix_cache?reset_external=true zResetting prefix cache...N status_code)loggerinforreset_prefix_cacher)rrrrrrrs   rz/reset_mm_cachecs(tdt|IdHtddS)z Reset the multi-modal cache. Note that we currently do not check if the multi-modal cache is successfully reset in the API server. zResetting multi-modal cache...Nrr)rrrreset_mm_cacher)rrrrr/s  rr cCstjsdS|tdSr )envsVLLM_SERVER_DEV_MODEinclude_routerrouter)r rrr attach_router:sr )fastapirrrrfastapi.responsesr vllm.envsrvllm.engine.protocolr vllm.loggerr__name__rrrpostboolrrr rrrrs*