o i@sPddlZddlZdZdefddZdeeejBdBdejdBdefdd ZdS) NlreturncCstjt@dS)N016x)uuiduuid4int MASK_64_BITSrrI/home/ubuntu/vllm_env/lib/python3.10/site-packages/vllm/utils/__init__.py random_uuid sr prompt_token_ids prompt_embedscCsl|durdnt|}|durdnt|}|dur"|dur td|S|dur4||kr4td|d||S)zjCalculate the request length (in number of tokens) give either prompt_token_ids or prompt_embeds. Nz8Neither prompt_token_ids nor prompt_embeds were defined.zJPrompt token ids and prompt embeds had different lengths prompt_token_ids=z prompt_embeds=)len ValueError)r r prompt_token_lenprompt_embeds_lenrrr &length_from_prompt_token_ids_or_embedssr) rtorchrstrr listrTensorrrrrr s