o `۷i/(@sddlZddlZddlmZmZmZmZmZdedeefddZ dedee dee fd d Z ed Z hd Z d eddfddZ  d,d edee dee deee gefdeedee f ddZd edeedeefddZd edeedeefddZd edeedeefddZd edee dee fddZd edee dee fddZd edee dee fd d!Zd edeedeefd"d#Zd ededefd$d%Zd&d'iZd eddfd(d)Zd eddfd*d+ZdS)-N)CallableListOptionalTypeTypeVarsreturncCsdddd|dDDS)z`Return a list from a comma-separated string. Trims whitespace and skips empty entries. cSsg|]}|r|qSr .0partr r X/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/serve/_private/constants_utils.py szstr_to_list..css|]}|VqdS)N)stripr r r r zstr_to_list..,)split)rr r r str_to_listsr bucket_strdefault_bucketsc Cs|dkr|Sz,dd|dD}|stdtdd|Dr&tdtt||kr2td |WStyM}z td |d t||d }~ww) a}Parse a comma-separated string of latency bucket values. Args: bucket_str: A comma-separated string of positive numbers in ascending order. default_buckets: Default bucket values to use if bucket_str is empty. Returns: A list of parsed float values. Raises: ValueError: If the format is invalid or values don't meet requirements. cSsg|]}t|qSr )floatrr xr r r rsz)parse_latency_buckets..rzEmpty bucket listcss|]}|dkVqdS)rNr rr r r r#rz(parse_latency_buckets..zBucket values must be positivez1Bucket values must be in strictly ascending orderzInvalid format for `zH`. Expected comma-separated positive numbers in ascending order. Error: N)rr ValueErroranysortedset Exceptionstr)rrbucketser r r parse_latency_bucketss* r#T>MAX_CACHED_HANDLESREQUEST_LATENCY_BUCKETS_MSMODEL_LOAD_LATENCY_BUCKETS_MS"SERVE_REQUEST_PROCESSING_TIMEOUT_SnamecCs4d}||s|tvr dStd|d|ddS)z-Validate Ray Serve environment variable name. RAY_SERVE_Nz*Got unexpected environment variable name `z3`! Ray Serve environment variables require prefix `z`. ) startswith_wrong_names_white_listr)r)required_prefixr r r _validate_name;s r.default value_typevalidation_funcexpected_value_descriptionc Cst|tj|}|dur|durdS|}nt||}z||}Wnty?}ztd|d|d|jd|d}~ww|rX||sXtd|d|d|d |jd |S) aGet environment variable with type conversion and validation. This function retrieves an environment variable, converts it to the specified type, and optionally validates the converted value. Args: name: The name of the environment variable. default: Default value to use if the environment variable is not set. If None, the function will return None without validation. value_type: Type to convert the environment variable value to (e.g., int, float, str). validation_func: Optional function that takes the converted value and returns a boolean indicating whether the value is valid. expected_value_description: Description of the expected value characteristics (e.g., "positive", "non-negative") used in error messages. Optional, expected only if validation_func is provided. Returns: The environment variable value converted to the specified type and validated, or the default value if the environment variable is not set. Raises: ValueError: If the environment variable value cannot be converted to the specified type, or if it fails the optional validation check. Also, if name validation fails. NzEnvironment variable `z ` value `z` cannot be converted to `z`!zGot unexpected value `z` for `z!` environment variable! Expected z `z`.)r.osenvironget_deprecation_warningr__name__) r)r/r0r1r2explicitly_defined_valuerawvaluer"r r r _get_env_valueIs6   r;cC t||tS)aNGet environment variable as an integer. Args: name: The name of the environment variable. default: Default value to use if the environment variable is not set. Returns: The environment variable value as an integer. Raises: ValueError: If the value cannot be converted to an integer. r;intr)r/r r r get_env_int r@cCt||tdddS)aqGet environment variable as a positive integer. Args: name: The name of the environment variable. default: Default value to use if the environment variable is not set. Returns: The environment variable value as a positive integer. Raises: ValueError: If the value cannot be converted to an integer or is not positive. cS|dkSNrr rr r r z&get_env_int_positive..positiver=r?r r r get_env_int_positive rIcCrB)auGet environment variable as a non-negative integer. Args: name: The name of the environment variable. default: Default value to use if the environment variable is not set. Returns: The environment variable value as a non-negative integer. Raises: ValueError: If the value cannot be converted to an integer or is negative. cS|dkSrDr rEr r r rFrGz*get_env_int_non_negative.. non negativer=r?r r r get_env_int_non_negativerJrMcCr<)aEGet environment variable as a float. Args: name: The name of the environment variable. default: Default value to use if the environment variable is not set. Returns: The environment variable value as a float. Raises: ValueError: If the value cannot be converted to a float. r;rr?r r r get_env_floatrArOcCrB)ajGet environment variable as a positive float. Args: name: The name of the environment variable. default: Default value to use if the environment variable is not set. Returns: The environment variable value as a positive float. Raises: ValueError: If the value cannot be converted to a float or is not positive. cSrCrDr rEr r r rFrGz(get_env_float_positive..rHrNr?r r r get_env_float_positiverJrPcCrB)anGet environment variable as a non-negative float. Args: name: The name of the environment variable. default: Default value to use if the environment variable is not set. Returns: The environment variable value as a non-negative float. Raises: ValueError: If the value cannot be converted to a float or is negative. cSrKrDr rEr r r rFrGz,get_env_float_non_negative..rLrNr?r r r get_env_float_non_negativerJrQcCr<)a:Get environment variable as a string. Args: name: The name of the environment variable. default: Default value to use if the environment variable is not set. Returns: The environment variable value as a string. Returns `None` if default is `None` and value not found. r;r r?r r r get_env_strs rScCst||t}|dkS)aGet environment variable as a boolean. Environment variable values of "1" are interpreted as True, all others as False. Args: name: The name of the environment variable. default: Default value to use if the environment variable is not set. Expects "0" or "1". Returns: True if the environment variable value is "1", False otherwise. 1rR)r)r/ env_value_strr r r get_env_bools rV#RAY_SERVE_HTTP_KEEP_ALIVE_TIMEOUT_Sz!http_options.keep_alive_timeout_scsbdtdtffdd }d}d|tvs|dkr/||}tjd|d |d |d td d dSdS)zLog replacement warning for wrong or legacy environment variables. TODO: remove this function for the '3.0.0' release. :param name: environment variable name r)rcs$|dkrdS|dkr dS|S)N'RAY_SERVE_HANDLE_METRIC_PUSH_INTERVAL_S3RAY_SERVE_HANDLE_AUTOSCALING_METRIC_PUSH_INTERVAL_Sr(&RAY_SERVE_REQUEST_PROCESSING_TIMEOUT_Sr )r)r-r r get_new_names  z*_deprecation_warning..get_new_namez3.0.0r*rXzStarting from version `z` environment variable `z"` will be deprecated. Please use `z ` instead. stacklevelN)r r,warningswarn FutureWarning)r)r\change_versionnew_namer r[r r6 s  r6cCsF|tvrtj|r!t|}tjd|d|dtdddSdSdS)zhWarn if a fully deprecated environment variable is set. :param name: environment variable name `z>` environment variable will be deprecated in the future. Use `z` in the Serve config instead.r^N)_fully_deprecated_env_varsr3r4r5r`raDeprecationWarning)r) config_optionr r r warn_if_deprecated_env_var_set)s rj)NN)r3r`typingrrrrrr rrr#r$r,r.boolr;r>r@rIrMrOrPrQrSrVrgr6rjr r r r sF" ;