o `۷iK" @sddlZddlZddlZddlZddlmZmZddlZddlm Z e e Z ia iiddiidZddZd d Zd d Zd dZddZddZddZddZddZddZddZddZdd Zd!d"Zd#d$Zd%d&Zd'd(Zd)d*Z d+d,Z!d-d.Z"d/d0Z#eeeeeeeeeee#ed1 Z$d2d3d4d5d6d7d8d9d:d;d Z%eeeee e!e"eed? Z&d@ee'effdAdBZ( CdMd@ee'efdDe'dEe)dFefdGdHZ*dIdJZ+dKdLZ,dS)NN)AnyDictload_function_or_class)ray.head.defaultzray.worker.defaultr)available_node_typeshead_node_type head_node worker_nodesc C@zddl}Wnty}ztd|d}~wwddlm}|S)Nrz}The Ray AWS VM launcher requires the AWS SDK for Python (Boto3) to be installed. You can install it with `pip install boto3`.)AWSNodeProvider)boto3 ImportError)ray.autoscaler._private.aws.node_providerr )provider_configr er rW/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/autoscaler/_private/providers.py _import_awss  rc Cr )NrzThe Ray GCP VM launcher requires the Google API Client to be installed. You can install it with `pip install google-api-python-client`.)GCPNodeProvider)googleapiclientr)ray.autoscaler._private.gcp.node_providerr)rrrrrrr _import_gcp,s  rcCddlm}|S)Nr)AzureNodeProvider),ray.autoscaler._private._azure.node_providerr)rrrrr _import_azure: rcCr)Nr)VsphereWcpNodeProvider)-ray.autoscaler._private.vsphere.node_providerr)rrrrr_import_vsphere@rr cCs(d|vr ddlm}|Sddlm}|S)Ncoordinator_addressr)CoordinatorSenderNodeProvider)LocalNodeProvider)7ray.autoscaler._private.local.coordinator_node_providerr"+ray.autoscaler._private.local.node_providerr#)rr"r#rrr _import_localFs   r&cCr)Nr)ReadOnlyNodeProvider).ray.autoscaler._private.readonly.node_providerr')rr'rrr_import_readonlySrr)cCr)Nr)FakeMultiNodeProvider)5ray.autoscaler._private.fake_multi_node.node_providerr*)rr*rrr_import_fake_multinodeY r,cCr)Nr)FakeMultiNodeDockerProvider)r+r.)rr.rrr_import_fake_multinode_dockerar-r/cCr)Nr)KubeRayNodeProvider)-ray.autoscaler._private.kuberay.node_providerr0)rr0rrr_import_kuberayirr2cCr)Nr)AliyunNodeProvider),ray.autoscaler._private.aliyun.node_providerr3)rr3rrr_import_aliyunorr5cCr)Nr)SparkNodeProvider)+ray.autoscaler._private.spark.node_providerr6)rr6rrr _import_sparkurr8cC0ddlmmm}tjtj|jdS)Nrz example.yaml 'ray.autoscaler._private.fake_multi_node autoscaler_privatefake_multi_nodeospathjoindirname__file__ray_fake_multinoderrr$_load_fake_multinode_defaults_config{rFcCr9Nrz defaults.yaml) ray.autoscaler._private.readonlyr<r=readonlyr?r@rArBrC) ray_readonlyrrr_load_read_only_defaults_configrGrLcCr9)Nrzexample_docker.yamlr:rDrrr+_load_fake_multinode_docker_defaults_configsrMcC*ddlmm}tjtj|jdSrH)ray.autoscaler.localr<localr?r@rArBrC) ray_localrrr_load_local_defaults_configrRcCrNrH)ray.autoscaler.awsr<awsr?r@rArBrC)ray_awsrrr_load_aws_defaults_configrSrWcCrNrH)ray.autoscaler.vspherer<vspherer?r@rArBrC) ray_vsphererrr_load_vsphere_defaults_configrSr[cCrNrH)ray.autoscaler.gcpr<gcpr?r@rArBrC)ray_gcprrr_load_gcp_defaults_configrSr_cCrNrH)ray.autoscaler.azurer<azurer?r@rArBrC) ray_azurerrr_load_azure_defaults_configrSrccCrNrH)ray.autoscaler.aliyunr<aliyunr?r@rArBrC) ray_aliyunrrr_load_aliyun_defaults_configrSrgcCst|dd}|S)Nmodule)r@r)r provider_clsrrr_import_externalsrj) rPfake_multinodefake_multinode_dockerrJrUr]rYrakuberayreexternalsparkzReadonly (Manual Cluster Setup)zFake MultinodezFake Multinode DockerLocalAWSGCPAzureKubeRayAliyunExternalvSphereSpark) rJrkrlrPrUr]rarmrernrYro) rkrlrPrUr]rarerYrJrcCs0t|d}|durtd|d||S)aQGet the node provider class for a given provider config. Note that this may be used by private node providers that proxy methods to built-in node providers, so we should maintain backwards compatibility. Args: provider_config: provider section of the autoscaler config. Returns: NodeProvider class typeNUnsupported node provider: {})_NODE_PROVIDERSgetNotImplementedErrorformat)rimporterrrr_get_node_provider_clss   rT cluster_name use_cachereturncCsHtj|dd|f}|r|tvrt|St|}|||}|r"|t|<|S)a,Get the instantiated node provider for a given provider config. Note that this may be used by private node providers that proxy methods to built-in node providers, so we should maintain backwards compatibility. Args: provider_config: provider section of the autoscaler config. cluster_name: cluster name from the autoscaler config. use_cache: whether or not to use a cached definition if available. If False, the returned object will also not be stored in the cache. Returns: NodeProvider T) sort_keys)jsondumps_provider_instancesr)rrr provider_keyri new_providerrrr_get_node_providers  rcCsiadS)N)rrrrr_clear_provider_cachesrcCs||ddkr ttSt|d}|durtd|d|}t|}t |}Wd|S1s7wY|S)zRetrieve a node provider. This is an INTERNAL API. It is not allowed to call this from any Ray package outside the autoscaler. ryrnNrz) copydeepcopyMINIMAL_EXTERNAL_CONFIG_DEFAULT_CONFIGSr|r}r~openyaml safe_load)r load_configpath_to_defaultfdefaultsrrr_get_default_configs      r)T)-rrloggingr?typingrrrray.autoscaler._private.loaderr getLogger__name__loggerrrrrrr r&r)r,r/r2r5r8rFrLrMrRrWr[r_rcrgrjr{_PROVIDER_PRETTY_NAMESrstrrboolrrrrrrrs