o ߥi^,@sddlZddlmZddlmZddlmZddlZddlZddl m Z m Z m Z m Z ddlmZddlmZmZddlmZmZmZmZmZmZdd lmZdd lmZeZGd d d eZ Gd ddeZ!GdddeZ"GdddeZ#GdddeZ$ddZ%e GdddeZ&e GdddeZ'e GdddeZ(e Gddde(Z)e Gdd d e(Z*e Gd!d"d"eZ+Gd#d$d$eZ,e Gd%d&d&e,Z-e Gd'd(d(e,Z.e Gd)d*d*e,Z/Gd+d,d,eZ0dS)-N)ABC) HTTPStatus)Optional)asdictdefinefield validators)ModelScopeConfig)API_RESPONSE_FIELD_DATAAPI_RESPONSE_FIELD_MESSAGE)NotLoginExceptionNotSupportError RequestErrorhandle_http_responseis_okraise_for_http_status) get_endpoint) get_loggerc@eZdZdZdZdS) AcceleratorcpugpuN)__name__ __module__ __qualname__CPUGPUrrI/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/hub/deploy.pyrrc@seZdZdZdS)VendoreasN)rrrEASrrrrr sr c@r) EASRegionz cn-beijingz cn-hangzhouN)rrrbeijinghangzhourrrrr#!rr#c@ eZdZdZdZdZdZdZdS)EASCpuInstanceTypezTEAS Cpu Instance Type, ref(https://help.aliyun.com/document_detail/144261.html) zecs.c6.2xlargezecs.c6.4xlargezecs.c6.6xlargezecs.c6.8xlargeNrrr__doc__tinysmallmediumlargerrrrr'& r'c@r&)EASGpuInstanceTypezTEAS Gpu Instance Type, ref(https://help.aliyun.com/document_detail/144261.html) zecs.gn5-c28g1.7xlargezecs.gn5-c8g1.4xlargezecs.gn6i-c24g1.12xlargezecs.gn6e-c12g1.3xlargeNr(rrrrr//r.r/cCs ||jkrtd||jfdS)NzG'min_replica' value: %s has to be smaller than 'max_replica' value: %s!) max_replica ValueError)instance attributevaluerrrmin_smaller_than_max8s r5c@sJeZdZUdZededdZee d<edede gdZ ee d<dS)ServiceScalingConfigzResource scaling config Currently we ignore max_replica Args: max_replica: maximum replica min_replica: minimum replica default validatorr0 min_replicaN) rrrr)rrger0int__annotations__r5r;rrrrr6?s r6c@sFeZdZUdZeed<eed<eej e ej ej gdZ eed<dS)ServiceResourceConfigzEas Resource request. Args: accelerator: the accelerator(cpu|gpu) instance_type: the instance type. scaling: The instance scaling config. instance_typescalingr8 acceleratorN)rrrr)strr>r6rrrrin_rrBrrrrr?Ls r?c@s eZdZdS)ServiceProviderParametersN)rrrrrrrrE\srEc@sZeZdZUdZeed<eed<eed<dZeeed<ee j e e j gdZ eed<dS) EASDeployParametersaAParameters for EAS Deployment. Args: resource_group: the resource group to deploy, current default. region: The eas instance region(eg: cn-hangzhou). access_key_id: The eas account access key id. access_key_secret: The eas account access key secret. vendor: must be 'eas' region access_key_idaccess_key_secretNresource_groupr8vendor)rrrr)rCr>rJrrr r"rrDrKrrrrrFas  rFc@sZeZdZUdZeed<eed<dZeed<dZeed<ee j e e j gdZ eed<dS) EASListParametersa@EAS instance list parameters. Args: resource_group: the resource group to deploy, current default. region: The eas instance region(eg: cn-hangzhou). access_key_id: The eas account access key id. access_key_secret: The eas account access key secret. vendor: must be 'eas' rHrINrGrJr8rK)rrrr)rCr>rGrJrr r"rrDrKrrrrrLts    rLc@s:eZdZUdZeed<eed<eed<eed<eed<dS)DeployServiceParametersa Deploy service parameters Args: instance_name: the name of the service. model_id: the modelscope model_id revision: the modelscope model revision resource: the resource requirement. provider: the cloud service provider. instance_namemodel_idrevisionresourceproviderN)rrrr)rCr>r?rErrrrrMs   rMc@seZdZdZddZdS)AttrsToQueryStringz7Convert the attrs class to json string. Args: cCsDt|jddd}t|}t|tj|}t|d|}|S)NcSs|duSNr)attrr4rrrsz1AttrsToQueryString.to_query_str..)filterz provider=%s)rrRjsondumpsprinturllibparse quote_plus)self self_dictjson_strsafe_str query_paramrrr to_query_strs   zAttrsToQueryString.to_query_strN)rrrr)rcrrrrrSs rSc@s.eZdZUeed<dZeed<dZeed<dS)ListServiceParametersrRrskipdlimitN)rrrrEr>rer=rgrrrrrds  rdc@eZdZUeed<dS)GetServiceParametersrRNrrrrEr>rrrrri ric@rh)DeleteServiceParametersrRNrjrrrrrlrkrlc @seZdZdZdddZdedededed ef d d Zded efd d Z ded efddZ  dd ede e de e fddZ dS)ServiceDeployerzEFacilitate model deployment on to supported service provider(s). NcCsB|dur|nt|_dti|_t|_|jdurtddS)Nz user-agentz5Token does not exist, please login with HubApi first.)rendpointr get_user_agentheaders get_cookiescookiesr )r^rnrrr__init__s  zServiceDeployer.__init__rOrPrNrQrRc Cs|jtjkr td|jt|||||d}|jd}t|}tj|||j |j d} t | t |j d| j tjkrU| j tjkrUt| rM| t} | St| tt| dS)aDeploy model to cloud, current we only support PAI EAS, this is an async API , and the deployment could take a while to finish remotely. Please check deploy instance status separately via checking the status. Args: model_id (str): The deployed model id revision (str): The model revision instance_name (str): The deployed model instance name. resource (ServiceResourceConfig): The service resource information. provider (ServiceProviderParameters): The service provider parameter Raises: NotSupportError: Not supported platform. RequestError: The server return error. Returns: ServiceInstanceInfo: The information of the deployed service instance. z1Not support vendor: %s ,only support EAS current.)rNrOrPrQrRz/api/v1/deployer/endpoint)rXrrrpcreate_serviceN)rKr r"r rMrnrrequestspostrrrprlogger status_coderOKMULTIPLE_CHOICESrrXr rr r) r^rOrPrNrQrR create_paramspathbodyrdatarrrcreates4     zServiceDeployer.createcCt|d}d|j||f}tj||j|jd}t|t|jd|j t j kr=t | r5| t}|St| tt|dS)aQuery the specified instance information. Args: instance_name (str): The deployed instance name. provider (ServiceProviderParameters): The cloud provider information, for eas need region(eg: ch-hangzhou), access_key_id and access_key_secret. Raises: RequestError: The request is failed from server. Returns: Dict: The information of the requested service instance. rR!%s/api/v1/deployer/endpoint/%s?%srrrp get_serviceN)rirnrcrugetrrrprrwrxrryrrXr rr rr^rNrRparamsr|r~rrrrrs     zServiceDeployer.getcCr)a Delete deployed model, this api send delete command and return, it will take some to delete, please check through the cloud console. Args: instance_name (str): The instance name you want to delete. provider (ServiceProviderParameters): The cloud provider information, for eas need region(eg: ch-hangzhou), access_key_id and access_key_secret. Raises: RequestError: The request is failed. Returns: Dict: The deleted instance information. rrrdelete_serviceN)rlrnrcrudeleterrrprrwrxrryrrXr rr rrrrrrs     zServiceDeployer.deleterrfrergcCst|||d}d|j|f}tj||j|jd}t|t|jd|j t j kr>t | r6| t}|St| tt|dS)aList deployed model instances. Args: provider (ServiceProviderParameters): The cloud service provider parameter, for eas, need access_key_id and access_key_secret. skip (int, optional): start of the list, current not support. limit (int, optional): maximum number of instances return, current not support Raises: RequestError: The request is failed from server. Returns: List: List of instance information )rRrergz%s/api/v1/deployer/endpoint?%srlist_service_instancesN)rdrnrcrurrrrprrwrxrryrrXr rr r)r^rRrergrr|r~rrrrlist1s   zServiceDeployer.listrT)rrf)rrrr)rsrCr?rErrrrr=rrrrrrms&   . rm)1r[abcrhttprtypingrrXruattrsrrrrmodelscope.hub.apir modelscope.hub.constantsr r modelscope.hub.errorsr r rrrrmodelscope.hub.utils.utilsrmodelscope.utils.loggerrrwobjectrr r#r'r/r5r6r?rErFrLrMrSrdrirlrmrrrrsN