o xi1@sdZddlmZddlZddlZddlZddlmZddlm Z ddl m Z m Z dd l mZe d d d Ze d dd ej_e ddd ej_e ddd ejj_e ddd ej_e ddd ej_eeZdZGdddeZd!ddZd"dd ZdS)#z7Implementation of the GCP environment for wandb launch.) annotationsN) LaunchError) get_module) GCS_URI_REevent_loop_thread_exec)AbstractEnvironmentgoogleznGoogle Cloud Platform support requires the google package. Please install it with `pip install wandb[launch]`.)requiredzgoogle.cloud.compute_v1z|Google Cloud Platform support requires the google-cloud-compute package. Please install it with `pip install wandb[launch]`.zgoogle.auth.credentialszgGoogle Cloud Platform support requires google-auth. Please install it with `pip install wandb[launch]`.zgoogle.auth.transport.requestszgoogle.api_core.exceptionszkGoogle Cloud Platform support requires google-api-core. Please install it with `pip install wandb[launch]`.zgoogle.cloud.storagezoGoogle Cloud Platform support requires google-cloud-storage. Please install it with `pip install wandb[launch].GOOGLE_CLOUD_REGIONcseZdZUdZded<dfdd Zedd d Zed d d Ze d!ddZ d"ddZ d#ddZ d$ddZ d%ddZd%ddZZS)&GcpEnvironmentzFGCP Environment. Attributes: region: The GCP region. strregionreturnNonecs*ttd|||_d|_dS)a(Initialize the GCP environment. Arguments: region: The GCP region. verify: Whether to verify the credentials, region, and project. Raises: LaunchError: If verify is True and the environment is not properly configured. z&Initializing GcpEnvironment in region N)super__init___loggerinfor_project)selfr __class__`/home/ubuntu/.local/lib/python3.10/site-packages/wandb/sdk/launch/environment/gcp_environment.pyr=s  zGcpEnvironment.__init__configdictcCsD|ddkrtd|dd|d}|std||dS)zCreate a GcpEnvironment from a config dictionary. Arguments: config: The config dictionary. Returns: GcpEnvironment: The GcpEnvironment. typegcpzJCould not create GcpEnvironment from config. Expected type 'gcp' but got 'z'.rzDCould not create GcpEnvironment from config. Missing 'region' field.r)getr)clsrrrrr from_configPs   zGcpEnvironment.from_configcCs t}|dur td||dS)zCreate a GcpEnvironment from the default configuration. Returns: GcpEnvironment: The GcpEnvironment. NaCould not create GcpEnvironment from user's gcloud configuration. Please set the default region with `gcloud config set compute/region` or set the environment variable {GCP_REGION_ENV_VAR}. Alternatively, you may specify the region explicitly in your wandb launch configuration at `$HOME/.config/wandb/launch-config.yaml`. See https://docs.wandb.ai/guides/launch/run-agent#environments for more information.r!)get_default_regionr)r#rrrr from_defaultfs   zGcpEnvironment.from_defaultcCs|jS)zGet the name of the gcp project associated with the credentials. Returns: str: The name of the gcp project. Raises: LaunchError: If the launch environment cannot be verified. )rrrrrproject{s zGcpEnvironment.project#google.auth.credentials.Credentialsc stdz*ttjj}|IdH\}}|js||_tdt|jtjjj IdHWn'tjj j yD}zt d|d}~wtjj jyW}zt d|d}~ww|js_t d|S)aGet the GCP credentials. Uses google.auth.default() to get the credentials. If the credentials are invalid, this method will refresh them. If the credentials are still invalid after refreshing, this method will raise an error. Returns: google.auth.credentials.Credentials: The GCP credentials. Raises: LaunchError: If the GCP credentials are invalid. zGetting GCP credentialsNzRefreshing GCP credentialszNo Google Cloud Platform credentials found. Please run `gcloud auth application-default login` or set the environment variable GOOGLE_APPLICATION_CREDENTIALS to the path of a valid service account key file.zCould not refresh Google Cloud Platform credentials. Please run `gcloud auth application-default login` or set the environment variable GOOGLE_APPLICATION_CREDENTIALS to the path of a valid service account key file.zInvalid Google Cloud Platform credentials. Please run `gcloud auth application-default login` or set the environment variable GOOGLE_APPLICATION_CREDENTIALS to the path of a valid service account key file.)rdebugrr authdefaultrrefresh transportrequestsRequest exceptionsDefaultCredentialsErrorr RefreshErrorvalid)rgoogle_auth_defaultcredsr(errrget_credentialss>    zGcpEnvironment.get_credentialscstd|IdHdS)a@Verify the credentials, region, and project. Credentials and region are verified by calling get_credentials(). The region and is verified by calling the compute API. Raises: LaunchError: If the credentials, region, or project are invalid. Returns: None zVerifying GCP environmentN)rr*r8r'rrrverifys zGcpEnvironment.verifyuric st|}|std||d}ttjjj}z| IdH}||dIdH}t|j |IdH}WdStj j j yR}z td|d|d|d}~wtj j jyl}z td|d|d|d}~ww) zVerify that a storage URI is valid. Arguments: uri: The storage URI. Raises: LaunchError: If the storage URI is invalid. zInvalid GCS URI: rN credentialszFailed verifying storage uri z : bucket  does not exist.z@ is not accessible. Please check your permissions and try again.)rmatchrgrouprr cloudstorageClientr8 get_bucketapi_corer1GoogleAPICallError Forbidden)rr:r>bucketcloud_storage_clientr<storage_clientr7rrrverify_storage_uris2  z!GcpEnvironment.verify_storage_urisource destinationc sftd|d|d|d|}tj|s$t|d|dt|}|s4t|d||d}|d  d }t t j j j}|Id H}z)||d Id H} t | j|Id H}t |j|Id H} t | j|Id HWd St jjjy} z+| j} | d usJz | d d} Wn tyt| } Ynwt|d| | d } ~ ww)zUpload a file to GCS. Arguments: source: The path to the local file. destination: The path to the GCS file. Raises: LaunchError: If the file cannot be uploaded. zUploading file  to zCould not upload file  to GCS destination z: File r=: Invalid GCS URI: rr/Nr;errormessage: )rr*ospathisfilerrr>r?lstriprr r@rArBr8rGblobupload_from_filenamerDr1rEresponsejson Exceptionr)rrKrL _err_prefixr>rGkeygoogle_storage_clientr<rIrXr7resprRrrr upload_files8       zGcpEnvironment.upload_filec std|d|d|d|}tj|s$t|d|dt|}|s4t|d||d}|d  d }t t j j j}|Id H}zP||d Id H} t | j|Id H}t|D]5\} } } | D]-} tj| | }tj|tj||d d }t |j|Id H}t |j|Id HqnqgWd St jjjy}z+|j}|d usJz |dd}Wn tyt|}Ynwt|d||d }~wty}z t|d||d }~ww)zUpload a directory to GCS. Arguments: source: The path to the local directory. destination: The path to the GCS directory. Raises: LaunchError: If the directory cannot be uploaded. zUploading directory rMzCould not upload directory rNz : Directory r=rOrrrPNr;\rQrRrSz: GCS upload failed: )rr*rTrUisdirrrr>r?rWrr r@rArBr8rGwalkjoinrelpathreplacerXrYrDr1rErZr[r\r)rrKrLr]r>rGr^r_r<rIroot_filesfile local_pathgcs_pathrXr7r`rRrrr upload_dirsT       zGcpEnvironment.upload_dir)rrrr)rrrr )rr )rr)rr))rr)r:rrr)rKrrLrrr)__name__ __module__ __qualname____doc____annotations__r classmethodr$r&propertyr(r8r9rJrarn __classcell__rrrrr 4s     /  #r config_namerr str | NonecCsZz!tjddd|gtjd}t|d}|rd|vr|WSWdStjy,YdSw)zGet a value from gcloud config. Arguments: config_name: The name of the config value. Returns: str: The config value, or None if the value is not set. gcloudrz get-value)stderrzutf-8unsetN) subprocess check_outputSTDOUTrdecodestripCalledProcessError)rwoutputvaluerrrget_gcloud_config_value1s  rcCstd}|s tjt}|S)zGet the default region from gcloud config or environment variables. Returns: str: The default region, or None if it cannot be determined. zcompute/region)rrTenvironr"GCP_REGION_ENV_VARr!rrrr%Fs r%)rwrrrx)rrx) rr __future__rloggingrTr|wandb.sdk.launch.errorsr wandb.utilrutilsrrabstractr r r@ compute_v1r+r<r.r/rDr1rA getLoggerrorrr rr%rrrrsN          ~