o ॵi@s`ddlZddlmZddlmZmZddlmZeZddZ eddd Z d d Z d d Z dS)N)contextmanager)Devices Frameworks) get_loggercCsd}|dur |dksJ||}|d}t|dks!J||dus'J|ddvs1J||d}d}t|dkrCt|d}|d krJtj}|tjkrU|durUd}||fS) a^ Verify device is valid, device should be either cpu, cuda, gpu, cuda:X or gpu:X. Args: device (str): device str, should be either cpu, cuda, gpu, gpu:X or cuda:X where X is the ordinal for gpu device. Return: device info (tuple): device_type and device_id, if device_id is not set, will use 0 as default. z^device should be either cpu, cuda, gpu, gpu:X or cuda:X where X is the ordinal for gpu device.N:r)cpucudagpur )lowersplitlenintrr ) device_nameerr_msgeles device_type device_idrK/home/ubuntu/.local/lib/python3.10/site-packages/modelscope/utils/device.py verify_device s      rgpu:0ccs&t|\}}|tjkrgddl}|tjkr|jst dtj }|tj krB| d dVWddS1s;wYdS|tjkre| d| dVWddS1s^wYdSdS|tj krddl }|tjkr|j r|j d|nt ddVdSdVdS)a Device placement function, allow user to specify which device to place model or tensor Args: framework (str): tensorflow or pytorch. device (str): gpu or cpu to use, if you want to specify certain gpu, use gpu:$gpu_id or cuda:$gpu_id. Returns: Context manager Examples: >>> # Requests for using model on cuda:0 for gpu >>> with device_placement('pytorch', device='gpu:0'): >>> model = Model.from_pretrained(...) rNz5tensorflow: cuda is not available, using cpu instead.z/CPU:0z /device:gpu:cuda:z2pytorch: cuda is not available, using cpu instead.)rrtf tensorflowrr testis_gpu_availableloggerdebugr devicetorchr is_available set_device) frameworkrrrrr"rrrdevice_placement's8    " "     r&cCsdddl}t|\}}d}|tjkrd}|jstdd}|r+|d|}|S|d}|S)z] create torch device Args: device_name (str): cpu, gpu, gpu:0, cuda:0 etc. rNFTz)cuda is not available, using cpu instead.rr ) r"rrr r r#rinfor!)rr"rruse_cudar!rrr create_deviceUs     r)cCs^ddl}ddlm}|jr(|r%|r%dtjvr%dtjd}nd}nd}||S)Nr) distributed LOCAL_RANKrzcuda:0r )r"r*r r#is_initializedosenvironr!)r"distrrrr get_devicels    r0)r) r- contextlibrmodelscope.utils.constantrrmodelscope.utils.loggerrrrr&r)r0rrrrs   -