o 9wi @s`ddlmZmZmZmZmZddlZddlmZddl m Z dee dee fddZ ddeee e ee fd ed edeee fd d Zdee e ee fdee ee ffddZddee d ed edee fddZdee ee ee dffd ed edeee fddZdd ed edee fddZdee ddfddZdeddfddZdS))ListMutableSequenceOptionalTupleUnionN)MisconfigurationException)_DEVICEgpusreturncCs:|durdSt|tstdt|dksJd|dS)a Args: gpus: Non-empty list of ints representing which GPUs to use Returns: Designated root GPU device id Raises: TypeError: If ``gpus`` is not a list AssertionError: If GPU list is empty NzGPUs should be a listrzGPUs should be a non-empty list) isinstancelist TypeErrorlen)r re/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/lightning/fabric/utilities/device_parser.py_determine_root_gpu_devices  rF include_cuda include_mpscCst||dust|tr|dkst|dvrdSt|}t|||d}|s,tdtj rHtj rHt |dkrHt t ||ddkrH|St|t|||dS)aHParses the GPU IDs given in the format as accepted by the :class:`~lightning.pytorch.trainer.trainer.Trainer`. Args: gpus: An int -1 or string '-1' indicate that all available GPUs should be used. A list of unique ints or a string containing a list of comma separated unique integers indicates specific GPUs to use. An int of 0 means that no GPUs should be used. Any int N > 0 indicates that GPUs [0..N) should be used. include_cuda: A boolean value indicating whether to include CUDA devices for GPU parsing. include_mps: A boolean value indicating whether to include MPS devices for GPU parsing. Returns: A list of GPUs to be used or ``None`` if no GPUs were requested Raises: MisconfigurationException: If no GPUs are available but the value of gpus variable indicates request for GPUs .. note:: ``include_cuda`` and ``include_mps`` default to ``False`` so that you only have to specify which device type to use and all other devices are not disabled. Nr)0z[]rrz&GPUs requested but none are available.)_check_data_typer intstrstrip!_normalize_parse_gpu_string_input"_normalize_parse_gpu_input_to_listrtorch distributed is_availableis_torchelastic_launchedr_get_all_available_gpus _check_unique_sanitize_gpu_idsr rrrrr_parse_gpu_ids0s * r%scCsBt|ts|S|dkr dSd|vrdd|dDSt|S)Nz-1,cSs$g|]}t|dkrt|qS)r)rrr).0xrrr os$z5_normalize_parse_gpu_string_input..)r rsplitrr)r&rrrris  rcCsNt||fdkr tdt||d}|D]}||vr$td|d|q|S)asChecks that each of the GPUs in the list is actually available. Raises a MisconfigurationException if any of the GPUs is not available. Args: gpus: List of ints corresponding to GPU indices Returns: Unmodified gpus variable Raises: MisconfigurationException: If machine has fewer available GPUs than requested. rz*At least one gpu type should be specified!rzYou requested gpu: z But your machine only has: )sum ValueErrorr!r)r rrall_available_gpusgpurrrr#ss r#.cCsJ|dusJt|ttfrt|S|sdS|dkrt||dStt|S)Nr'r)r rtupler r!ranger$rrrrs   rcCs<ddlm}ddlm}|r|ng}|r|ng}||S)z7 Returns: A list of all available GPUs r)_get_all_visible_cuda_devices)_get_all_available_mps_gpus)"lightning.fabric.accelerators.cudar3!lightning.fabric.accelerators.mpsr4)rrr3r4 cuda_gpusmps_gpusrrrr!s  r! device_idscCs t|tt|krtddS)zChecks that the device_ids are unique. Args: device_ids: List of ints corresponding to GPUs indices Raises: MisconfigurationException: If ``device_ids`` of GPUs aren't unique z!Device ID's (GPU) must be unique.N)rsetr)r9rrrr"s r"cCsd}|dur t|dt|ttfr0|D]}t|}|tur-t|dt|jdqdSt|ttfvrBt|d|ddS)a3Checks that the device_ids argument is one of the following: int, string, or sequence of integers. Args: device_ids: gpus/tpu_cores parameter as passed to the Trainer Raises: TypeError: If ``device_ids`` of GPU/TPUs aren't ``int``, ``str`` or sequence of ``int``` zQDevice IDs (GPU/TPU) must be an int, a string, a sequence of ints, but you passedNz Nonez a sequence of . )r r rr1typer__name__r)r9msgid_id_typerrrrs r)FF)typingrrrrrr%lightning.fabric.utilities.exceptionsr lightning.fabric.utilities.typesrrrrboolr%rr#rr!r"objectrrrrrs<     ,9$