o Ii@sddlmZddlZddlmZmZmZmZmZm Z m Z ddl m Z m Z ddlmZdZd e fd efd d Zd dZddZdS))PathN)is_hpu_availableis_mlu_availableis_musa_availableis_neuron_availableis_npu_availableis_sdaa_availableis_xpu_available) ClusterConfigdefault_json_config_file)SubcommandHelpFormatterzFCreate a default config file for Accelerate with only a few flags set.no save_locationc Cst|}|jjddd|rtd|ddS|}|dvr)td|d|d }trKtj }||d <d|d <|d krGd |d<nd|d<t ritj }||d <d|d <|d krdd|d<nd|d<nt rtj }||d <d|d <|d krd|d<nd|d<ntrtj }||d <d|d <|d krd|d<nd|d<ntjrtj }||d <d|d <|d krd|d<npd|d<nktrtj } | |d <d|d <| d krd|d<nRd|d<nMtrtj } | |d <d|d <| d krd|d<n3d|d<n.tr"tj } | |d <d|d <| d krd|d<nd|d<nd} d|d <d |d <d|d<d|d<d|d<tdi|}|||S)a Creates and saves a basic cluster config to be used on a local machine with potentially multiple GPUs. Will also set CPU if it is a CPU-only machine. Args: mixed_precision (`str`, *optional*, defaults to "no"): Mixed Precision to use. Should be one of "no", "fp16", or "bf16" save_location (`str`, *optional*, defaults to `default_json_config_file`): Optional custom save location. Should be passed to `--config_file` when using `accelerate launch`. Default location is inside the huggingface cache folder (`~/.cache/huggingface`) but can be overridden by setting the `HF_HOME` environmental variable, followed by `accelerate/default_config.yaml`. T)parentsexist_okz Configuration already exists at zZ, will not override. Run `accelerate config` manually or pass a different `save_location`.F)rfp16bf16fp8zL`mixed_precision` should be one of 'no', 'fp16', 'bf16', or 'fp8'. Received LOCAL_MACHINE)compute_environmentmixed_precision num_processesuse_cpur MULTI_MLUdistributed_typeNO MULTI_SDAA MULTI_MUSA MULTI_HPU MULTI_GPU MULTI_XPU MULTI_NPU MULTI_NEURONrdebugenable_cpu_affinityN)rparentmkdirexistsprintlower ValueErrorrtorchmlu device_countr sdaarmusarhpucuda is_availabler xpurnpurneuronr to_json_file) rrpathconfignum_mlus num_sdaas num_musasnum_hpusnum_gpusnum_xpusnum_npusnum_neuron_coresr'r'V/home/ubuntu/.local/lib/python3.10/site-packages/accelerate/commands/config/default.pywrite_basic_config%s                            rEcCsL|jd|ttd}|jdtddd|jdgdtd d d |jtd |S) Ndefault)rhelpformatter_classz --config_fileaTThe path to use to store the config file. Will default to a file named default_config.yaml in the cache location, which is the content of the environment `HF_HOME` suffixed with 'accelerate', or if you don't have such an environment variable, your cache directory ('~/.cache' or the content of `XDG_CACHE_HOME`) suffixed with 'huggingface'.r)rFrGdestz--mixed_precision)rrrzWhether or not to use mixed precision training. Choose between FP16 and BF16 (bfloat16) training. BF16 training is only supported on Nvidia Ampere GPUs and PyTorch 1.10 or later.r)choicestyperGrF)func) add_parser descriptionr add_argumentr str set_defaultsdefault_config_command)parserrr'r'rDdefault_command_parsers   rTcCs(t|j|j}|rtd|dSdS)Nz"accelerate configuration saved at )rErrr+)args config_filer'r'rDrRsrR)pathlibrr.utilsrrrrrr r config_argsr r config_utilsrrNrPrErTrRr'r'r'rDs $ i