o }oi*@sHddlmZddlZddlZejjddeedejej fddZ dS))OptionalNdevicesreturncCsFddi}|durtjrtj}ntdtjtj|d|d}|S)a  Local executor using torchrun. Args: devices (Optional[int]): Number of devices to use. If None, it will use all available CUDA devices. Returns: run.Config[run.LocalExecutor]: Configuration for the local executor using torchrun. TORCH_NCCL_AVOID_RECORD_STREAMS1NzbCannot infer the 'ntasks_per_node' parameter as CUDA is not available: please specify explicitely.torchrun)ntasks_per_nodelauncherenv_vars)torchcuda is_available device_count RuntimeErrorrunConfig LocalExecutor)rr executorr]/home/ubuntu/.local/lib/python3.10/site-packages/nemo/collections/llm/recipes/run/executor.pyrs   r)N) typingrnemo_runrr clifactoryintrrrrrrrs &