o ei@sndZddlZddlZddlZeeZddZddZddZ eee d Z e a e a d d Zd d ZdS)zGlobal changes and platform/GPU-specific quirks, i.e. workarounds and saner defaults, sometimes due to platform-specific issues. Author: * Sylvain de Langen 2024 NcCsdtjj_dS)afDisables CuDNN benchmarking. no-op on platforms where it is already off by default. Benchmarking, when enabled, theoretically improves convolution performance by automatically comparing different kernels for some operations. However, benchmarking has to be re-run for every unique input shape, which makes it unsuitable for highly dynamic shapes. Since SpeechBrain does tend to use very varied shapes without attempting to pad the differences out, leaving benchmarking on can severely degrade training performance. This function disables it as we deem no-benchmarking to be a saner default to avoid performance bugs at the moment. As of PyTorch 2.3.0, the default is `False` for CUDA GPUs, but `True` for HIP GPUs. The HIP equivalent to CuDNN is MIOpen, but it is controlled through the same PyTorch API. FN)torchbackendscudnn benchmarkrrV/home/ubuntu/transcripts/venv/lib/python3.10/site-packages/speechbrain/utils/quirks.pydisable_cudnn_benchmarkingsrcCstjdtjddS)zPDisables JIT profiling to avoid performance issues on highly dynamic shapes.FN)r_C_jit_set_profiling_executor_jit_set_profiling_moderrrrdisable_jit_profiling*s r cCsdtjjj_dtjj_dS)acOn CUDA backends (potentially including ROCm), enables TensorFloat32 support for CuDNN and the matmul operator. This allows performing certain operations transparently at a lower precision, even in fp32 math when AMP is not in use, when otherwise tensor cores would not be used. TF32 supports accumulation into fp32, so the concern for overflowing is somewhat mitigated. On NVIDIA GPUs, this is available since Ampere (e.g. A100). See `PyTorch documentation `__ for more details.TN)rrcudamatmul allow_tf32rrrrrr2s r)rr rc CstdtdtjrtjjrtddtjvrGtjd dD]!}|dkrF|t vrAt d|dd t d t|q%ttatD]}t |qMtd S) zHApply quirks depending on the platform. Also populates `applied_quirks`.r rrSB_DISABLE_QUIRKS,zDSB_DISABLE_QUIRKS environment variable includes unknown quirk name "z". Supported quirks: [, ]N)applied_quirksaddrr is_availableversionhiposenvironsplit KNOWN_QUIRKSkeys ValueErrorjoinexcluded_quirkslog_applied_quirks)quirk_to_excludequirkrrr apply_quirksRs"        r%cCs(tddttddtdS)z:Logs whichever quirks have been applied by `apply_quirks`.z5Applied quirks (see `speechbrain.utils.quirks`): [%s]rz]Excluded quirks specified by the `SB_DISABLE_QUIRKS` environment (comma-separated list): [%s]N)loggerinfor rr!rrrrr"qsr")__doc__loggingrr getLogger__name__r&rr rrsetrr!r%r"rrrrs$