o ©Ì³i†ã@sddededefdd„ZdS)éÚdimÚ multiple_ofÚreturncCs,dtd|dƒ}|||d|}|S)a&Scale hidden dimension for MLP to keep number of parameters and computation constant. Args: dim (int): Input dimension. multiple_of (int): Round scaled dimension to nearest multiple of `multiple_of` for clean computation. Returns: Scaled hidden dimension. éééé)Úint)rrÚ hidden_dim©r úX/home/ubuntu/.local/lib/python3.10/site-packages/torchtune/models/llama2/_model_utils.pyÚscale_hidden_dim_for_mlps r N)r)r r r r r r Ús