o ©Ì³iª ã@s0ddlmZGdd„deƒZGdd„deƒZdS)é)ÚProtocolc@sBeZdZdZddd„Zddd„Zddd „Zdd d „Zdd d „ZdS)ÚFTRecipeInterfacea This class provides a loose structure which every LLM fine-tuning recipe should follow. Please note that the interface itself should not be a vehicle for code reuse. torchtune strictly prohibits implementation inheritance in the codebase. A few notes about the design and the need for this interface: - This interface is meant to help recipe-writers organize their code in a way which is easy to read, understand and extend. Minimizing code duplication is not the goal. Recipe-writers are encouraged to copy-paste-modify. - This interface is not meant to add constraints. If the interface comes in the way of doing stuff, it needs to be updated or a new interface should be written to support what might be a new "family" of recipes. ÚreturnNcKódS)zÜ Responsible for loading ALL of the state for the recipe from the checkpoint file, including state for the model, optimizer, dataloader and training parameters such as the epoch and seed. N©©ÚselfÚkwargsrrúO/home/ubuntu/.local/lib/python3.10/site-packages/torchtune/recipe_interfaces.pyÚload_checkpointóz!FTRecipeInterface.load_checkpointcKr)z  Responsible for setting up all of the components necessary for training. This includes model, optimizer, loss function and dataloader. Nrrrrr Úsetup"ózFTRecipeInterface.setupcKr)z„ All of the training logic, including the core loop, loss computation, gradient accumulation, and backward. Nrrrrr Útrain)rzFTRecipeInterface.traincKr)z Responsible for saving ALL of the state for the recipe, including state for the model, optimizer, dataloader and training parameters such as the epoch and seed. Nrrrrr Úsave_checkpoint0r z!FTRecipeInterface.save_checkpointcKr)z8 Any cleaning up needed for the recipe. Nrrrrr Úcleanup8ózFTRecipeInterface.cleanup©rN) Ú__name__Ú __module__Ú __qualname__Ú__doc__r r rrrrrrr r s    rc@s.eZdZdZd dd„Zd dd„Zd dd „ZdS) ÚEvalRecipeInterfacezÿ This class provides a loose structure which every LLM evaluation recipe should follow. Please note that the interface itself should not be a vehicle for code reuse. torchtune strictly prohibits implementation inheritance in the codebase. rNcKr)zk Responsible for loading ALL of the state for the recipe from the checkpoint file. Nrrrrr r Frz#EvalRecipeInterface.load_checkpointcKr)z\ Responsible for setting up all of the components necessary for evaluation. Nrrrrr r MrzEvalRecipeInterface.setupcKr)zC All of the evaluation logic, including reporting. Nrrrrr ÚevaluateSrzEvalRecipeInterface.evaluater)rrrrr r rrrrr r?s   rN)Útypingrrrrrrr Ús 5