unslotUnsloth is a lhtweht tool that optimizes LLM modeling code and reduces memory usage and training time. It supports Llama and Mistral architectures and is compatible with 🤗 PEFT and TRL.Source:- Unslot AI. The multiplication order used in Unsloth’s optimization minimizes memory and computation by focusing on the smaller matrices first.