Learn how to efficiently fine-tuning the Llama 3.1 model using Unsloth, LoRa, and QLoRa techniques. LINKS: Colab: Unsloth: Huggingface blog: Unsloth UI: Dataset: 💻 RAG Beyond Basics Course: Let's Connect: 🦾 Discord: ☕ Buy me a Coffee: |🔴 Patreon: 💼Consulting: 📧 Business Contact: engineerprompt@ Become Member: 💻 Pre-configured localGPT VM: (use Code: PromptEngineering for 50% off). Signup for Newsletter, localgpt: TIMESTAMPS: 00:00 Introduction to Open Weight Models 00:26 Fine-Tuning Lama 3 with UnSloth 00:46 Stages of Model Training 02:21 Supervised Fine-Tuning Techniques 04:43 Setting Up the Training Environment 06:07 Understanding LoRa and QLoRa 09:15 Data Preparation for Fine-Tuning 10:51 Training and Inference 12:46 Saving and Loading Models 13:40 UnSloth's Chat UI Demo 14:44 Conclusion and Next Steps All Interesting Videos: Everything LangChain: Everything LLM: Everything Midjourney: AI Image Generation:
Hide player controls
Hide resume playing