ResNet Strikes Back! | Patches Are All You Need | Papers Explained

❤️ Become The AI Epiphany Patreon ❤️ ► 👨‍👩‍👧‍👦 JOIN OUR DISCORD COMMUNITY: Discord ► 📢 SUBSCRIBE TO MY MONTHLY AI NEWSLETTER: Substack ► In this video I cover 2 recent papers: * ResNet strikes back: An improved training procedure in timm * Patches Are All You Need? The ResNet paper proposes a novel training procedure and boosts ResNet-50 top-1 accuracy to over 80%! The “Patches Are All You Need“ paper shows that the template (using patch embeddings isotropic model) may be playing a more important role than the transformer block itself. ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ ✅ ResNet paper: ✅ All You Need paper: ✅ timm lib: ✅ My transformer implementation: ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ ⌚️ Timetable: 00:00 Intro 00:50 Paper 1: high