MInference 1.0 by Microsoft pre-release В преддверии предстоящей ICML 2024 (Вена, 21-27 июля 2024 г

Uploaded By: Myvideo

Published on

5 Jul 2024

1 view

0

0 votes

0

About Share Download Add to

MInference 1.0 by Microsoft pre-release В преддверии предстоящей ICML 2024 (Вена, 21-27 июля 2024 г.) Microsoft опубликовала результаты исследования проекта MInference. Данный метод позволяет ускорить обработку длинных последовательностей за счет разреженных вычислений, применение уникальных шаблонов в матрицах. Методика MInference не требует изменений в настройках предварительного обучения. Проведенные исследователями Microsoft синтетические тесты метода на моделях LLaMA-3-1M, GLM4-1M, Yi-200K, Phi-3-128K и Qwen2-128K показывают сокращение задержек и ошибок при предварительном заполнении до 10 раз на A100 с сохранением точности. Discuss at Huggingface GitHub Arxiv Страница проекта MInference 1.0

Share with your friends

Link:

Embed:

<iframe width="640" height="360" src="//myvideo.cc/embed/bWJlTElnNkxtdWQ4MGN6REJnMTVWREVKYnlVZU9zM2F6dERpN3hZdy8xTT0" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>

Video Size:

Custom size:

x

Autoplay video

Hide player controls

Hide resume playing

Add to Playlist:

Favorites

My Playlist

Watch Later

I Spent 100 Hours Fixing Warhammer's Most Infamous Miniature Fail!

5 hours ago

00:14:45

I Spent 100 Hours Fixing Warhammer's Most Infamous Miniature Fail!

1 92%

Questlove Supreme Podcast | Pino Palladino

9 hours ago

01:31:45

Questlove Supreme Podcast | Pino Palladino

1 36%

Rune Stone Paracord Pendant #shorts

10 hours ago

00:01:00

Rune Stone Paracord Pendant #shorts

1 91%

Lian Li LANCOOL 207 - Full Build! NEW CASE!

10 hours ago

00:12:28

Lian Li LANCOOL 207 - Full Build! NEW CASE!

1 74%

MR GFX Unreal How to Fix an Unreal Process Has Crashed UE4 - Complete Solution - levelu unloaded

13 hours ago

00:02:24

MR GFX Unreal How to Fix an Unreal Process Has Crashed UE4 - Complete Solution - levelu unloaded

10 84%

Speak About Animals in English. 158 words in 7 minutes

18 hours ago

00:07:44

Speak About Animals in English. 158 words in 7 minutes

1 29%

Seve - Sunny Kind Journey 5 SURPRISING Lessons I Learned After Simplifying Life

23 hours ago

00:08:52

Seve - Sunny Kind Journey 5 SURPRISING Lessons I Learned After Simplifying Life

8 87%

These Storms Keep Getting Bigger...

1 day ago

00:09:14

These Storms Keep Getting Bigger...

1 31%

SLIM LEGS and ROUND BOOTY in 14 Days | 10 minute Home Workout

1 day ago

00:11:34

SLIM LEGS and ROUND BOOTY in 14 Days | 10 minute Home Workout

1 31%

CURVY HOURGLASS HIPS Wider Hips & Side Booty Burn | 10 min Workout

1 day ago

00:11:05

CURVY HOURGLASS HIPS Wider Hips & Side Booty Burn | 10 min Workout

1 53%

DIY Dream Workshop Garage - Transforming an old room into a Man Cave with using Parkside Tools

1 day ago

00:29:26

DIY Dream Workshop Garage - Transforming an old room into a Man Cave with using Parkside Tools

1 80%

me and my UNREGISTERED FIREARM

1 day ago

00:02:28

me and my UNREGISTERED FIREARM

1 10%

Asians Try American Snacks in SILENT LIBRARY..!! (Ft. The Wind) I Korea, Japan, Thailand

1 day ago

00:19:15

Asians Try American Snacks in SILENT LIBRARY..!! (Ft. The Wind) I Korea, Japan, Thailand

1 40%

How to Inpaint FLUX. The BEST approaches including ControlNet and LoRA. Workflows, Tips, Comparisons

1 day ago

00:17:39

How to Inpaint FLUX. The BEST approaches including ControlNet and LoRA. Workflows, Tips, Comparisons

1 85%

Почему психология - наука Краткая история психологии. Исследования эффективности психотерапии

1 day ago

01:02:01

Почему психология - наука Краткая история психологии. Исследования эффективности психотерапии

1 38%

Почему психология - наука Краткая история психологии. Исследования эффективности психотерапии. Как работает психотерапия.

1 day ago

01:02:00

Почему психология - наука Краткая история психологии. Исследования эффективности психотерапии. Как работает психотерапия.

9 40%

Kick and Go Scooter with Auxiliary Drive Wheel: Static Test, close Right Side View

1 day ago

00:00:09

Kick and Go Scooter with Auxiliary Drive Wheel: Static Test, close Right Side View

2 26%

A Very Different Winter War in Hearts of Iron 4 | Fhrerredux

2 days ago

00:15:30

A Very Different Winter War in Hearts of Iron 4 | Fhrerredux

1 59%

Season 1: Extra Long Episode 1, 2 and 3 | H2O - Just add water

2 days ago

01:07:58

Season 1: Extra Long Episode 1, 2 and 3 | H2O - Just add water

1 17%

D-Fuse - Perfecto Presents. People (2002) PROGRESSIVE HOUSE. PROGRESSIVE TRANCE

2 days ago

02:28:48

D-Fuse - Perfecto Presents. People (2002) PROGRESSIVE HOUSE. PROGRESSIVE TRANCE

1 38%

Naoya Inoue (Japan) vs Nonito Donaire (Philippines) Full Fight Highlights

2 days ago

00:11:35

Naoya Inoue (Japan) vs Nonito Donaire (Philippines) Full Fight Highlights

1 55%

Linux Device Drivers Development Course for Beginners - Part 1

2 days ago

03:00:00

Linux Device Drivers Development Course for Beginners - Part 1

28 23%

Creating Realistic Moonlight is Complicated

2 days ago

00:09:11

Creating Realistic Moonlight is Complicated

1 83%

Crazy Chase Prototype (FOUND! Playthrough and Glitch Reel)

2 days ago

00:46:20

Crazy Chase Prototype (FOUND! Playthrough and Glitch Reel)

1 27%

0 Comments

Guest