AI Tech Talk: Optimizing NN inference performance on Arm NEON and Vulkan using the Ailia SDK

Get your questions answered plus access to the slides here: Ailia SDK is an inference framework for edge devices developed and provided by ax Inc. and AXELL CORPORATION. It has three major strengths: high-speed inference, cross-platform support, and developer-friendly. In this talk, Ax Inc will introduce an overview of ailia SDK, which is being developed from scratch, and introduce an optimization method for inferring neural networks at high speed in the Arm environment by utilizing the knowledge of ailia SDK. In the case of ailia SDK, which infers ONNX at high speed in the Arm environment, we will introduce the optimization for Arm CPU using NEON and the optimal implementation of compute shader code for Arm Mali using Vulkan. In addition, we will demonstrate how various machine learning models actually operate at high speed in the Arm environment. In this talk, you will learn the following: What is the ailia SDK? How to reali