Introduction to Evaluation Board Kit RZ/V Series Software Package for AI

时间： 2022-03-25 来源：Renesas

技术问答

Artificial intelligence, deep learning, neural networks... The AI applications are expanding exponentially and there is not a day that goes by without hearing these words. Also, there are many people out there who have the same thoughts like – “I'm interested, but even though I've looked into it a bit, I don't quite understand how to use it. I don't know how to use it in my work, and I can’t imagine what value it will bring in my work.”

In this article, RENESAS would like to introduce AI evaluation using the software package of Renesas' embedded AI processor--RZ/V series.

The software package for AI evaluation that Renesas is introducing here uses pre-trained models provided by AI frameworks such as PyTorch, so you can evaluate the AI's execution of image inference without the time-consuming learning process.

Let’s consider a specific illustration of Vision AI evaluation.

What is required?

There is no need to purchase an evaluation board from the start. In this article, Renesas will help you experience the Vision AI implementation flow of embedded AI processor RZ/V series, using only free open source software (hereafter referred to as OSS) and a software package provided free of charge on the web by Renesas Electronics.

Figure 3. RZ/V2L AI Implementation Tool Flow Overall Structure

Figure 3 shows the overall tool flow. There are various industry standard frameworks for AI learning people are familiar with, so Renesas developed the RZ/V series where "you can use existing AI frameworks that you are familiar with for AI training, and connect the trained neural network models to Renesas tools using a common format called ONNX,” - which is an AI development flow. ONNX is a widely adopted format, and most AI frameworks are able to output in ONNX format, either directly or with a conversion tool, but Renesas will use PyTorch, an AI framework, as an example here.

In the AI world, Linux, not Windows, is the de facto standard, and all OSs and software packages used here also require a PC with Linux (Ubuntu) installed.

There is a technology called WSL2 that runs Linux as a virtual OS on Windows, but the Renesas evaluation package is not guaranteed to work with WSL2, so please prepare a PC with Ubuntu installed. If you don't plan on doing AI learning, you won't need high performance, so you can also reuse an old PC you have on hand.

First, a Linux PC and the DRP-AI Support PackageGetting the Linux PC ready

For the hardware, you can use your own PC with an x86 64 bit CPU and at least 6GB of RAM, but the OS is not Windows. We will instead use Ubuntu version 18.04, one of the Linux distributions.

Go to the web page where Uubuntu 18.04 is available and download the ISO file from ubuntu-18.04.6-desktop-amd64.iso. You can use the Rufus tool for Windows to convert the ISO file into a bootable USB drive so you can install Ubuntu 18.04 on the PC where you plan on installing Ubuntu.

Getting the software ready

To download the software, first, download the software package “RZ/V2L DRP-AI Support Package” from the Renesas website. The file is a large ZIP file that is more than 2GB, so we recommend downloading it over a high-speed internet connection.

When you unzip this ZIP file, open the folder, rzv2l_ai-implementation-guide, and there you will find the file

rzv2l_ai-implementation-guide_en_rev5.00.pdf (hereafter referred to as the “Implementation Guide”). This guide is written in the form of a step-by-step practice. If you follow it, you will be able to evaluate the included trained neural network model, from conversion to actual operation on the evaluation board. Next, Renesas would like to introduce some points to be considered when using this guide to proceed with the evaluation.

Figure 4. DRP-AI Support Package Details

Creating the ONNX file

From here, Renesas will be using the command line in Linux.(If you are new to Linux, you will need to learn the basic commands of the OS itself.)

The AI frameworks PyTorch and torchvision can also be installed from the Linux command line using the command pip3. (Refer to the Implementation Guide, Chapter 2.2, Page 26)

Inside the DRP-AI Support Package you downloaded, you'll find the rzv2l_ai-implementation-guide_ver5.00.tar.gz compressed file. Unzip the file as described in the Implementation Guide. (Page 30)

Similarly, in the folder named pytorch_mobilenet, under rzv2l_ai-implementation-guide, you'll find the files
pytorch_mobilenet_en_rev5.00.pdf (hereafter referred to as MobileNet Guide) and pytorch_mobilenet_ver5.00.tar.gz which you should unzip as described in the Implementation Guide.

MobileNet is a lightweight and fast neural network for image recognition developed for mobile and embedded devices, which outputs the probability of a correct answer for an object in the image. For example, as shown in Figure 5, the probability that the object is a beagle is 93.53%, indicating that the determination is correct.

Figure 5. Image Recognition Image by MobileNet

If you move on to Chapter 2 of pytorch_mobilenet_en_rev5.00.pdf, you will find a file called mobilenet_v2.onnx. This is a representation of the pre-trained MobileNet v2 neural network model with weighting parameters in ONNX format.

Now that you have the trained ONNX files, let's move on to the next phase of creating DRP-AI Object files for DRP-AI and estimating the performance.

Converting to DRP-AI Object files in DRP-AI Translator

From here, Renesas will use the ONNX conversion tool DRP-AI Translator by Renesas. First, download the DRP-AI Translator from the Renesas website.

Install the unzipped installer according to Chapter 3.1 of the Implementation Guide. If you follow the steps in the Implementation Guide and MobileNet Guide, you should end up with a directory structure like the one in Figure 6.

Figure 6. Directory Structure of the ONNX Files and the DRP-AI Translator Directory Structure

After this, prepare the file to be input to the DRP-AI Translator by copying/renaming and editing the file from the sample. Please refer to the MobileNet Guide, Chapters 3.3–3.5 for detailed instructions.

When you are ready, the ONNX translation itself can be completed with a single command. For RZ/V2L, from the shell, run

$ ./run_DRP-AI_translator_V2L.sh mobilenet_v2 -onnx ./onnx/mobilenet_v2.onnx

in the output/mobilenet_v2/ directory under the working directory, and this will generate the binary files needed to run MobileNet on a real chip. (Figure 7)

Figure 7. List of Files after Running DRP-AI Translator

How to read the performance estimator Excel

The DRP-AI Translator outputs the summary of the neural network model, which was converted from ONNX to an Excel format, in addition to the objects required for the evaluation of the actual device. (Figure 8)

Along with the structural information of the neural network model, this Excel file contains the approximate processing time for each layer (each function) of the model (DRP-AI stand-alone performance excluding the limitations of the LSI internal bus and external DRAM bandwidth), which allows you to estimate the approximate performance.

Figure 8. Example of mobilenet_v2_summary.xlsx

Summary

Renesas has introduced the free software package provided by Renesas Electronics for users who are interested in AI but don't know where to start, so you can try it. If you have the object files created in this article, you are one step closer to evaluating AI performance using a real chip. The evaluation board kit for the RZ/V2L used in this article is available for purchase, and you can experience the AI performance, low power consumption and low heat generation of the actual chip embedded in the evaluation board kit.

The RZ/V series of Renesas embedded AI processors also includes RZ/V2M, which has approximately 1.5 times higher AI performance than the RZ/V2L introduced here, and a RZ/V2M DRP-AI Support Package is available that can be used in the same way as mentioned above.

发送到邮箱 |
+1 赞 0
收藏
评论 0
| 转发至：

本文由电子人生转载自Renesas，原文标题为:Start Your First Step on Vision AI Development Using RZ/V Microprocessor (MPU)，本站所有转载文章系出于传递更多信息之目的，且明确注明来源，不希望被转载的媒体或个人可与我们联系，我们将立即进行删除处理。

全部评论（0）

暂无评论

Renesas‘ Application of Deep Learning Algorithms in The Field of Defect Detection

Due to the variety of possible defects, it is difficult for traditional machine vision algorithms to completely model and migrate defect features. The reusability is not great, and working conditions must be distinguished, which will waste a lot of human costs. The following will introduce Renesas‘ application of deep learning algorithms in the field of defect detection, using PCB circuit board defect detection as an example.

设计经验发布时间 : 2023-09-05

【经验】瑞萨工业AI芯片RZ/V2M的开发环境的下载编译过程

瑞萨电子RZ/V2M搭载DRP-AI深度学习IP，集成ISP，典型功耗4W，功耗较低，无需散热片，可以用于在芯片端侧实现人脸，物体等的识别，本文记录RZ/V2M的开发环境的下载编译过程。

设计经验发布时间 : 2021-05-30

【经验】瑞萨RZ/V2L处理的二进制代码和示例代码的评估环境教程

作为简单的AI评估软件的首次推出，瑞萨发布了二进制代码和示例代码，您可以通过切换分类（ResNet50）、物体检测（Tiny-YOLOv2、YOLOv3）、姿势估计（HRNet）来评估几个AI模型。

设计经验发布时间 : 2023-07-04

GreenWaves Technologies Unveils GAP8 IoT Application Processor, Enabling Groundbreaking Embedded Artificial Intelligence at the Very Edge

GreenWaves Technologies Unveils GAP8 The Industry’s Lowest Power IoT Application Processor, Enabling Groundbreaking Embedded Artificial Intelligence at the Very Edge.

产品发布时间 : 2024-08-15

GreenWaves Technologies Announced Availability of GAP8 Software Development Kit and GAPuino Development Board

GreenWaves’ pioneering GAP8 IoT Application Processor enables high-performing evaluation board and development kit.Grenoble, France and Santa Clara, Calif., May 22, 2018 – GreenWaves Technologies, a fabless semiconductor startup designing disruptive ultra-low power embedded solutions for image, sound and vibration AI processing in sensing devices, today announced the availability of its GAP8 Software Development Kit (SDK) and GAPuino Development Board. The GAPuino Boards are available for purchase here and the GAP8 SDK can be downloaded via GitHub.

产品发布时间 : 2024-08-20

Renesas‘ RZ/V2M Brings The Innovation for AI Products with Better AI Performance

This article introduces the solution to the biggest challenge in AI inference that is “heat generation“, Renesas‘RZ/V2M achieved better AI performance with only 30% power consumption.

新产品发布时间 : 2021-11-18

RZ/V2M Evaluation Board Kit Booklet

型号- CP2105,THGBMJG7C1LBAIL,CIS IMX415,V2MEVK,RTL8211FG-CG,RZ/V2M,IMX415,FX18-60S-0.8SH,FX18-40S-0.8SV10,MT53D1024M32D4,GND,R9A09G011GBG,CIS GND,RJ45

应用笔记或设计指南 - RENESAS - Rev.1.00 - July 1, 2022 PDF 英文下载

INTRODUCING RZ PARTNER ECOSYSTEM SOLUTIONS

型号- RZ/N1D,RZ/G2UL,RB-RZLC,RZ/A SERIES,RZ,RZ FAMILY,RZ/N1 SERIES,RZV,RZ/V2L,RZ/V2M,RZ/A3UL,RZ/A,RZ/N,RZ/G2L,RB-RZUL,RZ/G2LC,RZ/G,RZ/N1,RZ/V,RZ/T1,RZ/G2E,RZ/T,R9A06G032,RZ/G2H,RZG2L-EK-200,RZ/G SERIES,RZ/FIVE,R9A07G043F01GBG,RZA3UL-EK-200,RZFIVE-EK-200,RZ/N SERIES,RZ/V SERIES,RZG2UL-EK-200,RZ/T SERIES,RZ/G2X,RZG2E

商品及供应商介绍 - RENESAS - JULY 2023 PDF 英文下载

Faster Evaluation Process with Unified and Scalable SMARC EVK Evaluation Board Kit Platform

Renesas decided to simplify the development cycle by unifying the evaluation kit for new products (RZ/V2L, RZ/G2L, RZ/G2LC and RZ/G2UL) into SMARC (“Smart Mobility ARChitecture”) V2.1 form factor.

厂牌及品类发布时间 : 2021-10-28

瑞萨电子人工智能解决方案——采用Cortex-A55内核的MPU系列

瑞萨电子公司提供了多种支持AI的设备（MPU从高端到低端列出）：RZ/V2M系统、RZ/V2L系统、RZ/G2L系统、RZ/G2LC系统和RZ/G2UL系统。单板计算机获胜组合是边缘AI系统的理想选择，涵盖RZ/V2L、RZ/G2L和RZ/G2LC。

厂牌及品类发布时间 : 2021-11-17

“EMBEDDED AI MPU” RZ/V INTRODUCTION

型号- RZ/V2L,RZ/V2M,RZ/V2XX,RZ/V2MA,RZ/V SERIES,RZ/V2XXX,RZ/V3X

商品及供应商介绍 - RENESAS - 2023/9/18 PDF 英文下载查看更多版本

RZ/V2M Linux Package Start-Up Guide

型号- RZ/V2M,THGBMJG7C1LBAIL

用户指南 - RENESAS - Rev.1.30 - Oct.14.2022 PDF 英文下载

【应用】使用YOLOv3-tiny深度学习算法的瑞萨缺陷检测解决方案，具有较高的实时性和良好的精度

由于存在的缺陷多种多样，传统的机器视觉算法很难对缺陷特征进行完全建模和迁移缺陷特征，致使传统机器视觉算法可重复使用性不是很大，并且需要区分工作条件，这将浪费大量的人力成本。因此，越来越多的工程师开始将深度学习算法引入缺陷检测领域，因为深度学习在特征提取和定位方面取得了非常好的效果。下面将介绍瑞萨电子深度学习算法在缺陷检测领域的应用，以PCB电路板缺陷检测为例。

应用方案发布时间 : 2023-10-12

RZ FAMILY MICROPROCESSORS:64-Bit & 32-Bit High-performance MPUs

型号- RZ/A1M,RZ/A1L,RZ/G2UL,RZ/G1M,RZ/G1N,RZ/V2MA,RZ/A1H,RZ/A1LU,RZ/G1C,R9A07G043UXX,RZ/G1E,RZ/G1H,RZ/T2M,RZ/V2L,RZ/V2M,R7S910006,R7S910007,R7S910002,RZ/A3UL,R9A07G075M05GFA,R7S910001,RZ/N2L,R9A07G084M04GBG,R9A07G075M22GBA,RZ/A,R9A07G075M22GBG,R9A07G075M26GBG,R9A07G084M08GBG,R9A07G084M04GBA,RTK9RZT2M0S00000BE,R9A07G075M24GBA,RTK7910018S01000BE,R9A07G075M28GBA,R8A774EX,R9A07G075M05GFP,RZ/T1,R9A07G084M08GBA,R8A774C0,RZ/N1S,RZ/G SERIES,RZ FAMILY,R7S910035,R7S910036,R9A07G075M21GBA,R8A774AX,RZ/N1L,RZ/NX,R9A07G075M27GBA,RZ/N1D,RZ/A SERIES,RTK9RZN2L0S00000BE,R8A774BX,R7S910028,R7S910026,R7S910027,R9A07G075M01GFP,R7S910025,R9A07G075M24GBG,RZ/G2,R9A07G075M28GBG,R9A07G044CXX,R9A07G075M26GBA,RZ/N,RZ/G2L,RZ/A2M,R9A07G075M01GFA,RZ/G2M,RZ/G2LC,RZ/G2N,R9A07G044LXX,RZ/G,RZ/TX,RZ/V,RZ/A1LC,RZ/T,RZ/G2E,RZ/G2H,R7S910017,R7S910018,R7S910015,R7S910016,R7S910013,R7S910011,RZ/N SERIES,RZ/V SERIES,RZ/T SERIES

商品及供应商介绍 - RENESAS - Rev.5.0-1 - October 2020 PDF 英文下载查看更多版本