Introducing Three examples of AI MPU RZ/V2M real-life applications

时间： 2022-07-30 来源：Renesas

技术问答

RENESAS released into the RZ/V2M in 2020 to be adopted in Vision AI applications. It is equipped with a high-performance ISP and an original AI-accelerator "DRP-AI". After its release, many customers started developing AI using this product.

Today, I would like to introduce the following three examples of RZ/V2M real-life applications.

Security camera (using Object Recognition)
Fitness application (using Pose Estimation)
AI edge gateway (using Object Recognition, Pose Estimation, and so on)

1. Security camera (using Object Recognition)

The typical application for RZ/V2M is a security camera. ISP is supported up to 4K resolution, the captured image can be encoded to H.265 or H.264. At the same time, AI inference can be treated using DRP-AI. A security camera also requires several special features such as Wide Dynamic Range(WDR), and 2D and/or 3D noise reduction. RZ/V2M supports such requirements.

The AI inference function adapted for security cameras is human detection and recognition, human count, face recognition, suspicious person detection, and so on. DRP-AI is a hardware accelerator, but it can also change the program dynamically. So, you can change the AI module after installation, or change several times the AI algorithms during run time. The key success factor of this application is not only the performance such as AI and/or ISP but also the top level of power efficiency.

2. Fitness application (using Pose Estimation)

Utilizes the pose estimation technology, estimates the pose, and advises the form correction, pose, and so on for fitness service, dance school, and sports analysis. Usually, such application uses cloud AI systems, but it has a delay due to the image cloud upload. This customer installed RZ/V2M in the camera, so its product can get the pose estimation result more easily.

The key success factor is the 4K resolution from the CMOS sensor and low power consumption which does not need any fan and heatsink.

3. AI edge gateway (using Object Recognition, Pose Estimation, and so on)

This case is a kind of edge gateway that inputs several video streams and treats AI function internally. The functionality is almost the same as a security camera, it only differs by the number of video inputs.

When this gateway is set on the edge, it can reduce the delay compared to the cloud. Also, the image data does not need to be uploaded to the cloud, so privacy issues can be solved. They used FPGA in former products, but they had power consumption and heat generation problems. The key success factor is the video codec capability which supports 4K video decoding, and low power consumption. Also, the heatsink could be removed saving costs for the system.

RZ/V2M has potential not only for the introduced application but also for many other kinds of applications.

发送到邮箱 |
+1 赞 0
收藏
评论 0
| 转发至：

本文由董慧转载自Renesas，原文标题为:Introducing various adoption cases of AI MPU “RZ/V2M”，本站所有转载文章系出于传递更多信息之目的，且明确注明来源，不希望被转载的媒体或个人可与我们联系，我们将立即进行删除处理。

全部评论（0）

暂无评论

瑞萨新一代运动摄像头解决方案为运动相机而生，具有低功耗、快速启动和快速决策的特点

瑞萨电池供电相机解决方案是对这一市场趋势的最佳回应。它通过优化启动和电源策略来提高效率，还利用边缘AI技术实施对象检测和分类，旨在显著延长电池的使用寿命，使摄像头在恶劣环境中的表现更加稳定和持久。

应用方案发布时间 : 2023-11-14

【应用】使用YOLOv3-tiny深度学习算法的瑞萨缺陷检测解决方案，具有较高的实时性和良好的精度

由于存在的缺陷多种多样，传统的机器视觉算法很难对缺陷特征进行完全建模和迁移缺陷特征，致使传统机器视觉算法可重复使用性不是很大，并且需要区分工作条件，这将浪费大量的人力成本。因此，越来越多的工程师开始将深度学习算法引入缺陷检测领域，因为深度学习在特征提取和定位方面取得了非常好的效果。下面将介绍瑞萨电子深度学习算法在缺陷检测领域的应用，以PCB电路板缺陷检测为例。

应用方案发布时间 : 2023-10-12

【应用】瑞萨推出了AI摄像头和语音识别整体解决方案，实时在线，多模态架构打造非接触式用户体验

基于对前端视频技术分析能力要求越来越高，以及集成方面的考虑，Renesas瑞萨推出了AI摄像头和语音识别解决方案。该方案可以始终保持在线，可通过语音触发，快速将机器从待机模式中激活，以执行目标物识别、面部识别和其他基于视觉的任务。

应用方案发布时间 : 2022-03-14

瑞萨MCU全览

型号- RX200,RX14X,RA4M1,RA6M1,RA4M3,RA4M2,RA6M3,RA8M1,RA6M2,RA6M5,RA2E1,RA6M4,RA4E1,RA2E3,RA2E2,RX23E-B,RA6E1,RA2A1,RA4E2,RA6E2,RX600,RX6XX,RX66X,RA4T1,RA6T2,RA6T1,RX26T,RA6T3,RA2L1,RA,RE,RA8D1,RL78,RX65X,RX,RX100,RX64X,RX72X,RX24X,RX700,RX7XX,RA2,RA4,RA6,RA8,RX系列,RX71X,RH850,RX23X,RX67X,RA4W1

商品及供应商介绍 - RENESAS - 2022年12月 PDF 中文下载

Revolution of Endpoint AI in Embedded Vision Applications

There are unlimited use cases for the deployment of AI in vision applications in the real world. Here are some of the examples where Renesas can provide comprehensive MCU and MPU based solutions inc. all the necessary SW and tools to enable quick development.

厂牌及品类发布时间 : 2022-06-30

大咖座谈 | 半导体行业对AI在终端场景及应用中的推动

尽管关于生成式AI和ChatGPT-4的讨论不绝于耳，但到2025年，大约75%的数据将来自网络边缘设备，而非云端。与此同时，目前企业收集的数据有90%被丢弃，这也为我们带来一个激动人心的机会，来寻找这些数据的有效用途。

行业资讯发布时间 : 2023-12-07

Renesas Launches New General-Purpose 64-Bit RZ/G2L Group of MPUs with Latest Arm Cortex-A55 for Improved AI Processing

January 19, 2021 - Renesas Electronics Corporation announced the expansion of its RZ/G2 general-purpose 64-bit microprocessors (MPUs), delivering improved AI processing for a wide range of applications. The expanded product lineup includes three new entry-level MPU models built around the latest Arm® Cortex®-A55 core: The RZ/G2L, RZ/G2LC, and RZ/G2UL.

新产品发布时间 : 2021-01-22

INTRODUCING RZ PARTNER ECOSYSTEM SOLUTIONS

型号- RZ/N1D,RZ/G2UL,RB-RZLC,RZ/A SERIES,RZ,RZ FAMILY,RZ/N1 SERIES,RZV,RZ/V2L,RZ/V2M,RZ/A3UL,RZ/A,RZ/N,RZ/G2L,RB-RZUL,RZ/G2LC,RZ/G,RZ/N1,RZ/V,RZ/T1,RZ/G2E,RZ/T,R9A06G032,RZ/G2H,RZG2L-EK-200,RZ/G SERIES,RZ/FIVE,R9A07G043F01GBG,RZA3UL-EK-200,RZFIVE-EK-200,RZ/N SERIES,RZ/V SERIES,RZG2UL-EK-200,RZ/T SERIES,RZ/G2X,RZG2E

商品及供应商介绍 - RENESAS - JULY 2023 PDF 英文下载