Revolution of Endpoint AI in Embedded Vision Applications

时间： 2022-06-30 来源：Renesas

技术问答

选型帮助

研发客服

商务客服

Endpoint AI is a new frontier in the space of artificial intelligence that takes the processing power of AI to the edge. It is a revolutionary way of managing information, accumulating relevant data, and making decisions locally on a device. Endpoint AI employs intelligent functionality at the edge of the network, in other words, it transforms the IoT devices that are used to coMPUte data into smarter tools embedded with AI features. This in turn improves real-time decision-making capabilities and functionalities. The goal is to bring machine-learning-based intelligent decision-making physically closer to the source of the data. In this context, Embedded vision shifts to the Endpoint. Embedded vision incorporates more than breaking down images or videos into pixels - it is the means to understand pixels, make sense of what is inside and support making a smart decision based on specific events that transpire. There have been massive endeavors at the research and industry levels to develop and improve AI technologies and algorithms.

What is Embedded Vision?

Embedded computer vision is a technology that imparts machines with the ability to see i.e., the sense of sight, which enables them to explore the environment with the support of machine-learning and deep-learning algorithms. There are numerous applications across several industries whose functionality relies on computer vision, thus becoming an integral part of technological procedures. In precise terms, computer vision is one of the Artificial Intelligent (AI) fields that enable machines to extract meaningful information from digital multimedia sources to take actions or make recommendations based on the information that has been obtained. Computer vision is, to some extent, akin to the human sense of sight. However, the two differ on several grounds. The human sight has the exceptional ability to understand many and varied things from what it sees. On the other hand, computer vision recognizes only what it has been trained on and what it is designed to do exactly, and that too with an error rate. AI in embedded vision processes trains the machines to perform supposed functions with the least processing time and has an upper edge over human sight in analyzing hundreds of thousands of images in a lesser timeframe.

Embedded vision is one of the leading technologies with embedded AI utilized in smart endpoint applications in a wide range of consumer and industrial applications. There are a number of value-added use cases examples; such as counting/analyzing the quality of products on a factory line, keeping a tally of people in a crowd, identifying objects, and analyzing the contents of a specific area in the environment to name a few.

Whilst considering the processing of embedded vision applications at the endpoint, the performance of such an operation may face some challenges. The data flow from the vision sensing device to the cloud for the purposes of analyzing and processing could be very large and may exceed the network available bandwidth. For instance, a camera with 1920 ×1080 and operating with 30 FPS (Frame Per Second) may generate about 190 MB/S of data. In addition to privacy concerns, this substantial amount of data contributes to latency during the round trip of data from the edge to the cloud, then back again to the endpoint. These limitations could negatively impact the employment of embedded vision technologies in real-time applications.

IoT Security is also a concern in the adoption and growth of embedded vision applications across any segment. In general, all IoT devices must be secured. A critical issue and concern in the use of smart vision devices is the possible misuse of sensitive images and videos. Unauthorized access to smart cameras for example is not only a breach of privacy, but it could pave a way for more harmful outcomes.

Vision AI at the Endpoint

· Endpoint AI can enable image processing to infer a complex insight from a huge number of captured images.

· AI uses machine-learning and deep-learning capabilities within the smart imaging devices to check a huge amount of previously well-known use cases.

· For optimum performance, Embedded vision requires AI algorithms to run on the endpoint devices and not transmit data to the cloud. The data here is captured by the imaging recognition device, then processed and analyzed in the same device.

The limitation of power consumption at the endpoint is still available, where the microcontrollers or microprocessors need to have more efficiency to take on high volumes of multiply-accumulate (MAC) that are required for AI processing.

Deployment of AI Vision Applications

There are unlimited use cases for the deployment of AI in vision applications in the real world. Here are some of the examples where RENESAS can provide comprehensive MCU and MPU based solutions inc. all the necessary SW and tools to enable quick development.

Smart Access Control:

Security access control systems are becoming more valuable with the addition of voice and facial recognition features. Real-time recognition requires embedded systems with very high computational capabilities and on-chip hardware acceleration. To meet this challenge, Renesas provides a choice of MCU or MPU that offers very high computational power that also integrates many key features that are critical to high-performance facial and voice recognition systems such as built-in H.265 hardware decoding, 2D/3D graphic acceleration, and ECC on internal and external memory to eliminate soft-errors and allow for high-speed video processing.

Industrial Control:

Embedded vision has a huge impact as it utilizes many applications, including product safety, automation, sorting of products, and many more. AI techniques can perform multiple operations in the production process such as packaging and distribution, which can ensure quality and safety during production in all stages. Safety is needed in areas such as critical infrastructure, warehouses, production plants, and buildings that require a high level of human resources.

Transportation:

Computer vision presents a large scale of ways to improve transportation services. In self-driving cars as an example, computer vision is used to detect and classify objects on the road. It is also used to create 3D maps and estimate movement around. By using computer vision, self-driving cars gather information from the environment using cameras and sensors, which then interpret and analyze the data to make the most suitable response by using vision techniques such as pattern recognition, feature extraction, and object tracking.

In general, Embedded vision can serve many purposes, and these functionalities can be used after customization and the needed training on different types of datasets from many areas. Functionalities include monitoring physical area, recognizing intrusion, detecting crowd density, and counting humans or objects, or animals. They also include identifying people or finding cars based on car number, detection of motion, and human behavior analysis in different cases.

Case study: Agricultural Plant Disease Detection

Vision AI & deep learning may be employed to detect various anomalies - plant disease detection is one example of this type of system. Deep learning algorithms -one of the AI techniques- are used widely for this purpose. According to research, computer vision gives better, accurate, fast, and low-cost results, as compared to the costly and slow labor-intensive results of previous methods.

The process that is used in this case study can be applied to any other detection. There are three main steps for using deep learning in computer/machine vision:

Step one is performed on normal computers in the lab, whereas step 2 is deployed on a microcontroller at the endpoint, which can be on the farm. Results in step 3 are displayed on the screen on the user side. The following diagram shows the process in general.

Conclusion:

We are experiencing a revolution in high-performance smart vision applications across a number of segments. The trend is well supported by the growing computational power of microcontrollers and Microprocessors at the endpoints, opening up great opportunities for exciting new vision applications. Renesas Vision AI solutions can help you to enhance overall system capability by delivering embedded AI technology with intelligent data processing at the endpoint. Our advanced image processing solutions at the edge are provided through a unique combination of low-power, multimodal, multi-feature AI inference capabilities. Take the chance now and start developing your vision AI application with Renesas Electronics.

发送到邮箱 |
+1 赞 0
收藏
评论 0
| 转发至：

本文由翊翊所思转载自Renesas，原文标题为:Revolution of Endpoint AI in Embedded Vision Applications，本站所有转载文章系出于传递更多信息之目的，且明确注明来源，不希望被转载的媒体或个人可与我们联系，我们将立即进行删除处理。

全部评论（0）

暂无评论

Geehy Showcased a Reliable 32-Bit APM32 MCU Solution at Embedded World 2023

Geehy successfully debuted at Embedded World 2023, showcasing its innovative IC product portfolio and reliable solutions, which included the latest APM32 MCU, Dedicated BMS IC, SoC products and applications in industrial control, new energy, and automotive fields.

厂牌及品类发布时间 : 2023-04-14

Realtime Vision AI runs at the size of a Raspberry Pi ! Introducing the RZBoard V2L Single Board Computer

This blog introduced the RZBOARD V2L, a raspy-like evaluation board that can run AI with extremely high power efficiency compared to conventional processors and GPUs.

厂牌及品类发布时间 : 2023-10-24

工业级MPU选型|Renesas瑞萨工业级高端MPU，助力新时代嵌入式工业应用

Renesas瑞萨电子推出了独有的嵌入式处理器“RZ”系列工业级MPU，是“像单片机一样使用极为方便的新时代处理器”，包括RZ/A,RZ/T,RZ/G三个系列。

厂牌及品类发布时间 : 2018-07-10

Renesas（瑞萨）电机控制微控制器（MCU）选型指南

型号- RX200,RX6XT,RX23T,RX71M,RX2XT,RA6T3 GROUP,RISC-V-MC,RA-T,RA-T系列,RX600,RX6XX,RX63T,RX66T,RA4T1,RA6T2,RX66N,RA6T1,RX26T,RA8T2,RA6T3,RA8T1,RX62G,RA4T1 GROUP,RX-T,RA,MCK-XXXXX,RL78/G14,RA6T1 GROUP,RL78,RX74T,RX62T,RX65X,RX13T,RX7XT,RX,RX100,RISC-V,RL78/G1F,RL78/G1G,RX1XT,RL78/G24,RX7XX,RA6T2 GROUP,RX24T,RX72M,RX24U,RX72N,RA2,RA4,RXV2,RXV3,RA6,RXV1,RA8,RA-T 系列,RX23X,RX72T

选型指南 - RENESAS - DEC 2022 PDF 中文下载

Renesas（瑞萨电子） RL78系列MCU选型指南

描述- RL78 8/16-bit microcontrollers (MCUs) greatly improve power efficiency with industry-leading low power consumption at 37.5μA/MHz consumption during normal operation and 0.355μA during clock operation.

型号- R5F104PFAFA,R5F104PFAFB,R5F113TJLFB,R5F110MEAFB,R5F10JGCAFB,R5F10AACLSP,R5F04CAALA,R7F100GBH2DFP,R5F10WMGAFA,R5F140PLAFB,R5F10WMGAFB,R5F101ACASP,R5F101JJAFA,R5F104BDANA,R5F1006EASP,R7F102GFE3CFP,R5F101FDAFP,R7F100GJH3CFA,R5F12047ANA,R5F100LJAFA,R5F100LJAFB,R5F101LCABG,R5F104CFALA,R5F1006ECASP#VX,R5F100BCANA,R5F10PGFLFB,R7F100GGN3CFB,R7F100GJG2DFA,R5F1006EASM,R5F04BAAFP,R5F10BLELFB,R5F100CEALA,R7F102GAC3CSP,R7F102GGE3CNP,R5F11NMGAFB,R5F113GLLFB,R5F10WLEAFB,R5F10BGFLNA,R5F104GCAFB,R5F10WLEAFA,R5F10KGCANA,R7F100GBJ2DNP,R5F11BGEAFB,R7F100GPK3CFB,R5F10369ASP,R5F100EGANA,R7F100GPK3CFA,R7F100GCH3CLA,R5F113MKLFB,R5F100MLAFB,R5F140FKGFP,R5F11FLLANA,R5F100FKAFP,R5F111NGALA,R5F100MLAFA,R5F101GFAFB,R5F10ALCLFB,R5F104BFAFP,R7F100GGN2DNP,R5F104GLANA,R5F10RFCAFP,R7F102GGC3CFB,R5F101LLAFA,R5F04AFASP,R5F104JGAFA,R5F101LLAFB,R5F11Y67DSM,R5F110NEALA,R7F100GGL2DFB,R5F100AAASP,R5F104GAANA,R5F11EAAASP,R5F10RF8AFP,R5F100JHAFA,R7F102G8E3CLA,R5F104MKAFA,R5F104MKAFB,R5F11MMEAFB,R5F10367ASM,R5F10367ASP,R5F100MJAFA,R5F100MJAFB,R5F10NPJDFB,R5F100LJABG,R5F100GDAFB,R7F102G7E2DNP,R7F100GBG2DFP,R5F100SKAFB,R7F100GBJ3CNP,R5F101GDANA,R5F10277ANA,R5F10BAELSP,R5F101PGAFA,R5F101PGAFB,R5F101LEABG,R7F100GBH3CFP,R5F10AGDLNA,R7F102GFE2DFP,R7F100GFN2DFP,R5F107AEMSP,RL78/G10,R5F101BEANA,RL78/G11,R5F12047ASP,RL78/G12,R7F100GJH2DFA,RL78/G13,RL78/G14,RL78/G15,R5F104FCAFP,R5F101CGALA,R5F140LLGFB,R5F100JFAFA,R5F113TLLFB,RL78/G1A,RL78/G1C,RL78/G1D,RL78/G1F,RL78/G1G,R5F12017MSP,RL78/G1H,R7F100GPJ3CFA,R5F117GAGFB,R7F100GPJ3CFB,R7F100GPH2DFB,R5F101AAASP,RL78/G1M,R7F100GPH2DFA,RL78/G1N,R5F10PMELFB,RL78/G1P,RL78/G22,RL78/G23,R5F101FFAFP,R5F10AAELSP,R5F100BEANA,R7F102G8E2DLA,R5F104CDALA,R5F10PGDLFB,R5F10BMGLFB,R5F100GKANA,R5F140GKGFB,R5F101LCAFA,R5F101LCAFB,R7F100GGK2DFB,R5F100CGALA,R5F10AGFLFB,R7F102GGC2DNP,R5F104LKAFB,R5F11B7CANA,R5F11NMEAFB,R5F101SKAFB,R5F11CBCGNA,R5F104LKAFA,R5F1018DALA,R5F104GEAFB,R5F10WLGAFA,R5F10WLGAFB,R5F12007MNS,R5F11BGCAFB,R7F100GFN3CFP,R7F100GJF3CFA,R5F100LCABG,R5F11Y68ASM,R5F10JGCANA,R5F104JEAFA,R5F110PGAFB,R7F102GAE3CSP,R5F11RMGDFB,R5F101GHAFB,R7F100GGL3CFB,R5F104FJAFP,R5F100JJAFA,R5F113GLLNA,R7F100GPK2DFA,R5F100ACASP,R5F102A8ASP,R5F1016EASP,R5F101LEAFB,R5F101LEAFA,R5F12047GSP,R5F101PKAFA,R5F101PKAFB,R5F100FDAFP,R5F111NEALA,R5F10PGFLNA,R5F10BGFLFB,R7F100GBJ2DFP,R7F100GCG3CLA,R5F104EFANA,R7F100GGN3CNP,R5F12017GSP,R5F10AAALSP,RL78/I1A,R5F04BAANA,R5F11Z7ADNA,RL78/I1B,RL78/I1C,RL78/I1D,R7F100GCF2DLA,RL78/I1E,R7F100GMN2DFA,R5F10NPLDFB,R5F101JLAFA,R7F100GMN2DFB,R7F102GGE3CFB,R5F101GFANA,R5F04CCALA,R5F101EGANA,R5F11MPEAFB,R5F104GLAFB,R7F100GGL2DNP,R5F104GAAFB,R5F104LGAFP,R7F100GCJ3CLA,R5F10RBAAFP,R5F10WLCAFA,R5F10WLCAFB,R5F111MEAFB,R5F10PGHLFB,R5F101BCANA,R5F104LGAFB,R7F100GPL2DFA,R5F107ACMSP,R7F100GPL2DFB,R5F04BCAFP,R7F102GEE2DNP,R5F104BFANA,R5F11CBCMNA,R5F104LGAFA,R7F102G7E3CNP,R5F100PGAFA,R5F104LEALA,R5F10PPELFB,R5F100PGAFB,R5F10BGDLNA,R5F113THLFB,R5F101CEALA,R5F12007GNS,R7F100GFL2DFP,R5F10ABELNA,R7F100GGK3CFB,R5F11FLJANA,R5F100GDANA,R5F12067ASP,R5F101FHAFP,R7F102GAC2DSP,R7F100GBJ3CFP,R5F11MPGAFB,R7F100GJF2DFA,R5F100BGANA,R5F11EA8ASP,R7F100GCH2DLA,R5F111MGAFB,R5F104GJANA,R5F10AGDLFB,R7F100GMN3CFA,R7F100GPJ2DFA,R7F100GMN3CFB,R7F100GPJ2DFB,R7F100GLJ3CFB#AAX,R7F102G7C2DNP,R5F104LGALA,R5F11NLGAFB,R7F100GJG3CFA,R5F10267ASP,R5F1007EANA,R5F10BMELFB,R5F10PPGLFB,R5F10267ASM,R5F10PAELSP,R5F100LLAFB,R5F100LLAFA,R5F104EHANA,R5F113LKLFB,R5F10EGDAFB,R7F102GGC2DFB,R5F10WMEAFA,R5F10KBCAFP,R5F10BLCLFB,R5F1006CASM,R5F1006CASP,R5F101GJAFB,R5F100GFAFB,R5F10WMEAFB,R7F100GCG2DLA,R7F102GGE2DNP,R5F101MGAFB,R5F110PEAFB,R7F100GPK2DFB,R5F101MGAFA,R5F100AEASP,R5F10Y47ASP,R5F101LGABG,R5F10E8EALA,R5F10279ANA,R5F10BAGLSP,R5F10PGDLNA,R7F100GGK2DNP,R7F100GPL3CFA,R7F100GPL3CFB,R5F101JCAFA,R5F11PLFABG,R5F104FAAFP,R5F110NJALA,R5F100MFAFB,R5F100MFAFA,R5F11Z7AANA,R5F10A6CLSP,R5F04AAASP,R5F10BBDLNA,R5F12067GSP,R5F04BGAFP,R5F10BGCLFB,R5F11PLGABG,R7F100GFK2DFP,R5F100LFABG,R5F1016CASM,R5F104ECANA,R5F101GHANA,R5F101EEANA,R5F1054AASP,R5F10RBCAFP,R5F104AFASP,R5F101BAANA,R5F100GEANA,R7F100GFL3CFP,R7F100GBG3CNP,R5F104FGAFP,R5F101JEAFA,R5F11BBCAFP,R5F11W67DSM,R5F104BAAFP,R7F100GLF2DFA,R5F101CCALA,R7F100GLF2DFB,R7F100GPG3CFB,R5F10ABALNA,R5F10EBEANA,R5F10RB8AFP,R7F100GPG3CFA,R7F100GEH2DNP,R7F100GJK3CFA,R5F100AFASP,R5F140LKAFB,R7F100GPG2DNB,R7F100GLG2DFB,R5F101FJAFP,R5F100PJAFB,R7F100GJJ2DFA,R5F100PJAFA,R5F104PLAFB,R5F1007DANA,R5F104PLAFA,R7F100GLH2DLA,R5F101GAAFB,R5F1016CASP,R5F104MHAFA,R5F111PFAFB,R7F100GML2DFB,R5F10EGEAFB,R5F101LGAFA,R5F100GGAFB,R5F101LGAFB,R5F10PGHLNA,R7F100GML2DFA,R5F11BCCALA,R5F117AAGSP,R5F104LDAFP,R5F10377ANA,R5F104MHAFB,R7F100GBF2DNP,RL78 FAMILY,R7F100GLH3CFA,R5F11EBAAFP,R7F100GLH3CFB,R5F140PLGFB,R5F04BCANA,R5F100JKAFA,R7F100GCJ2DLA,R5F104PJAFA,R5F113PHLFB,R5F104PJAFB,R5F1054AANA,R5F102A7ASP,R7F100GML3CFB,R7F100GML3CFA,R5F1008DALA,R5F101GLAFB,R5F04CEALA,R5F12047GNA,R5F11AGGANB,R7F100GGJ2DFB,R7F100GMK2DFB,R7F100GMK2DFA,R5F10EGCANA,R5F100CAALA,R7F100GEH3CNP,R5F10ALFLFB,R5F100LDABG,R5F10PGJLFB,R5F111PHAFB,R5F04BEAFP,R5F104JDAFA,R5F104GGANA,R7F100GLH3CLA,R5F104MFAFB

选型指南 - RENESAS - 2023.03 PDF 英文下载

Renesas MCU Families Developed with Robust ＆ Reliable Motor Control for Industrial Domain

Given the sensing and computational requirements, the careful selection of the appropriate microcontrollers (MCUs) is crucial for developing a robust induction motor control solution. For IM drive applications, the Renesas RA-T and RX-T MCU series have been meticulously designed with specific functions that help in the development of high-performance drive systems.

应用方案发布时间 : 2023-12-19

瑞萨MCU全览

型号- RX200,RX14X,RA4M1,RA6M1,RA4M3,RA4M2,RA6M3,RA8M1,RA6M2,RA6M5,RA2E1,RA6M4,RA4E1,RA2E3,RA2E2,RX23E-B,RA6E1,RA2A1,RA4E2,RA6E2,RX600,RX6XX,RX66X,RA4T1,RA6T2,RA6T1,RX26T,RA6T3,RA2L1,RA,RE,RA8D1,RL78,RX65X,RX,RX100,RX64X,RX72X,RX24X,RX700,RX7XX,RA2,RA4,RA6,RA8,RX系列,RX71X,RH850,RX23X,RX67X,RA4W1

商品及供应商介绍 - RENESAS - 2022年12月 PDF 中文下载

【经验】解析瑞萨MPU RZ/T1 SPI总线通信功能配置方法

当我们使用瑞萨（Renesas）MPU RZ/T1做项目开发时，基本都会用到SPI总线通信的功能，SPI总线通信速率较快很适合在单片机板级之间进行数据交互，本文将介绍使用瑞萨开发环境配置生成RZ/T1 SPI总线驱动程序的方法。

设计经验发布时间 : 2022-05-02

Can Your Vision AI Solution Keep Up with Cortex-M85?

This blog discusses a vision AI application built on the new RA8D1 graphics-enabled MCUs featuring the same Cortex-M85 core and use of Helium to accelerate the neural network. RA8D1 MCUs provide a unique combination of advanced graphics capabilities, sensor interfaces, large memory and the powerful Cortex-M85 core with Helium for acceleration of the vision AI neural networks, making them ideally suited for these vision AI applications.

设计经验发布时间 : 2023-12-14

【经验】瑞萨MPU RZ/T1使用SSC生成EtherCAT CiA402协议栈方法

瑞萨MPU RZ/T1支持EtherCAT网络设计，如何使用协议栈工具生成相对应的EtherCAT从机栈代码呢，本文主要就Beckhoff工具生成EtherCAT CiA402协议栈方法做相关介绍。

设计经验发布时间 : 2021-12-26

【经验】瑞萨MPU RZ/T1使用code generator生成SCI的初始代码方法

工程师初次使用瑞萨（Renesas）RZ/T1系列MPU时，可能不知道SCI该如何配置波特率，中断入口，中断标志位等。本文将介绍RZ/T1系列MPU利用code generator生产SCI的配置方法。

设计经验发布时间 : 2022-04-22

Renesas Introduces 32-bit MCU RX23E-B with High-Speed, High-Precision Analog Front End for High-End Industrial Sensor Systems

RENESAS RX23E-B offers a version that supports an A/D conversion data rate of up to 125kSPS, and a version that supports up to 31.25kSPS. Both products offer flexible data rate settings ranging from 3.8SPS to the maximum value, allowing users to choose the best balance between data rate and noise for their specific system requirements.

产品发布时间 : 2023-11-25

【经验】瑞萨MPU RZ/T1使用双寄存器切换开启DMA传输的方法介绍

在项目中使用瑞萨（Renesas）MPU RZ/T1做从机接收大量数据时，为了传输和接收数据效率，我们会启用DMA传输的功能，有时候项目中需要传输的是两块数据，这时候我们可以使用双寄存器切换的方式来完成，本文主要介绍启用双寄存器切换启用DMA传输的方法。

设计经验发布时间 : 2022-06-25

Renesas（瑞萨电子）RZ系列64位/32位基于Arm的微处理器(MPU)选型指南

目录- RZ Series MPU RZ/A Series MPU RZ/G Series MPU RZ/T Series MPU RZ/N Series MPU RZ Family MPU Package overview

型号- RZ/A1M,RZ/A1L,RZ/N1D,RZ/G1M,RZ/G1N,RZ/A1H,R8A774BX,RZ/A1LU,RZ/G1C,RZ/G1E,RZ/G1H,RZ/A1,RZ/A,RZ/G2,RZ/N,RZ/A2M,RZ/G2M,RZ/G2N,RZ/G2M 96,R8A774EX,RZ/G,RZ/N1,RZ/G2E 96,RZ/A1LC,RZ/T1,RZ/G2E,RZ/T,RZ/G2H,R8A774C0,RZ/N1S,RZ FAMILY,R8A774AX,RZ/G2M-96CE,RZ/N1L

选型指南 - RENESAS - 2020.02 PDF 英文下载