Visual Wakewords on GREENWAVES GAP8

时间： 2024-08-13 来源：GREENWAVES Official Website

技术问答

In the latest GAP SDK, released on the 7th February 2020, we have included a GAPflow example that converts the winner of the Google Visual Wake Words challenge to a working model on GAP8.

Visual Wake Words is Google’s term for a network trained for the binary classification task of detecting the presence or absence of a human in an image. Google provided a python script that relabels the well known MSCOCO dataset, which normally includes multiple classes of objects with bounding boxes, with binary person/no person labels.

The winning submission came from a team from MIT who have made quantized and non-quantized versions of their network available on github at: https://github.com/mit-han-lab/VWW.

We started with the non-quantized version of the model and ran it through the full GAPflow toolset. First, we converted the protobuf to a non-quantized TFLITE file using the TOCO converter from Google. Next, we used the GAP NNTool to convert the graph to a quantized GAP AutoTiler model using some of the images from the test set to analyze the dynamic of the activations for quantization into int8 containers. Finally, the model is executed, and the GAP AutoTiler produces highly optimized, readable GAP8 C code. This process is entirely automatic but very controllable with several different parameters that can be tuned during the conversion process.

The model takes just 17.7M cycles to run on GAP8. This leads to a minimum energy consumption of 6.05mJ/frame with an execution time for an inference of 193ms and an energy consumption of 7.29mJ/frame with an execution time of 92ms.

Sample trace of execution of visual wake words network

You can download the GAP SDK at https://github.com/GREENWAVES-Technologies/gap_sdk. The example is located in examples/nntool/visual_wake. It can be run on the GAP8 processor using GAPUINO or on the GAP GVSOC SoC simulator on your PC.

发送到邮箱 |
+1 赞 0
收藏
评论 0
| 转发至：

本文由雪飘梦飞转载自GREENWAVES Official Website，原文标题为:Visual Wakewords on GAP8，本站所有转载文章系出于传递更多信息之目的，且明确注明来源，不希望被转载的媒体或个人可与我们联系，我们将立即进行删除处理。

全部评论（0）

暂无评论

Building a battery-operated smart camera in five steps using a multi-core microcontroller

In this post, we demonstrate how to train and deploy a deep learning model for image recognition on GAP8—the first generation of ultra-low power IoT application processors. Thanks to the power-optimized MCU-class architecture tailored for intensive AI workloads, GAP8 is the perfect solution when coupled with low-power cameras.

设计经验发布时间 : 2024-11-12

Automated design intelligence with GAPflow

Our first product GAP8, in production since the beginning of 2020, is the leading off-the-shelf ultra-low power IoT Application Processor that combines ultra-low energy consumption, low-cost and high-computational power for compute-intensive tasks but still preserving the form-factor, system cost, energy efficiency and flexibility of a typical microcontroller.

设计经验发布时间 : 2024-08-20

GreenWaves’ GAP9 Hearables Platform Enables State-of-the-art Features Such as Scene-aware Active Noise Cancellation and Neural network-based Noise Reduction

GreenWaves’ GAP9 hearables platform enables state-of-the-art features such as scene-aware active noise cancellation and neural network-based noise reduction with no compromise in area, cost or energy.

产品发布时间 : 2024-08-15

AI赋能舞动最强音浪，GREENWAVES精彩亮相2024亚洲音频展！

2024年5月16-17日，蓝牙音频行业技术产业盛会2024（春季）亚洲音频展在深圳福田会展中心正式举行！2024年，GREENWAVES携基于AI降噪的创新GAP9处理器亮相本届盛会，带大家亲身体验GAP9处理器的卓越之处！与公司的资深工程师展开深入交流，包括GreenWaves如何巧妙融合DSP和AI技术，突破功耗限制，为可穿戴设备和物联网产品注入创新活力，打造用户心仪的卓越体验。

原厂动态发布时间 : 2024-08-08

GAP9 next generation processor for hearables and smart sensors Multidimensional computing for context-aware ANC, neural network based noise reduction, 3D sound, multisensor analysis and more

型号- GAP9

数据手册 - GREENWAVES - Version 1.14 - 2022/6/21 PDF 英文下载查看更多版本

GreenWaves Technologies Partners with Open-Silicon to develop Industry’s First IoT Processor Based on PULP and RISC-V

Open-Silicon, a system-optimized ASIC solution provider, today announced it was selected by GreenWaves Technologies to develop GAP8, the industry’s first IoT processor. GAP8 is built on the open source Parallel Ultra Low Power (PULP) and RISC-V ISA projects. Open-Silicon is providing GreenWaves Technologies with the complete RTL-to-physical design custom SoC implementation that is required to transform this smart IoT concept into working silicon in volume production.

产品发布时间 : 2024-08-20

Enabling ANC in Open-Ear Earbuds Beyond Apple with GreenWaves GAP9 AI+DSP Processor

By uniquely meeting this sub-millisecond latency requirement, the ultra-low-latency shared memory AI+DSP processor GAP9 enables brands, beyond Apple, to implement active noise cancellation (ANC) in open-ear designs.

应用方案发布时间 : 2024-10-22

GAP-8: A RISC-V SoC for AI at the Edge of the IoT

Current ultra-low power smart sensing edge devices, operating for years on small batteries, are limited to low-bandwidth sensors, such as temperature or pressure. Enabling the next generation of edge devices to process data from richer sensors such as image, video, audio, or multi-axial motion/vibration has huge application potential.

应用方案发布时间 : 2024-08-10

New GAP8 SDK V2.1 Was Released from GreenWaves Technologies

New GAP8 SDK release from GreenWaves Technologies. This article will show the headline changes in this SDK.

产品发布时间 : 2024-08-22

A 64mW DNN-based Visual Navigation Engine for Autonomous Nano-Drones

Really interesting paper by Daniele Palossi on using GAP8 to autonomously navigate a microdrone. This is a great example of porting a significant CNN to GAP8. Eric Flamand, GreenWave’s CTO assisted with the CNN model creation and use of the AutoTiler CNN generators.

应用方案发布时间 : 2024-09-30

GreenWaves Technologies Announced Availability of GAP8 Software Development Kit and GAPuino Development Board

GreenWaves’ pioneering GAP8 IoT Application Processor enables high-performing evaluation board and development kit.Grenoble, France and Santa Clara, Calif., May 22, 2018 – GreenWaves Technologies, a fabless semiconductor startup designing disruptive ultra-low power embedded solutions for image, sound and vibration AI processing in sensing devices, today announced the availability of its GAP8 Software Development Kit (SDK) and GAPuino Development Board. The GAPuino Boards are available for purchase here and the GAP8 SDK can be downloaded via GitHub.

产品发布时间 : 2024-08-20

GreenWaves Technologies Licenses Intrinsic ID Hardware Root of Trust for RISC-V AI Application Processor

GreenWaves’ pioneering RISC-V-based IoT application processors enable the cost-effective development, deployment and autonomous operation of intelligent, battery-operated sensing devices that capture, analyze, classify and act on the fusion of rich data sources such as images, sounds or vibrations at the very edge of the network.

产品发布时间 : 2024-08-20

GAP8 Performance Versus ARM M7 on Embedded CNNs

ARM recently published a new CMSIS library for embedded convolutional neural networks (CNNs) CMSIS-NN. Firstly, it was great to see ARM supporting the market that GreenWaves and GAP8 are focused on. We particularly liked their statement that: “Neural Networks are becoming increasingly popular in always-on IoT edge devices performing data analytics right at the source, reducing latency as well as energy consumption for data communication.”

产品发布时间 : 2024-09-10

GreenWaves Technologies Announces 7M€ Series A Funding with Huami, Soitec and other investors

Funds will finance the sales ramp of GreenWaves’ first product, GAP8,and the development of the GREENWAVES company’s next generation product.

原厂动态发布时间 : 2024-08-31

Lynred and GreenWaves collaborate on New Occupancy Management Reference Platform for People Counting Sensor

GreenWaves and Lynred have collaborated on an open-source workspace management platform that allows quick deployment of sensors collecting accurate occupancy data. This platform combines Lynred‘s low-power IR sensors with GreenWaves‘ GAP8 processor to create battery-operated people counting devices, released under open source licenses. The platform ensures occupant anonymity using infrared technology and will be demonstrated at Embedded World in Nuremburg, Germany.

产品发布时间 : 2024-09-07