Visual Wakewords on GREENWAVES GAP8
In the latest GAP SDK, released on the 7th February 2020, we have included a GAPflow example that converts the winner of the Google Visual Wake Words challenge to a working model on GAP8.
Visual Wake Words is Google’s term for a network trained for the binary classification task of detecting the presence or absence of a human in an image. Google provided a python script that relabels the well known MSCOCO dataset, which normally includes multiple classes of objects with bounding boxes, with binary person/no person labels.
The winning submission came from a team from MIT who have made quantized and non-quantized versions of their network available on github at: https://github.com/mit-han-lab/VWW.
We started with the non-quantized version of the model and ran it through the full GAPflow toolset. First, we converted the protobuf to a non-quantized TFLITE file using the TOCO converter from Google. Next, we used the GAP NNTool to convert the graph to a quantized GAP AutoTiler model using some of the images from the test set to analyze the dynamic of the activations for quantization into int8 containers. Finally, the model is executed, and the GAP AutoTiler produces highly optimized, readable GAP8 C code. This process is entirely automatic but very controllable with several different parameters that can be tuned during the conversion process.
The model takes just 17.7M cycles to run on GAP8. This leads to a minimum energy consumption of 6.05mJ/frame with an execution time for an inference of 193ms and an energy consumption of 7.29mJ/frame with an execution time of 92ms.
Sample trace of execution of visual wake words network
You can download the GAP SDK at https://github.com/GREENWAVES-Technologies/gap_sdk. The example is located in examples/nntool/visual_wake. It can be run on the GAP8 processor using GAPUINO or on the GAP GVSOC SoC simulator on your PC.
- |
- +1 赞 0
- 收藏
- 评论 0
本文由雪飘梦飞转载自GREENWAVES Official Website，原文标题为:Visual Wakewords on GAP8，本站所有转载文章系出于传递更多信息之目的，且明确注明来源，不希望被转载的媒体或个人可与我们联系，我们将立即进行删除处理。
相关推荐
Building a battery-operated smart camera in five steps using a multi-core microcontroller
In this post, we demonstrate how to train and deploy a deep learning model for image recognition on GAP8—the first generation of ultra-low power IoT application processors. Thanks to the power-optimized MCU-class architecture tailored for intensive AI workloads, GAP8 is the perfect solution when coupled with low-power cameras.
Automated design intelligence with GAPflow
Our first product GAP8, in production since the beginning of 2020, is the leading off-the-shelf ultra-low power IoT Application Processor that combines ultra-low energy consumption, low-cost and high-computational power for compute-intensive tasks but still preserving the form-factor, system cost, energy efficiency and flexibility of a typical microcontroller.
AI赋能舞动最强音浪，GREENWAVES精彩亮相2024亚洲音频展！
2024年5月16-17日，蓝牙音频行业技术产业盛会2024（春季）亚洲音频展在深圳福田会展中心正式举行！2024年，GREENWAVES携基于AI降噪的创新GAP9处理器亮相本届盛会，带大家亲身体验GAP9处理器的卓越之处！与公司的资深工程师展开深入交流，包括GreenWaves如何巧妙融合DSP和AI技术，突破功耗限制，为可穿戴设备和物联网产品注入创新活力，打造用户心仪的卓越体验。
GAP9评估套件（GAP 9_EVK）用户手册
描述- 本手册为GreenWaves Technologies的GAP9评估套件（GAP9_EVK）的用户指南。GAP9_EVK是一款针对GAP9芯片的评估和开发套件，GAP9芯片是一款超低功耗的应用处理器，适用于边缘AI和数字信号处理。该套件旨在评估GAP9的能力，并支持多种扩展连接，以便与额外的硬件（如传感器、低功耗无线电模块或音频板）配合使用。手册详细介绍了GAP9_EVK的架构、组件、电源管理、配置跳线设置、编程和调试方法，以及如何使用板上的LED、按钮、麦克风和GPIO扩展器。此外，还提供了关于电流测量的信息和使用技巧。
型号- GAP9
GreenWaves’ GAP9 Hearables Platform Enables State-of-the-art Features Such as Scene-aware Active Noise Cancellation and Neural network-based Noise Reduction
GreenWaves’ GAP9 hearables platform enables state-of-the-art features such as scene-aware active noise cancellation and neural network-based noise reduction with no compromise in area, cost or energy.
GAP-8: A RISC-V SoC for AI at the Edge of the IoT
Current ultra-low power smart sensing edge devices, operating for years on small batteries, are limited to low-bandwidth sensors, such as temperature or pressure. Enabling the next generation of edge devices to process data from richer sensors such as image, video, audio, or multi-axial motion/vibration has huge application potential.
GreenWaves Technologies Partners with Open-Silicon to develop Industry’s First IoT Processor Based on PULP and RISC-V
Open-Silicon, a system-optimized ASIC solution provider, today announced it was selected by GreenWaves Technologies to develop GAP8, the industry’s first IoT processor. GAP8 is built on the open source Parallel Ultra Low Power (PULP) and RISC-V ISA projects. Open-Silicon is providing GreenWaves Technologies with the complete RTL-to-physical design custom SoC implementation that is required to transform this smart IoT concept into working silicon in volume production.
GAP9下一代处理器，用于可听式设备和智能传感器多维计算，用于环境感知ANC、基于神经网络的降噪、3D声音、多传感器分析等
描述- 本资料介绍了GreenWaves Technologies的GAP9处理器，这是一款专为可穿戴设备设计的嵌入式音频处理器。该处理器集成了先进的数字信号处理能力和基于神经网络的算法，提供超低能耗和延迟。它支持主动降噪（ANC）、神经网络噪声消除、3D声音和多传感器分析等功能，适用于智能耳机等可穿戴设备和智能安全系统。
型号- GAP9
基于GAP9的TWS/耳机硬件架构及实现指南
描述- 本资料介绍了基于GAP9的TWS耳机和蓝牙连接耳机的硬件架构选项，包括单GAP9和双GAP9配置。资料提供了不同架构的示例，包括块图和实施指南，旨在帮助系统架构师和PCB设计师高效地将GAP9集成到目标耳机产品中。资料涵盖了GAP9与蓝牙SoC之间的接口、音频编解码器配置、传感器连接、功率管理、测试点、电池管理和外部存储等方面。此外，还讨论了GAP9作为纯协处理器的应用，以及与软件兼容性的影响。
型号- GAP9
New GAP8 SDK V2.1 Was Released from GreenWaves Technologies
New GAP8 SDK release from GreenWaves Technologies. This article will show the headline changes in this SDK.
GreenWaves Technologies Announced Availability of GAP8 Software Development Kit and GAPuino Development Board
GreenWaves’ pioneering GAP8 IoT Application Processor enables high-performing evaluation board and development kit.Grenoble, France and Santa Clara, Calif., May 22, 2018 – GreenWaves Technologies, a fabless semiconductor startup designing disruptive ultra-low power embedded solutions for image, sound and vibration AI processing in sensing devices, today announced the availability of its GAP8 Software Development Kit (SDK) and GAPuino Development Board. The GAPuino Boards are available for purchase here and the GAP8 SDK can be downloaded via GitHub.
GreenWaves Technologies GAP9实现超低功耗边缘计算的新维度
描述- GreenWaves Technologies推出的GAP9处理器旨在满足超低功耗边缘计算需求，适用于能量受限的设备，如物联网传感器、可穿戴设备和耳戴式产品。GAP9采用独特的架构，包括Fabric Controller、µDMA和Cluster，支持动态频率和电压缩放，优化功耗。它提供丰富的接口和内存选项，支持RISC-V指令集，并集成了神经网络加速器。GAP9 SDK包含开发工具和库，支持机器学习和音频应用开发，确保高效、安全的边缘计算体验。
型号- GAP9
GreenWaves Technologies Licenses Intrinsic ID Hardware Root of Trust for RISC-V AI Application Processor
GreenWaves’ pioneering RISC-V-based IoT application processors enable the cost-effective development, deployment and autonomous operation of intelligent, battery-operated sensing devices that capture, analyze, classify and act on the fusion of rich data sources such as images, sounds or vibrations at the very edge of the network.
GreenWaves Technologies Announces 7M€ Series A Funding with Huami, Soitec and other investors
Funds will finance the sales ramp of GreenWaves’ first product, GAP8,and the development of the GREENWAVES company’s next generation product.
电子商城
品牌：MELEXIS
品类：Triaxis Position Processor
价格：￥29.2242
现货： 160
现货市场
授权代理品牌：集成电路
授权代理品牌：分立元件
授权代理品牌：接插件及结构件
授权代理品牌：部件、组件及配件
授权代理品牌：电源及模块
授权代理品牌：电子材料
授权代理品牌：仪器仪表及测试配组件
授权代理品牌：电工工具及材料
授权代理品牌：机械电子元件
授权代理品牌：加工与定制
我要提问
登录 | 立即注册
提交评论