Bid Farewell to ISP Tuning and Manual Parameter Tweaking with RZ/V2M “Tuned ISP“

时间： 2022-11-03 来源：Renesas Blogs

技术问答

Recently, the majority of camera sensor input has become 2Mpix (full-HD) or 8Mpix (4K). However, when using high-resolution sensors, it is common problem that there are few choices of sensor modules that support ISP functionality. Also, the module with ISP is more expensive than the module without ISP. Therefore, the MPUs that support ISP is more desirable to manipulate image data and improve image quality.

This use case does not require an external ISP chip, thus you can reduce the BOM cost of your product. On the other hand, ISP tuning is a time-consuming task because of manual parameters tuning and effectively it adds schedule delays and additional development.

Consider some of the challenges listed below:

Multi-function implementation challenges
Typically, ISP converts image data and simultaneously adds image improvements:
e.g., WDR that blends two or more images to enhance the image, 2D or 3D noise reduction
Complexity challenges
The number of registers also increases with increased ISP functionality.
In some cases, there were thousands of registers in the ISP.
You must adjust these registers to get the desired image quality.
Sensor-specific performance and availability challenges
The best setting depends on the sensor type because these settings need to consider the unique characteristics of the sensor such as color.
There are also differences in settings depending on the lens, for example, shading and distortion correction.

Even for users who are familiar with ISPs, many challenges need to be overcome and iterations are needed. Therefore, at RENESAS, we came up with a "Tuned ISP" concept to simplify the ISP functions of the RZ/V2M MPU to speed up the image improvement process and shorten development time. Renesas uses APIs to abstract each ISP function at a higher level without compromising the image quality of the ISP function.

The "Tuned ISP" has the following features:

Various ISP functions are supported as API.
The several functions such as auto exposure or auto white balance require additional software processing.
The API includes the processing, thus you can realize the total function only by calling the API.
The image quality by default starts at a baseline that is optimum.
From this setting, you can apply the fine adjustments using the parameters of API.
You can use the adjustment tool when you install your product in the field.
This tool also supports many functions such as exposure and distortion correction.

The setting by this tool is referred to by API, but you can change the setting without much parameter tuning or programming.

You can "easily" and "immediately" use the input images from the sensor with preset settings and APIs.This figure shows the support function of the RZ/V2M ISP.

Renesas also provides multimedia-related APIs. These can be easily implemented on encoded video streams after ISP conversion.

To get started, Renesas has selected the number of sensors that are supported on RZ/V2M and the APIs Renesas provides. We continue to expand the list of supported sensors by RZ/V2M’s "Tuned ISP".

Please refer to the functionality of API and related software.

RZ/V2M: The product with high-performance ISP and power efficiency AI inference
RZ/V2M ISP Support Package: Supports ISP and multimedia API
Introduction for Image Quality Functions listed the several API results
RZ/V2M Linux Package: Base software for RZ/V2M
RZ/V2M DRP-AI Support Package: supports AI inference function on RZ/V2M.

发送到邮箱 |
+1 赞 0
收藏
评论 0
| 转发至：

本文由深蓝的鱼转载自Renesas Blogs，原文标题为:Bid Farewell to ISP Tuning and Manual Parameter Tweaking with RZ/V2M "Tuned ISP"，本站所有转载文章系出于传递更多信息之目的，且明确注明来源，不希望被转载的媒体或个人可与我们联系，我们将立即进行删除处理。

全部评论（0）

暂无评论

【经验】RZ/T2M使用瑞萨工具生成IAR开发环境软件项目驱动的方法

瑞萨RZ家族发布了最新的MPU型号RZ/T2系列，那么对于该系列MPU如何使用瑞萨软件工具生成IAR开发环境代码呢，如下步骤主要介绍使用瑞萨RZT Smart Configurator工具生成RZ/T2M IAR开发环境软件项目驱动方法。

设计经验发布时间 : 2023-03-25

【经验】解析瑞萨MPU RZ/T1 SPI总线通信功能配置方法

当我们使用瑞萨（Renesas）MPU RZ/T1做项目开发时，基本都会用到SPI总线通信的功能，SPI总线通信速率较快很适合在单片机板级之间进行数据交互，本文将介绍使用瑞萨开发环境配置生成RZ/T1 SPI总线驱动程序的方法。

设计经验发布时间 : 2022-05-02

【经验】瑞萨MPU RZ/T1使用SSC生成EtherCAT CiA402协议栈方法

瑞萨MPU RZ/T1支持EtherCAT网络设计，如何使用协议栈工具生成相对应的EtherCAT从机栈代码呢，本文主要就Beckhoff工具生成EtherCAT CiA402协议栈方法做相关介绍。

设计经验发布时间 : 2021-12-26

“EMBEDDED AI MPU” RZ/V INTRODUCTION

型号- RZ/V2L,RZ/V2M,RZ/V2XX,RZ/V2MA,RZ/V SERIES,RZ/V2XXX,RZ/V3X

商品及供应商介绍 - RENESAS - 2023/9/18 PDF 英文下载查看更多版本

【经验】瑞萨MPU RZ/T1使用code generator生成SCI的初始代码方法

工程师初次使用瑞萨（Renesas）RZ/T1系列MPU时，可能不知道SCI该如何配置波特率，中断入口，中断标志位等。本文将介绍RZ/T1系列MPU利用code generator生产SCI的配置方法。

设计经验发布时间 : 2022-04-22

RZ/G MPU G2L,LC,UL GROUP

型号- RZ/G3YYY,RZ/G2L,RZ/G2M,RZ/G2LC,RZ/G2UL,RZ/G1M,RZ/G2N,RZ/G1N,RZ/G,RZ/G1C,RZ/G2E,RZ/G1E,RZ/G2H,RZ/G1H,RZ/G3YY,RZ/G3XX,RZ/G3ZZ,RZ/G4X,RZ/G3X,RZ/G3Y,RZ/G4XX,RZ/G3Z

商品及供应商介绍 - RENESAS - SEPTEMBER 2023 PDF 英文下载

【经验】瑞萨MPU RZ/T1使用双寄存器切换开启DMA传输的方法介绍

在项目中使用瑞萨（Renesas）MPU RZ/T1做从机接收大量数据时，为了传输和接收数据效率，我们会启用DMA传输的功能，有时候项目中需要传输的是两块数据，这时候我们可以使用双寄存器切换的方式来完成，本文主要介绍启用双寄存器切换启用DMA传输的方法。

设计经验发布时间 : 2022-06-25

Renesas（瑞萨电子）RZ系列64位/32位基于Arm的微处理器(MPU)选型指南

目录- RZ Series MPU RZ/A Series MPU RZ/G Series MPU RZ/T Series MPU RZ/N Series MPU RZ Family MPU Package overview

型号- RZ/A1M,RZ/A1L,RZ/N1D,RZ/G1M,RZ/G1N,RZ/A1H,R8A774BX,RZ/A1LU,RZ/G1C,RZ/G1E,RZ/G1H,RZ/A1,RZ/A,RZ/G2,RZ/N,RZ/A2M,RZ/G2M,RZ/G2N,RZ/G2M 96,R8A774EX,RZ/G,RZ/N1,RZ/G2E 96,RZ/A1LC,RZ/T1,RZ/G2E,RZ/T,RZ/G2H,R8A774C0,RZ/N1S,RZ FAMILY,R8A774AX,RZ/G2M-96CE,RZ/N1L

选型指南 - RENESAS - 2020.02 PDF 英文下载