A sharper digital eye for intelligent devices with the latest Arm ISP technology
[ Back ]   [ More News ]   [ Home ]
A sharper digital eye for intelligent devices with the latest Arm ISP technology

By: Thomas Ensergueix, senior director of embedded, Embedded & Automotive Line of Business, Arm

News highlights

January 03, 2019 -- Of all our five senses, sight is the most evolved and richest sense, and for decades the digital world has strived to exceed our own visual processing capabilities which are enabled by 2 million-plus nerve fibers from the retinas into the brain. Creating “digital eyes” for processing real-time higher-quality images to give viewers the truest sense of an environment is among the many challenges faced by the Arm ecosystem, which is working towards enabling a trillion connected devices. 

In fact, according to our estimates, demand for IoT devices with embedded vision capabilities are among the highest across connected devices:

In response to the demand for real-time higher image quality in those devices, today Arm is announcing a new generation of image signal processors (ISPs), the  Arm Mali-C52 and  Mali-C32 ISPs.

Translating perception into pixels

A critical aspect of image technology used in the aforementioned devices is the ISP technology embedded within each of them. In these constrained devices, the key function of an ISP is to deliver the most accurate and highest image quality when pulling data from an image sensor and processing each pixel, particularly where machine learning is involved. The new Arm Mali-C52 and Mali-C32 apply over twenty-five processing steps to each pixel, of which three critical ones deliver key differentiation in terms of image output quality. These include high-dynamic range (HDR), noise reduction and color management. By incorporating Arm’s market-leading Iridix technology and other industry-leading algorithms for noise and color management, Mali-C52 and Mali-C32 ISPs efficiently deliver all three at high resolution and in real-time (e.g. 4k resolution at 60fps).

Don’t miss a thing with high-dynamic range

The best way to highlight the need for high-dynamic range (HDR) is to consider the image output from a connected outdoor security camera installed in a bright outdoor environment, which is usually a scene with very bright parts and deep shadows. While our eyes can naturally perceive contrast in these environments, digital sensors typically need multiple exposures to capture such a scene. To faithfully represent this HDR scene, image technology requires 20 or 24-bits of precision per pixel, but digital system displays are typically 8-bit or 10-bit, thus limiting the amount of data they can handle. This also means that any computer vision engine post the ISP is also bounded to 8 to 10-bit precision. In this scenario, the ISP needs to process HDR data (at higher bit depth), then compress it and utilize it further. Ultimately, if the dynamic range is not managed properly, then the details in the shadows are lost.

The new Mali ISPs, with Arm’s dynamic range management and tone mapping technology, are designed to overcome these device limitations and enable viewers to see enhanced shadows, without touching or changing the highlights of the image.

A complete and flexible solution for faster time-to-market

The Mali-C52 can be configured for two different optimizations - image quality or area. This flexibility allows our silicon partners to use the same IP and software across a range of products and use cases. The Mali-C32 is optimized specifically for area in lower-power, cost-sensitive embedded vision devices such as entry-level access control or hobby drones.

Both ISPs are a complete solution as Arm delivers the hardware IP along with ISP software drivers, including the 3A libraries (auto-exposure, auto-white balance, auto-focus) and the calibration and tuning tools. Features and benefits include:

One trillion devices require a sharp digital eye

Arm’s vision to enable one trillion devices needs vision. Specifically, achieving our vision of a world of a trillion connected devices will require a sharper digital eye for many of those devices to see and understand their environments in order to be reliable sources of information to both machines and humans. This all starts with enabling the highest possible image quality, and the new Mali ISPs that Arm is making available to the market today will deliver it. 

Learn more about  Arm Mali-C52 and  Mali-C32 ISPs.

About Arm

Arm technology is at the heart of a computing and connectivity revolution that is transforming the way people live and businesses operate. Our advanced, energy-efficient processor designs have enabled intelligent computing in more than 130 billion chips. More than 70% of the world’s population are using Arm technology, which is securely powering products from the sensor to the smartphone to the supercomputer. This technology combined with our IoT software and end-to-end connectivity, device and data management platform enables customers to derive real business value from their connected devices and data. Together with our 1,000+ technology partners we are at the forefront of designing, securing and managing all areas of compute from the chip to the cloud.

All information is provided "as is" and without warranty or representation. This document may be shared freely, attributed and unmodified. Arm is a registered trademark of Arm Limited (or its subsidiaries). All brands or product names are the property of their respective holders. © 1995-2018 Arm Group.



Contact:

Arm
Alex Harrod
Senior PR Manager, US and EMEA
+44 7795 363057
Email Contact