A CMOS image sensor is a device that converts light into electrical signals, which can be used for digital imaging applications. CMOS stands for complementary metal-oxide semiconductor, which is a type of technology that allows for low-power and high-performance integrated circuits
A RISC-V IP SoC is a system-on-chip that integrates a RISC-V processor with other components, such as memory, peripherals, and interfaces. RISC-V is an open and free instruction set architecture (ISA) that enables innovation and customization for different domains and applications
Recently, a company called OmniVision Technologies announced the first automotive-grade CMOS image sensor with a RISC-V IP SoC, called the OV9284. This sensor is designed for driver monitoring systems (DMS) and cabin monitoring systems (CMS) in smart cars, which can enhance safety and comfort for drivers and passengers
The OV9284 is a 1-megapixel sensor that can capture 1280×800 resolution images at 60 frames per second, with high dynamic range (HDR) and near-infrared (NIR) sensitivity. It also features a built-in image signal processor (ISP) that can perform functions such as noise reduction, lens correction, and color processing
The RISC-V IP SoC in the OV9284 is based on the PULP platform, which is a collection of open-source cores and SoCs developed by the University of Bologna and ETH Zurich. The PULP platform aims to provide energy-efficient and flexible solutions for embedded and IoT applications
The RISC-V IP SoC in the OV9284 enables the sensor to perform advanced functions, such as face detection, eye tracking, gaze estimation, and gesture recognition. These functions can help the DMS and CMS to monitor the driver’s attention, alertness, and fatigue, as well as the passenger’s comfort, preferences, and behavior
The OV9284 is the first CMOS image sensor to achieve the AEC-Q100 Grade 2 certification, which means it can operate reliably in temperatures ranging from -40°C to +105°C. This makes it suitable for automotive applications, which require high standards of quality and durability
The OV9284 also offers low power consumption, which is important for battery-operated and electric vehicles. The sensor consumes only 90mW of power when operating at full resolution and frame rate, and can reduce its power consumption by using a low-power mode or a standby mode
The OV9284 is a breakthrough product that demonstrates the potential of combining CMOS image sensors with RISC-V IP SoCs. It offers high performance, low power, and flexibility for automotive applications, as well as other domains that can benefit from smart vision systems
The following table summarizes some of the key features and specifications of the OV9284:
| Feature | Specification |
|---|---|
| Resolution | 1280×800 |
| Frame Rate | 60 fps |
| Pixel Size | 3 μm x 3 μm |
| Sensor Size | 1/4 inch |
| HDR | Yes |
| NIR | Yes |
| ISP | Yes |
| RISC-V IP SoC | Yes |
| AEC-Q100 Grade | 2 |
| Power Consumption | 90 mW |
