RENESAS R-CAR V3H

Best-in-Class ASIL B/C System-on-Chip, 7,2 TOPS for Intelligent Camera Applications

The Renesas R-Car V3H is a System-on-Chip (SoC) designed for intelligent camera applications, delivering best-in-class TOPS/Watt for cutting-edge computer vision. It supports the latest NCAP 2020 requirements, including Driver Monitoring Systems, and provides a migration path toward NCAP 2025. Building on advanced recognition technology with integrated IP for convolutional neural networks (CNN), the R-Car V3H offers four times the CNN processing performance compared to its predecessor, achieving up to 7.2 TOPS overall processing, including all Computer Vision IPs, while maintaining low power consumption.

Target Applications

• Front Stereo Smart Camera for NCAP
• Surround View with 3D visualization
• Driver and Occupant Monitoring System
• Lidar System
• Intelligent Survey Camera
• Robotics
• Industrial Applications

Key Features

• 4 Arm® Cortex®-A53 cores: 9.2 kDMIPS
• Dual Cortex-R7 LockStep cores for AUTOSAR: 2kDMIPS
• Overall TOPS performance: 7.2 TOPS
• Integrated ISP with up to 8 Mpixel sensors, RGB-IR support
• Automotive Interfaces: Ethernet AVB, CAN FD, and FlexRay
• ASIL D development process for systematic capability for the full SoC
• Supporting metric targets for ASIL B (sensor layer, application processors) and ASIL C (realtime Domain) safety goals

Core Technologies:

• CNN IP
• Multi-Threading Computer Vision Engine
• HW Accelerator: optical flow, object detection, etc.

Block Diagram Overview

The R-Car V3H architecture is organized into several key functional blocks:

• Application CPU: Features 4x ARM® Cortex® A53 cores operating at 1.0GHz, providing 9.2k DMIPS, with L1 Instruction and Data cache, and FPU.
• Real-time CPU: Includes Dual Cortex® R7 Lockstep cores at 800MHz (2kDMIPS), with Slim IDMA, iDMA, security control (ICU-MX), and RT-SRAM (1MB).
• Image Pipeline: Comprises 2x MIPI-CSI2 inputs (4L D-PHY), 2x ISP at 533MHz, 2x IMR-RS at 400MHz, 3x IMR std at 400MHz, 1x Display Unit, and 1x OLDI/dRGB output.
• Video Codec: Offers VCP1E/H.264 encoder supporting YUV420/8bit at 1920 x 1080p x 60 fps.
• Memory Interface: Utilizes 32bit LPDDR4-3200 with Inline ECC and DRAM cache, along with 2x QSPI (1x Hyperflash) and 1x eMMC.
• Computer Vision & Deep Learning Accelerators: Includes CNN-IPv2, STV (533MHz), 5x IMP cores (533MHz), 5x ACF (533MHz), 5x CVev1.1 (32thr 533MHz), 1x DOF (533MHz), and IMPC (2MB).
• Connectivity: Provides 1x PCIe Rev2.0 (2L), IPC (320Mbps), FlexRay (2ch), AURORA (PCIe), Ethernet (1x Gbit AVB, 1x Gbit Std port), 3x CAN2.0B/CAN-FD, 4x UART, 6x SPI, and 7x I2C.
• System: Includes SYSRAM (384kB), Power domain control, Thermal Sensor, and JTAG Debug (Coresight).
• Package: FCBGA 538 pins, measuring 21x21mm with a 0.8mm pitch.

Benefits

• R-Car V3H is tailored for the Intelligent Camera System use case, balancing innovation and automotive constraints.
• Overall performance of 7.2 TOPS, capable of handling any state-of-the-art neural networks.
• Integrated ISP supports major Sensor Vendors ICs, drastically reducing system BOM. 8 Mpixel sensors enable V3H for Level 3 use, while support of the latest RGB-IR standard makes V3H ideal for Driver Monitoring systems.
• ASIL certified SoC reduces SW development effort and removes the need for additional redundant SOCs.
• Real-time ASIL C CPU core avoids the need for an external MCU to handle real-time tasks and AUTOSAR.
• Integrated development environment enables fast time-to-market for computer vision & deep learning-based solutions.
• Renesas provides PMIC specially developed for R-Car V3H, allowing optimized power management in ASIL environments.
• Wide Partners Ecosystem provides HW tools, Perception Systems for Camera, Lidar, and Sensor Fusion with Radar.

Development Platforms

Condor Development Board

The Condor Development Board includes:

• NOR flash memory
• LPDDR4-SDRAM for DBSC4
• DMI output connector for LVDS
• Camera input connectors
• eMMC memory for MMC
• PCIe x 4 connectors (2 lanes) for PCIe
• Ethernet, CAN, FlexRay interfaces
• Power supply: 12.0-V DC input

Packages include:

• Evaluation Board
• Power Supply
• CD with User's Manual

Software:

• Linux BSP (Linux.Org)
• Boot SW

V3H Starter Kit

The V3H Starter Kit includes:

• 2 GBytes DDR3L-1600
• 64 Mbytes Hyper Flash & 64 Mbytes QSPI Flash
• 16 GBytes eMMC
• HDMI, RGB, LVDS, MipiCSI2, EthernetAVB, CAN interfaces
• JTAG, Debug Interface
• On-board Connector with SOC signals

Packages include:

• Starter Kit
• Power Supply
• USB & HDMI Cable

Software:

• Linux BSP (Linux.Org)
• Configuration tools
• Mimi Monitor

SW Development Environment

Renesas offers a company-wide IDE initiative with ADAS-specific plug-ins, exemplified by e² studio. This environment enables efficient editing, building, debugging, and profiling of R-Car applications on both target hardware and simulators. The development workflow allows for detailed control, including setting breakpoints, inspecting registers, and tracing bus data. Profiler integration leverages built-in trace capabilities for in-depth analysis of IP activities and application execution.

HW Ordering Reference