Microsemi SmartFusion2 Imaging and Video Kit MIPI CSI-2 Demo Guide

Revision History

The revision history describes the changes that were implemented in the document. The changes are listed by revision, starting with the most current publication.

Revision 1.0

Revision 1.0 is the first publication of this document.

SmartFusion2 Imaging and Video MIPI CSI-2

The SmartFusion2 Imaging and Video MIPI CSI-2 demo is based on the SmartFusion2 Advanced Development Kit and SmartFusion2 Imaging and Video MIPI CSI-2 Daughter Card.

The Microsemi SmartFusion2 Advanced Development Kit offers a full-featured 150K LE SmartFusion2 system-on-chip (SoC) FPGA. The device integrates reliable flash-based FPGA fabric, a 166 MHz ARM Cortex-M3 processor, advanced data security features, digital signal processing (DSP) blocks, static random-access memory (SRAM), embedded non-volatile memory (eNVM), and industry-required high-performance communication interfaces—all on a single chip. It also supports all the data security features available in SmartFusion2 devices. For more information, see Microsemi SmartFusion2 Advanced Development Kit.

The video daughter board provides several interfaces for video applications and the circuitry necessary to connect to an FPGA device through an FMC connector.

Description of Figure 1: MIPI CSI-2 Daughter Card: A printed circuit board featuring the MIPI CSI-2 interface, with connectors labeled 'IMAGE SENSOR', 'Display LVDS 7:1', 'LCD SIGNAL', and 'HDMI TX CON2'.

This demo guide provides essential information for setting up an environment to demonstrate the video solution, including hardware IP blocks and software. It details the hardware setup and connections required to run the demo design. A fully integrated video solution with an easy-to-use GUI is provided to demonstrate the following functions and facilitate quick prototype design:

• CFA to RGB conversion
• Display timing generator
• Alpha blending
• Edge detection
• Image enhancements (such as sharpening, brightness, contrast, hue, and saturation)

For detailed information about these features, visit: Microsemi Imaging Features.

Features

• HDMI transmitter (ADV7511) chip set and corresponding connector
• LVDS 7:1 interface for connecting LCD
• Image sensor interface that supports MIPI CSI-2
• Low pin count (LPC) FMC connector

Design Requirements

The following table lists the design requirements.

¹ Not shipped with SmartFusion2 Imaging and Video MIPI CSI-2 Daughter Card; must be purchased separately.

² Included with SmartFusion2 Advanced Development Kit.

³ If the display does not support HDMI input, use an adapter that converts the HDMI out from the imaging card to a protocol supported by the display.

Demo Design

The demo programming files are available for download at: Microsemi DG0723 Programming Files.

The programming files include:

• readme.txt file
• STAPL programming file

Description of Figure 3: Demo Programming Files Top-Level Structure: A hierarchical view of the programming files, showing folders and files like 'm2s_dg0723_pf', 'readme.txt', and the STAPL file 'IDB_AR0330_MIPI_ADK150.stp'.

The GUI installers are available for download at: Microsemi Imaging Video Demo GUI Installer.

The GUI installer files include:

• GUI installer
• readme.txt file

Description of Figure 4: GUI Installer Top-Level Structure: A hierarchical view of the GUI installer files, showing folders and files like 'imaging_video_demo_gui', 'readme.txt', 'GUI', 'bin', 'license', 'supportfiles', 'nidist.id', 'setup.exe', and 'setup.ini'.

Setting Up the Demo Design

This section describes how to set up the hardware for running the demo design and how to install the demo GUI.

Setting Up the Hardware

The hardware setup for the demo design involves establishing appropriate hardware connections for the SmartFusion2 Imaging and Video MIPI CSI-2 Daughter Card and the SmartFusion2 Advanced Development Kit.

Description of Figure 5: Hardware Setup: A photograph displaying the complete hardware setup, connecting the SmartFusion2 Advanced Development Kit, the MIPI CSI-2 Daughter Card, and the camera module.

Setting Up the Video Daughter Card

1. Connect the video daughter board to the LPC (J60) FMC connector of the SmartFusion2 Advanced Development Kit.
2. Connect one end of the HDMI cable to the HDMI Connector (CON2) of the video daughter board and the other end to the monitor.

Description of Figure 6: Video Daughter Card Setup: A close-up view of the MIPI CSI-2 Daughter Card, showing the HDMI connector (CON2) and other interfaces.

3. Connect one end of the image sensor ribbon cable to the image sensor interface (J21) on the video daughter board and the other end to the MIPI sensor (AR0330).

Description of Figure 7: Camera Ribbon Cable Connection: Diagrams illustrating the correct and incorrect methods for connecting the image sensor ribbon cable to the daughter card and the sensor.

Setting Up the SmartFusion2 Advanced Development Kit

1. Connect the 12 V power supply brick to J42 to supply power to the board.
2. Close pins 1-2 of J354 to select the core voltage 2.5 V.
3. Close pins 1-2 of J121 and J124.
4. Connect a USB cable (mini USB to Type A USB cable) to J33 and the other end of the cable to a USB port on the host PC. Connect one end of the USB micro connector to P1 and the other end of the cable to the host PC.

Description of Figure 8: SmartFusion2 Advanced Development Kit Setup: A photograph of the SmartFusion2 Advanced Development Kit board, highlighting key connectors and components such as the FMC connector (LPC), J-354, Micro USB connector, 12 V power supply, and SW7 switch.

6. Switch ON the SW7 power supply switch.
7. Open the FlashPro software, and program the STAPL file (IDB_AR0330_MIPI_ADK150.stp). For information about how to program using FlashPro, see UG0557: SmartFusion2 SoC FPGA Advanced Development Kit User Guide.

Installing the Video Demo GUI

The following steps describe how to install the Video Demo GUI:

1. Open the folder containing the GUI Installer files, and run setup.exe. Click Yes for any message from User Account Control. The Setup window is displayed with the default locations.
2. Accept the license agreement, and click Next.
3. Confirm the installation location in the installation dialog box, and click Next. A progress bar appears that shows the progress of the installation. Upon successful installation, a confirmation message is displayed.
4. Click Finish to exit the installation wizard.
5. Restart the host PC.

After installing the video demo GUI, check the Device Manager to see if the USB drivers are already configured on the host machine. To check if the drivers are configured, after ensuring that the hardware is powered ON and connected to the host PC using a USB cable (P1 on the board), check whether NI-VISA USB devices appear in the Device Manager, as shown in Figure 12. If they appear, proceed to run the demo design.

Configuring the GUI Driver

The following steps describe how to install the GUI driver on a host PC that has Windows 7 or later installed. The downloaded programming file must be programmed on the board before proceeding to driver installation.

1. Connect the host PC to the P1 connector on the SmartFusion2 Advanced Development Board using a USB A to mini-B USB cable.
2. Connect the power adapter to the kit, and switch ON the SW7 switch.
3. Navigate to C:\Windows\inf, and right-click the MSCC_UsbHID file.

Description of Figure 9: MSCC_UsbHID File Installation: A screenshot of Windows File Explorer showing the 'inf' directory, with the 'MSCC_UsbHID' file highlighted.

4. Click Install, and in the dialog box that asks you to confirm if you want to install the software, click Install again.

Description of Figure 10: Windows Security Dialog Box for MSCC_UsbHID File Installation: A Windows security prompt asking for confirmation to install device software from 'Microsemi Inc NI-VISA USB Devices'.

Description of Figure 11: Confirmation Message after MSCC_UsbHID File Installation: A Windows message indicating that the operation completed successfully.

5. In the Device Manager, under Network Adapters, check to confirm that NI-VISA USB Devices appears in the list, and that when expanded, it shows the MSCC_UsbHID driver. If the driver does not appear, re-scan the Device Manager for hardware changes or reset the board.

Description of Figure 12: MSCC_UsbHID File in Device Manager: A screenshot of Windows Device Manager showing 'NI-VISA USB Devices' listed under Network Adapters, with 'MSCC_UsbHID' expanded.

Running the Demo Design

The following steps describe how to run the demo design using the Video Demo GUI.

1. Go to the Start menu, and select Video_Demo_GUI to open the GUI.

Description of Figure 13: SmartFusion2 Video Demo GUI in Windows Start Menu: A screenshot of the Windows Start Menu, showing the path to launch the 'Video_Demo_GUI' application.

2. Click the Connect button on the top right side of the window. Upon successful connection, the Connect button turns green and the text changes to Connected.

Description of Figure 14: SmartFusion2 Video Demo GUI Launch Window: A screenshot of the application's main window, displaying image enhancement sliders (Brightness, Contrast, Saturation, Hue, Sharpness), demo type selection, configuration information, and control buttons (Configure, Start, Stop, Exit).

The following sections describe the two demos available in the Video Demo GUI:

• Camera Sensor Demo
• Edge Detection Demo

Camera Sensor Demo

To run the Camera Sensor Demo:

• Select the Camera Sensor Demo from the Demo Type Selection drop-down list. The video is displayed on the monitor with the Microsemi logo on it, thus demonstrating the alpha blending feature.

Description of Figure 15: Camera Sensor Demo Selection: A screenshot of the GUI with the 'Demo Selection' dropdown menu open, showing 'Camera Sensor Demo' highlighted.

Properties such as brightness, contrast, saturation, hue, and sharpness can be adjusted to enhance the clarity of the video.

Description of Figure 16: Image Enhancement Features: A screenshot of the GUI highlighting the image enhancement sliders for adjusting video clarity.

Edge Detection Demo

To run the Edge Detection Demo:

• Select the Edge Detection option from the Demo Type Selection drop-down list.

Description of Figure 17: Edge Detection Demo Selection: A screenshot of the GUI with the 'Demo Selection' dropdown menu open, showing 'Edge Detection' highlighted.

The edges of the image currently appearing on the monitor are highlighted.

Description of Figure 18: Normal Image vs. Edge-Detected Image—Example 1: Two images displayed side-by-side, showing an object in its normal view and its edge-detected representation.

Description of Figure 19: Normal Image vs. Edge-Detected Image—Example 2: Two images displayed side-by-side, showing a mug with the Microsemi logo in its normal view and its edge-detected representation.