Imaging and Video
Applications such as Drones, Machine Vision, Gaming, Video Surveillance, Robotics, Advanced Driver Assistance Systems (ADAS) and HMI often use cameras and displays. These designs demand low power, support for various interfaces and design security so one's IP is protected.
Microsemi provides an ecosystem to quickly develop video and imaging application using SmartFusion2 and IGLOO2 devices. Numerous IPs needed for video applications are readily available for faster time-to-market. Microsemi SoC FPGAs offer a solution that can adapt to various input and output interfaces for cameras and displays.
Microsemi Offerings for Imaging and Video Solution
- Modular IP suite
- Designs for Parallel and MIPI CSI-2 sensor interface
- Display interface for 7:1 LVDS
- Audio processing capabilities
- Low power, security and reliability
- Easy-to-use software GUI to real-time configure video and audio
IP Suite and Reference Designs
* Imaging Advanced development kit to be purchased separately comes with free one-year Gold license for Libero SoC
Microsemi offers various IPs to reduce the development time of the video application using the SmartFusion2 and IGLOO2 devices. Block diagram shown here highlights some of the available IPs for these devices that can be useful for image processing and display applications.
Available Imaging/Video IPs
|Bayer Conversion||Combines bilinear interpolation and median filtering together|
|Video DMA||Uses 64-bit AXI Master interface to the DDR-SDRAM on-chip controllers|
|Video Scalar||Video Scalar IP based on Nearest neighbor algorithm|
|Alpha Blending||Supports per-pixel alpha blending and global alpha|
|Color Space (YCbCr)||RGB video data to YCrCb color space|
|Color Space (RGB)||YCrCb to RGB|
|Image De-noising Filter||Removes impulse noise. Supports 3x3 2D median filtering.|
|Image Sharpening Filter||Unsharp Mask algorithm. Programmable gain for edge directions|
|Display Enhancement (Brightness/Contrast/Hue)||IP enables user to adjust brightness, contrast, saturation and hue of the final video display to personal preferences|
|Image Edge Detection||Based on Sobel Operator|
|LVDS 7:1 Display||Supports Digital Display Interface|
|Display Controller||Reads the video data from display frame buffers and generate the required timing|
Parallel Image Sensor Interface
The design example shows how to interface an image sensor with parallel output using a SmartFusion2 SoC FPGA device. It uses the available IP cores (mentioned above) to also implement image processing and display control blocks.
The design files can be downloaded from here:
Parallel sensor interface design
MIPI CSI-2 Sensor Interface
Camera Serial Interface 2 (CSI-2) is one of the popular interface standards defined by Mobile Industry Processor Interface (MIPI) and is used to transfer pxel data at high-speeds from an image sensor to a processor. Microsemi provides an application note and a design example to show an image sensor interface implementation using MIPI CSI-2 protocol. The design files and application note can be downloaded from here:
MIPI CSI-2 sensor interface design files
MIPI CSI-2 Application note
Infrared and Thermal Imaging
Infrared cameras are used across segments such as industrial, defense, medical and security. One of the requirements for any infrared system is the lowest power as functionality mandates high sensitivity to temperatures. Microsemi's SmartFusion2/IGLOO2 based imaging solution is ideal here because of low-power and reliability.
Microsemi has a proven FPGA/SoC solution for HMI (Human Machine Interface) applications. Compact and modular IP suite ensures that HMI is implemented in lowest density FPGAs (5K LE), this along with features like In-Applications and In-System programming makes Microsemi solution ideal for HMI applications.
Microsemi has collaborated with Mikroprojekt to introduce SmartFusion2 SoC FPGA-based HMI solution. Click here for more information
Microsemi SoC FPGAs and FPGAs provide core data acquisition, processing and display functions while providing industry's best reliability and security in small footprint packages crucial for building differentiated, secure and reliable advanced driver assist systems.
Drones and Unmanned Aerial Vehicles (UAV) require significant image processing capabilities. The other two important requirements for imaging systems in this application are low-power and high-security. Microsemi SoC FPGAs and FPGAs based imaging solutions are ideal for these applications as they meet both the critical specifications for this application.
Imaging & Video Partner Solutions:
- Connector to support multiple sensor interface. Camera module shipped with kit is parallel interface
- LVDS 7:1 interface for connecting LCD
- HDMI Transmitter and Receiver sets and corresponding connectors
- Microsemi's Audio Processor (Timberwolf ZL38051)
- Analog Audio: Mic, headphone and speaker connectors
- Digital mics
- 100-pin FMC Connector
SmartFusion2 Advanced Development Kit - Microsemi offers 150K LE device inherently integrates reliable flash-based FPGA fabric, a 166 MHz Cortex™-M3 processor digital signal processing (DSP) blocks, static random-access memory (SRAM), embedded non-volatile memory (eNVM), and industry-required high-performance communication interfaces— all on a single chip.
|Imaging and Video Solution with Microsemi FPGAs and SoCs||633 KB||7/2016|
- Libero SoC Design Software integrates industry leading synthesis, debug and DSP support from Synopsys, and simulation from Mentor Graphics with power analysis, timing analysis and push button design flow.
IP User Guides
|UG0651: Scaler User Guide||219 KB||3/2017|
|UG0643: Image De-Noising Filter User Guide||521 KB||3/2017|
|UG0642: Image Sharpening Filter User Guide||755 KB||3/2017|
|UG0646: Display Enhancement User Guide||247 KB||2/2016|
|UG0640: Bayer Conversion User Guide||421 KB||3/2017|
|UG0649: Display Controller User Guide||260 KB||3/2017|
|UG0641: Alpha Blending User Guide||259 KB||3/2017|
|UG0639: Color Space Conversion User Guide||315 KB||2/2016|
|UG0645: Low Voltage Differential Signaling 7:1 User Guide||261 KB||10/2016|
|UG0644: DDR AXI Arbiter User Guide||344 KB||3/2017|
|UG0682: Pattern Generator User Guide||212 KB||2/2016|
|UG0693: Image Edge Detection User Guide||369 KB||3/2017|
Design Files - Parallel Camera Sensor Interface
|Design files for Parallel Camera Sensor Interface||194 MB||7/2016|
Design Files - MIPI CSI-2 Camera Sensor Interface
|Design files for MIPI CSI-2 Camera Sensor Interface
|DG0702: SmartFusion2 Imaging and Video Kit Demo Guide (Parallel Camera Sensor)
|DG0568: Interfacing SmartFusion2 SoC FPGA with External LPDDR Memory through MDDR Controller - Libero SoC v11.7
Board / Schematics
|QG0695: Imaging and Video Kit Quickstart Guide||1.00 MB||3/2017|
|VIDEO-DC-PRL Board Schematics||2.60 MB||8/2016|
|Part Number||Description||Status||List Price|
|Hardware Boards||VIDEO-DC-PRL||Imaging and video FMC and camera sensor module with parallel interface *||Available||$499|
|M2S150-ADV-DEV-KIT||SmartFusion2 Advanced Development Kit||Available||$999|
|IP||Obfuscated IP cores in Libero SoC||Available||Free|
|Reference design for Parallel sensor interface||Available - Download||Free|
|Reference design for MIPI CSi-2 sensor interface||Available - Download||Free|
|VDSOLCores-RM||IP Cores with RTL Source code - Node locked license||Available||$1,499|
|VDSOLCores-RMFL||IP Cores with RTL Source code - Floating license||Available||$1,499|
Imaging and video FMCs require SmartFusion2 Advanced Development Kit which has to be purchased separately.