Embedded vision systems are the keystones to many advanced capabilities in modern applications including augmented vision, automotive, machine vision, medical, and Smart City cameras. Modern vision systems require high resolution, high frame rates, and increasing pixel depth, presenting significant data rate and memory bandwidth challenges. Xilinx offers both cost-optimized and high-performance MIPI-based solutions for camera sensor capture and display, supporting D-PHY, CSI-2, and DSI protocols. Additionally, Xilinx offers Image Signal Processing IP required by many image sensor applications for color conversion, correction, balancing, and more. Every design has unique requirements, the flexibility of Xilinx devices enables developers to meet those needs as well as differentiate their solutions.
Receiver and Transmitter Controller Subsystems
Transmitter Controller Subsystem
Xilinx devices support multiple MIPI configurations, from single to multiple links, different data rates, and data types, and can mix receive and transmit datapaths on a single device. Xilinx devices are also expandable, limited only by the number of I/Os. To further accelerate or streamline solutions, programmable logic enables integration of the entire image signal processing (ISP) chain, while remaining scalable and field upgradable as ISP algorithms improve.
|Cost-Optimized Portfolio||High-Performance Devices|
The Xilinx Automotive (XA) portfolio solves industry challenges within ADAS, Automated Driving, In-Vehicle Infotainment & Driver Information, and Electrification & Networking. Adaptable architecture allows customers to achieve low-latency compute and the ability to connect a wide array of interfaces – including MIPI. As enhancements to the MIPI protocol are released in the toolchain, Xilinx's flexible silicon can adapt – letting customers design their systems with the latest interfaces for the fastest data transmission possible.
Smart Cities and Smart Retail require a complex mix of compute requirements spanning from the cloud to the edge. Xilinx Industrial Vision solutions deliver camera and image processing platforms with optimal performance, power, and cost – while also offering low latency and high reliability. Xilinx offerings include heterogeneous embedded processing, I/O flexibility, hardware-based deterministic control, and comprehensive solutions able to handle harsh environments over industrial life cycles. The Vitis™ unified software platform and Vitis™ AI development environment simplify development of accelerated applications and AI inference across Xilinx hardware platforms, enabling video security equipment manufacturers and AI developers to rapidly create scalable and differentiated products.
Consumer products implement machine learning to improve autonomy, user interaction, and situational awareness. Traditional applications such as DSLR cameras, printers, and video conferencing are now being accompanied by camera-enabled robots and drones, TVs, virtual reality headsets, and smart appliances. Xilinx offers high-resolution MIPI interfaces along with machine learning, video compression, and a wide variety of AV interfaces to achieve adaptable, low-cost, single-chip solutions. This high level of integration is enabling the next wave of immersive consumer video and imaging products with increasing levels of autonomy and analytics.
With 30+ continuous years of heritage and support, Xilinx delivers the broadest product portfolio for enabling the next generation of advancements in ground-based, airborne, and space systems. Commercial-grade and Defense-grade variants of Zynq® UltraScale+™ MPSoC devices satisfy requirements for MIPI sensor imaging and connectivity. Various platforms are available including the UAV and Robotics Platform, which is built on the ZU7EV device with support for dual 4Kp60 MIPI connectivity in a software programmable platform.
Whether the application is conferencing and collaboration, digital cinema, or traditional broadcast, MIPI allows for the integration of the latest sensor technology for broadcast and professional video capture applications. MIPI IP, combined with any-to-any media connectivity, a Video Codec Unit (VCU), and 8K capable video processing elements, enables the latest developments in applications such as intelligent digital signage, 4K UHD broadcast, machine learning collaboration, and high quality, low bit rate live streaming.
A broad range of Industrial and Healthcare IoT applications can leverage MIPI support on our Cost-Optimized Portfolio platforms. These include vision-guided robotics, security cameras, Smart Cities, smart retail, endoscopy, and machine vision. If you are looking to design with our Spartan-7 FPGA or Zynq-7000 SoC families, start with these kits.
The SP701 Evaluation Kit, equipped with the best-in-class performance-per-watt Spartan®-7 FPGA, is built for designs requiring sensor fusion such as industrial networking, embedded vision, and automotive applications. The SP701 features video interfaces including MIPI CSI, DSI, and HDMI. It also features high I/O availability and I/O expansion capability via Pmods and FMC connectors making it the largest IP development canvas for Spartan-7 FPGA users.
Learn more >
Featuring the Spartan-7 XC7S100 FPGA
|System Logic Cells (K)||102|
|Memory||1,100Kb DRAM, 4,320Kb Block RAM|
|Maximum I/O Pins||400|
|Additional Features||8 clock management tiles (1MMCM + 1 PLL)|
|1 analog to digital converter (XADC)|
|1 configuration AES / HMC Block|
The Zybo Z7 from Digilent is built around the Zynq-7000 device, integrating dual Arm® Cortex®-A9 processors with 7 series programmable logic. The Zybo Z7 kit offers a video-capable feature set that includes a MIPI CSI-2 compatible Pcam connector, HDMI input and output, high DDR3L bandwidth, and other multimedia and connectivity peripherals. This feature set provides an affordable solution for complex embedded vision applications.
Featuring the Zynq-7000 XCZ7010 SoC or XC7Z020 SoC
|System Logic Cells (K)||28||85|
2.1Mb Block RAM
4.9Mb Block RAM
|Maximum I/O Pins||100||125|
|Additional Features||2 clock management tiles (1MMCM + 1 PLL)||4 clock management tiles (1MMCM+1PLL)|
|1 analog to digital converter (XADC)||1 analog to digital converter (XADC)|
|1 AES and SHA block||1 AES and SHA block|
For AI or video focused industrial, medical imaging, endoscopy, healthcare edge AI and more, our High-Performance device platforms open up added performance and features. If your application includes a need for video encoding or machine learning, check out our high-performance line based on the Zynq UltraScale+ MPSoCs.
The ZCU104 Evaluation Kit enables designers to jumpstart designs for embedded vision applications such as surveillance, Advanced Driver Assisted Systems (ADAS), machine vision, Augmented Reality (AR), drones, and medical imaging. This kit features a Zynq® UltraScale+™ MPSoC EV device with integrated video codec and supports many common peripherals and interfaces for embedded vision applications. The included ZU7EV device is equipped with a quad-core Arm® Cortex®-A53 applications processor, dual-core Cortex-R5F real-time processor, Mali™-400 MP2 graphic processing unit, 4KP60 capable H.264/H.265 video codec, and 16nm FinFET+ programmable logic.
Learn More >
Featuring the Zynq UltraScale+ XCZU7EV-2FFVC1156 MPSoC
|System Logic Cells (K)||504
|Video Codec Unit
|Maximum I/O Pins
Ultra96-V2, is an Arm-based development board built around the Zynq UltraScale+™ MPSoC. Available in commercial and industrial temperature grades, Ultra96-V2 has been designed with a certified radio module from Microchip. Additional power control and monitoring is possible with the included Infineon Pmics. Engineers have options of connecting to Ultra96-V2 through a Webserver using integrated wireless access point capability or to use the provided Linux Matchbox windows environment that can be viewed on the integrated Mini DisplayPort video output. Multiple application examples and onboard development options are provided as examples.
Learn More >
Featuring the Zynq UltraScale+ MPSoC ZU3EG A484
|System Logic Cells (K)||154
|Video Codec Unit
|Maximum I/O Pins
The VCK190 kit is the first Versal™ AI Core series evaluation kit, enabling designers to develop solutions using AI and DSP engines capable of delivering over 100X greater compute performance than today's server-class CPUs.
With a breadth of connectivity options and standardized development flows, the VCK190 kit features the Versal AI Core series VC1902 device, providing the portfolio's highest AI inference and signal processing throughput.
Learn More >
Featuring the Versal VC1902 ACAP
|System Logic Cells (K)||1,968|
|Application Processing Unit||Dual-Core Arm® Cortex®-A72|
|Real-Time Processing Unit||Dual-Core Arm Cortex-R5F|
|Maximum I/O Pins||770
|Programmable NoC Ports||28|
|Integrated Memory Controllers||4|
Platform designed specifically to meet the extreme vision and sensor processing requirements of UAV and Robotics development.
The UAV and Robotics Platform (URP) meets the typical processing requirements encountered when designing robotics and UAV applications. It is a Zynq UltraScale+ MPSoC based platform, providing a broad spectrum of processing capabilities. The small form factor board integrates sensors-on-board, software, and FPGA logic. With its motor control units, position sensors, obstacle detection interfaces, and communication resources, the URP can be used for many applications.
Learn More >
|System Logic Cells (K)||504
|Video Codec Unit||1
|Maximum I/O Pins||464
|Design Example||Description||Device Support|
|Spartan-7 SP701 Application Example
This example showcases a CSI-2 Subsystem IP with a PCAM camera module (Digilent), which is a popular interface used by MIPI CSI camera modules, and a DSI Subsystem IP with a display. These are both controlled by a MicroBlaze™ soft processor and all the IP is integrated in Vivado®. The D-PHY is implemented on the SP701 evaluation kit using passive components.
|Zynq UltraScale+ MPSoC ZCU102 and Versal ACAP VCK190 Application Example
This design demonstrates the use of the MIPI CSI-2 RX (decodes and processes video data) and MIPI DSI TX subsystems on the Zynq® UltraScale+™ ZCU102 board or Versal™ ACAP VCK190 board. The system receives images captured by the IMX274 image sensor. Processed images are then displayed on either an HDMI monitor or a MIPI DSI display.
|Zynq UltraScale+ MPSoC