An Image Processing VLIW Architecture for Real-Time Depth Detection

• Dan Iorga Delft University of Technology
• Razvan Nane Delft University of Technology
• Yi Lu Intel Benelux B.V.
• Edwin Van Dalen Intel Benelux B.V.
• Koen Bertels Delft University of Technology

Abstract

Numerous applications for mobile devices require 3D vision capabilities, which in turn require depth detection since this enables the evaluation of an object's distance, position and shape. Despite the increasing popularity of depth detection algorithms, available solutions need expensive hardware and/or additional ASICs, which are not suitable for low-cost commodity hardware devices. In this paper, we propose a low-cost and low-power embedded solution to provide high speed depth detection. We extend an existing off-the-shelf VLIW image processor and perform algorithmic and architectural optimizations in order to achieve the requested real-time performance speed. Experimental results show that by adding different functional units and adjusting the algorithm to take full advantage of them, a 640×480 image pair with 64 disparities1 can be processed at 36.75 fps on a single processor instance, which is an improvement of 23% compared to the best state-of-the-art image processor.

Keywords: VLIW, Hardware, Computer architecture, Real-time systems, Optimization, Kernel, Performance evaluation, stereo vision