Aiming at the needs of large data, high transport and complex operation, a real-time video-based processing system using SAA7115 as its capture A/D, TMS320DM642 as its core,SAA7105 as its display D/A ,is designed, and FPGA is used to control the display to achieve advanced function. The system using two cameras to capture image data can fulfil the demands of capture, processing and display of multi-channel video. Furthermore, it can be used as the video and image processing platform.