Abstract: In this paper, a new stereo matching system is presented. This system has two modules. The first one concerns the construction of region based structure primitive. Using this module, a three level structure (region-closed region boundary contour-feature points on the contour) can be obtained. The second module is a multilevel matching procedure. In each level, a generate- and-choose strategy is used to find the best matchings. Matching results from higher levels is used to guide the matching at the lower level. Moreover, the system can detect one-to-one and one-to-multiple/multiple-to-one region correspondence automatically. Thus, it is quite stable and capable of coping with complicated real scenes. Experimental results show that the system is effective in generating accurate disparity and depth measurements.