一种基于三角形重投影的虚拟视角合成

相比较传统的视角插值合成方法只能在基线上合成虚拟图像,提出的一种基于三角形重投影的虚拟视角合成方法,可以在已知少数几个匹配点的情况下,将场景内容自动迭代划分为一致和非一致三角形区域,通过不同策略的三角形重投影实现更加自由的视点的虚拟图像合成.划分过程中引入直线段约束可以解决直线纹理在三角形接缝处的畸变问题,保证最后的合成图像中场景表示在此处的连续性.利用设计的可信度函数,沿一定搜索路径可找到更多的新匹配点,从而带来更多的一致三角形区域.将此方法应用到虚拟彩色图像的合成,实验结果证明了此方法可以在更大视点范围内合成逼近于真实图的虚拟图像.

Virtual view synthesis based on triangular re-projection

Traditional view interpolation can only synthesize the novel view along the base line. The proposed method based on triangular re-projection can iteratively divide the scene into consistent and inconsistent triangles given a few of initial matches, and implement free-viewpoint view synthesis by re-projecting these two groups of triangles in different strategies. The straight line constraint was introduced to direct the division along the line in order to reduce the discontinuity nearby the common side of two adjacent triangles. The new matching points were confirmed by the designed evaluation function in a special searching order. They were detected in the inconsistent regions for further division to produce more and more consistent regions. The color-image experiment proves that this method is effective to synthesize a photo-realistic image under wider changes in viewpoint.