Single-View 3D Object Shape Estimation

An accurate single-view 3D reconstruction algorithm would allow researchers to develop better systems in robotics and VR/AR applications. However, single-view 3D reconstruc- tion is an ill-posed problem and thus solvable only for scenes that satisfy strong regularity conditions. Features such as texture variations, haze, colour, shading, known object size and occlusion can provide information about 3D structures. Further, the built environment has repeated patterns and orthogonal straight lines that contain structured information with strong regularities. In this report, I will introduce the research I have done for my PhD on the single-view reconstruction problem in two parts. Part 1 will detail the three research projects I have completed on single-view 3D reconstruction of the built environment: 1) line segment detection [4], 2) single-view geometry-driven road segmentation [5], and 3) single-view 3D reconstruction of Manhattan buildings [158]. Part 2 will detail the research I have done on reconstructing the 3D shape of more general objects from their bounding contours.