Login
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
|
research:vslam:dvso [2018/07/10 10:35] Nan Yang |
research:vslam:dvso [2018/08/25 11:09] Nan Yang |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| - | ====== Deep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometry ====== | + | ===== Deep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometry ===== |
| + | |||
| + | **Contact: | ||
| + | |||
| + | < | ||
| + | src=" | ||
| + | </ | ||
| + | < | ||
| + | |||
| + | ==== Abstract ==== | ||
| + | Monocular visual odometry approaches that purely rely on geometric cues are prone to scale drift and require sufficient motion parallax in successive frames for motion estimation and 3D reconstruction. In this paper, we propose to leverage deep monocular depth prediction to overcome limitations of geometry-based monocular visual odometry. To this end, we incorporate deep depth predictions into [[: | ||
| + | |||
| + | {{: | ||
| + | |||
| + | ==== Semi-Supervised Deep Monocular Depth Estimation ==== | ||
| + | We propose a semi-supervised approach to deep monocular depth estimation. It builds on three key ingredients: | ||
| + | |||
| + | {{: | ||
| + | |||
| + | ==== Deep Virtual Stereo Odometry ==== | ||
| + | Deep Virtual Stereo Odometry (**DVSO**) builds on the windowed sparse direct bundle adjustment formulation of monocular DSO. We use our disparity predictions for DSO in two key ways: Firstly, we initialize depth maps of new keyframes from the disparities. Beyond this rather straightforward approach, we also incorporate virtual direct image alignment constraints into the windowed direct bundle adjustment of DSO. We obtain these constraints by warping images with the estimated depth by bundle adjustment and the predicted right disparities by our network assuming a virtual stereo setup. | ||
| + | |||
| + | {{: | ||
| + | |||
| + | ==== Results ==== | ||
| + | We quantitatively evaluate our StackNet with other state-of-the-art monocular depth prediction methods on the publicly available KITTI dataset. For DVSO, we evaluate its tracking accuracy on the KITTI odometry benchmark with other state-of-the-art monocular as well as stereo visual odometry systems. In the [[: | ||
| + | |||
| + | === Monocular Depth Estimation === | ||
| + | |||
| + | {{: | ||
| + | |||
| + | {{: | ||
| + | |||
| + | === Monocular Visual Odometry === | ||
| + | |||
| + | {{: | ||
| + | |||
| + | {{: | ||
| + | |||
| + | {{: | ||
| + | |||
| + | ==== Publications | ||
| + | < | ||
| + | < | ||
| + | </ | ||
| - | **Contact: | ||
