Direkt zum Inhalt springen
Computer Vision Group
TUM School of Computation, Information and Technology
Technical University of Munich

Technical University of Munich

Menu

Links


VI-DSO: Direct Sparse Visual-Inertial Odometry using Dynamic Marginalization

Abstract

We present VI-DSO, a novel approach for visual-inertial odometry, which jointly estimates camera poses and sparse scene geometry by minimizing photometric and IMU measurement errors in a combined energy functional. The visual part of the system performs a bundle-adjustment like optimization on a sparse set of points, but unlike key-point based systems it directly minimizes a photometric error. This makes it possible for the system to track not only corners, but any pixels with large enough intensity gradients. IMU information is accumulated between several frames using measurement preintegration, and is inserted into the optimization as an additional constraint between keyframes. We explicitly include scale and gravity direction into our model and jointly optimize them together with other variables such as poses. As the scale is often not immediately observable using IMU data this allows us to initialize our visual-inertial system with an arbitrary scale instead of having to delay the initialization until everything is observable. We perform partial marginalization of old variables so that updates can be computed in a reasonable time. In order to keep the system consistent we propose a novel strategy which we call "dynamic marginalization". This technique allows us to use partial marginalization even in cases where the initial scale estimate is far from the optimum. We evaluate our method on the challenging EuRoC dataset, showing that VI-DSO outperforms the state of the art.

Downloads

The paper can be downloaded at: http://arxiv.org/abs/1804.05625
There is also supplementary material with additional evaluation and mathematical derivations at: vi-dso-supplementary-material.pdf.
The video is available at: https://youtu.be/GoqnXDS7jbA

The project is based on DSO which was developed by Jakob Engel.


Export as PDF, XML, TEX or BIB

Journal Articles
2022
[]DM-VIO: Delayed Marginalization Visual-Inertial Odometry (L. von Stumberg and D. Cremers), In IEEE Robotics and Automation Letters (RA-L) & International Conference on Robotics and Automation (ICRA), volume 7, 2022. ([arXiv][video][project page][supplementary][code]) [bibtex] [doi]
Conference and Workshop Papers
2018
[]Direct Sparse Visual-Inertial Odometry using Dynamic Marginalization (L. von Stumberg, V. Usenko and D. Cremers), In International Conference on Robotics and Automation (ICRA), 2018. ([supplementary][video][arxiv]) [bibtex] [pdf]
Powered by bibtexbrowser
Export as PDF, XML, TEX or BIB

Rechte Seite

Informatik IX
Computer Vision Group

Boltzmannstrasse 3
85748 Garching info@vision.in.tum.de

Follow us on:

News

15.10.2022

NeurIPS 2022

We have two papers accepted to NeurIPS 2022.

15.10.2022

WACV 2023

We have two papers accepted at WACV 2023.

31.08.2022

Fulbright PULSE podcast on Prof. Cremers went online on Apple Podcasts and Spotify.

17.07.2022

MCML Kick-Off

On July 27th, we are organizing the Kick-Off of the Munich Center for Machine Learning in the Bavarian Academy of Sciences.

17.07.2022

AI Symposium

On July 22nd 2022, we are organizing a Symposium on AI within the Technology Forum of the Bavarian Academy of Sciences.

More