Direkt zum Inhalt springen
Computer Vision Group
TUM School of Computation, Information and Technology
Technical University of Munich

Technical University of Munich

Menu

Links


DirectTracker: 3D Multi-Object Tracking Using Direct Image Alignment and Photometric Bundle Adjustment

Contact: Mariia Gladkova

Page is under development, stay tuned!

Abstract

Direct methods have shown excellent performance in the applications of visual odometry and SLAM. In this work we propose to leverage their effectiveness for the task of 3D multi-object tracking. To this end, we propose DirectTracker, a framework that effectively combines direct image alignment for the short-term tracking and sliding-window photometric bundle adjustment for 3D object detection. Object proposals are estimated based on the sparse sliding-window pointcloud and further refined using an optimization-based cost function that carefully combines 3D and 2D cues to ensure consistency in image and world space. We propose to evaluate 3D tracking using the recently introduced higher-order tracking accuracy (HOTA) metric and the generalized intersection over union similarity measure to mitigate the limitations of the conventional use of intersection over union for the evaluation of vision-based trackers. We perform evaluation on the KITTI Tracking benchmark for the Car class and show competitive performance in tracking objects both in 2D and 3D.

Video

Poster

Our work is presented in the poster session of the 2nd General Assembly in the Munich Data Science Institute

Citation

If you find our work useful, please consider citing:

@article{gladkova2022directtracker,
  title={DirectTracker: 3D Multi-Object Tracking Using Direct Image Alignment and Photometric Bundle Adjustment},
  author={Gladkova, Mariia and Korobov, Nikita and Demmel, Nikolaus and O{\v{s}}ep, Aljo{\v{s}}a and Leal-Taix{\'e}, Laura and Cremers, Daniel},
  journal={arXiv preprint arXiv:2209.14965},
  year={2022}
}

Rechte Seite

Informatik IX
Computer Vision Group

Boltzmannstrasse 3
85748 Garching info@vision.in.tum.de

Follow us on:

News

15.10.2022

NeurIPS 2022

We have two papers accepted to NeurIPS 2022.

15.10.2022

WACV 2023

We have two papers accepted at WACV 2023.

31.08.2022

Fulbright PULSE podcast on Prof. Cremers went online on Apple Podcasts and Spotify.

17.07.2022

MCML Kick-Off

On July 27th, we are organizing the Kick-Off of the Munich Center for Machine Learning in the Bavarian Academy of Sciences.

17.07.2022

AI Symposium

On July 22nd 2022, we are organizing a Symposium on AI within the Technology Forum of the Bavarian Academy of Sciences.

More