Tracking with Online Multiple Instance Learning (MILTrack)

In this paper, we address the problem of learning an adaptive appearance model for object tracking. In particular, a class of tracking techniques called ``tracking by detection'' have been shown to give promising results at real-time speeds. These methods train a discriminative classifier in an online manner to separate the object from the background. This classifier bootstraps itself by using the current tracker state to extract positive and negative examples from the current frame. Slight inaccuracies in the tracker can therefore lead to incorrectly labeled training examples, which degrades the classifier and can cause further drift. In this paper we show that using Multiple Instance Learning (MIL) instead of traditional supervised learning avoids these problems, and can therefore lead to a more robust tracker with fewer parameter tweaks. We present a novel online MIL algorithm for object tracking that achieves superior results with real-time performance.

Figure 1 - Updating a discriminative appearance model: (A) Using a single positive image patch to update a traditional discriminative classifier. The positive image patch chosen does not capture the object perfectly. (B) Using several positive image patches to update a traditional discriminative classifier. This can confuse the classifier causing poor performance. (C) Using one positive bag consisting of several image patches to update a MIL classifier.

Code

MilTrack Version 1.0. Licensed under LGPL, use at own risk.

Data *NEW clips added*

For each clip we provide a zip file that contains the following: (1) a directory with the original image sequence; image are named "img0000.png", "img00001.png", etc. (2) a [name]_frames.txt file that contains the frame number of the first and last frame of the sequence, (3) a [name]_gt.txt file that contains ground truth object locations; each line corresponds to a frame, and contains the "x,y,width,height"; note that this information is only available for 1 in every 5 frames, the rest is filled with 0's, (4) MILTrack restults for 5 trials in the same format as above.

Related Publications