Abstract / Description of output
Given a set of algorithms, which one(s) should you apply to, i) compute optical flow, or ii) perform feature matching? Would looking at the sequence in question help you decide? It is unclear if even a person with intimate knowledge of all the different algorithms and access to the sequence itself could predict which one to apply. Our hypothesis is that the most suitable algorithm can be chosen for each video automatically, through supervised training of a classifier. The classifier treats the different algorithms as black-box alternative “classes,” and predicts when each is best because of their respective performances on training examples where ground truth flow was available.
Our experiments show that a simple Random Forest classifier is predictive of algorithm-suitability. The automatic feature selection makes use of both our spatial and temporal video features. We find that algorithm-suitability can be determined per-pixel, capitalizing on the heterogeneity of appearance and motion within a video. We demonstrate our learned region segmentation approach quantitatively using four available flow algorithms, on both known and novel image sequences with ground truth flow. We achieve performance that often even surpasses that of the one best algorithm at our disposal.
Our experiments show that a simple Random Forest classifier is predictive of algorithm-suitability. The automatic feature selection makes use of both our spatial and temporal video features. We find that algorithm-suitability can be determined per-pixel, capitalizing on the heterogeneity of appearance and motion within a video. We demonstrate our learned region segmentation approach quantitatively using four available flow algorithms, on both known and novel image sequences with ground truth flow. We achieve performance that often even surpasses that of the one best algorithm at our disposal.
Original language | English |
---|---|
Title of host publication | 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition |
Publisher | Institute of Electrical and Electronics Engineers |
Pages | 1054-1061 |
Number of pages | 8 |
ISBN (Electronic) | 978-1-4244-6985-7 |
ISBN (Print) | 978-1-4244-6984-0 |
DOIs | |
Publication status | Published - 5 Aug 2010 |
Event | 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - San Francisco, United States Duration: 13 Jun 2010 → 18 Jun 2010 http://tab.computer.org/pamitc/archive/cvpr2010/index.html |
Publication series
Name | |
---|---|
Publisher | Institute of Electrical and Electronics Engineers (IEEE) |
ISSN (Print) | 1063-6919 |
Conference
Conference | 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition |
---|---|
Abbreviated title | CVPR 2010 |
Country/Territory | United States |
City | San Francisco |
Period | 13/06/10 → 18/06/10 |
Internet address |
Keywords / Materials (for Non-textual outputs)
- computer vision
- image classification
- image matching
- image motion analysis
- image segmentation
- image sequences
- video segmentation
- algorithm suitability
- optical flow
- image sequence
- ground truth flow
- random forest classifier
- automatic feature selection
- temporal video features
- spatial video features
- learned region segmentation approach
- black-box algorithm
- Image motion analysis
- Optical computing
- Image segmentation
- Testing
- Prediction algorithms
- Image sequences
- Stereo vision
- Gold
- Measurement standards
- Educational institutions