Interactive Segmentation Tool-Box

 

An implementation of ‘Lazy Snapping’ and ‘GrabCut’: Based on Interactive Graph Cuts

 

Lazy Snapping [2] and GrabCut [3] are 2D image segmentation tools based on the interactive graph-cuts technique proposed by Boykov and Jolly [1]. Lazy Snapping requires the user to specify foreground and background seeds, and performs 2D segmentation with the seeds as hard constraints. GrabCut makes the process more automatic by using iterated graph cuts – the only user interaction required is a bounding box of the foreground object.

 

We provide an implementation of both these tools, along with a third tool which combines both these methods. Our code uses the maxflow code [4] by Vladimimr Kolmogorov.

 

 

  

 

 

 

 


Source Code

 

SegTool.zip

Requires MATLAB and mex (C++) compiler. You will need kmeans on MATLAB to run the code. Refer the README file for compilation instructions.

 

 

 

 


PASCAL Data-Set

 

 

 

Our Segmentation Tool can be used to perform segmentation on huge image databases. As an example, we provide results of using the Grab Cut Tool on a subset of the PASCAL data set [5] (a few different Object Classes). We use the Bounding Boxes available along with this set to seed our iterative graph cuts algorithm. The parameters given in the parameter file can be fine-tuned to achieve desirable segmentations.

 

Note: The coarseness around the boundary of the segmented results is due to the fact that the code runs segmentation on water-shed super-pixels instead of pixels, for efficiency purposes. Using super-pixels, we achieve a significant speed-up at the cost of slight loss of accuracy.

 

 

 


References

 

[1] Interactive Graph Cuts for Optimal Boundary & Region Segmentation of Objects in N-D Images. Boykov & Jolly, ICCV 2001    [PDF]

[2] Lazy Snapping. Yin Li, Jian Sun, Chi-Keung Tang, Heung-Yeung Shum, SIGGRAPH 2004                                                                 [PDF]

[3] GrabCut — Interactive Foreground Extraction using Iterated Graph Cuts. Rother, Kolmogorov & Blake, SIGGRAPH 2004      [PDF]

[4] http://www.adastral.ucl.ac.uk/~vladkolm/software.html

[5] http://www.pascal-network.org/challenges/VOC/voc2005/index.html

 

 


Contacts

For questions/comments about the code, please contact:

Mohit Gupta – mohitg@cs.cmu.edu
Krishnan Ramnath – kramnath@andrew.cmu.edu

 

OR

 

You can post your comments/questions here

 

This project was done as part of the Advanced perception class at the Robotics Institute, CMU. Class Instructor: Alexei Efros