Difference between revisions of "Image retargeting by k-seam removal"

From AIRWiki
Jump to: navigation, search
(Students currently working on the project)
m (Laboratory work and risk analysis)
 
(57 intermediate revisions by 3 users not shown)
Line 7: Line 7:
 
=== Project short description ===
 
=== Project short description ===
  
This project presents a methodology for image retargeting based on seam removal. So we will define the concept of seam and we will show and compare four different approaches in order to resize an image:
+
This project presents a methodology for content aware image resizing based on seam removal. In this work four different approaches were implemented in order to retarget an image:
removing a 8-connected path of pixels minimizing an energy
+
* removing a 8-connected path of pixels (1-seam) minimizing an energy function
function
+
* removing a not connected path of pixels (k-seam) minimizing an energy function
removing a not connected path of pixels minimizing an energy
+
* removing a 8-connected path of pixels (1-seam) minimizing the energy variation in the image
function
+
* removing a not connected path of pixels (k-seam) minimizing the energy variation in the image
removing a 8-connected path of pixels minimizing the energy
+
where k is the maximum disconnect allowed.
variation in the image
+
 
removing a not connected path of pixels minimizing the energy
+
The work ends with a comparison on several test pictures among these algorithms considering the one which gives the best results.
variation in the image
+
  
 
=== Dates ===
 
=== Dates ===
 
Start date: 2008/01/01
 
Start date: 2008/01/01
  
End date: 2010/06/26
+
End date: 2008/06/24
  
 
=== People involved ===
 
=== People involved ===
Line 26: Line 25:
 
===== Project head(s) =====
 
===== Project head(s) =====
  
Vincenzo Caglioti - [[User:VincenzoCaglioti]]
+
* [[User:PierluigiTaddei|Pierluigi Taddei]]
 +
* Vincenzo Caglioti
  
===== Other Politecnico di Milano people =====
 
  
Pierluigi Taddei - [[User:PierluigiTaddei]]
 
  
 
===== Students currently working on the project =====
 
===== Students currently working on the project =====
  
Luigi Cardamone - [[User:LuigiCardamone]]
+
* Luigi Cardamone - luigi (dot) cardamone (at) mail (dot) polimi (dot) it
  
Pamela Gotti - [[User:PamelaGotti]]
+
* [[User:PamelaGotti|Pamela Gotti]]
  
=== Laboratory work and risk analysis ===
 
''describe here what you actually do or will do in the AIRLab for your project; it is especially important to specify any activity that can lead to potential risks for you or other people and how you will ensure that no one is harmed. A list of potentially dangerous (if not correctly performed) activities is included into the [http://airlab.elet.polimi.it/index.php/airlab/content/download/461/4110/file/documento_valutazione_rischi_AIRLab.pdf Safety norms] of the AIRLab, which you MUST know to work at the AIRLab.''
 
  
Laboratory work for this project will be mainly performed at AIRLab/Lambrate. It will include significant amounts of mechanical work as well as of electrical and electronic activity. Potentially risky activities are the following:
 
* Use of mechanical tools. Standard safety measures described in [http://airlab.elet.polimi.it/index.php/airlab/content/download/461/4110/file/documento_valutazione_rischi_AIRLab.pdf Safety norms] will be followed.
 
* Use of soldering iron. Standard safety measures described in [http://airlab.elet.polimi.it/index.php/airlab/content/download/461/4110/file/documento_valutazione_rischi_AIRLab.pdf Safety norms] will be followed.
 
* Use of high-voltage circuits. Special gloves and a current limiter will be used.
 
* Transportation of heavy loads (e.g. robot parts).  Standard safety measures described in [http://airlab.elet.polimi.it/index.php/airlab/content/download/461/4110/file/documento_valutazione_rischi_AIRLab.pdf Safety norms] will be followed.
 
* Robot testing.  Standard safety measures described in [http://airlab.elet.polimi.it/index.php/airlab/content/download/461/4110/file/documento_valutazione_rischi_AIRLab.pdf Safety norms] will be followed.
 
* Death ray testing: on the robot will be mounted professor Azzoide's death ray projector. When testing it on live animals (e.g. pigeons, pigs, camels) we will make sure that people stay away from the test area.
 
  
 
== '''Part 2: project description''' ==
 
== '''Part 2: project description''' ==
''Put here all the scientific and technical information about the project. Feel free to insert titles and sections as needed. Remember that [http://www.mediawiki.org/wiki/Help:Contents here] you can find help about wiki syntax.''
 
  
Just to give you some ideas:
+
==='''State of the art'''===
* state of the art;
+
 
* preliminary studies and sketches;
+
This project is based on the article ''Seam carving for content-aware image resizing, Avidan, S. and Shamir, A.,International Conference on Computer Graphics and Interactive Techniques, 2007'', in which the author describes content aware image resizing by removal of 8-connected path of pixels.
* design notes and guidelines;
+
 
* link to project documents and files (you can upload them using the [[Special:Upload]] page);
+
==='''The problem'''===
* description and results of experiments;
+
 
* photos and videos (they must have been uploaded with [[Special:Upload]] before you can insert them into this page);
+
The normal way of resizing a picture doesn’t take in account it’s content and differs from the resizing of a web page where each object is modified on the basis of its content. So, there is the need for an image resizing that is content aware.
* link to source code of the software written for the project (you can upload it with [[Special:Upload]]);
+
 
* advice about the configuration and the use of hardware and software;
+
==='''The Idea'''===
* useful internet links;
+
 
* anything else that you think is useful to describe the project or could help people who will work on it in the future. Think about what ''you'' would have liked to find clearly explained when you started your work, instead of discovering it all by yourself the hard way. (By the way, if some of those missing information belong to other pages of this wiki, please update those pages: future users will be grateful.)
+
The idea behind content aware resizing is to treat in a different way the important regions of the image respect to those regions with less information. To achieve this goal it’s possible to remove from the picture the seam with low energy.
 +
A seam is a path of pixel from top to bottom or from left to right, as it’s possible to see in the following picture:
 +
 
 +
[[Image:Paesaggioconseam.JPG|center|thumb|An example of vertical connected seam|400px]]
 +
 
 +
==='''The Algorithm'''===
 +
 
 +
The implemented algorithms use different kind of seam and minimize different measure:
 +
* removing a 8-connected path of pixels (1-seam) minimizing an energy function
 +
* removing a not connected path of pixels (k-seam) minimizing an energy function
 +
* removing a 8-connected path of pixels (1-seam) minimizing the total energy variation in the image
 +
* removing a not connected path of pixels (k-seam) minimizing the total energy variation in the image
 +
 
 +
Where k seam are those seam with a maximum disconnection of k pixel. This disconnection is important when in the picture there are many object and it’s important to don’t cut their edges.
 +
 
 +
All these algorithms were implemented in Matlab and tested on several pictures (source code is available here: [[Media:Carving.zip|Carving source code]]
 +
). The project follows with  a comparative analysis of strength and weakness of each method.
 +
 
 +
==='''Report'''===
 +
 
 +
The report about this project is available here: [[Media:Relazione.pdf|Report]]
 +
 
 +
==='''Conclusion'''===
 +
 
 +
From results emerge that the best algorithm is that one working with 1-seam with minimum energy.
 +
 
 +
In the following pictures it is possible to see the difference between the result of the retargeting using the best algorithm and the normal resize method (stretching).
 +
 
 +
[[Image:ImageContentResizeDelfino.jpg|left|thumb|Original image|325px]]
 +
 
 +
[[Image:Delfino22.JPG|left|thumb|Resized image with streching|250px]]
 +
 
 +
[[Image:Delfino2 original connected.JPG|left|thumb|Resized image with 1-seam with minumum energy|250px]]
 +
 
 +
[[Image:Delfino2 original notconnected.JPG|left|thumb|Resized image with k-seam with minumum energy|250px]]
 +
 
 +
[[Image:Delfino2 final connected.JPG|left|thumb|Resized image with 1-seam with minumum energy variation|250px]]
 +
 
 +
[[Image:Delfino2 final notconnected.JPG|left|thumb|Resized image with k-seam with minumum energy variation|250px]]

Latest revision as of 17:25, 16 June 2008

Part 1: project profile

Project name

Image retargeting by k-seam removal.

Project short description

This project presents a methodology for content aware image resizing based on seam removal. In this work four different approaches were implemented in order to retarget an image:

  • removing a 8-connected path of pixels (1-seam) minimizing an energy function
  • removing a not connected path of pixels (k-seam) minimizing an energy function
  • removing a 8-connected path of pixels (1-seam) minimizing the energy variation in the image
  • removing a not connected path of pixels (k-seam) minimizing the energy variation in the image

where k is the maximum disconnect allowed.

The work ends with a comparison on several test pictures among these algorithms considering the one which gives the best results.

Dates

Start date: 2008/01/01

End date: 2008/06/24

People involved

Project head(s)


Students currently working on the project
  • Luigi Cardamone - luigi (dot) cardamone (at) mail (dot) polimi (dot) it


Part 2: project description

State of the art

This project is based on the article Seam carving for content-aware image resizing, Avidan, S. and Shamir, A.,International Conference on Computer Graphics and Interactive Techniques, 2007, in which the author describes content aware image resizing by removal of 8-connected path of pixels.

The problem

The normal way of resizing a picture doesn’t take in account it’s content and differs from the resizing of a web page where each object is modified on the basis of its content. So, there is the need for an image resizing that is content aware.

The Idea

The idea behind content aware resizing is to treat in a different way the important regions of the image respect to those regions with less information. To achieve this goal it’s possible to remove from the picture the seam with low energy. A seam is a path of pixel from top to bottom or from left to right, as it’s possible to see in the following picture:

An example of vertical connected seam

The Algorithm

The implemented algorithms use different kind of seam and minimize different measure:

  • removing a 8-connected path of pixels (1-seam) minimizing an energy function
  • removing a not connected path of pixels (k-seam) minimizing an energy function
  • removing a 8-connected path of pixels (1-seam) minimizing the total energy variation in the image
  • removing a not connected path of pixels (k-seam) minimizing the total energy variation in the image

Where k seam are those seam with a maximum disconnection of k pixel. This disconnection is important when in the picture there are many object and it’s important to don’t cut their edges.

All these algorithms were implemented in Matlab and tested on several pictures (source code is available here: Carving source code ). The project follows with a comparative analysis of strength and weakness of each method.

Report

The report about this project is available here: Report

Conclusion

From results emerge that the best algorithm is that one working with 1-seam with minimum energy.

In the following pictures it is possible to see the difference between the result of the retargeting using the best algorithm and the normal resize method (stretching).

Original image
Resized image with streching
Resized image with 1-seam with minumum energy
Resized image with k-seam with minumum energy
Resized image with 1-seam with minumum energy variation
Resized image with k-seam with minumum energy variation