METHOD AND APPARATUS FOR GENERATING SUPERPIXELS FOR MULTI-VIEW IMAGES
A method and an apparatus for generating temporally and multi-view consistent superpixels for a sequence of multi-view images. A sequence generator generates an ordered sequence of views forming a joined path from views of a first multi-view capture and views of a second multi-view capture, wherein in the joined path the views of the second multi-view capture have an order which is a reverse of an order of the views of the first multi-view capture. A superpixel generator then applies an algorithm for generating temporally consistent superpixels for the ordered sequence of views.
1 . A method for generating temporally and multi-view consistent superpixels for a sequence of multi-view captures, each multi-view capture including at least two views, the method comprising:
generating an ordered sequence of views forming a joined path from views of a first multi-view capture and views of a second multi-view capture, wherein in the joined path the views of the second multi-view capture have an order which is a reverse of an order of the views of the first multi-view capture; and
applying an algorithm for generating temporally consistent superpixels to the ordered sequence of views.
2 . The method according to claim 1 , wherein the first multi-view capture and the second multi-view capture are temporally successive multi-view captures.
3 . The method according to claim 1 , further comprising refining labels of superpixels generated for a view of the second multi-view capture using superpixels generated for a corresponding view of the first multi-view capture.
4 . The method according to claim 1 , further comprising refining labels of superpixels generated for a view of the second multi-view capture using superpixels generated for a neighboring view of the second multi-view capture.
5 . The method according to claim 3 , wherein at least one of a geometrical measure and a similarity measure is used for refining labels of superpixels.
6 . The method according to claim 5 , wherein the similarity measure comprises at least one of color information, depth information, and motion vectors.
7 . A computer readable non-transitory storage medium having stored therein instructions enabling generating temporally and multi-view consistent superpixels for a sequence of multi-view captures, each multi-view capture including at least two views, which, when executed by a computer, cause the computer to:
generate an ordered sequence of views forming a joined path from views of a first multi-view capture and views of a second multi-view capture, wherein in the joined path the views of the second multi-view capture have an order which is a reverse of an order of the views of the first multi-view capture; and
apply an algorithm for generating temporally consistent superpixels to the ordered sequence of views.
8 . An apparatus configured to generate temporally and multi-view consistent superpixels for a sequence of multi-view captures, each multi-view capture at least two views, the apparatus comprising:
a sequence generator configured to generate an ordered sequence of views forming a joined path from views of a first multi-view capture and views of a second multi-view capture, wherein in the joined path the views of the second multi-view capture have an order which is a reverse of an order of the views of the first multi-view capture; and
a superpixel generator configured to apply an algorithm for generating temporally consistent superpixels to the ordered sequence of views.
9 . An apparatus configured to generate temporally and multi-view consistent superpixels for a sequence of multi-view captures, each multi-view capture including at least two views, the apparatus comprising a processing device and a memory device having stored therein instructions, which, when executed by the processing device, cause the apparatus to:
generate an ordered sequence of views forming a joined path from views of a first multi-view capture and views of a second multi-view capture, wherein in the joined path the views of the second multi-view capture have an order which is a reverse of an order of the views of the first multi-view capture; and
apply an algorithm for generating temporally consistent superpixels to the ordered sequence of views.
10 . The computer readable non-transitory storage medium according to claim 7 , wherein the first multi-view capture and the second multi-view capture are temporally successive multi-view captures.
11 . The computer readable non-transitory storage medium according to claim 7 , wherein the instructions further cause the computer to refine labels of superpixels generated for a view of the second multi-view capture using superpixels generated for a corresponding view of the first multi-view capture.
12 . The computer readable non-transitory storage medium according to claim 7 , wherein the instructions further cause the computer to refine labels of superpixels generated for a view of the second multi-view capture using superpixels generated for a neighboring view of the second multi-view capture.
13 . The computer readable non-transitory storage medium according to claim 12 , wherein the instructions cause the computer to use at least one of a geometrical measure and a similarity measure for refining labels of superpixels.
14 . The computer readable non-transitory storage medium according to claim 13 , wherein the similarity measure comprises at least one of color information, depth information, and motion vectors.
15 . The apparatus according to claim 8 , wherein the first multi-view capture and the second multi-view capture are temporally successive multi-view captures.
16 . The apparatus according to claim 8 , wherein the superpixel generator is configured to refine labels of superpixels generated for a view of the second multi-view capture using superpixels generated for a corresponding view of the first multi-view capture.
17 . The apparatus according to claim 8 , wherein the superpixel generator is configured to refine labels of superpixels generated for a view of the second multi-view capture using superpixels generated for a neighboring view of the second multi-view capture.
18 . The apparatus according to claim 17 , wherein the superpixel generator is configured to use at least one of a geometrical measure and a similarity measure for refining labels of superpixels.
19 . The apparatus according to claim 18 , wherein the similarity measure comprises at least one of color information, depth information, and motion vectors.
20 . The apparatus according to claim 9 , wherein the first multi-view capture and the second multi-view capture are temporally successive multi-view captures.
21 . The apparatus according to claim 9 , wherein the instructions further cause the processing device to refine labels of superpixels generated for a view of the second multi-view capture using superpixels generated for a corresponding view of the first multi-view capture.
22 . The apparatus according to claim 9 , wherein the instructions further cause the processing device to refine labels of superpixels generated for a view of the second multi-view capture using superpixels generated for a neighboring view of the second multi-view capture.
23 . The apparatus according to claim 22 , wherein the instructions cause the processing device to use at least one of a geometrical measure and a similarity measure for refining labels of superpixels.
24 . The apparatus according to claim 23 , wherein the similarity measure comprises at least one of color information, depth information, and motion vectors.