IP Library Granted Patent US 10,104,360
Granted Patent B2
US 10,104,360 · App. 14/198,942 · Granted Oct 16, 2018

Image encoding method, image decoding method, image encoding apparatus, and image decoding apparatus

Inventors: Steffen Kamp (Frankfurt, DE); Matthias Narroschke (Schaafheim, DE); Thomas Wedi (The Hague, NL); Semih Esenlik (Nazilli, TR)
Assignee: SUN PATENT TRUST
H04N13/161H04N13/00H04N13/111H04N13/128H04N13/178H04N19/597H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,104,360
App. No.
14/198,942
Granted
Oct 16, 2018
Kind
B2
Abstract

An image encoding method for encoding a multi-view image captured from a plurality of capturing views includes: generating a plurality of view identification information items each for identifying a plurality of display views that are a plurality of views used for display in an image decoding apparatus, by corresponding to each of a plurality of screen sizes used in the image decoding apparatus; and encoding the view identification information items.

Claims (52)

1. An image encoding method for encoding a multi-view image including a plurality of views, the image encoding method comprising:

generating a plurality of pairs of view identification information items corresponding to a plurality of screen sizes used in an image decoding apparatus on a one-to-one basis, wherein each of the pairs of view identification information items is respectively associated with a different one of the screen sizes; and

encoding the pairs of view identification information items,

wherein each of the pairs of view identification information items includes (i) view identification information for display to a left eye and (ii) view identification information for display to a right eye,

wherein for each of the pairs of view identification information items, (i) the view identification information for display to the left eye indicates a first view and a second view from among the plurality of views and (ii) the view identification information for display to the right eye indicates a third view and a fourth view from among the plurality of views,

wherein for each of the pairs of view identification information items, (i) the view identification information of the view for display to the left eye indicates a first distance from the first view or the second view to a view of a first synthetic image and (ii) the view identification information of the view for display to the right eye indicates a second distance from the third view or the fourth view to a view of a second synthetic image, and

wherein the image decoding apparatus:

generates the first synthetic image by synthesizing, using the view identification information of the view for display to the left eye, an image of the first view and an image of the second view;

generates the second synthetic image by synthesizing, using the view identification information of the view for display to the right eye, an image of the third view and an image of the fourth view;

displays the first synthetic image for the left eye; and

displays the second synthetic image for the right eye.

2. An image decoding method for decoding a bitstream generated by encoding a multi-view image including a plurality of views, the image decoding method comprising:

decoding a plurality of pairs of view identification information items corresponding to a plurality of screen sizes used in an image decoding apparatus on a one-to-one basis, wherein each of the pairs of view identification information items is respectively associated with a different one of the screen sizes; and

determining display views to be used for display in the image decoding apparatus using one of the decoded pairs of view identification information items corresponding to a screen size of a display device included in the image decoding apparatus,

wherein each of the pairs of view identification information items includes (i) view identification information for display to a left eye and (ii) view identification information for display to a right eye,

wherein for each of the pairs of view identification information items, (i) the view identification information for display to the left eye indicates a first view and a second view from among the plurality of views and (ii) the view identification information for display to the right eye indicates a third view and a fourth view from among the plurality of views,

wherein for each of the pairs of view identification information items, (i) the view identification information of the view for display to the left eye indicates a first distance from the first view or the second view to a view of a first synthetic image and (ii) the view identification information of the view for display to the right eye indicates a second distance from the third view or the fourth view to a view of a second synthetic image, and

wherein image decoding method further comprises:

generating the first synthetic image by synthesizing, using the view identification information of the view for display to the left eye, an image of the first view and an image of the second view;

generating the second synthetic image by synthesizing, using the view identification information of the view for display to the right eye, an image of the third view and an image of the fourth view;

displaying the first synthetic image for the left eye; and

displaying the second synthetic image for the right eye.

3. An image encoding apparatus which encodes a multi-view image including a plurality of views, the image encoding apparatus comprising:

a view identification information generation unit configured to generate a plurality of pairs of view identification information items corresponding to a plurality of screen sizes used in an image decoding apparatus on a one-to-one basis, wherein each of the pairs of view identification information items is respectively associated with one of the screen sizes,

a view identification information encoder which encodes the pairs of view identification information items,

wherein each of the pairs of view identification information items includes (i) view identification information for display to a left eye and (ii) view identification information for display to a right eye,

wherein for each of the pairs of view identification information items, (i) the view identification information for display to the left eye indicates a first view and a second view from among the plurality of views and (ii) the view identification information for display to the right eye indicates a third view and a fourth view from among the plurality of views,

wherein for each of the pairs of view identification information items, (i) the view identification information of the view for display to the left eye indicates a first distance from the first view or the second view to a view of a first synthetic image and (ii) the view identification information of the view for display to the right eye indicates a second distance from the third view or the fourth view to a view of a second synthetic image, and

wherein the image decoding apparatus:

generates the first synthetic image by synthesizing, using the view identification information of the view for display to the left eye, an image of the first view and an image of the second view;

generates the second synthetic image by synthesizing, using the view identification information of the view for display to the right eye, an image of the third view and an image of the fourth view;

displays the first synthetic image for the left eye; and

displays the second synthetic image for the right eye.

4. An image decoding apparatus which decodes a bitstream generated by encoding a multi-view image including a plurality of views, the image decoding apparatus comprising:

a view identification information decoder which decodes a plurality of pairs of view identification information items corresponding to a plurality of screen sizes used in the image decoding apparatus on a one-to-one basis, wherein each of the pairs of view identification information items is respectively associated with a different one of the screen sizes; and

a view determination unit configured to determine a display view to be used for display in the image decoding apparatus using one of the decoded pairs of view identification information items corresponding to a screen size of a display device included in the image decoding apparatus,

wherein each of the pairs of view identification information items includes (i) view identification information for display to a left eye and (ii) view identification information for display to a right eye,

wherein for each of the pairs of view identification information items, (i) the view identification information for display to the left eye indicates a first view and a second view from among the plurality of views and (ii) the view identification information for display to the right eye indicates a third view and a fourth view from among the plurality of views,

wherein for each of the pairs of view identification information items, (i) the view identification information of the view for display to the left eye indicates a first distance from the first view and or second view to a view of a first synthetic image and (ii) the view identification information of the view for display to the right eye indicates a second distance from the third view or the fourth view to a view of a second synthetic image, and

wherein the image decoding apparatus further comprises a display device configured to:

generate the first synthetic image by synthesizing, using the view identification information of the view for display to the left eye, an image of the first view and an image of the second view;

generate the second synthetic image by synthesizing, using the view identification information of the view for display to the right eye, an image of the third view and an image of the fourth view;

display the first synthetic image for the left eye; and

display the second synthetic image for the right eye.

5. An image encoding apparatus comprising:

a processor; and

a non-transitory memory having stored thereon executable instructions, which when executed, cause the processor to perform the image encoding method according to claim 1 .

6. An image decoding apparatus comprising:

a processor; and

a non-transitory memory having stored thereon executable instructions, which when executed, cause the processor to perform the image decoding method according to claim 2 .

7. The image encoding method according to claim 1 ,

wherein in the encoding, information indicating an optimal inter-camera distance is further encoded.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2016
From: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
To: SUN PATENT TRUST
Reel/Frame 038299/0213 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2015
From: KAMP, STEFFEN; NARROSCHKE, MATTHIAS; WEDI, THOMAS; ESENLIK, SEMIH
To: PANASONIC CORPORATION
Reel/Frame 035364/0234 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2014
From: PANASONIC CORPORATION
To: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
Reel/Frame 033033/0163 →
Continuity (3)
Continuation PCTJP2013004192 · Jul 5, 2013
Provisional Application 61673422 · Jul 19, 2012
Related Publication 20140184742A1 · Jul 3, 2014