IP Library Granted Patent US 9,549,167
Granted Patent B2
US 9,549,167 · App. 13/085,680 · Granted Jan 17, 2017

Data structure, image processing apparatus and method, and program

Inventors: Suguru Ushiki (Tokyo, JP); Takafumi Morifuji (Tokyo, JP)
Assignee: Sony Corporation
H04N13/007H04N13/004H04N13/0022H04N13/0066H04N21/4347H04N21/44008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,549,167
App. No.
13/085,680
Granted
Jan 17, 2017
Kind
B2
Abstract

An image processing apparatus includes: an acquisition mechanism acquiring image data of a 3D image including a left-eye image and a right-eye image, and superimposed-area information being information on a superimposed area included in the left-eye image and the right-eye image; and a disparity detection mechanism detecting an amount of disparity in an area excluding the superimposed area identified by the superimposed-area information of the left-eye image and the right-eye image.

Claims (84)

1. An image processing apparatus, comprising:

a memory to store image data representing a 3D image, the image data including:

first image data representing a left-eye image;

second image data representing a right-eye image; and

positional information regarding superimposed-areas included in the left-eye image and the right-eye image, the superimposed-areas being areas of the left-eye image and the right-eye image having information superimposed on the left-eye image and the right-eye image; and

a processor, which

accesses the image data;

determines an amount of disparity in the left-eye image and the right-eye image, excluding the superimposed-areas; and

shifts the whole left-eye image and the whole right-eye image according to the amount of disparity, excluding the superimposed-areas.

2. The image processing apparatus according to claim 1 , wherein the processor:

calculates a control parameter on the basis of the amount of disparity; and

adjusts the amount of disparity on the basis of the control parameter.

3. The image processing apparatus according to claim 2 , wherein the processor:

determines the control parameter by calculating an amount of image shift on the basis of the amount of disparity; and

adjusts the amount of disparity by performing image-shift processing of the whole left-eye image and the whole right-eye image on the basis of the amount of image shift.

4. The image processing apparatus according to claim 1 , wherein the processor:

determines whether the positional information is included in the image data;

detects the superimposed-areas when the positional information is not included in the image data; and

determines the positional information based on the detection.

5. A computer-implemented method of processing an image, the method comprising the steps of:

storing image data representing a 3D image in a memory, the image data including:

first data representing a left-eye image including:

a first image area; and

a first superimposed-area other than the first image area, the first superimposed-area having information superimposed on the left-eye image;

second data representing a right-eye image including:

a second image area; and

a second superimposed-area other than the second image area, the second superimposed-area having the information superimposed on the right- eye image; and

positional information regarding the first superimposed-area and the second superimposed-area;

accessing, using a processor, the image data stored in the memory;

determining, using the processor, an amount of disparity in the first image area and the second image area; and

shifting the whole first image area and the whole second image area according to the amount of disparity.

6. A non-transitory computer-readable medium storing instructions, which when executed by a processor, cause a computer to perform processing comprising the steps of:

acquiring image data representing a 3D image, the image data including:

first data representing a left-eye image including:

a first image area; and

a first superimposed-area other than the first image area, the first superimposed-area having information superimposed on the left-eye image; and

second data representing a right-eye image including:

a second image area; and

a second superimposed-area other than the second image area, the second superimposed-area having the information superimposed on the right-eye image; and

positional information regarding the first superimposed-area and the second superimposed-area;

determining an amount of disparity in the first image area and the second image area; and

shifting the whole first image area and the whole second image area according to the amount of disparity.

7. An image processing apparatus comprising:

a memory to store image data representing a 3D image, the image data including:

first data representing a left-eye image including:

a first image area; and

a first superimposed-area other than the first image area, the first superimposed-area having information superimposed on the left-eye image;

second data representing a right-eye image including:

a second image area; and

a second superimposed-area other than the second image area, the second superimposed-area having the information superimposed on the right- eye image; and

positional information regarding the first superimposed-area and the second superimposed-area; and

a processor, which

accesses the image data;

determines an amount of disparity in the first image area and the second image area; and

shifts the whole first image area and the whole second image area according to the amount of disparity.

8. The image processing apparatus of claim 7 , wherein the first superimposed-area and the second superimposed-area display meta data associated with the 3D image.

9. The image processing apparatus of claim 8 , wherein the meta data includes at least one of subtitles, on screen display, a menu screen, and a black-belt image of a letter box.

10. The image processing apparatus of claim 7 , wherein the amount of disparity is an average of the amounts of disparity of pixels in the first image area and the second image area.

11. The image processing apparatus of claim 10 , wherein the processor calculates an amount of image shift as half of the amount of disparity.

12. The image processing apparatus of claim 11 , wherein the processor:

shifts the whole first image area to the right by the amount of image shift; and

shifts the whole second image area to the left by the amount of image shift.

13. The image processing apparatus of claim 12 , wherein the processor:

determines a minimum amount of disparity in the first image area and the second image area; and

calculates an amount of image shift such that the minimum amount of disparity is less than a distance between eyes of a viewer.

14. The computer-implemented image processing method of claim 5 , further including:

calculating an amount of image shift on the basis of the amount of disparity.

15. The computer-implemented image processing method of claim 14 , wherein determining the amount of disparity includes determining an average of amounts of disparity of pixels in the first image area and the second image area.

16. The computer-implemented image processing method of claim 14 , wherein the processor calculates an amount of image shift as half of the amount of disparity.

17. The computer-implemented image processing method of claim 16 , further including:

shifting the whole first image area to the right by the amount of image shift; and

shifting the whole second image area to the left by the amount of image shift.

18. A computer-implemented method of processing an image, the method comprising the steps of:

storing image data representing a 3D image in a memory, the image data including:

first data representing a left-eye image;

second data representing a right-eye image; and

positional information regarding superimposed-areas included in the left-eye image and the right-eye image, the superimposed-areas being areas of the left-eye image and the right-eye image having superimposed information;

accessing, using a processor, the image data stored in the memory;

detecting, using the processor, an amount of disparity in the left-eye image and the right-eye image, excluding the superimposed-areas; and

shifting the whole left-eye image and the whole right-eye image according to the amount of disparity, excluding the superimposed-areas.

19. The image processing apparatus according to claim 1 , wherein the positional information is stored as a definition file.

20. The image processing apparatus according to claim 1 , wherein the superimposed-areas are an on screen display, a menu-screen, or a black-belt image of a letter box.

21. The image processing apparatus according to claim 1 , wherein the processor further determines an amount of disparity of each pixel in the left-eye image and the right-eye image, excluding the superimposed-areas.

22. The image processing apparatus according to claim 21 , wherein the processor further supplies the amount of disparity of each pixel of the left-eye and the right eye image as a disparity map, in which a size of the amount of disparity is expressed by a luminance value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2011
From: USHIKI, SUGURU; MORIFUJI, TAKAFUMI
To: SONY CORPORATION
Reel/Frame 026115/0016 →
Priority Claims (1)
JP 2010-097213 · Apr 20, 2010 · national
Continuity (1)
Related Publication 20110254919A1 · Oct 20, 2011