Stereoscopic display device and parallax image correcting method

1. A stereoscopic display device comprising:

a naked-eye stereoscopic display that projects respectively-different images into an observer's left eye and right eye aligned in a first direction based on a first input image and a second input image corresponding to two viewpoints;

a spatial imaging device of a flat-plate shape that includes a plurality of optical reflection devices reflecting light transmitted from an object on a first reflection surface and a second reflection surface that are orthogonal to each other, and that images, in the air, a floating image based on the first input image and the second input image, the first input image and the second input image respectively including a plurality of portions defined by a main lobe and a side lobe; and

an image processing unit that interchanges a corresponding portion of the plurality of portions in the first input image corresponding to a reverse viewing area and a corresponding portion of the plurality of portions in the second input image corresponding to the reverse viewing area in which depth parallax and popup parallax of the first input image and the second input image are reversed in a part of the floating image imaged in the air, and outputs the first input image including the corresponding portion in the second input image and the second input image including the corresponding portion in the first input image to the naked-eye stereoscopic display,

wherein the spatial imaging device images, in the air on an observer side, the floating image based on the first input image including the corresponding portion in the second input image and the second input image including the corresponding portion in the first input image that are projected by the naked-eye stereoscopic display, and

wherein the naked-eye stereoscopic display includes the main lobe that is a front stereoscopic viewing area near a normal line passing through the center of a display surface and the side lobe that is a stereoscopic viewing area disposed on an outer side of the main lobe in the first direction.

2. The stereoscopic display device according to claim 1 , further comprising a viewpoint position detecting unit that detects a viewpoint position of the observer,

wherein, in a case where, in the image projecting one input image, the image projecting the other input image is mixed, the image processing unit interchanges portions corresponding to the reverse viewing areas in accordance with the viewpoint position of the observer detected by the viewpoint position detecting unit and outputs the resultant images to the naked-eye stereoscopic display.

3. The stereoscopic display device according to claim 2 , wherein the viewpoint position detecting unit includes

an observer imaging unit capturing the observer, and

a both-eye position detecting unit detecting positions of both eyes from a captured image,

the stereoscopic display device further comprises a relative position calculating unit specifying a positional relation between the special imaging device and the observer based on the positions of both eyes detected by the both-eye position detecting unit, and

the image processing unit interchanges the portions corresponding to the reverse viewing areas and outputs the resultant images to the naked-eye stereoscopic display in accordance with the positional relation specified in a case where, in the image projecting one input image, the image projecting the other input image is mixed.

4. The stereoscopic display device according to claim 1 , wherein the image processing unit further executes:

extracting the reverse viewing area based on a predetermined condition.

5. The stereoscopic display device according to claim 4 , wherein a boundary line of the reverse viewing area has an angle with respect to an arrangement direction of pixels included in the naked-eye stereoscopic display.

6. The stereoscopic display device according to claim 4 , wherein the image processing unit further executes:

extracting depth information of each portion of a display target object based on the first and second input images corresponding to the two viewpoints; and

adjusting parallax amounts of the first and second input images corresponding to the two viewpoints based on the predetermined condition.

7. The stereoscopic display device according to claim 6 , wherein the image processing unit sets a parallax amount of a portion near a boundary between an image of a portion corresponding to the reverse viewing area and an image adjacent to the image of the portion corresponding to the reverse viewing area to be less than a parallax amount of a portion other than the portion near the boundary.

8. The stereoscopic display device according to claim 6 , wherein the image processing unit sets a parallax amount of image of a portion corresponding to the reverse viewing area to be more than a parallax amount of an image of a portion other than the portions corresponding to the reverse viewing area.

9. The stereoscopic display device according to claim 4 , wherein the predetermined condition includes at least one of an angle formed by a visual line direction of the observer and a normal direction of the spatial imaging device, a distance between the naked-eye stereoscopic display and the spatial imaging device, a distance between the spatial imaging device and the observer, and optical characteristics of the spatial imaging device.

10. A parallax image correcting method using a stereoscopic display device including:

a naked-eye stereoscopic display that projects respectively-different images into an observer's left eye and right eye aligned in a first direction based on a first input image and a second input image corresponding to two viewpoints; and

a spatial imaging device of a flat-plate shape that includes a plurality of optical reflection devices reflecting light transmitted from an object on a first reflection surface and a second reflection surface that are orthogonal to each other, and that images, in the air, a floating image based on the first input image and the second input image projected by the naked-eye stereoscopic display, the first input image and the second input image respectively including a plurality of portions defined by a main lobe and a side lobe,

the naked-eye stereoscopic display including a main lobe that is a front stereoscopic viewing area near a normal line passing through the center of a display surface and a side lobe that is a stereoscopic viewing area disposed on an outer side of the main lobe in the first direction,

the parallax image correcting method using the stereoscopic display device comprising:

determining whether a reverse viewing area in which depth parallax and popup parallax of the first input image and the second input image are reversed is present in a part of the floating image imaged in the air;

interchanging a corresponding portion of the plurality of portions in the first input image corresponding to the reverse viewing area and a corresponding portion of the plurality of portions in the second input image corresponding to the reverse viewing area, in a case where the reverse viewing area is present; and

outputting the first input image including the corresponding portion in the second input image, and the second input image including the corresponding portion in the first input image to the naked-eye stereoscopic display,

wherein the spatial imaging device images, in the air on an observer side, the floating image based on the first input image including the corresponding portion in the second input image and the second input image including the corresponding portion in the first input image that are projected by the naked-eye stereoscopic display.

11. The parallax image correcting method using the stereoscopic display device according to claim 10 , further comprising:

detecting a viewpoint position of the observer; and

determining whether or not the reverse viewing areas are present in accordance with the detected viewpoint position of the observer in a case where, in the image projecting one input image, the image projecting the other input image is mixed;

specifying the reverse viewing areas in accordance with the detected viewpoint position of the observer;

interchanging portions corresponding to the specified reverse viewing areas; and

outputting the resultant images to the naked-eye stereoscopic display in a case where the reverse viewing areas are present.

12. The parallax image correcting method using the stereoscopic display device according to claim 11 , further comprising:

capturing an image of the observer;

detecting positions of both eyes from a captured image;

specifying a positional relation between the special imaging device and the observer based on the detected positions of both eyes; and

interchanging the portions corresponding to the reverse viewing areas in accordance with the specified positional relation and outputting the resultant images to the naked-eye stereoscopic display in accordance with the positional relation specified in a case where, in the image projecting one input image, the image projecting the other input image is mixed.

13. The parallax image correcting method using the stereoscopic display device according to claim 10 , further comprising:

extracting the reverse viewing area based on a predetermined condition.

14. The parallax image correcting method using the stereoscopic display device according to claim 13 , wherein a boundary line of the reverse viewing area has an angle with respect to an arrangement direction of pixels included in the naked-eye stereoscopic display.

15. The parallax image correcting method using the stereoscopic display device according to claim 13 , further comprising:

extracting depth information of each portion of a display target object based on the first and second input images corresponding to the two viewpoints before the extraction of the reverse viewing area; and

adjusting parallax amounts of the first and second input images corresponding to the two viewpoints based on the predetermined condition.

16. The parallax image correcting method using the stereoscopic display device according to claim 15 , further comprising setting a parallax amount of a portion near a boundary between an image of a portion corresponding to one of the reverse viewing area and an image adjacent to the image to be less than a parallax amount of a portion other than the portion near the boundary.

17. The parallax image correcting method using the stereoscopic display device according to claim 15 , further comprising setting a parallax amount of image of a portion corresponding to the reverse viewing area to be more than a parallax amount of an image of a portion other than the portions corresponding to the reverse viewing area.

18. The parallax image correcting method using the stereoscopic display device according to claim 13 , wherein the predetermined condition includes at least one of an angle formed by a visual line direction of the observer and a normal direction of the spatial imaging device, a distance between the naked-eye stereoscopic display and the spatial imaging device, a distance between the spatial imaging device and the observer, and optical characteristics of the spatial imaging device.