IP Library Granted Patent US 10,038,881
Granted Patent B2
US 10,038,881 · App. 15/150,924 · Granted Jul 31, 2018

Display device, image processing device and image processing method, and computer program

Inventors: Ken Tamayama (Tokyo, JP); Akira Fujinawa (Kanagawa, JP); Masayuki Shimizu (Kanagawa, JP); Kiyoshi Ikeda (Kanagawa, JP)
Assignee: Sony Corporation
H04N9/3185G02B27/017G02B27/0172G09G5/005H04N5/145H04N5/64H04N9/3129H04N9/3188H04N13/0468G02B2027/011G02B2027/014G09G3/002G09G5/391G09G2340/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,038,881
App. No.
15/150,924
Granted
Jul 31, 2018
Kind
B2
Abstract

Provided is a display device including an image display unit configured to display an image with a plurality of pixels arranged on a display surface, an eyepiece optical unit configured to project the display surface of the image display unit in a manner that a predetermined angle of view is obtained, and an image correction unit configured to correct a display image on the display surface at a position of each of representative pixels which are discretely located on the display surface, on the basis of distortion generated due to the eyepiece optical unit.

Claims (96)

1. An information processing apparatus comprising:

circuitry configured to control:

receiving an original image which, when displayed on a display surface, corresponds to a plurality of pixels arranged on the display surface; and

correcting a display of the original image on the display surface at a position of each of representative pixels which are discretely located on the display surface, on the basis of distortion generated by an eyepiece optical unit projecting the display surface to obtain a predetermined angle of view;

in which the correcting of the display of the original image on the display surface includes:

holding a first correction information at the position of the representative pixel for correcting the distortion generated due to the eyepiece optical unit,

generating second correction information at a position of each pixel other than the representative pixel on the basis of the first correction information of one or more representative pixels, and

providing, by use of the first correction information and the second correction information, distortion in a direction opposite to the distortion generated due to the eyepiece optical unit to each pixel on the display surface and correcting the pixel,

in which the first correction information is in accordance with a display scale of the original image on a virtual image surface at the eyepiece optical unit, in which the display scale is determined with reference to a predetermined acceptable range for a given original image.

2. The information processing apparatus according to claim 1 , wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

3. The information processing apparatus according to claim 1 , further comprising:

an optical simulator configured to trace a light ray of the display of the original image on the display surface passing through the eyepiece optical unit; and

wherein the circuitry is configured to control generating the first correction information at the position of the representative pixel on the basis of light ray trace data obtained by the optical simulator, and

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

4. The information processing apparatus according to claim 1 ,

wherein the circuitry is configured to control generating the first correction information at the position of the representative pixel based on actually shooting a virtual image projected by the eyepiece optical unit when the representative pixel is made to be lighted, and

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

5. The information processing apparatus according to claim 1 , wherein

the display surface is vertically longer compared with an aspect ratio of the display of the original image,

the eyepiece optical unit generates a substantially pin-cushion shaped distortion,

the correcting of the display of the original image is in a manner that an angle of view at a horizontal end is not changed, and

the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

6. The information processing apparatus according to claim 1 ,

wherein the correcting of the display of the original image includes separating pixel correction in a vertical direction and pixel correction in a horizontal direction and performing a pixel correction process in series for each direction, and

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

7. The information processing apparatus according to claim 1 ,

wherein the correcting of the display of the original image includes moving the pixel in the same vertical line for each line to perform correction in a vertical direction and then subsequently moving the pixel in the same horizontal line for each line to perform correction in a horizontal direction, and

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

8. The information processing apparatus according to claim 7 ,

wherein the second correction information in the horizontal direction is determined at a position moved by an amount of the second correction information in the vertical direction, and

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

9. The information processing apparatus according to claim 1 ,

wherein a corrected display image is generated based on the correcting of the display of the original image,

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood, and

wherein the circuitry is configured to control

shifting a display position of the corrected display image at low frequency,

correcting the corrected display image having been subjected to a modulation process while shifting a correspondence relationship of a pixel position and at least one of the first correction information or the second correction information, and

shifting the display position of the corrected display image for burn-in prevention in relation to the shifting the correspondence relationship.

10. The information processing apparatus according to claim 1 ,

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood,

wherein the display surface includes a number of pixels,

wherein the correcting of the display of the original image is on a line memory and includes scaling in conformity to the number of pixels of the display surface, and

wherein the circuitry is configured to control driving at a timing for making a size of the line memory minimum.

11. The information processing apparatus according to claim 1 , wherein a circle is indicated by the predetermined acceptable range.

12. An information processing method comprising:

controlling, by a processing device,

receiving an original image which, when displayed on a display surface, corresponds to a plurality of pixels arranged on the display surface; and

correcting a display of the original image on the display surface at a position of each of representative pixels which are discretely located on the display surface, on the basis of distortion generated by an eyepiece unit projecting the display surface to obtain a predetermined angle of view;

in which the correcting of the display of the original image on the display surface includes:

holding a first correction information at the position of the representative pixel for correcting the distortion generated due to the eyepiece optical unit,

generating second correction information at a position of each pixel other than the representative pixel on the basis of the first correction information of one or more representative pixels, and

providing, by use of the first correction information and the second correction information, distortion in a direction opposite to the distortion generated due to the eyepiece optical unit to each pixel on the display surface and correcting the pixel,

in which the first correction information is in accordance with a display scale of the original image on a virtual image surface at the eyepiece optical unit, in which the display scale is determined with reference to a predetermined acceptable range for a given original image.

13. The information processing method according to claim 12 , wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

14. The information processing method according to claim 12 , further comprising:

controlling, by the processing device,

tracing a light ray of the display of the original image on the display surface passing through the eyepiece optical unit; and

generating the first correction information at the position of the representative pixel on the basis of light ray trace data obtained based on the tracing; and

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

15. The information processing method according to claim 12 , further comprising:

controlling, by the processing device, generating the first correction information at the position of the representative pixel based on actually shooting a virtual image projected by the eyepiece optical unit when the representative pixel is made to be lighted; and

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

16. The information processing method according to claim 12 , wherein

the display surface is vertically longer compared with an aspect ratio of the display of the original image,

the eyepiece optical unit generates a substantially pin-cushion shaped distortion,

the correcting of the display of the original image is in a manner that an angle of view at a horizontal end is not changed, and

the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

17. The information processing method according to claim 12 ,

wherein the correcting of the display of the original image includes separating pixel correction in a vertical direction and pixel correction in a horizontal direction and performing a pixel correction process in series for each direction, and

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

18. The information processing method according to claim 12 ,

wherein the correcting of the display of the original image includes moving the pixel in the same vertical line for each line to perform correction in a vertical direction and then subsequently moving the pixel in the same horizontal line for each line to perform correction in a horizontal direction, and

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

19. The information processing method according to claim 18 ,

wherein the second correction information in the horizontal direction is determined at a position moved by an amount of the second correction information in the vertical direction, and

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood.

20. The information processing method to claim 12 ,

wherein a corrected display image is generated based on the correcting of the display of the original image,

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood, and

the method further comprising controlling, by the processing device,

shifting a display position of the corrected display image at low frequency,

correcting the corrected display image having been subjected to a modulation process while shifting a correspondence relationship of a pixel position and at least one of the first correction information or the second correction information, and

shifting the display position of the corrected display image for burn-in prevention in relation to the shifting the correspondence relationship.

21. The information processing method according to claim 12 ,

wherein the second correction information at the position of each pixel other than the representative pixel is generated on the basis of the first correction information of one or more representative pixels in the neighborhood,

wherein the display surface includes a number of pixels,

wherein the correcting of the display of the original image is on a line memory and includes scaling in conformity to the number of pixels of the display surface, and

the method further comprising controlling, by the processing device, driving at a timing for making a size of the line memory minimum.

22. A non-transitory computer-readable medium configured to store a program, the program comprising:

receiving an original image which, when displayed on a display surface, corresponds to a plurality of pixels arranged on the display surface; and

correcting a display of the original image on the display surface at a position of each of representative pixels which are discretely located on the display surface, on the basis of distortion generated by an eyepiece unit projecting the display surface to obtain a predetermined angle of view by an eyepiece unit;

in which the correcting of the display of the original image on the display surface includes:

holding a first correction information at the position of the representative pixel for correcting the distortion generated due to the eyepiece optical unit,

generating second correction information at a position of each pixel other than the representative pixel on the basis of the first correction information of one or more representative pixels, and

providing, by use of the first correction information and the second correction information, distortion in a direction opposite to the distortion generated due to the eyepiece optical unit to each pixel on the display surface and correcting the pixel,

in which the first correction information is in accordance with a display scale of the original image on a virtual image surface at the eyepiece optical unit, in which the display scale is determined with reference to a predetermined acceptable range for a given original image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2016
From: TAMAYAMA, KEN; FUJINAWA, AKIRA; SHIMIZU, MASAYUKI; IKEDA, KIYOSHI
To: SONY CORPORATION
Reel/Frame 038956/0984 →
Priority Claims (1)
JP 2012-036407 · Feb 22, 2012 · national
Continuity (2)
Continuation 14378840
Related Publication 20160255317A1 · Sep 1, 2016
Cited By (1)
US 12,436,396