IP Library Granted Patent US 10,356,375
Granted Patent B2
US 10,356,375 · App. 15/934,061 · Granted Jul 16, 2019

Display device, image processing device and image processing method, and computer program

Inventors: Ken Tamayama (Tokyo, JP); Akira Fujinawa (Kanagawa, JP); Masayuki Shimizu (Kanagawa, JP); Kiyoshi Ikeda (Kanagawa, JP)
Assignee: Sony Corporation
H04N9/3185G02B27/017G02B27/0172G09G5/005H04N5/145H04N5/64H04N9/3129H04N9/3188H04N13/366G02B2027/011G02B2027/014G09G3/002G09G5/391G09G2340/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,356,375
App. No.
15/934,061
Granted
Jul 16, 2019
Kind
B2
Abstract

Provided is a display device including an image display unit configured to display an image with a plurality of pixels arranged on a display surface, an eyepiece optical unit configured to project the display surface of the image display unit in a manner that a predetermined angle of view is obtained, and an image correction unit configured to correct a display image on the display surface at a position of each of representative pixels which are discretely located on the display surface, on the basis of distortion generated due to the eyepiece optical unit.

Claims (49)

1. An information processing apparatus comprising:

circuitry configured to control:

receiving an original image which, when displayed on a display surface, corresponds to a plurality of pixels arranged on the display surface, and

correcting the original image by applying signal processing to the original image with distortion in a direction opposite to distortion generated in a projection image of an eyepiece unit, wherein the correcting accounts for a pixel pitch of a display screen for displaying the original image and a pixel pitch of a virtual image surface for displaying the projection image, and wherein the correcting is based on correction information at a position of a given representative pixel for correcting the distortion generated which is due to the eyepiece unit and other correction information at a position of each pixel other than the given representative pixel on the basis of respective correction information of one or more other given representative pixels; and

an optical simulator configured to trace a light ray of the display of the original image on the display surface passing through the eyepiece unit,

wherein the circuitry is configured to control generating the correction information at the position of the given representative pixel on the basis of light ray trace data obtained by the optical simulator, and wherein the other correction information at the position of each pixel other than the given representative pixel is generated on the basis of respective correction information of one or more representative pixels in the neighborhood.

2. An information processing apparatus comprising:

circuitry configured to control:

receiving an original image which, when displayed on a display surface, corresponds to a plurality of pixels arranged on the display surface,

correcting the original image by applying signal processing to the original image with distortion in a direction opposite to distortion generated in a projection image of an eyepiece unit, wherein the correcting accounts for a pixel pitch of a display screen for displaying the original image and a pixel pitch of a virtual image surface for displaying the projection image, and wherein the correcting is based on correction information at a position of a given representative pixel for correcting the distortion generated which is due to the eyepiece unit and other correction information at a position of each pixel other than the given representative pixel on the basis of respective correction information of one or more other given representative pixels, and

generating the correction information at the position of the given representative pixel based on actually shooting a virtual image projected by the eyepiece unit when the given representative pixel is made to be lighted,

wherein the other correction information at the position of each pixel other than the given representative pixel is generated on the basis of respective correction information of one or more representative pixels in the neighborhood.

3. An information processing apparatus comprising:

circuitry configured to control:

receiving an original image which, when displayed on a display surface, corresponds to a plurality of pixels arranged on the display surface, and

correcting the original image by applying signal processing to the original image with distortion in a direction opposite to distortion generated in a projection image of an eyepiece unit, wherein the correcting accounts for a pixel pitch of a display screen for displaying the original image and a pixel pitch of a virtual image surface for displaying the projection image, and wherein the correcting is based on correction information at a position of a given representative pixel for correcting the distortion generated which is due to the eyepiece unit and other correction information at a position of each pixel other than the given representative pixel on the basis of respective correction information of one or more other given representative pixels,

wherein

the display surface is vertically longer compared with an aspect ratio of a display of the original image on the display surface,

the eyepiece unit generates a substantially pin-cushion shaped distortion,

the correcting the original image is in a manner that an angle of view at a horizontal end is not changed, and

the other correction information at the position of each pixel other than the given representative pixel is generated on the basis of respective correction information of one or more representative pixels in the neighborhood.

4. An information processing apparatus comprising:

circuitry configured to control:

receiving an original image which, when displayed on a display surface, corresponds to a plurality of pixels arranged on the display surface, and

correcting the original image by applying signal processing to the original image with distortion in a direction opposite to distortion generated in a projection image of an eyepiece unit, wherein the correcting accounts for a pixel pitch of a display screen for displaying the original image and a pixel pitch of a virtual image surface for displaying the projection image, wherein the correcting is based on correction information at a position of a given representative pixel for correcting the distortion generated which is due to the eyepiece unit and other correction information at a position of each pixel other than the given representative pixel on the basis of respective correction information of one or more other given representative pixels,

wherein the correcting the original image includes separating pixel correction in a vertical direction and pixel correction in a horizontal direction and performing a pixel correction process in series for each direction, and

wherein the other correction information at the position of each pixel other than the given representative pixel is generated on the basis of respective correction information of one or more representative pixels in the neighborhood.

5. An information processing apparatus comprising:

circuitry configured to control:

receiving an original image which, when displayed on a display surface, corresponds to a plurality of pixels arranged on the display surface, and

correcting the original image by applying signal processing to the original image with distortion in a direction opposite to distortion generated in a projection image of an eyepiece unit, wherein the correcting accounts for a pixel pitch of a display screen for displaying the original image and a pixel pitch of a virtual image surface for displaying the projection image, wherein the correcting is based on correction information at a position of a given representative pixel for correcting the distortion generated which is due to the eyepiece unit and other correction information at a position of each pixel other than the given representative pixel on the basis of respective correction information of one or more other given representative pixels,

wherein a corrected display image is generated based on the correcting of the original image,

wherein the other correction information at the position of each pixel other than the given representative pixel is generated on the basis of respective correction information of one or more representative pixels in the neighborhood, and

wherein the circuitry is configured to control

shifting a display position of the corrected display image at low frequency, correcting the corrected display image having been subjected to a modulation process while shifting a correspondence relationship of a pixel position and at least one of the correction information or the other correction information, and shifting the display position of the corrected display image for burn-in prevention in relation to the shifting the correspondence relationship.

6. An information processing method comprising:

controlling, by a processing device,

receiving an original image which, when displayed on a display surface, corresponds to a plurality of pixels arranged on the display surface,

correcting the original image by applying signal processing to the original image with distortion in a direction opposite to distortion generated in a projection image of an eyepiece unit, wherein the correcting accounts for a pixel pitch of a display screen for displaying the original image and a pixel pitch of a virtual image surface for displaying the projection image, and wherein the correcting is based on correction information at a position of a given representative pixel for correcting the distortion generated which is due to the eyepiece unit and other correction information at a position of each pixel other than the given representative pixel on the basis of respective correction information of one or more other given representative pixels,

tracing a light ray of the display of the original image on the display surface passing through the eyepiece unit, and

generating the correction information at the position of the given representative pixel on the basis of light ray trace data obtained based on the tracing; and wherein the other correction information at the position of each pixel other than the given representative pixel is generated on the basis of respective correction information of one or more representative pixels in the neighborhood.

7. An information processing method comprising:

controlling, by a processing device,

receiving an original image which, when displayed on a display surface, corresponds to a plurality of pixels arranged on the display surface, and

correcting the original image by applying signal processing to the original image with distortion in a direction opposite to distortion generated in a projection image of an eyepiece unit, wherein the correcting accounts for a pixel pitch of a display screen for displaying the original image and a pixel pitch of a virtual image surface for displaying the projection image, and wherein the correcting is based on correction information at a position of a given representative pixel for correcting the distortion generated which is due to the eyepiece unit and other correction information at a position of each pixel other than the given representative pixel on the basis of respective correction information of one or more other given representative pixels, wherein

the display surface is vertically longer compared with an aspect ratio of a display of the original image on the display surface,

the eyepiece unit generates a substantially pin-cushion shaped distortion,

the correcting the original image is in a manner that an angle of view at a horizontal end is not changed, and

the other correction information at the position of each pixel other than the given representative pixel is generated on the basis of respective correction information of one or more representative pixels in the neighborhood.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2018
From: TAMAYAMA, KEN; FUJINAWA, AKIRA; SHIMIZU, MASAYUKI; IKEDA, KIYOSHI
To: SONY CORPORATION
Reel/Frame 045718/0068 →
Priority Claims (1)
JP 2012-036407 · Feb 22, 2012 · national
Continuity (3)
Continuation 15150924 · May 10, 2016
Continuation 14378840
Related Publication 20180213197A1 · Jul 26, 2018
Cited By (1)
US 12,436,396