IP Library Granted Patent US 9,881,421
Granted Patent B2
US 9,881,421 · App. 14/810,736 · Granted Jan 30, 2018

Image processing

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,881,421
App. No.
14/810,736
Granted
Jan 30, 2018
Kind
B2
Abstract

An image processing method for a head mounted display device is provided, operable in respect of an image generated for display by the head mountable display device according to at least one of an initial position or orientation of a viewpoint. The method includes detecting one or both of a current position or orientation of the head mountable display device depending upon a display time at which the image is to be displayed. The method further includes processing the image using pixel position mappings in which at least a subset of pixels of the image are displaced by respective pixel displacements dependent upon a difference between at least one of the initial position and the detected current position, or the initial orientation and the detected current orientation at the time at which the image is to be displayed.

Claims (34)

1. An image processing method for a head mounted display device, operable in respect of an image generated for display by the head mountable display device according to one or both of an initial position or an initial orientation of a viewpoint, the method comprising:

detecting, by a sensor device, one or both of a current position or a current orientation of the head mountable display device depending upon a display time at which the image is to be displayed; and

processing, by a processing device, the image using pixel position mappings in which at least a subset of pixels of the image are displaced by respective pixel displacements dependent upon a difference between at least one of the initial position and the detected current position or the initial orientation and the detected current orientation at the display time at which the image is to be displayed;

the processing step comprising applying a lateral pixel displacement to at least a subset of rows of pixels, the lateral pixel displacement depending on a difference in lateral rotation between the initial orientation and the detected current orientation of the head mountable display device;

wherein the lateral displacement is different for two or more subsets of rows of pixels, and the lateral displacement is greater for a subset of pixel rows towards a vertical centre of the image than for another subset of pixel rows towards a top or bottom of the image.

2. A method according to claim 1 , in which the processing step comprises applying a vertical pixel displacement to the image in dependence upon a difference in vertical rotation between the initial orientation and the detected current orientation of the head mountable display device.

3. A method according to claim 1 , in which the processing step comprises generating the pixel displacements as a function of pixel position in the image and the difference between the initial orientation and the detected current orientation of the head mountable display device.

4. A method according to claim 1 , further comprising the step of distorting the generated image to compensate for optics of the display device.

5. A method according to claim 1 , further comprising the steps of:

detecting at least one of the initial position or the initial orientation of the head mountable display device; and

generating the image according to at least one of the detected initial position or the detected initial orientation.

6. A non-transitory computer readable storage medium which stores computer readable instructions, the instructions, when executed by a processor, cause the processor to perform an image processing method for a head mounted display device, operable in respect of an image generated for display by the head mountable display device according to one or both of an initial position or an initial orientation of a viewpoint, the method comprising:

detecting one or both of a current position or a current orientation of the head mountable display device depending upon a display time at which the image is to be displayed; and

processing the image using pixel position mappings in which at least a subset of pixels of the image are displaced by respective pixel displacements dependent upon a difference between at least one of the initial position and the detected current position or the initial orientation and the detected current orientation at the display time at which the image is to be displayed;

the processing comprising applying a lateral pixel displacement to at least a subset of rows of pixels, the lateral pixel displacement depending on a difference in lateral rotation between the initial orientation and the detected current orientation of the head mountable display device;

wherein the lateral displacement is different for two or more subsets of rows of pixels, and the lateral displacement is greater for a subset of pixel rows towards a vertical centre of the image than for another subset of pixel rows towards a top or bottom of the image.

7. The non-transitory computer readable storage medium of claim 6 , in which the processing further comprises applying a vertical pixel displacement to the image in dependence upon a difference in vertical rotation between the initial orientation and the detected current orientation of the head mountable display device.

8. The non-transitory computer readable storage medium of claim 6 , in which the processing further comprises generating the pixel displacements as a function of pixel position in the image and the difference between the initial orientation and the detected current orientation of the head mountable display device.

9. The non-transitory computer readable storage medium of claim 6 , in which the method further comprising the step of distorting the generated image to compensate for optics of the display device.

10. The non-transitory computer readable storage medium of claim 6 , in which the method further comprises the steps of:

detecting at least one of the initial position or the initial orientation of the head mountable display device; and

generating the image according to at least one of the detected initial position or the detected initial orientation.

11. An image processing apparatus operable to process an image generated for display by a head mountable display device according to one or both of an initial position or an initial orientation of a viewpoint, the image processing apparatus comprising:

a detector operable to detect one or both of a current position or a current orientation of the head mountable display device depending upon a display time at which the image is to be displayed; and

a processor operable to process the image using pixel position mappings in which at least a subset of pixels of the image are displaced by respective pixel displacements dependent upon a difference between at least one of the initial position and the detected current position or the initial orientation and the detected current orientation at the display time at which the image is to be displayed;

the processor being configured to apply a lateral pixel displacement to at least a subset of rows of pixels, the lateral pixel displacement depending on a difference in lateral rotation between the initial orientation and the detected current orientation of the head mountable display device;

wherein the lateral displacement is different for two or more subsets of rows of pixels, and the lateral displacement is greater for a subset of pixel rows towards a vertical centre of the image than for another subset of pixel rows towards a top or bottom of the image.

12. A head mountable display device comprising apparatus according to claim 11 .

13. The image processing apparatus of claim 11 , in which the processor is further configured to apply a vertical pixel displacement to the image in dependence upon a difference in vertical rotation between the initial orientation and the detected current orientation of the head mountable display device.

14. The image processing apparatus of claim 11 , in which the processor is configured to generate the pixel displacements as a function of pixel position in the image and the difference between the initial orientation and the detected current orientation of the head mountable display device.

15. The image processing apparatus of claim 11 , in which the processor is further configured to distort the generated image to compensate for optics of the display device.

16. The image processing apparatus of claim 11 , in which the processor is further configured to:

detect at least one of the initial position or the initial orientation of the head mountable display device; and

generate the image according to at least one of the detected initial position or the detected initial orientation.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2020
From: SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 052167/0398 →
CHANGE OF NAME Recorded Jul 14, 2017
From: SONY COMPUTER ENTERTAINMENT EUROPE LIMITED
To: SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED
Reel/Frame 043198/0110 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 18, 2015
From: BICKERSTAFF, IAN HENRY; RAGHOEBARDAJAL, SHARWIN WINESH
To: SONY COMPUTER ENTERTAINMENT EUROPE LIMITED
Reel/Frame 036345/0392 →