IP Library Granted Patent US 10,490,157
Granted Patent B2
US 10,490,157 · App. 15/859,930 · Granted Nov 26, 2019

Compression of distorted images for head-mounted display

Inventor: Sagiv Philipp (Raanana, IL)
Assignee: Screenovate Technologies Ltd.
G09G5/005G09G3/002G09G5/006H04N19/103H04N19/136H04N19/154H04N19/167H04N19/182G09G2340/02G09G2340/0407G09G2354/00G09G2370/12G09G2370/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,490,157
App. No.
15/859,930
Granted
Nov 26, 2019
Kind
B2
Abstract

A method and device for distorted compression of images displayed over a head mounted display (HMD) are provided. The method includes receiving, at a sink device, an image from a source device over a transport medium; determining, based on the optical means of the HMD, a circumscribed circle of the received image; determining a compression ratio based on at least radial attributes of the received image; and compressing, using a compression process, pixels inside the circumscribed circle of the received image, wherein the compression is based on the determined compression ratio.

Claims (61)

1. A method for distorted compression of images displayed over a head mounted display (HMD), comprising:

receiving, at a sink device, an image from a source device over a transport medium;

determining, based on an optical means of the HMD, a circumscribed circle of the received image;

determining a compression ratio, as a function of a first compression ratio and a second compression ratio, based on at least radial attributes of the received image by:

distorting the received image;

determining a radial distance of each pixel in the distorted image;

computing using a distorted function as a radial distance of each pixel; and

determining the second compression ratio for each pixel based on a location of the pixel relative to a fovea area, wherein the second compression ratio of a pixel corresponds to the radial distance of the pixel; and

compressing, using a compression process, pixels inside the circumscribed circle of the received image, wherein the compression is based on the determined compression ratio.

2. The method of claim 1 , further comprising determining the first compression ratio:

determining the fovea area in the received image; and

determining the first compression ratio for each pixel based on a location of the pixel relative to the fovea area, wherein a compression ratio of a pixel outside of the fovea area is higher than a pixel inside the fovea area.

3. The method of claim 2 , wherein determining the fovea area further comprising:

receiving at least a sensory signal indicating a gaze direction of a user wearing the HMD.

4. The method of claim 3 , wherein the distortion of the image is a geometric distortion and the distortion is a chromatic aberration function of a single basic color.

5. The method of claim 4 , further comprising:

calibrating the sink device to determine the distortion function and the values of the function.

6. The method of claim 3 , wherein the compression ratio is the function of a maximum value between the first compression ratio and the second compression ratio.

7. The method of claim 1 , wherein further comprising:

adjusting the compression ratio based on an available bandwidth on the transport medium.

8. The method of claim 1 , wherein the transport medium is at least a wireless medium.

9. The method of claim 1 , wherein the image is any type of multimedia content received from the source device.

10. The method of claim 1 , wherein the compression process includes at least any one of: a texture compression, a block compression, a JPEG, a PNG, and a MPEG compression.

11. The method of claim 1 , wherein the sink device is connected to the HMD.

12. A non-transitory computer readable medium having stored thereon instructions for causing one or more processing circuitry to execute a process for distorted compression of images displayed over a head mounted display (HMD), comprising:

receiving, at a sink device, an image from a source over a transport medium;

determining, based on an optical means of the HMD, a circumscribed circle of the received image;

determining a compression ratio, as a function of a first compression ratio and a second compression ratio, based on at least radial attributes of the received image by:

distorting the received image;

determining a radial distance of each pixel in the distorted image;

computing using a distorted function a radial distance of each pixel; and

determining the second compression ratio for each pixel based on a location of the pixel relative to a fovea area, wherein the second compression ratio of a pixel corresponds to the radial distance of the pixel; and

compressing, using a compression process, pixels inside the circumscribed circle of the received image, wherein the compression is based on the determined compression ratio.

13. A device for distorted compression of images displayed over a head mounted display (HMD), comprising:

a processing circuitry; and

a memory, the memory containing instructions that, when executed by the processing circuitry, configure the device to:

receive an image from a source device over a transport medium;

determine, based on an optical means of the HMD, a circumscribed circle of the received image;

determine a compression ratio, as a function of a first compression ratio and a second compression ratio, based on at least radial attributes of the received image

distort the received image;

determine a radial distance of each pixel in the distorted image;

compute using a distorted function a radial distance of each pixel; and

determining the second compression ratio for each pixel based on a location of the pixel relative to a fovea area, wherein the second compression ratio of a pixel corresponds to the radial distance of the pixel; and

compress, using a compression process, pixels inside the circumscribed circle of the received image, wherein the compression is based on the determined compression ratio.

14. The device of claim 13 , wherein the device is further configured to:

determine the fovea area in the received image; and

determine the first compression ratio for each pixel based on a location of the pixel relative to the fovea area, wherein a compression ratio of a pixel outside of the fovea area is higher than a pixel inside the fovea area.

15. The device of claim 14 , wherein the device is further configured to:

receive at least a sensory signal indicating a gaze direction of a user wearing the HMD.

16. The device of claim 15 , wherein the distortion of the image is a geometric distortion and the distortion is a chromatic aberration function of a single basic color.

17. The device of claim 15 , wherein the compression ratio is the function of a maximum value between the first compression ratio and the second compression ratio.

18. The device of claim 15 , wherein the device is further configured to:

adjust the compression ratio based on an available bandwidth on the transport medium.

19. The device of claim 13 , further comprising:

a wireless medium for at least communicating with the source device over the transport medium.

20. The device of claim 19 , wherein a communication protocol carried by the wireless medium is at least an IEEE 802.11ad communication standard.

21. The device of claim 19 , further comprising:

a decoder circuitry configured to decode the received image; and

a graphical processing unit configured to render an image to be displayed on the HMD.

22. The device of claim 13 , wherein the compression process includes at least any one of: a texture compression, a block compression, a JPEG, a PNG, and a MPEG compression.

23. The device of claim 13 , wherein the device is a sink device connected to the HMD.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2022
From: SCREENOVATE TECHNOLOGIES LTD.
To: INTEL CORPORATION
Reel/Frame 059478/0777 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2018
From: PHILIPP, SAGIV
To: SCREENOVATE TECHNOLOGIES LTD.
Reel/Frame 044762/0237 →
Continuity (2)
Provisional Application 62441765 · Jan 3, 2017
Related Publication 20180190236A1 · Jul 5, 2018