IP Library Granted Patent US 11,893,755
Granted Patent B2
US 11,893,755 · App. 16/963,162 · Granted Feb 6, 2024

Multi-focal planes with varying positions

Inventors: Seppo T. Valli (Espoo, FI); Pekka K. Siltanen (Helsinki, FI)
Assignee: InterDigital VC Holdings, Inc.
G06T7/536G02B27/0101G06T7/55G06T7/97G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,893,755
App. No.
16/963,162
Granted
Feb 6, 2024
Kind
B2
Abstract

Systems and methods are described for display of a depth image (depth plus texture) using multiple focal planes. In one embodiment, a depth image (which may be a frame of a depth video, consisting of a video plus depth sequence) is mapped to a first set of image planes. The depth image (or a subsequent frame of the depth video) is mapped to a second set of image planes. Each image plane in the first and second set has a specified depth, and the first and second set differ in at least one depth. Each of the image planes is displayed in the first set at the respective depth of that image plane, and, subsequently, each of the image planes in the second set is displayed at its respective depth. Display of the first and second sets may be cyclically alternated at rate sufficiently high to avoid perceptible flicker.

Claims (36)

1. A method of displaying video frames having corresponding depth information, the method comprising:

mapping a first image frame to a first set of at least two image planes;

mapping a subsequent second image frame to a second set of at least two image planes, wherein each image plane in the first and second set has a specified depth, wherein the first and second set differ in at least one depth, and wherein at least one depth of an image plane in the second set is between two consecutive depths of image planes in the first set;

displaying each of the image planes in the first set at the respective depth thereof;

after displaying all of the image planes in the first set, displaying each of the image planes in the second set at the respective depth thereof.

2. The method of claim 1 , wherein mapping the first image frame to the first set of image planes is performed using a first set of blending functions, and mapping the second image frame to the second set of image planes is performed using a second set of blending functions.

3. The method of claim 1 , wherein at least one of the blending functions has the form 0.5+0.5 cos(Ax+B) for at least a selected portion of a domain thereof.

4. The method of claim 3 , wherein the at least one blending function has a value of zero or one outside the selected portion.

5. The method of claim 1 , wherein all of the image planes in the first set are displayed simultaneously and, subsequently, all of the image planes in the second set are displayed simultaneously.

6. The method of claim 1 , wherein no two image planes are displayed simultaneously.

7. The method of claim 1 , wherein all depths of image planes in the second set are different from all depths of image planes in the first set.

8. The method of claim 1 , wherein display of the image planes in the first set and display of image planes in the second set are performed cyclically.

9. The method of claim 8 , wherein cyclic display of the image planes in the first set and display of image planes in the second set is performed a rate of at least 30 Hz.

10. The method of claim 9 , wherein displaying an image plane at a respective depth thereof includes:

displaying an image on a display component; and

adjusting optics of a display device to form a virtual image of the display component at the respective depth.

11. The method of claim 1 , wherein the image is displayed on a display device comprising a display component and a plurality of electronically controllable eyepiece lenses at different positions along an optical path from the display component, and wherein displaying an image plane at a respective depth thereof includes:

displaying an image on the display component; and

controlling the eyepiece lenses so as to form a virtual image of the display component at the respective depth.

12. The method of claim 11 , wherein controlling the eyepiece lenses comprises controlling a selected one of the eyepiece lenses to have a predetermined positive optical power and controlling the remaining eyepiece lenses to have substantially zero optical power.

13. The method of claim 12 , wherein the display device is an optical-see-through display comprising an objective lens and at least one inverting lens system.

14. A display device for displaying video frames having corresponding depth information, the device comprising:

an image plane formation module operative to map a first image frame to a first set of at least two image planes and to map a subsequent second image frame to a second set of at least two image planes, wherein each image plane in the first and second set has a specified depth, wherein the first and second set differ in at least one depth, and wherein at least one depth of an image plane in the second set is between two consecutive depths of image planes in the first set;

display optics operative to display image planes at respective associated depths; and

a multiplexer operative to cause the display optics to (i) display each of the image planes in the first set at the respective depth thereof and (ii) after displaying all of the image planes in the first set, display each of the image planes in the second set at the respective depth thereof.

15. The display device of claim 14 , wherein the multiplexer is configured to display all of the image planes in the first set simultaneously and, subsequently, to display all of the image planes in the second set simultaneously.

16. The device of claim 14 , wherein the display optics comprises a display component and a plurality of electronically controllable eyepiece lenses at different positions along an optical path from the display component, and wherein the displaying of the image planes comprises:

displaying an image on the display component; and

controlling the eyepiece lenses so as to form a virtual image of the display component at the respective depth.

17. The device of claim 16 , wherein at least one of the electronically controllable eyepiece lenses is switchable between a state with a positive optical power and a state with substantially zero optical power.

18. The device of claim 14 , wherein the display optics comprise an optical-see-through display having an objective lens and at least one inverting lens system.

19. An apparatus comprising a processor configured to perform at least:

mapping a first image frame of a video to a first set of at least two image planes;

mapping a subsequent second image frame of the video to a second set of at least two image planes, wherein each image plane in the first and second set has a specified depth, wherein the first and second set differ in at least one depth, and wherein at least one depth of an image plane in the second set is between two consecutive depths of image planes in the first set;

displaying each of the image planes in the first set at the respective depth thereof;

after displaying all of the image planes in the first set, displaying each of the image planes in the second set at the respective depth thereof.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2023
From: PCMS HOLDINGS, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 062383/0359 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2022
From: VALLI, SEPPO T.; SILTANEN, PEKKA K
To: PCMS HOLDINGS, INC.
Reel/Frame 060789/0254 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2022
From: TEKNOLOGIAN TUTKIMUSKESKUS VTT OY
To: PCMS HOLDINGS, INC.
Reel/Frame 060789/0278 →
Continuity (2)
Provisional Application 62619401 · Jan 19, 2018
Related Publication 20210133994A1 · May 6, 2021