IP Library Granted Patent US 9,380,295
Granted Patent B2
US 9,380,295 · App. 14/257,854 · Granted Jun 28, 2016

Non-linear navigation of a three dimensional stereoscopic display

Inventors: Scott M. Dolim (Mountain View, CA); Cisco Lopez-Fresquet (Los Gatos, CA)
Assignee: zSpace, Inc.
H04N13/0468G06F3/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,380,295
App. No.
14/257,854
Granted
Jun 28, 2016
Kind
B2
Abstract

Systems and methods for navigating a 3D stereoscopic scene displayed via a 3D stereoscopic display system using user head tracking. A reference POV including a reference user head position and a reference user head orientation may be established. The user head POV may be tracked, including monitoring user head positional displacements and user head angular rotations relative to the reference POV. In response to the tracking, a camera POV used to render the 3D stereoscopic scene may be adjusted based on a non-linear mapping between changes in the camera POV and the user head positional displacements and user head angular rotations relative to the reference POV. The non-linear mapping may include a mapping of user head positional displacements relative to the reference POV to translational movements in the camera POV and a mapping of user head angular rotations relative to the reference POV to rotations in the camera POV.

Claims (68)

1. A method for navigating a three dimensional (3D) stereoscopic scene displayed via a 3D stereoscopic display system, the method comprising:

enabling a user head tracking navigational mode of the 3D stereoscopic display system;

establishing a reference point of view (POV), wherein the reference POV comprises a reference user head position and a reference user head orientation;

tracking user head POV, wherein said tracking monitors user head positional displacements and user head angular rotations relative to the reference POV; and

adjusting, in response to said tracking, a camera POV used to render the 3D stereoscopic scene, wherein said adjusting is based on a non-linear mapping between changes in the camera POV and the user head positional displacements and user head angular rotations relative to the reference POV, and wherein the non-linear mapping comprises:

a mapping of user head positional displacements relative to the reference POV to translational movements in the camera POV; and

a mapping of user head angular rotations relative to the reference POV to rotations in the camera POV.

2. The method of claim 1 , wherein said enabling comprises:

receiving user input enabling the head tracking navigational mode via one or more of:

a user interface displayed within the 3D stereoscopic scene; or

an input device of the 3D stereoscopic display system.

3. The method of claim 2 , wherein the input device is a user control element.

4. The method of claim 1 , wherein said adjusting further comprises adjusting one or more 3D stereoscopic rendering variables, and wherein said adjusting is further based on a non-linear mapping of each of the one or more 3D stereoscopic rendering variables to the camera POV.

5. The method of claim 4 , wherein the one or more 3D stereoscopic rendering variables comprise one or more of:

a world scale variable;

a stereo level variable;

a zero parallax offset variable; or

a head-tracking scale variable.

6. The method of claim 1 , wherein the non-linear mapping further comprises:

a mapping of rate of change of user head positional displacements relative to the reference POV to rate of change of translational movements in the camera POV; and

a mapping of rate of change of user head angular rotations relative to the reference POV to rate of change of rotations in the camera POV.

7. The method of claim 1 , wherein said adjusting occurs in real-time.

8. The method of claim 1 , wherein the camera POV corresponds to a frustum field of view angle.

9. A non-transitory computer readable memory medium storing programming instructions for navigating a three dimensional (3D) stereoscopic scene displayed via a 3D stereoscopic display system, wherein the programming instructions are executable by a processor to:

enable a user head tracking navigational mode of the 3D stereoscopic display system;

establish a reference point of view (POV), wherein the reference POV comprises a reference user head position and a reference user head orientation;

track user head POV, wherein said tracking monitors user head positional displacements and user head angular rotations relative to the reference POV; and

adjust, in response to tracking user head POV, a camera POV used to render the 3D stereoscopic scene, wherein said adjusting is based on a non-linear mapping between changes in the camera POV and the user head positional displacements and user head angular rotations relative to the reference POV, and wherein the non-linear mapping comprises:

a mapping of user head positional displacements relative to the reference POV to translational movements in the camera POV; and

a mapping of user head angular rotations relative to the reference POV to rotations in the camera POV.

10. The non-transitory computer readable memory medium of claim 9 , wherein to enable a user head tracking navigational mode of the 3D stereoscopic display system the programming instructions are further executable by a processor to:

receive user input enabling the head tracking navigational mode via one or more of:

a user interface displayed within the 3D stereoscopic scene; or

an input device of the 3D stereoscopic display system.

11. The non-transitory computer readable memory medium of claim 10 , wherein the input device is a user control element.

12. The non-transitory computer readable memory medium of claim 9 , wherein to adjust the camera POV the programming instructions are further executable by a processor to adjust one or more 3D stereoscopic rendering variables, and wherein said adjusting is further based on a non-linear mapping of each of the one or more 3D stereoscopic rendering variables to the camera POV.

13. The non-transitory computer readable memory medium of claim 12 , wherein the one or more 3D stereoscopic rendering variables comprise one or more of:

a world scale variable;

a stereo level variable;

a zero parallax offset variable; or

a head-tracking scale.

14. The non-transitory computer readable memory medium of claim 9 , wherein the non-linear mapping further comprises:

a mapping of rate of change of user head positional displacements relative to the reference POV to rate of change of translational movements in the camera POV; and

a mapping of rate of change of user head angular rotations relative to the reference POV to rate of change of rotations in the camera POV.

15. The non-transitory computer readable memory medium of claim 9 , wherein said adjusting is executed in real-time.

16. The non-transitory computer readable memory medium of claim 9 , wherein the camera POV corresponds to a frustum field of view angle.

17. A system for navigating a three dimensional (3D) stereoscopic scene displayed via a 3D stereoscopic display system, comprising:

a 3D stereoscopic display system, comprising:

a display screen;

a user head tracking system; and

a functional unit coupled to the user head tracking system and the display screen,

wherein the functional unit is configured to:

enable a user head tracking navigational mode of the 3D stereoscopic display system, wherein the user's head is tracked via the user head tracking system;

establish a reference point of view (POV), wherein the reference POV comprises a reference user head position and a reference user head orientation;

track user head POV via the user head tracking system, wherein said tracking monitors user head positional displacements and user head angular rotations relative to the reference POV; and

adjust, in response to tracking user head POV, a camera POV used to render the 3D stereoscopic scene via the display screen, wherein said adjusting is based on a non-linear mapping between changes in the camera POV and the user head positional displacements and user head angular rotations relative to the reference POV, and wherein the non-linear mapping comprises:

a mapping of user head positional displacements relative to the reference POV to translational movements in the camera POV; and

a mapping of user head angular rotations relative to the reference POV to rotations in the camera POV.

18. The system of claim 17 , further comprising:

an input device;

wherein to enable a user head tracking navigational mode of the 3D stereoscopic display system the functional unit is further configured to:

receive user input enabling the head tracking navigational mode via one or more of:

a user interface displayed within the 3D stereoscopic scene; or

the input device.

19. The system of claim 17 , wherein to adjust the camera POV the functional unit is further configured to adjust one or more 3D stereoscopic rendering variables, and wherein said adjusting is further based on a non-linear mapping of each of the one or more 3D stereoscopic rendering variables to the camera POV.

20. The system of claim 17 , wherein the non-linear mapping further comprises:

a mapping of rate of change of user head positional displacements relative to the reference POV to rate of change of translational movements in the camera POV; and

a mapping of rate of change of user head angular rotations relative to the reference POV to rate of change of rotations in the camera POV.

Assignments (8)
SECURITY INTEREST Recorded Apr 14, 2025
From: ZSPACE, INC.
To: 3I, L.P.
Reel/Frame 070826/0887 →
RELEASE OF PATENT SECURITY AGREEMENT Recorded Feb 6, 2023
From: EAST WEST BANK
To: ZSPACE, INC.
Reel/Frame 062640/0162 →
SECURITY INTEREST Recorded Sep 17, 2021
From: ZPACE, INC.
To: EAST WEST BANK
Reel/Frame 057651/0222 →
SECURITY INTEREST Recorded May 22, 2019
From: ZSPACE, INC.
To: BSPACE INVESTMENTS LIMITED
Reel/Frame 049259/0533 →
RELEASE OF SECURITY INTEREST Recorded May 8, 2019
From: RUNWAY GROWTH CREDIT FUND INC.
To: ZSPACE, INC. (F/K/A INFINITE Z, INC.)
Reel/Frame 049113/0898 →
SECURITY INTEREST Recorded Jan 2, 2018
From: ZSPACE, INC. (F/K/A INFINITE Z, INC.)
To: RUNWAY GROWTH CREDIT FUND INC.
Reel/Frame 044985/0721 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE "RECEIVING PARTY DATA" ON THE PATENT ASSIGNMENT COVER SHEET IS INCORRECT. PREVIOUSLY RECORDED ON REEL 032788 FRAME 0284. ASSIGNOR(S) HEREBY CONFIRMS THE THE UNDERSIGNED DOES HEREBY: SELL, ASSIGN AND TRANSFER TO ZSPACE, INC. (THE "ASSIGNEE").... Recorded May 6, 2014
From: DOLIM, SCOTT M.; LOPEZ-FRESQUET, CISCO
To: ZSPACE, INC.
Reel/Frame 032828/0223 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2014
From: DOLIM, SCOTT M.; LOPEZ-FRESQUET, CISCO
To: NATIONAL INSTRUMENTS CORPORATION
Reel/Frame 032788/0284 →
Continuity (2)
Provisional Application 61814319 · Apr 21, 2013
Related Publication 20140313295A1 · Oct 23, 2014