IP Library Granted Patent US 9,824,485
Granted Patent B2
US 9,824,485 · App. 14/952,397 · Granted Nov 21, 2017

Presenting a view within a three dimensional scene

Inventors: Michael A. Vesely (Santa Cruz, CA); Alan S. Gray (San Jose, CA)
Assignee: zSpace, Inc.
G06T15/20G06F3/012G06F3/013G06F3/04815G06T15/00G06T19/006G09G3/003H04N13/0278H04N13/0468H04N13/0484G09G2340/12G09G2340/125G09G2340/14G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,824,485
App. No.
14/952,397
Granted
Nov 21, 2017
Kind
B2
Abstract

Presenting a view based on a virtual viewpoint in a three dimensional (3D) scene. The 3D scene may be presented by at least one display, which includes displaying at least one stereoscopic image of the 3D scene by the display(s). The 3D scene may be presented according to a first viewpoint. A virtual viewpoint may be determined within the 3D scene that is different than the first viewpoint. The view of the 3D scene may be presented on the display(s) according to the virtual viewpoint and/or the first view point. The presentation of the view of the 3D scene is performed concurrently with presenting the 3D scene.

Claims (72)

1. A system for presenting a three dimensional (3D) scene, comprising:

at least one display; and

at least one processor coupled to the at least one display;

wherein the at least one processor is configured to:

determine a user viewpoint based on tracking of a user position, wherein the user position comprises position and orientation in physical space;

determine a user perspective relative to at least one display surface of the at least one display, wherein the user perspective comprises a mapping between angle and orientation of the at least one display surface and a render plane to the user viewpoint;

render and display the 3D scene within a virtual space based on a projection in virtual space to the render plane, wherein the render plane has a correlation to the position and orientation of the at least one display, and wherein the correlation is based on the user perspective;

determine a first virtual viewpoint, wherein the first virtual viewpoint is controlled by a first position, angle and orientation of at least a portion of a hand of the user in physical space without use of hand-held tools and corresponds to a first position, angle and orientation in the virtual space;

determine a second virtual viewpoint, wherein the second virtual viewpoint is controlled by a second position, angle and orientation of the at least a portion of the hand of the user in physical space without use of hand-held tools and corresponds to a second position, angle and orientation in the virtual space; and

establish first and second fields of view and first and second view volumes of the 3D scene, wherein the first field of view and first view volume are based on the first virtual viewpoint, and wherein the second field of view and second view volume are based on the second virtual viewpoint.

2. The system of claim 1 ,

wherein the user perspective is based on a first user eyepoint and the user position.

3. The system of claim 2 ,

wherein to determine the user perspective, the at least one processor is further configured to:

determine a first user eyepoint based on user position; and

correlate user position to a position of the at least one display surface, wherein the correlation is relative to an angle and orientation of the at least one display surface.

4. The system of claim 1 ,

wherein the at least one processor is further configured to:

store the first and second fields of view and the first and second view volumes.

5. The system of claim 1 ,

wherein the first and second positions, angles, and orientations of the at least a portion of the hand of the user are in open space.

6. The system of claim 1 ,

wherein the user position comprises at least one of:

a user head position;

a user eye position; and

a user eye pair position.

7. The system of claim 1 ,

wherein the user perspective further comprises an oblique viewpoint, wherein the render plane corresponds to the oblique viewpoint, wherein the render plane has a first oblique render plane angle, and wherein an additional render plane corresponds to the oblique viewpoint wherein the additional render plan has a second oblique render plane angle.

8. The system of claim 1 ,

wherein the 3D scene renders in stereo and the at least one display surface is a stereo 3D display surface.

9. The system of claim 1 ,

wherein the at least one processor is further configured to:

present, via the at least one display, the 3D scene according to one of the first field of view and first view volume and the second field of view and second view volume.

10. The system of claim 1 ,

wherein the first virtual viewpoint is in one of open space and inner space.

11. A non-transitory computer readable memory medium storing program instructions for presenting a view based on a virtual viewpoint in a three dimensional (3D) scene, wherein the program instructions are executable by a processor to:

determine a user viewpoint based on tracking of a user position, wherein the user position comprises position and orientation in physical space;

determine a user perspective relative to at least one display surface of at least one display, wherein the user perspective comprises a mapping between angle and orientation of the at least one display surface and a render plane to the user viewpoint;

render and display the 3D scene within a virtual space based on a projection in virtual space to the render plane, wherein the render plane has a correlation to the position and orientation of the at least one display, and wherein the correlation is based on the user perspective;

determine a first viewpoint, wherein the first virtual viewpoint is controlled by a first position, angle and orientation of at least a portion of a hand of the user in physical space without use of hand-held tools and corresponds to a first position, angle and orientation in the virtual space;

determine a second virtual viewpoint, wherein the second virtual viewpoint is controlled by a second position, angle and orientation of the at least a portion of the hand of the user in physical space without use of hand-held tools and corresponds to a second position, angle and orientation in the virtual space; and

establish first and second fields of view and first and second view volumes of the 3D scene, wherein the first field of view and first view volume are based on the first virtual viewpoint, and wherein the second field of view and second view volume are based on the second virtual viewpoint.

12. The non-transitory computer readable memory medium of claim 11 ,

wherein the user perspective is based on a first user eyepoint and the user position.

13. The non-transitory computer readable memory medium of claim 12 ,

wherein to determine the user perspective, the program instructions are further executable to:

determine a first user eyepoint based on user position; and

correlate user position to a position of the at least one display surface, wherein the correlation is relative to an angle and orientation of the at least one display surface.

14. The non-transitory computer readable memory medium of claim 11 ,

wherein the program instructions are further executable to:

store the first and second fields of view and the first and second view volumes.

15. The non-transitory computer readable memory medium of claim 11 ,

wherein the first and second positions, angles, and orientations of the at least a portion of the hand of the user are in open space.

16. The non-transitory computer readable memory medium of claim 11 ,

wherein the user position comprises at least one of:

a user head position;

a user eye position; and

a user eye pair position.

17. The non-transitory computer readable memory medium of claim 11 ,

wherein the user perspective further comprises an oblique viewpoint, wherein the render plane corresponds to the oblique viewpoint, wherein the render plane has a first oblique render plane angle, and wherein an additional render plane corresponds to the oblique viewpoint wherein the additional render plan has a second oblique render plane angle.

18. The non-transitory computer readable memory medium of claim 11 ,

wherein the 3D scene renders in stereo and the at least one display surface is a stereo 3D display surface.

19. The non-transitory computer readable memory medium of claim 11 ,

wherein the program instructions are further executable to:

present, via the at least one display, the 3D scene according to one of the first field of view and first view volume and the second field of view and second view volume.

20. A method for presenting a view based on a virtual viewpoint in a three dimensional (3D) scene, the method comprising:

determining a user viewpoint based on tracking of a user position, wherein the user position comprises position and orientation in physical space;

determining a user perspective relative to at least one display surface of at least one display, wherein the user perspective comprises a mapping between angle and orientation of the at least one display surface and a render plane to the user viewpoint;

rendering and display the 3D scene within a virtual space based on a projection in virtual space to the render plane, wherein the render plane has a correlation to the position and orientation of the at least one display, and wherein the correlation is based on the user perspective;

determining a first virtual viewpoint, wherein the first virtual viewpoint is controlled by a first position, angle and orientation of at least a portion of a hand of the user in physical space without use of hand-held tools and corresponds to a first position, angle and orientation in the virtual space;

determining a second virtual viewpoint, wherein the second virtual viewpoint is controlled by a second position, angle and orientation of the at least a portion of the hand of the user in physical space without use of hand-held tools and corresponds to a second position, angle and orientation in the virtual space; and

establishing first and second fields of view and first and second view volumes of the 3D scene, wherein the first field of view and first view volume are based on the first virtual viewpoint, and wherein the second field of view and second view volume are based on the second virtual viewpoint.

Assignments (7)
SECURITY INTEREST Recorded Apr 14, 2025
From: ZSPACE, INC.
To: 3I, L.P.
Reel/Frame 070826/0887 →
RELEASE OF PATENT SECURITY AGREEMENT Recorded Feb 6, 2023
From: EAST WEST BANK
To: ZSPACE, INC.
Reel/Frame 062640/0162 →
SECURITY INTEREST Recorded Sep 17, 2021
From: ZPACE, INC.
To: EAST WEST BANK
Reel/Frame 057651/0222 →
SECURITY INTEREST Recorded May 22, 2019
From: ZSPACE, INC.
To: BSPACE INVESTMENTS LIMITED
Reel/Frame 049259/0533 →
RELEASE OF SECURITY INTEREST Recorded May 8, 2019
From: RUNWAY GROWTH CREDIT FUND INC.
To: ZSPACE, INC. (F/K/A INFINITE Z, INC.)
Reel/Frame 049113/0898 →
SECURITY INTEREST Recorded Jan 2, 2018
From: ZSPACE, INC. (F/K/A INFINITE Z, INC.)
To: RUNWAY GROWTH CREDIT FUND INC.
Reel/Frame 044985/0721 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 25, 2015
From: VESELY, MICHAEL A.; GRAY, ALAN S.
To: ZSPACE, INC.
Reel/Frame 037142/0839 →
Continuity (4)
Continuation 14268613 · May 2, 2014
Continuation 12797958 · Jun 10, 2010
Provisional Application 61299538 · Jan 29, 2010
Related Publication 20160086373A1 · Mar 24, 2016