IP Library Granted Patent US 9,299,183
Granted Patent B2
US 9,299,183 · App. 14/198,252 · Granted Mar 29, 2016

Detection of partially obscured objects in three dimensional stereoscopic scenes

Inventor: Michael A. Vesely (Santa Cruz, CA)
Assignee: zSpace, Inc.
G06T15/08G06F3/012G06F3/013G06F3/0346G06F3/0482G06F3/0485G06F3/04815H04N13/0484
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,299,183
App. No.
14/198,252
Granted
Mar 29, 2016
Kind
B2
Abstract

System and methods for user interface elements for use within a 3D scene. The 3D scene may be presented by at least one display, which includes displaying at least one stereoscopic image of the 3D scene by the display(s). The 3D scene may be presented according to a first viewpoint. One or more user interface elements may be used. The 3D scene may be updated in response to the use of the user interface elements.

Claims (92)

1. A method comprising:

displaying a three dimensional (3D) stereoscopic scene by at least one stereoscopic display device wherein the 3D stereoscopic scene is displayed according to a first viewpoint, wherein the first viewpoint comprises a first location and orientation in physical space with respect to the at least one stereoscopic display device, and wherein the 3D stereoscopic scene comprises a rendering of two or more objects from the first viewpoint in which the rendering of a first object of the two or more objects is at least partially visible and the rendering of a second object of the two or more objects is at least partially obscured by the first object;

determining a second location and orientation in physical space of a six degree of freedom (6DOF) input device, wherein the second location and orientation in physical space maps to a corresponding position and orientation within the 3D stereoscopic scene;

displaying a depicted beam according to a first representation;

determining an intersection of the depicted beam within the 3D stereoscopic scene with an obscured portion of the second object of the two or more objects, wherein the depicted beam extends from the corresponding position and orientation within the 3D stereoscopic scene; and

displaying at least a portion of the depicted beam with a representation that indicates the intersection, comprising:

displaying a first portion of the depicted beam with the first representation; and

displaying a second portion of the depicted beam with a second representation;

wherein the first portion extends from the corresponding position and orientation within the 3D stereoscopic scene towards the intersection, wherein the second portion extends away from the intersection, and wherein the second representation is different from the first representation.

2. The method of claim 1 ,

wherein the first representation comprises one or more of:

a first line style; or

a first line color; and

wherein the second representation comprises one or more of:

a second line style; or

a second line color.

3. The method of claim 2 ,

wherein the first line style comprises a solid line and the second line style comprises a notched line.

4. The method of claim 1 , further comprising:

rendering the first object transparent or translucent; and

displaying the partially obscured portion of the second object from the first viewpoint.

5. The method of claim 1 , further comprising:

determining a region of the first object that corresponds to the partially obscured portion of the second object;

rendering the region of the first object transparent; and

displaying the partially obscured portion of the second object from the first viewpoint.

6. The method of claim 1 , further comprising:

determining a region of the first object that corresponds to the partially obscured portion of the second object;

rendering the region of the first object translucent; and

displaying the partially obscured portion of the second object from the first viewpoint.

7. The method of claim 1 ,

wherein the depicted beam comprises a rendering of a continuous beam.

8. A non-transitory computer accessible memory medium storing program instructions for utilizing a six degree of freedom (6DOF) input device with a three-dimensional (3D) stereoscopic scene, wherein the program instructions are executable by a processor to:

display the 3D stereoscopic scene by at least one stereoscopic display device, wherein the 3D stereoscopic scene is displayed according to a first viewpoint, wherein the first viewpoint comprises a first location and orientation in physical space with respect to the at least one stereoscopic display device, and wherein the 3D stereoscopic scene comprises a rendering of two or more objects from the first viewpoint in which the rendering of a first object of the two or more objects is at least partially visible and the rendering of a second object of the two or more objects is at least partially obscured by the first object;

determine a second location and orientation in physical space of the 6DOF input device, wherein the second location and orientation in physical space maps to a corresponding position and orientation within the 3D stereoscopic scene;

display a depicted beam according to a first representation;

determine an intersection of the depicted beam within the 3D stereoscopic scene with an obscured portion of the second object of the two or more objects, wherein the depicted beam extends from the corresponding position and orientation within the 3D stereoscopic scene; and

display at least a portion of the depicted beam with a representation that indicates the intersection, wherein to display at least the portion of the depicted beam, the program instructions are further executable to:

display a first portion of the depicted beam with the first representation; and

display a second portion of the depicted beam with a second representation;

wherein the first portion extends from the corresponding position and orientation within the 3D stereoscopic scene towards the intersection, wherein the second portion extends away from the intersection, and wherein the second representation is different from the first representation.

9. The non-transitory computer accessible memory medium of claim 8 , wherein the depicted beam comprises a rendering of a continuous beam.

10. The non-transitory computer accessible memory medium of claim 8 , wherein the first representation comprises a first line style and the second representation comprises a second line style.

11. The non-transitory computer accessible memory medium of claim 10 ,

wherein the first line style comprises a solid line and the second line style comprises a notched line.

12. The non-transitory computer accessible memory medium of claim 8 , wherein the first representation comprises a first line color and the second representation comprises a second line color.

13. The non-transitory computer accessible memory medium of claim 8 , wherein the program instructions are further executable to:

determine a region of the first object that corresponds to the partially obscured portion of the second object;

render the region of the first object transparent; and

display the partially obscured portion of the second object from the first viewpoint.

14. The non-transitory computer accessible memory medium of claim 8 , wherein the program instructions are further executable to:

determine a region of the first object that corresponds to the partially obscured portion of the second object;

render the region of the first object translucent; and

display the partially obscured portion of the second object from the first viewpoint.

15. The non-transitory computer accessible memory medium of claim 8 , wherein the program instructions are further executable to:

render the first object transparent; and

display the partially obscured portion of the second object from the first viewpoint.

16. The non-transitory computer accessible memory medium of claim 8 , wherein the program instructions are further executable to:

render the first object translucent; and

display the partially obscured portion of the second object from the first viewpoint.

17. A system for utilizing a six degree of freedom (6DOF) input device with a three-dimensional (3D) stereoscopic scene, the system comprising:

a processor;

an input device configured to provide information to the processor indicating a current viewpoint of the user;

at least one display coupled to the processor;

the 6DOF input device; and

a memory medium coupled to the processor which stores program instructions executable to:

display the 3D stereoscopic scene by at least one stereoscopic display device, wherein the 3D stereoscopic scene is displayed according to a first viewpoint, wherein the first viewpoint comprises a first location and orientation in physical space with respect to the at least one stereoscopic display device, and wherein the 3D stereoscopic scene comprises a rendering of two or more objects from the first viewpoint in which the rendering of a first object of the two or more objects is at least partially visible and the rendering of a second object of the two or more objects is at least partially obscured by the first object;

determine a second location and orientation in physical space of the 6DOF input device, wherein the second location and orientation in physical space maps to a corresponding position and orientation within the 3D stereoscopic scene;

display a depicted beam according to a first representation;

determine an intersection of the depicted beam within the 3D stereoscopic scene with an obscured portion of the second object of the two or more objects, wherein the depicted beam extends from the corresponding position and orientation within the 3D stereoscopic scene; and

display at least a portion of the depicted beam with a representation that indicates the intersection, wherein to display at least the portion of the depicted beam, the program instructions are further executable to:

display a first portion of the depicted beam with the first representation; and

display a second portion of the depicted beam with a second representation;

wherein the first portion extends from the corresponding position and orientation within the 3D stereoscopic scene towards the intersection, wherein the second portion extends away from the intersection, and wherein the second representation is different from the first representation.

18. The system of claim 17 , wherein the depicted beam comprises a rendering of a continuous beam.

19. The system of claim 17 , wherein the first representation comprises a first line style and the second representation comprises a second line style.

20. The system of claim 17 , wherein the first representation comprises a first line color and the second representation comprises a second line color.

21. The system of claim 17 , wherein the program instructions are further executable to:

determine a region of the first object that corresponds to the partially obscured portion of the second object;

render the region of the first object transparent; and

display the partially obscured portion of the second object from the first viewpoint.

22. The system of claim 17 , wherein the program instructions are further executable to:

determine a region of the first object that corresponds to the partially obscured portion of the second object;

render the region of the first object translucent; and

display the partially obscured portion of the second object from the first viewpoint.

23. The system of claim 17 , wherein the program instructions are further executable to:

render the first object transparent; and

display the partially obscured portion of the second object from the first viewpoint.

24. The system of claim 17 , wherein the program instructions are further executable to:

render the first object translucent; and

display the partially obscured portion of the second object from the first viewpoint.

25. The system of claim 19 ,

wherein the first line style comprises a solid line and the second line style comprises a notched line.

Assignments (7)
SECURITY INTEREST Recorded Apr 14, 2025
From: ZSPACE, INC.
To: 3I, L.P.
Reel/Frame 070826/0887 →
RELEASE OF PATENT SECURITY AGREEMENT Recorded Feb 6, 2023
From: EAST WEST BANK
To: ZSPACE, INC.
Reel/Frame 062640/0162 →
SECURITY INTEREST Recorded Sep 17, 2021
From: ZPACE, INC.
To: EAST WEST BANK
Reel/Frame 057651/0222 →
SECURITY INTEREST Recorded May 22, 2019
From: ZSPACE, INC.
To: BSPACE INVESTMENTS LIMITED
Reel/Frame 049259/0533 →
RELEASE OF SECURITY INTEREST Recorded May 8, 2019
From: RUNWAY GROWTH CREDIT FUND INC.
To: ZSPACE, INC. (F/K/A INFINITE Z, INC.)
Reel/Frame 049113/0898 →
SECURITY INTEREST Recorded Jan 2, 2018
From: ZSPACE, INC. (F/K/A INFINITE Z, INC.)
To: RUNWAY GROWTH CREDIT FUND INC.
Reel/Frame 044985/0721 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2014
From: VESELY, MICHAEL A.
To: ZSPACE, INC.
Reel/Frame 032563/0902 →
Continuity (4)
Continuation 13174448 · Jun 30, 2011
Provisional Application 61361081 · Jul 2, 2010
Provisional Application 61364277 · Jul 14, 2010
Related Publication 20140184589A1 · Jul 3, 2014