IP Library Granted Patent US 10,403,050
Granted Patent B1
US 10,403,050 · App. 15/948,729 · Granted Sep 3, 2019

Multi-user virtual and augmented reality tracking systems

Inventors: Andrew C. Beall (Santa Barbara, CA); Christopher Coffin (Goleta, CA); Todd Hartwig (Santa Barbara, CA)
Assignee: WorldViz, Inc.
G06T19/006G02B27/017G06F3/04815G06F3/04817G06T7/292
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,403,050
App. No.
15/948,729
Granted
Sep 3, 2019
Kind
B1
Abstract

An aspect of the disclosure relates to an example marker identification and position tracking system configured to interface and work in conjunction with a marker device and camera system and to provide high fidelity tracking of user and object motion in a virtual and/or augmented reality experience. The example computing system enables use case scenarios in which certain computer aided design capabilities enable rapid creation/configuration of a multi-user, interactive, virtual reality, and/or augmented reality slide presentation experience.

Claims (48)

1. A cluster system, comprising:

a plurality of motion tracking cameras, wherein the plurality of motion tracking cameras are placeable in a physical space coincident with a presenter and a first user, the plurality of motion tracking cameras configured to detect infrared light and to communicate position data, corresponding to detected infrared light;

non-transitory media storing instructions readable by the cluster system, that when executed by the cluster system, cause the cluster system to:

join a head mounted display of the first user to a virtual reality presentation session in response to receipt of a first control selection by the first user;

render during the virtual reality presentation session, in the head mounted display of the first user, a scene defined by a first slide of a virtual reality slide presentation that comprises a plurality of virtual reality slides, wherein an initial placement of the first user in the scene is defined by the virtual reality slide presentation;

join a head mounted display of the presenter to the virtual reality presentation session in response to receipt of a second control selection by the presenter;

render, in the head mounted display of the presenter, the scene defined by the first slide of the virtual reality slide presentation and a representation of the first user;

subsequent to the presenter joining the virtual reality presentation session, render, in the head mounted display of the first user, a representation of the presenter wherein an initial placement of the presenter in the scene is defined by the virtual reality slide presentation; and

in response to receipt of a third control selection by the presenter, advance the virtual reality slide presentation to a second slide wherein the second slide causes a corresponding scene change to be rendered in the head mounted display of the presenter and the head mounted display of the first user.

2. The cluster system of claim 1 , wherein the cluster system is configured to receive the virtual reality slide presentation from a presentation designer client configured to enable virtual reality slide presentations to be designed using a two dimensional display.

3. The cluster system of claim 1 , wherein the cluster system is configured to receive the virtual reality slide presentation from a presentation designer client configured to enable virtual reality slide presentations to be designed and to display a thumbnail version of one or more slides of a virtual reality slide presentation being designed.

4. The cluster system of claim 1 , wherein the plurality of motion tracking cameras are configured to derive an identity of one or more markers from a detected repetitive pattern of infrared light pulses.

5. The cluster system of claim 1 , wherein a portion of the slides of the virtual reality slide presentation comprises a virtual reality recording of a second user presenting using one or more of the slides of the virtual reality slide presentation.

6. The cluster system of claim 1 , wherein a portion of the cluster system further comprises one or more computing devices configured in a cloud-based computing environment.

7. The cluster system of claim 1 , wherein the cluster system further comprises:

a master computing device; and

wherein the plurality of motion tracking cameras are configured to communicate position data corresponding to detected infrared light to the master computing device.

8. The cluster system of claim 1 , wherein the corresponding scene change in response to the slide advance comprises the appearance of an object.

9. A cluster system, comprising:

a first plurality of motion tracking cameras, wherein the first plurality of motion tracking cameras are placeable in a physical space coincident with a presenter, the plurality of motion tracking cameras configured to detect infrared light and to communicate position data, corresponding to detected infrared light;

a second plurality of motion tracking cameras, wherein the second plurality of motion tracking cameras are placeable in a physical space coincident with a first user, the plurality of motion tracking cameras configured to detect infrared light and to communicate position data, corresponding to detected infrared light;

non-transitory media storing instructions readable by the cluster system, that when executed by the cluster system, cause the cluster system to:

join a head mounted display of the first user to a virtual reality conference session in response to receipt of a first control selection by the first user;

render during the virtual reality conference session, in the head mounted display of the first user, a scene defined by a first slide of a virtual reality slide presentation comprising a plurality of slides, wherein an initial placement of the first user in the scene is defined by the virtual reality slide presentation;

join a head mounted display of the presenter to the virtual reality conference session in response to receipt of a first control selection by the presenter;

render, in the head mounted display of the presenter, the scene defined by the first slide of the virtual reality slide presentation and a representation of the first user;

subsequent to the presenter joining the virtual reality conference session, render, in the head mounted display of the first user, a representation of the presenter wherein an initial placement of the presenter in the scene is defined by the virtual reality slide presentation; and

in response to receipt of a third control selection by the presenter, advance the virtual reality slide presentation to a second slide wherein the second slide causes a corresponding scene change to be rendered in the head mounted display of the presenter and the head mounted display of the first user.

10. The cluster system of claim 9 , wherein first user is geographically remote from the presenter.

11. The cluster system of claim 9 , wherein the cluster system further comprises:

a first computing device local to the first plurality of motion tracking cameras;

a master computing device; and,

wherein the position data corresponding to detected infrared light is transmitted to the master computing device of the cluster system via the first computing device.

12. The cluster system of claim 9 , wherein the virtual reality slide presentation is designed via a first user interface and the first user interface displays a thumbnail version of one or more slides of the virtual reality slide presentation.

13. The cluster system of claim 9 , wherein the first plurality of motion tracking cameras and second plurality of motion tracking cameras are configured to derive an identity of one or more markers from a detected repetitive pattern of infrared light pulses.

14. The cluster system of claim 9 , wherein a portion of the slides of the virtual reality slide presentation comprises a virtual reality recording of a second user presenting using one or more of the slides of the virtual reality slide presentation.

15. The cluster system of claim 9 , wherein the cluster system is configured to receive the virtual reality slide presentation from a presentation designer client configured to enable virtual reality slide presentations to be is designed via a computer-aided design user interface.

16. The cluster system of claim 9 , wherein a portion of the cluster system further comprises one or more computing devices configured in a cloud-based computing environment.

17. The cluster system of claim 9 , wherein the cluster system further comprises:

a master computing device; and

wherein the first plurality of motion tracking cameras and the second plurality of motion tracking cameras are configured to communicate position data corresponding to detected infrared light to the master computing device.

18. The cluster system of claim 9 , wherein the corresponding scene change in response to the slide advance comprises the appearance of an object.

19. Non-transitory media that stores instructions that when executed by a computer system cause the computer system to perform operations comprising:

render, in a head mounted display of a first user, a scene defined by a first slide of a virtual slide reality presentation comprising a plurality of virtual reality slides, wherein an initial placement of the first user in the scene is defined by the virtual reality slide presentation;

link a head mounted display of presenter to a virtual reality slide presentation session in response to receipt of a first control selection by the presenter;

render during the virtual reality slide presentation session, in the head mounted display of the presenter, the scene defined by the first slide of the virtual reality slide presentation and a representation of the first user;

subsequent to the presenter joining the virtual reality slide presentation session, render, in the head mounted display of the first user, a representation of the presenter, wherein an initial placement of the presenter in the scene is defined by the virtual reality slide presentation; and

in response to receipt of a second control selection by the presenter, advance the virtual reality slide presentation to a second slide, wherein the second slide causes a corresponding scene change to be rendered in the head mounted display of the presenter and the head mounted display of the first user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2018
From: BEALL, ANDREW C.; COFFIN, CHRISTOPHER; HARTWIG, TODD
To: WORLDVIZ, INC.
Reel/Frame 045626/0795 →
Continuity (1)
Provisional Application 62483845 · Apr 10, 2017
Cited By (65)
US 1,115,806 US 1,117,268 US 1,118,657 US 1,129,462 US 12,200,404 US 12,211,145 US 12,212,705 US 12,238,152 US 12,244,605 US 12,254,434 US 12,260,456 US 12,267,482 US 12,282,604 US 12,289,561 US 12,293,011 US 12,315,094 US 12,320,654 US 12,321,468 US 12,322,052 US 12,340,080 US 12,346,841 US 12,346,987 US 12,347,265 US 12,354,033 US 12,361,486 US 12,417,496 US 12,417,593 US 12,449,891 US 12,450,672 US 12,477,082 US 12,487,095 US 12,489,815 US 12,493,831 US 12,495,094 US 12,515,586 US 12,517,892 US 12,518,242 US 12,519,924 US 12,536,585 US 12,536,586 US 12,536,750 US 12,536,757 US 12,541,292 US 12,544,674 US 12,547,237 US 12,579,486 US 12,579,492 US 12,579,588 US 12,591,926 US 12,596,515 US 12,596,525 US 12,597,046 US 12,597,063 US 12,597,068 US 12,602,635 US 12,613,580 US 12,619,928 US 12,646,130 US 12,651,286 US 12,681,563 US 12,694,420 US 12,704,946 US 12,705,847 US 12,710,278 US 12,718,494