IP Library › Granted Patent US 10,720,006
Granted Patent B2
US 10,720,006 · App. 16/157,488 · Granted Jul 21, 2020

Mixed reality systems and methods for displaying and recording authorized real-world and virtual elements

Inventors: Dwayne Nelson (Las Vegas, NV); Patrick Danielson (Las Vegas, NV)
Assignee: IGT
G07F17/3211G07F17/3216
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,720,006
App. No.
16/157,488
Filed
Oct 11, 2018
Granted
Jul 21, 2020
Kind
B2
Art Unit
3715
USPC
463/31
Abstract

A mixed reality display system includes a processor circuit, and a memory coupled to the processor circuit. The memory includes machine-readable instructions that, when executed by the processor circuit, cause the processor circuit to determine a location of a user wearing a mixed reality viewer and generate a live video signal of a real-world scene including a plurality of real-world elements. The machine readable instructions further cause the processor circuit to determine an authorized region within the real-world scene including a plurality of authorized real-world elements that are authorized to be displayed to a third party, and generate a mixed reality including the authorized real-world elements within the authorized region and a first virtual element that obscures one of the plurality of real-world elements of the live video signal that is not within the authorized region of the real-world scene, and generate an output video signal of the mixed reality scene.

Claims (82)

1. A mixed reality display system comprising:

a processor circuit; and

a memory coupled to the processor circuit, the memory comprising stored instructions that, when executed by the processor circuit:

cause the processor circuit to determine a location of a user wearing a mixed reality viewer;

cause the processor circuit to generate a live video signal of a real-world scene associated with a field of view of the user wearing the mixed reality viewer, the real-world scene comprising a plurality of real-world elements;

cause the processor circuit to determine, based on the location of the user and the live video signal, an authorized region within the real-world scene comprising a plurality of authorized real-world elements that are authorized to be displayed to a third party;

cause the processor circuit to generate a mixed reality scene based on the live video signal, the mixed reality scene comprising the authorized real-world elements within the authorized region and a first virtual element that obscures one of the plurality of real-world elements of the live video signal that is not within the authorized region of the real-world scene; and

cause the processor circuit to generate an output video signal of the mixed reality scene.

2. The mixed reality display system of claim 1 , wherein the memory further comprises stored instructions that, when executed by the processor circuit:

cause the processor circuit to generate the mixed reality scene comprising a second virtual element that obscures one of the plurality of real-world elements that is within the authorized region of the real-world scene.

3. The mixed reality display system of claim 1 , wherein the memory further comprises stored instructions that, when executed by the processor circuit:

cause the processor circuit to determine the authorized region within the real-world scene by:

accessing a mixed reality model corresponding to a real-world reference element within the authorized region of the real-world scene; and

determining the authorized region within the real-world scene based on the mixed reality model.

4. The mixed reality display system of claim 3 , wherein the real-world reference element is an electronic gaming machine.

5. The mixed reality display system of claim 1 , wherein the memory further comprises stored instructions that, when executed by the processor circuit:

cause the processor circuit to determine the authorized region within the real-world scene by:

accessing a floor map comprising an indication of the authorized region; and

determining the authorized region within the real-world scene based on the indication of the authorized region.

6. The mixed reality display system of claim 1 , wherein the memory further comprises stored instructions that, when executed by the processor circuit:

cause the processor circuit to determine the authorized region within the real-world scene by:

determining a predetermined location within the real-world scene; and

defining a predetermined area around the predetermined location within the real-world scene as the authorized region.

7. The mixed reality display system of claim 1 , wherein the memory further comprises stored instructions that, when executed by the processor circuit:

cause the processor circuit to generate the mixed reality scene by:

identifying the one of the plurality of real-world elements that is not within the authorized region;

determining that the one of the plurality of real-world elements that is not within the authorized region is not authorized to be displayed to the third party; and

based on determining that one of the plurality of real-world elements is not authorized, obscuring the one of the plurality of real-world elements with the first virtual element within the mixed reality scene.

8. The mixed reality display system of claim 1 , wherein the one of the plurality of real-world elements is a face of a person that is not authorized to be displayed to the third party.

9. The mixed reality display system of claim 1 , wherein the memory further comprises stored instructions that, when executed by the processor circuit:

cause the processor circuit to generate the mixed reality scene by:

identifying the one of the plurality of real-world elements that is not within the authorized region;

determining that the one of the plurality of real-world elements is authorized to be displayed to the third party; and

based on determining that one of the plurality of real-world elements is authorized, displaying the one of the plurality of real-world elements within the mixed reality scene.

10. The mixed reality display system of claim 9 , wherein the memory further comprises stored instructions that, when executed by the processor circuit:

cause the processor circuit to generate the output video signal by:

displaying a second virtual element proximate to the one of the plurality of real-world elements within the mixed reality scene in the output video signal, based on determining that one of the plurality of real-world elements is authorized, to draw attention to the one of the plurality of real-world elements within the mixed reality scene in the output video signal.

11. The mixed reality display system of claim 1 , further comprising a mixed reality viewer comprising a head-wearable frame and a first display device coupled to the head-wearable frame, wherein the memory further comprises stored instructions that, when executed by the processor circuit:

cause the processor circuit to generate the mixed reality scene by:

generating a first mixed reality scene comprising the authorized real-world elements within the authorized region, the first virtual element that obscures one of the plurality of real-world elements of the live video signal that is not within the authorized region of the real-world scene, and a second virtual element that obscures another one of the plurality of real-world elements of the live video signal that is not within the authorized region of the real-world scene; and

generating a second mixed reality scene comprising the first virtual element, wherein the second mixed reality scene does not comprise the second virtual element;

cause the processor circuit to generate the output video signal of the mixed reality scene by generating a first output video signal of the first mixed reality scene and generating a second output video signal of the second mixed reality scene.

12. The mixed reality display system of claim 11 , further comprising a second display device,

wherein the memory further comprises stored instructions that, when executed by the processor circuit:

cause the processor circuit to transmit the second output video signal to the first display device;

cause the first display device to display the second mixed reality scene to the user wearing the head-wearable frame;

cause the processor circuit to transmit the second output video signal to the second display device; and

cause the second display device to display the first mixed reality scene so that the first mixed reality scene is viewable by the third party.

13. The mixed reality display system of claim 11 , wherein the memory further comprises stored instructions that, when executed by the processor circuit:

cause the processor circuit to transmit the first output video signal to the first display device;

cause the first display device to display the first mixed reality scene to the user wearing the head-wearable frame; and

cause the processor circuit to record the second output video signal to a video storage medium.

14. The mixed reality display system of claim 11 , wherein the second mixed reality scene comprises a particular real-world element that is not part of the first mixed reality scene.

15. The mixed reality display system of claim 1 , wherein the memory further comprises stored instructions that, when executed by the processor circuit:

prior to generating the output video signal, cause the processor circuit to determine that a triggering condition has occurred, wherein generating an output video signal occurs in response to determining that the triggering condition has occurred.

16. The mixed reality display system of claim 1 , wherein the memory further comprises stored instructions that, when executed by the processor circuit:

cause the processor circuit to determine that a triggering condition has occurred by determining that the user has made a predetermined movement.

17. The mixed reality display system of claim 1 , wherein the memory further comprises stored instructions that, when executed by the processor circuit:

cause the processor circuit to determine that a triggering condition has occurred by determining that a predetermined game event has occurred within a game being played by the user.

18. A method comprising:

determining, by a processor circuit, a location of a user wearing a mixed reality display device;

generating a live video signal of a real-world scene associated with a field of view of the user, the real-world scene comprising a plurality of real-world elements;

determining, by the processor circuit based on the location of the user and the live video signal, an authorized region within the real-world scene comprising a plurality of authorized real-world elements that are authorized to be displayed to a third party;

generating a mixed reality scene based on the live video signal, the mixed reality scene comprising the authorized real-world elements within the authorized region of the real-world scene and a first virtual element that obscures one of the plurality of real-world elements of the live video signal that is not within the authorized region of the real-world scene; and

generating an output video signal of the mixed reality scene.

19. The method of claim 18 , wherein generating the mixed reality scene further comprises:

generating a first mixed reality scene comprising the authorized real-world elements within the authorized region, the first virtual element that obscures one of the plurality of real-world elements of the live video signal that is not within the authorized region of the real-world scene, and a second virtual element that obscures another one of the plurality of real-world elements of the live video signal that is not within the authorized region of the real-world scene; and

generating a second mixed reality scene comprising the first virtual element, wherein the second mixed reality scene does not comprise the second virtual element, and

wherein generating the output video signal of the mixed reality scene further comprises generating a first output video signal of the first mixed reality scene and generating a second output video signal of the second mixed reality scene.

20. A mixed reality display device comprising:

a head-wearable frame;

a display device coupled to the head-wearable frame;

a video capture device coupled to the head-wearable frame;

a processor circuit; and

a memory coupled to the processor circuit, the memory comprising stored instructions that, when executed by the processor circuit:

cause the processor circuit to determine a location of a user wearing a mixed reality display device;

cause the video capture device to generate a live video signal of a real-world scene associated with a field of view of the user wearing the head-wearable frame, the real-world scene comprising a plurality of real-world elements;

cause the processor circuit to determine, based on the location of the user and the live video signal, an authorized region within the real-world scene comprising a plurality of authorized real-world elements that are authorized to be displayed to a third party;

cause the processor circuit to generate a mixed reality scene based on the live video signal, the mixed reality scene comprising the authorized real-world elements within the authorized region and a first virtual element that obscures one of the plurality of real-world elements of the live video signal that is not within the authorized region of the real-world scene;

cause the processor circuit to generate an output video signal of the mixed reality scene;

cause the processor circuit to transmit the output video signal to the display device; and

cause display device to display the mixed reality scene to the user wearing the head-wearable frame.

Assignments (2)
SECURITY AGREEMENT Recorded Jul 3, 2025
From: IGT
To: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
Reel/Frame 071817/0394 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2018
From: NELSON, DWAYNE; DANIELSON, PATRICK
To: IGT
Reel/Frame 047134/0428 →
Continuity (1)
Related Publication 20200118380A1 · Apr 16, 2020