IP Library Granted Patent US 11,587,292
Granted Patent B2
US 11,587,292 · App. 16/049,742 · Granted Feb 21, 2023

Triggered virtual reality and augmented reality events in video streams

Inventors: John Holbrook Crocker (Valencia, CA); Wilfredo Rosas (Encino, CA)
Assignee: Disney Enterprises, Inc.
G06T19/006G06T2200/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,587,292
App. No.
16/049,742
Granted
Feb 21, 2023
Kind
B2
Abstract

Various embodiments of the invention disclosed herein provide techniques for generating a virtual object for a VR/AR environment in response to a trigger. A VR/AR application executing on a client device receives a media content item. The VR/AR application detects an event trigger associated with the media content item. The VR/AR application generates at least a portion of a virtual object based on the event trigger. The VR/AR application displays the media content item and the at least a portion of the virtual object on a display associated with a user device.

Claims (49)

1. A computer-implemented method for generating a virtual object in response to a trigger, the method comprising:

receiving a first media content item;

detecting a first event trigger associated with the first media content item, wherein the first event trigger is activated when a first virtual representation of a first object based on a first number of dimensions crosses a display boundary associated with a virtual two-dimensional screen that is included within a virtual environment, and wherein the virtual two-dimensional screen displays the first media content item within the virtual environment;

generating at least a portion of a second virtual representation of the first object and a second event trigger based on a second number of dimensions that is different than the first number of dimensions, wherein the second event trigger is included in the second virtual representation of the first object; and

displaying the first media content item and, based on the display boundary, the at least a portion of the second virtual representation of the first object on one or more displays associated with a user device.

2. The computer-implemented method of claim 1 , wherein the first event trigger is embedded as metadata within a file associated with the first media content item.

3. The computer-implemented method of claim 1 , wherein the first event trigger is encoded into a video frame included in the first media content item.

4. The computer-implemented method of claim 1 , further comprising:

predicting a first time when an object included in the first media content item is to intersect a screen on which the first media content item is displayed; and

generating the first event trigger based on the first time.

5. The computer-implemented method of claim 1 , wherein the first event trigger includes a unique identifier (UID) that identifies a first characteristic associated with the first object.

6. The computer-implemented method of claim 5 , wherein the first characteristic determines, at least in part, how the at least a portion of the second virtual representation of the first object is displayed.

7. The computer-implemented method of claim 1 , wherein the first event trigger includes a timestamp that identifies a first time at which the at least a portion of the second virtual representation of the first object is displayed.

8. The computer-implemented method of claim 1 , further comprising:

receiving a selection of the first object via a controller associated with the user device;

generating at least a portion of a virtual representation of a second object based on the selection; and

displaying the at least a portion of the virtual representation of the second object on the display.

9. The computer-implemented method of claim 1 , further comprising:

receiving a selection of the first object via a controller associated with the user device; and

displaying a second media content item on the display.

10. The computer-implemented method of claim 1 , wherein the second virtual representation of the first object is displayed on the one or more displays while the first virtual representation of the first object remains outside of the display boundary.

11. A non-transitory computer-readable medium including instructions that, when executed by a processor, cause the processor to generate a virtual representation of an object in response to a trigger, by performing the steps of:

receiving a first media content item;

detecting a first event trigger associated with the first media content item, wherein the first event trigger is activated when a first virtual representation of a first object based on a first number of dimensions crosses a display boundary associated a virtual two-dimensional screen that is included within a virtual environment, and wherein the virtual two-dimensional screen displays the first media content item within the virtual environment;

generating at least a portion of a second virtual representation of the first object and a second event trigger based on a second number of dimensions that is different that the first number of dimensions, wherein the second event trigger is included in the second virtual representation of first object; and

displaying the first media content item and, based on the display boundary, the at least a portion of the second virtual representation of the first object on one or more displays associated with a user device.

12. The non-transitory computer-readable medium of claim 11 , wherein the first event trigger is embedded as metadata within a file associated with the media content item.

13. The non-transitory computer-readable medium of claim 11 , wherein the first event trigger is encoded into a video frame included in the media content item.

14. The non-transitory computer-readable medium of claim 11 , wherein the first event trigger includes a unique identifier (UID) that identifies a first characteristic associated with the first object.

15. The non-transitory computer-readable medium of claim 14 , wherein the first characteristic determines, at least in part, how the at least a portion of the second virtual representation of the first object is displayed.

16. The non-transitory computer-readable medium of claim 11 , wherein the first event trigger includes a timestamp that identifies a first time at which the at least a portion of the second virtual representation of the first object is displayed.

17. The non-transitory computer-readable medium of claim 11 , further comprising embedding the second event trigger as metadata within a file associated with the at least a portion of the second virtual representation of the first object.

18. The non-transitory computer-readable medium of claim 11 , further comprising:

determining that the at least a portion of the second virtual representation of the first object is to be removed from the one or more displays; and

deleting the second event trigger.

19. The non-transitory computer-readable medium of claim 11 , further comprising:

determining that the at least a portion of the second virtual representation of the first object is to intersect a virtual screen upon which the media content item is displayed;

generating at least a portion of a virtual representation of a second object based on the second event trigger; and

displaying the at least a portion of the virtual representation of the second object on the display.

20. A computing device, comprising:

a memory that includes a trigger generation engine; and

a processor that is coupled to the memory and, when executing the trigger generation engine, is configured to:

receive a first media content item;

detect a first event trigger associated with the first media content item, wherein the first event trigger is activated when a first virtual representation of a first object based on a first number of dimensions crosses a display boundary associated with a virtual two-dimensional screen that is included within a virtual environment, and wherein the virtual two-dimensional screen displays the first media content item within virtual environment;

generate at least a portion of a second virtual representation of the first object and a second event trigger based on a second number of dimensions that is different than the first number of dimensions, wherein the second event trigger is included in the second virtual representation of the first object; and

display the first media content item and, based on the display boundary, the at least a portion of the second virtual representation of the first object on one or more displays associated with a user device.

21. The computing device of claim 20 , wherein the memory further includes a machine learning engine, and wherein the processor, when executing the machine learning engine, is configured to:

predict a first time when an object included in the first media content item is to intersect a virtual screen upon which the first media content item is displayed; and

generate the first event trigger based on the first time.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2026
From: DISNEY ENTERPRISES, INC.
To: ADEIA MEDIA HOLDINGS INC.
Reel/Frame 075817/0438 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2018
From: CROCKER, JOHN HOLBROOK; ROSAS, WILFREDO
To: DISNEY ENTERPRISES, INC.
Reel/Frame 046519/0726 →
Continuity (1)
Related Publication 20200035025A1 · Jan 30, 2020
Cited By (1)
US 12,293,470