IP Library Granted Patent US 9,898,871
Granted Patent B1
US 9,898,871 · App. 15/286,353 · Granted Feb 20, 2018

Systems and methods for providing augmented reality experience based on a relative position of objects

Inventors: Richard Reagan (Burbank, CA); Sagar Mistry (Burbank, CA); Nathan Allison (Burbank, CA)
Assignee: Disney Enterprises, Inc.
G06T19/006G06K9/52G06K9/6267G06T7/004G06T19/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,898,871
App. No.
15/286,353
Granted
Feb 20, 2018
Kind
B1
Abstract

This disclosure relates to system and methods for providing augmented reality experience based on a relative position of objects. Augmented reality experience based on a relative position of object may be provided by detecting a first object and a second object. Positions and orientations of the first object and the second object may be determined. A first visual effect may be determined for the first object and a second visual effect may be determined for the second object. Overlay positions and orientations for the first visual effect and the second visual effect may be determined. An overlay image including the first visual effect and the second visual effect may be determined, and the overlay image may be displayed. An interaction between the first visual effect and the second visual effect may be determined based on the relative position of the first object and the second object.

Claims (69)

1. A system configured to provide an augmented reality experience, the system comprising:

a display configured to display an overlay image;

an image sensor configured to generate visual output signals conveying visual information within a field of view of the image sensor, the visual information including depictions of a first object and a second object present in the real world;

one or more physical processors configured by machine readable instructions to:

detect presence of the first object based on the visual output signals;

detect presence of the second object based on the visual output signals;

determine a position and orientation of the first object based on the visual output signals;

determine a position and orientation of the second object based on the visual output signals;

determine a relative orientation between the first object and the second object;

determine a first visual effect for the first object;

determine a second visual effect for the second object;

determine an overlay position and overlay orientation for the first visual effect based on the position and orientation of the first object;

determine an overlay position and overlay orientation for the second visual effect based on the position and orientation of the second object;

determine the overlay image comprising the first visual effect and the second visual effect, wherein the first visual effect is placed within the overlay image according to the overlay position and overlay orientation for the first visual effect and the second visual effect is placed within the overlay image according to the overlay position and overlay orientation for the second visual effect;

effectuate presentation of the overlay image on the display so that the first visual effect appears to augment an appearance of the first object within the real world and the second visual effect appears to augment an appearance of the second object within the real world; and

determine an interaction between the first visual effect and the second visual effect based on the relative orientation between the first object and the second object.

2. The system of claim 1 , wherein the one or more physical processors are further configured by machine readable instructions to:

obtain user input, the user input indicating a set of controls for the first visual effect, the set of controls including a first control defining a first action for the first visual effect; and

modify the first visual effect to simulate the first visual effect executing an action corresponding to the user input.

3. The system of claim 2 , wherein the interaction between the first visual effect and the second visual effect are determined further based on the user input.

4. The system of claim 1 , wherein by virtue of the relative orientation between the first object and the second object being a first relative orientation, the interaction is determined to be a first interaction, and by virtue of the relative orientation between the first object and the second object being a second relative orientation, the interaction is determined to be a second interaction.

5. The system of claim 1 , wherein the first visual effect is characterized by a first status parameter set, the first status parameter set including a first power parameter defining a power of the first visual effect, and wherein the interaction between the first visual effect and the second visual effect are determined further based on the first status parameter set.

6. The system of claim 5 , wherein the second visual effect is characterized by a second status parameter set, the second status parameter set including a second power parameter defining a power of the second visual effect, and wherein the interaction between the first visual effect and the second visual effect are determined further based on the second status parameter set.

7. The system of claim 5 , wherein the one or more physical processors are further configured by machine readable instructions to change the first status parameter set based on the interaction between the first visual effect and the second visual effect.

8. The system of claim 7 , wherein the one or more physical processors are further configured by machine readable instruction to modify the first visual effect based on a change to the first status parameter set.

9. The system of claim 1 , wherein the first object includes a first card and the second object includes a second card.

10. A method to provide an augmented reality experience, the method comprising:

generating visual output signals conveying visual information within a field of view of an image sensor, the visual information including depictions of a first object and a second object present in the real world;

detecting presence of the first object based on the visual output signals;

detecting presence of the second object based on the visual output signals;

determining a position and orientation of the first object based on the visual output signals;

determining a position and orientation of the second object based on the visual output signals;

determining a relative orientation between the first object and the second object;

determining a first visual effect for the first object;

determining a second visual effect for the second object;

determining an overlay position and overlay orientation for the first visual effect based on the position and orientation of the first object;

determining an overlay position and overlay orientation for the second visual effect based on the position and orientation of the second object;

determining an overlay image comprising the first visual effect and the second visual effect, wherein the first visual effect is placed within the overlay image according to the overlay position and overlay orientation for the first visual effect and the second visual effect is placed within the overlay image according to the overlay position and overlay orientation for the second visual effect;

effectuating presentation of the overlay image on a display so that the first visual effect appears to augment an appearance of the first object within the real world and the second visual effect appears to augment an appearance of the second object within the real world; and

determining an interaction between the first visual effect and the second visual effect based on the relative orientation between the first object and the second object.

11. The method of claim 10 , further comprising:

obtaining user input, the user input indicating a set of controls for the first visual effect, the set of controls including a first control defining a first action for the first visual effect; and

modifying the first visual effect to simulate the first visual effect executing an action corresponding to the user input.

12. The method of claim 11 , wherein the interaction between the first visual effect and the second visual effect are determined further based on the user input.

13. The method of claim 10 , wherein by virtue of the relative orientation between the first object and the second object being a first relative orientation, the interaction is determined to be a first interaction, and by virtue of the relative orientation between the first object and the second object being a second relative orientation, the interaction is determined to be a second interaction.

14. The method of claim 10 , wherein the first visual effect is characterized by a first status parameter set, the first status parameter set including a first power parameter defining a power of the first visual effect, and wherein the interaction between the first visual effect and the second visual effect are determined further based on the first status parameter set.

15. The method of claim 14 , wherein the second visual effect is characterized by a second status parameter set, the second status parameter set including a second power parameter defining a power of the second visual effect, and wherein the interaction between the first visual effect and the second visual effect are determined further based on the second status parameter set.

16. The method of claim 14 , further comprising changing the first status parameter set based on the interaction between the first visual effect and the second visual effect.

17. The method of claim 16 , further comprising modifying the first visual effect based on a change to the first status parameter set.

18. The method of claim 10 , wherein the first object includes a first card and the second object includes a second card.

19. A system configured to provide an augmented reality experience, the system comprising:

a display configured to display an overlay image;

an image sensor configured to generate visual output signals conveying visual information within a field of view of the image sensor, the visual information including depictions of a first object and a second object present in the real world;

one or more physical processors configured by machine readable instructions to:

detect presence of the first object based on the visual output signals;

detect presence of the second object based on the visual output signals;

determine a position and orientation of the first object based on the visual output signals;

determine a position and orientation of the second object based on the visual output signals;

determine a relative orientation between the first object and the second object;

determine a first visual effect for the first object;

determine a second visual effect for the second object;

determine an overlay position and overlay orientation for the first visual effect based on the position and orientation of the first object;

determine an overlay position and overlay orientation for the second visual effect based on the position and orientation of the second object;

determine the overlay image comprising the first visual effect and the second visual effect, wherein the first visual effect is placed within the overlay image according to the overlay position and overlay orientation for the first visual effect and the second visual effect is placed within the overlay image according to the overlay position and overlay orientation for the second visual effect;

effectuate presentation of the overlay image on the display so that the first visual effect appears to augment the appearance of the first object and the second visual effect appears to augment the appearance of the second object;

determine an interaction between the first visual effect and the second visual effect based on the relative orientation between the first object and the second object;

obtain user input, the user input indicating a set of controls for the first visual effect, the set of controls including a first control defining a first action for the first visual effect; and

modify the first visual effect to simulate the first visual effect executing an action corresponding to the user input.

20. The system of claim 19 , wherein the interaction between the first visual effect and the second visual effect are determined further based on the user input.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2026
From: DISNEY ENTERPRISES, INC.
To: ADEIA MEDIA HOLDINGS INC.
Reel/Frame 075575/0145 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2016
From: REAGAN, RICHARD; MISTRY, SAGAR; ALLISON, NATHAN
To: DISNEY ENTERPRISES, INC.
Reel/Frame 041198/0594 →