IP Library › Granted Patent US 10,587,834
Granted Patent B2
US 10,587,834 · App. 15/451,082 · Granted Mar 10, 2020

Systems and methods for tracking objects for augmented reality

Inventors: Michael P. Goslin (Burbank, CA); Sebastian Janisz (Burbank, CA); Matthew Ryan (Burbank, CA); Katherine M. Bassett (Burbank, CA); Joseph Olson (Burbank, CA)
Assignee: Disney Enterprises, Inc.
H04N5/44504G02B27/017G06T19/006H04N5/2224G02B2027/014G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,587,834
App. No.
15/451,082
Granted
Mar 10, 2020
Kind
B2
Abstract

This disclosure relates to systems and methods for tracking objects for augmented reality. Positions and/or orientations of objects, light sources, and/or visual markers may be determined. Visual effects may be determined based on the objects, lights sources, and/or visual markers. Overlay positions and/or overlay orientations for the visual effects may be determined based on the positions and orientations of the objects, light sources, and/or visual markers. An overlay image including the visual effects may be determined and displayed.

Claims (56)

1. A system to augment an appearance of an object, the system comprising:

a display configured to display an overlay image;

an image sensor configured to generate visual output signals conveying visual information within a field of view of the image sensor; and

one or more processors configured by non-transitory machine-readable instructions to:

determine a position of the object based on the visual output signals, the object carrying a patterned light source, the patterned light source indicating a reference point for the object that facilitates the determination of the position of the object, wherein the patterned light source emits a dynamic light pattern;

responsive to detecting light surrounding the patterned light source that is similar in color and/or pattern of the dynamic light pattern, change the dynamic light pattern so that the dynamic light pattern is no longer similar in color and/or pattern to the light surrounding the patterned light source;

determine an overlay position for a visual effect based on the position of the object;

determine the overlay image comprising the visual effect, wherein the visual effect is placed within the overlay image according to the overlay position for the visual effect; and

effectuate displaying of the overlay image on the display so that the visual effect appears to augment the appearance of the object.

2. The system of claim 1 , wherein the patterned light source includes one or more light emitting diodes.

3. The system of claim 1 , wherein the patterned light source is configured to generate multiple colors of light.

4. The system of claim 1 , wherein the patterned light source includes a static light pattern.

5. The system of claim 1 , wherein the dynamic light pattern is a light pattern that changes over time during operation of the patterned light source.

6. The system of claim 1 , wherein:

the object carries an orientation sensor, the orientation sensor configured to generate orientation output signals conveying orientation information of the object;

the one or more processors are further configured by machine readable instructions to:

determine an orientation of the object based on the orientation output signals; and

determine an overlay orientation for the visual effect based on the orientation of the object,

wherein the visual effect is further placed within the overlay image according to the overlay orientation for the visual effect.

7. The system of claim 1 , further comprising:

an orientation sensor carried by the display, the orientation sensor configured to generate orientation output signals conveying orientation information of the display;

the one or more processors are further configured by machine readable instructions to:

determine an orientation of the display based on the orientation output signals; and

determine an overlay orientation for the visual effect based on the orientation of the display,

wherein the visual effect is further placed within the overlay image according to the overlay orientation for the visual effect.

8. The system of claim 1 , wherein the visual effect includes an image and/or a video.

9. A method for augmenting an appearance of an object, the method comprising:

generating visual output signals conveying visual information within a field of view of an image sensor;

determining a position of the object based on the visual output signals, the object carrying a patterned light source, the patterned light source indicating a reference point for the object that facilitates the determination of the position of the object, wherein the patterned light source emits a dynamic light pattern;

responsive to detecting light surrounding the patterned light source that is similar in color and/or pattern of the dynamic light pattern, changing the dynamic light pattern so that the dynamic light pattern is no longer similar in color and/or pattern to the light surrounding the patterned light source;

determining an overlay position for a visual effect based on the position of the object;

determining an overlay image comprising the visual effect, wherein the visual effect is placed within the overlay image according to the overlay position for the visual effect; and

effectuating displaying of the overlay image on a display so that the visual effect appears to augment the appearance of the object.

10. The method of claim 9 , wherein the patterned light source includes one or more light emitting diodes.

11. The method of claim 9 , wherein the patterned light source is configured to generate multiple colors of light.

12. The method of claim 9 , wherein the patterned light source includes a static light pattern.

13. The method of claim 9 , wherein the dynamic light pattern is a light pattern that changes over time during operation of the patterned light source.

14. The method of claim 9 , wherein the object carries an orientation sensor, the orientation sensor configured to generate orientation output signals conveying orientation information of the object, the method further comprising:

determining an orientation of the object based on the orientation output signals; and

determining an overlay orientation for the visual effect based on the orientation of the object,

wherein the visual effect is further placed within the overlay image according to the overlay orientation for the visual effect.

15. The method of claim 9 , wherein the display carries an orientation sensor, the orientation sensor configured to generate orientation output signals conveying orientation information of the display, the method further comprising:

determining an orientation of the display based on the orientation output signals; and

determining an overlay orientation for the visual effect based on the orientation of the display,

wherein the visual effect is further placed within the overlay image according to the overlay orientation for the visual effect.

16. The method of claim 9 , wherein the visual effect includes an image and/or a video.

17. A system for augmenting an appearance of an object, the system comprising:

a display configured to display an overlay image;

an image sensor configured to generate visual output signals conveying visual information within a field of view of the image sensor; and

one or more processors configured by non-transitory machine-readable instructions to:

determine a position of the object based on the visual output signals, the object carrying a patterned light source emitting a dynamic light pattern, the patterned light source indicating a reference point for the object that facilitates the determination of the position of the object;

responsive to detecting light surrounding the patterned light source that is similar in color and/or pattern of the dynamic light pattern, change the dynamic light pattern so that the dynamic light pattern is no longer similar in color and/or pattern to the light surrounding the patterned light source;

determine an overlay position for a visual effect based on the position of the object;

determine the overlay image comprising the visual effect, wherein the visual effect is placed within the overlay image according to the overlay position for the visual effect; and

effectuate displaying of the overlay image on the display so that the visual effect appears to augment the appearance of the object.

18. The system of claim 17 , wherein the patterned light source includes one or more light emitting diodes.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2017
From: GOSLIN, MICHAEL P.; JANISZ, SEBASTIAN; RYAN, MATTHEW; BASSETT, KATHERINE M.; OLSON, JOSEPH
To: DISNEY ENTERPRISES, INC.
Reel/Frame 041478/0227 →
Continuity (2)
Provisional Application 62304893 · Mar 7, 2016
Related Publication 20170257594A1 · Sep 7, 2017