IP Library Granted Patent US 9,483,876
Granted Patent B2
US 9,483,876 · App. 15/017,211 · Granted Nov 1, 2016

Augmentation of elements in a data content

Inventors: Fabrizio Polo (Boulder, CO); Skylar Castator-Smith (Boulder, CO); Adam Wilson (Longmont, CO); Brian Smith (Longmont, CO); Patrick Martin (Arvada, CO); Brandon Dorris (Erie, CO)
Assignee: Sphero, Inc.
G06T19/006G06F3/041
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,483,876
App. No.
15/017,211
Granted
Nov 1, 2016
Kind
B2
Abstract

A computing device can augment video content by receiving video content from an image capturing device and detecting and tracking a self-propelled device in the video content. The computing device can display a plurality of augmented reality elements selectable to augment the self-propelled device and receive a user selection of one of the plurality of augmented reality elements to augment the self-propelled device. The computing device may then augment the self-propelled device in the video content by superimposing the selected augmented reality element over the self-propelled device as the self-propelled device moves.

Claims (64)

1. A mobile computing device comprising:

a touch-sensitive display;

one or more processors; and

one or more memory resources storing instructions that, when executed by the one or more processors, cause the mobile computing device to:

receive video content from an image capturing device;

detect and track a self-propelled device in the video content;

display, on the touch-sensitive display, a plurality of augmented reality elements selectable to augment the self-propelled device;

receive a user selection of one of the plurality of augmented reality elements to augment the self-propelled device; and

augment the self-propelled device in the video content by superimposing the selected augmented reality element over the self-propelled device as the self-propelled device moves.

2. The mobile computing device of claim 1 , wherein the executed instructions further cause the mobile computing device to:

receive real-time data from the self-propelled device; and

provide an augmentation tool on the touch-sensitive display to enable a user of the mobile computing device to augment the self-propelled device in real time.

3. The mobile computing device of claim 2 , wherein the real-time data received from the self-propelled device comprises one or more of orientation data, temperature data, or power level data of the self-propelled device.

4. The mobile computing device of claim 3 , wherein the selected augmented reality element for the self-propelled device visually represents the real-time data received from the self-propelled device.

5. The mobile computing device of claim 1 , wherein the executed instructions further cause the mobile computing device to:

store the video content to enable a user of the mobile computing device to augment the stored video content after capture.

6. The mobile computing device of claim 1 , wherein the executed instructions further cause the mobile computing device to:

provide an interface feature on the touch-sensitive display to enable a user of the mobile computing device to share the video content, including the augmented self-propelled device, with a number of other users.

7. The mobile computing device of claim 1 , wherein the executed instructions further cause the mobile computing device to:

identify a plurality of elements in the video content;

generate content metadata corresponding to each of the plurality of elements;

using the content metadata, associate each of the plurality of elements with a number of corresponding augmented reality elements;

provide an augmentation tool on the touch-sensitive display to enable a user to select a respective augmented reality element for each of the plurality of elements; and

augment the video content to include the selected respective augmented element for each of the plurality of elements.

8. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a mobile computing device, cause the mobile computing device to:

receive video content from an image capturing device;

detect and track a self-propelled device in the video content;

display, on a touch-sensitive display, a plurality of augmented reality elements selectable to augment the self-propelled device;

receive a user selection of one of the plurality of augmented reality elements to augment the self-propelled device; and

augment the self-propelled device in the video content by superimposing the selected augmented reality element over the self-propelled device as the self-propelled device moves.

9. The non-transitory computer-readable medium of claim 8 , wherein the executed instructions further cause the mobile computing device to:

receive real-time data from the self-propelled device; and

provide an augmentation tool on the touch-sensitive display to enable a user of the mobile computing device to augment the self-propelled device in real time.

10. The non-transitory computer-readable medium of claim 9 , wherein the real-time data received from the self-propelled device comprises one or more of orientation data, temperature data, or power level data of the self-propelled device.

11. The non-transitory computer-readable medium of claim 10 , wherein the selected augmented reality element for the self-propelled device visually represents the real-time data received from the self-propelled device.

12. The non-transitory computer-readable medium of claim 8 , wherein the executed instructions further cause the mobile computing device to:

store the video content to enable a user of the mobile computing device to augment the stored video content after capture.

13. The non-transitory computer-readable medium of claim 8 , wherein the executed instructions further cause the mobile computing device to:

provide an interface feature on the touch-sensitive display to enable a user of the mobile computing device to share the video content, including the augmented self-propelled device, with a number of other users.

14. The non-transitory computer-readable medium of claim 8 , wherein the executed instructions further cause the mobile computing device to:

identify a plurality of elements in the video content;

generate content metadata corresponding to each of the plurality of elements;

using the content metadata, associate each of the plurality of elements with a number of corresponding augmented reality elements;

provide an augmentation tool on the touch-sensitive display to enable a user to select a respective augmented reality element for each of the plurality of elements; and

augment the video content to include the selected respective augmented element for each of the plurality of elements.

15. A computer-implemented method of augmenting video content, the method being performed by one or more processors of a mobile computing device and comprising:

receiving video content from an image capturing device;

detecting and tracking a self-propelled device in the video content;

displaying, on a touch-sensitive display, a plurality of augmented reality elements selectable to augment the self-propelled device;

receiving a user selection of one of the plurality of augmented reality elements to augment the self-propelled device; and

augmenting the self-propelled device in the video content by superimposing the selected augmented reality element over the self-propelled device as the self-propelled device moves.

16. The method of claim 15 further comprising:

receiving real-time data from the self-propelled device; and

providing an augmentation tool on the touch-sensitive display to enable a user of the mobile computing device to augment the self-propelled device in real time.

17. The method of claim 16 , wherein the real-time data received from the self-propelled device comprises one or more of orientation data, temperature data, or power level data of the self-propelled device.

18. The method of claim 17 , wherein the selected augmented reality element for the self-propelled device visually represents the real-time data received from the self-propelled device.

19. The method of claim 15 , further comprising:

providing an interface feature on the touch-sensitive display to enable a user of the mobile computing device to share the video content, including the augmented self-propelled device, with a number of other users.

20. The method of claim 15 , further comprising:

identifying a plurality of elements in the video content;

generating content metadata corresponding to each of the plurality of elements;

using the content metadata, associating each of the plurality of elements with a number of corresponding augmented reality elements;

providing an augmentation tool on the touch-sensitive display to enable a user to select a respective augmented reality element for each of the plurality of elements; and

augmenting the video content to include the selected respective augmented element for each of the plurality of elements.

Assignments (3)
SECURITY INTEREST Recorded May 11, 2020
From: SPHERO, INC.
To: SILICON VALLEY BANK
Reel/Frame 052623/0705 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 29, 2016
From: POLO, FABRIZIO; CASTATOR-SMITH, SKYLAR; WILSON, ADAM; SMITH, BRIAN; MARTIN, PATRICK; DORRIS, BRANDON
To: ORBOTIX, INC.
Reel/Frame 037849/0286 →
CHANGE OF NAME Recorded Feb 29, 2016
From: ORBOTIX, INC.
To: SPHERO, INC.
Reel/Frame 037952/0483 →
Continuity (5)
Continuation 14148541 · Jan 6, 2014
Continuation In Part 13894247 · May 14, 2013
Continuation In Part 14054636 · Oct 15, 2013
Provisional Application 61646716 · May 14, 2012
Related Publication 20160155272A1 · Jun 2, 2016