IP Library Granted Patent US 10,192,310
Granted Patent B2
US 10,192,310 · App. 15/010,337 · Granted Jan 29, 2019

Operating a computing device by detecting rounded objects in an image

Inventor: Fabrizio Polo (Boulder, CO)
Assignee: Sphero, Inc.
G06T7/004G06K9/3241G06K9/46G06T7/20G06T7/246G06T7/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,192,310
App. No.
15/010,337
Granted
Jan 29, 2019
Kind
B2
Abstract

A method is disclosed for operating a computing device. One or more images of a scene captured by an image capturing device of the computing device is processed. The scene includes an object of interest that is in motion and that has a rounded shape. The one or more images are processed by detecting a rounded object that corresponds to the object of interest. Position information is determined based on a relative position of the rounded object in the one or more images. One or more processes are implemented that utilize the position information determined from the relative position of the rounded object.

Claims (48)

1. A computing device comprising:

an image capturing device;

a display screen;

one or more processors; and

one or more memory resources storing instructions that, when executed by the one or more processors, cause the computing device to:

capture image data using the image capturing device;

process the image data to identify a brightness gradient indicating a spherical object, wherein the brightness gradient corresponds to a vector having a direction corresponding to an increased brightness level of a plurality of pixels; and

identify a center of the spherical object in the image data in part by marking a point with a highest brightness level along the brightness gradient.

2. The computing device of claim 1 , wherein the spherical object comprises a spherical self-propelled device under operational control of the computing device.

3. The computing device of claim 1 , wherein the executed instructions further cause the computing device to:

dynamically overlay a graphic element on the spherical object in the image data.

4. The computing device of claim 3 , wherein the executed instructions further cause the computing device to:

perform dimensional analysis to dynamically determine a distance from the spherical object to the computing device; and

dynamically adjust a size of the graphic element based on the distance.

5. The computing device of claim 2 , wherein the executed instructions further cause the computing device to:

receive a user input on the display screen corresponding to a target location in the image data; and

in response to receiving the user input, causing the self-propelled device to move to the target location.

6. The computing device of claim 1 , wherein the executed instructions cause the computing device to identify the brightness gradient by applying an image filter to the image data.

7. The computing device of claim 6 , wherein the image filter comprises a grey-scale filter.

8. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a computing device, cause the computing device to:

capture image data using an image capturing device of the computing device;

process the image data to identify a brightness gradient indicating a spherical object wherein the brightness gradient corresponds to a vector having a direction corresponding to an increased brightness level of a plurality of pixels; and

identify a center of the spherical object in the image data in part by marking a point with a highest brightness level along the brightness gradient.

9. The non-transitory computer-readable medium of claim 8 , wherein the spherical object comprises a spherical self-propelled device under operational control of the computing device.

10. The non-transitory computer-readable medium of claim 8 , wherein the executed instructions further cause the computing device to:

dynamically overlay a graphic element on the spherical object in the image data.

11. The non-transitory computer-readable medium of claim 10 , wherein the executed instructions further cause the computing device to:

perform dimensional analysis to dynamically determine a distance from the spherical object to the computing device; and

dynamically adjust a size of the graphic element based on the distance.

12. The non-transitory computer-readable medium of claim 9 , wherein the executed instructions further cause the computing device to:

receive a user input on a display screen of the computing device, the user input corresponding to a target location in the image data; and

in response to receiving the user input, causing the self-propelled device to move to the target location.

13. The non-transitory computer-readable medium of claim 8 , wherein the executed instructions cause the computing device to identify the brightness gradient by applying an image filter to the image data.

14. The non-transitory computer-readable medium of claim 13 , wherein the image filter comprises a grey-scale filter.

15. A computer-implemented method of detecting objects, the method being performed by one or more processors of a computing device and comprising:

capturing image data using an image capturing device of the computing device;

processing the image data to identify a brightness gradient indicating a spherical object wherein the brightness gradient corresponds to a vector having a direction corresponding to an increased brightness level of a plurality of pixels; and

identifying a center of the spherical object in the image data in part by marking a point with a highest brightness level along the brightness gradient to track movement of the spherical object in the image data.

16. The method of claim 15 , wherein the spherical object comprises a spherical self-propelled device under operational control of the computing device.

17. The method of claim 15 , wherein the executed instructions further comprising:

dynamically overlaying a graphic element on the spherical object in the image data.

18. The method of claim 17 , further comprising:

performing dimensional analysis to dynamically determine a distance from the spherical object to the computing device; and

dynamically adjusting a size of the graphic element based on the distance.

19. The method of claim 16 , further comprising:

receiving a user input on a display screen of the computing device, the user input corresponding to a target location in the image data; and

in response to receiving the user input, causing the self-propelled device to move to the target location.

20. The method of claim 15 , wherein the one or more processors of the computing device identify the brightness gradient by applying an image filter to the image data.

Assignments (3)
SECURITY INTEREST Recorded May 11, 2020
From: SPHERO, INC.
To: SILICON VALLEY BANK
Reel/Frame 052623/0705 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2016
From: POLO, FABRIZIO
To: ORBOTIX, INC.
Reel/Frame 037813/0245 →
CHANGE OF NAME Recorded Feb 24, 2016
From: ORBOTIX, INC.
To: SPHERO, INC.
Reel/Frame 037901/0168 →
Continuity (3)
Continuation 13894247 · May 14, 2013
Provisional Application 61646716 · May 14, 2012
Related Publication 20160148367A1 · May 26, 2016