IP Library Granted Patent US 10,248,118
Granted Patent B2
US 10,248,118 · App. 14/933,827 · Granted Apr 2, 2019

Remotely controlling a self-propelled device in a virtualized environment

Inventors: Ian Bernstein (Boulder, CO); Adam Wilson (Longmont, CO); Jonathan Carroll (Boulder, CO); Fabrizio Polo (Boulder, CO)
Assignee: Sphero, Inc.
G05D1/0038A63H30/04A63H33/005B62D63/025G05D1/0016G05D1/0044G06F17/00G05D1/027G05D1/0259G05D1/0278G05D2201/0214Y10S901/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,248,118
App. No.
14/933,827
Granted
Apr 2, 2019
Kind
B2
Abstract

A computing device operating as a controller can obtain image data from a camera component. The computing device can determine a location of the self-propelled device relative to the camera based on the image data. A virtual content may be generated on the computing device based at least in part on the location of the self-propelled device.

Claims (18)

1. A computer-implemented method for operating a computing device, the method comprising:

generating image data by a camera component of the computing device;

programmatically detecting, by the computing device, from the image data, a location of a self-propelled device relative to the computing device;

receiving, at the computing device, input from the self-propelled device, the input including sensor information that is obtained on the self-propelled device; and

generating, on the computing device, content based on the location of the self-propelled device as the self-propelled device moves, wherein the self-propelled device is remote from the computing device.

2. The computer-implemented method of claim 1 , wherein programmatically detecting the location of the self-propelled device comprises image processing the image data.

3. The computer-implemented method of claim 2 , wherein image processing the image data comprises utilizing an object-type specific detector to locate at least one of a predetermined shape, a predetermined color, a predetermined visual code, and a predetermined structural feature.

4. The computer-implemented method of claim 1 , further comprising programmatically detecting, from the image data generated by the camera component of the computing device, a location of an object relative to at least one of the computing device and the self-propelled device.

5. The computer-implemented method of claim 1 , wherein the sensor information comprises information obtained from at least one of a gyroscope, an inertial mass unit, a GPS, an accelerometer, a light sensor, and a proximity sensor located on the self-propelled device.

6. The computer-implemented method of claim 1 , further comprising displaying the generated content on the computing device.

7. The computer-implemented method of claim 6 , wherein the generated content comprises a map.

8. The computer-implemented method of claim 6 , wherein the generated content comprises a depiction of a physical space in which the self-propelled device is located.

9. The computer-implemented method of claim 6 , wherein the generated content corresponds to a virtual environment.

10. The computer-implemented method of claim 9 , wherein the generated content comprises a graphic form of the self-propelled device.

11. The computer-implemented method of claim 1 , further comprising:

identifying a landmark from the image data generated by the camera component of the computing device; and

translating the landmark into an object, wherein the generated content comprises a virtual environment and the object.

12. The computer-implemented method of claim 11 , further comprising displaying the generated content on the computing device.

Assignments (3)
SECURITY INTEREST Recorded May 11, 2020
From: SPHERO, INC.
To: SILICON VALLEY BANK
Reel/Frame 052623/0705 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2015
From: BERNSTEIN, IAN; WILSON, ADAM; CARROLL, JONATHAN; POLO, FABRIZIO
To: ORBOTIX, INC.
Reel/Frame 036992/0740 →
CHANGE OF NAME Recorded Nov 9, 2015
From: ORBOTIX, INC.
To: SPHERO, INC.
Reel/Frame 037072/0258 →
Continuity (6)
Continuation 13766455 · Feb 13, 2013
Continuation In Part 13342853 · Jan 3, 2012
Provisional Application 61430023 · Jan 5, 2011
Provisional Application 61430083 · Jan 5, 2011
Provisional Application 61553923 · Oct 31, 2011
Related Publication 20160054734A1 · Feb 25, 2016