IP Library Granted Patent US 10,809,724
Granted Patent B2
US 10,809,724 · App. 16/223,220 · Granted Oct 20, 2020

Multi-purposed self-propelled device

Inventors: Paul Berberian (Boulder, CO); Ian Bernstein (Boulder, CO); Adam Wilson (Longmont, CO); Kevin Hemmings (Broomfield, CO); Ross MacGregor (Erie, CO)
Assignee: Sphero, Inc.
G05D1/0088A63H30/04A63H33/005B62D61/00G01S19/13G05D1/0022G05D1/0038G05D1/027G05D1/0278G05D1/0259G05D2201/0214Y10S901/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,809,724
App. No.
16/223,220
Granted
Oct 20, 2020
Kind
B2
Abstract

A self-propelled device can include at least a wireless interface, a housing, a propulsion mechanism, and a camera. Using the camera, the self-propelled device can generate a video feed and transmit the video feed to a controller device via the wireless interface. The self-propelled device can receive an input from the controller device indicating an object or location in the video feed. In response to the input, the self-propelled device can initiate an autonomous mode to autonomously operate the propulsion mechanism to propel the self-propelled device towards the object or location indicated in the video feed.

Claims (41)

1. A method of operating a self-propelled device comprising:

generating a video feed from a camera disposed within a housing of the self-propelled device;

transmitting the video feed to a controller device via a wireless interface of the self-propelled device, wherein the self-propelled device comprises a plurality of operation modes comprising a controlled mode, an autonomous mode, and touch and drive mode;

receiving an input from the controller device indicating a location in the video feed; and

in response to the input, initiating an autonomous mode to autonomously operate a propulsion mechanism of the self-propelled device to propel the self-propelled device to a physical location point that corresponds to the location in the video feed based upon one or more control parameters programmatically generated on the self-propelled device, wherein the propulsion mechanism is disposed within the housing and includes a motor and a wheel engaged with an inner surface of the housing to propel the housing.

2. The method of claim 1 , further comprising when in the autonomous mode:

detecting one or more obstacles in the path of propulsion; and

maneuvering around the one or more obstacles by changing operation of the propulsion mechanism.

3. The method of claim 1 , further comprising initiating a control mode to (i) receive command inputs from the controller device, and (ii) operate the propulsion mechanism to accelerate and maneuver the self-propelled device based on the input.

4. The method of claim 1 , further comprising:

receiving feedback from an inertial measurement unit of the self-propelled device; and

based on the feedback, dynamically stabile at least one of a pitch, a roll, and a yaw of the self-propelled device via the propulsion mechanism.

5. The method of claim 1 , further comprising when in the autonomous mode, maintaining an orientation awareness of the self-propelled device in relation to an initial frame of reference.

6. The method of claim 1 , further comprising operating a door mechanism on the housing.

7. The method of claim 1 , further comprising stabilizing the camera within the housing.

8. A method of operating a self-propelled device comprising;

receiving at a mobile computing device an image from a camera disposed within the self-propelled device, wherein the image provides a field of view of the camera;

displaying the image on a touch-sensitive display of the mobile computing device;

receiving, on the touch-sensitive display, a user selection of a location within the field of view of the camera;

based on the user selection, generating a command signal to be transmitted to the self-propelled device, wherein the command signal includes instructions for causing the self-propelled device to autonomously generate one or more control parameters for a propulsion mechanism disposed within the self-propelled device to maneuver the self-propelled device to the location; and

sending the command signal to the self-propelled device.

9. The method of claim 8 , further comprising:

determining a position of the location in the field of view based on a first reference frame of the field of view as displayed on the mobile computing device; and

mapping the position of the location point on a second reference frame corresponding to the location point relative to the self-propelled device.

10. The method of claim 9 , wherein the command signal is generated to include instructions for maneuvering the self-propelled device based solely on the second reference frame.

11. The method of claim 8 , wherein the image is a live video feed provided from the camera.

12. The method of claim 11 , wherein generating the command signal is performed dynamically in conjunction with receiving the live video feed.

13. The method of claim 8 , wherein the command signal further includes opening instructions for a door mechanism on the self-propelled device.

14. A self-propelled device comprising:

a housing comprising an inner surface and defining a payload space;

a carrier disposed within the housing;

a propulsion mechanism disposed within the housing and supported by the carrier, wherein the propulsion mechanism comprises a motor and a wheel engaged with the inner surface of the housing to propel the housing;

a controller for self-propelled device comprises a plurality of operation modes comprising a controlled mode, an autonomous mode in which controls are programmatically generated on the self-propelled device, and touch and drive mode, the controller providing instructions to the propulsion mechanism based upon a determined operation mode;

a camera supported on the carrier and at least partially disposed within the payload space of the housing; and

a wireless interface configured to transmit one or more images from the camera to a remote device.

15. The self-propelled device of claim 14 , wherein the camera is a video camera and the one or more images is a video feed.

16. The self-propelled device of claim 14 , wherein the housing is at least partially transparent.

17. The self-propelled device of claim 14 , further comprising one or more of a motion sensor, an infrared sensor, a chemical sensor, a biological sensor, an explosive, and a listening device disposed within the payload space.

18. The self-propelled device of claim 14 , wherein the housing further comprises at least two shells configured to at least partially open so as to expose the payload space.

19. The self-propelled device of claim 14 , wherein the camera is mounted on a biasing mechanism.

20. The self-propelled device of claim 14 , further comprising a protective cover for the housing.

Assignments (1)
SECURITY INTEREST Recorded May 11, 2020
From: SPHERO, INC.
To: SILICON VALLEY BANK
Reel/Frame 052623/0705 →
Continuity (9)
Continuation 15146631 · May 4, 2016
Division 14271203 · May 6, 2014
Continuation In Part 14035841 · Sep 24, 2013
Continuation 13342853 · Jan 3, 2012
Provisional Application 61820109 · May 6, 2013
Provisional Application 61553923 · Oct 31, 2011
Provisional Application 61430023 · Jan 5, 2011
Provisional Application 61430083 · Jan 5, 2011
Related Publication 20190369617A1 · Dec 5, 2019