IP Library Granted Patent US 10,275,036
Granted Patent B2
US 10,275,036 · App. 15/253,778 · Granted Apr 30, 2019

Modular sensing device for controlling a self-propelled device

Inventors: David Hygh (Boulder, CO); Jeffrey Wiencrot (Boulder, CO); Ian H. Bernstein (Boulder, CO)
Assignee: Sphero, Inc.
G06F3/017A63F13/21A63F13/211A63F13/212A63F13/235A63F13/28A63F13/32A63H17/26A63H23/04A63H27/00A63H27/12A63H30/04A63H33/005G05D1/0016G06F1/163G06F1/1694G06F3/016G06F3/02G06F3/038G06F3/0346G06F3/0485G06F3/167G08B7/06G08C17/02H04W4/80H04W8/005A63F2300/405A63F2300/8082G05D2201/0214G06F3/04883G08C2201/32G08C2201/92H04L12/2803H04W84/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,275,036
App. No.
15/253,778
Granted
Apr 30, 2019
Kind
B2
Abstract

A wearable device can be worn by a user, and can include one or more sensors to detect user gestures performed by the user. The wearable device can further include a wireless communication module to establish a communication link with a self-propelled device, and a controller that can generate control commands based on the user gestures. The control commands may be executable to accelerate and maneuver the self-propelled device. The controller may then transmit the control commands to the self-propelled device over the communication link for execution by the self-propelled device.

Claims (38)

1. A system comprising:

a wearable device, including:

a wireless communication module to communicate the control commands to a self-propelled device;

a selectable component to enable the user to perform an initial directional calibration with the self-propelled device; and

one or more sensors, configured to be worn by a user, the wearable device generating control commands based on user gestures performed by the user utilizing the wearable device; and

a self-propelled device comprising:

a wireless communication module to wirelessly connect with the wearable device and receive the control commands from the wearable device;

an internal drive system operable to control movement of the self-propelled device; and

a control system to implement the control commands on the internal drive system to accelerate and maneuver the self-propelled device in accordance with the user gestures.

2. The system of claim 1 , wherein the wearable device comprises a wrist-worn device operable in a plurality of modes, and wherein detection of a distinct user gesture by a controller of the wearable device causes the controller to override a current mode and execute a drive mode corresponding to operative control of the self-propelled device.

3. The system of claim 1 , wherein the wearable device comprises one or more output devices, and wherein the one or more output devices include a haptic system, an audio system, and a visual system.

4. The system of claim 1 , wherein the selectable component comprises an analog button on the wrist-worn device, and wherein the initial directional calibration comprises depressing the analog button when the wrist-worn device is forward directionally aligned with the self-propelled device.

5. The system of claim 1 , wherein the wearable device further comprises an induction interface configured to establish a communication link between the wearable device and the self-propelled device once the wearable device and the self-propelled device are within inductive range.

6. The system of claim 2 , wherein the user gestures comprise (i) raising an arm, on which the wrist-worn device is attached, to accelerate the self-propelled device, (ii) lowering the arm to decelerate the self-propelled device, and (iii) performing lateral gestures with the arm to steer the self-propelled device.

7. The system of claim 6 , wherein the wearable device initially interprets the lateral gestures according to a first set of directional commands, and wherein, after the user performs a vertical arm gesture that exceeds a threshold angle, the wearable device interprets the lateral gestures according to a second set of directional commands.

8. The system of claim 7 , wherein the first set of directional commands correspond to turn commands to turn the self-propelled device, and wherein the second set of directional commands corresponds to an inverse of the turn commands triggered by the vertical arm gesture exceeding the threshold angle.

9. The system of claim 5 , wherein the communication link comprises a BLUETOOTH low energy link.

10. The system of claim 1 , wherein the one or more sensors comprises an inertial measurement unit generating raw sensor data based on the user gestures, wherein the control commands are generated by the wearable device based on the raw sensor data.

11. The system of claim 10 , wherein the wearable device further comprises:

a controller implementing a plurality of state machines, each respective state machine being associated with a sensor data signature corresponding to a specified user gesture, and wherein the respective state machine executes a state transition when the raw sensor data correlates with the sensor data signature, the state transition causing the controller to generate an associated control command executable by the self-propelled device.

12. A wearable device to be worn by a user, the wearable device comprising:

one or more sensors to detect user gestures performed by the user;

a calibration feature that is capable of generating a calibration signal to calibrate a self-propelled device, wherein the calibration signal includes a command to initiate a spin by the self-propelled device;

a wireless communication module to establish a communication link with the self-propelled device; and

a controller to:

generate control commands based on the user gestures, the control commands being executable to accelerate and maneuver the self-propelled device; and

transmit the control commands to the self-propelled device over the communication link.

13. The wearable device of claim 12 , wherein the wearable device is a wrist-worn device, and wherein the user gestures comprise (i) raising an arm, on which the wrist-worn device is attached, to accelerate the self-propelled device, (ii) lowering the arm to decelerate the self-propelled device, and (iii) performing lateral gestures with the arm to steer the self-propelled device.

14. The wearable device of claim 13 , wherein the controller initially interprets the lateral gestures according to a first set of directional commands, and wherein, after the user performs a vertical arm gesture that exceeds a threshold angle, the wearable device interprets the lateral gestures according to a second set of directional commands.

15. The wearable device of claim 14 , wherein the first set of directional commands correspond to turn commands to turn the self-propelled device, and wherein the second set of directional commands corresponds to an inverse of the turn commands triggered by the vertical arm gesture exceeding the threshold angle.

16. The wearable device of claim 12 , wherein the communication link comprises a BLUETOOTH low energy link.

17. The wearable device of claim 12 , wherein the one or more sensors comprise an inertial measurement unit generating raw sensor data based on the user gestures, wherein the control commands are generated by the wearable device based on the raw sensor data.

18. The wearable device of claim 16 , wherein the controller implements a plurality of state machines, each respective state machine being associated with a sensor data signature corresponding to a specified user gesture, and wherein the respective state machine executes a state transition when the raw sensor data correlates with the sensor data signature, the state transition causing the controller to generate an associated control command executable by the self-propelled device.

19. A computer-implemented method of controlling a self-propelled device, the method being performed by one or more processors of a wearable device and comprising:

sending a calibration signal to control the self-propelled device, wherein the calibration signal includes a command to initiate the spin in a self-propelled device;

detecting, using one or more sensors, user gestures performed by a user wearing the wearable device;

based on user gestures, generating control commands executable to accelerate and maneuver the self-propelled device; and

transmitting the control commands to the self-propelled device over a wireless communication link.

Assignments (2)
SECURITY INTEREST Recorded May 11, 2020
From: SPHERO, INC.
To: SILICON VALLEY BANK
Reel/Frame 052623/0705 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2017
From: HYGH, DAVID; WIENCROT, JEFFREY; BERNSTEIN, IAN H.
To: SPHERO, INC.
Reel/Frame 041254/0385 →
Continuity (3)
Provisional Application 62274514 · Jan 4, 2016
Provisional Application 62346216 · Jun 6, 2016
Related Publication 20170192517A1 · Jul 6, 2017