IP Library Granted Patent US 10,001,843
Granted Patent B2
US 10,001,843 · App. 15/253,799 · Granted Jun 19, 2018

Modular sensing device implementing state machine gesture interpretation

Inventors: David Hygh (Boulder, CO); Fabrizio Polo (Boulder, CO)
Assignee: Sphero, Inc.
G06F3/017A63F13/21A63F13/211A63F13/235A63F13/28A63F13/32A63H17/26A63H23/04A63H27/00A63H27/12A63H30/04A63H33/005G05D1/0016G06F1/163G06F3/016G06F3/02G06F3/038G06F3/0346G06F3/0485G06F3/167G08B7/06G08C17/02H04W4/008H04W8/005A63F2300/405A63F2300/8082G05D2201/0214G06F3/04883G08C2201/32G08C2201/92H04L12/2803H04W84/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,001,843
App. No.
15/253,799
Granted
Jun 19, 2018
Kind
B2
Abstract

A modular sensing device can include an inertial measurement unit to generate sensor data corresponding to user gestures performed by a user, a mode selector enabling the user to select a mode of the modular sensing device out of a plurality of modes, and one or more output devices to generate output based on the user gestures and the selected mode. The modular sensing device can further include a controller to implement a plurality of state machines. Each state machine can be associated with a corresponding user gesture by a sensor data signature. The state machine can execute a state transition when the sensor data matches the sensor data signature. The executed state transition can cause the controller to generate a corresponding output via the one or more output devices specific to the selected mode and based on the corresponding user gesture.

Claims (29)

1. A modular sensing device comprising:

an inertial measurement unit to generate sensor data corresponding to user gestures performed by a user;

a mode selector for receiving a selection of a mode of the modular sensing device out of a plurality of modes;

one or more output devices to generate output based on the user gestures and the selected mode; and

a controller to implement a plurality of state machines, at least one state machine of the plurality of state machines being associated with a corresponding user gesture by a sensor data signature, wherein the respective state machine executes a state transition when the sensor data matches the sensor data signature, the executed state transition causing the controller to generate a corresponding output via the one or more output devices specific to the selected mode and based on the corresponding user gesture, and wherein the controller initiates a sub-mode in response to a particular user gesture, the sub-mode causing the controller to modify interpretation of the state transition for the selected mode, and wherein the modular sensing device generates the corresponding output based on the modified interpretation.

2. The modular sensing device of claim 1 , wherein the respective state machine continuously iterates based on the sensor data from the inertial measurement unit and automatically executes the state transition when the sensor data matches the sensor data signature.

3. The modular sensing device of claim 1 , wherein the modular sensing device is insertable into a wearable device, and wherein the corresponding user gesture comprises a sequence of actions performed by the user utilizing the wearable device.

4. The modular sensing device of claim 3 , wherein the sensor data signature provides the respective state machine with a threshold error tolerance for each of the sequence of actions.

5. The modular sensing device of claim 3 , wherein, for a particular iteration, the respective state machine terminates when the corresponding user gesture diverges from the sequence of actions.

6. The modular sensing device of claim 3 , wherein, for a particular iteration, the respective state machine automatically terminates if one of the set of states does not transition.

7. The modular sensing device of claim 1 , wherein the state transition of the respective state machine causes the controller to generate distinct outputs based on the selected mode.

8. The modular sensing device of claim 1 , wherein the corresponding output comprises one or more control commands enabling the user to control a remote controlled device using the modular sensing device.

9. The modular sensing device of claim 1 , wherein the one or more output devices include a haptic system, an audio system, and a visual system.

10. The modular sensing device of claim 1 , wherein the respective state machine comprises a finite set of states, one or more inputs, one or more outputs, a transition function, and an initial state.

11. The modular sensing device of claim 1 , wherein the respective state machine comprises a set of states, and wherein each state in the set of states transitions in sequential order in order to cause the state transition.

12. The modular sensing device of claim 1 , wherein the controller initiates a second mode, from the plurality of modes of the modular sensing device, when the user performs a specific user gesture.

13. The modular sensing device of claim 1 , wherein the modular sensing device is configured to be portable and insertable into at least one compatible apparatus.

14. The modular sensing device of claim 13 , wherein the at least one compatible apparatus comprises a wrist-worn device and a wielded device.

15. The modular sensing device of claim 1 , wherein each of the plurality of state machines is associated with a corresponding user gesture by a sensor data signature.

16. A method of generating outputs based on user gestures, the method being performed by a modular sensing device and comprising:

receiving a mode selection input to select a mode from a plurality of selectable modes;

in response to the mode selection input, utilize a plurality of state machines to interpret user gestures in accordance with the selected mode, at least one state machine of the plurality of state machines being associated with a corresponding user gesture by a sensor data signature, wherein the respective state machine executes a state transition when the sensor data matches the sensor data signature;

in response to the executed state transition, generating a final state report corresponding to the selected mode and based on the corresponding user gesture;

modifying the interpretation of the final state report; and

generating the corresponding output via one or more output devices of the modular sensing device based on the modified interpretation.

17. The method of claim 16 , wherein the selected mode comprises a drive mode, the drive mode enabling the user to control a self-propelled device with the modular sensing device.

18. The method of claim 16 , wherein the selected mode comprises a smart home control mode, the smart home control mode enabling the user to control at least one smart home device using the modular sensing device.

19. The method of claim 16 , wherein the selected mode comprises a gaming mode, the gaming mode causing the modular sensing device to output task-oriented instructions for the user to perform in connection with a game.

20. The method of claim 16 , wherein the one or more output devices include a haptic driver, one or more light elements, and one or more audio elements.

Assignments (2)
SECURITY INTEREST Recorded May 11, 2020
From: SPHERO, INC.
To: SILICON VALLEY BANK
Reel/Frame 052623/0705 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2017
From: HYGH, DAVID; POLO, FABRIZIO
To: SPHERO, INC.
Reel/Frame 041281/0502 →
Continuity (3)
Provisional Application 62274514 · Jan 4, 2016
Provisional Application 62346216 · Jun 6, 2016
Related Publication 20170192518A1 · Jul 6, 2017