IP Library Granted Patent US 9,324,327
Granted Patent B2
US 9,324,327 · App. 14/694,878 · Granted Apr 26, 2016

Spoken control for user construction of complex behaviors

Inventors: Farzad Ehsani (Sunnyvale, CA); Silke Maren Witt-Ehsani (Sunnyvale, CA); Demitrios Master (Cupertino, CA)
Assignee: NANT HOLDINGS IP, LLC
G10L17/22G06F3/167G10L15/063H04M1/72563H04M1/72566H04M1/72569H04M1/72572H04M2250/12H04M2250/74
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,324,327
App. No.
14/694,878
Granted
Apr 26, 2016
Kind
B2
Abstract

A device interface system is presented. Contemplated device interfaces allow for construction of complex device behaviors by aggregating device functions. The behaviors are triggered based on conditions derived from environmental data about the device.

Claims (35)

1. A virtual assistant device comprising:

a memory;

at least one processor;

a dialog interface including at least one sensor and configured to:

accept a digital representation of a dialog interaction with a user via the at least sensor; and

derive an interpretation of the dialog interaction from signal characteristics of the digital representation; and

a behavior triggering module comprising software instruction stored in the memory and that configures the at least one processor to:

receive the interpretation from the dialog interface;

determine if the interpretation from dialog interface has sufficient information to construct a future device behavior;

instruct the dialog interface to construct a query to be presented to the user to collect additional information when it is determined that the interpretation does not have sufficient information;

identify a set of primitive device functions from a device function database based on the interpretation;

construct a future device behavior from the set of primitive device functions and the interpretation;

generate a trigger for the future device behavior as a function of the future device behavior and a device state associated with a target device;

query the device state associated with a target device to determine satisfaction of the trigger; and

configure the target device to exhibit the future device behavior upon satisfaction of the trigger.

2. The device of claim 1 , wherein the digital representation comprises a representation of a spoken utterance.

3. The device of claim 2 , wherein the digital representation comprise at least one of the following representations from the spoken utterance: a word, a token, a syntax, a modulation, a frequency, a tone, and an accent.

4. The device of claim 1 , wherein the digital representation comprises a representation of at least one of the following input signals: haptic data, tactile data, motion data, gesture data, and location data.

5. The device of claim 1 , wherein the interpretation comprises a set of key-value pairs.

6. The device of claim 1 , wherein the interpretation comprises a concept identifier.

7. The device of claim 1 , wherein the behavior triggering module further configures the processor to:

identify missing pieces of information with respect to the future device behavior; and

cause the dialog interface to construct a query for the missing pieces of information from the user.

8. The device of claim 1 , wherein the trigger comprises a primary trigger.

9. The device of claim 1 , wherein the trigger comprises an optional condition.

10. The device of claim 1 , wherein the behavior triggering module further configures the processor to query the device state at regular time intervals.

11. The device of claim 1 , wherein the device state comprises a past device state.

12. The device of claim 1 , wherein the device state comprises a further device state.

13. The device of claim 1 , wherein the device state includes at least one of the following at attributes: a location, a time, a battery level, a ringer mode, a ringer volume, a device environment attribute, a temperature, and a change in location.

14. The device of claim 1 , wherein the future device behavior is a member of a queue of device behaviors.

15. The device of claim 1 , further comprising a cell phone that includes the memory, the at least one processor, the dialog interface, and the behavior triggering module.

16. The device of claim 1 , further comprising a server that includes the memory, the at least one processor, the dialog interface, and the behavior triggering module.

17. The device of claim 1 , wherein the future device behavior comprises at least one of the following: a device command, a reservation, a temperature change, and a multimodal interaction.

18. The device of claim 1 , wherein the behavior triggering module further configures the processor to resolve ambiguities of a future device behavior based on an interaction history stored in an interaction history database.

19. The device of claim 1 , wherein the target device comprises the virtual assistant device.

Assignments (3)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 14, 2016
From: FLUENTIAL, LLC
To: NANT HOLDINGS IP, LLC
Reel/Frame 037489/0935 →
NUNC PRO TUNC ASSIGNMENT Recorded Jan 13, 2016
From: EHSANI, FARZAD; MASTER, DEMITRIOS
To: FLUENTIAL, LLC
Reel/Frame 037474/0147 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2016
From: WITT-EHSANI, SILKE MAREN
To: FLUENTIAL, LLC
Reel/Frame 037457/0018 →
Continuity (3)
Continuation 13780645 · Feb 28, 2013
Provisional Application 61604873 · Feb 29, 2012
Related Publication 20150228283A1 · Aug 13, 2015