IP Library Granted Patent US 10,042,603
Granted Patent B2
US 10,042,603 · App. 14/028,021 · Granted Aug 7, 2018

Context aware service provision method and apparatus of user device

Inventors: Jooyoon Bae (Seoul, KR); Minjeong Ko (Suwon-si, KR); Sungsoo Kim (Bucheon-si, KR); Jinsung Kim (Seoul, KR); Hwakyung Kim (Seoul, KR); Jinha Jun (Seoul, KR)
Assignee: Samsung Electronics Co., Ltd.
G06F3/167H04M1/72569H04M2250/74
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,042,603
App. No.
14/028,021
Granted
Aug 7, 2018
Kind
B2
Abstract

A context aware service provision method and apparatus for recognizing the user context and executing an action corresponding to the user context according to a rule defined by the user and feeding back the execution result to the user interactively are provided. The method for providing a context-aware service includes receiving a user input, the user input being at least one of a text input and a speech input, identifying a rule including a condition and an action corresponding to the condition based on the received user input, activating the rule to detect a context which corresponds to the condition of the rule, and executing, when the context is detected, the action corresponding to the condition.

Claims (104)

1. A method for providing a context-aware service of a user device, the method comprising:

receiving, by an input unit of the user device, a first user input according to a guidance provided by the user device, the first user input being at least one of a natural language-based text input or a natural language-based speech input;

in response to receiving the first user input, parsing the received first user input to extract and identifying a condition, an action corresponding to the condition, and a command, wherein the action is a function executable by one or more applications of the user device;

defining a rule including the condition and the action corresponding to the condition based on the parsed first user input;

mapping the command to the rule in response to the defining of the rule;

storing the rule and the mapped command in at least one of the user device or a server;

receiving, by the input unit, a second user input, wherein the second user input is one of a natural language-based text input or a natural language based speech input; and

in response to receiving the second user input:

determining whether the second user input corresponds to the command;

activating, if the second user input corresponds to the command, the rule to detect, by a sensor of the user device, a context of the user device; and

executing, if the detected context corresponds to the condition of the rule, the action corresponding to the condition.

2. The method of claim 1 ,

wherein the context comprises a change in the user device, and

wherein the change in the user device corresponds to at least one of a posture change or a location change of the user device.

3. The method of claim 1 , wherein the context comprises receiving at least one of an inbound message or an inbound sound.

4. The method of claim 1 , wherein the action comprises an operation performed by the user device when the context is detected.

5. The method of claim 4 , wherein the action comprises at least one of feeding back context information corresponding to the rule through the user device by controlling internal components of the user device, or feeding back the context information through an external device by controlling the external device.

6. The method of claim 1 , wherein one or more rules are defined based on the received first user input.

7. The method of claim 1 ,

wherein the rule is defined as a singular structure rule when one action is identified from the received first user input, and

wherein the rule is defined as a plural structure rule when a plurality of actions are identified from the received first user input.

8. The method of claim 1 , further comprising:

displaying at least one of a user interface allowing the user to designate at least one of an action supported by the user device, or a guidance on the action supported by the user device.

9. The method of claim 1 , further comprising:

determining whether supplementary information is necessary for identifying the condition, the action corresponding to the condition, or the command;

displaying, when it is determined that supplementary information is necessary for identifying the condition, the action corresponding to the condition, or the command, a query to prompt the user to provide supplementary information necessary for identifying the condition, the action corresponding to the condition, or the command; and

receiving the second user input in response to the query,

wherein the query is not displayed when it is determined that supplementary information is not necessary for identifying the condition, the action corresponding to the condition, or the command.

10. A method for providing a context-aware service of a user device, the method comprising:

operating the user device in a rule configuration mode, a user interface for configuring a rule being displayed during the rule configuration mode;

receiving, by an input unit of the user device, a first user input according to a guidance provided by the user device if the user device is operating in the rule configuration mode, the first user input being at least one of a natural language-based speech input or a natural language-based text input;

in response to receiving the first user input, parsing the received first user input to extract and identifying a condition, an action, and a command, wherein the action is a function executable by one or more applications of the user device;

configuring a rule with the condition and the action based on the parsed first user input;

mapping the command to the rule in response to the configuring of the rule;

storing the rule and the mapped command at the user device;

switching the user device to a second mode different from the rule configuration mode;

receiving, by the input unit, a second user input, wherein the second user input is one of a natural language-based text input or a natural language based speech input; and

in response to receiving the second user input:

determining whether the second user input corresponds to the command;

activating, if the second user input corresponds to the command while the user device is in the second mode, the rule to detect, by a sensor of the user device, an event at the user device, which corresponds to the condition of the rule; and

executing, if the detected event corresponds to the condition of the rule while the user device is in the second mode, the action corresponding to the condition.

11. The method of claim 10 , wherein at least one of the condition or the command further comprises at least one of a motion detection event of the user device, a receipt of an inbound sound, or a receipt of an inbound message.

12. The method of claim 10 , wherein the activating of the rule comprises:

determining, when the command is received, whether a rule matching the command exists,

outputting, when no rule matches the command, a guidance,

determining, when a rule matching the command exists, whether a number of matched rules is greater than 1, and

activating at least one rule according to the number of matched rules.

13. The method of claim 12 , wherein the activating of the rule further comprises:

prompting, when the number of matched rules is greater than 1, to select one of the matched rules.

14. The method of claim 10 , wherein the activating of the rule further comprises:

releasing, when a rule release condition is satisfied in a state in which the rule is activated, the activated rule, and

providing feedback associated with release information, the feedback including information notifying of the release of the rule.

15. The method of claim 14 , wherein the feedback associated with the release information comprises at least one of audio feedback, video feedback, or tactile feedback.

16. A user device comprising:

an input device;

a random access memory;

a display; and

at least one microprocessor configured to:

receive, by the input device, an indication associated with a first user input according to a guidance provided by the user device, the first user input being at least one of a natural language-based text input or a natural language-based speech input,

in response to receiving the first user input, parse the received first user input to extract and identify a condition, an action corresponding to the condition, and a command, wherein the action is a function executable by one or more applications of the user device,

define a rule including the condition and the action corresponding to the condition based on the parsed first user input,

map the command to the rule in response to the defining of the rule,

store the rule and the mapped command to the random access memory,

receive, by the input device, an indication associated with a second user input,

wherein the second user input is one of a natural language-based text input or a natural language-based speech input, and

in response to receiving the second user input:

determine whether the second user input corresponds to the command,

activate, if the second user input corresponds to the command, the rule to detect, by a sensor of the user device, a context,

control the display to display execution information if the rule is activated, and

execute, if the detected context corresponds to the condition of the rule, the action corresponding to the condition,

wherein the second user input is one of a natural language-based text input or a natural language-based speech input.

17. The user device of claim 16 ,

wherein the second user input further comprises at least one of a motion detection event of the user device, a receipt of an inbound sound, or a receipt of an inbound message.

18. The user device of claim 16 , wherein the at least one microprocessor is further configured to:

execute, when an event detected in the user device satisfies the condition specified in the activated rule, at least one action corresponding to the condition, and

control the user device to provide feedback as an execution result.

19. The user device of claim 16 , wherein the at least one microprocessor is further configured to:

release, when a rule release condition is fulfilled in a state in which at least one rule is activated, the activated rule, and

control the user device to provide feedback as notification of the release of the at least one rule.

20. A user device comprising:

a display configured to display information; and

at least one microprocessor configured to:

receive, by an input unit of the user device, a first user input according to a guidance provided by the user device, the first user input being at least one of a natural language-based text input or a natural language-based speech input,

in response to receiving the first user input, parse the received first user input to extract and identify a condition, an action corresponding to the condition, and a command, wherein the action is a function executable by one or more applications on the user device,

define a rule including the condition and the action corresponding to the condition based on the parsed first user input,

map the command to the rule in response to the defining of the rule,

store the rule and the mapped command in at least one of the user device or a server,

receive, by the input unit, an indication associated with a second user input, wherein the second user input comprises one of a natural language-based speech input, a natural language-based text input, a motion detection event of the user device, a receipt of inbound sound, or a receipt of inbound message, and

in response to receiving the second user input:

determine whether the second user input corresponds to the command,

activate, if the second user input corresponds to the command, the rule after the rule is stored in at least one of the user device or the server,

detect, by a sensor of the user device, a context of the user device which corresponds the condition as specified in the rule, and

execute, if the context is detected, the action corresponding to the condition.

21. A non-transitory computer-readable storage medium storing a program that, when executed, causes at least one processor to perform a method comprising:

receiving a first user input by an input unit of a user device, by providing to a guidance, wherein the first user input is at least one of a natural language-based text input or a natural language-based speech input;

parsing the received first user input to extract and identifying a condition, an action corresponding to the condition, and a command;

defining a rule including the condition and the action corresponding to the condition based on the parsed first user input;

mapping the command to the rule in response to the defining of the rule;

storing the rule and the mapped command;

receiving, by the input unit, a second user input, wherein the second user input is one of a natural language-based text input or a natural language- based speech input; and

in response to receiving the second user input:

determining whether the second user input corresponds to the command;

activating, if the second user input corresponds to the command, the rule to detect, by a sensor of the user device, a context of the user device after the rule is stored; and

executing, if the detected context corresponds to the condition of the rule, the action corresponding to the condition.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2013
From: BAE, JOOYOON; KO, MINJEONG; KIM, SUNGSOO; KIM, JINSUNG; KIM, HWAKYUNG; JUN, JINHA
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 031214/0642 →
Priority Claims (2)
KR 10-2012-0104357 · Sep 20, 2012 · national
KR 10-2013-0048755 · Apr 30, 2013 · national
Continuity (1)
Related Publication 20140082501A1 · Mar 20, 2014