IP Library Granted Patent US 9,182,903
Granted Patent B2
US 9,182,903 · App. 13/964,028 · Granted Nov 10, 2015

Method and apparatus for keyword graphic selection

Inventors: Michael J. Lombardi (Lake Zurich, IL); Mitul R. Patel (Lake Zurich, IL); Amber M. Pierce (Libertyville, IL); Natalie J. Stevens (Spring Grove, IL)
Assignee: Google Technology Holdings LLC
G06F3/0488G06F1/32G06F1/3206G06F3/0412G06F3/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,182,903
App. No.
13/964,028
Granted
Nov 10, 2015
Kind
B2
Abstract

A method on an electronic device is described. A set of graphics and a set of stored keywords are received in a higher-power mode of operation, each graphic corresponding to one or more of the stored keywords. The higher-power mode of operation is discontinued to enter a lower-power mode of operation. In the lower-power mode: audio signals are listened for; it is detected whether any keywords of the set of stored keywords are present in the audio signals; detected keywords present in the audio signals are stored; a graphic is selected from the set of graphics based on a comparison between the set of detected keywords and the set of stored keywords; a first portion of the selected graphic is displayed, in response to the at least one control signal, on a first area of a touch screen display that is within a first portion of the touch screen display.

Claims (108)

1. A method comprising:

actively controlling, with an application processor of an electronic device and while the electronic device is operating in a higher-power mode of operation, an entire display screen of a touch screen display of the electronic device;

receiving, by the application processor and while the electronic device is operating in the higher-power mode of operation, a set of graphics and a set of stored keywords, wherein each graphic of the set of graphics corresponds to one or more keywords of the set of stored keywords;

transitioning from operating in the higher-power mode of operation to operating in a lower-power mode of operation by at least discontinuing, by the application processor, actively controlling the touch screen display;

receiving, by a microphone of the electronic device and while the electronic device operates in the lower-power mode of operation, audio signals;

determining, by a sensor hub of the electronic device and while the electronic device operates in the lower-power mode of operation, a set of detected keywords from the set of stored keywords that are present in the audio signals;

storing, by the sensor hub and while the electronic device operates in the lower-power mode of operation, the set of detected keywords that are present in the audio signals;

selecting, by the sensor hub and while the electronic device operates in the lower-power mode of operation, a graphic from the set of graphics based on a comparison between the set of detected keywords and the set of stored keywords;

providing, by the sensor hub and while the electronic device operates in the lower-power mode of operation, at least one control signal to the touch screen display; and

in response to the at least one control signal:

activating, by the sensor hub and while the electronic device operates in the lower-power mode of operation, only a first portion of the touch screen display; and

displaying, by the touch screen display and while the electronic device operates in the lower-power mode of operation, a first portion of the selected graphic on a first area of the touch screen display that is within the first portion of the touch screen display.

2. The method of claim 1 , wherein selecting the graphic comprises:

determining, by the sensor hub, a match indicator that indicates a number of keywords that match between the set of detected keywords and the set of stored keywords for at least one graphic of the set of graphics;

selecting, by the sensor hub, the graphic with a highest match indicator from the set of graphics.

3. The method of claim 1 , wherein each detected keyword of the set of detected keywords is associated with a respective detection time, and wherein selecting the graphic comprises:

determining, by the sensor hub, a match indicator that indicates a number of keywords that match between the set of detected keywords and the set of stored keywords for at least one graphic of the set of graphics;

determining, by the sensor hub, a recentness indicator that indicates an elapsed time since the respective detection time for each detected keyword;

selecting, by the sensor hub, the graphic from the set of graphics based on the match indicator and the recentness indicator.

4. The method of claim 3 , wherein selecting the graphic comprises selecting, by the sensor hub, the graphic with a lowest recentness indicator.

5. The method of claim 3 , wherein the at least one control signal is a first control signal, the method further comprising:

selecting, by the sensor hub and while the electronic device is operating in the lower-power mode of operation, a set of action icons for the selected graphic based on the set of detected keywords;

after the touch screen display displays the first portion of the selected graphic on the first area of the touch screen display that is within the first portion of the touch screen display, providing, by the sensor hub and while the electronic device is operating in the lower-power mode of operation and in response to a first touch input that corresponds to the first area, at least one second control signal to the touch screen display;

activating, by the sensor hub and while the electronic device is operating in the lower-power mode of operation and in response to the at least one second control signal, a second portion of the touch screen display;

displaying, by the touch screen display and while the electronic device is operating in the lower-power mode of operation and in response to the at least one second control signal, a second portion of the selected graphic on a second area of the touch screen display that is within the second portion of the touch screen display;

selecting, by the sensor hub and while the electronic device is operating in the lower-power mode of operation, an action indication for the selected graphic from a set of action indications that corresponds to the set of action icons in response to a second touch input that corresponds to the second area; and

performing, by the sensor hub, a selected action that corresponds to the selected action indication.

6. The method of claim 3 ,

wherein selecting the graphic comprises:

selecting, by the sensor hub, a first graphic from the set of graphics at a first time; and

selecting, by the sensor hub and while the electronic device is operating in the lower-power mode of operation, a second graphic from the set of graphics at a second time after the first time based on a most recently detected keyword of the set of detected keywords; and

wherein displaying the first portion of the selected graphic comprises displaying, by the touch screen display, a first portion of the second graphic.

7. The method of claim 3 ,

wherein selecting the graphic from the set of graphics comprises maintaining, by the sensor hub, the set of graphics in a priority list based on the match indicator and the recentness indicator; and

wherein displaying the first portion of the graphic comprises displaying, by the sensor hub, a first portion of a highest priority graphic of the priority list.

8. The method of claim 1 , further comprising:

storing, by the sensor hub and while the electronic device is operating in the lower-power mode of operation, graphic display information for the selected graphic after displaying the first portion of the selected graphic, wherein the graphic display information comprises a set of matched keywords that match between the set of detected keywords and the one or more keywords of the set of stored keywords that correspond to the selected graphic and a match count associated with each keyword of the set of matched keywords.

9. The method of claim 1 , wherein at least one stored keyword of the set of stored keywords comprises a phrase of multiple words.

10. The method of claim 1 , wherein providing the at least one control signal comprises providing, by the sensor hub, the at least one control signal in response to receiving an indication that the electronic device has been moved after a period of being stationary or in response to receiving an indication that the touch screen display of the electronic device has changed to an uncovered state after a period of being in a covered state.

11. The method of claim 1 , wherein:

the application processor is configured to consume a first amount of power while the electronic devices is operating in the higher-power mode; and

the sensor hub is configured to:

consume a second amount of power while the electronic device is operating in the lower-power mode, wherein the second amount of power is less than the first amount of power; and

control the one or more sensors while the electronic device operates in the higher-power mode of operation and while the electronic device operates in the lower-power mode of operation.

12. An electronic device comprising:

a receiver configured to receive wireless communication signals;

a memory device;

a touch screen display;

a microphone configured to receive audio signals within an audible range of the microphone;

at least one application processor configured to:

control the touch screen display while the electronic device operates in a higher-power mode of operation; and

receive and store a set of graphics and a set of stored keywords in the memory device while the electronic device operates in the higher-power mode of operation, wherein each graphic of the set of graphics corresponds to one or more keywords of the set of stored keywords; and

a sensor hub configured to:

control the touch screen display while the electronic device operates in a lower-power mode of operation;

determine, while the electronic device operates in the lower-power mode of operation, a set of detected keywords of the set of stored keywords that are present in the audio signals;

store, while the electronic device operates in the lower-power mode of operation, the set of detected keywords present in the audio signals;

select, while the electronic device operates in the lower-power mode of operation, a graphic from the set of graphics based on a comparison between the set of detected keywords and the set of stored keywords; and

provide, while the electronic device operates in the lower-power mode of operation, at least one control signal to the touch screen display,

wherein the touch screen display is configured to:

while the electronic device operates in the lower-power mode of operation and in response to the at least one control signal:

activate only a first portion of the touch screen display; and

display a first portion of the selected graphic on a first area of the touch screen display that is within the first portion of the touch screen display.

13. The electronic device of claim 12 , wherein the sensor hub is further configured to:

determine, while the electronic device operates in the lower-power mode of operation, a match indicator that indicates a number of keywords that match between the set of detected keywords and the set of stored keywords for at least one graphic of the set of graphics; and

select, while the electronic device operates in the lower-power mode of operation, the graphic with a highest match indicator from the set of graphics.

14. The electronic device of claim 12 , wherein:

each detected keyword of the set of detected keywords is associated with a detection time; and

the sensor hub is further configured to:

determine, while the electronic device operates in the lower-power mode of operation, a match indicator that indicates a number of keywords that match between the set of detected keywords and the set of stored keywords for at least one graphic of the set of graphics;

determine, while the electronic device operates in the lower-power mode of operation, a recentness indicator that indicates an elapsed time since the detection time for each detected keyword; and

select, while the electronic device operates in the lower-power mode of operation, the graphic from the set of graphics based on the match indicator and the recentness indicator.

15. The electronic device of claim 14 , wherein the sensor hub is further configured to:

select, while the electronic device operates in the lower-power mode of operation, the graphic with a lowest recentness indicator.

16. The electronic device of claim 14 ,

wherein the at least one control signal is at least one first control signal and the sensor hub is further configured to:

select, while the electronic device operates in the lower-power mode of operation, a set of action icons for the selected graphic based on the set of detected keywords; and

after providing the at least one first control signal, provide, while the electronic device operates in the lower-power mode of operation and in response to a first touch input that corresponds to the first area, at least one second control signal to the touch screen display;

wherein the touch screen display is configured to:

while the electronic device operates in the lower-power mode of operation and in response to the at least one second control signal:

activate a second portion of the touch screen display; and

display a second portion of the selected graphic on a second area of the touch screen display that is within the second portion of the touch screen display; and

wherein the sensor hub is further configured to:

select, while the electronic device operates in the lower-power mode of operation, an action indication, from a set of action indications that corresponds to the set of action icons, for the selected graphic in response to a second touch input that corresponds to the second area; and

perform a selected action that corresponds to the selected action indication.

17. The electronic device of claim 14 , wherein the sensor hub is further configured to:

maintain, while the electronic device operates in the lower-power mode of operation, the set of graphics in a priority list based on the match indicator and the recentness indicator; and

select, while the electronic device operates in the lower-power mode of operation, a highest priority graphic of the priority list as the selected graphic.

18. The electronic device of claim 14 ,

wherein the sensor hub is further configured to store, while the electronic device operates in the lower-power mode of operation, graphic display information for the selected graphic after displaying the first portion of the selected graphic; and

wherein the graphic display information comprises a set of matched keywords that match between the set of detected keywords and the one or more keywords of the set of stored keywords that correspond to the selected graphic and a match count associated with each keyword of the set of matched keywords.

19. The electronic device of claim 14 , wherein the sensor hub is further configured to provide the at least one control signal in response to receiving an indication that the electronic device has been moved after a period of being stationary or in response to receiving an indication that the touch screen display of the electronic device has changed to an uncovered state after a period of being in a covered state.

20. An electronic device comprising:

a memory device;

a touch screen display;

one or more sensors including a microphone configured to receive audio signals within an audible range of the microphone;

at least one application processor configured to:

control the touch screen display only while the electronic device operates in a higher-power mode of operation; and

receive and store a set of graphics and a set of stored keywords in the memory device while the electronic device operates in the higher-power mode of operation, wherein each graphic of the set of graphics corresponds to one or more keywords of the set of stored keywords; and

a sensor hub configured to:

control the one or more sensors while the electronic device operates in the higher-power mode of operation and while the electronic device operates in the lower-power mode of operation;

control, by consuming less power than the at least one application processor, the touch screen display while the electronic device operates in a lower-power mode of operation;

determine, while the electronic device operates in the lower-power mode of operation, a set of detected keywords of the set of stored keywords that are present in the audio signals;

store, while the electronic device operates in the lower-power mode of operation, the set of detected keywords present in the audio signals;

select, while the electronic device operates in the lower-power mode of operation, a graphic from the set of graphics based on a comparison between the set of detected keywords and the set of stored keywords; and

provide, while the electronic device operates in the lower-power mode of operation, at least one control signal to the touch screen display,

wherein the touch screen display is configured to:

activate, while the electronic device operates in the lower-power mode of operation and in response to the at least one control signal, only a first portion of the touch screen display; and

display, while the electronic device operates in the lower-power mode of operation and in response to the at least one control signal, a first portion of the selected graphic on a first area of the touch screen display that is within the first portion of the touch screen display.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2014
From: MOTOROLA MOBILITY LLC
To: GOOGLE TECHNOLOGY HOLDINGS LLC
Reel/Frame 034625/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2013
From: LOMBARDI, MICHAEL J; PATEL, MITUL R; PIERCE, AMBER M; STEVENS, NATALIE J
To: MOTOROLA MOBILITY LLC
Reel/Frame 031309/0601 →
Continuity (1)
Related Publication 20150042570A1 · Feb 12, 2015