IP Library Granted Patent US 8,666,728
Granted Patent B2
US 8,666,728 · App. 12/666,930 · Granted Mar 4, 2014

Visual feedback based on interaction language constraints and pattern recognition of sensory features

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,666,728
App. No.
12/666,930
Granted
Mar 4, 2014
Kind
B2
Abstract

A language model back-off system can be used with a user interface employing one or more language models to constrain navigation of selectable user interface input components. A user input interpretation module receives user input and interprets the user input to determine if a selection is made of one or more user interface input components. If a selection is not made, the user input interpretation module determines whether conditions are met for backing off one or more language models employed to constrain navigation of the user interface input components. If the conditions are met, a language model back-off module backs off the one or more language models.

Claims (45)

1. A language model back-off system for use with a user interface employing one or more language models to constrain navigation of selectable user interface input components representing a set of characters based on at least one previously received user interface input component, the system comprising:

a user input interpretation module receiving user input and interpreting the user input to determine if a selection is made of one or more user interface input components, wherein said user input interpretation module, if a selection is not made, determines whether conditions are met for replacing at least one of the one or more language models employed to constrain navigation of the user interface input components with a replacement language model, wherein the replacement language model defines a set of selectable user interface components that is different than the set of user interface components defined by the one or more language models that are to be replaced; and

a language model back-off module replacing at least one of the one or more language models with the replacement language models if the conditions are met, further comprising

a user interface displaying the user interface input components with a focus indicator, the focus indicator operable to visually differentiate between selectable user interface input components and non-selectable user interface input components pursuant to the one or more employed language models.

2. The system of claim 1 , further comprising

a navigation constraint module employing the one or more language models, based on previous user interface input component selections, to constrain navigation of the selectable user interface input components.

3. The system of claim 2 ,

wherein said navigation constraint module constrains navigation of the user interface input components by controlling sizes of the components based on probabilities of the components being next selected as determined by employing the one or more language models.

4. The system of claim 2 ,

wherein said navigation constraint module constrains navigation of the user interface input components by controlling attraction of a pointer to the components based on probabilities of the components being next selected as determined by employing the one or more language models.

5. A language model back-off method for use with a user interface employing one or more language models to constrain navigation of selectable user interface input components representing a set of characters based on at least one previously received user interface input component, the method comprising:

receiving user input and interpreting the user input to determine if a selection is made of one or more user interface input components;

if a selection is not made, determining whether conditions are met for replacing at least one of the one or more language models employed to constrain navigation of the user interface input components with a replacement language model, wherein the replacement language model defines a set of selectable user interface components that is larger than the set of user interface components defined by the one or more language models that are to be replaced; and

if the conditions are met, replacing at least one of the one or more language models with a replacement language model.

6. The method of claim 5 , further comprising

displaying the user interface input components with a focus indicator, the focus indicator operable to visually differentiate between selectable user interface input components and non-selectable user interface input components pursuant to the one or more employed language models.

7. The method of claim 6 , further comprising

employing the one or more language models, based on previous selections, to constrain navigation of the selectable user interface input components.

8. The method of claim 7 , further comprising

constraining navigation of the user interface input components by controlling sizes of the components based on probabilities of the components being next selected as determined by employing the one or more language models.

9. The method of claim 7 , further comprising

constraining navigation of the user interface input components by controlling attraction of a pointer to the components based on probabilities of the components being next selected as determined by employing the one or more language models.

10. The method of claim 5 , further comprising

replacing at least one of the one or more language models with the replacement language model by adjusting weights of probabilities that are computed using multiple language models.

11. The method of claim 10 , further comprising

adjusting the weights to ensure that probabilities computed by employing a more highly constrained language model are given less weight while probabilities computed by employing a less highly constrained language model are given more weight.

12. The method of claim 5 , further comprising

determining whether the conditions are met based on a time since a previous selection.

13. The method of claim 5 , further comprising

determining whether the conditions are met by employing a probabilistic model taking into account a feature set of sensed user interaction with an input device of the user interface.

14. The method of claim 13 , further comprising employing a feature set including at least one of the following sensory inputs:

(a) a finger position;

(b) a click event;

(c) an acceleration derivative;

(d) a holding integral;

(e) dual finger positions and their multiple derivatives;

(f) dual click events;

(g) dual finger pressure values;

(h) input device acceleration and its integrals; or

(i) holding sensors outputs and their derivatives.

15. A language model back-off system for use with a user interface employing one or more language models to constrain navigation of selectable user interface input components representing a set of characters based on a previously received user interface input component, the system comprising:

a user interface displaying the user interface input components with a focus indicator, the focus indicator operable to visually differentiate between selectable user interface input components and non-selectable user interface input components pursuant to the employed one or more language models;

a navigation constraint module employing the one or more language models, based on previous user interface input component selections, to constrain navigation of the selectable user interface input components;

a user input interpretation module receiving user input and interpreting the user input to determine if a selection is made of the one or more user interface input components, wherein said user input interpretation module, if a selection is not made, determines whether conditions are met for replacing at least one of the one or more language models with a replacement language model, wherein the replacement language model defines a set of selectable user interface components that is larger than the set of user interface components defined by the one or more language models that are to be replaced, based on: (a) a time since a previous selection; and (b) a probabilistic model taking into account a feature set of sensed user interaction with an input device of the user interface; and

a language model back-off module replacing at least one or more of the one or more language models with the replacement language model if the conditions are met by adjusting weights of probabilities that are computed using multiple language models to ensure that probabilities computed by employing a more highly constrained language model are given less weight while probabilities computed by employing a less highly constrained language model are given more weight.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2019
From: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
To: SOVEREIGN PEAK VENTURES, LLC
Reel/Frame 049383/0752 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE ADDRESS PREVIOUSLY RECORDED ON REEL 048829 FRAME 0921. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 10, 2019
From: PANASONIC CORPORATION
To: SOVEREIGN PEAK VENTURES, LLC
Reel/Frame 048846/0041 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 9, 2019
From: PANASONIC CORPORATION
To: SOVEREIGN PEAK VENTURES, LLC
Reel/Frame 048829/0921 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2014
From: PANASONIC CORPORATION
To: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
Reel/Frame 033033/0163 →