IP Library › Granted Patent US 10,509,627
Granted Patent B2
US 10,509,627 · App. 15/820,823 · Granted Dec 17, 2019

User interface sound emanation activity classification

Inventors: Tamer E. Abuelsaad (Somers, NY); Gregory J. Boss (Saginaw, MI); John E. Moore, Jr. (Brownsburg, IN); Randy A. Rendahl (Raleigh, NC)
Assignee: International Business Machines Corporation
G06F3/167G06F9/451G06K9/00G06N5/047G06N20/00G10L25/51G06F8/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,509,627
App. No.
15/820,823
Granted
Dec 17, 2019
Kind
B2
Abstract

Methods, computer program products, and systems are presented. The method computer program products, and systems can include, for instance: obtaining an audio input, the audio input representing sound emanating from a key press based user interface; generating a context pattern based on the audio input; performing classification of the context pattern to classify the context pattern as belonging to a signature pattern classification, wherein the signature pattern classification specifies a user activity; and providing an output based on the performing classification.

Claims (17)

1. A method comprising:

obtaining an audio input, the audio input representing sound emanating from a key press based user interface;

generating a context pattern based on the audio input;

performing classification of the context pattern to classify the context pattern as belonging to a signature pattern classification, wherein the signature pattern classification specifies a user activity; and

providing an output based on the performing classification, wherein the performing classification results in classification failure, wherein the method includes prompting a user to enter activity information in response to the classification failure, and wherein the prompting includes providing user interface functionality that prompts the user to enter activity specifying information that specifies an activity engaged in by the user resulting in the generating of the context pattern, and wherein the method includes, using data received from the user in response to the prompting, registering the context pattern as a new signature pattern for comparison to subsequent context patterns.

2. The method of claim 1 , wherein the signature pattern classification is a classification selected from the group consisting of Web Browsing, Social Media, Mass Messaging, Gaming, Word Processing, and Specific String.

3. The method of claim 1 , wherein the signature pattern classification is a classification defined by a certain character string.

4. The method of claim 1 , wherein the method includes providing user interface functionality that allows an administrator user to enter a character string, registering a first context pattern as a first signature pattern associated to the character string, and wherein the performing classification includes matching an incoming context pattern to the first signature pattern.

5. The method of claim 1 , wherein the providing an output includes providing a notification to an external system.

6. The method of claim 1 , wherein the providing an output includes providing an output to configure a network hardware component.

7. The method of claim 1 , wherein the providing an output includes providing an output to initiate installation of software on a computer device.

8. The method of claim 1 , wherein the context pattern includes key press sequence information and timing information.

9. The method of claim 1 , wherein the obtaining includes obtaining the audio input from a computer device, wherein responsively to the performing classification failing to classify the context pattern, there is provided a prompt on the computer device prompting a user of the computer device to enter labeling information that specifies an activity associated with the context pattern.

10. The method of claim 1 , wherein the method includes providing functionality that allows an administrator user to perform training use of an administrator user key press based user interface during a training period, providing a certain audio input representing sound emanating from the administrator user key press based user interface during the training period, providing functionality that allows the administrator user to enter labeling information that specifies an activity associated to the training use, registering a first context pattern generated using the certain audio input as a first signature pattern labeled with the labeling information stored in a data repository, and matching an incoming context pattern to the first signature pattern.

11. The method of claim 1 , wherein the signature pattern classification is a Web Browsing classification.

12. The method of claim 1 , wherein the signature pattern classification is a Gaming classification.

13. The method of claim 1 , wherein the signature pattern classification is a Word Processing classification.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: KYNDRYL, INC.
Reel/Frame 057885/0644 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2017
From: ABUELSAAD, TAMER E.; BOSS, GREGORY J.; MOORE, JOHN E., JR.; RENDAHL, RANDY A.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 044199/0203 →
Continuity (2)
Continuation 15648628 · Jul 13, 2017
Related Publication 20190018647A1 · Jan 17, 2019
Cited By (1)
US 12,437,123