IP Library Granted Patent US 9,996,315
Granted Patent B2
US 9,996,315 · App. 14/697,856 · Granted Jun 12, 2018

Systems and methods using audio input with a mobile device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,996,315
App. No.
14/697,856
Granted
Jun 12, 2018
Kind
B2
Abstract

Systems and methods of using audio input with a mobile device. A method comprises receiving content at a mobile device; annotating, at the mobile device, a selectable item of a user interface associated with the content with an annotation; receiving, at the mobile device, an audio input associated with the annotation; converting, at the mobile device, the audio input into a user interface command; and causing the mobile device to perform a function in response to the user interface command.

Claims (46)

1. A method, comprising:

receiving content at a mobile device;

annotating, by the mobile device, a selectable item of a user interface associated with the content so that the selectable item is displayed with an annotation;

receiving, at the mobile device, an audio input prompted by the annotation;

converting, at the mobile device, the audio input into a user interface command; and

causing the mobile device to perform a function in response to the user interface command;

wherein annotating, by the mobile device, the selectable item comprises:

annotating selectable items having text that is identical such that the text of the selectable items are different from each other; and

displaying alternate text associated with the selectable item, wherein the alternate text is text that the content indicates is displayed as an alternative to displaying the selectable item.

2. The method according to claim 1 , wherein the selectable item is a hyperlink.

3. The method according to claim 1 , wherein the function comprises selecting the selectable item.

4. The method according to claim 3 , wherein the function comprises changing a selection from the selected selectable item to a different selectable item of the user interface.

5. The method according to claim 1 , wherein the function comprises activating the selectable item.

6. The method according to claim 1 , wherein the selectable item includes at least one of form fields, pull down menus, scroll boxes, text boxes, form buttons, radio buttons, and check boxes.

7. The method according to claim 1 , wherein annotating, at the mobile device, the selectable item comprises changing a text of the selectable item to be different from corresponding text in the content.

8. The method according to claim 1 , wherein annotating, at the mobile device, the selectable item comprises displaying an overlay associated with the selectable item.

9. The method of claim 1 , wherein the alternate text includes text of an image tag within the content.

10. The method according to claim 1 , further comprising:

converting, at the mobile device, audio input into first text; and

comparing, at the mobile device, the first text to second text associated with the selectable item.

11. A mobile device comprising:

a user interface;

a communication module; and

a processor coupled to the user interface and the communication module, and configured to:

receive content;

annotate a selectable item of a user interface associated with the content with an annotation, wherein selectable items having text that is identical are annotated such that the text of the selectable items are different from each other;

receive an audio input associated with the annotation;

convert the audio input into a user interface command associated with a selectable item of the user interface;

perform a function in response to the user interface command; and

cause the user interface to display alternate text associated with the selectable item, wherein the alternate text is text that the content indicates is displayed as an alternative to displaying the selectable item.

12. The mobile device according to claim 11 , wherein the function comprises selecting the selectable item.

13. The mobile device according to claim 12 , wherein the function comprises changing a selection from the selected selectable item to a different selectable item of the user interface.

14. The mobile device according to claim 11 , wherein the function comprises activating the selectable item.

15. The mobile device according to claim 11 , wherein the processor is further configured to change a text of the selectable item.

16. The mobile device according to claim 11 , wherein the processor is further configured to cause the user interface to display an overlay associated with the selectable item.

17. A method, comprising:

displaying, at a mobile device, a web page with a hyperlink;

modifying, at the mobile device, text associated with the hyperlink;

receiving, at the mobile device, a first audio input;

converting, at the mobile device, the first audio input into a first user interface command associated with the hyperlink;

annotating, at the mobile device, the hyperlink with highlighting in response to the first user interface command, wherein annotating, by the mobile device, the hyperlink comprises:

annotating hyperlinks having text that is identical such that the text of the annotated hyperlinks are different from each other; and

displaying alternate text associated with the hyperlink, wherein the alternate text is text that the web page indicates is displayed as an alternative to displaying the hyperlink;

receiving, at the mobile device, a second audio input;

converting, at the mobile device, the second audio input into a second user interface command associated with the hyperlink; and

selecting, at the mobile device, the hyperlink in response to the second user interface command.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2025
From: INTELLECTUAL VENTURES ASSETS 196 LLC
To: ECOMM INNOVATIONS, LLC
Reel/Frame 071128/0491 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2025
From: GULA CONSULTING LIMITED LIABILITY COMPANY
To: INTELLECTUAL VENTURES ASSETS 196 LLC
Reel/Frame 070662/0078 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME, EXECUTION DATE AND EFFECTIVE DATE OF MERGER PREVIOUSLY RECORDED AT REEL: 037028 FRAME: 0663. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Mar 15, 2018
From: WOUNDER GMBH., LLC
To: GULA CONSULTING LIMITED LIABILITY COMPANY
Reel/Frame 046507/0144 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCOMPLETE ASSIGNEE NAME TO INCLUDE "LIMITED LIABILITY COMPANY" PREVIOUSLY RECORDED ON REEL 037028 FRAME 0663. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Nov 30, 2015
From: WOUNDER GMBH., LLC
To: GULA CONSULTING LIMITED LIABILITY COMPANY
Reel/Frame 037172/0557 →
MERGER Recorded Nov 12, 2015
From: WOUNDER GMBH., LLC
To: GULA CONSULTING
Reel/Frame 037028/0663 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2015
From: BARNES, MELVIN L., JR.
To: WOUNDER GMBH., LLC
Reel/Frame 035526/0006 →