IP Library Granted Patent US 10,402,162
Granted Patent B2
US 10,402,162 · App. 16/243,941 · Granted Sep 3, 2019

Automatic speech recognition (ASR) feedback for head mounted displays (HMD)

Inventors: Christopher Parkinson (Richland, WA); James Woodall (Nottinghamshire, GB)
Assignee: KOPIN CORPORATION
G06F3/167G10L15/22G10L17/22G10L2015/225
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,402,162
App. No.
16/243,941
Granted
Sep 3, 2019
Kind
B2
Abstract

Feedback mechanisms to the user of a Head Mounted Display (HMD) are provided. It is important to provide feedback to the user when speech is recognized as soon as possible after the user utters a voice command. The HMD displays and/or audibly renders an ASR acknowledgment in a manner that ensures the user that the HMD has received/understood his voiced command.

Claims (27)

1. A method of acknowledging a voice command, comprising:

receiving, by a headset computer, a voice command;

interpreting, by the headset computer, the voice command; and

acknowledging, by the headset computer, the received voice command, in response to interpreting the voice command, by providing visual feedback to the user on a display such that the visual feedback is presented to the user on of (a) within 500 mS of when the voice command is interpreted and (b) within two cycles of a frame rate of the display of when the voice command is interpreted.

2. The method of claim 1 , further including converting, using a microphone, an utterance corresponding to the voice command into an electrical signal.

3. The method of claim 1 , wherein interpreting the voice command includes determining if the voice command is a member of a predetermined suite of voice commands.

4. The method of claim 1 , wherein acknowledging the received voice command includes presenting an automatic speech recognition (ASR) notification clue.

5. The method of claim 4 , wherein the ASR notification clue includes a visual clue.

6. The method of claim 5 , wherein the visual clue is presented within 500 mS of when the utterance is interpreted.

7. The method of claim 5 , wherein the visual clue is instantiated on a display within two cycles of the frame rate of the display.

8. The method of claim 5 , wherein the visual clue remains on the display for a predetermined time after the visual clue is instantiated, and removed from the display after the predetermined time has elapsed.

9. The method of claim 4 , wherein the ASR notification clue includes an audio clue.

10. The method of claim 9 , wherein the audio clue is a chirp.

11. An apparatus for acknowledging a voice command, comprising:

a headset computer, including a processor, configured to:

receive a voice command;

interpret the voice command; and

acknowledge the received voice command, in response to interpreting the voice command by providing visual feedback to the user on a display such that the visual feedback is presented to the user on of (a) within 500 mS of when the voice command is interpreted and (b) within two cycles of a frame rate of the display of when the voice command is interpreted.

12. The apparatus of claim 11 , wherein the headset computer is further configured to convert, using a microphone, an utterance corresponding to the voice command into an electrical signal.

13. The apparatus of claim 11 , wherein the headset computer is further configured to determine if the voice command is a member of a predetermined suite of voice commands.

14. The apparatus of claim 11 , the headset computer is further configured to present an automatic speech recognition (ASR) notification clue.

15. The apparatus of claim 14 , wherein the ASR notification clue includes a visual clue.

16. The apparatus of claim 15 , wherein the visual clue is presented within 500 mS of when the utterance is interpreted.

17. The apparatus of claim 15 , wherein the visual clue is instantiated on a display within two cycles of the frame rate of the display.

18. The apparatus of claim 15 , wherein the visual clue remains on the display for a predetermined time after the visual clue is instantiated, and removed from the display after the predetermined time has elapsed.

19. The apparatus of claim 14 , wherein the ASR notification clue includes an audio clue.

20. The apparatus of claim 19 , wherein the audio clue is a chirp.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2019
From: IKANOS CONSULTING LTD
To: KOPIN CORPORATION
Reel/Frame 048025/0848 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2019
From: PARKINSON, CHRISTOPHER
To: KOPIN CORPORATION
Reel/Frame 048009/0067 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2019
From: WOODALL, JAMES
To: IKANOS CONSULTING LTD.
Reel/Frame 048010/0355 →
Continuity (3)
Continuation 14540943 · Nov 13, 2014
Provisional Application 61905130 · Nov 15, 2013
Related Publication 20190146753A1 · May 16, 2019
Cited By (1)
US 12,688,053