IP Library Granted Patent US 8,226,416
Granted Patent B2
US 8,226,416 · App. 11/952,713 · Granted Jul 24, 2012

Method and apparatus for reading education

Assignee: SRI International
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,226,416
App. No.
11/952,713
Granted
Jul 24, 2012
Kind
B2
Abstract

The present invention is a method and apparatus for reading education. In one embodiment, a method for recognizing an utterance spoken by a reader, includes receiving text to be read by the reader, generating a grammar for speech recognition, in accordance with the text, receiving the utterance, interpreting the utterance in accordance with the grammar, and outputting feedback indicative of reader performance.

Claims (61)

1. A method for recognizing an utterance spoken by a reader, the method comprising:

receiving text comprising one or more words to be read by the reader;

generating a grammar for speech recognition, in accordance with the text;

inserting at least one reading learner grammar feature into the grammar, wherein the at least one reading learner grammar feature comprises a recognition of at least one reading learner mistake;

receiving the utterance;

interpreting the utterance in accordance with the grammar; and

outputting feedback indicative of reader performance.

2. Apparatus for recognizing an utterance spoken by a reader, the apparatus comprising:

means for receiving text comprising one or more words to be read by the reader;

means for generating a grammar for speech recognition, in accordance with the text;

means for inserting at least one reading learner grammar feature into the grammar, wherein the at least one reading learner grammar feature comprises a recognition of at least one reading learner mistake;

means for receiving the utterance; and

means for interpreting the utterance in accordance with the grammar; and

means for outputting feedback indicative of reader performance.

3. A non-transitory computer readable medium containing an executable program for recognizing an utterance spoken by a reader, where the program performs the steps of:

receiving text comprising one or more words to be read by the reader;

generating a grammar for speech recognition, in accordance with the text;

inserting at least one reading learner grammar feature into the grammar, wherein the at least one reading learner grammar feature comprises a recognition of at least one reading learner mistake;

receiving the utterance;

interpreting the utterance in accordance with the grammar; and

outputting feedback indicative of reader performance.

4. The non-transitory computer readable medium of claim 3 , wherein the at least one reading learner mistake comprises a structural restart.

5. The non-transitory computer readable medium of claim 3 , wherein the at least one reading learner mistake comprises a jump-ahead.

6. The non-transitory computer readable medium of claim 3 , wherein the at least one reading learner mistake comprises at least one pronunciation mistake.

7. The non-transitory computer readable medium of claim 3 , wherein the at least one reading learner mistake comprises a word insertion error or a word deletion error.

8. The non-transitory computer readable medium of claim 3 , wherein the at least one reading learner mistake comprises a mistake in directionality.

9. The non-transitory computer readable medium of claim 3 , wherein the at least one reading learner mistake comprises, for at least one of the one or more words, skipping the next word.

10. The non-transitory computer readable medium of claim 3 , wherein the at least one reading learner mistake comprises, for at least one of the one or more words, repeating a current word.

11. The non-transitory computer readable medium of claim 3 , wherein the at least one reading learner mistake comprises, for at least one of the one or more words, uttering an immediately preceding word.

12. The non-transitory computer readable medium of claim 3 , wherein the at least one reading learner mistake comprises, for at least one of the one or more words, uttering a beginning of a current phrase of which the current word is a part.

13. The non-transitory computer readable medium of claim 3 , wherein the at least one reading learner mistake comprises, for at least one of the one or more words that is a line-ending word, repeating a current line.

14. The non-transitory computer readable medium of claim 3 , wherein the at least one reading learner mistake comprises, for at least one of the one or more words that is a line-ending word, uttering an immediately preceding line.

15. The non-transitory computer readable medium of claim 3 , wherein the at least one reading learner grammar feature further comprises a reject grammar for at least one of the one or more words.

16. The non-transitory computer readable medium of claim 3 , further comprising:

displaying the text to the reader prior to receiving the utterance.

17. The non-transitory computer readable medium of claim 16 , wherein the displaying, the receiving of the utterance, and the interpreting are performed substantially simultaneously.

18. The non-transitory computer readable medium of claim 16 , wherein the displaying comprises:

formatting the text for display.

19. The non-transitory computer readable medium of claim 18 , wherein the text further comprises a formatting markup for guiding the formatting.

20. The non-transitory computer readable medium of claim 19 , wherein the formatting comprises:

calculating a position of at least one text format feature in accordance with at least one characteristic of a device on which the text is to be displayed.

21. The non-transitory computer readable medium of claim 3 , wherein the text further comprises metadata comprising semantic data.

22. The non-transitory computer readable medium of claim 3 , wherein the feedback comprises at least partial results of the interpreting.

23. The non-transitory computer readable medium of claim 3 , wherein the feedback comprises a score indicative of an accuracy of the utterance relative to the text.

24. The non-transitory computer readable medium of claim 23 , wherein the score comprises at least one of: a number of words uttered by the reader in a given period of time, an amount of time taken by the reader to complete utterance of at least a portion of the text, a confidence score relating to a word uttered by the reader, a confidence score relating to a sentence uttered by the reader, a confidence score relating to a phrase uttered by the reader, or a percentage of words correctly uttered by the reader.

25. The non-transitory computer readable medium of claim 23 , wherein the score is at least one of: a dialog act score, a duration score, a fluency score, a score related to a path taken through the grammar, or a pronunciation score.

26. The non-transitory computer readable medium of claim 3 , wherein the feedback comprises at least one of: poorly uttered portions of the text, correctly uttered portions of the text, skipped portion of the text, or repeated portions of the text.

27. The non-transitory computer readable medium of claim 3 , further comprising:

storing the feedback.

28. The non-transitory computer readable medium of claim 3 , wherein the inserting comprises:

generating transitions representing a correct utterance of the text; and

generating transitions representing the at least one reading learner grammar feature.

29. The non-transitory computer readable medium of claim 28 , wherein the transitions representing the correct utterance and the transitions representing the at least one reading learner feature are assigned probabilities.

30. The non-transitory computer readable medium of claim 28 , wherein at least one word in at least one of the correct utterance and the transitions representing the at least one reading learner grammar feature is represented by a multi-word sub-grammar, the multi-word sub-grammar comprising:

the at least one word;

a reject grammar; and

a pause grammar.

31. The non-transitory computer readable medium of claim 3 , wherein the text is received from local storage.

32. The non-transitory computer readable medium of claim 3 , wherein the text is received from a remote computing device.

33. The non-transitory computer readable medium of claim 3 , wherein the receiving text comprises:

performing optical character recognition on a piece of printed text.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2008
From: ABRASH, VICTOR; BERCOW, DOUGLAS
To: SRI INTERNATIONAL
Reel/Frame 020349/0770 →
Continuity (3)
Provisional Application 60869289 · Dec 8, 2006
Provisional Application 60972606 · Sep 14, 2007
Related Publication 20080140401A1 · Jun 12, 2008