IP Library Granted Patent US 10,133,920
Granted Patent B2
US 10,133,920 · App. 14/633,875 · Granted Nov 20, 2018

OCR through voice recognition

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,133,920
App. No.
14/633,875
Granted
Nov 20, 2018
Kind
B2
Abstract

One embodiment provides a method, including: receiving, at an input and display device, handwriting input; receiving, using a processor, voice input; generating, using a processor, at least one first word based on the handwriting input; generating, using a processor, at least one second word based on the voice input; and determining, using a processor, a highest probability word based on the at least one first word and the at least one second word. Other aspects are described and claimed.

Claims (51)

1. A method, comprising:

receiving, at an input and display device, handwriting input;

receiving, using a processor, voice input, wherein the receiving voice input comprises receiving voice input at a time associated with receipt of the handwriting input;

generating, using a processor, at least one first word based on the handwriting input and a probability associated with the at least one first word;

generating, using a processor, at least one second word based on the voice input and a probability associated with the at least one second word, wherein the probability is based on a context of the voice input;

determining, using a processor, a highest probability word based on the at least one first word and the at least one second word, wherein the determining comprises using at least one of: the at least one first word and the at least one second word to modify a probability of the other of: the at least one first word and the at least one second word; and

providing the determined highest probability word.

2. The method of claim 1 , further comprising:

displaying, on the input and display device, at least one high probability word prior to the handwriting input being complete.

3. The method of claim 2 , further comprising:

receiving user input selecting one of the at least one high probability words.

4. The method of claim 1 , wherein the voice input comprises receiving a verbal representation of the handwriting input being substantially concurrently input.

5. The method of claim 1 , wherein the voice input comprises receiving a general discussion relating to the handwriting input being substantially concurrently input.

6. The method of claim 1 , wherein the voice input comprises receiving a lecture relating to the handwriting input being substantially concurrently input.

7. The method of claim 1 , further comprising:

storing, on a memory device, a recording of the voice input.

8. The method of claim 7 , wherein the highest probability word is linked to a retrievable time in the recording of the voice input.

9. The method of claim 1 , wherein the generating a probability associated with the at least one first word comprises weighting, using the processor, each of the words from the at least one first word based on a handwriting recognition score; and

wherein the generating a probability associated the at least one second word comprises weighting, using the processor, each of the words from the at least one second word based on a voice recognition score.

10. The method of claim 9 , wherein the highest probability word is determined using a combination of the weighting of the at least one first word and the at least one second word.

11. An information handling device, comprising:

an input device;

a display device;

an audio capture device;

a processor;

a memory device that stores instructions executable by the processor to:

receive handwriting input;

receive voice input, wherein to receive voice input comprises receiving voice input at a time associated with receipt of the handwriting input;

generate at least one first word based on the handwriting input and a probability associated with the at least one first word;

generate at least one second word based on the voice input and a probability associated with the at least one second word, wherein the probability is based on a context of the voice input;

determine a highest probability word based on the at least one first word and the at least one second word, wherein to determines comprises using at least one of: the at least one first word and the at least one second word to modify a probability of the other of: the at least one first word and the at least one second word; and

provide the determined highest probability word.

12. The information handling device of claim 11 , further comprising:

displaying, on the input and display device, at least one high probability words prior to the handwriting input being complete.

13. The information handling device of claim 11 , wherein the Voice input comprises receiving a verbal representation of the handwriting input being substantially concurrently input.

14. The information handling device of claim 11 , wherein the voice input comprises receiving a general discussion relating to the handwriting input being substantially concurrently input.

15. The information handling device of claim 11 , wherein the voice input comprises receiving a lecture relating to the handwriting input being concurrently input.

16. The information handling device of claim 11 , further comprising:

storing, on the memory device, a recording of the voice input.

17. The information handling device of claim 16 , wherein the highest probability word is linked to a retrievable time in the recording of the voice input.

18. The information handling device of claim 11 , wherein the code that generates a probability associated with the at least one first word comprises code that weights, using the processor, each of the words from the at least one first word based on a handwriting recognition score; and

wherein the code that generates a probability associated with the at least one second word comprises code that weights, using the processor, each of the words from the at least one second word based on a voice recognition score.

19. The information handling device of claim 18 , wherein the highest probability word is determined using a combination of the weighting of the at least one first word and the at least one second word.

20. A product, comprising:

a storage device having code stored therewith, the code being executable by a processor and comprising:

code that receives, at an input and display device, handwriting input;

code that receives voice input, wherein the code that receives voice input comprise code that receives voice input at a time associated with receipt of the handwriting input;

code that generates at least one first word based on the handwriting input and a probability associated with the at least one first word;

code that generates at least one second word based on the voice input and a probability associated with the at least one second word, wherein the probability is based on a context of the voice input;

code that determines a highest probability word based on the at least one first word and the at least one second word, wherein the code that determines comprises code that uses at least one of: the at least one first word and the at least one second word to modify a probability of the other of: the at least one first word and the at least one second word; and

code that provides the determined highest probability word.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2025
From: LENOVO PC INTERNATIONAL LIMITED
To: LENOVO SWITZERLAND INTERNATIONAL GMBH
Reel/Frame 069870/0670 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2019
From: LENOVO (SINGAPORE) PTE. LTD.
To: LENOVO PC INTERNATIONAL LIMITED
Reel/Frame 049694/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2015
From: RAUX, ANTOINE ROLAND; ZAITSEV, GRIGORI; VANBLON, RUSSELL SPEIGHT; ZHANG, JIANBANG
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 035053/0747 →