DOCUMENT AND IMAGE PROCESSING
Computer implemented methods, apparatus and computer program product are described that involve capturing images of a plurality of documents and performing specialized processing on the documents for generalized translation, menu translation, expense reporting, business card and social networking site updating, calendar updating and currency identification. Other specialized applications are also disclosed.
1 . A computer implemented method, the method comprising:
capturing images of a plurality of receipts using an image capturing component of a portable electronic device;
performing, by one or more computing devices, optical character recognition to extract information from the plurality of receipts; and
storing in a storage device information extracted from each of the receipts as separate entries in an expenses summary; and
calculating, by the one or more computing devices, a total of expenses based on the information extracted from the plurality of receipts.
2 . The method of claim 1 , further comprising:
retrieving images from the plurality of receipts; and
uploading the images and the expenses summary to a computer system.
3 . The method of claim 1 , wherein the portable electronic device comprises a mobile telephone.
4 . A method comprising:
capturing an image of a first receipt using an image capturing component of a portable electronic device;
performing, by one or more computing devices, optical character recognition to extract information from the first receipt; and
storing information extracted from the first receipt in an expenses summary.
5 . The method of claim 1 , further comprising:
capturing an image of succeeding receipts using the image capturing component of the portable electronic device;
automatically extracting information from the succeeding receipts; and
storing information extracted from the succeeding receipts in the expenses summary.
6 . The method of claim 5 , further comprising:
generating a total of expenses based on the information extracted from the first and succeeding receipts.
7 . The method of claim 4 , further comprising:
retrieving images from the first and all succeeding receipts;
bundling the images from the first and succeeding receipts into a file; and
uploading the bundled images and the expenses summary to a computer system.
8 . The method of claim 7 , wherein the computer system runs an accounts payable application that receives the bundled images and expenses summary.
9 . A method comprising:
capturing an image of a business card using an image capturing component of a portable electronic device that includes one or more computing devices;
performing, by the one or more computing devices, optical character recognition to identify text included in the business card,
extracting, by the one or more computing devices, information from the business card satisfying one or more pre-defined categories of information, the extracted information including a name identified from the business card; and
automatically adding a contact to an electronic contact database based on the extracted information; and
automatically forming a contact with the name identified from the business card in a social networking website.
10 . The method of claim 9 , wherein the electronic contact database comprises a Microsoft Outlook database.
11 . The method of claim 9 , wherein the pre-defined categories comprise one or more of name, business, company, telephone, email, and address information.
12 . The method of claim 9 , further comprising verifying the contact in the social networking website based on additional information extracted from the business card.
13 . A computer implemented method comprising:
capturing an image of a unit of currency using an image capturing component of a portable electronic device that includes one or more computing devices;
determining, by the one or more computing devices, the type of the currency;
determining, by the one or more computing devices, a denomination of the currency; and
converting a value of the currency to a different type of currency; and
displaying on a user interface of the portable electronic device a value of the piece of currency in the different type of currency.
14 . The method of claim 13 , further comprising displaying the type of currency and denomination.
15 . A method comprising:
capturing an image using an image capturing component of a portable electronic device that includes one or more computing devices, the image including an address;
performing, by the one or more computing devices, optical character recognition to identify the address;
determining a current location of the portable electronic device; and
generating directions from the determined current location to the identified address.
16 . The method of claim 15 , wherein determining a current location comprises using GPS to identify a current location for the portable electronic device.
17 . A method comprising:
capturing an image of a first street sign at an intersection using an image capturing component of a portable electronic device;
capturing an image of a second street sign at the intersection using the image capturing component of the portable electronic device; and
determining, by one or more computing devices, a location of the portable electronic device based on the images of the first and second street signs.
18 . The method of claim 16 , further comprising:
performing optical character recognition to identify a first street name from the image of the first street sign; and
performing optical character recognition to identify a second street name from the image of the second street sign.
19 . A method comprising:
capturing an image using an image capturing component of a portable electronic device that includes one or more computing devices;
performing, by one or more computing devices, optical character recognition to identify text included in the image, the text being written in a first language;
automatically by the one or more computing devices, translating the text from the first language to a second language, the second language being different from the first language; and
presenting the translated text to the user on a user interface of the portable electronic device.
20 . The method of claim 19 , further comprising automatically determining the language of the text included in the image.
21 . The method of claim 19 , wherein the portable electronic device comprises a cellular telephone.
22 . The method of claim 21 , wherein the image capturing component comprises a camera included in the cellular telephone.
23 . The method of claim 19 , wherein capturing an image comprises capturing an image of a menu.
24 . The method of claim 23 , further comprising providing additional information about one or more words on the menu.
25 . The method of claim 24 , wherein the additional information comprises an explanation or definition of the one or more words on the menu.