System and method for processing transaction records for users
A computer system can implement a network service by receiving, from a computing device of a user, image data comprising an image of a record. The computer system can then execute image processing logic to determine a set of information items from the image. The computer system may then execute augmentation logic to process the record by (i) accessing a transaction database to identify a plurality of transactions made by the user, (ii) identifying a matching transaction from the plurality of transactions that pertains to the record, and (iii) resolving the set of information items using the matching transaction.
1. A method for determining record information, the method being implemented by one or more processors and comprising:
processing an image of a record to determine a record type of multiple record types;
initiating one or more optical character recognition (OCR) processes to determine a first set of information items from the image of the record;
determining, based on the determined record type, that the first set of information items is not sufficient to classify the record;
in response to the determination that the first set of information items is not sufficient, identifying a second set of information items that are likely part of the record but not determinable from the image of the record;
accessing, over one or more networks, a database resource to determine, based at least in part upon information that is determined from the first set of information items, the second set of information items that are likely part of the record;
selecting, from a group of multiple predefined classifications, a classification for the record, based on the determined record type, the first set of information items, and the second set of information items; and
storing, in a database, the record, including the record type, the first set of information items, the second set of information items, and the classification, the record being stored in association with a financial resource of a user.
2. The method of claim 1 , where the multiple record types include one or more record types selected from a group consisting of (i) a business card, (ii) an odometer reading, (iii) a cash receipt, and (iv) a travel itinerary.
3. The method of claim 1 , wherein the financial resource of the user includes a financial account of the user.
4. The method of claim 1 , further comprising verifying information of the first set of information based on a quality of the image.
5. The method of claim 1 , wherein the image of the record is transmitted from a mobile computing device of the user.
6. The method of claim 1 further comprising identifying the second set of information items as being likely part of the record but not determinable from OCR-recognized characters provided on the image.
7. The method of claim 1 , wherein selecting the classification includes determining that the record is a particular type of financial receipt.
8. The method of claim 1 , wherein the database resource comprises one of a merchant and an entity database, and wherein determining the second set of information items includes querying the one of the merchant and entity database using information that is determined from the first set of information items.
9. The method of claim 8 , wherein determining the second set of information items further comprises:
obtaining a plurality of transactions recorded with one or more financial accounts of a user;
identifying at least a first transaction that is relevant to the record, based on the first set of information items; and
identifying the second set of information items from information provided with the at least first transaction.
10. The method of claim 9 , wherein the second set of information items includes at least one information item selected from a group consisting of (i) a merchant name, (ii) a transaction value, and (iii) a date of a transaction.
11. A non-transitory computer readable medium that stores instructions, which when executed by one or more processors of a computer system, cause the computer system to perform operations that include:
processing an image of a record to determine a record type of multiple record types;
initiating one or more optical character recognition (OCR) processes to determine a first set of information items from the image of the record;
determining, based on the determined record type, that the first set of information items is not sufficient to classify the record;
in response to the determination that the first set of information items is not sufficient, identifying a second set of information items that are likely part of the record but not determinable from the image of the record;
accessing, over one or more networks, a database resource to determine, based at least in part upon information that is determined from the first set of information items, the second set of information items that are likely part of the record;
selecting, from a group of multiple predefined classifications, a classification for the record based on the determined record type, the first set of information items, and the second set of information items; and
storing, in a database, the record, including the record type, the first set of information items, the second set of information items, and the classification, the record being stored in association with a financial resource of a user.
12. The non-transitory computer readable memory of claim 11 , wherein the multiple record types include one or more record types selected from a group consisting of (i) a business card, (ii) an odometer reading, (iii) a cash receipt, and (iv) a travel itinerary.
13. The non-transitory computer readable memory of claim 12 , wherein the financial resource of the user includes financial account of the user.
14. The non-transitory computer readable memory of claim 13 , wherein the operations further comprise verifying information of the first set of information based on a quality of the image.
15. The non-transitory computer readable memory of claim 11 , wherein the database resource comprises one of a merchant and an entity database, and wherein determining the second set of information items includes querying the one of the merchant and entity database using information that is determined from the first set of information items.
16. The non-transitory computer readable memory of claim 15 , wherein determining the second set of information items includes:
obtaining a plurality of transactions recorded with one or more financial accounts of a user;
identifying at least a first transaction that is relevant to the record, based on the first set of information items; and
identifying the second set of information items from information provided with the at least first transaction.
17. The non-transitory computer readable memory of claim 16 , wherein the second set of information items includes at least one information item selected from a group consisting of (i) a merchant name, (ii) a transaction value, and (iii) a date of a transaction.
18. A computer system comprising:
one or more processors;
a memory to store instructions;
wherein the one or more processors execute the instructions to perform operations that include:
processing an image of a record to determine a record type of multiple record types;
initiating one or more optical character recognition (OCR) processes to determine a first set of information items from the image of the record;
determining, based on the determined record type, that the first set of information items is not sufficient to classify the record;
in response to the determination that the first set of information items is not sufficient, identifying a second set of information items that are likely part of the record but not determinable from the image of the record;
accessing, over one or more networks, a database resource to determine, based at least in part upon information that is determined from the first set of information items, the second set of information items that are likely part of the record;
selecting, from a group of multiple predefined classifications, a classification for the record based on the determined record type, the first set of information items, and the second set of information items; and
storing, in a database, the record, including the record type, the first set of information items, the second set of information items, and the classification, the record being stored in association with a financial resources of a user.
19. The computer system of claim 18 , wherein the database resource comprises one of a merchant and an entity database, and wherein determining the second set of information items includes querying the one of the merchant and entity database using information that is determined from the first set of information items.
20. The computer system of claim 19 , wherein determining the second set of information items further comprises:
obtaining a plurality of transactions recorded with one or more financial accounts of a user;
identifying at least a first transaction that is relevant to the record, based on the first set of information items; and
identifying the second set of information items from information provided with the at least first transaction.