Systems and methods for detecting and classifying objects in video captured using mobile devices
View Patent ↗In one embodiment, a system includes a processor and logic executable by the processor. The logic is configured to cause the processor to: capture video data using a mobile device, the video data comprising a plurality of frames; determine whether one or more of the frames depict a document exhibiting one or more defining characteristics; determine whether one or more of the frame(s) determined to depict the document also satisfy one or more predetermined quality control criteria; and in response to determining one or more of the frames depict the document and also satisfy the one or more predetermined quality control criteria, automatically capture an image of the document. Corresponding computer program products are also disclosed.
1. A system, comprising a processor and logic executable by the processor, the logic being configured to cause the processor to:
capture video data using a mobile device, the video data comprising a plurality of frames;
determine whether one or more of the frames depict a document exhibiting one or more defining characteristics;
determine whether one or more of the frame(s) determined to depict the document also satisfy one or more predetermined quality control criteria; and
in response to determining one or more of the frames depict the document and also satisfy the one or more predetermined quality control criteria, automatically capture an image of the document.
2. The system as recited in claim 1 , wherein the image is characterized by a resolution higher than a resolution of any of the plurality of frames.
3. The system as recited in claim 1 , wherein the defining characteristics comprise one or more of:
a document shape;
a document contour;
one or more document dimensions; and
a document color profile.
4. The system as recited in claim 1 , wherein determining whether one or more of the frames depict the document comprises performing optical character recognition (OCR).
5. The system as recited in claim 1 , wherein the defining characteristics comprise one or more of:
textual information depicted on the document;
a photograph depicted on the document;
a barcode depicted on the document;
a logo depicted on the document;
an emblem depicted on the document;
a seal depicted on the document; and
an aspect ratio of the document.
6. The system as recited in claim 1 , wherein the document corresponds to a loan application; and
wherein the defining characteristics comprise the document depicting one or more of:
a customer name;
a guarantor name;
a customer address;
a date;
an account number
a loan number;
a digital signature;
a handwritten signature; and
a photograph.
7. The system as recited in claim 1 , wherein the document comprises one or more of:
a receipt;
an expense report;
a credit card; and
a check; and
wherein the defining characteristics comprise the document depicting one or more of:
a credit card number;
a name;
an expense amount; and
an order number.
8. The system as recited in claim 1 , wherein the document corresponds to an insurance claim; and
wherein the defining characteristics comprise the document depicting one or more of:
a photograph of an automobile;
a photograph of an accident report;
a photograph of a proof of insurance document;
a photograph of a driver's license;
a photograph of a quote; and
a signature.
9. The system as recited in claim 1 , wherein the document corresponds to a delivery; and
wherein the defining characteristics comprise the document depicting one or more of:
a signature;
a proof of delivery;
a package number;
a photograph of a package; and
a declaration of package contents.
10. The system as recited in claim 1 , wherein the document corresponds to an educational program application; and
wherein the defining characteristics comprise the document depicting one or more of:
an applicant name;
a photograph of the applicant; and
a student identification document.
11. A computer program product, comprising a computer non-transitory readable storage medium having embodied therewith computer readable program code configured to cause a processor to:
capture video data using a mobile device, the video data comprising a plurality of frames;
determine whether one or more of the frames depict a document exhibiting one or more defining characteristics;
determine whether one or more of the frame(s) determined to depict the document also satisfy one or more predetermined quality control criteria; and
in response to determining one or more of the frames depict the document and also satisfy the one or more predetermined quality control criteria, automatically capture an image of the document.
12. The computer program product as recited in claim 11 , wherein the image is characterized by a resolution higher than a resolution of any of the plurality of frames.
13. The computer program product as recited in claim 11 , wherein the defining characteristics comprise one or more of:
a document shape;
a document contour;
one or more document dimensions; and
a document color profile.
14. The computer program product as recited in claim 11 , wherein determining whether one or more of the frames depict the document comprises performing optical character recognition (OCR).
15. The computer program product as recited in claim 11 , wherein the defining characteristics comprise one or more of:
textual information depicted on the document;
a photograph depicted on the document;
a barcode depicted on the document;
a logo depicted on the document;
an emblem depicted on the document;
a seal depicted on the document; and
an aspect ratio of the document.
16. The computer program product as recited in claim 11 , wherein the document corresponds to a loan application; and
wherein the defining characteristics comprise the document depicting one or more of:
a customer name;
a guarantor name;
a customer address;
a date;
an account number
a loan number;
a digital signature;
a handwritten signature; and
a photograph.
17. The computer program product as recited in claim 11 , wherein the document comprises one or more of:
a receipt;
an expense report;
a credit card; and
a check; and
wherein the defining characteristics comprise the document depicting one or more of:
a credit card number;
a name;
an expense amount; and
an order number.
18. The computer program product as recited in claim 11 , wherein the document corresponds to an insurance claim; and
wherein the defining characteristics comprise the document depicting one or more of:
a photograph of an automobile;
a photograph of an accident report;
a photograph of a proof of insurance document;
a photograph of a driver's license;
a photograph of a quote; and
a signature.
19. The computer program product as recited in claim 11 , wherein the document corresponds to a delivery; and
wherein the defining characteristics comprise the document depicting one or more of:
a signature;
a proof of delivery;
a package number;
a photograph of a package; and
a declaration of package contents.
20. The computer program product as recited in claim 11 , wherein the document corresponds to an educational program application; and
wherein the defining characteristics comprise the document depicting one or more of:
an applicant name;
a photograph of the applicant; and
a student identification document.