Live document detection in a captured video stream
The present disclosure is directed toward systems and methods to quickly and accurately identify boundaries of a displayed document in a live camera image feed, and provide a document boundary indicator within the live camera image feed. For example, systems and methods described herein utilize different display document detection processes in parallel to generate and provide a document boundary indicator that accurately corresponds with a displayed document within a live camera image feed. Thus, a user of the mobile computing device can easily see whether the document identification system has correctly identified the displayed document within the camera viewfinder feed.
1. A computer-implemented method comprising:
capturing, from a live camera feed on a mobile device, a first image frame comprising a visual representation of a first physical document;
generating a first enhanced document image corresponding to the first physical document;
capturing, from the live camera feed on the mobile device, a second image frame comprising a visual representation of a second physical document;
generating a second enhanced document image corresponding to the second physical document; and
combining the first enhanced document image and the second enhanced document image to generate a single document file having a document file format.
2. The computer-implemented method of claim 1 , further comprising:
providing, for display within a graphical user interface of the mobile device, the first enhanced document image; and
providing an add page graphical element within the graphical user interface while displaying the first enhanced document image.
3. The computer-implemented method of claim 2 , further comprising: providing, for display in the graphical user interface, a camera viewfinder interface, the camera viewfinder interface comprising a capture button, wherein capturing the first image frame comprising a visual representation of a first physical document is based on receiving an indication of a user interaction with the capture button.
4. The computer-implemented method of claim 1 , wherein:
the mobile device is associated with a user account; and
the computer-implemented method further comprises syncing the single document file with a client device associated with the user account.
5. The computer-implemented method of claim 1 , wherein:
the mobile device is associated with a user account; and
the computer-implemented method further comprises syncing the single document file with a client device associated with a different user account.
6. The computer-implemented method as recited in claim 1 , wherein the document file format is a word processor format or a portable document format.
7. A non-transitory computer-readable medium storing instructions thereon that, when executed by at least one processor, cause a computing device to:
provide, for display within a graphical user interface, a camera viewfinder comprising a live camera feed;
capture a first image frame from the live camera feed, the first image frame comprising a visual representation of a first physical document;
generate a first enhanced document image corresponding to the first physical document;
capture a second image frame from the live camera feed, the second image frame comprising a visual representation of a second physical document;
generate a second enhanced document image corresponding to the second physical document; and
create a single document file having a document file format from the first enhanced document image and the second enhanced document image.
8. The non-transitory computer-readable medium as recited in claim 7 , further comprising instructions that, when executed by the at least one processor, cause the computing device to provide, within the camera viewfinder, a live boundary indicator associated with a visual representation of the first physical document.
9. The non-transitory computer-readable medium as recited in claim 7 , wherein the first image frame and the second image frame comprise files in a picture file format.
10. The non-transitory computer-readable medium as recited in claim 7 , further comprising instructions that, when executed by the at least one processor, cause the computing device to:
provide the first enhanced document image for display within the graphical user interface after generating the first enhanced document image; and
provide an add page graphical element within the graphical user interface while displaying the first enhanced document image.
11. The non-transitory computer-readable medium as recited in claim 10 , further comprising instructions that, when executed by the at least one processor, cause the computing device to:
provide the second enhanced document image for display within the graphical user interface after generating the second enhanced document image; and
provide the add page graphical element within the graphical user interface while displaying the second enhanced document image.
12. The non-transitory computer-readable medium as recited in claim 7 , further comprising instructions that, when executed by the at least one processor, cause the computing device to provide, for display within the graphical user interface, a content item object corresponding to the single document file within a listing content item objects associated with a user account.
13. The non-transitory computer-readable medium as recited in claim 7 , further comprising instructions that, when executed by the at least one processor, cause the computing device to sync the single document file with a client device that is different than the computing device.
14. The non-transitory computer-readable medium as recited in claim 7 , further comprising instructions that, when executed by the at least one processor, cause the computing device to provide, for display in the graphical user interface, a camera viewfinder interface, the camera viewfinder interface comprising a capture button, wherein capturing the first image frame comprising a visual representation of a first physical document is based on receiving an indication of a user interaction with the capture button.
15. A system comprising:
at least one processor; and
at least one non-transitory computer-readable storage medium storing instructions thereon that, when executed by the at least one processor, cause the system to:
capture a first image frame from a live camera feed, the first image frame comprising a visual representation of a first physical document;
generate a first enhanced document image corresponding to the first physical document, wherein generating the first enhanced document image comprises modifying the first image frame to correct visual characteristics of the first image frame;
capture a second image frame from the live camera feed, the second image frame comprising a visual representation of a second physical document;
generate a second enhanced document image corresponding to the second physical document, wherein generating the second enhanced document image comprises modifying the second image frame to correct visual characteristics of the second image frame; and
create a single document file from the first enhanced document image and the second enhanced document image, the single document file having a document file format.
16. The system as recited in claim 15 , further comprising instructions, that when executed by the at least one processor, cause the system to:
provide, for display within a graphical user interface, the first enhanced document image; and
provide an add page graphical element within the graphical user interface while displaying the first enhanced document image.
17. The system as recited in claim 15 , further comprising instructions, that when executed by the at least one processor, cause the system to provide, for display in a graphical user interface, a camera viewfinder interface, the camera viewfinder interface comprising a capture button, wherein capturing the first image frame comprising a visual representation of a first physical document is based on receiving an indication of a user interaction with the capture button.
18. The system as recited in claim 15 , wherein:
the live camera feed is generated by a mobile device associated with a user account; and
the system further comprises instructions that, when executed by the at least one processor, cause the system to sync the single document file with a client device associated with the user account.
19. The system as recited in claim 15 , wherein:
the live camera feed is generated by a mobile device associated with a first user account; and
the system further comprises instructions that, when executed by the at least one processor, cause the system to sync the single document file with a client device associated with a second user account.
20. The system as recited in claim 15 , further comprising instructions that, when executed by the at least one processor, cause the system to provide, for display within a graphical user interface, a content item object corresponding to the single document file within a listing content item objects associated with a user account.