Voice commands for the visually impaired to move a camera relative to a document
View Patent ↗A system and method for providing aural guidance in imaging a document is disclosed. Visually impaired people may have difficulty when imaging a document with a mobile computing device. The system and method may analyze the image of the document in the imaging device, and output one or more aural directions in order for the user to move the document and/or camera for proper imaging of the document. In that regard, those with visual impairments may be assisted in imaging documents using a mobile computing device.
1. A method for outputting aural guidance to a visually impaired user, the method comprising:
receiving, at a mobile computing device, a user input indicative of requesting to image a document;
in response to receipt of the user input, a processor of the mobile computing device automatically searching for the document in part or all of a field of view of a camera associated with the mobile computing device;
determining an offset of the document relative to the camera, the offset comprising a direction to move one or both of the document or the camera so that the document is entirely within the field of view or so that the document is at least a certain percentage of the field of view;
generating a first aural command, the first aural command containing one or more instructions to the user regarding a direction to move one or both of the camera or the document based on the direction;
transmitting the first aural command from a sound generating interface associated with the mobile computing device;
after transmitting the first aural command, determining whether the document is entirely within the field of view or is at least the certain percentage of the field of view; and
responsive to the determining that the document is entirely within the field of view or is at least the certain percentage of the field of view, transmitting a second aural command from the sound generating interface, the second aural command containing one or more instructions to the user to hold the camera steady.
2. The method of claim 1 , wherein the camera includes an alignment guide;
wherein determining the offset of the document relative to the camera comprises determining the direction to move so that the document is within the alignment guide; and
further comprising automatically capturing an image of the document upon determining that an entirety of the document is within the alignment guide.
3. The method of claim 1 , wherein the direction comprises a direction perpendicular to a surface of the document; and
wherein the first aural command comprises moving the camera closer to or further away from the document.
4. The method of claim 3 , wherein determining the offset of the document relative to the field of view of the camera comprises:
searching an image of the document in order to identify a number of edges for the document; and
determining the offset based on the number of edges identified.
5. The method of claim 1 , wherein the document comprises a negotiable instrument.
6. The method of claim 1 , wherein the first aural command contains one or more instructions to the user regarding the direction to move the camera relative to the document.
7. The method of claim 1 , wherein determining the offset of the document relative to the camera comprises:
determining a first offset of the document relative to the camera based on a first image generated by the camera;
determining a second offset of the document relative to the camera based on a second image generated by the camera, wherein the second image is generated by the camera later in time than the first image generated by the camera; and
determining a change between the first offset and the second offset, wherein the first aural command is a relative command indicating a command based on previous movement of the user.
8. A mobile apparatus to output aural guidance to a visually impaired user, the apparatus comprising:
an image capture device;
an input device configured to receive a user input indicative of requesting to image a document;
an aural output device configured to output aural commands; and
a controller in communication with the image capture device, the input device, and the aural output device, the controller configured to:
in response to receipt of the user input, automatically search for the document in part or all of a field of view of image capture device;
determine an offset of the document relative to the image capture device, the offset comprising a direction to move one or both of the document or the image capture device so that the document is entirely within the field of view or so that the document is at least a certain percentage of the field of view;
generate a first aural command, the first aural command containing one or more instructions to a user regarding the direction to move one or both of the image capture device or the document;
transmit the aural command to the aural output device for output of the aural command;
after transmitting the first aural command, determine whether the document is entirely within the field of view or is at least the certain percentage of the field of view; and
responsive to the determining that the document is entirely within the field of view or is at least the certain percentage of the field of view, transmit a second aural command from the aural output device, the second aural command containing one or more instructions to the user to hold the image capture device steady.
9. The apparatus of claim 8 , wherein the image capture device includes an alignment guide;
wherein the controller is configured to determine the offset of the document relative to the image capture device by determining the direction to move so that the document is within the alignment guide; and
wherein the controller is further configured to automatically capture an image of the document upon determining that an entirety of the document is within the alignment guide.
10. The apparatus of claim 8 , wherein the direction comprises a direction perpendicular to a surface of the document; and
wherein the first aural command comprises moving the image capture device closer to or further away from the document.
11. The apparatus of claim 10 , wherein the controller is configured to determine the offset of the document relative to the field of view of the image capture device by:
searching an image of the document in order to identify a number of edges for the document; and
determining the offset based on the number of edges identified.
12. The apparatus of claim 8 , wherein the first aural command contains one or more instructions to the user regarding the direction to move the image capture device relative to the document.
13. The apparatus of claim 8 , wherein the controller is configured to determine the offset of the document relative to the image capture device by:
determining a first offset of the document relative to the image capture device based on a first image generated by the image capture device;
determining a second offset of the document relative to the image capture device based on a second image generated by the image capture device, wherein the second image is generated by the camera later in time than the first image generated by the camera; and
determining a change between the first offset and the second offset, wherein the first aural command is a relative command indicating a command based on previous movement of the user.