Voice based manual image review
Methods and systems for manual-based image review can involve associating an image with a group of keyword utterances, the image displayable in a display screen of a computing device, the group of keyword utterances including different keyword utterances. A prompt for the user to utter a keyword utterance can be displayed in a first area of the image in the display screen and another prompt for the user to utter another keyword utterance can be displayed in another area of the image in the display screen. Audio of the keyword utterances displayed in the display screen can be captured and processed by natural language processing (NLP), when uttered by the user. The utterances can be displayed respectively as text in the first area and the other area of the image in response to processing by NLP of the audio. Thus, instead of users typing in the results and changing their focus between screen and keyboard, for example, the user can speak to the results, which increases the throughput of the results.
1. A method for manual-based image review, comprising:
associating an image with a plurality of keyword utterances, the image displayable in a display screen of a computing device, the plurality of keyword utterances including different keyword utterances, wherein each area of the display screen displays at least one keyword utterance among the plurality of keyword utterances;
displaying for a user, a prompt for the user to utter the at least one keyword utterance among the plurality of keyword utterances in a first area of the image displayed in the display screen and another prompt for the user to utter at least one other keyword utterance among the plurality of keyword utterances in another area of the image displayed in the display screen;
capturing and processing by natural language processing (NLP), audio of the at least one keyword utterance and the at least one other keyword utterance when uttered by the user through an audio device operable to operate with the NLP, for display of the at least one keyword utterance and the at least one other keyword utterance as text in the respective first area and the another area of the image, in response to processing by NLP of the audio, wherein the NLP is operable to understand the at least one keyword utterance and post NLP results resulting from the capturing and the processing by the NLP;
wherein the NLP understands the at least one keyword utterance and the at least one other keyword utterance uttered by the user posts NLP results to a back office after the processing of the audio; and
the NLP comprises at least one of: NLP based on a hybrid sequence-to-sequence approach, and NLP processing review and override based on confidence analysis.
2. The method of claim 1 wherein the capturing and the processing by NLP of the at least one other keyword utterance further comprises: detecting the at least one other keyword utterance when uttered by the user.
3. The method of claim 1 wherein:
the capturing and the processing by NLP of the at least one other keyword utterance further comprises: detecting the at least one other keyword utterance when uttered by the user; and
the NLP understands the at least one keyword utterance and the at least one other keyword utterance uttered by the user posts NLP results to a back office after the processing of the audio.
4. The method of claim 1 wherein the image comprises an image of a vehicle.
5. The method of claim 4 wherein the plurality of keyword utterances associated with the image includes at least one of: a license plate number of the vehicle, a state of the vehicle, and a type of the vehicle.
6. The method of claim 1 wherein the image comprises an image of a vehicle and wherein the plurality of keyword utterances associated with the image includes at least one of: a license plate number of the vehicle, a state of the vehicle, and a type of the vehicle.
7. The method of claim 1 wherein the image comprises an image of a vehicle and wherein the plurality of keyword utterances associated with the image includes a license plate number of the vehicle, a state of the vehicle, and a type of the vehicle.
8. A system for manual-based image review, comprising:
a display screen for displaying an image associated with a plurality of keyword utterances, wherein the plurality of keyword utterances includes different keyword utterances;
a user interface for displaying for a user, a prompt for the user to utter at least one keyword utterance among the plurality of keyword utterances in a first area of the image displayed in the display screen and another prompt for the user to utter at least one other keyword utterance among the plurality of keyword utterances in another area of the image displayed in the display screen; and
an audio device for capturing and processing by natural language processing (NLP), audio of the at least one keyword utterance and the at least one other keyword utterance when uttered by the user through an audio device operable to operate with the NLP, for display of the at least one keyword utterance and the at least one other keyword utterance as text in the respective first area and the another area of the image, in response to processing by NLP of the audio, wherein the NLP is operable to understand the at least one keyword utterance and post NLP results resulting from the capturing and the processing by the NLP;
wherein the NLP understands the at least one keyword utterance and the at least one other keyword utterance uttered by the user posts NLP results to a back office after the processing of the audio; and
the NLP comprises at least one of: NLP based on a hybrid sequence-to-sequence approach, and NLP processing review and override based on confidence analysis.
9. The system of claim 8 wherein the capturing and the processing by NLP of the at least one other keyword utterance involves detecting the at least one other keyword utterance when uttered by the user.
10. The system of claim 8 wherein:
the capturing and the processing by NLP of the at least one other keyword utterance further comprises: detecting the at least one other keyword utterance when uttered by the user; and
the NLP understands the at least one keyword utterance and the at least one other keyword utterance uttered by the user posts NLP results to a back office after the processing of the audio.
11. The system of claim 8 wherein the image comprises an image of a vehicle.
12. The system of claim 11 wherein the plurality of keyword utterances associated with the image includes at least one of: a license plate number of the vehicle, a state of the vehicle, and a type of the vehicle.
13. The system of claim 11 wherein the image comprises an image of a vehicle and wherein the plurality of keyword utterances associated with the image includes at least one of: a license plate number of the vehicle, a state of the vehicle, and a type of the vehicle.
14. The system of claim 11 wherein the image comprises an image of a vehicle and wherein the plurality of keyword utterances associated with the image includes a license plate number of the vehicle, a state of the vehicle, and a type of the vehicle.
15. A computer program product for facilitating manual-based image review of images, the computer program product comprising one or more non-transitory computer readable storage media and program instructions collectively stored on the one or more non-transitory computer readable storage media, the program instructions comprising program instructions to:
associate an image with a plurality of keyword utterances, the image displayable in a display screen of a computing device, the plurality of keyword utterances including different keyword utterances;
display for a user, a prompt for the user to utter at least one keyword utterance among the plurality of keyword utterances in a first area of the image displayed in the display screen and another prompt for the user to utter at least one other keyword utterance among the plurality of keyword utterances in another area of the image displayed in the display screen; and
capture and process by natural language processing (NLP), audio of the at least one keyword utterance and the at least one other keyword utterance when uttered by the user through an audio device operable to operate with the NLP, for display of the at least one keyword utterance and the at least one other keyword utterance as text in the respective first area and the another area of the image, in response to processing by NLP of the audio, wherein the NLP is operable to understand the at least one keyword utterance and post NLP results resulting from the capturing and the processing by the NLP;
wherein the NLP understands the at least one keyword utterance and the at least one other keyword utterance uttered by the user posts NLP results to a back office after the processing of the audio; and
the NLP comprises at least one of: NLP based on a hybrid sequence-to-sequence approach, and NLP processing review and override based on confidence analysis.
16. The computer program product of claim 15 wherein the program instructions further comprise program instructions to detect the at least one other keyword utterance when uttered by the user.
17. The computer program product of claim 15 wherein:
the image comprises an image of a vehicle; and
the plurality of keyword utterances associated with the image includes at least one of: a license plate number of the vehicle, a state of the vehicle, and a type of the vehicle.