Expression recognition in messaging systems
A computer device such as a smartphone includes at least one processor programmed to monitor a video feed from at least one camera to detect a facial profile of an operating user when a messaging interface is being used, match the detected facial profile against a known facial profile utilizing a facial recognition process to verify an identity of the operating user, determine a plurality of human expressions of the operating user based on the video feed and an expression recognition process, associate the plurality of human expressions with a plurality of contextual tags, generate a user profile in a user profile database based on the plurality of human expressions and the plurality of contextual tags, determine a current activity for the smartphone, associate the determined activity for the smartphone with one of the contextual tags, and update the user profile in the user profile database based on the association.
1 . A smartphone comprising at least one processor, at least one camera, at least one machine-readable storage medium, and software or firmware stored in the at least one machine-readable storage medium, the software or firmware including a text messaging application, wherein the at least one processor is programmed via the software or firmware to:
monitor a video feed from the at least one camera to detect a facial profile of an operating user when a messaging interface of the text messaging application is actively being used;
match the detected facial profile against a known facial profile utilizing a facial recognition process to verify an identity of the operating user;
determine a plurality of human expressions of the operating user based on the video feed and an expression recognition process;
associate each human expression of the plurality of human expressions with a contextual tag to generate a plurality of contextual tags;
generate a user profile in a user profile database based on the plurality of human expressions and the plurality of contextual tags;
determine a current activity for the smartphone;
associate the determined current activity for the smartphone with one of the plurality of contextual tags; and
update the user profile in the user profile database based on the association.
2 . The smartphone of claim 1 wherein the at least one processor is further programmed to present a targeted advertisement to the operating user on the messaging interface.
3 . The smartphone of claim 2 wherein the at least one processor is further programmed to present the targeted advertisement to the operating user on the messaging interface based on an identity of the operating user.
4 . The smartphone of claim 2 wherein the at least one processor is further configured to receive an expression trigger condition associated with the targeted advertisement, and to present the targeted advertisement to the operating user on the messaging interface in response to determining a current contextual tag based on a current human expression corresponds to the expression trigger condition.
5 . The smartphone of claim 4 wherein the at least one processor is further programmed to select the targeted advertisement from a plurality of options based on the current contextual tag.
6 . The smartphone of claim 1 wherein the at least one processor is further programmed to determine a targeted advertisement to display to the operating user on the messaging interface based on the user profile in the user profile database.