Expression recognition in messaging systems
Some embodiments include a messaging system capable of expression-based communication and/or expression-based actions. The messaging system can run on a computing device. For example, the messaging system monitors a camera feed from a camera of the computing device to detect a biometric signature when a messaging interface of the messaging application is actively being used. The messaging system can match the detected biometric signature against a known profile utilizing a facial recognition process to authenticate an operating user to use the messaging application. The messaging system can determine a human expression based on the detected biometric signature utilizing an expression recognition process to associate a contextual tag with an activity on the messaging interface. The messaging system can then communicate with a message server system to associate the contextual tag with content presented to the operating user or a conversation participated by the operating user via the messaging application.
1. A computer device comprising at least one processor in communication with at least one memory device, wherein the at least one processor is programmed to:
receive a selection of an emoticon;
monitor a sensor feed provided by one or more sensors of the computer device to detect a plurality of human facial expression states;
automatically generate a dynamic emoticon that simulates the detected plurality of human facial expression states on the selected emoticon based on the sensor feed of the plurality of human facial expression states; and
route a message with the dynamic emoticon to a second computer device.
2. The computer device of claim 1 , wherein a messaging interface is used to compose the message, and wherein the dynamic emoticon is embedded as part of the message.
3. The computer device of claim 1 , wherein the at least one processor is further programmed to detect a facial profile and to match the facial profile against a known facial profile utilizing a facial recognition process to authenticate an operating user.
4. The computer device of claim 1 , wherein the detected plurality of human facial expression states includes a smile, a laugh, a grimace, a frown, a pout, or any combination thereof.
5. The computer device of claim 1 , wherein the detected plurality of human facial expression states includes an expression corresponding to a mood or an emotion, a micro expression, a stimulated expression, a neutralized expression, a masked expression, or any combination thereof.
6. The computer device of claim 1 , where the at least one processor is further programmed to analyze a human facial expression using an expression recognition process to detect the human facial expression state.
7. The computer device of claim 1 , wherein the dynamic emoticon is embedded at a displayable portion of the message.
8. The computer device of claim 1 , wherein a human facial expression is captured in real-time from the one or more sensors.
9. The computer device of claim 1 , wherein the at least one processor is further programmed to detect a plurality of human facial expression states on a periodic basis based on a predetermined period of time.
10. The computer device of claim 1 , wherein the sensor feed is analyzed for an expression recognition process and a biometric recognition process.
11. A computer-implemented method of operating a messaging application, the method comprising:
receiving a selection of an emoticon;
monitoring a sensor feed provided by one or more sensors of a computer device to detect a plurality of human facial expression states;
automatically generating a dynamic emoticon that simulates the detected plurality of human facial expression states on the selected emoticon based on the sensor feed of the plurality of human facial expression states; and
route a message with the dynamic emoticon to a second computer device.
12. The computer-implemented method of claim 11 , wherein a messaging interface is used to compose the message, and wherein the dynamic emoticon is embedded as part of the message.
13. The computer-implemented method of claim 11 , further comprising detecting a facial profile and matching the facial profile against a known facial profile utilizing a facial recognition process to authenticate an operating user.
14. The computer-implemented method of claim 11 , wherein the detected plurality of human facial expression states includes a smile, a laugh, a grimace, a frown, a pout, or any combination thereof.
15. The computer-implemented method of claim 11 , wherein the detected plurality of human facial expression states includes an expression corresponding to a mood or an emotion, a micro expression, a stimulated expression, a neutralized expression, a masked expression, or any combination thereof.
16. The computer-implemented method of claim 11 , further comprising analyzing a human facial expression using an expression recognition process to detect the human facial expression state.
17. The computer-implemented method of claim 11 , wherein a human facial expression is captured in real-time from the one or more sensors.
18. The computer-implemented method of claim 11 , further comprising continuously detecting human facial expression states using one or more sensors of the computer device after detecting a first human facial expression state.
19. At least one non-transitory computer-readable storage media having computer-executable instructions embodied thereon, wherein when executed by a computer device having at least one processor in communication with at least one memory device, the computer-executable instructions cause the processor to:
receive a selection of an emoticon;
monitor a sensor feed provided by one or more sensors of the computer device to detect a plurality of human facial expression state;
automatically generate a dynamic emoticon that displays the selected emoticon changing to the plurality of detected human facial expression states based on the sensor feed of the plurality of human facial expression states; and
route a message with the dynamic emoticon to a second computer device, wherein the second computer device displays the selected emoticon changing to the detected plurality of human facial expression states.
20. The at least one non-transitory computer-readable storage media of claim 19 , wherein the detected plurality of human facial expression states includes a smile, a laugh, a grimace, a frown, a pout, or any combination thereof.