Method and apparatus for shared viewing of media content
In systems and methods for enhancing group watch experiences, a first user's reaction is detected using multiple sensors, e.g., at least one camera and a microphone, and may be combined with context information to determine an action to perform at user equipment devices of other users participating in the group watch to convey the first user's reaction. Images from the at least one camera can be used to determine a portion of the screen to which the user's reaction is directed and/or another user to whom the reaction is directed. The reaction may be conveyed using one or more of an audio effect, a visual effect, haptic effect or text, e.g., to highlight the determined portion or user, display an icon and/or output an audio or video clip. A signal for providing haptic feedback may be transmitted to the user equipment device of the determined user.
1. A method comprising:
generating for display, using control circuitry of a first user equipment device, media content in a shared viewing session;
monitoring, using the control circuitry, actions by a first user of the first user equipment device, wherein monitoring the actions of the first user comprises:
monitoring, based on an output from one or more cameras, physical gestures by the first user;
detecting, using the control circuitry, a reaction of the first user based on the monitored actions;
determining, using the control circuitry, a context of the reaction based on the media content and/or user profile information of the first user;
transmitting, to at least a second user equipment device participating in the shared viewing session, a message based on the reaction of the first user and the determined context;
generating for display one or more images of respective other users participating in the shared viewing session;
determining, based on the output from the one or more cameras, that the first user is pointing at a third portion of a display screen displaying one of the one or more images; and
determining that the image corresponds to a user of the second user equipment device;
wherein the message is transmitted to the second user equipment device in response to determining that the third portion of the display screen corresponds to the user of the second user equipment device.
2. The method of claim 1 , wherein monitoring the actions of the first user comprises:
monitoring, via an audio input device, sounds from the first user.
3. The method of claim 2 , wherein:
monitoring the actions of the first user comprises determining, based on the output from the one or more cameras, that the first user is pointing at a first portion of a display screen displaying the media content; and
including, in the message, an indication of the first portion of the display screen or an indication of particular content shown in the first portion of the display screen.
4. The method of claim 3 , further comprising:
receiving, using control circuitry of the second user equipment device, the message from the first user equipment device; and
generating for output, using the control circuitry of the second user equipment device, a visual effect highlighting a second portion of the media content corresponding to the first portion indicated by the message.
5. The method of claim 4 , wherein generating for output the effect comprises transmitting, to a haptic device, an instruction to provide a haptic effect.
6. The method of claim 2 , further comprising:
determining, using the control circuitry, that sounds from the first user received via the audio input device include a remark regarding a future event in the media content;
monitoring, using the control circuitry, the media content to determine an outcome of the event;
determining, using the control circuitry, whether the outcome of the event is consistent with the remark;
generating for output, using the control circuitry receiving, an audio effect and/or a visual effect based on whether the outcome is consistent with the remark; and
transmitting, to at least a second user equipment device participating in the shared viewing session, a message based on whether the outcome is consistent with the remark.
7. The method of claim 1 , further comprising:
receiving, using control circuitry of the second user equipment device, the message from the first user equipment device;
generating for output, using the control circuitry of the second user equipment device, one or more of a visual effect, an audio effect or a haptic effect based on the message.
8. The method of claim 7 , further comprising:
receiving, using control circuitry of the second user equipment device, the message from the first user equipment device;
determining, using the control circuitry of the second user equipment device, based on the received message, at least one of a visual effect, an audio effect or a haptic effect corresponding to the reaction of the first user and the determined context; and
generating for output, using the control circuitry of the second user equipment device, the at least one determined effect.
9. The method of claim 1 , further comprising:
determining, using the control circuitry, at least one of a visual effect, an audio effect or a haptic effect corresponding to the reaction of the first user and the determined context;
wherein the message includes an indication of the at least one determined effect.
10. The method of claim 1 , wherein the shared viewing session is a group watch session of live media content, a group watch session of on-demand video content, a videocall, a videoconference, a multi-player game or screen-sharing session.
11. A non-transitory computer-readable medium on which are stored computer-readable instructions for performing the method of claim 1 .
12. An apparatus comprising: control circuitry configured to:
generate for display media content in a shared viewing session;
monitor actions by a first user of a first user equipment device;
detect a reaction of the first user based on the monitored actions;
determine a context of the reaction based on the media content and/or user profile information of the first user; and
transmit, to at least a user equipment device participating in the shared viewing session, a message based on the reaction of the first user and the determined context; and
one or more cameras arranged to capture images of physical actions by the first user;
wherein the control circuitry is further configured to:
generate for display one or more images of respective other users participating in the shared viewing session;
determine, based on an output from the one or more cameras, that the first user is pointing at a third portion of a display screen displaying one of the one or more images; and
determine that the image corresponds to a user of the user equipment device;
wherein the control circuitry is configured to transmit the message to the user equipment device in response to determining that the third portion of the display screen corresponds to the user of the user equipment device.
13. The apparatus of claim 12 , further comprising:
an audio input device configured to capture verbal cues from the first user.
14. The apparatus of claim 13 , wherein the control circuitry is further configured to:
determine, based on an output from the one or more cameras, that the first user is pointing at a first portion of a display screen displaying the media content; and
include, in the message, an indication of the first portion of the display screen or an indication of particular content shown in the first portion of the display screen.
15. A system comprising:
the apparatus of claim 14 ; and
the user equipment device, comprising second control circuitry configured to:
receive, using control circuitry of the user equipment device, the message from the first user equipment device; and
generate for output, using the control circuitry of the apparatus, a visual effect highlighting a second portion of the media content corresponding to the first portion indicated by the message.
16. The apparatus of claim 12 , further comprising:
the user equipment device, comprising second control circuitry configured to receive the message and generate for output one or more of a visual effect, an audio effect or a haptic effect based on the message.
17. The apparatus of claim 16 , wherein the second control circuitry is further configured to:
receive, using the second control circuitry, the message from the first user equipment device; and
determine, using the control circuitry of the second user equipment device, based on the received message, the one or more of a visual effect, an audio effect or a haptic effect corresponding to the reaction of the first user and the determined context.
18. The apparatus of claim 16 , wherein the control circuitry is further configured to:
determine that verbal cues from the first user received via the audio input device include a remark regarding a future event in the media content;
monitor the media content to determine an outcome of the event;
determine, using the control circuitry, whether the outcome of the event is consistent with the remark;
generate for output an audio effect and/or a visual effect based on whether the outcome is consistent with the remark; and
transmit, to at least the user equipment device participating in the shared viewing session, a message based on whether the outcome is consistent with the remark.