IP Library Granted Patent US 12,192,584
Granted Patent B2
US 12,192,584 · App. 18/521,071 · Granted Jan 7, 2025

Leveraging emotional transitions in media to modulate emotional impact of secondary content

Inventor: Mona Singh (Cary, NC)
Assignee: Adeia Guides Inc.
H04N21/4667H04N21/23424H04N21/4223H04N21/44218
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,192,584
App. No.
18/521,071
Granted
Jan 7, 2025
Kind
B2
Abstract

Systems and methods for determining emotional responses to videos, generating emotional arc based on the responses and reactions, and determining the type and/or point of insertion of secondary content based on the determined emotional responses are disclosed. The methods display primary content to a plurality of users and determine their emotional response as they consume the primary content. An average emotional arc is generated based on the determined emotional response and it is compared to a current emotional arc generated based on emotional response from a current user. When values of the current emotional are within a predefined range of the average emotional arc at a particular play position in the timeline of the primary content, a secondary content that is designated for the value of the current emotional arc is inserted in the primary content at the particular play position.

Claims (48)

1. A method comprising:

generating a primary emotional arc and a secondary emotional arc, wherein the primary emotional arc is generated based on emotional reaction data from a first plurality of users that have previously consumed a primary video and the secondary emotional arc is generated based on emotional reaction data from a second plurality of users that have previously consumed a secondary video;

determining points of intersection between the primary emotional arc and the secondary emotional arc, wherein each point of intersection is associated with an impact score;

selecting a point of intersection, from the determined points of intersection, based on the impact score; and

inserting in the primary video displayed on a display of an electronic device, the secondary video at the selected point of intersection.

2. The method of claim 1 further comprising:

monitoring a current user's emotional response to the secondary video that was inserted at the selected point of intersection, wherein the current user's emotional response is based on the current user's consumption of the secondary video; and

comparing the current user's emotional response to an expected emotional response, wherein the expected emotional response is based on the emotional reaction data from the second plurality of users that have previously consumed the secondary video.

3. The method of claim 2 , further comprising:

determining, based on the comparing, that the current user's emotional response is not within a predetermined threshold of the expected emotional response that is based on the emotional reaction data from the second plurality of users that have previously consumed the secondary video; and

in response to determining that the current user's emotional response is not within the predetermined threshold of the expected emotional response, identifying another secondary video and a point of insertion for inserting the identified secondary video into the primary video.

4. The method of claim 1 , wherein the selected point of intersection, from the determined points of intersection, is associated with a highest impact score.

5. The method of claim 4 , wherein the highest impact score is associated with a highest impact on a current user's emotional state if the secondary video is inserted at the selected point of insertion.

6. The method of claim 1 , wherein the first plurality of users are same users as the second plurality of users.

7. The method of claim 1 , wherein inserting the secondary video at the selected point of intersection further comprises:

determining a play position in the primary video at the selected point of intersection; and

inserting in the secondary video at the determined play position in the primary video.

8. The method of claim 1 , wherein the selected point of intersection is associated with the primary emotional arc and the secondary emotional arc having an emotional value that is within a predetermined threshold of each other.

9. The method of claim 1 , wherein generating the primary emotional arc comprises:

displaying the primary video to the first plurality of users;

obtaining emotional response data from the first plurality of users based on their consumption of the primary video; and

generating the primary emotional arc based on an average of the received emotional response data from the first plurality of users.

10. The method of claim 9 , further comprising using devices capable of collecting biometric data that are communicatively connected with a media device used by each user, from the first plurality of users, to obtain the emotional response data, wherein the devices used to collect the biometric means include any one or more of a motion sensor, a heartbeat or pulse monitor, a skin sensor, a gyroscope, and an accelerometer.

11. A system comprising:

communications circuitry for transmitting a video stream to a media device; and

control circuitry to:

generate a primary emotional arc and a secondary emotional arc, wherein the primary emotional arc is generated based on emotional reaction data from a first plurality of users that have previously consumed a primary video and the secondary emotional arc is generated based on emotional reaction data from a second plurality of users that have previously consumed a secondary video;

determine points of intersection between the primary emotional arc and the secondary emotional arc, wherein each point of intersection is associated with an impact score;

select a point of intersection, from the determined points of intersection, based on the impact score; and

insert in the primary video displayed on a display of an electronic device, the secondary video at the selected point of intersection.

12. The system of claim 11 , further comprising, the control circuitry configured to:

monitor a current user's emotional response to the secondary video that was inserted at the selected point of intersection, wherein the current user's emotional response is based on the current user's consumption of the secondary video; and

compare the current user's emotional response to an expected emotional response, wherein the expected emotional response is based on the emotional reaction data from the second plurality of users that have previously consumed the secondary video.

13. The system of claim 12 , further comprising, the control circuitry configured to:

determine, based on the comparing, that the current user's emotional response is not within a predetermined threshold of the expected emotional response that is based on the emotional reaction data from the second plurality of users that have previously consumed the secondary video; and

in response to determining that the current user's emotional response is not within the predetermined threshold of the expected emotional response, identify another secondary video and a point of insertion for inserting the identified secondary video into the primary video.

14. The system of claim 11 , wherein the selected point of intersection, from the determined points of intersection, is associated with a highest impact score.

15. The system of claim 14 , wherein the highest impact score is associated with a highest impact on a current user's emotional state if the secondary video is inserted at the selected point of insertion.

16. The system of claim 11 , wherein the first plurality of users are same users as the second plurality of users.

17. The system of claim 11 , wherein inserting the secondary video at the selected point of intersection further comprises, the control circuitry configured to:

determining a play position in the primary video at the selected point of intersection; and

inserting in the secondary video at the determined play position in the primary video.

18. The system of claim 11 , wherein the selected point of intersection is associated with the primary emotional arc and the secondary emotional arc having an emotional value that is within a predetermined threshold of each other.

19. The system of claim 11 , wherein generating the primary emotional arc further comprises, the control circuitry configured to:

display the primary video to the first plurality of users;

obtain emotional response data from the first plurality of users based on their consumption of the primary video; and

generate the primary emotional arc based on an average of the received emotional response data from the first plurality of users.

20. The system of claim 19 , further comprising, the control circuitry configured to use devices capable of collecting biometric data that are communicatively connected with the media device used by each user, from the first plurality of users, to obtain the emotional response data, wherein the devices used to collect the biometric means include any one or more of a motion sensor, a heartbeat or pulse monitor, a skin sensor, a gyroscope, and an accelerometer.

Assignments (2)
CHANGE OF NAME Recorded Oct 4, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069113/0406 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 29, 2023
From: SINGH, MONA
To: ROVI GUIDES, INC.
Reel/Frame 065694/0392 →
Continuity (2)
Continuation 17750664 · May 23, 2022
Related Publication 20240098337A1 · Mar 21, 2024
References Cited (23)
US 9105047B1 · Curran et al. · 2015 [cited by applicant]
US 9525912B1 · Israelian et al. · 2016 [cited by applicant]
US 9788777B1 · Knight · 2017 [cited by examiner]
US 9942615B1 · Panchaksharaiah et al. · 2018 [cited by applicant]
US 10171877B1 · Shah · 2019 [cited by examiner]
US 20030093784A1 · Dimitrova et al. · 2003 [cited by applicant]
US 20050289582A1 · Tavares et al. · 2005 [cited by applicant]
US 20090150919A1 · Lee et al. · 2009 [cited by applicant]
US 20130238419A1 · Glick · 2013 [cited by examiner]
US 20130283162A1 · Aronsson et al. · 2013 [cited by applicant]
US 20130288212A1 · Bist · 2013 [cited by applicant]
US 20130311270A1 · Daftary · 2013 [cited by examiner]
US 20170068847A1 · El Kaliouby et al. · 2017 [cited by applicant]
US 20170134803A1 · Shaw et al. · 2017 [cited by applicant]
US 20180260026A1 · Drake et al. · 2018 [cited by applicant]
US 20180349923A1 · Edwards · 2018 [cited by examiner]
US 20200336800A1 · Novick et al. · 2020 [cited by applicant]
US 20210117685A1 · Sureshkumar et al. · 2021 [cited by applicant]
US 20210168450A1 · Gritzman et al. · 2021 [cited by applicant]
US 20220148452A1 · Dellimore et al. · 2022 [cited by applicant]
US 20230379543A1 · Singh · 2023 [cited by applicant]
US 20230379544A1 · Singh · 2023 [cited by applicant]
Kollias, Dimitrios , et al., “Analysing Affective Behavior in the second ABAW2 Competition”, arXiv:2106.15318v2 [cs.CV] Jul. 3, 2021. [cited by applicant]