IP Library › Granted Patent US 12,593,104
Granted Patent B2
US 12,593,104 · App. 18/965,505 · Granted Mar 31, 2026

Leveraging emotional transitions in media to modulate emotional impact of secondary content

Inventor: Mona Singh (Cary, NC)
Assignee: Adeia Guides Inc.
H04N21/4667H04N21/23424H04N21/4223H04N21/44218
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,593,104
App. No.
18/965,505
Granted
Mar 31, 2026
Kind
B2
Abstract

Systems and methods for determining emotional responses to videos, generating emotional arc based on the responses and reactions, and determining the type and/or point of insertion of secondary content based on the determined emotional responses are disclosed. The methods display primary content to a plurality of users and determine their emotional response as they consume the primary content. An average emotional arc is generated based on the determined emotional response and it is compared to a current emotional arc generated based on emotional response from a current user. When values of the current emotional are within a predefined range of the average emotional arc at a particular play position in the timeline of the primary content, a secondary content that is designated for the value of the current emotional arc is inserted in the primary content at the particular play position.

Claims (52)

1 . A method comprising:

displaying a primary content item to a current user;

capturing, via at least one sensor, the current users emotional response as a dynamic emotional arc during consumption of the primary content item at a current play position;

accessing emotional arc profiles for a plurality of secondary content items, wherein each profile is associated with an emotional arc for a specific secondary content item;

predicting, based on the dynamic emotional arc, a future emotional state of the current user at a subsequent play position in the primary content item;

selecting a secondary content item that relates to the predicted future emotional state; and

inserting the selected secondary content item into the primary content item at the subsequent play position.

2 . The method of claim 1 , wherein selecting the secondary content item further comprises:

analyzing contextual data of each secondary content item that is relevant to the primary content item; and

selecting the secondary content item with the highest contextual relevance to the primary content for inserting into the primary content item at the subsequent play position.

3 . The method of claim 1 , wherein predicting the future emotional state of the current user further comprises:

determining a pattern of response based on the real-time emotional response at the current play position; and

generating an estimated emotional arc for the subsequent play position based on the pattern.

4 . The method of claim 1 , wherein the current users emotional response is captured based on the current user's biometric data obtained while the current user is consuming the primary content item.

5 . The method of claim 4 , wherein the biometrics data includes heart rate data, galvanic skin response data, or facial expression data.

6 . The method of claim 4 , wherein the dynamic emotional arc is generated based on the current user's biometric data.

7 . The method of claim 1 , wherein the dynamic emotional arc represents changes in activation and valence values corresponding to the current user's emotional state over time.

8 . The method of claim 1 , wherein the inserting the selected secondary content item into the primary content at the subsequent play position comprises:

determining the subsequent play position based on an occurrence of a predetermined event within the primary content; and

inserting the selected secondary content item at the determined subsequent play position corresponding to the occurrence of the predetermined event.

9 . The method of claim 8 , wherein the primary content is a live broadcast.

10 . The method of claim 1 , wherein the inserting the selected secondary content item into the primary content at the subsequent play position comprises:

monitoring the dynamic emotional arc of the primary content;

determining when a value of the dynamic emotional arc reaches a desired value; and

inserting the selected secondary content item at the subsequent play position when the value of the dynamic emotional arc reaches the desired value.

11 . A system comprising:

communications circuitry for transmitting a primary content item to a media device; and

control circuitry configured to:

display the primary content item to a current user;

capture, via at least one sensor, the current users emotional response as a dynamic emotional arc during consumption of the primary content item at a current play position;

access emotional arc profiles for a plurality of secondary content items, wherein each profile is associated with an emotional arc for a specific secondary content item;

predict, based on the dynamic emotional arc, a future emotional state of the current user at a subsequent play position in the primary content item;

select a secondary content item that relates to the predicted future emotional state; and

insert the selected secondary content item into the primary content item at the subsequent play position.

12 . The system of claim 11 , wherein selecting the secondary content item further comprises, the control circuitry configured to:

analyze contextual data of each secondary content item that is relevant to the primary content item; and

select the secondary content item with the highest contextual relevance to the primary content for inserting into the primary content item at the subsequent play position.

13 . The system of claim 11 , wherein predicting the future emotional state of the current user further comprises, the control circuitry configured to:

determine a pattern of response based on the real-time emotional response at the current play position; and

generate an estimated emotional arc for the subsequent play position based on the pattern.

14 . The system of claim 11 , wherein the current users emotional response is captured by the control circuitry based on the current user's biometric data obtained while the current user is consuming the primary content item.

15 . The system of claim 14 , wherein the biometrics data includes heart rate data, galvanic skin response data, or facial expression data.

16 . The system of claim 14 , wherein the dynamic emotional arc is generated by the control circuitry based on the current user's biometric data.

17 . The system of claim 11 , wherein the dynamic emotional arc represents changes in activation and valence values corresponding to the current user's emotional state over time.

18 . The system of claim 11 , wherein the inserting the selected secondary content item into the primary content at the subsequent play position comprises, the control circuitry configured to:

determine the subsequent play position based on an occurrence of a predetermined event within the primary content; and

insert the selected secondary content item at the determined subsequent play position corresponding to the occurrence of the predetermined event.

19 . The system of claim 18 , wherein the primary content is a live broadcast.

20 . The system of claim 11 , wherein the inserting the selected secondary content item into the primary content at the subsequent play position comprises, control circuitry configured to:

monitor the dynamic emotional arc of the primary content;

determine when a value of the dynamic emotional arc reaches a desired value; and

insert the selected secondary content item at the subsequent play position when the value of the dynamic emotional arc reaches the desired value.

Assignments (3)
SECURITY INTEREST Recorded May 28, 2025
From: ADEIA INC. (F/K/A XPERI HOLDING CORPORATION); ADEIA HOLDINGS INC.; ADEIA MEDIA HOLDINGS INC.; ADEIA IMAGING LLC; ADEIA MEDIA LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA TECHNOLOGIES INC.; ADEIA GUIDES INC.; ADEIA SOLUTIONS LLC; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR INTELLECTUAL PROPERTY LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA PUBLISHING INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 071454/0343 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2024
From: SINGH, MONA
To: ROVI GUIDES, INC.
Reel/Frame 069483/0891 →
CHANGE OF NAME Recorded Dec 4, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069495/0264 →
Continuity (3)
Continuation 18521071 · Nov 28, 2023
Continuation 17750664 · May 23, 2022
Related Publication 20250227333A1 · Jul 10, 2025
References Cited (23)
US 9105047B1 · Curran et al. · 2015 [cited by applicant]
US 9525912B1 · Israelian et al. · 2016 [cited by applicant]
US 9788777B1 · Knight · 2017 [cited by examiner]
US 9942615B1 · Panchaksharaiah et al. · 2018 [cited by applicant]
US 11822719B1 · Chappell, III · 2023 [cited by examiner]
US 20030093784A1 · Dimitrova et al. · 2003 [cited by applicant]
US 20050289582A1 · Tavares et al. · 2005 [cited by applicant]
US 20090150919A1 · Lee et al. · 2009 [cited by applicant]
US 20130283162A1 · Aronsson et al. · 2013 [cited by applicant]
US 20130288212A1 · Bist · 2013 [cited by applicant]
US 20170053320A1 · Russek · 2017 [cited by examiner]
US 20170068847A1 · El Kaliouby et al. · 2017 [cited by applicant]
US 20170134803A1 · Shaw et al. · 2017 [cited by applicant]
US 20180260026A1 · Drake et al. · 2018 [cited by applicant]
US 20180349923A1 · Edwards · 2018 [cited by examiner]
US 20200336800A1 · Novick et al. · 2020 [cited by applicant]
US 20210117685A1 · Sureshkumar et al. · 2021 [cited by applicant]
US 20210168450A1 · Gritzman et al. · 2021 [cited by applicant]
US 20220148452A1 · Dellimore et al. · 2022 [cited by applicant]
US 20230038347A1 · Rajanna et al. · 2023 [cited by applicant]
US 20230379543A1 · Singh · 2023 [cited by applicant]
US 20230379544A1 · Singh · 2023 [cited by applicant]
Kollias et al., “Analysing Affective Behavior in the second ABAW2 Competition,” arXiv:2106.15318v2 [cs.CV] (Jul. 2021) (8 Pages). [cited by applicant]