IP Library Granted Patent US 11,562,016
Granted Patent B2
US 11,562,016 · App. 16/453,841 · Granted Jan 24, 2023

Systems and methods for generating supplemental content for media content

Inventors: Sakura Saito (Tokyo, JP); Alan Waterman (Merced, CA)
Assignee: Rovi Guides, Inc.
G06F16/5846G06F3/0483G06F16/538G06F16/90344G06F40/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,562,016
App. No.
16/453,841
Granted
Jan 24, 2023
Kind
B2
Abstract

Systems and methods are disclosed herein for generating supplemental content for media content. One disclosed technique herein generates for display a page of an electronic book. A noun, and a word contextually related to the noun, are identified from the displayed page of the electronic book. Content structures are searched for a content structure that includes a matching object having an object name matching the noun. The content structure includes objects, where each object has attribute table entries. Upon finding an identified attribute table entry of the matching object that matches the related word, a new content structure is generated. The new content structure includes the matching object and the identified attribute table entry. A content segment is generated for output (e.g., for display on the electronic book) based on the new content structure.

Claims (88)

1. A method for generating supplemental content for media content, the method comprising:

generating for display a particular page of an electronic book;

identifying, with a linguistics processing engine and without receiving user interface input, a noun from the displayed particular page;

identifying a related word from the displayed page that is contextually related to the noun and identifies an action related to the noun;

searching a plurality of content structures for a content structure that comprises a matching object with an object name that matches the noun, wherein each of the plurality of content structures comprises:

an attribute table including one or more object data structures, each object data structure comprising one or more attribute table entries including a feature, and a temporal mapping indicating a time period to which the feature applies; and

in response to identifying an attribute table entry of the matching object that matches the related word:

generating a new content structure comprising the matching object, wherein the matching object comprises the identified attribute table entry; and

generating for output a content segment based on the new content structure, wherein the content segment is a video displayed on the particular page of a display of the electronic book as the particular page displaying the noun and the related word, wherein the video depicts the identified action performed in relation to the noun.

2. The method of claim 1 , wherein:

in response to identifying an attribute table entry of the matching object that does not match the related word, determining an approximate attribute table entry of the matching object that matches the related word;

generating a new content structure comprising the matching object, wherein the matching object comprises the approximate attribute table entry; and

generating for output a content segment based on the new content structure.

3. The method of claim 1 , wherein:

in response to identifying an attribute table entry of the matching object that does not match the related word:

generating a new content structure comprising the matching object excluding the non-matching attribute table entry; and

generating for output a content segment based on the new content structure.

4. The method of claim 1 , wherein:

the plurality of content structures further comprises virtual modelling data for the one or more objects and one or more attribute table entries of each of the one or more objects, wherein the virtual modelling data includes at least one of 2D animation, 3D animation, holographic representation, avatar-based modelling, or representations produced from artificial intelligence generation engines; and

generating for output a content segment based on the new content structure comprises:

determining matching virtual modelling data of the matching object comprising the identified attribute table entry;

rendering the content segment based on the matching virtual modelling data; and

generating for output the rendered content segment.

5. The method of claim 1 , wherein the attribute table is mapped against a plurality of time stamps, and wherein:

the method further comprises:

determining a first reading location at a first time stamp of the plurality of time stamps on the page of the electronic book;

determining a second reading location at a second time stamp of the plurality of time stamps on the page of the electronic book, wherein the second time stamp occurs subsequent to the first time stamp;

determining the amount of text between the first reading location and the second reading location; and

determining an average reading speed value based on the amount of text, and a difference between the first time stamp and the second time stamp; and

generating for output the content segment based on the new content structure comprises outputting the content segment for an output duration based on the average reading speed value.

6. The method of claim 5 , wherein determining at least one of the first reading location or second reading location comprises:

determining, using an optical sensor, a viewing angle of a user on the displayed page of the electronic book; and

determining, based on the viewing angle of the user on the displayed page of the electronic book, a particular line of text on the displayed page of the electronic book.

7. The method of claim 6 , wherein the optical sensor may be embedded in at least one of a device generating for display the page of the electronic book, or a wearable device.

8. The method of claim 5 , wherein outputting the content segment for a duration based on the average reading speed value further comprises:

determining whether a current reading location on the page of the electronic book matches a location of the outputted content segment; and

in response to the determination that the current reading location on the page of the electronic book matches the location of the outputted content segment, extending the output duration.

9. The method of claim 1 , wherein generating for output a content segment based on the new content structure comprises outputting the content segment within the margins of the page of the electronic book.

10. A system for generating supplemental content for media content, comprising:

control circuitry configured to:

generate for display a particular page of an electronic book;

identify, with a linguistics processing engine and without receiving user interface input, a noun from the displayed particular page;

identify a related word from the displayed page that is contextually related to the noun and identifies an action related to the noun;

search a plurality of content structures for a content structure that comprises a matching object with an object name that matches the noun, wherein each of the plurality of content structures comprises:

an attribute table including one or more object data structures, each object data structure comprising one or more attribute table entries including a feature, and a temporal mapping indicating a time period to which the feature applies; and

in response to identifying an attribute table entry of the matching object that matches the related word:

generate a new content structure comprising the matching object, wherein the matching object comprises the identified attribute table entry; and

generate for output a content segment based on the new content structure, wherein the content segment is a video displayed on the particular page of a display of the electronic book as the particular page displaying the noun and the related word, wherein the video depicts the identified action performed in relation to the noun.

11. The system of claim 10 , wherein:

the control circuitry is configured to, in response to identifying an attribute table entry of the matching object that does not match the related word, determine an approximate attribute table entry of the matching object that matches the related word;

the control circuitry is further configured to:

generate a new content structure comprising the matching object, wherein the matching object comprises the approximate attribute table entry; and

generate for output a content segment based on the new content structure.

12. The system of claim 10 , wherein:

the control circuitry is configured to, in response to identifying an attribute table entry of the matching object that does not match the related word:

generate a new content structure comprising the matching object excluding the non-matching attribute table entry; and

generate for output a content segment based on the new content structure.

13. The system of claim 10 , wherein:

the plurality of content structures further comprises virtual modelling data for the one or more objects and one or more attribute table entries of each of the one or more objects, wherein the virtual modelling data includes at least one of 2D animation, 3D animation, holographic representation, avatar-based modelling, or representations produced from artificial intelligence generation engines; and

the control circuitry is configured, when generating for output a content segment based on the new content structure, to:

determine matching virtual modelling data of the matching object comprising the identified attribute table entry;

render the content segment based on the matching virtual modelling data; and

generate for output the rendered content segment.

14. The system of claim 10 , wherein the attribute table is mapped against time stamps, and wherein:

the control circuitry is further configured to:

determine a first reading location at a first time stamp of the plurality of time stamps on the page of the electronic book;

determine a second reading location at a second time stamp of the plurality of time stamps on the page of the electronic book, wherein the second time stamp occurs subsequent to the first time stamp;

determine the amount of text between the first reading location and the second reading location; and

determine an average reading speed value based on the amount of text, and a difference between the first time stamp and the second time stamp; and

the control circuitry is configured, when generating for output the content segment based on the new content structure, to output the content segment for an output duration based on the average reading speed value.

15. The system of claim 14 , wherein the control circuitry is configured, when determining at least one of the first reading location or second reading location, to:

determine, using an optical sensor, a viewing angle of a user on the displayed page of the electronic book; and

determine, based on the viewing angle of the user on the displayed page of the electronic book, a particular line of text on the displayed page of the electronic book.

16. The system of claim 15 , wherein the optical sensor may be embedded in at least one of a device generating for display the page of the electronic book, or a wearable device.

17. The system of claim 14 , wherein the control circuitry is further configured, when outputting the content segment for a duration based on the average reading speed value, to:

determine whether a current reading location on the page of the electronic book matches a location of the outputted content segment; and

in response to the determination that the current reading location on the page of the electronic book matches the location of the outputted content segment, extend the output duration.

18. The system of claim 10 , wherein generating for output a content segment based on the new content structure comprises outputting the content segment within the margins of the page of the electronic book.

19. The method of claim 1 , wherein the identifying the noun comprises one or more of:

receiving metadata of the electronic book from an internet service providing the electronic book as electronic content;

performing optical character recognition techniques to parse the words from the electronic book;

matching the noun identified with a relevance score based on analysis of an entire text on the displayed page; and

matching the noun identified with a relevance score based on analysis of at least a portion of an entirety of the electronic book.

20. The system of claim 10 , wherein the identifying the noun comprises one or more of:

receiving metadata of the electronic book from an internet service providing the electronic book as electronic content;

performing optical character recognition techniques to parse the words from the electronic book;

matching the noun identified with a relevance score based on analysis of an entire text on the displayed page; and

matching the noun identified with a relevance score based on analysis of at least a portion of an entirety of the electronic book.

Assignments (7)
CHANGE OF NAME Recorded Oct 3, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069106/0231 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053481/0790 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: HPS INVESTMENT PARTNERS, LLC
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053458/0749 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2020
From: SAITO, SAKURA; WATERMAN, ALAN
To: ROVI GUIDES, INC.
Reel/Frame 051603/0906 →
PATENT SECURITY AGREEMENT Recorded Nov 25, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 051110/0006 →
SECURITY INTEREST Recorded Nov 22, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: HPS INVESTMENT PARTNERS, LLC, AS COLLATERAL AGENT
Reel/Frame 051143/0468 →
Continuity (1)
Related Publication 20200409990A1 · Dec 31, 2020
Cited By (2)
US 12,335,583 US 12,386,892