IP Library › Granted Patent US 12,353,464
Granted Patent B2
US 12,353,464 · App. 18/441,819 · Granted Jul 8, 2025

Subtitle rendering based on the reading pace

Inventors: Padmassri Chandrashekar (Karnataka, IN); Daina Emmanuel (Karnataka, IN); Reda Harb (Tampa, FL)
Assignee: ADEIA GUIDES INC.
G06F16/345G10L15/26H04N21/2355H04N21/23614H04N21/44204H04N21/4856H04N21/4884H04N21/434
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,353,464
App. No.
18/441,819
Granted
Jul 8, 2025
Kind
B2
Abstract

Systems and methods for summarizing captions, configuring playback speed, and rewriting the caption file for a media asset are disclosed. The system determines whether to display the original captions or a summarized version of the captions, which are based on user's language proficiency level, reading pace, and historical data, and can be generated either on-demand or automatically when rewinds and pauses are detected. The caption file which includes the original captions can be rewritten. The system determines whether to stream a caption or a rewritten file to a media device based on user or system selections. In the absence of a caption file, or when the caption file cannot be summarized, the playback speed of the media asset is slowed down to provide additional reading time to the user.

Claims (67)

1. A method comprising:

determining display of a first media asset on a media device;

summarizing a captions file associated with the displayed first media asset based on a language proficiency level of a user consuming the first media asset, wherein the language proficiency level is determined based on factors external to the first media asset;

receiving user feedback based on the summarization of the captions file associated with the first media asset;

determining that the user has placed a second media asset in a playlist to be consumed at a later time; and

rewriting a captions file associated with the second media asset at a time when the second media asset is placed in the playlist prior to its consumption by the user, as a rewritten captions file, wherein the rewritten captions file associated with the second media asset incorporates the user feedback received for the summarization of the captions file for the first media asset.

2. The method of claim 1 , further comprising:

receiving a selection of the second media asset for display; and

in response to receiving the selection of the second media asset:

transmitting a manifest file to the media device, wherein the transmitted manifest file references the rewritten captions file associated with the second media asset.

3. The method of claim 2 , wherein the received selection of the second media asset for display includes a request to display a segment of the second media asset; and

in response to receiving the request to display the segment of the second media asset:

delivering the segment of the requested second media asset and its corresponding rewritten captions that are referenced by the manifest file to the media device for display.

4. The method of claim 2 , further comprising:

determining whether corresponding rewritten captions for a segment of the requested second media asset can be read within a start and end time of the segment; and

in response to determining that the corresponding rewritten captions for the segment of the requested second media asset cannot be read within the start and end time of the segment:

further summarizing the corresponding rewritten captions for the segment of the requested second media asset, wherein the further summarization is a shorter description of the captions file than the corresponding rewritten captions file that can be read within the start and end time of the segment.

5. The method of claim 1 , further comprising:

accessing a GPS location of the user's mobile device;

determining based on the accessed location that the user is currently away from the media device; and

rewriting the captions file associated with the second media asset while the user is away from the media device.

6. The method of claim 1 , further comprising:

determining that the user has placed a third and a fourth media asset in the playlist;

determining that the third media asset is currently being consumed by the user and the fourth media asset is not being currently consumed; and

in response to the determination that the fourth media asset is not being consumed, rewriting the captions file for only the fourth media asset.

7. The method of claim 1 , wherein the factors external to the media asset include any one or more of the user's social media interactions, the user's text messages, and the user's geographical location.

8. The method of claim 1 , wherein summarizing the captions file associated with the displayed first media asset further comprises, replacing or rewording a caption with a user defined term, synonym, antonym, abbreviation, symbol, emoji, emoticon, icon, or an image.

9. The method of claim 1 , wherein the user feedback based on the summarization of the captions file associated with the first media asset is received in response to the user consuming the summarized captions file displayed during playback of the first media asset.

10. A system comprising:

communication circuitry configured to access a database that stores a first media asset and a media device for displaying the first media asset for a user; and

control circuitry configured to:

determine display of the first media asset on the media device;

summarizing a captions file associated with the displayed first media asset based on a language proficiency level of the user consuming the first media asset, wherein the language proficiency level is determined based on factors external to the first media asset;

receiving user feedback based on the summarization of the captions file associated with the first media asset;

determine that the user has placed a second media asset in a playlist to be consumed at a later time; and

rewriting a captions file associated with the second media asset at a time when the second media asset is placed in the playlist prior to its consumption by the user, as a rewritten captions file, wherein the rewritten captions file associated with the second media asset incorporates the user feedback received for the summarization of the captions file for the first media asset.

11. The system of claim 10 , further comprising, the control circuitry configured to:

receive a selection of the second media asset for display; and

in response to receiving the selection of the second media asset:

transmit a manifest file to the media device, wherein the transmitted manifest file references the rewritten captions file associated with the second media asset.

12. The system of claim 11 , wherein the received selection of the second media asset for display includes a request to display a segment of the second media asset; and

in response to receiving the request to display the segment of the second media asset, the control circuitry configured to:

deliver the segment of the requested second media asset and its corresponding rewritten captions that are referenced by the manifest file to the media device for display.

13. The system of claim 11 , further comprising, the control circuitry configured to:

determine whether corresponding rewritten captions for a segment of the requested second media asset can be read within a start and end time of the segment; and

in response to determining that the corresponding rewritten captions for the segment of the requested second media asset cannot be read within the start and end time of the segment:

further summarize the corresponding rewritten captions for the segment of the requested second media asset, wherein the further summarization is a shorter description of the captions file than the corresponding rewritten captions file that can be read within the start and end time of the segment.

14. The system of claim 10 , further comprising, the control circuitry configured to:

access a GPS location of the user's mobile device;

determine based on the accessed location that the user is currently away from the media device; and

rewrite the captions file associated with the second media asset while the user is away from the media device.

15. The system of claim 10 , further comprising, the control circuitry configured to:

determine that the user has placed a third and a fourth media asset in the playlist;

determine that the third media asset is currently being consumed by the user and the fourth media asset is not being currently consumed; and

in response to the determination that the fourth media asset is not being consumed, rewrite the captions file for only the fourth media asset.

16. The system of claim 10 , wherein the factors external to the media asset include any one or more of the user's social media interactions, the user's text messages, and the user's geographical location.

17. The system of claim 10 , wherein summarizing the captions file associated with the displayed first media asset further comprises, replacing or rewording a caption with a user defined term, synonym, antonym, abbreviation, symbol, emoji, emoticon, icon, or an image.

18. A method comprising:

determining display of a first media asset on a media device;

summarizing a captions file associated with the displayed first media asset based on a language proficiency level of a user consuming the first media asset, wherein the language proficiency level is determined based on factors external to the first media asset;

receiving user feedback based on the summarization of the captions file associated with the first media asset; and

prior to the user consuming a captions file associated with a second media asset placed in a playlist by the user, rewriting the captions file as a rewritten captions file, wherein the rewritten captions file associated with the second media asset incorporates the user feedback received for the summarization of the captions file for the first media asset.

19. The method of claim 18 , further comprising:

accessing a GPS location of the user's mobile device;

determining based on the accessed location that the user is currently away from the media device; and

rewriting the captions file associated with the second media asset while the user is away from the media device.

20. The method of claim 18 , wherein summarizing the captions file associated with the displayed first media asset further comprises, replacing or rewording a caption with a user defined term, synonym, antonym, abbreviation, symbol, emoji, emoticon, icon, or an image.

Assignments (2)
CHANGE OF NAME Recorded Oct 4, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069113/0348 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2024
From: CHANDRASHEKAR, PADMASSRI; EMMANUEL, DAINA; HARB, REDA
To: ROVI GUIDES, INC.
Reel/Frame 066558/0001 →
Continuity (2)
Continuation 17361050 · Jun 28, 2021
Related Publication 20240184817A1 · Jun 6, 2024
References Cited (37)
US 5576768A · Gomikawa · 1996 [cited by applicant]
US 6408128B1 · Abecassis · 2002 [cited by applicant]
US 8271865B1 · Bennett · 2012 [cited by applicant]
US 9558159B1 · Thirupparangiri et al. · 2017 [cited by applicant]
US 9571870B1 · Wilson et al. · 2017 [cited by applicant]
US 9672203B1 · Bhar et al. · 2017 [cited by applicant]
US 11416530B1 · Chandrashekar et al. · 2022 [cited by applicant]
US 20040093220A1 · Kirby et al. · 2004 [cited by applicant]
US 20100030551A1 · Ark et al. · 2010 [cited by applicant]
US 20100225807A1 · Mears · 2010 [cited by applicant]
US 20110004330A1 · Rothkopf et al. · 2011 [cited by applicant]
US 20130100347A1 · Zinovieva · 2013 [cited by applicant]
US 20140201631A1 · Pornprasitsakul et al. · 2014 [cited by applicant]
US 20150006621A1 · Westphal · 2015 [cited by applicant]
US 20150277552A1 · Wilairat et al. · 2015 [cited by applicant]
US 20180197098A1 · Subbian et al. · 2018 [cited by applicant]
US 20180211556A1 · Sreedhara · 2018 [cited by applicant]
US 20180225519A1 · Chen et al. · 2018 [cited by applicant]
US 20180302686A1 · Bhattacharjee et al. · 2018 [cited by applicant]
US 20180302687A1 · Bhattacharjee et al. · 2018 [cited by applicant]
US 20190069013A1 · Abed · 2019 [cited by applicant]
US 20190200050A1 · Zhang et al. · 2019 [cited by applicant]
US 20190205373A1 · Walsh · 2019 [cited by applicant]
US 20200007946A1 · Olkha · 2020 [cited by applicant]
US 20200007947A1 · Narayanamurthy et al. · 2020 [cited by applicant]
US 20200134090A1 · Mankovskii et al. · 2020 [cited by applicant]
US 20200196022A1 · Sen et al. · 2020 [cited by applicant]
US 20200314479A1 · Umansky et al. · 2020 [cited by applicant]
US 20210019369A1 · Sharma et al. · 2021 [cited by applicant]
US 20210266473A1 · Engelke et al. · 2021 [cited by applicant]
US 20220272284A1 · Chandrashekar et al. · 2022 [cited by applicant]
US 20220414132A1 · Chandrashekar et al. · 2022 [cited by applicant]
US 20220414133A1 · Chandrashekar et al. · 2022 [cited by applicant]
US 20230010466A1 · Port et al. · 2023 [cited by applicant]
RU 2668721C1 · 2018 [cited by examiner]
WO 2018140086A1 · 2018 [cited by applicant]
PCT International Search Report and Written Opinion for International Application No. PCT/US2021/064567, dated Apr. 26, 2022 (13 pages). [cited by applicant]