IP Library Granted Patent US 11,875,133
Granted Patent B2
US 11,875,133 · App. 17/165,451 · Granted Jan 16, 2024

Methods and systems for providing subtitles

Inventors: Ankur Anil Aher (Maharashtra, IN); Charishma Chundi (Andhra Pradesh, IN)
Assignee: Rovi Guides, Inc.
G06F40/58G10L21/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,875,133
App. No.
17/165,451
Granted
Jan 16, 2024
Kind
B2
Abstract

Systems and methods are described for providing subtitles for a media content item. Subtitles are obtained, using control circuitry, for the media content item. Control circuitry determines whether a character component of the subtitles should be replaced by an image component. In response to determining that the character component of the subtitles should be replaced by an image component, control circuitry selects, from memory, an image component corresponding to the character component. Control circuitry replaces the character component of the subtitles by the image component to generate modified subtitles.

Claims (79)

1. A method for providing modified subtitles comprising:

obtaining, using control circuitry, subtitles for a media content item;

parsing the subtitles, using the control circuitry, to categorize character components of the subtitles;

determining, using the control circuitry, whether a character component of the subtitles is replaceable with an image by:

querying the character component in an image search;

analyzing the results of the search to determine a level of variance between the images returned as part of the search; and

determining that the character component is replaceable when the level of variance is less than a threshold level of variance;

in response to determining that the character component of the subtitles is replaceable with an image, determining, using the control circuitry, whether replacement of the character component of the subtitles by an image component will make the subtitles more understandable by:

determining a comprehension difficulty rating of the character component; and

determining that the character component is difficult to understand when the comprehension difficulty rating of the character component exceeds a threshold comprehension difficulty rating;

in response to determining that replacement of the character component of the subtitles by an image component will make the subtitles more understandable, selecting, from memory, an image component corresponding to the character component;

replacing, using the control circuitry, the character component of the subtitles with the image component to generate modified subtitles; and

displaying the modified subtitles at user equipment.

2. The method of claim 1 , wherein determining whether the character component of the subtitles is replaceable with an image comprises at least one of:

determining whether the character component is greater than a predetermined length; or

determining whether the character component is difficult to understand.

3. The method of claim 2 , wherein the predetermined length comprises at least one of:

a number of characters in the character component; or

an audio length of the character component.

4. The method of claim 2 , wherein determining the comprehension difficulty rating of the character component comprises at least one of:

determining a difficulty rating of the character component; or

determining a language ability level of a user.

5. The method of claim 1 , further comprising:

translating an audio component of the media content item from a first language into a second language to obtain the subtitles; and

determining if the subtitles comprise a character component that could not be translated into the second language to determine if the character component of the subtitles should be replaced with an image component.

6. The method of claim 1 , further comprising:

accessing metadata of the media content item;

accessing a database containing a plurality of images corresponding to the character component; and

selecting one of the plurality of images corresponding to the character component as the image component based on the metadata of the media content item.

7. The method of claim 1 , further comprising:

accessing metadata of a consumed portion of the media content item;

determining whether the consumed portion of the media content item comprises a frame containing an image corresponding to the character component based on the metadata; and

in response to determining that the consumed portion of the media content item comprises a frame containing an image corresponding to the character component, selecting the frame as the image component.

8. The method of claim 7 , wherein the consumed portion of the media content item comprises a plurality of frames containing an image corresponding to the character component, the method further comprising:

selecting a frame from the plurality of frames as the image component based on at least one of:

an elapsed time between display of the frame in the consumed portion of the media content item and a time of generation of the subtitles;

a clarity of the image corresponding to the character component in the frame; or

a size of the image in the frame.

9. The method of claim 1 , further comprising adjusting a visual property of the image component.

10. A system for providing modified subtitles, the system comprising:

control circuitry configured to:

obtain subtitles for a media content item;

parse the subtitles to categorize character components of the subtitles;

determine whether a character component of the subtitles is replaceable with an image by:

querying the character component in an image search;

analyzing the results of the search to determine a level of variance between the images returned as part of the search; and

determining that the character component is replaceable when the level of variance is less than a threshold level of variance;

in response to determining that the character component of the subtitles is replaceable with an image, determine whether replacement of the character component of the subtitles by an image component will make the subtitles more understandable by:

determining a comprehension difficulty rating of the character component; and

determining that the character component is difficult to understand when the comprehension difficulty rating of the character component exceeds a threshold comprehension difficulty rating;

in response to determining that replacement of the character component of the subtitles by an image component will make the subtitles more understandable, select, from memory, an image component corresponding to the character component;

replace the character component of the subtitles with the image component to generate modified subtitles; and

display the modified subtitles at user equipment.

11. The system of claim 10 , wherein, when determining whether the character component of the subtitles is replaceable with an image, the control circuitry is configured to perform at least one of:

determine whether the character component is greater than a predetermined length; or

determine whether the character component is difficult to understand.

12. The system of claim 11 , wherein the predetermined length comprises at least one of:

a number of characters in the character component; or

an audio length of the character component.

13. The system of claim 11 , wherein, when determining the comprehension difficulty rating of the character component, the control circuitry is configured to perform at least one of:

determining a difficulty rating of the character component; or

determining a language ability level of a user.

14. The system of claim 10 , wherein the control circuitry is configured to:

translate an audio component of the media content item from a first language into a second language to obtain the subtitles; and

determine if the subtitles comprise a character component that could not be translated into the second language to determine if the character component of the subtitles should be replaced with an image component.

15. The system of claim 10 , wherein the control circuitry is further configured to:

access metadata of the media content item;

access a database containing a plurality of images corresponding to the character component; and

select one of the plurality of images corresponding to the character component as the image component based on the metadata of the media content item.

16. The system of claim 10 , wherein the control circuitry is further configured to:

access metadata of a consumed portion of the media content item;

determine whether the consumed portion of the media content item comprises a frame containing an image corresponding to the character component based on the metadata; and

in response to determining that the consumed portion of the media content item comprises a frame containing an image corresponding to the character component, select the frame as the image component.

17. The system of claim 16 , wherein the consumed portion of the media content item comprises a plurality of frames containing an image corresponding to the character component, and wherein the control circuitry is further configured to:

select a frame from the plurality of frames as the image component based on at least one of:

an elapsed time between the display of the frame in the consumed portion of the media content item and a time of the generation of the subtitles;

a clarity of the image corresponding to the character component in the frame; or

the size of the image in the frame.

18. The system of claim 10 , wherein the control circuitry is further configured to adjust a visual property of the image component.

Assignments (3)
CHANGE OF NAME Recorded Oct 4, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069113/0323 →
SECURITY INTEREST Recorded May 19, 2023
From: ADEIA GUIDES INC.; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063707/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2021
From: AHER, ANKUR ANIL; CHUNDI, CHARISHMA
To: ROVI GUIDES, INC.
Reel/Frame 055904/0320 →
Continuity (1)
Related Publication 20220247941A1 · Aug 4, 2022