Granted Patent B2

US 12,394,333 · App. 17/492,273 · Granted Aug 19, 2025

Inventors: Vaishali Trivedi (Uttar Pradesh, IN); Padmassri Chandrashekar (Karnataka, IN); Daina Emmanuel (Bangalore, IN); Sukanya Agarwal (Haryana, IN); Ankur Anil Aher (Maharashtra, IN); Charishma Chundi (Andhra Pradesh, IN); Reda Harb (Bellevue, WA)

Assignee: Adeia Guides Inc.

G09B19/06G09B5/06H04N21/4394H04N21/4532H04N21/47217H04N21/4856

Abstract

Claims (78)

1. A method comprising:

accessing a user profile comprising a user's proficiency level in a secondary language;

receiving a command to replay a first portion of a content item, wherein the first portion has a first portion duration;

in response to receiving the replay command, accessing a data structure associated with the first portion of the content item, wherein the data structure comprises:

a plurality of audio tracks associated with respective objects represented in the first portion of the content item, wherein each audio track of the plurality of audio tracks further includes a respective timed text, and wherein the respective timed text of each of the audio tracks comprises, in the secondary language, one of a dialog text or a non-dialog descriptive text; and

a plurality of mappings, wherein each mapping of the plurality of mappings is associated with a respective audio track of the plurality of audio tracks, wherein each mapping of the plurality of mappings is associated with a respective time period within the first portion duration; and

modifying the data structure to remove timed texts associated with the non-dialog descriptive text from the data structure based on the user's proficiency level; and

generating for display, based on the modified data structure, the dialog text during the first portion duration.

2. The method of claim 1 , further comprising:

receiving a request to generate the content item in the secondary language; and

generating for display the first portion of the content item based on the user's proficiency level in the secondary language.

3. The method of claim 1 , further comprising:

receiving a request to generate the content item in a new secondary language not in the user's profile; and

creating a language profile for the new secondary language in the user profile.

4. The method of claim 1 , further comprising:

detecting the user's proficiency level of the secondary language.

5. The method of claim 4 , wherein the detecting the user's proficiency level of the secondary language comprises at least one of:

detecting if the user is using timed text in the secondary language;

detecting if the user is using audio in the secondary language;

detecting if the user is using audio in the secondary language and timed text in a primary language;

detecting if the user has ever made a replay event while using audio in the secondary language;

detecting if the user has ever made a replay event while using timed text in the secondary language;

receiving an indication of proficiency level from a third party application; or

receiving an indication of proficiency level from the user.

6. The method of claim 5 , wherein a primary language is the user's native language.

7. The method of claim 1 , wherein the secondary language is the user's non-native language.

8. The method of claim 1 , wherein generating for display the dialog text during the first portion duration comprises at least one of:

adding timed text in a primary language to the first portion of the content item;

changing language of timed text from the secondary language to a primary language;

changing language of audio from the secondary language to a primary language; or

changing a playback speed of the first portion of the content item.

9. The method of claim 1 , further comprising:

generating for display a first view and second view of the first portion of the content item;

wherein the first view of the first portion is at the user's proficiency level; and

wherein the second view of the first portion is at a level below the user's proficiency level.

10. The method of claim 1 , further comprising:

generating for display metadata based on a subject-matter of the first portion; and

wherein the metadata comprises at least one of: grammar, pronunciation, diacritical markings, use in a sentence, commons phrases or sayings, a definition, synonyms, antonyms, or language of origin.

11. The method of claim 1 , wherein the command is at least one of: a voice request in a primary language of the user profile, a voice request in a secondary language of the user profile, the user selecting a word in timed text, a user input, selection of a rewind button, a selection of a timeline, or a scrubbing event on a timeline.

12. The method of claim 1 , further comprising:

in response to receiving the replay command, tagging the first portion of the content item; and

wherein the tag represents content that is difficult to understand at the user's proficiency level.

13. The method of claim 12 , further comprising:

identifying a second portion of the content item that has been tagged as difficult;

wherein the second portion was tagged by at least one other user in historic viewing data; and

generating for display the dialog text at a level below the user's proficiency level during a second portion duration of playback of the second portion.

14. The method of claim 1 , further comprising:

receiving a timed text file associated with the content item;

analyzing the timed text file;

determining the user's proficiency level;

rewriting the dialog text of the timed text file based on the user's proficiency level; and

generating for display text from the rewritten dialog text of the timed text file during consumption of the first portion of the content item.

15. The method of claim 1 , further comprising:

modifying at least one of the plurality of mappings of the data structure to increase a time period of dialog text to have additional time that was freed up by the removal of the timed texts associated with non-dialog descriptive text.

16. A media device comprising a control module, a transceiver module, and a network module, configured to:

access a user profile comprising a user's proficiency level in a secondary language;

receive a command to replay a first portion of a content, wherein the first portion has a first portion duration;

in response to receiving the replay command, access a data structure associated with the first portion of the content item, wherein the data structure comprises:

a plurality of audio tracks associated with respective objects represented in the first portion of the content item, wherein each audio track of the plurality of audio tracks further includes a respective timed text, and wherein the respective timed text of each of the audio tracks comprises, in the secondary language, one of a dialog text or a non-dialog descriptive text; and

a plurality of mappings, wherein each mapping of the plurality of mappings is associated with a respective audio track of the plurality of audio tracks, wherein each mapping of the plurality of mappings is associated with a respective time period within the first portion duration; and

modifying the data structure to remove timed texts associated with the non-dialog descriptive text from the data structure based on the user's proficiency level; and

generating for display, based on the modified data structure, the dialog text during the first portion duration.

17. The media device of claim 16 , further configured to:

receive a request to generate the content item in the secondary language; and

generate for display the first portion of the content item based on the user's proficiency level in the secondary language.

18. The media device of claim 16 , further configured to:

receive a request to generate the content item in a new secondary language not in the user's profile; and

create a language profile for the new secondary language in the user profile.

19. The media device of claim 16 , further configured to:

detect the user's proficiency level of the secondary language.

20. A system comprising:

means for accessing a user profile comprising a user's proficiency level in a secondary language;

means for receiving a command to replay a first portion of a content, wherein the first portion has a first portion duration;

in response to receiving the replay command, means for accessing a data structure associated with the first portion of the content item, wherein the data structure comprises:

a plurality of audio tracks associated with respective objects represented in the first portion of the content item, wherein each audio track of the plurality of audio tracks further includes a respective timed text, and wherein the respective timed text of each of the audio tracks comprises, in the secondary language, one of a dialog text or a non-dialog descriptive text; and

a plurality of mappings, wherein each mapping of the plurality of mappings is associated with a respective audio track of the plurality of audio tracks, wherein each mapping of the plurality of mappings is associated with a respective time period within the first portion duration; and

modifying the data structure to remove timed texts associated with the non-dialog descriptive text from the data structure based on the user's proficiency level; and

generating for display, based on the modified data structure, the dialog text during the first portion duration.

Assignments (3)

Continuity (1)

References Cited (13)

Cited By (1)

US 12,639,708