IP Library Granted Patent US 12,238,385
Granted Patent B2
US 12,238,385 · App. 18/084,786 · Granted Feb 25, 2025

Systems and methods for fast, intuitive, and personalized language learning from video subtitles

Inventor: Zhiyun Li (Kenmore, WA)
Assignee: ADEIA GUIDES INC.
H04N21/4884H04N21/466H04N21/47217
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,238,385
App. No.
18/084,786
Granted
Feb 25, 2025
Kind
B2
Abstract

A vocabulary level of a user in a language to be learned is identified. During playback of a media asset on a first device, subtitles in the language are extracted for at least a portion of the media asset. The extracted subtitles may contain a single word, or a plurality of words in the language in question. Based on the vocabulary level, a subset of words from the extracted subtitles are predicted to be new to the user. The predicted new words are then generated for display on a second device associated with the user, along with an explanation of each word of the subset of words.

Claims (64)

1. A method for fast, intuitive, personalized language learning from subtitles, the method comprising:

identifying a vocabulary level of a user in a first language;

during playback, on a first device, of a media asset, extracting subtitles in the first language for at least a portion of the media asset, the subtitles comprising a plurality of words in the first language;

predicting, based on the vocabulary level, a subset of words of the plurality words that are new to the user;

generating for display, on a second device associated with the user, the subset of words and a respective explanation of each word of the subset of words;

receiving an input to bookmark a word of the subset of words;

based on receiving the input:

identifying a start time and an end time for display of a subtitle in which the word is contained; and

storing the start time, the end time, and an identifier of the media asset in association with the word;

storing a segment of the media asset beginning at the start time and ending at the end time; and

based on receiving a selection of the bookmark, replaying the stored segment.

2. The method of claim 1 , wherein identifying a vocabulary level of the user in the first language further comprises:

retrieving, from a user profile associated with the user, a language learning history for the first language; and

determining, based on the language learning history, a familiarity level of the user with the first language.

3. The method of claim 1 , wherein generating for display, on the second device associated with the user, the subset of words and a respective explanation of each word of the subset of words further comprises:

transmitting, to the second device, the subset of words and the respective explanations.

4. The method of claim 1 , wherein generating for display, on the second device associated with the user, the subset of words and a respective explanation of each word of the subset of words further comprises:

adding the subset of words and the respective explanation of each word to a list of words and corresponding explanations that have previously been generated for display during playback of the media asset; and

automatically scrolling the list such that the subset of words is visible on a display of the second device.

5. The method of claim 1 , further comprising:

in response to receiving a selection of the bookmark:

retrieving the identifier of the media asset; and

based on the identifier of the media asset, the start time, and the end time, replaying a segment of the media asset beginning at the start time and ending at the end time.

6. The method of claim 5 , wherein replaying the segment of the media asset corresponding to the display time comprises instructing the first device to perform a rewind operation to the start time.

7. The method of claim 5 , wherein replaying the segment of the media asset corresponding to the display time comprises:

instructing the first device to pause playback of the media asset;

retrieving, at the second device, the segment of the media asset; and

replaying at least audio data of the segment on the second device.

8. The method of claim 1 , wherein generating for display, on a second device associated with the user, the subset of words and a respective explanation of each word of the subset of words further comprises:

retrieving a sentence from the subtitles, the sentence including a word of the subset of words; and

transmitting, to the second device, the sentence and the respective explanation of the word of the subset of words.

9. A system for fast, intuitive, personalized language learning from subtitles, the system comprising:

input/output circuitry; and

control circuitry configured to:

identify a vocabulary level of a user in a first language;

during playback, on a first device, of a media asset, extract subtitles in the first language for at least a portion of the media asset, the subtitles comprising a plurality of words in the first language;

predict, based on the vocabulary level, a subset of words of the plurality words that are new to the user;

generate for display, via the input/output circuitry, on a second device associated with the user, the subset of words and a respective explanation of each word of the subset of words

receive an input to bookmark a word of the subset of words;

based on receiving the input:

identify a start time and an end time for display of a subtitle in which the word is contained; and

store the start time, the end time, and an identifier of the media asset in association with the word;

store a segment of the media asset beginning at the start time and ending at the end time; and

based on receiving a selection of the bookmark, replay the stored segment.

10. The system of claim 9 , wherein the control circuitry configured to identify a vocabulary level of the user in the first language is further configured to:

retrieve, using the input/output circuitry, from a user profile associated with the user, a language learning history for the first language; and

determine, based on the language learning history, a familiarity level of the user with the first language.

11. The system of claim 9 , wherein the control circuitry configured to generate for display, via the input/output circuitry, on the second device associated with the user, the subset of words and a respective explanation of each word of the subset of words is further configured to:

transmit, to the second device, the subset of words and the respective explanations.

12. The system of claim 9 , wherein the control circuitry configured to generate for display, via the input/output circuitry, on the second device associated with the user, the subset of words and a respective explanation of each word of the subset of words is further configured to:

add the subset of words and the respective explanation of each word to a list of words and corresponding explanations that have previously been generated for display during playback of the media asset; and

automatically scroll the list such that the subset of words is visible on a display of the second device.

13. The system of claim 9 , wherein the control circuitry is further configured to

in response to receiving a selection of the bookmark:

retrieve the identifier of the media asset; and

based on the identifier of the media asset, the start time, and the end time, replay a segment of the media asset beginning at the start time and ending at the end time.

14. The system of claim 13 , wherein the control circuitry configured to replay the segment of the media asset corresponding to the display time is further configured to instruct the first device to perform a rewind operation to the start time.

15. The system of claim 13 , wherein the control circuitry configured to replay the segment of the media asset corresponding to the display time is further configured to:

instruct the first device to pause playback of the media asset;

retrieve, at the second device, the segment of the media asset; and

replay at least audio data of the segment on the second device.

16. The system of claim 9 , wherein the control circuitry configured to generate for display, using the input/output circuitry, on a second device associated with the user, the subset of words and a respective explanation of each word of the subset of words is further configured to:

retrieve a sentence from the subtitles, the sentence including a word of the subset of words; and

transmit, to the second device, using the input/output circuitry, the sentence and the respective explanation of the word of the subset of words.

Assignments (3)
CHANGE OF NAME Recorded Oct 4, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069113/0420 →
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2022
From: LI, ZHIYUN
To: ROVI GUIDES, INC.
Reel/Frame 062167/0630 →