IP Library › Granted Patent US 12,348,830
Granted Patent B2
US 12,348,830 · App. 17/725,103 · Granted Jul 1, 2025

Video playback method and device for setting a subtitle and audio language

Inventors: Weiwei Qi (Beijing, CN); Ruie Gao (Beijing, CN); Zhuguang Wang (Culver City, CA); Peng Wan (Culver City, CA); Tiancheng Yang (Culver City, CA); Ryan Rosello (Culver City, CA); Conghui Zhu (Los Angeles, CA); Yuzhang Du (Beijing, CN); Ye Chen (Beijing, CN); Siqi Tan (Beijing, CN); Wenjia Zhu (Singapore, CN); Ye Lin (Beijing, CN); Xilu Wang (Culver City, CA); Yijun Mao (Culver City, CA); Yuxuan Zhou (Culver City, CA); Donghui Bai (Beijing, CN); Jiangnan Liu (Beijing, CN); Honglei Gao (Beijing, CN); Jicheng Wang (Beijing, CN); Zhe Wang (Beijing, CN); Jiayuan Guo (Singapore, CN)
Assignee: LEMON INC.
H04N21/4856G06F3/165H04N21/4884
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,348,830
App. No.
17/725,103
Granted
Jul 1, 2025
Kind
B2
Abstract

Embodiments of the present disclosure provide a method and device for playing a video. The method comprises: in the process of playing a video, displaying a first subtitle in a subtitle component displayed in a playback interface of the video, and playing a first audio corresponding to the first subtitle; in response to a first trigger operation of a user on the subtitle component, displaying a first pop-up window, the first pop-up window being used to switch display of the first subtitle to the second subtitle; in response to a second trigger operation of the user on the first pop-up window, switching to display the second subtitle in the subtitle component, and playing a second audio corresponding to the second subtitle. The video playback method and device provided by the embodiments of the present disclosure can solve the issues that users cannot understand subtitles and audios in the process of watching videos, thereby improving the users' experience.

Claims (50)

1. A video playback method comprising:

in a process of playing a video, displaying a first subtitle in a first language in a subtitle component displayed in a playback interface of the video, and playing a first audio in the first language corresponding to the first subtitle;

in response to a first trigger operation of a user on the subtitle component, displaying a first pop-up window, which is used to switch display of the first subtitle to a second subtitle in a second language; and

in response to a second trigger operation of the user on the first pop-up window to switch display of the first subtitle to the second subtitle, switching to display the second subtitle in the subtitle component,

wherein the method further comprises:

in response to a third trigger operation of the user, displaying an application setting interface, the application setting interface comprising a dubbing control element that is selectively enabled by the user and wherein the enabling of the dubbing control element causes automatic switching of a dubbing language to be the same language as a currently displayed subtitle language without requiring the user to identify a specific dubbing language;

detecting whether the dubbing control element is enabled; and

based on the detected enabling of the dubbing control element, the second trigger operation and the switching to display the second subtitle, performing the automatic switching such that the second audio is played in the second language along with the second subtitle automatically.

2. The method according to claim 1 , wherein

after switching to display the second subtitle in the subtitle component, the method further comprises:

in response to a fourth trigger operation on the subtitle component, displaying a second pop-up window, which is used to switch display of the second subtitle to the first subtitle, and

in response to a fifth trigger operation on the second pop-up window to switch display of the second subtitle to the first subtitle, switching to display the first subtitle in the subtitle component, and playing the first audio in the first language along with the first subtitle automatically if the dubbing control element is enabled.

3. The method according to claim 1 , wherein, the method further comprises:

the application setting interface further comprises a subtitle language control element for setting of a target subtitle, the target subtitle including the first subtitle; and

in response to a sixth trigger operation of the user on the application setting interface, in the process of playing the video, displaying the target subtitle, and playing a target audio in the same language as the target subtitle along with the target subtitle automatically if the dubbing control element is enabled.

4. The method according to claim 3 , wherein the application setting interface comprises at least one of the following control elements:

a subtitle display control element used to control whether to display the target subtitle.

5. The method according to claim 4 , wherein the dubbing control element is displayed based on an enable setting of the subtitle display control element.

6. The method according to claim 3 , wherein

the subtitle language control element is used to provide a plurality of languages to be selected, and determine a target language corresponding to the target subtitle among the plurality of languages to be selected according to a selection trigger operation of the user.

7. The method according to claim 6 , wherein the target language includes the first language corresponding to the first subtitle, the displaying the first subtitle in the subtitle component displayed in the playback interface of the video includes:

detecting whether the subtitle display control element is enabled; and

if the subtitle display control element is enabled, displaying the first subtitle in the target language in the subtitle component displayed in the playback interface of the video.

8. A non-transitory computer-readable storage medium having a computer program stored thereon which, when executed by a processor, implements the video playback method according to claim 1 .

9. A terminal device comprising: a processor and a memory, wherein

the memory is used to store executable instructions for the processor; and

the processor is used to execute the executable instructions to implement the video playback method according to claim 1 .

10. The method according to claim 1 , the application setting interface further comprises a tone selection control element to provide a plurality of tones to be selected, and to determine a target tone among the plurality of tones to be selected according to a selection trigger operation of the user.

11. A video playback method comprising:

in a process of playing a video, displaying a target subtitle in a first language in a playback interface of the video, and playing a target audio in the first language corresponding to the target subtitle;

in response to a trigger operation of a user on the playback interface, switching display of the target subtitle to a second subtitle in a second language that is different from the first language;

displaying an application setting interface for setting of a second audio of the video, wherein the application setting interface includes a dubbing control element that is selectively enabled by the user and wherein the enabling of the dubbing control element causes automatic switching of a dubbing language to be the same language as a currently displayed subtitle language without requiring the user to identify a specific dubbing language; and

based on the trigger operation and the switching display of the target subtitle to the second subtitle and in response to the enabling operation of the user on the dubbing control element in the process of playing the video, performing the automatic switching such that the second subtitle is displayed and concurrently the second audio is automatically played in the second language.

12. The method according to claim 11 , wherein the application setting interface includes:

a subtitle display control element used to control whether to display the target subtitle.

13. The method according to claim 12 , wherein the dubbing control element is displayed based on enablement of the subtitle display control element.

14. The method according to claim 12 , wherein the application setting interface further comprises: a subtitle language control element,

wherein the subtitle language control element is used to provide a plurality of languages to be selected and determine a target language corresponding to the target subtitle among the plurality of languages to be selected according to a selection trigger operation of the user.

15. The method according to claim 11 further comprising:

in response to a trigger operation of the user on a subtitle component where the target subtitle is displayed, displaying a first pop-up window, which is used to instruct to switch display of the target subtitle to the second subtitle in the second language; and

in response to a trigger operation of the user on the first pop-up window to switch display of the target subtitle to the second subtitle, switching to display the second subtitle in the subtitle component, and play the second audio in the second language along with the second subtitle automatically if the dubbing control element is enabled,

wherein, the second language is different from a target language of the target subtitle.

16. The method according to claim 15 , wherein:

after switching to display the second subtitle in the subtitle component and play the second audio in the second language, the method further comprises:

in response to a touch operation of the user on the subtitle component, displaying a second pop-up window, which is used to switch display of the second subtitle to the target subtitle; and

in response to a touch operation of the user on the second pop-up window to switch display of the second subtitle to the target subtitle, switching to display the target subtitle in the subtitle component, and playing the target audio in the same language with the target subtitle along with the target subtitle automatically.

17. A non-transitory computer-readable storage medium having a computer program stored thereon which, when executed by a processor, implements the video playback method according to claim 11 .

18. A terminal device comprising: a processor and a memory, wherein

the memory is used to store executable instructions for the processor; and

the processor is used to execute the executable instructions to implement the video playback method according to claim 11 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2024
From: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.; BEIJING YOUZHUJU NETWORK TECHNOLOGY CO. LTD.; SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.; TIKTOK PTE. LTD.; TIKTOK INC.; BYTEDANCE INC.; MIAOZHENDIDA (BEIJING) NETWORK TECHNOLOGY CO., LTD.
To: LEMON INC.
Reel/Frame 067822/0232 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2024
From: QI, WEIWEI; GAO, RUIE; WANG, ZHUGUANG; WAN, PENG; YANG, TIANCHENG; ROSELLO, RYAN; ZHU, CONGHUI; DU, YUZHANG; CHEN, YE; TAN, SIQI; ZHU, WENJIA; LIN, YE; MAO, YIJUN; ZHOU, YUXUAN; BAI, DONGHUI; LIU, JIANGNAN; GAO, HONGLEI; WANG, JICHENG; WANG, ZHE; GUO, JIAYUAN; WANG, XILU
To: BYTEDANCE INC.; TIKTOK INC.; TIKTOK PTE. LTD.; SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.; BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.; BEIJING YOUZHUJU NETWORK TECHNOLOGY CO. LTD.; MIAOZHENDIDA (BEIJING) NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 067915/0076 →
Priority Claims (1)
CN 202110921569.1 · Aug 11, 2021 · national
Continuity (1)
Related Publication 20230046440A1 · Feb 16, 2023
References Cited (33)
US 9571870B1 · Wilson et al. · 2017 [cited by applicant]
US 11190851B1 · Palaniswami · 2021 [cited by examiner]
US 20070196795A1 · Groff · 2007 [cited by examiner]
US 20070211168A1 · Ko · 2007 [cited by examiner]
US 20090178010A1 · Chaudhri · 2009 [cited by examiner]
US 20110163939A1 · Tam et al. · 2011 [cited by applicant]
US 20200099989A1 · Niemirska · 2020 [cited by examiner]
CN 102014256 · 2011 [cited by examiner]
CN 102014256A · 2011 [cited by applicant]
CN 103257821A · 2013 [cited by applicant]
CN 112684967 · 2021 [cited by examiner]
CN 112860361A · 2021 [cited by applicant]
EP 2629545A1 · 2013 [cited by applicant]
EP 3211882A1 · 2017 [cited by applicant]
JP 10294896A · 1997 [cited by applicant]
JP 2013168927A · 2013 [cited by applicant]
JP 2018029382A · 2018 [cited by applicant]
KR 20070041187A · 2007 [cited by applicant]
KR 100726439B1 · 2007 [cited by applicant]
KR 20100022396A · 2010 [cited by applicant]
WO 2011084950A2 · 2011 [cited by applicant]
WO 2020251122A1 · 2020 [cited by applicant]
YouTube video by username Still Watching Netflix, “How to Choose between Subtitles and Dubbing on Netflix,” dated May 17, 2021 , downloaded from https://www.youtube.com/watch?v=q-UalJS0X2g (Year: 2021). [cited by examiner]
Amara.org website, “Subtitles vs Captions: What's the Difference?,” published Sep. 5, 2019, downloaded from https://blog.amara.org/2019/09/05/subtitles-vs-captions-what-is-the-difference/ (Year: 2019). [cited by examiner]
YouTube video by username TroubleChute, “Change language back to default/English,” published Apr. 30, 2021, downloaded from https://www.youtube.com/watch?v=Kh96ZflBGPo (Year: 2021). [cited by examiner]
How to Change the Subtitles and Audio Language on Netflix-for All Devices. Jun. 11, 2021, [searched on Mar. 30, 2023 from https://www.radiotimes.com/technology/technology-guides/how-to-change-subtitles-audio-language-ne… [cited by applicant]
International Search Report mailed Mar. 31, 2023 for International Application No. PCT/SG2022/050498, with English translation. [cited by applicant]
Extended European Search Report mailed Aug. 26, 2024 in European Application No. 22856330.0. [cited by applicant]
Office Action for Singapore Application No. 11202400872T, mailed on Dec. 31, 2024, 9 pages. [cited by applicant]
Written Opinion for International Application No. PCT/SG2022/050498, mailed Mar. 31, 2023, 03 Pages. [cited by applicant]
First Office Action for Chinese Application No. 202110921569.1, mailed Feb. 23, 2025, 17 pages. [cited by applicant]
Office action received from Japanese patent application No. 2024-508336 mailed on Mar. 11, 2025, 10 pages (6 pages English Translation and 4 pages Original Copy). [cited by applicant]
Communication pursuant to Article 94(3) EPC mailed May 22, 2025 in European Applicant No. 22 856 330.0. [cited by applicant]