IP Library Granted Patent US 12,413,685
Granted Patent B2
US 12,413,685 · App. 17/881,743 · Granted Sep 9, 2025

System, method and computer-readable medium for video processing

Inventors: Shao-Yuan Wu (Taipei, TW); Ming-Che Cheng (Taipei, TW); Po-Sheng Chiu (Taipei, TW); Yu-Chuan Chang (Taipei, TW)
Assignee: 17LIVE Japan Inc.
H04N7/152G06V40/28H04N21/4312H04N21/4728
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,413,685
App. No.
17/881,743
Granted
Sep 9, 2025
Kind
B2
Abstract

The present disclosure relates to a system, a method and a computer-readable medium for video processing. The method includes displaying a live video of a first user in a first region on a user terminal and displaying a video of a second user in a second region on the user terminal. A portion of the live video of the first user extends to the second region on the user terminal. The present disclosure can improve interaction during a conference call or a group call.

Claims (30)

1. A method for video processing related to live streaming in a mode where at least a first user and a second user simultaneously provide a first live video and a second live video, respectively, for the live streaming, the method performed by a user terminal of a third user viewing the live streaming, the method comprising:

displaying the first live video of the first user in a first region of a display on the user terminal, the first live video representing real image of the first user;

displaying, simultaneously with the display of the first video, the second live video of the second user in a second region of the display on the user terminal, the second region being apart from and lined up with the first region, the second live video representing real image of the second user;

generating a first visual virtual effect in the second region, the first visual virtual effect being associated with the first live video; and

generating a second visual virtual effect in the second region, the second visual virtual effect being generated subsequent to the first visual virtual effect, wherein the first and second visual virtual effects are displayed synchronously in the second region, and the first and second visual virtual effects are different,

wherein the second visual virtual effect is displayed in such a manner to overlap with the real image of the second user in an area where the first visual virtual effect touches the real image of the second user in the second region, and the first visual virtual effect, the second visual virtual effect, and the real image of the second user overlap with each other, and

wherein the second visual virtual effect is displayed only in the second region.

2. The method according to claim 1 , wherein the generating the first visual virtual effect includes generating the first visual virtual effect so that the first visual virtual effect moves synchronously with the first live video.

3. The method according to claim 1 , wherein the second visual virtual effect is an animated object representing hitting.

4. A method for video processing related to live streaming in a mode where at least a first user and a second user simultaneously provide a first live video and a second live video, respectively, for the live streaming, the method performed by an application program able to be installed on a user terminal of a third user viewing the live streaming, the method comprising:

displaying the first live video of the first user in a first region of a display on the user terminal, the first live video representing real image of the first user;

displaying, simultaneously with the display of the first video, the second live video of the second user in a second region of the display on the user terminal, the second region being apart from and lined up with the first region, the second live video representing real image of the second user;

generating a first visual virtual effect in the second region, the first visual virtual effect being associated with the first live video; and

generating a second visual virtual effect in the second region, the second visual virtual effect being generated subsequent to the first visual virtual effect, wherein the first and second visual virtual effects are displayed synchronously in the second region, and the first and second visual virtual effects are different,

wherein the second visual virtual effect is displayed in such a manner to overlap with the real image of the second user in an area where the first visual virtual effect touches the real image of the second user in the second region, and the first visual virtual effect, the second visual virtual effect, and the real image of the second user overlap with each other, and

wherein the second visual virtual effect is displayed only in the second region.

5. A non-transitory computer-readable medium including a program for video processing related to live streaming in a mode where at least a first user and a second user simultaneously provide a first live video and a second live video, respectively, for the live streaming, wherein the program causes one or a plurality of computers of a user terminal of a third user viewing the live streaming to execute:

displaying the first live video of the first user in a first region of a display on the user terminal, the first live video representing real image of the first user;

displaying, simultaneously with the display of the first video, the second live video of the second user in a second region of the display on the user terminal, the second region being apart from and lined up with the first region, the second live video representing real image of the second user;

generating a first visual virtual effect in the second region, the first visual virtual effect being associated with the first live video; and

generating a second visual virtual effect in the second region, the second visual virtual effect being generated subsequent to the first visual virtual effect, wherein the first and second visual virtual effects are displayed synchronously in the second region, and the first and second visual virtual effects are different,

wherein the second visual virtual effect is displayed in such a manner to overlap with the real image of the second user in an area where the first visual virtual effect touches the real image of the second user in the second region, and the first visual virtual effect, the second visual virtual effect, and the real image of the second user overlap with each other, and

wherein the second visual virtual effect is displayed only in the second region.

6. The method according to claim 1 , wherein a movement of the first visual virtual effect is controlled by a movement of the first user, and wherein the movement of the first visual virtual effect is synchronous with the movement of the first user.

7. The method according to claim 1 , wherein a first visual representation of the first visual virtual effect is shown in the first region, a second visual representation of the first visual virtual effect is shown in the second region, wherein the second visual representation is shown in the second region while the first visual representation is shown in the first region, and

wherein the first visual representation shown in the first region is identical to the second visual representation shown in the second region.

8. The method according to claim 7 , wherein the second visual virtual effect is displayed in the second region in response to the second visual representation of the first visual virtual effect coming into contact with the real image of the second user in the second region.

9. The method according to claim 1 , wherein the first visual virtual effect represents a part of the first user.

10. The method according to claim 1 , wherein the first visual virtual effect is extended from the first region to the second region.

11. The method according to claim 1 , wherein the first visual virtual effect or the second visual virtual effect is tied to an amount of gift or gift with an amount of value.

Assignments (2)
CHANGE OF ASSIGNEE ADDRESS Recorded Apr 16, 2024
From: 17LIVE JAPAN INC.
To: 17LIVE JAPAN INC.
Reel/Frame 067126/0303 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2022
From: WU, SHAO-YUAN; CHENG, MING-CHE; CHIU, PO-SHENG; CHANG, YU-CHUAN
To: 17LIVE JAPAN INC.
Reel/Frame 060728/0918 →
Continuity (4)
Continuation In Part PCTUS2021073183 · Dec 30, 2021
Continuation In Part PCTUS2021073182 · Dec 30, 2021
Continuation In Part PCTUS2021052779 · Sep 30, 2021
Related Publication 20230101606A1 · Mar 30, 2023
References Cited (42)
US 20090033737A1 · Goose et al. · 2009 [cited by applicant]
US 20130250118A1 · Kawakami · 2013 [cited by applicant]
US 20150261409A1 · Tanaka · 2015 [cited by applicant]
US 20160205341A1 · Hollander et al. · 2016 [cited by applicant]
US 20170127023A1 · High · 2017 [cited by examiner]
US 20170339372A1 · Valli · 2017 [cited by applicant]
US 20170365036A1 · Wang · 2017 [cited by examiner]
US 20180124477A1 · Qu et al. · 2018 [cited by applicant]
US 20190222803A1 · Pather et al. · 2019 [cited by applicant]
US 20190268567A1 · Ahn · 2019 [cited by examiner]
US 20200099889A1 · Sugihara · 2020 [cited by applicant]
US 20200177823A1 · Zhu et al. · 2020 [cited by applicant]
US 20200192550A1 · Laaksonen · 2020 [cited by examiner]
US 20210099505A1 · Ravine · 2021 [cited by applicant]
US 20210127071A1 · Rebien et al. · 2021 [cited by applicant]
US 20210365707A1 · Mao et al. · 2021 [cited by applicant]
US 20210400142A1 · Jorasch · 2021 [cited by examiner]
US 20220239812A1 · Tokuchi · 2022 [cited by examiner]
CN 104914990A · 2015 [cited by applicant]
CN 111294622A · 2020 [cited by applicant]
CN 111385663A · 2020 [cited by applicant]
CN 112261424A · 2021 [cited by applicant]
CN 113038149A · 2021 [cited by applicant]
CN 113709545A · 2021 [cited by applicant]
JP 2009218792A · 2009 [cited by applicant]
JP 2013192804A · 2013 [cited by applicant]
JP 2015172886A · 2015 [cited by applicant]
JP 2020044132A · 2020 [cited by applicant]
JP 2021087150A · 2021 [cited by applicant]
TW 202123172A · 2021 [cited by applicant]
Notice of Reasons for Refusal dated Sep. 26, 2023, issued in corresponding Japanese Patent Application No. 2022-522347 with English translation (10 pgs.). [cited by applicant]
Office Action dated Sep. 2, 2022, issued in corresponding Taiwanese Patent Application No. 110149532 with full English translation (27 pgs.). [cited by applicant]
Office Action dated Nov. 30, 2022, issued in corresponding Taiwanese Patent Application No. 110149533 with full English translation (19 pgs.). [cited by applicant]
“Heart Photo Maker Uses Photos to Spell out Hearts, Stars, and Various Hand-Drawn Shapes” with machine translation (26 pgs.). URL: https://briian.com/23999/. [cited by applicant]
International Search Report dated Dec. 29, 2021, issued in corresponding International Application No. PCT/US2021/052779 (7 pgs.). [cited by applicant]
International Search Report dated Mar. 17, 2022, issued in corresponding International Application No. PCT/US2021/073182 (7 pgs.). [cited by applicant]
International Search Report dated Mar. 17, 2022, issued in corresponding International Application No. PCT/US2021/073183 (7 pgs.). [cited by applicant]
Office Action dated Mar. 13, 2023, issued in corresponding Taiwanese Patent Application No. 110149532 with English translation (16 pgs.). [cited by applicant]
Rejection Decision dated Jun. 29, 2023, issued in corresponding Taiwanese Patent Application No. 110149533 with English translation (6 pgs.). [cited by applicant]
Office Action dated Nov. 10, 2023, issued in corresponding Taiwanese Patent Application No. 110149532 with English translation (10 pgs.). [cited by applicant]
Notice of Reasons for Refusal dated Dec. 19, 2023, issued in corresponding Japanese Patent Application No. 2022-522349 with English translation (14 pgs.). [cited by applicant]
Notice of Reasons for Refusal dated Dec. 19, 2023, issued in corresponding Japanese Patent Application No. 2022-528663 with English translation (4 pgs.). [cited by applicant]