Granted Patent B2

US 12,641,302 · App. 18/797,215 · Granted May 26, 2026

Inventors: Wanhong Wang (Beijing, CN); Yalou Wang (Beijing, CN); Jiahuan Huang (Beijing, CN); Yong Zhu (Beijing, CN); Yaxin Li (Beijing, CN); Xin Che (Beijing, CN); Jiacheng Liu (Beijing, CN); Zihao Zhang (Beijing, CN); Yuanyuan Wang (Beijing, CN); Zheqi Qu (Beijing, CN); Weihao Xu (Beijing, CN); Jianping Chen (Beijing, CN)

Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.

H04N21/2187A63F13/86H04N21/4312

Abstract

Claims (37)

1 . A method for controlling live streaming interaction comprises:

acquiring a first interactive image of a first terminal;

receiving a mirror interactive image of a second terminal,

wherein the first terminal and the second terminal are in a live streaming interaction state in a live streaming, the first interactive image is an image of an interactive object in a first interactive region of the first terminal, the mirror interactive image of the second terminal is obtained by performing mirror processing on a second interactive image of the second terminal, and the second interactive image is an image of the interactive object in a second interactive region of the second terminal;

combining, by the first terminal, the first interactive image and the mirror interactive image to obtain a target interactive image for the live streamlining,

wherein at least one interactive object moves between the first interactive region corresponding to the first interactive image and the second interactive region corresponding to the second interactive image; and

receiving, by the first terminal, control signaling sent by a game server and adjusting a state of an interactive scenario in which the first terminal and the second terminal are located based on the control signaling, wherein the control signaling is sent by the game server synchronously to the first terminal and the second terminal, wherein the control signaling comprises start signaling, end signaling, and state switch signaling.

2 . The method according to claim 1 , wherein the movement of the at least one interactive object between the first interactive region and the second interactive region is determined according to a movement pattern, the movement pattern being determined based on an interactive scenario in which the first terminal and the second terminal are located.

3 . The method according to claim 1 , wherein a visual style of the at least one interactive object during the movement is determined based on an interactive scenario in which the first terminal and the second terminal are located.

4 . The method according to claim 1 , wherein at least one of a location, a speed, a direction, or a shape of the at least one interactive object is controlled during the movement of the at least one interactive object between the first interactive region and the second interactive region.

5 . The method according to claim 1 , wherein acquiring the first interactive image comprises:

identifying, by the first terminal, control information in a video image of a first user;

determining, in an interactive scenario, data of a control object in the first interactive region of the first terminal based on the control information; and

forming the first interactive image corresponding to the first interactive region of the first terminal based on the data of the control object.

6 . The method according to claim 5 , wherein the control object is different from the at least one interactive object, or the control object is at least one of the at least one interactive object.

7 . The method according to claim 1 , wherein forming the initial video merging stream based on the first video stream and the second video stream comprises:

determining, according to an identifier of the first video stream and an identifier of the second video stream, a stream merging position of the first video stream and a stream merging position of the second video stream; and

performing, according to the stream merging position of the first video stream and the stream merging position of the second video stream, stream merging processing on the first video stream and the second video stream to form the initial video merging stream.

8 . The method according to claim 7 , wherein performing, according to the stream merging position of the first video stream and the stream merging position of the second video stream, the stream merging processing on the first video stream and the second video stream comprises:

performing, based on timestamps of a plurality of video frames of the first video stream and timestamps of a plurality of video frames of the second video stream, the stream merging processing on a video frame in the first video stream and a video frame in the second video stream according to the stream merging position of the first video stream and the stream merging position of the second video stream, wherein the video frame in the first video and the video frame in the second video have a same timestamp.

9 . An electronic device, comprising:

at least one processor; and

a storage apparatus, configured to store at least one program;

wherein the at least one processor, when executing the at least one program, perform acts comprising:

acquiring a first interactive image of a first terminal;

receiving a mirror interactive image of a second terminal,

wherein the first terminal and the second terminal are in a live streaming interaction state in a live streaming, the first interactive image is an image of an interactive object in a first interactive region of the first terminal, the mirror interactive image of the second terminal is obtained by performing mirror processing on a second interactive image of the second terminal, and the second interactive image is an image of the interactive object in a second interactive region of the second terminal;

combining, by the first terminal, the first interactive image and the mirror interactive image to obtain a target interactive image for the live streamlining,

wherein at least one interactive object moves between the first interactive region corresponding to the first interactive image and the second interactive region corresponding to the second interactive image; and

receiving, by the first terminal, control signaling sent by a game server and adjusting a state of an interactive scenario in which the first terminal and the second terminal are located based on the control signaling, wherein the control signaling is sent by the game server synchronously to the first terminal and the second terminal, wherein the control signaling comprises start signaling, end signaling, and state switch signaling.

10 . The electronic device according to claim 9 , wherein the movement of the at least one interactive object between the first interactive region and the second interactive region is determined according to a movement pattern, the movement pattern being determined based on an interactive scenario in which the first terminal and the second terminal are located.

11 . The electronic device according to claim 9 , wherein a visual style of the at least one interactive object during the movement is determined based on an interactive scenario in which the first terminal and the second terminal are located.

12 . The electronic device according to claim 9 , wherein at least one of a location, a speed, a direction, or a shape of the at least one interactive object is controlled during the movement of the at least one interactive object between the first interactive region and the second interactive region.

13 . The electronic device according to claim 9 , wherein acquiring the first interactive image comprises:

identifying, by the first terminal, control information in a video image of a first user;

determining, in an interactive scenario, data of a control object in the first interactive region of the first terminal based on the control information; and

forming the first interactive image corresponding to the first interactive region of the first terminal based on the data.

Priority Claims (1)

Continuity (3)

References Cited (31)