Granted Patent B2

US 12,581,152 · App. 18/291,606 · Granted Mar 17, 2026

Inventor: Yuxuan Zhuang (Guangzhou, CN)

Assignee: Guangzhou Boguan Telecommunication Technology Co., Ltd.

H04N21/4312H04N21/2187H04N21/233H04N21/242H04N21/8453H04N21/8545

Abstract

Claims (63)

1 . A method for controlling same-screen interaction, comprising:

responding to an initiation request for the same-screen interaction, and determining a same-screen interaction recipient, wherein the same-screen interaction recipient replies to the initiation request;

calling a virtual scene template corresponding to the initiation request, and establishing a target virtual scene corresponding to the virtual scene template;

obtaining a second key image corresponding to the same-screen interaction recipient and a first key image;

obtaining a same-screen interaction scene by performing, through the target virtual scene, integration processing for the first key image and the second key image, and generating a same-screen live video stream corresponding to the same-screen interaction scene; and

sending the same-screen live video stream to a server to synchronize, through the server, the same-screen live video stream to a live streaming client;

wherein the virtual scene template comprises a key image integration logic and virtual scene rendering data;

wherein establishing the target virtual scene instance corresponding to the virtual scene template comprises:

obtaining a second virtual scene by copying a first virtual scene configured to play a first live video stream; and

based on the second virtual scene, establishing the target virtual scene according to the key image integration logic and the virtual scene rendering data in the virtual scene template;

wherein obtaining the second key image corresponding to the same-screen interaction recipient and the first key image comprises:

obtaining a first idle frame by performing frame lock processing for the first live video stream, and obtaining a second idle frame corresponding to the same-screen interaction recipient; and

based on the target virtual scene, extracting the first key image in the first idle frame, and extracting the second key image in the second idle frame.

2 . The method according to claim 1 , wherein obtaining the same-screen interaction scene by performing, through the target virtual scene, the integration processing for the first key image and the second key image comprises:

based on the target virtual scene, performing the integration processing for the first key image and the second key image according to the key image integration logic; and obtaining the same-screen interaction scene by performing a rendering processing for a result of the integration processing in combination with the virtual scene rendering data.

3 . The method according to claim 2 , wherein based on the target virtual scene performing the integration processing for the first key image and the second key image according to the key image integration logic comprises:

based on the target virtual scene, determining a first interaction position coordinate of the first key image and a second interaction position coordinate of the second key image according to the key image integration logic; and

performing the integration processing for the first key image and the second key image through the first interaction position coordinate and the second interaction position coordinate.

4 . The method according to claim 3 , wherein performing the integration processing for the first key image and the second key image through the first interaction position coordinate and the second interaction position coordinate comprises:

identifying first posture data of the first key image, and identifying second posture data of the second key image;

determining first profile data of the first interaction position coordinate, and second profile data of the second interaction position coordinate;

integrating the first key image to the first interaction position coordinate in response to detecting that the first posture data matches the first profile data; and

integrating the second key image to the second interaction position coordinate in response to detecting that the second posture data matches the second profile data.

5 . The method according to claim 3 , wherein performing the integration processing for the first key image and the second key image through the first interaction position coordinate and the second interaction position coordinate comprises:

reading a first initial position coordinate, in the first virtual scene, of the first key image, and a second initial position coordinate, in an initial virtual scene of the same-screen interaction recipient, of the second key image;

integrating the first key image to the first interaction position coordinate in response to detecting that the first initial position coordinate is the same as the first interaction position coordinate; and

in response to detecting that the second initial position coordinate is different from the second interaction position coordinate, performing scaling processing for the second key image, and integrating the scaled second key image to the second interaction position coordinate.

6 . The method according to claim 1 , wherein the method further comprises:

reading newly added virtual prop data in the virtual scene template, and rendering a virtual prop corresponding to the newly added virtual prop data into the same-screen interaction scene; and

performing edge stitching processing for the virtual prop, the first key image and the second key image, and adding a standard filter effect to the stitched same-screen interaction scene.

7 . The method according to claim 1 , wherein generating the same-screen live video stream corresponding to the same-screen interaction scene comprises:

collecting a first audio data stream, and obtaining a second audio data stream of the same-screen interaction recipient; and

generating the same-screen live video corresponding to the same-screen interaction scene by synchronizing, through the target virtual scene, the first audio data stream and the second audio data stream to the same-screen interaction scene.

8 . The method according to claim 1 , wherein the method further comprises:

identifying an interaction operation and determining an interaction result corresponding to the interaction operation;

reading display type data of the interaction result in the same-screen interaction scene; and

in response to detecting that the display type data is separate display type data, determining a target anchor identity corresponding to responding to the interaction operation, and sending the interaction result, the separate display type data and the target anchor identity to the server to make the server display the interaction result to a live streaming client associated with the target anchor identity.

9 . The method according to claim 8 , wherein the method further comprises:

in response to detecting that the display type data is same-screen display type data, sending the interaction result and the same-screen display type data to the server to make the server display the interaction result to a live streaming client associated with an anchor in the same-screen interaction scene.

10 . An electronic device, comprising:

a processor; and

a memory having computer-readable instructions stored thereon, wherein the computer-readable instructions, when executed by the processor, implement:

responding to an initiation request for the same-screen interaction, and determining a same-screen interaction recipient that replies to the initiation request;

calling a virtual scene template corresponding to the initiation request, and establishing a target virtual scene corresponding to the virtual scene template;

obtaining a second key image corresponding to the same-screen interaction recipient and a first key image;

obtaining a same-screen interaction scene by performing, through the target virtual scene, integration processing for the first key image and the second key image, and generating a same-screen live video stream corresponding to the same-screen interaction scene; and

sending the same-screen live video stream to a server to synchronize, through the server, the same-screen live video stream to a live streaming client;

wherein the virtual scene template comprises a key image integration logic and virtual scene rendering data;

obtaining a second virtual scene by copying a first virtual scene configured to play a first live video stream; and

based on the second virtual scene, establishing the target virtual scene according to the key image integration logic and the virtual scene rendering data in the virtual scene template;

obtaining a first idle frame by performing frame lock processing for the first live video stream, and obtaining a second idle frame corresponding to the same-screen interaction recipient; and

based on the target virtual scene, extracting the first key image in the first idle frame, and extracting the second key image in the second idle frame.

11 . A non-transitory computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements:

responding to an initiation request for the same-screen interaction, and determining a same-screen interaction recipient that replies to the initiation request;

calling a virtual scene template corresponding to the initiation request, and establishing a target virtual scene corresponding to the virtual scene template;

obtaining a second key image corresponding to the same-screen interaction recipient and a first key image;

obtaining a same-screen interaction scene by performing, through the target virtual scene, integration processing for the first key image and the second key image, and generating a same-screen live video stream corresponding to the same-screen interaction scene; and

sending the same-screen live video stream to a server to synchronize, through the server, the same-screen live video stream to a live streaming client;

wherein the virtual scene template comprises a key image integration logic and virtual scene rendering data;

obtaining a second virtual scene by copying a first virtual scene configured to play a first live video stream; and

based on the second virtual scene, establishing the target virtual scene according to the key image integration logic and the virtual scene rendering data in the virtual scene template;

obtaining a first idle frame by performing frame lock processing for the first live video stream, and obtaining a second idle frame corresponding to the same-screen interaction recipient; and

based on the target virtual scene, extracting the first key image in the first idle frame, and extracting the second key image in the second idle frame.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (25)