Granted Patent B2

US 12,367,560 · App. 17/819,861 · Granted Jul 22, 2025

Inventors: Yujia Wang (Beijing, CN); Shu Liu (Beijing, CN); Gao Liu (Beijing, CN); Shu Tao (Beijing, CN); Jie Yang (Beijing, CN)

Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.

G06T5/77G06T5/50G06T7/70G06V20/46

Abstract

Claims (81)

1. A video transmission method, applied to a first application installed in a first terminal, wherein the first terminal is further installed with multiple second applications, and the method comprises:

acquiring a current video frame;

updating a set of special effects to be superimposed according to a received special effect setting instruction, performing special effect processing on the current video frame according to the updated set of special effects to be superimposed, and generating a target video frame to meet requirements of special effect processing of the multiple second applications, wherein the special effect setting instruction is input by a user during an operation of the first application through a special effect setting interface provided by the first application comprising a preview area and a special effect setting area, and multiple special effect setting components are set in the special effect setting area, wherein a specific form of the set of special effects to be superimposed is a form of an array; and

sending the target video frame to each of the second applications;

wherein the method further comprises:

triggering the first terminal to create a virtual device; and

sending the target video frame to the virtual device, so that the virtual device sends the target video frame to each of the second applications;

creating a plug-in, so that each of the second applications creates a plug-in object corresponding to each of the second applications by loading the plug-in,

wherein the virtual device sends the target video frame to each of the second applications via the corresponding plug-in object;

wherein the sending the target video frame to the virtual device comprises:

decomposing the target video frame into multiple subframes;

storing the multiple subframes in a shared memory, so that the virtual device reads the multiple subframes from the shared memory;

wherein the virtual device is used to combine multiple subframes read to obtain the target video frame and send the target video frame to each of the second applications.

2. The method according to claim 1 , wherein the performing the special effect processing on the current video frame according to the updated set of special effects to be superimposed, and generating the target video frame comprises:

identifying a target object in the current video frame;

determining at least one target special effect to be superimposed from the updated set of special effects to be superimposed; and

superimposing the at least one target special effect to be superimposed with the target object, and generating the target video frame.

3. The method according to claim 2 , wherein the determining at least one target special effect to be superimposed from the updated set of special effects to be superimposed comprises:

determining whether there are one or more groups of mutually exclusive sub special effects in the updated set of special effects to be superimposed according to special effect parameters of sub special effect to be superimposed in the updated set of special effects to be superimposed;

in response to determining that there are the one or more groups of mutually exclusive sub special effects, for each group of mutually exclusive sub special effects, selecting one of the mutually exclusive sub special effects as an enabled sub special effect according to priority parameters in special effect parameters of the mutually exclusive sub special effects;

determining the enabled sub special effect as the sub special effect to be superimposed; and

determining the at least one target special effect to be superimposed according to the special effect parameters of the determined sub special effect to be superimposed.

4. The method according to claim 1 , wherein

each of the second applications is used to send the target video frame to at least one second terminal immediately after receiving the target video frame,

wherein the at least one second terminal receives and displays the target video frame through the second application.

5. The method according to claim 1 , wherein the plug-in object corresponding to each of the second applications comprises an identifier of the second application, and plug-in objects corresponding to different second applications are different, so that the virtual device sends the target video to each of the second applications corresponding to each plug-in object through each plug-in object.

6. The method according to claim 1 , further comprises:

receiving video acquisition requests sent from the second applications; and

wherein the current video frame is a current video frame in running processes of the second applications.

7. The method according to claim 1 , wherein each special effect setting component comprises multiple sub special effect setting components, in a case where it is detected that the user clicks a sub special effect setting component, the received special effect setting instruction comprises a special effect adding instruction, and the updating the set of special effects to be superimposed according to the received special effect setting instruction comprises:

adding special effect parameters of a sub special effect corresponding to the sub special effect setting component into the set of special effects to be superimposed according to the special effect adding instruction;

after adding the special effect parameters of the sub special effect corresponding to the sub special effect setting component into the set of special effects to be superimposed, in a case where it is detected that the user clicks the sub special effect setting component, the received special effect setting instruction comprises a special effect cancellation instruction, and the updating the set of special effects to be superimposed according to the received special effect setting instruction comprises:

deleting the special effect parameters of the sub special effect corresponding to the sub special effect setting component from the set of special effects to be superimposed according to the special effect cancellation instruction.

8. The method according to claim 7 , wherein the special effect parameters of the sub special effect comprise mutually exclusive parameters, priority parameters and addition time parameters, wherein the mutually exclusive parameters comprise identifications of other sub special effects mutually exclusive with the sub special effect.

9. A non-transitory computer readable medium, wherein the medium stores a computer program which, when executed by a processing apparatus, implements steps of the method according to claim 1 .

10. A video transmission method, applied to a virtual device in a first terminal, wherein the first terminal is installed with a first application and multiple second applications, and the method comprises:

acquiring multiple subframes sent by the first application, wherein the first application is used to decompose a target video frame into the multiple subframes;

combining the multiple subframes to obtain the target video frame; and

sending the target video frame to each of the second applications,

wherein the target video frame is generated by the first application performing special effect processing on a current video frame according to a set of special effects to be superimposed to meet requirements of special effect processing of the multiple second applications, wherein the set of special effects to be superimposed is updated according to a received special effect setting instruction, wherein the special effect setting instruction is input by a user during an operation of the first application through a special effect setting interface provided by the first application comprising a preview area and a special effect setting area, and multiple special effect setting components are set in the special effect setting area, wherein a specific form of the set of special effects to be superimposed is a form of an array;

wherein the sending the target video frame to each of the second applications comprises:

sending the target video frame to a plug-in object corresponding to each of the second applications, so that the corresponding plug-in object sends the target video frame to each of the second applications,

wherein the corresponding plug-in object is created by loading a plug-in corresponding to the first application by each of the second applications.

11. The method according to claim 10 , wherein the method further comprises:

sending a specified video frame to each of the second applications when the multiple subframes sent by the first application are not obtained.

12. The method according to claim 11 , wherein the sending the specified video frame to each of the second applications when the multiple subframes sent by the first application are not obtained comprises:

calculating whether a consecutive number of times that the multiple subframes are not acquired reaches a preset number of times, when the multiple subframes sent by the first application are not acquired; and

taking the target video frame obtained by a latest combination as the specified video frame and sending the specified video frame to each of the second applications, in the case that the number of consecutive times is less than the preset number of times.

13. The method according to claim 12 , wherein the sending the specified video frame to each of the second applications when the multiple subframes sent by the first application are not obtained further comprises:

sending a preset video frame as the specified video frame to each of the second applications, in the case that the number of consecutive times reaches the preset number of times.

14. An electronic device, comprising:

at least one processor;

a memory storing instructions and connected with the at least one processor;

wherein the instructions, when executed by the at least one processor, cause the at least one processor to perform the method according to claim 10 .

15. A non-transitory computer readable medium, wherein the medium stores a computer program which, when executed by a processing apparatus, implements steps of the method according to claim 10 .

16. An electronic device, applied to a first application installed in a first terminal, wherein the first terminal is further installed with multiple second applications, and the electronic device comprises:

at least one processor;

a memory storing instructions and connected with the at least one processor;

wherein the instructions, when executed by the at least one processor, cause the at least one processor to:

acquire a current video frame;

update a set of special effects to be superimposed according to a received special effect setting instruction, perform special effect processing on the current video frame according to the updated set of special effects to be superimposed, and generate a target video frame to meet requirements of special effect processing of the multiple second applications, wherein the special effect setting instruction is input by a user during an operation of the first application through a special effect setting interface provided by the first application comprising a preview area and a special effect setting area, and multiple special effect setting components are set in the special effect setting area, wherein a specific form of the set of special effects to be superimposed is a form of an array; and

send the target video frame to each of the second applications;

wherein the instructions further cause the at least one processor to:

trigger the first terminal to create a virtual device; and

send the target video frame to the virtual device, so that the virtual device sends the target video frame to each of the second applications;

create a plug-in, so that each of the second applications creates a plug-in object corresponding to each of the second applications by loading the plug-in,

wherein the virtual device sends the target video frame to each of the second applications via the corresponding plug-in object;

wherein the instructions further cause the at least one processor to:

decompose the target video frame into multiple subframes;

store the multiple subframes in a shared memory, so that the virtual device reads the multiple subframes from the shared memory;

wherein the virtual device is used to combine multiple subframes read to obtain the target video frame and send the target video frame to each of the second applications.

17. The device according to claim 16 , wherein the instructions further cause the at least one processor to:

identify a target object in the current video frame;

determine at least one target special effect to be superimposed from the updated set of special effects to be superimposed; and

superimpose the at least one target special effect to be superimposed with the target object, and generate the target video frame.

18. The device according to claim 16 , wherein each of the second applications is used to send the target video frame to at least one second terminal immediately after receiving the target video frame,

wherein the at least one second terminal receives and displays the target video frame through the second application.

19. The device according to claim 16 , wherein the plug-in object corresponding to each of the second applications comprises an identifier of the second application, and plug-in objects corresponding to different second applications are different, so that the virtual device sends the target video to each of the second applications corresponding to each plug-in object through each plug-in object.

20. The device according to claim 16 , wherein the instructions further cause the at least one processor to:

receive video acquisition requests sent from the second applications; and

wherein the current video frame is a current video frame in running processes of the second applications.

Assignments (8)

Priority Claims (1)

Continuity (2)

References Cited (30)