IP Library Granted Patent US 11,632,576
Granted Patent B2
US 11,632,576 · App. 17/534,255 · Granted Apr 18, 2023

Live video broadcast method, live broadcast device and storage medium

Inventor: Baocheng Fan (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
H04N21/2187H04N21/23424H04N21/2743H04N21/41407H04N21/42203H04N21/4316H04N21/44004H04N21/44016H04N21/4781H04N21/4788H04N21/816
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,632,576
App. No.
17/534,255
Granted
Apr 18, 2023
Kind
B2
Abstract

The present disclosure provides a live video broadcast method performed by a first mobile device. The method includes: receiving a live broadcast command to live broadcast a video game played by a user on the first mobile device, and creating a video buffer for the video game based on the live broadcast command; binding the video buffer with a game engine to detect and extract video picture frames from the video game and store them in the video buffer; transferring the video picture frames into a frame buffer to be displayed on the first mobile device; collecting voice data by using a microphone, and synchronously synthesize the voice data and the video picture frames stored in the video buffer into a video streaming media file; and uploading the video streaming media file to a live broadcast server so as to perform live broadcasting of the video game to other devices.

Claims (87)

1. A live video broadcast method performed at a first mobile device comprising one or more processors, memory, a display, and a microphone, the method comprising:

receiving, by the first mobile device, a live broadcast command to live broadcast a video game being played by a user on the first mobile device, wherein the video game generates, in real time, game pictures using a game engine running on the first mobile device;

creating a video buffer based on the live broadcast command for storing one or more of the game pictures of the video game in real time;

binding the video buffer with the game engine;

while the user is playing the video game:

detecting and extracting a plurality of video picture frames from the video game using the game engine;

storing the plurality of video picture frames in the video buffer;

transferring the plurality of video picture frames from the video buffer into a frame buffer;

displaying the plurality of video picture frames in the frame buffer on the display of the first mobile device;

collecting voice data using the microphone;

synchronously synthesizing the voice data and the plurality of video picture frames stored in the video buffer into a video streaming media file corresponding to the video game; and

uploading the video streaming media file to a live broadcast server, so that the live broadcast server performs live broadcasting of the video streaming media file in response to one or more live streaming requests from other mobile devices.

2. The live video broadcast method according to claim 1 , wherein the operation of creating a video buffer based on the live broadcast command comprises:

invoking a pre-configured mounting component based on the live broadcast command;

replacing a picture loading method using the mounting component; and

creating a corresponding video buffer based on the replaced picture loading method.

3. The live video broadcast method according to claim 2 , wherein the operation of replacing a picture loading method using the mounting component comprise:

detecting whether the picture loading method is invoked; and

replacing a picture drawing method in the picture loading method when the picture loading method is invoked, so as to detect updating of the video picture frame by using the game engine.

4. The live video broadcast method according to claim 1 , wherein the live broadcast server is configured to perform the live broadcasting by:

receiving comment information associated with the video game from one or more other mobile devices;

synthesizing the comment information and the video streaming media file, to obtain a live streaming media file with comments; and

performing a broadcast operation on the live streaming media file with comments to one or more mobile devices including the first mobile device,

wherein a respective mobile device is configured to display comments from all other mobile devices that are currently live broadcasting the video game.

5. The live video broadcast method according to claim 1 , wherein the live broadcast server is configured to perform the live broadcasting by:

receiving barrage comments information associated with the video game from one or more mobile devices;

performing a broadcast operation on the video streaming media file; and

synchronously superimposing the barrage comments information on the associated video picture frames of the video streaming media file on a playback screen of the first mobile device.

6. A first mobile device for live video broadcast, comprising:

one or more processors;

memory coupled to the one or more processors; and

a plurality of programs stored in the memory that, when executed by the one or more processors, cause the mobile device to perform a plurality of operations including:

receiving, by the first mobile device, a live broadcast command to live broadcast a video game being played by a user on the first mobile device, wherein the video game generates, in real time, game pictures using a game engine running on the first mobile device;

creating a video buffer based on the live broadcast command for storing one or more of the game pictures of the video game in real time;

binding the video buffer with the game engine;

while the user is playing the video game:

detecting and extracting a plurality of video picture frames from the video game using the game engine;

storing the plurality of video picture frames in the video buffer;

transferring the plurality of video picture frames from the video buffer into a frame buffer;

displaying the plurality of video picture frames in the frame buffer on the display of the first mobile device;

collecting voice data using the microphone;

synchronously synthesizing the voice data and the plurality of video picture frames stored in the video buffer into a video streaming media file corresponding to the video game; and

uploading the video streaming media file to a live broadcast server, so that the live broadcast server performs live broadcasting of the video streaming media file in response to one or more live streaming requests from other mobile devices.

7. The first mobile device according to claim 6 , wherein the operation of creating a video buffer based on the live broadcast command comprises:

invoking a pre-configured mounting component based on the live broadcast command;

replacing a picture loading method using the mounting component; and

creating a corresponding video buffer based on the replaced picture loading method.

8. The first mobile device according to claim 7 , wherein the operation of replacing a picture loading method using the mounting component comprise:

detecting whether the picture loading method is invoked; and

replacing a picture drawing method in the picture loading method when the picture loading method is invoked, so as to detect updating of the video picture frame by using the game engine.

9. The first mobile device according to claim 6 , where the live broadcast server is configured to perform the live broadcasting by:

receiving comment information associated with the video game from one or more other mobile devices;

synthesizing the comment information and the video streaming media file, to obtain a live streaming media file with comments; and

performing a broadcast operation on the live streaming media file with comments to one or more mobile devices including the first mobile device,

wherein a respective mobile device is configured to display comments from all other mobile devices that are currently live broadcasting the video game.

10. The first mobile device according to claim 6 , where the live broadcast server is configured to perform the live broadcasting by:

receiving barrage comments information associated with the video game from one or more mobile devices;

performing a broadcast operation on the video streaming media file; and

synchronously superimposing the barrage comments information on the associated video picture frames of the video streaming media file on a playback screen of the first mobile device.

11. A non-transitory computer readable storage medium storing a plurality of instructions in connection with a first mobile device having one or more processors for live video broadcast, wherein the plurality of instructions, when executed by the one or more processors, cause the first mobile device to perform a plurality of operations including:

receiving, by the first mobile device, a live broadcast command to live broadcast a video game being played by a user on the first mobile device, wherein the video game generates, in real time, game pictures using a game engine running on the first mobile device;

creating a video buffer based on the live broadcast command for storing one or more of the game pictures of the video game in real time;

binding the video buffer with the game engine;

while the user is playing the video game:

detecting and extracting a plurality of video picture frames from the video game using the game engine;

storing the plurality of video picture frames in the video buffer;

transferring the plurality of video picture frames from the video buffer into a frame buffer;

displaying the plurality of video picture frames in the frame buffer on the display of the first mobile device;

collecting voice data using the microphone;

synchronously synthesizing the voice data and the plurality of video picture frames stored in the video buffer into a video streaming media file corresponding to the video game; and

uploading the video streaming media file to a live broadcast server, so that the live broadcast server performs live broadcasting of the video streaming media file in response to one or more live streaming requests from other mobile devices.

12. The non-transitory computer readable storage medium according to claim 11 , wherein the operation of creating a video buffer based on the live broadcast command comprises:

invoking a pre-configured mounting component based on the live broadcast command;

replacing a picture loading method using the mounting component; and

creating a corresponding video buffer based on the replaced picture loading method.

13. The non-transitory computer readable storage medium according to claim 12 , wherein the operation of replacing a picture loading method using the mounting component comprise:

detecting whether the picture loading method is invoked; and

replacing a picture drawing method in the picture loading method if the picture loading method is invoked, so as to detect updating of the video picture frame by using the game engine.

14. The non-transitory computer readable storage medium according to claim 11 , where the live broadcast server is configured to perform the live broadcasting by:

receiving comment information associated with the video game from one or more other mobile devices;

synthesizing the comment information and the video streaming media file, to obtain a live streaming media file with comments; and

performing a broadcast operation on the live streaming media file with comments to one or more mobile devices including the first mobile device,

wherein a respective mobile device is configured to display comments from all other mobile devices that are currently live broadcasting the video game.

15. The non-transitory computer readable storage medium according to claim 11 , where the live broadcast server is configured to perform the live broadcasting by:

receiving, by the live broadcast server, barrage comments information associated with the video game from one or more mobile devices;

performing, by the live broadcast server, a broadcast operation on the video streaming media file; and

synchronously superimposing the barrage comments information on the associated video picture frames of the video streaming media file on a playback screen of the first mobile device.

Priority Claims (1)
CN 201611073970.X · Nov 29, 2016 · national
Continuity (3)
Continuation 16351267 · Mar 12, 2019
Continuation PCTCN2017111535 · Nov 17, 2017
Related Publication 20220086508A1 · Mar 17, 2022
Cited By (1)
US 12,389,049