IP Library Granted Patent US 11,070,867
Granted Patent B2
US 11,070,867 · App. 15/846,816 · Granted Jul 20, 2021

Method, device, and computing apparatus for acquiring broadcasting content

Inventors: Keming Fang (Guangzhou, CN); Pan Xu (Guangzhou, CN)
Assignee: Alibaba Group Holding Limited
H04N21/4334H04N21/44008H04N21/4782H04N21/6125
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,070,867
App. No.
15/846,816
Granted
Jul 20, 2021
Kind
B2
Abstract

A method, device, and computing apparatus for acquiring broadcasting content are provided. The method includes: in a recognition step, recognizing a type of multimedia player in a target webpage and an output mode for broadcasting multimedia resource; and in a broadcasting-content acquiring step, based on the type and the output mode, acquiring broadcasting content of a multimedia resource played by the multimedia player.

Claims (76)

1. A method for acquiring and storing broadcasting multimedia content performed by computer programs stored in a memory and executable by a processor, the method comprising:

while broadcasting multimedia content is being broadcasted on a webpage, analyzing, by the processor, a broadcasting mechanism of a multimedia resource corresponding to the broadcasting multimedia content, wherein analyzing the broadcasting mechanism of the multimedia resource includes:

recognizing, by the processor, a type of a multimedia player on the webpage and an output mode for broadcasting the multimedia resource;

acquiring, by the processor, based at least in part on the recognized multimedia player type and the recognized output mode, the broadcasting multimedia content at a gradually decreasing frame rate;

storing, by the processor, during the broadcasting of the broadcasting multimedia content on the webpage, the acquired broadcasting multimedia content in the memory; and

when acquiring the broadcasting multimedia content and when the webpage is a non-current webpage, timely triggering, by the processor, the multimedia player to keep broadcasting the multimedia content.

2. The method according to claim 1 , wherein:

the acquired broadcasting multimedia content is stored in a multimedia storage region in a preset format.

3. The method according to claim 2 , wherein:

the multimedia resource includes a video resource; and

acquiring, by the processor, the broadcasting multimedia content includes:

acquiring, by the processor, a whole or a part of video frames of the video resource played by the multimedia player one by one.

4. The method according to claim 3 , wherein:

the multimedia storage region is a canvas buffering region configured to store a series of video frames, and

a canvas dimension of the canvas buffering region is substantially same as an initial dimension of the video frames when the broadcasting multimedia content is started being acquired.

5. The method according to claim 4 , wherein storing, by the memory, the acquired broadcasting multimedia content includes:

converting, by the processor, each of the acquired video frames into the preset format, and

filling, by the processor, each of the acquired video frames to a corresponding region of the canvas buffering region based on location information, wherein after an acquired video frame is filled to the corresponding region of the canvas buffering region, a portion of another acquired video frame following the acquired video frame is filled in a corresponding region of the canvas buffering region based on corresponding location information while remaining regions of the canvas buffering region are filled with the acquired video frame based on corresponding location information.

6. The method according to claim 1 , wherein:

the multimedia resource includes an audio resource, and

acquiring, by the processor, the broadcasting multimedia content includes:

acquiring, by the processor, audio content outputted to a sound card for playing.

7. The method according to claim 1 , wherein:

the type of the multimedia player is recognized to be a webpage element, and

based on the recognized output mode, the broadcasting multimedia content is acquired based on one of following:

based on a recognized software-decoding output mode, directly acquiring the broadcasting multimedia content decoded by software; and

based on a recognized hardware-decoding output mode, directly acquiring the broadcasting multimedia content that hasn't been decoded by the hardware followed by software self-decoding, or acquiring the broadcasting multimedia content decoded by hardware by reading data of the hardware.

8. The method according to claim 1 , wherein:

the type of the multimedia player is recognized to be a webpage plugin, and

the broadcasting multimedia content is acquired by intercepting an output interface.

9. The method according to claim 8 , wherein:

based on the recognized output mode, following approaches are applied to acquire the broadcasting multimedia content by intercepting the output interface:

based on a recognized 2D software-decoding output mode, directly intercepting an output interface to acquire the broadcasting multimedia content;

based on a recognized 3D software-decoding output mode, intercepting output contents of a plurality of output interfaces and acquiring the broadcasting multimedia content based on correlation between the plurality of output contents; and

based on a recognized hardware-decoding output mode, calling an output interface to read data of the hardware to acquire the broadcasting multimedia content.

10. The method according to claim 1 , wherein:

when acquiring the broadcasting multimedia content and when the webpage is a current webpage and a whole or a part of content of the multimedia player is on a non-display region, a clipping region is created for the multimedia player to keep the multimedia player broadcasting the multimedia content.

11. A device for acquiring and storing broadcasting multimedia content, comprising:

a memory, for storing computer programs for a method for acquiring broadcasting multimedia content;

a processor, coupled to the memory and, when executing the computer programs, configured for:

while broadcasting multimedia content is being broadcasted on a webpage, analyzing, by the processor, a broadcasting mechanism of a multimedia resource corresponding to the broadcasting multimedia content, wherein analyzing the broadcasting mechanism of the broadcasting multimedia content comprises recognizing, by the processor, a type of a multimedia player on the webpage and an output mode for broadcasting the multimedia resource;

acquiring, by the processor and based at least in part on the recognized multimedia player type and the recognized output mode, the broadcasting multimedia content at a gradually decreasing frame rate;

storing, by the processor, during the broadcasting of the multimedia content on the webpage, the acquired broadcasting multimedia content in the memory; and

when acquiring the broadcasting multimedia content and when the webpage is a non-current webpage, timely triggering, by the processor, the multimedia player to keep broadcasting the multimedia content.

12. The device according to claim 11 , wherein:

the acquired broadcasting multimedia content is stored in a multimedia storage region in a preset format.

13. The device according to claim 12 , wherein: the multimedia resource includes a video resource, and acquiring the broadcasting multimedia content includes:

acquiring a whole or a part of video frames of the video resource played by the multimedia player one by one.

14. The device according to claim 11 , wherein:

the type of the multimedia player is recognized to be a webpage element, and

based on the recognized output mode, acquiring the broadcasting multimedia content includes one of:

based on a recognized software-decoding output mode, directly acquiring the broadcasting multimedia content decoded by software; or

based on a recognized hardware-decoding output mode, directly acquiring the broadcasting multimedia content that hasn't been decoded by the hardware followed by software self-decoding, or acquiring the broadcasting multimedia content decoded by hardware by reading data of the hardware.

15. The device according to claim 14 , wherein based on the recognized output mode, acquiring the broadcasting multimedia content includes one of following operations:

based on a recognized 2D software-decoding output mode, directly intercepting the output interface to acquire the broadcasting multimedia content;

based on the recognized 3D software-decoding output mode, capturing output content of a plurality of output interfaces and acquiring the broadcasting multimedia content based on a mutual relationship between a plurality of output contents; and

based on a recognized hardware-decoding output mode, calling an output interface to read data of the hardware to acquire the broadcasting multimedia content.

16. The device according to claim 11 , wherein:

the type of the multimedia player is a webpage plugin, and

the broadcasting multimedia content is acquired by intercepting an output interface.

17. The device according to claim 11 , wherein the processor is further configured for:

when the webpage is a current webpage and a whole or a part of content of the multimedia player is on a non-display region, creating a clipping region for the multimedia player to keep the multimedia player broadcasting the multimedia content.

18. A computing apparatus, comprising:

a display device, configured to display information;

a memory, configured to store information; and

a processor, connected to the display device and the memory, the processor being configured to:

while multimedia content is being broadcasted on a webpage, analyze a broadcasting mechanism of a multimedia resource corresponding to the multimedia content, by recognizing a type of a multimedia player on the webpage and an output mode for broadcasting the multimedia resource;

acquire, based at least in part on the recognized multimedia player type and the recognized output mode, the broadcasting multimedia content at a gradually decreasing frame rate;

store the acquired broadcasting multimedia content in the memory; and

when acquiring the broadcasting multimedia content and when the webpage is a non-current webpage, timely trigger the multimedia player to keep the multimedia player broadcasting the multimedia content.

19. The computing apparatus of claim 18 , wherein:

the acquired broadcasting multimedia content is stored in a multimedia storage region in a preset format.

20. The computing apparatus of claim 18 , wherein:

the multimedia resource includes a video resource; and

acquiring, by the processor, the broadcasting multimedia content includes:

acquiring, by the processor, a whole or a part of video frames of the video resource played by the multimedia player one by one.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 28, 2020
From: GUANGZHOU UCWEB COMPUTER TECHNOLOGY CO., LTD
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 052771/0562 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2018
From: FANG, KEMING; XU, PAN
To: GUANGZHOU UCWEB COMPUTER TECHNOLOGY CO., LTD
Reel/Frame 044588/0932 →
Priority Claims (1)
CN 201611199443.3 · Dec 22, 2016 · national
Continuity (1)
Related Publication 20180184155A1 · Jun 28, 2018