IP Library › Granted Patent US 11,336,711
Granted Patent B2
US 11,336,711 · App. 17/304,774 · Granted May 17, 2022

Method of playing audio and video, computing device, and computer program product

Inventors: Sheng Wang (Shanghai, CN); Hanchao Zheng (Shanghai, CN); Zhiqiang Wu (Shanghai, CN); Hui Chen (Shanghai, CN); Jianqiang Ding (Shanghai, CN); Wenjie Fan (Shanghai, CN); Zhaoxin Tan (Shanghai, CN)
Assignee: Shanghai Bilibili Technology Co., Ltd.
H04L65/607H04L65/4084H04L65/601H04N21/2662
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,336,711
App. No.
17/304,774
Granted
May 17, 2022
Kind
B2
Abstract

A method of playing audio and video is provided. The method includes: obtaining a streaming media content to be encapsulated, and parsing the streaming media content to obtain audio parameter information and/or video parameter information; forming a Media Presentation Description (MPD) file in JavaScript Object Notation (JSON) format according to the audio parameter information and/or the video parameter information, wherein the MPD file in JSON format includes multiple streaming media content segments, each streaming media content segment includes a video segment and/or an audio segment, each of the video segment and the audio segment includes multiple arrays, and each array includes the audio parameter information or the video parameter information; sending the MPD file in JSON format to a client.

Claims (43)

1. A method, comprising:

obtaining a streaming media content to be encapsulated, and parsing the streaming media content to obtain audio parameter information corresponding to multiple resolutions and/or video parameter information corresponding to multiple bitstreams;

forming a Media Presentation Description (MPD) file in JavaScript Object Notation (JSON) format according to the audio parameter information and/or the video parameter information, wherein the MPD file in JSON format comprises multiple streaming media content segments, each streaming media content segment comprises a video segment and/or an audio segment, each of the video segment and the audio segment comprises multiple arrays, and each array includes corresponding information to a bitstream of the multiple bitstreams in the audio parameter information or corresponding information to a resolution of the multiple resolutions in the video parameter information; and

sending the MPD file in JSON format to a client.

2. The method of claim 1 , wherein the audio parameter information comprises bitstream information, audio address information for each of the multiple bitstreams, and audio attribute information for each of the multiple bitstreams; and

wherein the video parameter information comprises resolution information, video address information for each of the multiple resolutions, and video attribute information for each of the multiple resolutions.

3. The method of claim 2 , wherein the forming a Media Presentation Description (MPD) file in JavaScript Object Notation (JSON) format according to the audio parameter information and/or the video parameter information comprises:

for a same resolution of the multiple resolutions, adding the corresponding information in the video parameter information to an array of the multiple arrays, and/or for a same bitstream of the multiple bitstreams, adding the corresponding information in the audio parameter information to a respective array;

adding respective arrays for respective resolutions to a video segment, and/or adding respective arrays for respective bitstreams to an audio segment; and

adding the video segment and/or the audio segment to a streaming media content segment.

4. The method of claim 2 , wherein the video address information comprises at least one of video primary address information or video backup address information.

5. The method of claim 2 , wherein the video attribute information comprises at least one of video stream identification number, bandwidth recommended for video transmission, media type, encoding method, width, height, framerate, video SAR ratio, video SAP start value, whether the video is initialized, current video segment index range, or video encoding identification number.

6. The method of claim 2 , wherein the audio address information comprises at least one of audio primary address information or audio backup address information.

7. The method of claim 2 , wherein the audio attribute information comprises at least one of audio stream identification number, bandwidth recommended for audio transmission, media type, encoding method, whether the audio is initialized, current audio segment index range, or audio encoding identification number.

8. A computing device, comprising:

one or more processors; and

one or more non-transitory computer-readable storage mediums containing instructions configured to cause the one or more processors to perform operations including:

obtaining a streaming media content to be encapsulated, and parsing the streaming media content to obtain audio parameter information corresponding to multiple resolutions and/or video parameter information corresponding to multiple bitstreams;

forming a Media Presentation Description (MPD) file in JavaScript Object Notation (JSON) format according to the audio parameter information and/or the video parameter information, wherein the MPD file in JSON format comprises multiple streaming media content segments, each streaming media content segment comprises a video segment and/or an audio segment, each of the video segment and the audio segment comprises multiple arrays, and each array includes corresponding information to a bitstream of the multiple bitstreams in the audio parameter information or corresponding information to a resolution of the multiple resolutions in the video parameter information; and

sending the MPD file in JSON format to a client.

9. The computing device of claim 8 , wherein the audio parameter information comprises: bitstream information, audio address information for each of the multiple bitstreams, and audio attribute information for each of the multiple bitstreams; and

wherein the video parameter information comprises: resolution information, video address information for each of the multiple resolutions, and video attribute information for each of the multiple resolutions.

10. The computing device of claim 9 , wherein the video address information comprises at least one of video primary address information or video backup address information.

11. The computing device of claim 9 , wherein the video attribute information comprises at least one of video stream identification number, bandwidth recommended for video transmission, media type, encoding method, width, height, framerate, video SAR ratio, video SAP start value, whether the video is initialized, current video segment index range, or video encoding identification number.

12. The computing device of claim 9 , wherein the audio address information comprises at least one of audio primary address information or audio backup address information.

13. The computing device of claim 9 , wherein the audio attribute information comprises at least one of audio stream identification number, bandwidth recommended for audio transmission, media type, encoding method, whether the audio is initialized, current audio segment index range, or audio encoding identification number.

14. The computing device of claim 8 , wherein the forming a Media Presentation Description (MPD) file in JavaScript Object Notation (JSON) format according to the audio parameter information and/or the video parameter information comprises:

for a same resolution of the multiple resolutions, adding the corresponding information in the video parameter information for a same resolution to an respective array of the multiple arrays, and/or for a same bitstream of the multiple bitstreams, adding the corresponding information in the audio parameter information for a same bitstream to a respective array;

adding respective arrays for respective resolutions to a video segment, and/or adding respective arrays for respective bitstreams to an audio segment; and

adding the video segment and/or the audio segment to a streaming media content segment.

15. A non-transitory computer-program product tangibly embodied in a machine-readable non-transitory storage medium that includes instructions configured to cause one or more processors to:

obtain a streaming media content to be encapsulated, and parsing the streaming media content to obtain audio parameter information corresponding to multiple resolutions and/or video parameter information corresponding to multiple bitstreams;

form a Media Presentation Description (MPD) file in JavaScript Object Notation (JSON) format according to the audio parameter information and/or the video parameter information, wherein the MPD file in JSON format comprises multiple streaming media content segments, each streaming media content segment comprises a video segment and/or an audio segment, each of the video segment and the audio segment comprises multiple arrays, and each array includes corresponding information to a bitstream of the multiple bitstreams in audio parameter information corresponding information to a resolution of the multiple resolutions in video parameter information; and

send the MPD file in JSON format to a client.

16. The non-transitory computer-program product of claim 15 , wherein the audio parameter information comprises: bitstream information, audio address information for each of the multiple bitstreams, and audio attribute information for each of the multiple bitstreams; and

wherein the video parameter information comprises: resolution information, video address information for each of the multiple resolutions, and video attribute information for each of the multiple resolutions.

17. The non-transitory computer-program product of claim 16 , wherein the video address information comprises at least one of video primary address information or video backup address information.

18. The non-transitory computer-program product of claim 16 , wherein the video attribute information comprises at least one of video stream identification number, bandwidth recommended for video transmission, media type, encoding method, width, height, framerate, video SAR ratio, video SAP start value, whether the video is initialized, current video segment index range, or video encoding identification number.

19. The non-transitory computer-program product of claim 16 , wherein the audio attribute information comprises at least one of audio stream identification number, bandwidth recommended for audio transmission, media type, encoding method, whether the audio is initialized, current audio segment index range, or audio encoding identification number.

20. The non-transitory computer-program product of claim 15 , wherein the forming a Media Presentation Description (MPD) file in JavaScript Object Notation (JSON) format according to the audio parameter information and/or the video parameter information comprises:

for a same resolution of the multiple resolutions, adding the corresponding information in the video parameter information to an array of the multiple arrays, and/or for a same bitstream of the multiple bitstreams, adding the corresponding information in the audio parameter information to a respective array;

adding respective arrays for respective resolutions to a video segment, and/or adding respective arrays for respective bitstreams to an audio segment; and

adding the video segment and/or the audio segment to a streaming media content segment.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE 3RD AND 5TH ASSIGNOR'S NAME PREVIOUSLY RECORDED AT REEL: 056734 FRAME: 0562. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Jul 13, 2021
From: WANG, SHENG; ZHENG, HANCHAO; WU, ZHIQIANG; CHEN, HUI; DING, JIANQIANG; FAN, WENJIE; TAN, ZHAOXIN
To: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
Reel/Frame 056861/0493 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2021
From: WANG, SHENG; ZHENG, HANCHAO; WU, ZHIGIANG; CHEN, HUI; DING, JIANGIANG; FAN, WENJIE; TAN, ZHAOXIN
To: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
Reel/Frame 056734/0562 →
Priority Claims (1)
CN 201910092692.X · Jan 30, 2019 · national
Continuity (2)
Continuation PCTCN2019128439 · Dec 25, 2019
Related Publication 20210352127A1 · Nov 11, 2021