IP Library Granted Patent US 9,510,031
Granted Patent B2
US 9,510,031 · App. 14/464,146 · Granted Nov 29, 2016

Systems and methods for encoding alternative streams of video for playback on playback devices having predetermined display aspect ratios and network connection maximum data rates

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,510,031
App. No.
14/464,146
Granted
Nov 29, 2016
Kind
B2
Abstract

Systems and methods for adaptive bitrate streaming of alternative streams of video encoded at resolution and sample aspect ratio combinations and maximum bitrates in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a source encoder configured to encode a source video stream as a plurality of alternative streams of video for playback on a playback device includes a processor configured to receive multimedia content including source video data having a primary resolution, a primary sample aspect ratio, and a primary frame rate and to encode the source video data as alternative streams of video, where the resolution and sample aspect ratio of at least one of the alternative streams of video are selected to have an aspect ratio that is the same as a predetermined display aspect ratio and at least one of the alternative streams is encoded at a maximum bitrate.

Claims (49)

1. A source encoder configured to encode a source video stream as a plurality of alternative streams of video for playback on a playback device, comprising:

a processor configured by an encoding application to:

obtain an encoding profile, where the encoding profile specifies a plurality of maximum bitrates including a maximum bitrate corresponding to a predetermined network connection maximum data rate;

receive multimedia content, where the multimedia content comprises source video having a primary resolution, a primary display aspect ratio, and a primary frame rate; and

encode the source video data as a set of alternative video streams with resolutions and sample aspect ratios that result in a common aspect ratio across the alternative streams corresponding to the primary display aspect ratio of the original source video; wherein each alternative streams encodes the source video at different resolution and sample aspect ratio combinations and different maximum bitrates, and wherein at least one of the alternative streams is encoded at the maximum bitrate corresponding to the predetermined network connection maximum data rate

wherein the encoding application further configures the processor to:

select a resolution, sample aspect ratio, and frame rate for each alternative stream;

determine a maximum bitrate threshold beyond which higher video quality can be achieved using a higher resolution than the selected resolution at the selected frame rate of each alternative stream by using an adjusted number of macroblocks per second determined based upon the selected resolution, and frame rate;

select a maximum bitrate from the profile for each alternative stream, where the selected maximum bitrate is the highest maximum bitrate specified in the profile that is less than the maximum bitrate threshold determined for the alternative stream; and

generate each alternative stream by encoding the source video stream at the selected maximum bitrate, selected resolution, sample aspect ratio and frame rate.

2. The source encoder of claim 1 , wherein each pixel of encoded video can be scaled to an integer number of pixels on the display of the playback device.

3. The source encoder of claim 2 , wherein the playback device can transition between the set of alternative streams without the need to resample the alternative streams or add padding rows and columns to the decoded video to fit to a display resolution.

4. The source encoder of claim 1 , wherein the encoding application further directs the processor to:

select a set of resolutions and different sample aspect ratio combinations that have an aspect ratio corresponding to the primary display aspect ratio; and

encode an alternative stream at each resolution and sampling aspect ratio combination.

5. The source encoder of claim 4 , wherein the encoding application further directs the process to, for each alternative stream, select a maximum bitrate to encode the alternative stream based upon a set of predetermined maximum bitrates corresponding to maximum effective data rates of network connections of playback devices.

6. The source encoder of claim 1 , wherein alternative streams encode the source video at a different frame rate.

7. The source encoder of claim 1 , wherein the encoding application further directs the processor to encode at least one of the alternative streams at a maximum bitrate corresponding to a predetermined network connection maximum data rate typically experienced by a set of playback devices that use a particular technology and Internet Service Provider to connect to the Internet.

8. The source encoder of claim 7 , wherein the encoding application further directs the processor to:

select a resolution, sample aspect ratio, and frame rate for one of the alternative streams;

determine a maximum bitrate threshold beyond which higher video quality can be achieved using a higher resolution than the selected resolution at the selected frame rate; and

encode the source video at the predetermined network connection maximum data rate, when the predetermined network connection maximum data rate is less than the maximum bitrate threshold.

9. The source encoder of claim 1 , wherein the encoding application directs the processor to determine the adjusted number of macroblocks per second (AMBPS) as follows:

AMBPS=((width*height*FPS)/256)*AdjustmentFactor (FPS),

where width and height are the width and height of the encoding resolution,

FPS is the frame rate per second for the video data, and

AdjustmentFactor (FPS) is a predetermined value based on the FPS of the video data.

10. The source encoder of claim 9 , wherein the adjustment factor is selected from the group comprising:

an AdjustmentFactor (FPS)=1, where FPS=29.97;

an AdjustmentFactor (FPS)=1.1333, where FPS=25; and

an AdjustmentFactor (FPS)=1.1606, where FPS=23.976.

11. The source encoder of claim 9 , wherein the encoding application directs the processor to determine the adjustment factor is determined as follows:

AdjustmentFactor (FPS)=1+((MaxFPS−FPS)/(MaxFPS*1.25))

where MaxFPS is Ceiling (FPS/30)*30.

12. The non-transitory machine readable medium of claim 1 , wherein execution of the instructions by a processor further causes the processor to:

select a set of resolutions and different sample aspect ratio combinations that have an aspect ratio corresponding to the primary display aspect ratio; and

encode an alternative stream at each resolution and sampling aspect ratio combination.

13. The non-transitory machine readable medium of claim 1 , wherein execution of the instructions by a processor further causes the processor to: for each alternative stream, select a maximum bitrate to encode the alternative stream based upon a set of predetermined maximum bitrates corresponding to maximum effective data rates of network connections of playback devices.

14. The non-transitory machine readable medium of claim 1 , wherein alternative streams encode the source video at a different frame rate.

15. A non-transitory machine readable medium containing processor instructions, where execution of the instructions by a processor causes the processor to perform a process comprising:

obtain an encoding profile, where the encoding profile specifies a plurality of maximum bitrates including a maximum bitrate corresponding to a predetermined network connection maximum data rate;

receive multimedia content, where the multimedia content comprises source video having a primary resolution, a primary display aspect ratio, and a primary frame rate; and

encode the source video data as a set of alternative video streams with resolutions and sample aspect ratios that result in a common aspect ratio across the alternative streams corresponding to the primary display aspect ratio of the original source video; wherein each alternative streams encodes the source video at different resolution and sample aspect ratio combinations and different maximum bitrates, and wherein at least one of the alternative streams is encoded at the maximum bitrate corresponding to the predetermined network connection maximum data rate, wherein execution of the instructions by a processor further causes the processor to:

select a resolution, sample aspect ratio, and frame rate for each alternative stream;

determine a maximum bitrate threshold beyond which higher video quality can be achieved using a higher resolution than the selected resolution at the selected frame rate of each alternative stream using an adjusted number of macroblocks per second determined based upon the selected resolution, and frame rate;

select a maximum bitrate from the profile for each alternative stream, where the selected maximum bitrate is the highest maximum bitrate specified in the profile that is less than the maximum bitrate threshold determined for the alternative stream; and

generate each alternative stream by encoding the source video stream at the selected maximum bitrate, selected resolution, sample aspect ratio and frame rate.

16. The non-transitory machine readable medium of claim 15 , wherein each pixel of encoded video can be scaled to an integer number of pixels on the display of the playback device.

17. The non-transitory machine readable medium of claim 16 , wherein execution of the instructions by a processor further causes the processor to transition between the set of alternative streams without the need to resample the alternative streams or add padding rows and columns to the decoded video to fit to a display resolution.

Assignments (5)
CHANGE OF PRINCIPAL PLACE OF BUSINESS Recorded Mar 5, 2019
From: DIVX, LLC
To: DIVX, LLC
Reel/Frame 050407/0104 →
CHANGE OF NAME Recorded Mar 5, 2018
From: DIVX CF HOLDINGS LLC
To: DIVX, LLC
Reel/Frame 045498/0560 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2018
From: SONIC IP, INC.; DIVX, LLC
To: DIVX CF HOLDINGS LLC
Reel/Frame 045310/0020 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2014
From: SOROUSHIAN, KOUROSH; VAN DER SCHAAR, AUKE SJOERD
To: DIVX, LLC
Reel/Frame 033801/0334 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2014
From: DIVX, LLC
To: SONIC IP, INC.
Reel/Frame 033801/0342 →