IP Library Granted Patent US 10,708,633
Granted Patent B1
US 10,708,633 · App. 16/357,705 · Granted Jul 7, 2020

Systems and methods for selective audio segment compression for accelerated playback of media assets

Inventors: Neeraj Kumar (Saran, IN); Vishwas Sharadanagar Panchaksharaiah (Tumkur District, IN); Vikram Makam Gupta (Karnataka, IN)
Assignee: Rovi Guides, Inc.
H04N21/2335H04N21/234381H04N21/8456H04N21/8547H04W4/029
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,708,633
App. No.
16/357,705
Granted
Jul 7, 2020
Kind
B1
Abstract

Systems and methods are disclosed herein for selective audio segment compression for accelerated playback of media assets. A playback speed of the video segment of a media asset is calculated based on the duration of the video segment and a received playback time period. A priority weight for each of the various audio segments is then determined. The audio segments with the lowest priority weight are removed from the group of various audio segments. The system then determines whether the duration of the remaining audio segments exceeds the received playback time period. If so, the system modifies the remaining audio segments by removing another audio segment with the lowest priority weight from the remaining audio segments. The system then rechecks whether the received playback time period is exceeded. If not, the system generates for playback the video segment based on the video playback speed and the remaining audio segments.

Claims (71)

1. A method for selective audio segment compression for accelerated playback of media assets, the method comprising:

calculating a video playback speed of a video segment of a media asset based on a received playback time period and a duration of the video segment;

determining a plurality of audio segments from the media asset, wherein each audio segment comprises one or more audio portions of similar type from the media asset;

determining a corresponding priority weight for each of the plurality of audio segments comprising:

retrieving a predefined priority scheme comprising a plurality of audio portion types and corresponding priority weights;

determining, for each of the plurality of audio segments, whether the type of the corresponding one or more audio portions of the audio segment match a predefined audio portion type from the predefined priority scheme; and

in response to the determination that the type of the corresponding one or more audio portions of the audio segment matches the predefined audio portion type from the predefined priority scheme, assigning the corresponding priority weight of the matching predefined audio portion type to the corresponding audio segment;

modifying the plurality of audio segments by removing an audio segment assigned to a lowest priority weight from the plurality of audio segments; and

in response to determining that the duration of remaining audio segments does not exceed the received playback time period, generating, for playback, the video segment based on the video playback speed and the remaining audio segments.

2. The method of claim 1 further comprising:

in response to determining that the duration of the remaining audio segments exceeds the received playback time period, modifying the remaining audio segments by removing an audio segment assigned to a lowest remaining priority weight from the remaining audio segments.

3. The method of claim 2 , wherein modifying the remaining audio segments by removing an audio segment assigned to a lowest remaining priority weight from the remaining audio segments comprises removing a plurality of audio segments assigned to one or more of the lowest remaining priority weights from the remaining audio segments.

4. The method of claim 1 , wherein in response to determining that the duration of remaining audio segments does not exceed the received playback time period, generating, for playback, the video segment based on the video playback speed and the remaining audio segments further comprises:

calculating a time period by the difference between the received playback time period and the sum of all remaining audio segments;

retrieving the previously removed audio segment;

trimming the previously removed audio segment to a playback period matching the time period; and

adding the trimmed removed audio segment to the remaining audio segments.

5. The method of claim 1 , wherein the predefined priority scheme is received from a content producer of the media asset.

6. The method of claim 1 further comprising:

receiving real-time locational information of an electronic device for media asset playback, wherein the real-time locational information indicates movement of the electronic device;

determining, based on historical locational information for the electronic device, whether a subset of the real-time locational information matches a subset of historical locational information;

responsive to the determination that the subset of the current real-time locational information matches the subset of historical locational information, determining an estimated playback time period based on the subset of historical locational information; and

assigning the estimated playback time period to the received playback time period.

7. The method of claim 1 , further comprising:

determining a dialogue audio segment from the plurality of audio segments;

at a particular time during playback:

determining an offset audio value based on the difference between the particular time of the audio segment and the start time of the dialogue audio segment; and

determining an offset video value based on the difference between the particular time of the video segment and the start time of the video segment;

determining whether the difference between the offset audio value and the offset video value exceeds a predefined maximum offset value; and

in response to the determination that the difference between the offset audio value and the offset video value exceeds the predefined maximum offset value, stopping generation for playback of the video segment and the remaining audio segments.

8. The method of claim 1 , wherein:

the method further comprises determining one or more audio segments as high priority audio segments;

modifying the remaining audio segments by removing an audio segment assigned to a lowest remaining priority weight from the remaining audio segments comprises determining whether the audio segment being removed is one of the one or more high priority audio segments; and

in response to the determination that the audio segment being removed is one of the one or more high priority audio segments, stopping generation for playback of the video segment and the remaining audio segments.

9. The method of claim 8 , wherein determinations of one or more audio segments as high priority audio segments are received from a content producer of the media asset.

10. A system for selective audio segment compression for accelerated playback of media assets, comprising:

control circuitry configured to:

calculate a video playback speed of a video segment of a media asset based on a received playback time period and a duration of the video segment;

determine a plurality of audio segments from the media asset, wherein each audio segment comprises one or more audio portions of similar type from the media asset;

determine a corresponding priority weight for each of the plurality of audio segments by control circuitry further configured to:

retrieve a predefined priority scheme comprising a plurality of audio portion types and corresponding priority weights;

determine, for each of the plurality of audio segments, whether the type of the corresponding one or more audio portions of the audio segment match a predefined audio portion type from the predefined priority scheme; and

in response to the determination that the type of the corresponding one or more audio portions of the audio segment matches the predefined audio portion type from the predefined priority scheme, assign the corresponding priority weight of the matching predefined audio portion type to the corresponding audio segment;

modify the plurality of audio segments by removing an audio segment assigned to a lowest priority weight from the plurality of audio segments; and

in response to determining that the duration of remaining audio segments does not exceed the received playback time period, generate, for playback, the video segment based on the video playback speed and the remaining audio segments.

11. The system of claim 10 , wherein control circuitry is further configured, when determining a corresponding priority weight for each of the plurality of audio segments, to:

in response to determining that the duration of the remaining audio segments exceeds the received playback time period, modify the remaining audio segments by removing an audio segment assigned to a lowest remaining priority weight from the remaining audio segments.

12. The system of claim 11 , wherein modifying the remaining audio segments by removing an audio segment assigned to a lowest remaining priority weight from the remaining audio segments comprises removing a plurality of audio segments assigned to one or more of the lowest remaining priority weights from the remaining audio segments.

13. The system of claim 10 , wherein control circuitry if further configured, when in response to determining that the duration of remaining audio segments does not exceed the received playback time period, generating, for playback, the video segment based on the video playback speed and the remaining audio segments, is further configured to:

calculate a time period by the difference between the received playback time period and the sum of all remaining audio segments;

retrieve the previously removed audio segment;

trim the previously removed audio segment to a playback period matching the time period; and

add the trimmed removed audio segment to the remaining audio segments.

14. The system of claim 10 , wherein the predefined priority scheme is received from a content producer of the media asset.

15. The system of claim 10 , wherein the control circuitry is further configured to:

receive real-time locational information of an electronic device for media asset playback, wherein the real-time locational information indicates movement of the electronic device;

determine, based on historical locational information for the electronic device, whether a subset of the real-time locational information matches a subset of historical locational information;

responsive to the determination that the subset of the current real-time locational information matches the subset of historical locational information, determine an estimated playback time period based on the subset of historical locational information; and

assign the estimated playback time period to the received playback time period.

16. The system of claim 10 , wherein control circuitry is further configured to:

determine a dialogue audio segment from the plurality of audio segments;

at a particular time during playback:

determine an offset audio value based on the difference between the particular time of the audio segment and the start time of the dialogue audio segment; and

determine an offset video value based on the difference between the particular time of the video segment and the start time of the video segment;

determine whether the difference between the offset audio value and the offset video value exceeds a predefined maximum offset value; and

in response to the determination that the difference between the offset audio value and the offset video value exceeds the predefined maximum offset value, stop generation for playback of the video segment and the remaining audio segments.

17. The system of claim 10 , wherein:

the control circuitry of the system is further configured to determine one or more audio segments as high priority audio segments;

the control circuitry is further configured, when modifying the remaining audio segments by removing an audio segment assigned to a lowest remaining priority weight from the remaining audio segments, to determine whether the audio segment being removed is one of the one or more high priority audio segments; and

in response to the determination that the audio segment being removed is one of the one or more high priority audio segments, stopping generation for playback of the video segment and the remaining audio segments.

18. The system of claim 17 , wherein determinations of one or more audio segments as high priority audio segments are received from a content producer of the media asset.

Assignments (7)
CHANGE OF NAME Recorded Oct 3, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069106/0178 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053481/0790 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: HPS INVESTMENT PARTNERS, LLC
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053458/0749 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2020
From: KUMAR, NEERAJ; PANCHAKSHARAIAH, VISHWAS SHARADANAGAR; GUPTA, VIKRAM MAKAM
To: ROVI GUIDES, INC.
Reel/Frame 051992/0439 →
PATENT SECURITY AGREEMENT Recorded Nov 25, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 051110/0006 →
SECURITY INTEREST Recorded Nov 22, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: HPS INVESTMENT PARTNERS, LLC, AS COLLATERAL AGENT
Reel/Frame 051143/0468 →
Cited By (1)
US 12,432,398