IP Library Granted Patent US 12,432,398
Granted Patent B2
US 12,432,398 · App. 17/382,780 · Granted Sep 30, 2025

Systems and methods for selective audio segment compression for accelerated playback of media assets by service providers

Inventors: Neeraj Kumar (Saran, IN); Vishwas Sharadanagar Panchaksharaiah (Tumkur District, IN); Vikram Makam Gupta (Karnataka, IN)
Assignee: Adeia Guides Inc.
H04N21/233H04N21/4307H04N21/47217H04N21/8456G06V20/47H04N21/8549
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,432,398
App. No.
17/382,780
Granted
Sep 30, 2025
Kind
B2
Abstract

Systems and methods are disclosed herein for selective audio segment compression for accelerated playback of media assets by service providers. A playback speed of the video segment of a media asset is calculated based on the duration of the video segment and a received playback time period. The system receives audio segments and corresponding priority weights. The audio segments with the lowest priority weight are removed from the group of various audio segments. The system then determines whether the duration of the remaining audio segments exceeds the received playback time period. If so, the system modifies the remaining audio segments by removing another audio segment with the lowest priority weight from the remaining audio segments. The system then rechecks whether the received playback time period is exceeded. If not, the system generates for playback the video segment based on the video playback speed and the remaining audio segments.

Claims (92)

1. A method comprising:

receiving a plurality of audio segments for a media asset selected for playback at an accelerated speed, wherein the plurality of audio segments collectively corresponds to a video segment of the media asset and each of the plurality of audio segments corresponds to a respective portion of the corresponding video segment of the media asset and are provided separately from the video segment;

identifying, within the media asset, a start time of the each respective portion of the corresponding video segment, wherein the each respective portion has a separate start time than another respective portion of the video segment;

identifying a corresponding audio type for each of the plurality of audio segments based on similarity of audio portions in the each audio segment by analyzing the each portion of the each audio segment, wherein the each audio segment comprises one or more audio portions of a similar type from the media asset;

determining priority weights of the plurality of audio segments by matching the corresponding audio type for the each of the plurality of audio segments and audio portion type parameters from a predefined priority scheme, wherein:

the predefined priority scheme correlates at least one audio type to at least one priority weight,

the predefined priority scheme is selected from a plurality of priority schemes where each of the plurality of priority schemes are associated with a respective service provider, and

the predefined priority scheme is selected based on determining which service provider of the plurality of service providers corresponds to the media asset;

selecting, from the plurality of audio segments, a set of audio segments selected for playback based on the priority weights of the plurality of audio segments;

generating a modified version of the set of audio segments selected for playback based on the priority weights of the plurality of audio segments, wherein generating the modified version of the set of audio segments selected for playback includes calculating a different modified playback speed for the each audio segment of the set of audio segments selected for playback such that the each audio segment of the set of audio segments selected for playback begins playback at the start time of the each respective portion of the corresponding video segment and the each audio segment has a different modified speed; and

providing, for playback, the video segment at the accelerated speed with the modified version of the set of audio segments selected for playback, wherein the each audio segment having the different modified speed is synchronized with the accelerated speed of the respective portion of the corresponding video segment.

2. The method of claim 1 , further comprising:

receiving a media asset playback time period; and

calculating the accelerated speed based on the media asset playback time period and an original duration of the video segment, wherein the original duration of the video segment exceeds the media asset playback time period.

3. The method of claim 1 , wherein the predefined priority scheme removes audio segments which do not match any of the audio portion type parameters.

4. The method of claim 3 , wherein the predefined priority scheme removes audio segments assigned to a lowest priority weight.

5. The method of claim 2 , further comprising:

assigning priority weights to each of the plurality of audio segments;

removing audio segments assigned to a lowest priority weight;

determining a duration of remaining audio segments exceeds the received media asset playback time period; and

modifying a remaining plurality of audio segments based on the predefined priority scheme.

6. The method of claim 5 , wherein in response to the determining the duration of the remaining audio segments does not exceed the received media asset playback time period:

calculating a time period by a difference between the received media asset playback time period and a sum of all the remaining audio segments;

retrieving a removed audio segment with a highest priority of the removed audio segments;

determining the remaining audio segments and the retrieved removed audio segment comprise a playback period exceeds the received media asset playback time period;

trimming the retrieved removed audio segment to a duration such that when the retrieved removed audio segment is combined with the remaining audio segments a combined audio portion comprises a duration that matches the received media asset playback time period; and

adding the trimmed retrieved removed audio segment to the remaining audio segments.

7. The method of claim 1 , further comprising:

receiving real-time locational information of a device capable of generating the media asset for playback, wherein the real-time locational information indicates movement of the device;

determining, based on historical locational information for the device, whether a subset of the real-time locational information matches a subset of historical locational information;

responsive to the determination that the subset of the real-time locational information matches the subset of historical locational information, determining an estimated media asset playback time period based on the subset of historical locational information; and

assigning the estimated media asset playback time period to the received media asset playback time period.

8. The method of claim 1 , further comprising:

determining an audio segment of the plurality of audio segments comprises a segment of dialogue;

at a particular time during playback:

determining an offset audio value based on a difference between the particular time of the segment of dialogue and the particular time of the video segment;

determining whether the offset audio value exceeds a predefined maximum offset value; and

in response to the determination that the offset audio value exceeds the predefined maximum offset value, stopping generation for playback of the video segment and remaining audio segments.

9. The method of claim 1 , further comprising:

determining at least one audio segment of the plurality of audio segments comprises a high priority audio segment;

modifying the plurality of audio segments by removing the at least one audio segment that comprises the high priority audio segment in response to determining the high priority audio segment is assigned a lowest priority weight from the plurality of audio segments; and

in response to the determination that the high priority audio segment was removed, stopping generation for playback of the video segment and remaining audio segments.

10. The method of claim 1 , further comprising:

determining a corresponding service provider based on the media asset, wherein the corresponding service provider comprises a service that provides the media asset; and

retrieving the predefined priority scheme based on the corresponding service provider.

11. A system comprising:

input/output circuitry configured to:

receive a plurality of audio segments for a media asset selected for playback at an accelerated speed, wherein the plurality of audio segments collectively corresponds to a video segment of the media asset and each of the plurality of audio segments corresponds to a respective portion of the corresponding video segment in the media asset and are provided separately from the video segment; and

control circuitry configured to:

identify a start time of the each respective portion of the corresponding video segment, wherein the each respective portion has a separate start time than another respective portion of the video segment;

identify a corresponding audio type for each of the plurality of audio segments based on similarity of audio portions in the each audio segment by analyzing each portion of the each audio segment, wherein the each audio segment comprises one or more audio portions of a similar type from the media asset;

determining priority weights of the plurality of audio segments by matching the corresponding audio type for the each of the plurality of audio segments and audio portion type parameters from a predefined priority scheme, wherein:

the predefined priority scheme correlates at least one audio type to at least one priority weight;

the predefined priority scheme is selected from a plurality of priority schemes where each of the plurality of priority schemes are associated with a respective service provider, and

the predefined priority scheme is selected based on determining which service provider of the plurality of service providers corresponds to the media asset;

select, from the plurality of audio segments, a set of audio segments selected for playback based on the priority weights of the plurality of audio segments;

generate a modified version of the set of audio segments selected for playback based on the priority weights of the plurality of audio segments, wherein generating the modified version of the set of audio segments selected for playback includes calculating a different modified playback speed for the each audio segment of the set of audio segments selected for playback such that the each audio segment of the set of audio segments selected for playback begins playback at the start time of the respective portion of the corresponding video segment and the each audio segment has a different modified speed; and

providing, for playback, the video segment at the accelerated speed with the modified version of the set of audio segments selected for playback, wherein the each audio segment having the different modified speed is synchronized with the accelerated speed of the respective portion of the corresponding video segment.

12. The system of claim 11 , wherein control circuitry is further configured to:

receive a media asset playback time period; and

calculate the accelerated speed based on the media asset playback time period and an original duration of the video segment, wherein the original duration of the video segment exceeds the media asset playback time period.

13. The system of claim 11 , wherein the control circuitry is configured to remove audio segments which do not match any of the audio portion type parameters.

14. The system of claim 13 , wherein the control circuitry is further configured to remove audio segments assigned to a lowest priority weight based on the predefined priority scheme.

15. The system of claim 12 , wherein the control circuitry is further configured to:

assign priority weights to each of the plurality of audio segments;

remove audio segments assigned to a lowest priority weight;

determine a duration of remaining audio segments exceeds the received media asset playback time period; and

modify a remaining plurality of audio segments based on the predefined priority scheme.

16. The system of claim 15 , wherein the control circuitry is further configured to determine the duration of the remaining audio segments does not exceed the received media asset playback time period and in response to the determining, is configured to:

calculate a time period by a difference between the received media asset playback time period and a sum of all the remaining audio segments;

retrieve a removed audio segment with a highest priority of the removed audio segments;

determine the remaining audio segments and the retrieved removed audio segment comprise a playback period exceeds the received media asset playback time period;

trim the retrieved removed audio segment to a duration such that when the retrieved removed audio segment is combined with the remaining audio segments a combined audio portion comprises a duration that matches the received media asset playback time period; and

add the trimmed retrieved removed audio segment to the remaining audio segments.

17. The system of claim 11 , wherein the control circuitry is further configured to:

receive real-time locational information of a device capable of generating the media asset for playback, wherein the real-time locational information indicates movement of the device;

determine, based on historical locational information for the device, whether a subset of the real-time locational information matches a subset of historical locational information;

responsive to the determination that the subset of the real-time locational information matches the subset of historical locational information, determine an estimated media asset playback time period based on the subset of historical locational information; and

assign the estimated media asset playback time period to the received media asset playback time period.

18. The system of claim 11 , wherein the control circuitry is further configured to:

determine an audio segment of the plurality of audio segments comprises a segment of dialogue;

at a particular time during playback:

determine an offset audio value based on a difference between the particular time of the segment of dialogue and the particular time of the video segment;

determine whether the offset audio value exceeds a predefined maximum offset value; and

in response to the determination that the offset audio value exceeds the predefined maximum offset value, stop generation for playback of the video segment and remaining audio segments.

19. The system of claim 11 , wherein the control circuitry is further configured to:

determine at least one audio segment of the plurality of audio segments comprises a high priority audio segment;

modify the plurality of audio segments by removing the at least one audio segment that comprises the high priority audio segment in response to determining the high priority audio segment is assigned a lowest priority weight from the plurality of audio segments; and

in response to the determination that the high priority audio segment was removed, stop generation for playback of the video segment and remaining audio segments.

20. The system of claim 11 , wherein the control circuitry is further configured to:

determine a corresponding service provider based on the media asset, wherein the corresponding service provider comprises a service that provides the media asset; and

retrieve the predefined priority scheme based on the corresponding service provider.

Assignments (3)
CHANGE OF NAME Recorded Oct 3, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069106/0178 →
SECURITY INTEREST Recorded May 19, 2023
From: ADEIA GUIDES INC.; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063707/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2021
From: KUMAR, NEERAJ; PANCHAKSHARAIAH, VISHWAS SHARADANAGAR; GUPTA, VIKRAM MAKAM
To: ROVI GUIDES, INC.
Reel/Frame 056948/0549 →
Continuity (2)
Continuation 16357725 · Mar 19, 2019
Related Publication 20210352338A1 · Nov 11, 2021
References Cited (67)
US 5583653A · Timmermans · 1996 [cited by applicant]
US 5781696A · Oh et al. · 1998 [cited by applicant]
US 5995153A · Moeller et al. · 1999 [cited by applicant]
US 6370315B1 · Mizuno · 2002 [cited by applicant]
US 6484137B1 · Taniguchi et al. · 2002 [cited by applicant]
US 7065485B1 · Chong-White et al. · 2006 [cited by applicant]
US 7136571B1 · Dagtas · 2006 [cited by applicant]
US 7149412B2 · Blair et al. · 2006 [cited by applicant]
US 7260439B2 · Foote et al. · 2007 [cited by applicant]
US 7313808B1 · Gupta et al. · 2007 [cited by applicant]
US 7426470B2 · Chu et al. · 2008 [cited by applicant]
US 7612832B2 · Zhang et al. · 2009 [cited by applicant]
US 7809241B2 · Blair et al. · 2010 [cited by applicant]
US 8032360B2 · Chen · 2011 [cited by applicant]
US 9214190B2 · Lin et al. · 2015 [cited by applicant]
US 9270964B1 · Tseytlin · 2016 [cited by applicant]
US 9788062B2 · Dimov et al. · 2017 [cited by applicant]
US 10339974B1 · Luo et al. · 2019 [cited by applicant]
US 10419830B2 · Packard et al. · 2019 [cited by applicant]
US 10433030B2 · Packard et al. · 2019 [cited by applicant]
US 10504554B2 · Takahashi · 2019 [cited by applicant]
US 10708633B1 · Kumar et al. · 2020 [cited by applicant]
US 10878835B1 · Pedruzzi et al. · 2020 [cited by applicant]
US 11102523B2 · Kumar et al. · 2021 [cited by applicant]
US 11102524B2 · Kumar et al. · 2021 [cited by applicant]
US 20020093591A1 · Gong et al. · 2002 [cited by applicant]
US 20030063407A1 · Zimmerman et al. · 2003 [cited by applicant]
US 20030165327A1 · Blair et al. · 2003 [cited by applicant]
US 20030231871A1 · Ushimaru · 2003 [cited by applicant]
US 20040143434A1 · Divakaran et al. · 2004 [cited by applicant]
US 20040170385A1 · Bhadkamkar et al. · 2004 [cited by applicant]
US 20040267388A1 · Perdon · 2004 [cited by applicant]
US 20050078113A1 · Goldhor et al. · 2005 [cited by applicant]
US 20050160449A1 · Goronzy · 2005 [cited by examiner]
US 20050207733A1 · Gargi · 2005 [cited by applicant]
US 20060165379A1 · Agnihotri et al. · 2006 [cited by applicant]
US 20060221788A1 · Lindahl et al. · 2006 [cited by applicant]
US 20060239644A1 · Barbieri · 2006 [cited by applicant]
US 20060293883A1 · Endo et al. · 2006 [cited by applicant]
US 20080037953A1 · Kawamura et al. · 2008 [cited by applicant]
US 20080221942A1 · Agnihotri · 2008 [cited by examiner]
US 20080232775A1 · Ljolje · 2008 [cited by applicant]
US 20090041356A1 · Barbieri et al. · 2009 [cited by applicant]
US 20090132243A1 · Suzuki · 2009 [cited by applicant]
US 20100023964A1 · Basso · 2010 [cited by examiner]
US 20100088330A1 · Komiya · 2010 [cited by applicant]
US 20120076357A1 · Yamamoto et al. · 2012 [cited by applicant]
US 20140028848A1 · Takenaka et al. · 2014 [cited by applicant]
US 20140255000A1 · Kao et al. · 2014 [cited by applicant]
US 20140321831A1 · Olsen et al. · 2014 [cited by applicant]
US 20150078562A1 · Shanmugasundaram et al. · 2015 [cited by applicant]
US 20150098691A1 · Avrahami et al. · 2015 [cited by applicant]
US 20150170670A1 · Luyten et al. · 2015 [cited by applicant]
US 20150332732A1 · Gilson et al. · 2015 [cited by applicant]
US 20160323482A1 · Chung · 2016 [cited by examiner]
US 20170004858A1 · Ngiam et al. · 2017 [cited by applicant]
US 20170300752A1 · Biswas et al. · 2017 [cited by applicant]
US 20170347135A1 · Frantz et al. · 2017 [cited by applicant]
US 20180227610A1 · Jin · 2018 [cited by examiner]
US 20180268866A1 · Takahashi · 2018 [cited by applicant]
US 20180285496A1 · Le Chevalier et al. · 2018 [cited by applicant]
US 20180350388A1 · Jain · 2018 [cited by applicant]
US 20200186728A1 · Pena et al. · 2020 [cited by applicant]
US 20200304842A1 · Kumar et al. · 2020 [cited by applicant]
US 20200304844A1 · Kumar et al. · 2020 [cited by applicant]
EP 3382706A1 · 2018 [cited by applicant]
WO 2012160771A1 · 2012 [cited by applicant]