IP Library Granted Patent US 12,677,044
Granted Patent B2
US 12,677,044 · App. 18/598,652 · Granted Jul 7, 2026

Midroll breaks feedback system

Inventors: Yun Shi (Sunnyvale, CA); Jianfeng Yang (Mountain View, CA); Ramesh Sarukkai (Los Gatos, CA); Zindziswa Lara McCormick (Mountain View, CA)
Assignee: GOOGLE LLC
H04N21/812H04N21/23424H04N21/2407H04N21/4532H04N21/4755
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,677,044
App. No.
18/598,652
Filed
Mar 7, 2024
Granted
Jul 7, 2026
Kind
B2
Art Unit
3629
USPC
725/32
Abstract

A computer-implemented method for optimizing the placement of previously selected breaks in a media item is provided herein. Embodiments of the method include steps of identifying a break in a media item, the break being associated with a first break point at a first time during playback of the media item. The method may also include steps of dynamically adjusting the placement of the breaks within the media item based on the performance of the media item.

Claims (46)

1 . A computer-implemented method comprising:

accessing, by a processor of a content server, a media item comprising visible content;

identifying, by the processor using a machine learning algorithm, a plurality of candidate break points in the media item, wherein the machine learning algorithm produces a plurality of confidence values respectively associated with the plurality of candidate break points, and wherein each confidence value indicates a likelihood that the corresponding candidate break point is an appropriate location for inclusion of a content item;

selecting, by the processor from the plurality of candidate break points, a break point in the media item, the break point being associated with a first point in time within the media item;

providing the media item to a plurality of devices, wherein each of the plurality of devices presents (i) the media item and (ii) the content item at the first point in time within the media item during playback of the media item;

after providing the media item to the plurality of devices, determining, by the processor based on data indicating how the media item and the content item are viewed by users when presented via the plurality of devices, to adjust the break point from the first point in time to a second point in time within the media item, wherein the second point in time is different from the first point in time;

adjusting, by the processor, a position of the break point from the first point in time to the second point in time; and

after adjusting the position of the break point, providing the media item to an additional device, wherein the additional device presents (i) the media item and (ii) the content item at the second point in time within the media item during playback of the media item.

2 . The computer-implemented method of claim 1 , wherein adjusting the position of the break point comprises:

selecting, by the processor from the plurality of candidate break points, a second break point that aligns with the second point in time.

3 . The computer-implemented method of claim 1 , wherein determining to adjust the break point in the media item comprises:

determining, by the processor based on the data indicating how the media item and the content item are viewed by users when presented via the plurality of devices and the plurality of confidence values respectively associated with the plurality of candidate break points, to adjust the break point from the first point in time to the second point in time within the media item, wherein the second point in time is different from the first point in time.

4 . The computer-implemented method of claim 1 , wherein identifying the break point in the media item comprises:

identifying, by the processor using the machine learning algorithm, a scene change in the media item.

5 . The computer-implemented method of claim 1 , wherein identifying the break point in the media item comprises:

identifying, by the processor using the machine learning algorithm, a break in dialogue in the media item.

6 . The computer-implemented method of claim 1 , wherein adjusting the position of the break point comprises:

after determining to adjust the break point, automatically adjusting, by the processor, the position of the break point.

7 . The computer-implemented method of claim 1 , wherein adjusting the position of the break point comprises:

presenting, via an electronic device of a user, an indication of an adjustment to the break point in the media item;

receiving, via the electronic device, an acceptance to adjust the break point; and

after receiving the acceptance to adjust the break point, adjusting the position of the break point.

8 . A system for managing break points in a media item, the system comprising:

a memory storing data associated with a machine learning algorithm; and

at least one processor interfacing with the memory and configured to:

access the media item comprising visible content,

identify, using the machine learning algorithm, a plurality of candidate break points in the media item, wherein the machine learning algorithm produces a plurality of confidence values respectively associated with the plurality of candidate break points, and wherein each confidence value indicates a likelihood that the corresponding candidate break point is an appropriate location for inclusion of a content item,

select, from the plurality of candidate break points, a break point in the media item, the break point being associated with a first point in time within the media item,

provide the media item to a plurality of devices, wherein each of the plurality of devices presents (i) the media item and (ii) a content item at the first point in time within the media item during a playback of the media item,

after providing the media item to the plurality of devices, determine, based on data indicating how the media item and the content item are viewed by users when presented via the plurality of devices, to adjust the break point from the first point in time to a second point in time within the media item, wherein the second point in time is different from the first point in time,

adjust a position of the break point from the first point in time to the second point in time, and

after adjusting the position of the break point, provide the media item to an additional device, wherein the additional device presents (i) the media item and (ii) the content item at the second point in time within the media item during playback of the media item.

9 . The system of claim 8 , wherein to adjust the position of the break point, the at least one processor is configured to:

select, from the plurality of candidate break points, a second break point that aligns with the second point in time.

10 . The system of claim 8 , wherein to determine to adjust the break point in the media item, the at least one processor is configured to:

determine, based on the data indicating how the media item and the content item are viewed by users when presented via the plurality of devices and the plurality of confidence values respectively associated with the plurality of candidate break points, to adjust the break point from the first point in time to the second point in time within the media item, wherein the second point in time is different from the first point in time.

11 . The system of claim 8 , wherein to identify the break point in the media item, the at least one processor is configured to:

identify, using the machine learning algorithm, a scene change in the media item.

12 . The system of claim 8 , wherein to identify the break point in the media item, the at least one processor is configured to:

identify, using the machine learning algorithm, a break in dialogue in the media item.

13 . The system of claim 8 , wherein to adjust the position of the break point, the at least one processor is configured to:

after determining to adjust the break point, automatically adjust the position of the break point.

14 . The system of claim 8 , wherein to adjust the position of the break point, the at least one processor is configured to:

present, via an electronic device of a user, an indication of an adjustment to the break point in the media item,

receive, via the electronic device, an acceptance to adjust the break point, and

after receiving the acceptance to adjust the break point, adjust the position of the break point.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2024
From: SHI, YUN; YANG, JIANFENG; SARUKKAI, RAMESH; MCCORMICK, ZINDZISWA LARA
To: GOOGLE INC.
Reel/Frame 066925/0199 →
CHANGE OF NAME Recorded Mar 27, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 066925/0398 →
Continuity (5)
Continuation 17833887 · Jun 6, 2022
Continuation 17104453 · Nov 25, 2020
Continuation 15959155 · Apr 20, 2018
Continuation In Part 14333380 · Jul 16, 2014
Related Publication 20240214647A1 · Jun 27, 2024
References Cited (38)
US 7826911B1 · Bennett · 2010 [cited by examiner]
US 9361353B1 · Aristides · 2016 [cited by examiner]
US 10097605B2 · Lewis et al. · 2018 [cited by applicant]
US 20040158865A1 · Kubler et al. · 2004 [cited by applicant]
US 20070168259A1 · Haberman et al. · 2007 [cited by applicant]
US 20070204310A1 · Hua · 2007 [cited by examiner]
US 20070288518A1 · Crigler · 2007 [cited by examiner]
US 20090119179A1 · Kolve et al. · 2009 [cited by applicant]
US 20100205049A1 · Long · 2010 [cited by examiner]
US 20110047567A1 · Zigmond · 2011 [cited by examiner]
US 20110191178A1 · Newberg · 2011 [cited by examiner]
US 20110289531A1 · Moonka · 2011 [cited by examiner]
US 20120110616A1 · Kilar · 2012 [cited by examiner]
US 20120166289A1 · Gadoury · 2012 [cited by examiner]
US 20130028573A1 · Hoofien et al. · 2013 [cited by applicant]
US 20130237318A1 · Colaco · 2013 [cited by examiner]
US 20130263182A1 · Ivy · 2013 [cited by examiner]
US 20130298147A1 · Klein et al. · 2013 [cited by applicant]
US 20130305273A1 · Hadfield · 2013 [cited by examiner]
US 20140115631A1 · Mak et al. · 2014 [cited by applicant]
US 20140123173A1 · Mak · 2014 [cited by examiner]
US 20140259048A1 · Brueck · 2014 [cited by examiner]
US 20140304233A1 · Belaunde · 2014 [cited by examiner]
US 20150278687A1 · Sculley, II · 2015 [cited by examiner]
US 20150318018A1 · Kaiser · 2015 [cited by examiner]
WO WO2008056358A2 · 2008 [cited by applicant]
Audio Processing and Loudness Estimation Algorithms with iOS Simulations, Author: Kalyanasundaram, Girish, Publication info: Arizona State University. ProQuest Dissertations Publishing, 2013. (Year: 2013). [cited by examiner]
Dongle for TV Location Identification and Advertisement Insertion, ip.com Disclosure No. IPCOM000236792D, Publication Date: May 15, 2014. (Year: 2014). [cited by examiner]
Methods, systems, and media for presenting content, ip.com Disclosure No. IPCOM000236856D, Publication Date: May 19, 2014. (Year: 2014). [cited by examiner]
IP.conn Search Strategy (Year: 2021). [cited by applicant]
STIC EIC 3600 Search Report for parent U.S. Appl. No. 15/959,155 (similar claims) dated Jul. 23, 2020 (Year: 2020). [cited by applicant]
STIC EIC 3600 Search Report for U.S. Appl. No. 17/104,453 dated Aug. 27, 2021 (Year: 2021). [cited by applicant]
IP.conn NPL Search Strategy dated 20210819 (Year: 2021). [cited by applicant]
Final Office Action on U.S. Appl. No. 14/333,380 dated Jan. 22, 2018 (16 pages). [cited by applicant]
Final Office Action on U.S. Appl. No. 15/959,155 dated Jan. 10, 2020 (20 pages). [cited by applicant]
Non-Final Office Action on U.S. Appl. No. 14/333,380 dated Jun. 13, 2017 (18 pages). [cited by applicant]
Non-Final Office Action on U.S. Appl. No. 15/959,155 dated Sep. 17, 2019 (19 pages). [cited by applicant]
Notice of Allowance on U.S. Appl. No. 15/959,155 dated Jul. 31, 2020 (12 pages). [cited by applicant]