IP Library › Granted Patent US 12,288,224
Granted Patent B2
US 12,288,224 · App. 17/747,700 · Granted Apr 29, 2025

Adaptively embedding visual advertising content into media content

Inventor: Jason Garcia (Chandler, AZ)
Assignee: Intel Corporation
G06Q30/0251G06Q30/02G06Q50/10G06T3/40G06T7/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,288,224
App. No.
17/747,700
Filed
May 18, 2022
Granted
Apr 29, 2025
Kind
B2
Examiner
DAGNEW, SABA
Art Unit
3621
USPC
709/203
Abstract

Technologies for adaptively embedding visual advertising content into media content include a computing device for receiving visual advertisements, an advertisement map, and media content from a remote content provider. Such technologies may also include determining a location of an advertising enabled area within an image of the media content, selecting a visual advertisement to embed within the image of the media content at the determined location of the advertising enabled area as a function of the advertisement map, and embedding the selected visual advertisement into the image of the media content at the determined location of the advertising enabled area to generate augmented media content for subsequent display to the user. In some embodiments, the advertisement map includes display conditions for each of the visual advertisements.

Claims (49)

1. A media device comprising:

at least one memory;

computer readable instructions; and

at least one processor circuit to be programmed by the computer readable instructions to at least:

detect, based on at least one of object detection or feature detection performed on an image frame, one or more markings that depict in the image frame a location and a size of an advertisement area within the image frame that is replaceable with one of a plurality of possible advertisements;

determine the size and the location of the advertisement area based on the one or more detected markings;

select a first advertisement of the plurality of possible advertisements based on evaluation of an advertisement map, the evaluation of the advertisement map based on the one or more detected markings in the image frame and based on at least one condition, a first entry of the advertisement map to associate the first advertisement with a first marking corresponding to the one or more detected markings in the image frame, a second entry of the advertisement map to associate a second advertisement of the plurality of possible advertisements with a second marking different from the first marking;

adjust a size of the first advertisement to correspond with the determined size of the advertisement area;

generate a modified image frame that includes the first advertisement embedded in the advertisement area of the image frame; and

cause the media device to display the modified image frame.

2. The media device of claim 1 , wherein the one or more detected markings include one or more graphical symbols.

3. The media device of claim 1 , wherein the one or more detected markings define an orientation of the advertisement area in the image frame, and one or more of the at least one processor circuit is to adjust an orientation of the first advertisement based on the one or more detected markings.

4. The media device of claim 1 , wherein the at least one condition corresponds to a first time period, and the first entry of the advertisement map is to associate the first advertisement with the first time period.

5. The media device of claim 1 , wherein the at least one condition includes a first condition, the first entry of the advertisement map is to also associate the first advertisement with the first condition, and one or more of the at least one processor circuit is to:

access user profile data from the at least one memory; and

select the first advertisement after a determination that the first condition is satisfied by the user profile data.

6. The media device of claim 1 , wherein one or more of the at least one processor circuit is to:

obtain the advertisement map from a server via a network; and

store the advertisement map in the at least one memory prior to receipt of the image frame of media by the media device.

7. At least one machine-readable memory or storage device comprising machine readable instructions to cause at least one processor circuit to at least:

detect, based on at least one of object detection or feature detection performed on an image frame, one or more markings that depict in the image frame a location and a size of a replaceable area within the image frame;

determine the size and the location of the replaceable area based on the one or more detected markings;

select a first image of a plurality of possible images based on evaluation of a map, the evaluation of the map based on the one or more detected markings in the image frame and based on at least one condition, a first entry of the map to associate the first image with a first marking corresponding to the one or more detected markings in the image frame, a second entry of the map to associate a second image of the plurality of possible images with a second marking different from the first marking;

adjust a size of the first image to correspond with the determined size of the replaceable area;

generate a modified image frame that includes the first image embedded in the replaceable area of the image frame; and

cause a media device to display the modified image frame.

8. The at least one machine-readable memory or storage device of claim 7 , wherein the one or more detected markings define an orientation of the replaceable area in the image frame, and the instructions are to cause one or more of the at least one processor circuit to adjust an orientation of the first image based on the one or more detected markings.

9. The at least one machine-readable memory or storage device of claim 7 , wherein the at least one condition corresponds to a first time period, and the first entry of the map is to associate the first image with the first time period.

10. The at least one machine-readable memory or storage device of claim 7 , wherein the at least one condition includes a first condition, the first entry of the map is to also associate the first image with the first condition, and the instructions are to cause one or more of the at least one processor circuit to:

access user profile data from storage; and

select the first image after a determination that the first condition is satisfied by the user profile data.

11. The at least one machine-readable memory or storage device of claim 7 , wherein the instructions are to cause one or more of the at least one processor circuit to:

obtain the map from a server via a network; and

store the map prior to receipt of the image frame of media.

12. A method comprising:

detecting, at a media device, and based on at least one of object detection or feature detection performed on an image frame, one or more markings that depict in the image frame a location and a size of a replaceable area within the image frame;

determining, at the media device, the size and the location of the replaceable area based on the one or more detected markings;

selecting, at the media device, a first graphic object of a plurality of possible graphic objects based on evaluation of a map, the evaluation of the map based on the one or more detected markings in the image frame and based on at least one condition, a first entry of the map to associate the first graphic object with a first marking corresponding to the one or more detected markings in the image frame, a second entry of the map to associate a second graphic object of the plurality of possible graphic objects with a second marking different from the first marking;

adjusting, at the media device, a size of the first graphic object to correspond with the determined size of the replaceable area;

generating, at the media device, a modified image frame that includes the first graphic object embedded in the replaceable area of the image frame; and

displaying the modified image frame with the media device.

13. The method of claim 12 , wherein the one or more detected markings define an orientation of the replaceable area in the image frame, and further including adjusting an orientation of the first graphic object based on the one or more detected markings.

14. The method of claim 12 , wherein the at least one condition corresponds to a first time period, and the first entry of the map is to associate the first graphic object with the first time period.

15. The method of claim 12 , wherein the at least one condition includes a first condition, the first entry of the map is to also associate the first graphic object with the first condition, and further including:

accessing user profile data from storage; and

selecting the first graphic object after a determination that the first condition is satisfied by the user profile data.

16. The method of claim 12 , further including:

obtaining the map from a server via a network; and

storing the map prior to receipt of the image frame of media.

Continuity (4)
Continuation 17504185 · Oct 18, 2021
Continuation 16685545 · Nov 15, 2019
Division 14129440
Related Publication 20220351242A1 · Nov 3, 2022
References Cited (96)
US 7698172B2 · Choe et al. · 2010 [cited by applicant]
US 7895076B2 · Kutaragi et al. · 2011 [cited by applicant]
US 7920849B2 · Pop · 2011 [cited by applicant]
US 8666806B2 · Rojas et al. · 2014 [cited by applicant]
US 8776111B1 · Eldering et al. · 2014 [cited by applicant]
US 9105032B2 · Altberg et al. · 2015 [cited by applicant]
US 9204181B2 · Ress et al. · 2015 [cited by applicant]
US 9232252B2 · Eldering · 2016 [cited by applicant]
US 9544631B2 · Eldering · 2017 [cited by applicant]
US 9872069B1 · Funk et al. · 2018 [cited by applicant]
US 10546318B2 · Garcia · 2020 [cited by applicant]
US 11151606B2 · Garcia · 2021 [cited by applicant]
US 20020112249A1 · Hendricks et al. · 2002 [cited by applicant]
US 20020126990A1 · Rasmussen et al. · 2002 [cited by applicant]
US 20030093784A1 · Dimitrova et al. · 2003 [cited by applicant]
US 20040172661A1 · Yagawa · 2004 [cited by examiner]
US 20060026628A1 · Wan et al. · 2006 [cited by applicant]
US 20060206380A1 · Joo · 2006 [cited by applicant]
US 20060212897A1 · Li et al. · 2006 [cited by applicant]
US 20060256133A1 · Rosenberg · 2006 [cited by applicant]
US 20060287915A1 · Boulet et al. · 2006 [cited by applicant]
US 20080033801A1 · McKenna et al. · 2008 [cited by applicant]
US 20080033812A1 · McKenna et al. · 2008 [cited by applicant]
US 20080046920A1 · Bill · 2008 [cited by applicant]
US 20080104634A1 · Gajdos · 2008 [cited by applicant]
US 20080319844A1 · Hua et al. · 2008 [cited by applicant]
US 20090094637A1 · Lemmons · 2009 [cited by examiner]
US 20090123069A1 · Deng · 2009 [cited by examiner]
US 20090125226A1 · Laumeyer et al. · 2009 [cited by applicant]
US 20090300677A1 · Zalewski · 2009 [cited by applicant]
US 20090320063A1 · Barrett · 2009 [cited by examiner]
US 20100070996A1 · Liao · 2010 [cited by examiner]
US 20100228626A1 · Im · 2010 [cited by applicant]
US 20110082915A1 · Carr et al. · 2011 [cited by applicant]
US 20110188836A1 · Popkiewicz et al. · 2011 [cited by applicant]
US 20120020559A1 · Deng · 2012 [cited by examiner]
US 20120158502A1 · Chung et al. · 2012 [cited by applicant]
US 20120284610A1 · Masuko · 2012 [cited by applicant]
US 20130006866A1 · Pendakur et al. · 2013 [cited by applicant]
US 20130091519A1 · Mclauchlan et al. · 2013 [cited by applicant]
US 20130152148A1 · Negroponte · 2013 [cited by applicant]
US 20130243270A1 · Kamhi et al. · 2013 [cited by applicant]
US 20130278635A1 · Maggiore · 2013 [cited by applicant]
US 20140095341A1 · Woods et al. · 2014 [cited by applicant]
US 20140165095A1 · Miller · 2014 [cited by examiner]
US 20140195328A1 · Ferens et al. · 2014 [cited by applicant]
US 20150046270A1 · Kocabiyik · 2015 [cited by applicant]
US 20160212455A1 · Manna · 2016 [cited by applicant]
US 20220180396A1 · Garcia · 2022 [cited by applicant]
CN 101765856 · 2010 [cited by applicant]
JP H06284274A · 1994 [cited by applicant]
JP H11312072 · 1999 [cited by applicant]
JP 2004185456 · 2004 [cited by applicant]
JP 2007528680 · 2007 [cited by applicant]
JP 2007528680A · 2007 [cited by applicant]
JP 2009529300A · 2009 [cited by applicant]
JP 2010508688A · 2010 [cited by applicant]
KR 1020060099367 · 2006 [cited by applicant]
WO 2011065564A1 · 2011 [cited by applicant]
WO 2012027595A2 · 2012 [cited by applicant]
Summons to attend oral proceeding in European patent application No. 13900867.6, dated Apr. 9, 2020 (14 pages). [cited by applicant]
National Intellectual Property Administration of China, “First Office Action,” mailed in connection with Chinese Patent Application No. 201380076967.1, dated Feb. 27, 2019, 12 pages. [cited by applicant]
National Intellectual Property Administration of China, “Second Office Action,” mailed in connection with Chinese Patent Application No. 201380076967.1, dated Aug. 12, 2019, 11 pages. [cited by applicant]
Japanese Patent Office, “Notice of Reasons for Rejection,” mailed in connection with Japanese Patent Application No. 2016-519485, dated Feb. 15, 2017, 7 pages. [cited by applicant]
Korean Patent Office, “Office Action,” mailed in connection with Korean Patent Application No. 2015-7033702, dated May 31, 2017, 11 pages. [cited by applicant]
Korean Patent Office, “Notice of Preliminary Rejection,” mailed in connection with Korean Patent Application No. 2015-7033702, dated Nov. 11, 2016, 12 pages. [cited by applicant]
European Patent Office, “European Search Report,” mailed in connection with European Patent Application No. 13900867.6, dated Dec. 14, 2016, 7 pages. [cited by applicant]
International Searching Authority, “International Search Report and Written Opinion,” mailed in connection with International Patent Application No. PCT/US2013/077581, dated Apr. 21, 2014, 10 pages. [cited by applicant]
Vola et al., “Rapid Object Detection using a Booted Cascade of Simple Features,” Conference on Computer Vision and Pattern Recognition, 2001, 9 pages. [cited by applicant]
“Product Placement,” Wikipedia, the Free Encyclopedia, retrieved from <http://en.wikipedia.org/w/index.php? title=Product_placement&oldid=530689404>, edited Jan. 1, 2013, 27 pages. [cited by applicant]
“Geometric Modeling,” Wikipedia, the Free Encyclopedia, retrieved from <http://en.wikipedia.org/w/index.php? title=Geometric modeling&oldid=528981570>, edited Dec. 20, 2012, 2 pages. [cited by applicant]
“Chroma Key,” Wikipedia, the Free Encyclopedia, retrieved from <http://en.wikipedia.org/w/index.php? title=Chroma_key&oldid=526780658>, edited Dec. 6, 2012, 7 pages. [cited by applicant]
“Machine Vision,” Wikipedia, the Free Encyclopedia, retrieved from <http://en.wikipedia.org/w/index.php? title=Machine_vision&oldid=526331389>, edited Dec. 4, 2012, 4 pages. [cited by applicant]
“Computer Vision,” Wikipedia, the Free Encyclopedia, retrieved from <http://en.wikipedia.org/w/index.php? title=Computer_vision&oldid=517888680>, edited Oct. 15, 2012, 8 pages. [cited by applicant]
“Feature Detection (Computer Vision),” Wikipedia, the Free Encyclopedia, retrieved from <http://en.wikipedia.org/w/index.php?title=feature_detection_(computer-_vision)oldid&=517191243>, edited Oct. 11, 2012, 4 pages. [cited by applicant]
“Targeted Advertising,” Wikipedia, the Free Encyclopedia, retrieved from <http://en.wikipedia.org/w/index.php? title=Targeted_advertising&oldid=499079396>, edited Jun. 24, 2012, 3 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance,” mailed in connection with U.S. Appl. No. 14/129,440, dated Jul. 12, 2019, 8 pages. [cited by applicant]
United States Patent and Trademark Office, “Final Office Action,” mailed in connection with U.S. Appl. No. 14/129,440, dated Oct. 11, 2018, 26 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-final Office Action,” mailed in connection with U.S. Appl. No. 14/129,440, dated Apr. 13, 2018, 23 pages. [cited by applicant]
United States Patent and Trademark Office, “Advisory Action,” mailed in connection with U.S. Appl. No. 14/129,440, dated Sep. 15, 2017, 3 pages. [cited by applicant]
United States Patent and Trademark Office, “Final Office Action,” mailed in connection with U.S. Appl. No. 14/129,440, dated Jun. 7, 2017, 34 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-final Office Action,” mailed in connection with U.S. Appl. No. 14/129,440, dated Dec. 21, 2016, 15 pages. [cited by applicant]
United States Patent and Trademark Office, “Requirement for Restriction/Election,” mailed in connection with U.S. Appl. No. 14/129,440, dated Sep. 15, 2016, 5 pages. [cited by applicant]
European Patent Office, “Office Action,” mailed in connection with European Patent Application No. 13900867.6, dated Aug. 13, 2019, 7 pages. [cited by applicant]
International Searching Authority, “Search Report and Written Opinion,” mailed in connection with International Patent Application No. PCT/US2013/048235, dated Apr. 1, 2014, 11 pages. [cited by applicant]
European Patent Office, “Decision to Refuse a European Patent Application,” mailed in connection with European Patent Application No. 13900867.6, dated Dec. 10, 2020, 22 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance,” mailed in connection with U.S. Appl. No. 16/685,545, dated Jun. 11, 2021, 11 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance,” mailed in connection with U.S. Appl. No. 16/685,545, dated Feb. 22, 2021, 12 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” mailed in connection with U.S. Appl. No. 16/685,545, dated Oct. 29, 2020, 15 pages. [cited by applicant]
Patent Cooperation Treaty, “International Preliminary Report on Patentability,” issued in connection with International Patent Application No. PCT/US2013/048235, mailed on Jan. 7, 2016, 8 pages. [cited by applicant]
Korean Intellectual Property Office, “Request for the Submission of an Opinion,” issued in connection with Korean Patent Application No. 10-2015-7033702, mailed on Nov. 16, 2016, 13 pages. [English Translation Included]. [cited by applicant]
European Patent Office, “European Search Opinion,” in connection with European Patent Application No. 13900867.6, issued on Dec. 7, 2016, 3 pages. [cited by applicant]
Japanese Patent Office, “Decision to Grant a Patent,” issued in connection with Japanese Patent Application No. 2016-519485, dated Oct. 24, 2017, 5 pages. (English translation included). [cited by applicant]
Korean Intellectual Property Office, “Written Decision on Registration,” issued in connection with Korean Patent Application No. 10-2015-7033702, mailed on Dec. 29, 2017, 3 pages. [English Translation Included]. [cited by applicant]
Chinese Patent Office, “Search Report,” issued in connection with Chinese Patent Appl. No. 201380076967.1, dated Feb. 19, 2019, 1 page. [English translation included]. [cited by applicant]
Chinese Patent Office, “Notification of Grant,” issued in connection with Chinese Patent Appl. No. 201380076967.1, dated Jan. 6, 2020, 3 pages. [English translation included]. [cited by applicant]