IP Library Granted Patent US 12,395,711
Granted Patent B2
US 12,395,711 · App. 18/626,232 · Granted Aug 19, 2025

Dynamic code integration within network-delivered media

Inventors: Ken Weiner (Los Angeles, CA); Jagadish Kamath (Karnataka, IN)
Assignee: GumGum, Inc.
H04N21/854H04N21/222H04N21/812H04N21/8146H04N21/8456
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,395,711
App. No.
18/626,232
Granted
Aug 19, 2025
Kind
B2
Abstract

Systems and methods are described for dynamically generating a graphical code that is placed within an advertisement, which may in in turn be placed dynamically over video or image content delivered to a client device. A portion of a stored advertisement unit may be created to have a color-coded section designated to be later replaced with a graphical code. When a user requests to view image or video content on or in which a given advertisement will be shown, a server may generate a tag that contains a URI that includes tracking parameters to identify what advertisement was scanned and/or other data associated with the advertisement, a publisher, or a client device. A graphical code may be generated to represent the given URI, then that graphical code may be inserted into a previously color-coded area of an ad creative before delivery to a client device for presentation.

Claims (55)

1. A computer system comprising:

memory; and

one or more processors in communication with the memory and configured to:

receive, over a network, a first request for an advertisement to be shown on a client device;

in response to receiving the first request for the advertisement to be shown on the client device:

obtain an advertisement package comprising (a) at least one media item and (b) data regarding or comprising a code to be visually integrated within the at least one media item as a graphical code, wherein the at least one media item comprises an image or video;

generate, based at least in part on the data regarding or comprising the code, the graphical code as a two-dimensional graphical code representing a uniform resource identifier, such that capture of the graphical code by a camera configured by software to interpret two-dimensional graphical codes configures a computing device operating the software to direct a browser or application to access the uniform resource identifier;

generate a final advertisement by modifying at least a portion of either (i) the image or (ii) at least one frame of the video to visually include the graphical code in the portion instead of original content of the portion as originally included in the advertisement package; and

store, in an electronic data store, the final advertisement for subsequent delivery to at least one of (a) the client device or (b) a second client device for which the combination of the code and the at least one media item is subsequently selected for presentation.

2. The computer system of claim 1 , wherein the at least one media item is video content comprising at least a plurality of frames, wherein generating the final advertisement comprising modifying the plurality of frames to include the graphical code.

3. The computer system of claim 2 , wherein an in-frame position of the graphical code is different between two or more individual frames of the final advertisement.

4. The computer system of claim 2 , wherein a display size of the graphical code is different between two or more individual frames of the final advertisement.

5. The computer system of claim 1 , wherein the graphical code is a QR code.

6. The computer system of claim 1 , wherein the advertisement package is obtained over a network from an advertisement server, wherein the advertisement server selects the code and corresponding media item of the advertisement package based at least in part on information received by the computer system regarding the client device.

7. The computer system of claim 1 , wherein the one or more processors are further configured to:

retrieve one or more original video segments from a video in which to insert the final advertisement as overlay content; and

generate one or more replacement segments of the video, wherein the one or more replacement segments depict at least portions of video content from the final advertisement overlaid over video content from the one or more original video segments, such that a plurality of individual video frames within the one or more replacement segments each depict both advertisement content and portions of corresponding original frames of the video, wherein the advertisement content includes depiction of the graphical code.

8. The computer system of claim 7 , wherein the one or more processors are further configured to:

generate a revised manifest file that includes references to the replacement segments instead of corresponding original segments of the video; and

send, over the network, the revised manifest file to the client device for presentation of streaming video by the client device in accordance with the revised manifest file, such that the client device presents the graphical code and other content of the final advertisement within portions of each of a plurality of frames of the streaming video.

9. The computer system of claim 7 , wherein generating the one or more replacement segments of the video comprises, for each of a plurality of individual frames within the one or more original video segments, replacing some but not all pixels in the individual frame with pixels of the final advertisement.

10. The computer system of claim 1 , wherein the one or more processors are further configured to send the final advertisement to the client device for presentation on a page presented by a browser operating on the client device, wherein code of the page caused the client device to send the first request to the computer system.

11. The computer system of claim 10 , wherein the uniform resource identifier represented by the graphical code includes identification of a publisher of the page.

12. The computer system of claim 1 , wherein the one or more processors are further configured to:

receive a second advertisement request originating from a second client device;

obtain the advertisement package; and

based on a determination that the electronic data store includes the final advertisement associated with the code and the at least one media item of the advertisement package:

send the final advertisement to the second client device for presentation by the second client device.

13. A computer-implemented method comprising:

receiving, over a network, a first request for an advertisement to be shown on a client device;

in response to receiving the first request for the advertisement to be shown on the client device:

obtaining an advertisement package comprising (a) at least one media item and (b) data regarding or comprising a code to be visually integrated within the at least one media item as a graphical code, wherein the at least one media item comprises an image or video;

generating, based at least in part on the data regarding or comprising the code, the graphical code as a two-dimensional graphical code representing a uniform resource identifier, such that capture of the graphical code by a camera configured by software to interpret two-dimensional graphical codes configures a computing device operating the software to direct a browser or application to access the uniform resource identifier;

generating a final advertisement by modifying at least a portion of either (i) the image or (ii) at least one frame of the video to visually include the graphical code in the portion instead of original content of the portion as originally included in the advertisement package; and

storing, in an electronic data store, the final advertisement for subsequent delivery to at least one of (a) the client device or (b) a second client device for which the combination of the code and the at least one media item is subsequently selected for presentation.

14. The computer-implemented method of claim 13 , wherein the uniform resource identifier represented by the graphical code includes information regarding at least one of (a) the client device or (b) a user of the client device.

15. The computer-implemented method of claim 13 , wherein the uniform resource identifier represented by the graphical code includes a parameter identifying a cohort to which a user of the client device belongs.

16. The computer-implemented method of claim 13 further comprising:

prior to obtaining the advertisement package, requesting that a third-party advertisement service select particular advertisement content to include in the advertisement package based on information regarding the client device received in the first request, wherein the third-party advertisement service generates the data regarding or comprising the code to be visually integrated within the at least one media item.

17. The computer-implemented method of claim 13 further comprising:

receiving a second advertisement request originating from a second client device;

obtaining the advertisement package; and

based on a determination that the electronic data store includes the final advertisement associated with the code and the at least one media item of the advertisement package:

sending, in response to the second advertisement request, the final advertisement to the second client device for presentation by the second client device.

18. The computer-implemented method of claim 13 further comprising:

retrieving one or more original video segments from a video in which to insert the final advertisement; and

generating one or more replacement segments of the video, wherein the one or more replacement segments depict at least portions of video content from the final advertisement within or overlaid over video content from the one or more original video segments, such that a plurality of individual video frames within the one or more replacement segments each depict both advertisement content and portions of corresponding original frames of the video, wherein the advertisement content includes depiction of the graphical code.

19. The computer-implemented method of claim 13 further comprising sending the final advertisement to the client device for presentation on a page presented by a browser operating on the client device, wherein code of the page caused the client device to send the first request to the computer system.

20. A non-transitory computer-readable medium storing computer executable instructions that, when executed by one or more computer systems, configure the one or more computer systems to perform operations comprising:

receiving, over a network, a first request for an advertisement to be shown on a client device;

in response to receiving the first request for the advertisement to be shown on the client device:

obtaining an advertisement package comprising (a) at least one media item and (b) data regarding or comprising a code to be visually integrated within the at least one media item as a graphical code, wherein the at least one media item comprises an image or video;

generating, based at least in part on the data regarding or comprising the code, the graphical code as a two-dimensional graphical code representing a uniform resource identifier, such that capture of the graphical code by a camera configured by software to interpret two-dimensional graphical codes configures a computing device operating the software to direct a browser or application to access the uniform resource identifier;

generating a final advertisement by modifying at least a portion of either (i) the image or (ii) at least one frame of the video to visually include the graphical code in the portion instead of original content of the portion as originally included in the advertisement package; and

storing, in an electronic data store, the final advertisement for subsequent delivery to at least one of (a) the client device or (b) a second client device for which the combination of the code and the at least one media item is subsequently selected for presentation.

Assignments (2)
SECURITY INTEREST Recorded Sep 1, 2026
From: GUMGUM, INC.
To: CITIBANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 075867/0967 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2025
From: WEINER, KEN; KAMATH, JAGADISH
To: GUMGUM, INC.
Reel/Frame 070687/0656 →
Continuity (2)
Continuation 18051688 · Nov 1, 2022
Related Publication 20250016430A1 · Jan 9, 2025
References Cited (19)
US 9292859B1 · Sivertsen · 2016 [cited by examiner]
US 11314998B1 · Sanderson et al. · 2022 [cited by applicant]
US 11979645B1 · Weiner · 2024 [cited by examiner]
US 20130194437A1 · Osman · 2013 [cited by examiner]
US 20130226714A1 · Osewalt · 2013 [cited by applicant]
US 20160078335A1 · Annamalai · 2016 [cited by examiner]
US 20160247423A1 · Hohl · 2016 [cited by examiner]
US 20160277793A1 · Eyer · 2016 [cited by examiner]
US 20180131976A1 · Zabelin · 2018 [cited by examiner]
US 20190075371A1 · Parampath · 2019 [cited by examiner]
US 20190141410A1 · Zverina et al. · 2019 [cited by applicant]
US 20190238954A1 · Dawson · 2019 [cited by examiner]
US 20190259124A1 · Barnett · 2019 [cited by examiner]
US 20190373337A1 · Martell et al. · 2019 [cited by applicant]
US 20200108316A1 · Nay · 2020 [cited by examiner]
US 20210400296A1 · Hoarty et al. · 2021 [cited by applicant]
US 20220156798A1 · Wu et al. · 2022 [cited by applicant]
US 20220329887A1 · McClendon · 2022 [cited by applicant]
Written Opinion in PCT/US2023/078236, mailed Feb. 22, 2024. [cited by applicant]