IP Library Granted Patent US 12,450,627
Granted Patent B2
US 12,450,627 · App. 19/067,754 · Granted Oct 21, 2025

Multimedia communication system and method

Inventors: Neil Greer (La Jolla, CA); Bennett Blank (La Jolla, CA); Bryan Depew (La Jolla, CA)
Assignee: Impact Engine, Inc.
G06Q30/0256G06F3/0482G06F16/4393G06F16/50G06F40/103G06F40/106G06F40/186G06F40/197G06Q30/0276G06Q30/0277H04L41/22H04L65/611
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,450,627
App. No.
19/067,754
Granted
Oct 21, 2025
Kind
B2
Abstract

Systems and methods are disclosed for creating, editing, sharing and distributing high-quality, media-rich web-based communications. The communications are created in a layered fashion that integrates user-selected text, colors, background patterns, images, sound, music, video, or other media. The systems and methods are used to generate, edit, broadcast, and track electronic presentations, brochures, advertisements (such as banner advertisements on highly trafficked media websites), announcements, and interactive web pages, without the need for the user to understand complex programming languages.

Claims (56)

1. A non-transitory computer-readable medium storing instructions that, when executed by a processor, perform a method for dynamically generating a multimedia communication, the method comprising:

storing a project object in a network-accessible media repository, the project object comprising at least one slide, each slide comprising a plurality of design layers that are predefined to include a background layer, a main content layer, and a foreground layer, each design layer being configured to store one or more types of media assets that include one or more of images, text, audio, and video, wherein each media asset is associated with metadata defining asset properties including size or format;

providing a graphical user interface for assigning, based on user input, one or more of the media assets to content containers within the design layers;

coordinating, via a slide layer interface comprising a collection of pointers, a real-time communication between the design layers to integrate the assigned media assets according to predefined rules stored in the project object;

generating, based on the project object and the integrated media assets, a renderable multimedia data structure serialized for compatibility with a plurality of distribution formats;

converting the renderable multimedia data structure into the plurality of distribution formats, each of the distribution formats being dynamically adjusted based on recipient electronic device characteristics that include screen size or bandwidth constraints to optimize rendering of the multimedia communication; and

distributing the converted multimedia communication to a plurality of recipients via a communication network, wherein changes to the multimedia communication are propagated in real-time to derivative multimedia communications using metadata-driven rules.

2. The non-transitory computer-readable medium in accordance with claim 1 , wherein propagating changes to the multimedia communication using the metadata driven rules further comprises disseminating the changes to all derivative multimedia communications in real-time.

3. The non-transitory computer-readable medium in accordance with claim 2 , wherein the propagating further includes applying the changes to the multimedia communication and all derivative multimedia communications at the same time.

4. The non-transitory computer-readable medium in accordance with claim 2 , wherein the rule based metadata analysis determines which updates to propagate to provide real-time consistency across all instances and distribution formats of the multimedia communication.

5. The non-transitory computer-readable medium in accordance with claim 1 , wherein the plurality of distribution formats includes one or more of HTML, Flash, PDF, or a streaming media format.

6. The non-transitory computer-readable medium in accordance with claim 1 , wherein the plurality of distribution formats correspond to one or more recipient devices, and wherein the method further comprises adjusting the media assets to accommodate device-specific constraints including the screen sizes or bandwidth limits of recipient devices.

7. The non-transitory computer-readable medium in accordance with claim 1 , wherein the method further comprises dynamically adjusting a layout of the media assets using rules to reorient, resize, and reposition the media assets in real time.

8. A non-transitory computer-readable medium storing instructions that, when executed by a processor, perform a method for dynamically generating a multimedia communication, the method comprising:

storing a project object comprising at least one slide, the slide including a plurality of predefined design layers including a background layer, a main content layer, and a foreground layer, each design layer containing one or more content containers configured to store one or more media assets selected from images, text, audio, and video, wherein each media asset is associated with metadata defining properties including size and format;

providing a graphical user interface for a user to assign, via input, one or more of the media assets to the content containers within the design layers;

coordinating, via a slide layer interface comprising a collection of pointers implemented in a programming language, real-time exchange of information and commands between the predefined design layers to integrate the assigned media assets according to predefined rules stored in the project object;

generating, using a project viewer module, a renderable multimedia data structure by serializing the integrated media assets for compatibility with a plurality of distribution formats;

converting the renderable multimedia data structure into a plurality of distribution formats, each format dynamically adjusted based on recipient device characteristics including screen size or bandwidth constraints to optimize rendering of the multimedia communication on each recipient device;

broadcasting the converted multimedia communication to a plurality of recipients via a communication network, wherein changes to the multimedia communication are propagated in real-time to derivative multimedia communications using metadata-driven rules.

9. The non-transitory computer-readable medium in accordance with claim 8 , wherein the method further comprises managing, via a slide layer interface, the exchange of information and/or commands between the design layers of the slide, wherein the slide layer interface provides a conduit for coordinating and integrating the assigned media assets across the design layers according to predefined rules stored in the project object.

10. The non-transitory computer-readable medium in accordance with claim 8 , wherein the method further comprises propagating changes to the multimedia communication using metadata defining asset properties to disseminate the changes to all derivative multimedia communications in real-time.

11. The non-transitory computer-readable medium in accordance with claim 10 , wherein the changes to the multimedia communication are propagated in real-time to all derivative multimedia communications simultaneously.

12. The non-transitory computer-readable medium in accordance with claim 10 , wherein the metadata defining asset properties and rule-based logic determines which updates to propagate, to provide real-time consistency across all instances and distribution formats of the multimedia communication.

13. The non-transitory computer-readable medium in accordance with claim 8 , wherein converting the renderable multimedia data structure further includes:

assembling media assets into corresponding design layers;

structuring the design layers into a main multimedia communication;

and mapping the design layers of the main multimedia communication to one or more derivative multimedia communications in the plurality of distribution formats.

14. The non-transitory computer-readable medium in accordance with claim 8 , wherein the plurality of distribution formats includes one or more of HTML, Flash, PDF, or a streaming media format.

15. The non-transitory computer-readable medium in accordance with claim 8 , wherein the plurality of distribution formats correspond to one or more recipient devices, and wherein the method further comprises adjusting the media assets to accommodate device-specific constraints including screen sizes or bandwidth limits of recipient devices.

16. The non-transitory computer-readable medium in accordance with claim 8 , wherein the method further comprises dynamically adjusting a layout of the media assets using user-defined rules to update, reorient, resize, or reposition the media assets in real time.

17. A non-transitory computer-readable medium storing instructions that, when executed by a processor, perform a method for dynamically generating, editing, broadcasting and tracking a multimedia communication, the method comprising:

storing communication project templates and media assets of a plurality of content types in a network-accessible media repository, each communication project template comprising a plurality of predefined design layers including a background layer, a main content layer, and a foreground layer, each design layer containing one or more content containers configured to store media assets selected from images, text, audio, or video, wherein each media asset is associated with metadata defining properties including size and format;

providing a graphical user interface on a client computer via a network, the graphical user interface comprising controls for selecting a-communication project template and assigning one or more of the media assets to the content containers within the design layers of the selected communication project template;

rendering, via, the multimedia communication in the graphical user interface, the multimedia communication comprising a collection of one or more slides, each slide comprising the predefined design layers and content containers, wherein the project viewer module serializes the integrated media assets into a renderable multimedia data structure compatible with a plurality of distribution formats;

converting the renderable multimedia data structure into the plurality of distribution formats, each format dynamically adjusted based on recipient device characteristics including screen size or bandwidth constraints: and

broadcasting the converted multimedia communication to a plurality of recipients via a communication network, wherein recipient interactions are tracked, and changes to the multimedia communication are propagated in real-time to derivative multimedia communications using metadata-driven rules.

18. The non-transitory computer-readable medium in accordance with claim 17 , further comprising displaying the rendered multimedia communication using either auto-play on or auto-play off.

19. The non-transitory computer-readable medium in accordance with claim 17 , wherein the converting further comprises:

assembling media assets into corresponding design layers;

structuring the design layers into a main multimedia communication; and

mapping the design layers of the main multimedia communication to one or more derivative multimedia communications in the plurality of distribution formats.

20. The non-transitory computer-readable medium in accordance with claim 17 , wherein the plurality of distribution formats includes one or more of HTML, Flash, PDF, or a streaming media format.

21. The non-transitory computer-readable medium in accordance with claim 19 , further comprising propagating changes to the multimedia communication using metadata-driven rules to disseminate the changes to all derivative multimedia communications in real-time.

22. The non-transitory computer-readable medium in accordance with claim 21 , wherein the propagating further includes applying the changes to the multimedia communication and all derivative multimedia communications at the same time.

23. A non-transitory computer-readable medium storing instructions that, when executed by a processor, perform a method for dynamically generating a multimedia communication, the method comprising:

storing a project object in a network-accessible media repository, the project object including a template defining a structure for the multimedia communication, the template comprising a plurality of predefined design layers including a background layer, a main content layer, and a foreground layer, each design layer containing one or more predefined media elements configured to store media assets selected from images, text, audio, and video, wherein each media asset associated with metadata defining properties including size or format;

assigning, based on user input received through a graphical user interface, one or more of the media assets to the predefined media elements of the template, wherein the assignment is guided by a structured sequence of user prompts displayed in the graphical user interface;

coordinating, via a slide layer interface comprising a collection of pointers implemented in a programming language, real-time communication between the predefined design layers to integrate the assigned media assets according to predefined rules stored in the template;

interpreting, using a project viewer module, the template with the assigned media assets to generate a renderable multimedia data structure, wherein the project viewer module serializes the assigned media assets into a format compatible with a plurality of distribution formats;

converting, using a project builder, the renderable multimedia data structure into the plurality of distribution formats compatible with a plurality of recipient devices, each distribution format being dynamically adjusted based on recipient device characteristics including screen size or bandwidth constraints to optimize rendering of the multimedia communication; and

distributing the converted multimedia communication to a plurality of recipients via a communication network, wherein the distribution is tracked to provide feedback on recipient interactions, and changes to the multimedia communication are propagated in real-time to derivative multimedia communications using metadata-driven rules.

24. The non-transitory computer-readable medium in accordance with claim 23 , wherein the project builder facilitates integration of the one or more media assets into at least one of the communication project templates to generate the multimedia communication.

25. The non-transitory computer-readable medium in accordance with claim 23 , wherein the project builder coordinates formatting of the multimedia communication according to one or more of a plurality of electronic distribution formats.

26. The non-transitory computer-readable medium in accordance with claim 23 , wherein the project builder further comprises a plurality of media asset palettes, each media asset palette comprising a content type, and each media asset palette is displayed in the graphical user interface according to user preferences.

27. The non-transitory computer-readable medium in accordance with claim 23 , wherein the media assets are classified according to content types, and wherein the content types include images, audio, video and text.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2025
From: GREER, NEIL; BLANK, BENNETT; DEPEW, BRYAN
To: IMPACT ENGINE, INC.
Reel/Frame 070372/0311 →
Continuity (13)
Continuation 18642586 · Apr 22, 2024
Continuation 18382947 · Oct 23, 2023
Continuation 18112260 · Feb 21, 2023
Continuation 16792087 · Feb 14, 2020
Continuation 15937568 · Mar 27, 2018
Continuation 15795136 · Oct 26, 2017
Continuation 15174945 · Jun 6, 2016
Continuation 14590881 · Jan 6, 2015
Continuation 13741332 · Jan 14, 2013
Continuation 13004862 · Jan 11, 2011
Continuation 11404509 · Apr 13, 2006
Provisional Application 60671170 · Apr 13, 2005
Related Publication 20250217851A1 · Jul 3, 2025
References Cited (99)
US 6266683B1 · Yehuda et al. · 2001 [cited by applicant]
US 6601057B1 · Underwood et al. · 2003 [cited by applicant]
US 6694353B2 · Sommerer · 2004 [cited by applicant]
US 6826727B1 · Mohr et al. · 2004 [cited by applicant]
US 6910049B2 · Fenton et al. · 2005 [cited by applicant]
US 6976028B2 · Fenton et al. · 2005 [cited by applicant]
US 7111254B1 · Rosen et al. · 2006 [cited by applicant]
US 7219303B2 · Fish · 2007 [cited by applicant]
US 7315983B2 · Evans et al. · 2008 [cited by applicant]
US 7398473B2 · Stoner et al. · 2008 [cited by applicant]
US 7519912B2 · Moody et al. · 2009 [cited by applicant]
US 7577905B2 · Collins et al. · 2009 [cited by applicant]
US 7707226B1 · Tonse · 2010 [cited by applicant]
US 7870497B2 · Greer et al. · 2011 [cited by applicant]
US 8356253B2 · Greer et al. · 2013 [cited by applicant]
US 8447651B1 · Scholl · 2013 [cited by examiner]
US 8930832B2 · Greer et al. · 2015 [cited by applicant]
US 9361632B2 · Greer et al. · 2016 [cited by applicant]
US 9805393B2 · Greer et al. · 2017 [cited by applicant]
US 10068253B2 · Greer et al. · 2018 [cited by applicant]
US 10565618B2 · Greer et al. · 2020 [cited by applicant]
US 10572898B2 · Greer et al. · 2020 [cited by applicant]
US 11488206B2 · Greer et al. · 2022 [cited by applicant]
US 11978088B2 · Greer et al. · 2024 [cited by applicant]
US 20010010059A1 · Burman et al. · 2001 [cited by applicant]
US 20010049635A1 · Chung · 2001 [cited by applicant]
US 20020036654A1 · Evans · 2002 [cited by examiner]
US 20020046094A1 · Takekuma · 2002 [cited by applicant]
US 20020087352A1 · Armstrong et al. · 2002 [cited by applicant]
US 20020087398A1 · Chun-Yen · 2002 [cited by examiner]
US 20020112180A1 · Land et al. · 2002 [cited by applicant]
US 20020194195A1 · Fenton et al. · 2002 [cited by applicant]
US 20020194215A1 · Cantrell et al. · 2002 [cited by applicant]
US 20030001846A1 · Davis et al. · 2003 [cited by applicant]
US 20030018969A1 · Humpleman et al. · 2003 [cited by applicant]
US 20030048294A1 · Arnold · 2003 [cited by applicant]
US 20030183905A1 · Karakawa · 2003 [cited by applicant]
US 20040049574A1 · Watson et al. · 2004 [cited by applicant]
US 20040064836A1 · Ludvig et al. · 2004 [cited by applicant]
US 20040093377A1 · Lumera et al. · 2004 [cited by applicant]
US 20040122808A1 · Martin et al. · 2004 [cited by applicant]
US 20040123238A1 · Hefetz et al. · 2004 [cited by applicant]
US 20040187079A1 · Yamada et al. · 2004 [cited by applicant]
US 20040268224A1 · Balkus et al. · 2004 [cited by applicant]
US 20050038700A1 · Doemling · 2005 [cited by examiner]
US 20050046918A1 · Yasuda et al. · 2005 [cited by applicant]
US 20050079477A1 · Diesel et al. · 2005 [cited by applicant]
US 20050094206A1 · Tonisson · 2005 [cited by applicant]
US 20050102260A1 · Spring et al. · 2005 [cited by applicant]
US 20050114784A1 · Spring et al. · 2005 [cited by applicant]
US 20050143032A1 · Matsushita et al. · 2005 [cited by applicant]
US 20050240596A1 · Worthen · 2005 [cited by examiner]
US 20050245241A1 · Durand et al. · 2005 [cited by applicant]
US 20050251742A1 · Mogilevsky et al. · 2005 [cited by applicant]
US 20050273458A1 · Adams · 2005 [cited by examiner]
US 20060015904A1 · Marcus · 2006 [cited by applicant]
US 20060026655A1 · Perez · 2006 [cited by applicant]
US 20060033957A1 · Kaneko et al. · 2006 [cited by applicant]
US 20060074727A1 · Briere · 2006 [cited by applicant]
US 20060074751A1 · Kline · 2006 [cited by examiner]
US 20060085360A1 · Grim, III et al. · 2006 [cited by applicant]
US 20060085431A1 · Burns et al. · 2006 [cited by applicant]
US 20060095320A1 · Jones · 2006 [cited by applicant]
US 20060111970A1 · Hill · 2006 [cited by examiner]
US 20060129417A1 · Williams et al. · 2006 [cited by applicant]
US 20060150088A1 · Kraft et al. · 2006 [cited by applicant]
US 20060253542A1 · McCausland et al. · 2006 [cited by applicant]
US 20070022442A1 · Gil et al. · 2007 [cited by applicant]
US 20080109472A1 · Underwood · 2008 [cited by examiner]
EP 1367832A2 · 2003 [cited by applicant]
EP 1376406A2 · 2004 [cited by applicant]
EP 1431977A2 · 2004 [cited by applicant]
JP 2002330415A · 2002 [cited by applicant]
JP 2003223454A · 2003 [cited by applicant]
JP 2004533076A · 2004 [cited by applicant]
JP 2004535006A · 2004 [cited by applicant]
KR 1020040040406 · 2004 [cited by applicant]
KR 20050061964A · 2005 [cited by applicant]
WO 9428480A1 · 1994 [cited by applicant]
WO 200127715A2 · 1999 [cited by applicant]
WO 0101686A1 · 2001 [cited by applicant]
WO 02103568A1 · 2002 [cited by applicant]
WO 2004025508A2 · 2004 [cited by applicant]
WO 2004063830A2 · 2004 [cited by applicant]
WO 2004097688A1 · 2004 [cited by applicant]
Amamai; “EdgeSuite 5.0: ESI Developer's Guide”; Aug. 29, 2004; pp. 7-11, 99, 104-105; 112 pgs. Total; (2004). [cited by applicant]
Anonymous: “Press Release: Create Flashy Web Images with the New Macromedia”, Jan. 22, 2003, Retrieved from the Internet. <URL:www.scalado.com>; [retrieved on Oct. 13, 2003]; pp. 1-2 (2003). [cited by applicant]
“Order Granting Motion for Summary Judgment”, Case No. 19-CV-1301-CAB-DEB, U.S. District Court, South District of California, Aug. 31, 2022, pp. 1-8 (2022). [cited by applicant]
United States Court of Appeals for the Federal Circuit; No. 2022-2291; Appeal from the United States District Court for the Southern District of California; Reply Brief; [cited by applicant]
United States Court of Appeals for the Federal Circuit; No. 2022-2291; Appeal from the United States District Court for the Southern District of California in No. 3:19-cv-1301-CAB-DEB; Response Brief of Appellee Google … [cited by applicant]
United States Court of Appeals for the Federal Circuit; No. 2022-2291; Appeal from the United States District Court for the Southern District of California; “Impact Engine's Petition for Rehearing by the Panel and En Ba… [cited by applicant]
United States Court of Appeals for the Federal Circuit; No. 2022-2291; “Appeal from the United States District Court for the Southern District of California in No. 3:19-cv-01301-CABDEB, Judge Cathy Ann Bencivengo”; [cited by applicant]
United States Court of Appeals for the Federal Circuit; No. 2022-2291; Appeal from the United States District Court for the Southern District of California; “On Petition for Panel Rehearing and Rehearing En Banc”; [cited by applicant]
Gaines; Knowledge Sciences Institute; University of Calgary; Non-Patent Literature Document; “Supporting Collaboration through Multimedia Digital Documents Archives”; pp. 1-54 (1994). [cited by applicant]
Fortin et al.; Journal of Business Research; vol. 58; Issue 3, Mar. 2005; pp. 387-396: “Interactivity and vividness effects on social presence and involvement wit a web-based advertisement”; pp. 1-6 (2005). [cited by applicant]
Celentano et al.; International Journal of Software Engineer and Knowledge Engineering; Non-Patent Literature Reference; vol. 13, No. 4 (2003) 419-445; pp. 1-26 (2003). [cited by applicant]
Rebelsky; “Interactive Multimedia Conference Proceedings”; Chi '95 Mosaic of Creativity; Dartmouth College Department of Computer Science; pp. 1-2; (1995). [cited by applicant]
Rebelsky; “Building Multimedia Proceedings: The Roles of Video in Interactive Electronic Conference Proceedings”; Dartmouth College, United States; Jan. 1, 1994 [only abstract readily available Online—please contact the… [cited by applicant]
Spicklemire et al. Zope: Web Application Development and Content Management'; ISBN 978-0-7357-1110-5; Jan. 1, 2002 [only abstract readily available Online—please contact the undersigned if physical copies are required]. [cited by applicant]
Cited By (1)
US 12,646,092