IP Library Granted Patent US 12,469,063
Granted Patent B2
US 12,469,063 · App. 18/050,103 · Granted Nov 11, 2025

Generation of product videos using machine learning

Inventors: Jeremy R. Fox (Georgetown, TX); Martin G. Keen (Cary, NC); Tushar Agrawal (West Fargo, ND); Sarbajit K. Rakshit (Kolkata, IN)
Assignee: International Business Machines Corporation
G06Q30/0623G06N20/00G06Q30/0276G06Q30/0643G06T11/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,469,063
App. No.
18/050,103
Granted
Nov 11, 2025
Kind
B2
Abstract

A computer-implemented method, a computer system and a computer program product automatically generate product videos based on requested feature sets in stored data. the method includes acquiring a plurality of product features from a server, where each product feature in the plurality of product features is associated with data selected from a group consisting of: text data, audio data, and image data. The method also includes receiving a request for a product video, where a product in the product video comprises a set of product features in the plurality of product features. The method further includes identifying the data associated with each product feature in the set of product features for the request. Lastly, the method includes generating the product video based on identified data for the product.

Claims (52)

1 . A computer-implemented method for automated generation of adaptive instructional product videos to indicate how a product is used based on requested feature sets in stored data, the method comprising:

acquiring a plurality of product features from a server, wherein each product feature in the plurality of product features is associated with data selected from a group consisting of: text data, audio data, and image data;

receiving a request for an instructional product video, wherein a product in the instructional product video comprises a set of current product features in the plurality of product features, the request for the product video including a request to view instructions to utilize a specific version of a manufacturer's product or to view a specific product feature;

identifying the data associated with each current product feature in the set of product features for the request for the instructional product video;

generating the instructional product video using a generative adversarial neural network (GAN) based on identified data for the product, the instructional product video including frames showing the requested version of the manufacturer's product or the specific product feature;

acquiring a plurality of updated or revised product features from the server, the updated or revised product features associated with an update to the specific version of the manufacturer's product or the specific product feature; and

generating an updated instructional product video, the updated instructional product video including frames showing the updated or revised product feature associated with the update to the specific version of the manufacturer's product or the specific product feature and instructions how to use the updated specific version of the manufacturer's product or the updated specific product feature.

2 . The computer-implemented method of claim 1 , further comprising:

identifying a product version for each product feature in the plurality of product features; and

generating a template video for the product version from the data associated with each product feature having the identified product version.

3 . The computer-implemented method of claim 2 , further comprising:

determining that a product feature in the set of product features for the request does not include the product version for the template video;

identifying a change to the template video based on the product feature; and

modifying the template video based on an identified change to the template video.

4 . The computer-implemented method of claim 3 , wherein the modifying the template video includes removing a video frame associated with the product feature from the template video, wherein the product feature is determined to be an obsolete product feature.

5 . The computer-implemented method of claim 3 , wherein a machine learning model that predicts video context based on content in a video is used to identify the change to the template video.

6 . The computer-implemented method of claim 2 , further comprising storing the plurality of product features in a product feature database, wherein the product feature database associates each product feature in the plurality of product features with the data of a respective product feature and the product version for the respective product feature.

7 . A computer system for automated generation of adaptive instructional product videos to indicate how a product is used based on requested feature sets in stored data, the computer system comprising:

one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage media, and program instructions stored on at least one of the one or more tangible storage media for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising:

acquiring a plurality of product features from a server, wherein each product feature in the plurality of product features is associated with data selected from a group consisting of: text data, audio data, and image data;

receiving a request for an instructional product video, wherein a product in the instructional product video comprises a set of current product features in the plurality of product features, the request for the product video including a request to view instructions to utilize a specific version of a manufacturer's product or to view a specific product feature;

identifying the data associated with each current product feature in the set of product features for the request for the instructional product video;

generating the instructional product video using a generative adversarial neural network (GAN) based on identified data for the product, the instructional product video including frames showing the requested version of the manufacturer's product or the specific product feature;

acquiring a plurality of updated or revised product features from the server, the updated or revised product features associated with an update to the specific version of the manufacturer's product or the specific product feature; and

generating an updated instructional product video, the updated instructional product video including frames showing the updated or revised product feature associated with the update to the specific version of the manufacturer's product or the specific product feature and instructions how to use the updated specific version of the manufacturer's product or the updated specific product feature.

8 . The computer system of claim 7 , further comprising:

identifying a product version for each product feature in the plurality of product features; and

generating a template video for the product version from the data associated with each product feature having the identified product version.

9 . The computer system of claim 8 , further comprising:

determining that a product feature in the set of product features for the request does not include the product version for the template video;

identifying a change to the template video based on the product feature; and

modifying the template video based on an identified change to the template video.

10 . The computer system of claim 9 , wherein the modifying the template video includes removing a video frame associated with the product feature from the template video, wherein the product feature is determined to be an obsolete product feature.

11 . The computer system of claim 9 , wherein a machine learning model that predicts video context based on content in a video is used to identify the change to the template video.

12 . The computer system of claim 8 , further comprising storing the plurality of product features in a product feature database, wherein the product feature database associates each product feature in the plurality of product features with the data of a respective product feature and the product version for the respective product feature.

13 . A computer program product for automated generation of adaptive instructional product videos to indicate how a product is used based on requested feature sets in stored data, the computer program product comprising:

a computer-readable storage device having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method comprising:

acquiring a plurality of product features from a server, wherein each product feature in the plurality of product features is associated with data selected from a group consisting of: text data, audio data, and image data;

receiving a request for an instructional product video, wherein a product in the instructional product video comprises a set of product features in the plurality of product features, the request for the product video including a request to view instructions to utilize a specific version of a manufacturer's product or to view a specific product feature;

identifying the data associated with each product feature in the set of product features for the request for the instructional product video;

generating the instructional product video using a generative adversarial neural network (GAN) based on identified data for the product, the instructional product video including frames showing the requested version of the manufacturer's product or the specific product feature;

acquiring a plurality of updated or revised product features from the server, the updated or revised product features associated with an update to the specific version of the manufacturer's product or the specific product feature; and

generating an updated instructional product video, the updated instructional product video including frames showing the updated or revised product feature associated with the update to the specific version of the manufacturer's product or the specific product feature and instructions how to use the updated specific version of the manufacturer's product or the updated specific product feature.

14 . The computer program product of claim 13 , further comprising:

identifying a product version for each product feature in the plurality of product features; and

generating a template video for the product version from the data associated with each product feature having the identified product version.

15 . The computer program product of claim 14 , further comprising:

determining that a product feature in the set of product features for the request does not include the product version for the template video;

identifying a change to the template video based on the product feature; and

modifying the template video based on an identified change to the template video.

16 . The computer program product of claim 15 , wherein the modifying the template video includes removing a video frame associated with the product feature from the template video, wherein the product feature is determined to be an obsolete product feature.

17 . The computer program product of claim 15 , wherein a machine learning model that predicts video context based on content in a video is used to identify the change to the template video.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2022
From: FOX, JEREMY R.; KEEN, MARTIN G.; AGRAWAL, TUSHAR; RAKSHIT, SARBAJIT K.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 061558/0989 →
Continuity (1)
Related Publication 20240144337A1 · May 2, 2024
References Cited (30)
US 9571827B2 · Su · 2017 [cited by applicant]
US 10540578B2 · Madani · 2020 [cited by applicant]
US 10839269B1 · Al-Turki · 2020 [cited by applicant]
US 10997464B2 · Yang · 2021 [cited by applicant]
US 11037222B1 · Natesh · 2021 [cited by examiner]
US 11250329B2 · Karras · 2022 [cited by applicant]
US 20090262238A1 · Hope · 2009 [cited by examiner]
US 20160357408A1 · Zavar · 2016 [cited by examiner]
US 20170264934A1 · Guo · 2017 [cited by examiner]
US 20200228880A1 · Iyer · 2020 [cited by examiner]
US 20200273062A1 · Probell · 2020 [cited by applicant]
US 20200280730A1 · Wang · 2020 [cited by applicant]
US 20210049468A1 · Karras · 2021 [cited by applicant]
US 20210090130A1 · Daly · 2021 [cited by examiner]
US 20210174426A1 · Isaacson · 2021 [cited by examiner]
US 20210281878A1 · Chan · 2021 [cited by applicant]
US 20210390319A1 · Yang · 2021 [cited by applicant]
US 20220004809A1 · Iyer · 2022 [cited by applicant]
US 20220092420A1 · Lu · 2022 [cited by applicant]
US 20220138473A1 · Kwatra · 2022 [cited by applicant]
US 20220180190A1 · Verma · 2022 [cited by applicant]
US 20230393833A1 · Cain, Jr. · 2023 [cited by examiner]
CN 111091151A · 2020 [cited by applicant]
Guo et al., “Auto-Embedding Generative Adversarial Networks For High Resolution Image Synthesis”, https://arxiv.org/pdf/1903.11250, Mar. 29, 2019, pp. 1-12. [cited by applicant]
Hoffmann et al., “ProGAN: Toward A Framework For Process Monitoring And Flexibility By Change Via Generative Adversarial Networks”, https://link.springer.com/chapter/10.1007/978-3-030-94343-1_4, SpringerLink, Jan. 23, 2… [cited by applicant]
IBM, “IBM Watson Advertising Accelerator”, Dynamic Creative Optimization, https://www.ibm.com/products/watson-advertising accelerator, Accessed Jul. 11, 2022, pp. 1-14. [cited by applicant]
IBM, “IBM Watson Advertising”, AI-Powered Advertising Solutions, https://www.ibm.com/watson-advertising, Accessed Jul. 11, 2022, pp. 1-10. [cited by applicant]
Liu et al., “GL-GAN: Adaptive Global And Local Bilevel Optimization For Generative Adversarial Network”, https://doi.org/10.1016/j.patcog.2021.108375, Elsevier, ScienceDirect, Pattern Recognition, vol. 123, 2022, pp. 1-… [cited by applicant]
Qi et al., “STC-GAN : Spatio-Temporally Coupled Generative Adversarial Networks For Predictive Scene Parsing”, https://ieeexplore.ieee.org/document/9052709, IEEE Transactions on Image Processing, vol. 29, 2020, pp. 5420… [cited by applicant]
Zhang et al., “Multi-Modal Generative Adversarial Network For Short Product Title Generation In Mobile E-Commerce”, https://doi.org/10.48550/arXiv.1904.01735, Apr. 3, 2019, pp. 1-9. [cited by applicant]