Using artificial intelligence to generate images of product based on user input
The disclosed technology includes a computer-implemented technique for generating images of physically producible products in response to user input describing a conceptual product. The system receives user input—such as natural language text, speech, or images—via a user interface, configures a prompt for a generative artificial intelligence (AI) system, and generates an image representing a version of the conceptual product with distinct physical attributes. Each version is associated with a unique identifier, enabling selection, modification, and purchase of the conceptual product. The system supports multiple product categories, including jewelry, home décor, and fashion, and extracts physical attributes to determine manufacturability and pricing. User feedback is incorporated to improve AI performance. The invention enables presentation of selectable product versions and initiates manufacturing processes based on user selections, supporting unstructured user input and multiple data modalities.
1 . A computer-implemented method for generating an image of a physically producible product in response to user input including a description of a conceptual product, the method comprising:
receiving the user input including at least one of natural language text, natural language speech, or an image entered to a user interface,
wherein the user input includes the description of the conceptual product;
configuring, based on the natural language text, the natural language speech, or the image entered to the user interface, a prompt instruction for a generative artificial intelligence (AI) system;
processing the prompt instruction with the generative AI system to generate the image that includes a version of the conceptual product,
wherein the version of the conceptual product is not a real product and is producible to a physical product, and
wherein the version of the conceptual product includes an indication of a physical attribute of the version of the conceptual product;
determining a price to purchase the version of the conceptual product included in the image,
wherein the price of the version of the conceptual product is determined based in part on the physical attribute of the version of the conceptual product; and
causing the user interface to present the price and the image including a representation of the version of the conceptual product,
wherein the conceptual product has an associated unique identifier that is created in association with the version of the conceptual product.
2 . The computer-implemented method of claim 1 , further comprising:
receiving an indication and necessary information, received at the user interface, to purchase the conceptual product for the price shown on the user interface; and
in response to the indication to purchase the conceptual product, initiating a process to produce the physical product based on the version of the conceptual product in accordance with the physical attribute and in association with the unique identifier.
3 . The computer-implemented method of claim 1 , wherein the image is a first image, the version of the conceptual product is a first version, the physical attribute is a first physical attribute, and the unique identifier is a first unique identifier, the method further comprising:
creating a second unique identifier for a second version of the conceptual product that is based on the first version,
wherein the second unique identifier is different from the first unique identifier; and
causing the user interface to present, in addition to the first image, a second image including a representation of the second version of the conceptual product,
wherein the second version of the conceptual product includes a second physical attribute of the physical product.
4 . The computer-implemented method of claim 3 , wherein the physical attribute is a first physical attribute, the method further comprising:
receiving an indication of a selection of the second image presented on the user interface; and
in response to the selection of the second image, initiating a process to produce the physical product as the second version of the conceptual product in accordance with a second physical attribute different from a first physical attribute and in association with the second unique identifier.
5 . The computer-implemented method of claim 1 , wherein the image is a first image, the version of the conceptual product is a first version, and the physical attribute is a first physical attribute, the method further comprising:
causing the user interface to present, in addition to the first image, a second image including a representation of the second version of the conceptual product,
wherein the first physical attribute of the first version of the conceptual product is different from a second physical attribute of the second version of the conceptual product, and
wherein the first and second images are distinctly selectable on the user interface for initiating a process to manufacture the physical product in accordance with the first version or the second version of the conceptual product, respectively.
6 . The computer-implemented method of claim 1 , wherein the user input is a first user input, the image is a first image, the version of the conceptual product is a first version, and the unique identifier is a first unique identifier of the first version of the conceptual product, the method further comprising:
receiving a second user input related to the conceptual product;
configuring, based on the second user input, a second prompt instruction for the generative AI system;
processing the second prompt instruction with the generative AI system to generate a second image that includes a second version of the conceptual product,
wherein the second version of the conceptual product corresponds to a modification of the first version of the conceptual product; and
causing the user interface to present a second image including a representation of the second version of the conceptual product,
wherein the second version of the conceptual product corresponds to a modification of the first version of the conceptual product and is associated with a second unique identifier different from the first unique identifier.
7 . The computer-implemented method of claim 1 ,
wherein the conceptual product is a jewelry item,
wherein the generative AI system is trained to generate images of types of jewelry,
wherein the physical attribute includes a design or material specification, and
wherein the unique identifier is a stock keeping unit (SKU) for the jewelry item.
8 . The computer-implemented method of claim 1 ,
wherein the conceptual product is a home décor item,
wherein the generative AI system is trained to generate images of types of home décor,
wherein the physical attribute includes a design or material specification, and
wherein the unique identifier is a stock keeping unit (SKU) for the home décor item.
9 . The computer-implemented method of claim 1 ,
wherein the conceptual product is a fashion or personal décor item,
wherein the generative AI system is trained to generate images of types of fashion or personal décor items,
wherein the physical attribute includes a design or material specification, and
wherein the unique identifier is a stock keeping unit (SKU) for the fashion or personal décor item.
10 . The computer-implemented method of claim 1 , wherein configuring the prompt instruction for the generative AI system comprises:
preprocessing the user input to create the prompt instruction for the generative AI system,
wherein the prompt instruction is configured to cause the generative AI system to generate multiple images representing different manufacturable versions of the conceptual product.
11 . The computer-implemented method of claim 1 , wherein preprocessing the user input to create the prompt instruction for the generative AI system comprises:
analyzing manufacturability constraints of producing the physical product based on a model of products including the conceptual product; and
configuring the prompt instruction such that different manufacturable versions of the conceptual product satisfy the manufacturability constraints.
12 . The computer-implemented method of claim 1 , wherein the generative AI system includes models that are trained using a combination of real-world data and synthetic data created by humans or AI image-generating models.
13 . The computer-implemented method of claim 1 , further comprising:
incorporating user feedback of the image into a data pipeline used to improve the generative AI system,
wherein the feedback includes aesthetic qualities, accuracy of one or more images, or comparisons to an actual completed product.
14 . The computer-implemented method of claim 1 , wherein processing the prompt instruction with the generative AI system comprises:
determining the price for the version of the conceptual product based on an analysis of the image to extract values of physical attributes including the physical attribute,
wherein the physical attributes include a volume, weight, dimensions, or materials.
15 . The computer-implemented method of claim 1 , wherein processing the prompt instruction with the generative AI system comprises:
determining the price for the version of the conceptual product based on an analysis of the image to extract values of physical attributes including the physical attribute,
wherein the physical attributes include design complexity, color, shape, or a combination thereof.
16 . The computer-implemented method of claim 1 , further comprising:
extracting, from the image, values of multiple physical attributes of the conceptual product,
wherein the multiple physical attributes include a volume, weight, dimensions, or a material for manufacturing the physical product; and
calculating the price for the version of the conceptual product based on an analysis of the multiple physical attributes.
17 . The computer-implemented method of claim 1 , further comprising:
extracting, from the image, values of multiple physical attributes of the conceptual product,
wherein the multiple physical attributes include a volume, a weight, a dimension, or a material for manufacturing the physical product.
18 . A non-transitory, computer-readable storage medium comprising instructions recorded thereon, wherein the instructions, when executed by at least one data processor of a system, cause the system to:
receive a prompt including an unstructured description of a conceptual product,
wherein the unstructured description lacks a specific format;
process the prompt with a generative artificial intelligence (AI) system to generate a representation of a version of a conceptual product that is physically reproducible with distinct physical attributes, wherein the version of the conceptual product is not a real product, and
wherein the version of the conceptual product includes an indication of a physical attribute of the version of the conceptual product;
determine a price to purchase the version of the conceptual product included in the representation,
wherein the price of the version of the conceptual product is determined based in part on the physical attribute of the version of the conceptual product;
generate an image that includes the representation of the conceptual product that is purchasable as the physical product for the price; and
create a unique identifier for the conceptual product.
19 . The non-transitory, computer-readable storage medium of claim 18 , further comprising:
initiate a process to manufacture the physical product based on the image for the price shown on a user interface, with the distinct physical attributes of the conceptual product and in association with the unique identifier.
20 . The non-transitory, computer-readable storage medium of claim 18 , further comprising:
creating an alternative unique identifier for an alternative image including an alternative version of the conceptual product for an alternative price,
wherein the alternative unique identifier is different from the unique identifier,
wherein the alternative price is different from the price for the version of the conceptual product; and
causing a user interface to present the image, the alternative price, and the alternative image including different versions of the conceptual product.
21 . A system comprising:
at least one hardware processor; and
at least one non-transitory memory storing instructions, which, when executed by the at least one hardware processor, cause the system to:
generate, using a generative artificial intelligence (AI) system, a price and an image including a representation of a conceptual product based on user input including an unstructured description of a physical product,
wherein the unstructured description lacks a specific format, and
wherein the conceptual product is not a real product, is physically producible to a real product, and has multiple physical attributes;
determine the price to purchase the conceptual product included in the image,
wherein the price of the conceptual product is determined based in part on the physical attribute of the conceptual product; and
create a unique identifier for the conceptual product.
22 . The system of claim 21 being further caused to:
cause presentation of the price and the image including the representation of the conceptual product and a control configured to enable purchase of the conceptual product;
receive an indication of a purchase of the conceptual product based on input to the control; and
in response to the indication of the purchase of the conceptual product, initiate a process to produce a physical product based on the conceptual product in accordance with the physical attributes.
23 . The system of claim 21 :
wherein the user input includes a combination of natural language text, natural language speech, or an image, and
wherein the physical attributes include a combination of volume, weight, dimensions, or materials for manufacturing the physical product.
24 . The system of claim 21 :
wherein the user input additionally includes images, videos, voice, or indications of interactive gestures, and
wherein the physical attributes include tangible and measurable characteristics for manufacturing the physical product.