MODIFYING IMAGES FOR IMPROVED SEARCH

1 . A method comprising:

generating a first embedding that represents an input image using a first encoder, wherein a dimension of the first embedding matches a first dimension;

generating, using the first embedding, a second embedding that represents (i) the input image and (ii) a modification to the input image, wherein a dimension of the second embedding matches the first dimension;

generating, using the second embedding, a third embedding that represents (i) the input image and (ii) the modification to the input image using a second encoder; and

identifying, using the third embedding, a set of one or more images that are different from the input image.

2 . The method of claim 1 , wherein the modification input is text provided by a user of an input device.

3 . The method of claim 1 , wherein the input image represents a product or service listing on an e-commerce platform.

4 . The method of claim 1 , wherein identifying the set of one or more images that are different from the input image comprises:

identifying product listings, wherein each of the set of one or more images represents one or more of the product listings.

5 . The method of claim 1 , wherein the first encoder and the second encoder are autoencoders.

6 . The method of claim 1 , wherein identifying the set of one or more images that are different from the input image comprises:

performing one or more operations of an approximate nearest neighbor (ANN) algorithm.

7 . The method of claim 6 , wherein, prior to performing the one or more operations of the ANN algorithm, the method comprises:

generating, using the second encoder, one or more embeddings of a same dimension as the third embedding; and

performing, using the one or more embeddings of the same dimension as the third embedding and the third embedding, the one or more operations of the ANN algorithm.

8 . The method of claim 1 , wherein generating the third embedding that represents (i) the input image and (ii) the modification to the input image comprises:

compressing the second embedding from the first dimension to a second dimension.

9 . The method of claim 8 , wherein the first dimension includes 16,000 values and the second dimension includes 512 values.

10 . The method of claim 1 , wherein generating the first embedding that represents the input image comprises:

generating an initial embedding using the first encoder; and

generating a diffused embedding as the first embedding using a diffusion model.

11 . The method of claim 10 , wherein generating the first embedding occurs in batch prior to generating the second embedding.

12 . The method of claim 1 , wherein generating the second embedding comprises:

providing (i) the first embedding and (ii) the modification to the input image to a reverse diffusion model, wherein the reverse diffusion model generates the second embedding.

13 . The method of claim 12 , wherein the reverse diffusion model includes U-Net architecture.

14 . A system comprising one or more computers and one or more storage devices on which are stored instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

generating a first embedding that represents an input image using a first encoder, wherein a dimension of the first embedding matches a first dimension;

generating, using the first embedding, a second embedding that represents (i) the input image and (ii) a modification to the input image, wherein a dimension of the second embedding matches the first dimension;

generating, using the second embedding, a third embedding that represents (i) the input image and (ii) the modification to the input image using a second encoder; and

identifying, using the third embedding, a set of one or more images that are different from the input image.

15 . The system of claim 14 , wherein the modification input is text provided by a user of an input device.

16 . The system of claim 14 , wherein the input image represents a product or service listing on an e-commerce platform.

17 . The system of claim 14 , wherein identifying the set of one or more images that are different from the input image comprises:

identifying product listings, wherein each of the set of one or more images represents one or more of the product listings.

18 . The system of claim 14 , wherein the first encoder and the second encoder are autoencoders.

19 . The system of claim 14 , wherein identifying the set of one or more images that are different from the input image comprises:

performing one or more operations of an approximate nearest neighbor (ANN) algorithm.

20 . One or more computer storage media encoded with instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:

generating a first embedding that represents an input image using a first encoder, wherein a dimension of the first embedding matches a first dimension;

generating, using the first embedding, a second embedding that represents (i) the input image and (ii) a modification to the input image, wherein a dimension of the second embedding matches the first dimension;

generating, using the second embedding, a third embedding that represents (i) the input image and (ii) the modification to the input image using a second encoder; and

identifying, using the third embedding, a set of one or more images that are different from the input image.