Granted Patent B2

US 12,288,300 · App. 18/492,639 · Granted Apr 29, 2025

Inventors: Shrenik Sadalgi (Cambridge, MA); Christian Vázquez (Revere, MA)

Assignee: Wayfair LLC

G06T19/006G06T15/50G06T19/003G06T2219/008G06T2219/2004G06T2219/2016

Abstract

Claims (72)

1. A method for obtaining a two-dimensional (2D) image of one or more products in a physical scene, the method performed by a computing device comprising a computer hardware processor, the method comprising:

obtaining a three-dimensional (3D) model of the physical scene;

generating an image of the physical scene using the 3D model of the physical scene;

determining, based on input provided by a user through a graphical user interface (GUI), position information indicative of a target position of a first product in the physical scene;

transmitting, via a communication network to another computing device, the image of the physical scene and the position information;

receiving, via the communication network from the other computing device, a plurality of 2D images of a respective plurality of products, each of the plurality of products being of a same type as the first product and being a different product from the first product, each of the plurality of 2D images including an image of respective one of the plurality of products in the physical scene and being rendered using the image of the physical scene and the position information; and

displaying the plurality of 2D images of the respective plurality of products.

2. The method of claim 1 , further comprising displaying the 3D model of the physical scene in the GUI.

3. The method of claim 1 , wherein determining the position information indicative of the target position comprises determining the target position based on input provided by the user through the GUI to position a model of the first product in the 3D model of the physical scene.

4. The method of claim 1 , further comprising:

determining a field of view of a camera for capturing the image of the physical scene; and

transmitting, via the communication network to the other computing device, the field of view for use in rendering the plurality of 2D images of the respective plurality of products.

5. The method of claim 1 , wherein the image of the physical scene comprises a panorama generated using the 3D model of the physical scene.

6. The method of claim 5 , further comprising:

obtaining a rotation angle of the panorama relative to a camera position; and

transmitting the rotation angle of the panorama relative to the camera position to the other computing device via the communication network.

7. The method of claim 1 , further comprising determining a plane in the 3D model of the physical scene using ray casting.

8. The method of claim 1 , wherein the first product is selected from a group consisting of furniture, floor covering, décor, light fixture, appliance, art, wall covering, flooring, bedding, storage container, fencing, heating device, cooling device, bathroom accessory, wall fixture, plant, organization accessory, kitchen accessory, cookware, and tableware.

9. The method of claim 1 , wherein the indication of the target position of the first product in the physical scene comprises an indication of a position of a model of the first product in a 3D scene.

10. A system for obtaining a 2D image of one or more products in a physical scene, the system comprising:

a computer hardware processor; and

a non-transitory computer-readable storage medium storing instructions that, when executed by the computer hardware processor, cause the computer hardware processor to perform:

obtaining a three-dimensional (3D) model of the physical scene;

generating an image of the physical scene using the 3D model of the physical scene;

determining, based on input provided by a user through a graphical user interface (GUI), position information indicative of a target position of a first product in the physical scene;

transmitting, via a communication network to another computing device, the image of the physical scene and the position information;

receiving, via the communication network from the other computing device, a plurality of 2D images of a respective plurality of products, each of the plurality of products being of a same type as the first product and being a different product from the first product, each of the plurality of 2D images including an image of a respective one of the plurality of products in the physical scene and being rendered using the image of the physical scene and the position information; and

displaying the plurality of 2D images of the respective plurality of products.

11. The system of claim 10 , wherein the instructions further cause the computer hardware processor to perform displaying the 3D model of the physical scene in the GUI.

12. The system of claim 10 , wherein determining the position information indicative of the target position comprises determining the target position based on input provided by the user through the GUI to position a model of the first product in the 3D model of the physical scene.

13. The system of claim 10 , wherein the instructions further cause the computer hardware processor to perform:

determining a field of view of a camera for capturing the image of the physical scene; and

transmitting, via the communication network to the other computing device, the field of view for use in rendering the plurality of 2D images of the respective plurality of products.

14. The system of claim 10 ,

wherein the image of the physical scene comprises a panorama generated using the 3D model of the physical scene, and

wherein the instructions further cause the computer hardware processor to perform:

obtaining a rotation angle of the panorama relative to a camera position; and

transmitting, via the communication network to the other computing device, the rotation angle of the panorama relative to the camera position for use in rendering the plurality of 2D images of the respective plurality of products.

15. A non-transitory computer-readable storage medium storing instructions that, when executed by a computer hardware processor, cause the computer hardware processor to perform:

obtaining a three-dimensional (3D) model of a physical scene;

generating an image of the physical scene using the 3D model of the physical scene;

determining, based on input provided by a user through a graphical user interface (GUI), position information indicative of a target position of a first product in the physical scene;

transmitting, via a communication network to another computing device, the image of the physical scene and the position information;

receiving, via the communication network from the other computing device, a plurality of 2D images of a respective plurality of products, each of the plurality of products being of a same type as the first product and being a different product from the first product, each of the plurality of 2D images including a respective image of one of the plurality of products in the physical scene and being rendered using the image of the physical scene and the position information; and

displaying the plurality of 2D images of the respective plurality of products.

16. A method for generating a two-dimensional (2D) image of one or more products in a physical scene, the method performed by a computing device comprising a computer hardware processor, the method comprising:

obtaining a three-dimensional (3D) model of the physical scene;

generating an image of the physical scene using the 3D model of the physical scene;

determining, based on input provided by a user through a graphical user interface (GUI), position information indicative of a target position of a first product in the physical scene;

generating a plurality of 2D images of a respective plurality of products, each of the plurality of products being of a same type as the first product and being a different product from the first product, each of the plurality of 2D images including a respective image of one of the plurality of products in the physical scene using the image of the physical scene and the position information; and

displaying the plurality of 2D images of the respective plurality of products.

17. The method of claim 16 , wherein generating the plurality of 2D images of the respective plurality products in the physical scene using the image of the physical scene and the position information comprises rending the plurality of 2D images of the respective plurality products in the physical scene using the image of the physical scene, the position information, and 3D models of the respective plurality products.

18. The method of claim 16 , wherein generating the plurality of 2D images of the respective plurality products in the physical scene comprises:

generating a 3D scene, the 3D scene including 3D models of the respective plurality products positioned in the 3D scene in accordance with the target position; and

rendering the 2D image of the respective plurality products in the physical scene using the 3D scene.

19. The method of claim 18 , further comprising determining one or more camera setting values used to capture the image of the physical scene, wherein generating the plurality of 2D images of the respective plurality products in the physical scene comprises rendering the 2D image of the respective plurality products in the physical scene using a virtual camera configured with the one or more camera setting values.

20. The method of claim 19 , wherein the image of the physical scene comprises a panorama, and the one or more camera setting values comprise a rotation angle of the panorama relative to a camera position.

21. The method of claim 16 , wherein the indication of the target position of the first product in the physical scene comprises an indication of a position of a model of the first product in the 3D model of the physical scene.

22. A system for obtaining a 2D image of one or more products in a physical scene, the system comprising:

a computer hardware processor; and

a non-transitory computer-readable storage medium storing instructions that, when executed by the computer hardware processor, cause the computer hardware processor to perform:

obtaining a three-dimensional (3D) model of the physical scene;

generating an image of the physical scene using the 3D model of the physical scene;

determining, based on input provided by a user through a graphical user interface (GUI), position information indicative of a target position of a first product in the physical scene;

generating a plurality of 2D images of a respective plurality of products, each of the plurality of products being of a same type as the first product and being a different product from the first product, each of the plurality of 2D images including a respective image of one of the plurality of products in the physical scene using the image of the physical scene and the position information; and

displaying the plurality of 2D images of the respective plurality of products.

23. A non-transitory computer-readable storage medium storing instructions that, when executed by a computer hardware processor, cause the computer hardware processor to perform:

obtaining a three-dimensional (3D) model of a physical scene;

generating an image of the physical scene using the 3D model of the physical scene;

determining, based on input provided by a user through a graphical user interface (GUI), position information indicative of a target position of a first product in the physical scene;

generating a plurality of 2D images of a respective plurality of products, each of the plurality of products being of a same type as the first product and being a different product from the first product, each of the plurality of 2D images including a respective image of one of the plurality of products in the physical scene using the image of the physical scene and the position information; and

displaying the plurality of 2D images of the respective plurality of products.

Assignments (6)

Continuity (5)

References Cited (89)