IP Library Granted Patent US 10,489,961
Granted Patent B2
US 10,489,961 · App. 15/894,877 · Granted Nov 26, 2019

Systems and methods for generating textured three-dimensional models

Inventors: Michael Silvio Festa (Wakefield, MA); Rebecca W. Perry (Brookline, MA); Patrick G. Clark (North Billerica, MA)
Assignee: Wayfair LLC
G06T15/04G06T7/49G06T15/506G06T17/20H04N13/282H04N13/296G06T2200/08G06T2207/10152G06T2210/16G06T2215/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,489,961
App. No.
15/894,877
Granted
Nov 26, 2019
Kind
B2
Abstract

According to at least one aspect, a system is provided. The system comprises at least one hardware processor; and at least one non-transitory computer-readable storage medium storing processor executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform: generating a 3-dimensional (3D) model of an object at least in part by analyzing a first plurality of images of the object captured using a first scanning device; generating a texture model of a texture of a material at least in part by analyzing a second plurality of images of the material captured using a second scanning device different from the first scanning device, the material being separate and distinct from the object; and applying the texture model to the 3D model to generate a textured 3D model of the object.

Claims (73)

1. A system, comprising:

at least one hardware processor; and

at least one non-transitory computer-readable storage medium storing processor executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform:

generating a 3-dimensional (3D) model of an object at least in part by analyzing a first plurality of images of the object captured using a first scanning device;

generating a texture model of a texture of a material at least in part by analyzing a second plurality of images of the material captured using a second scanning device different from the first scanning device, the material being separate and distinct from the object, wherein:

the second scanning device comprises a lighting system comprising a first light source configured to emit light of a first color to illuminate the material, and

generating the texture model comprises identifying one or more regions in the second plurality of images having a color that matches the first color of the light emitted by the first light source as one or more transparent regions of the material; and

applying the texture model to the 3D model to generate a textured 3D model of the object.

2. The system of claim 1 , wherein the second scanning device further comprises:

a housing comprising a base having a top surface configured to receive the material having the texture, wherein the top surface comprises a transparent surface, and the first light source is configured to illuminate the material from underneath the top surface.

3. The system of claim 1 , wherein the first scanning device comprises:

a rotation device that is configured to receive the object and rotate the object about at least one axis; and

a plurality of imaging sensors configured to image the object.

4. The system of claim 3 , wherein generating the 3D model comprises:

controlling the plurality of imaging sensors to capture a first set of images of the object in a first position;

controlling the rotation device to rotate the object from the first position to a second position different from the first position;

controlling the plurality of imaging sensors to capture a second set of images of the object in the second position; and

generating the 3D model using the first set of images and the second set of images.

5. The system of claim 1 , wherein the second scanning device further comprises:

a housing configured to receive the material having the texture; and

at least one imaging sensor coupled to the housing and disposed above the material, wherein the lighting system is coupled to the housing and comprises a plurality of light sources each configured to emit light to illuminate the material, the plurality of light sources comprising the first light source.

6. The system of claim 5 , wherein generating the texture model comprises:

controlling the lighting system to illuminate the material with light emitted by a second light source of the plurality of light sources disposed at a first position;

controlling the at least one imaging sensor to capture a first image of the material illuminated with light from the second light source disposed at the first position;

controlling the lighting system to illuminate the material with light emitted by a third light source of the plurality of light sources disposed at a second position that is different from the first position;

controlling the at least one imaging sensor to capture a second image of the material illuminated with light from the third light source disposed at the second position; and

generating the texture model using the first and second images.

7. The system of claim 1 , wherein the 3D model comprises a polygonal mesh and the texture model comprises at least one image.

8. A method, comprising:

generating a 3-dimensional (3D) model of an object at least in part by analyzing a first plurality of images of the object captured using a first scanning device;

generating a texture model of a texture of a material at least in part by analyzing a second plurality of images of the material captured using a second scanning device different from the first scanning device, the material being separate and distinct from the object, wherein generating the texture model comprises:

illuminating, using a first light source, the material with light of a first color, and

identifying one or more regions in the second plurality of images having a color that matches the first color as one or more transparent regions of the material; and

applying the texture model to the 3D model to generate a textured 3D model of the object.

9. The method of claim 8 , wherein generating the 3D model comprises:

capturing, using a plurality of imaging sensors, a first set of images of an object in a first position;

rotating, using a rotation device, the object from the first position to a second position that is different from the first position;

capturing, using the plurality of imaging sensors, a second set of images of the object in the second position; and

generating the 3D model of the object using the first set of images and the second set of images.

10. The method of claim 9 , wherein generating the 3D model comprises:

illuminating the object with a first light using a first light source; and

capturing the first set of images while the object is illuminated with the first light.

11. The method of claim 10 , wherein generating the 3D model comprises:

illuminating the object with a second light that has a different spectrum from the first light using a second light source; and

capturing, using the plurality of image sensors, a third set of images while the object is illuminated with the second light.

12. The method of claim 11 , wherein generating the 3D model of the object comprises:

generating the 3D model of the object using the first set of images, the second set of images, and the third set of images.

13. The method of claim 8 , wherein generating the texture model comprises:

illuminating, using a second light source disposed at a first position, the material with light;

capturing, using at least one image sensor, a first image of the material illuminated with light from the second light source disposed at the first position;

illuminating, using a third light source disposed at a second position that is different from the first position, the material with light;

capturing, using the at least one imaging sensor, a second image of the material illuminated with light from the third light source disposed at the second position; and

generating the texture model using the first and second images.

14. The method of claim 13 , wherein illuminating the material with light using the second light source or the third light source comprises:

reading a light intensity value from at least one photodetector; and

adjusting at least one setting of the second light source or the third light source based on the light intensity value.

15. A system, comprising:

at least one hardware processor; and

at least one non-transitory computer-readable storage medium storing processor executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform:

receiving a 3-dimensional (3D) model of an object comprising a first section and a second section different from the first section;

identifying a first portion of the 3D model that corresponds to the first section of the object;

identifying a second portion of the 3D model that corresponds to the second section of the object;

receiving a first texture model of a first texture and a second texture model of a second texture different from the first texture, wherein at least the first texture model is generated by:

illuminating, using a light source, the first texture with light of a first color, and

identifying one or more regions in a plurality of images of the first texture having a color that matches the first color as one or more transparent regions of the first texture;

applying the first texture model to the first portion of the 3D model; and

applying the second texture model to the second portion of the 3D model.

16. The system of claim 15 , wherein the object is a piece of furniture.

17. The system of claim 16 , wherein each of the first texture and the second texture is selected from the group consisting of: a wood, a metal, a fabric, a leather, a glass, a ceramic, and a plastic.

18. The system of claim 15 , wherein the first section of the object comprises a fabric and wherein the first texture model is a texture model of a fabric swatch.

19. The system of claim 18 , wherein the fabric swatch is a swatch of the fabric in the first section of the object.

20. The system of claim 19 , wherein applying the first texture model to the first portion of the 3D model comprises:

applying the first texture model to the first section of the object using a UV map that describes a spatial relationship between at least part of the 3D model of the object and at least part of the first texture model.

Assignments (6)
SECURITY AGREEMENT Recorded May 20, 2026
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 075591/0399 →
SECURITY INTEREST Recorded Nov 10, 2025
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 073514/0326 →
SECURITY AGREEMENT Recorded Mar 13, 2025
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 070513/0542 →
SECURITY AGREEMENT Recorded Oct 10, 2024
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 069143/0399 →
SECURITY AGREEMENT Recorded Mar 24, 2021
From: WAYFAIR LLC
To: CITIBANK, N.A.
Reel/Frame 055708/0832 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2018
From: FESTA, MICHAEL SILVIO; PERRY, REBECCA W.; CLARK, PATRICK G.
To: WAYFAIR LLC
Reel/Frame 045349/0454 →
Continuity (1)
Related Publication 20190251733A1 · Aug 15, 2019