IP Library › Granted Patent US 11,727,627
Granted Patent B2
US 11,727,627 · App. 17/500,756 · Granted Aug 15, 2023

Integration of 3D models

Inventors: Qiaosong Wang (San Jose, CA); James Thomas Dowdell (Oakland, CA); Jinrong Xie (San Jose, CA); Robinson Piramuthu (Oakland, CA)
Assignee: eBay Inc.
G06T15/205G06T7/90G06T17/20G06T2200/08G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,727,627
App. No.
17/500,756
Granted
Aug 15, 2023
Kind
B2
Abstract

In various example embodiments, a system and method for integration of a three-dimensional model is disclosed. In one example embodiment, a method includes receiving a plurality of images, selecting points on the images and triangulating the points to generate a plurality of depth maps, generate a three-dimensional mesh by combining the plurality of depth maps, generating a three-dimensional model of the item by projecting the plurality of images onto the mesh using the points, calibrating colors used in the model using colors diffuse properties of the colors in the images, and providing a user interface allowing a user to select one or more user points on the three-dimensional model and provide additional information associated with the selected user points.

Claims (81)

1. A computer-implemented method comprising:

receiving, by one or more processors, a plurality of two-dimensional (2D) images of an item;

generating a three-dimensional (3D) model of the item based at least in part on the plurality of 2D images;

incorporating a subset of a second model of the item to complete the 3D model based at least in part on a determination that the 3D model is incomplete; and

providing, in a user interface, an indication distinguishing a first portion of the 3D model from a second portion of the 3D model, the first portion being based at least in part on the plurality of 2D images and the second portion being based at least in part on the subset of the second model.

2. The computer-implemented method of claim 1 , further comprising:

determining that a first 2D image of the plurality of 2D images lacks sufficient quality; and

retrieving a stock image of the item to replace the first 2D image based at least in part on the determining, wherein the 3D model is generated based at least in part on the stock image.

3. The computer-implemented method of claim 1 , further comprising:

determining that the plurality of 2D images do not depict a certain angle of the item; and

retrieving a stock image of the item from the certain angle based at least in part on the determining, wherein the 3D model is generated based at least in part on the stock image.

4. The computer-implemented method of claim 1 , further comprising:

causing presentation of a plurality of 3D models, including the generated 3D model;

receiving input manipulating a first 3D model of the plurality of 3D models; and

manipulating a second 3D model of the plurality of 3D models to keep the second 3D model similarly oriented with respect to the first 3D model.

5. The computer-implemented method of claim 1 , further comprising:

selecting a shipping container for the item by selecting a smallest shipping container available that is capable of enclosing the item using a size of the item determined based at least in part on the 3D model of the item; and

directing shipping of the item by providing instructions to a shipping carrier including the selected shipping container.

6. The computer-implemented method of claim 5 , further comprising:

indicating an amount of filler material to be used according to the amount of space within the shipping container that is not occupied by the item, according to the 3D model.

7. The computer-implemented method of claim 1 , further comprising:

receiving a plurality of images depicting a portion of a person;

generating a 3D model of the portion of the person;

combining the 3D model of the item with the 3D model of the portion of the person in a three-dimensional environment;

manipulating the 3D model of the item and the 3D model of the portion of the person in the three-dimensional environment to determine whether the portion of the person fits inside the item; and

outputting a notification indicating whether the item fits the portion of the person.

8. The computer-implemented method of claim 1 , further comprising:

retrieving an authenticated three-dimensional representation of the item;

comparing the 3D model of the item with the authenticated three-dimensional representation; and

indicating authenticity of the item in response to dimensions of the 3D model of the item being consistent with dimensions of the authenticated three-dimensional representation.

9. A system comprising:

at least one processor; and

a machine-readable memory having instructions stored thereon, which, when executed by the at least one processor, causes the system to perform operations comprising:

receiving a plurality of two-dimensional (2D) images of an item;

generating a three-dimensional (3D) model of the item based at least in part on the plurality of 2D images;

incorporating a subset of a second model of the item to complete the 3D model based at least in part on a determination that the 3D model is incomplete; and

providing, in a user interface, an indication distinguishing a first portion of the 3D model from a second portion of the 3D model, the first portion being based at least in part on the plurality of 2D images and the second portion being based at least in part on the subset of the second model.

10. The system of claim 9 , wherein the operations further comprise:

determining that a first 2D image of the plurality of 2D images lacks sufficient quality; and

retrieving a stock image of the item to replace the first 2D image based at least in part on the determining, wherein the 3D model is generated based at least in part on the stock image.

11. The system of claim 9 , wherein the operations further comprise:

determining that the plurality of 2D images do not depict a certain angle of the item; and

retrieving a stock image of the item from the certain angle based at least in part on the determining, wherein the 3D model is generated based at least in part on the stock image.

12. The system of claim 9 , wherein the operations further comprise:

causing presentation of a plurality of 3D models, including the generated 3D model;

receiving input manipulating a first 3D model of the plurality of 3D models; and

manipulating a second 3D model of the plurality of 3D models to keep the second 3D model similarly oriented with respect to the first 3D model.

13. The system of claim 9 , wherein the operations further comprise:

selecting a shipping container for the item by selecting a smallest shipping container available that is capable of enclosing the item using a size of the item determined based at least in part on the 3D model of the item; and

directing shipping of the item by providing instructions to a shipping carrier including the selected shipping container.

14. The system of claim 9 , wherein the operations further comprise:

receiving a plurality of images depicting a portion of a person;

generating a 3D model of the portion of the person;

combining the 3D model of the item with the 3D model of the portion of the person in a three-dimensional environment;

manipulating the 3D model of the item and the 3D model of the portion of the person in the three-dimensional environment to determine whether the portion of the person fits inside the item; and

outputting a notification indicating whether the item fits the portion of the person.

15. The system of claim 9 , wherein the operations further comprise:

retrieving an authenticated three-dimensional representation of the item;

comparing the 3D model of the item with the authenticated three-dimensional representation; and

indicating authenticity of the item in response to dimensions of the 3D model of the item being consistent with dimensions of the authenticated three-dimensional representation.

16. A machine-readable hardware medium having instructions stored thereon, which, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving a plurality of two-dimensional (2D) images of an item;

generating a three-dimensional (3D) model of the item based at least in part on the plurality of 2D images;

incorporating a subset of a second model of the item to complete the 3D model based at least in part on a determination that the 3D model is incomplete; and

providing, in a user interface, an indication distinguishing a first portion of the 3D model from a second portion of the 3D model, the first portion being based at least in part on the plurality of 2D images and the second portion being based at least in part on the subset of the second model.

17. The machine-readable hardware medium of claim 16 , wherein the operations further comprise:

determining that a first 2D image of the plurality of 2D images lacks sufficient quality; and

retrieving a stock image of the item to replace the first 2D image based at least in part on the determining, wherein the 3D model is generated based at least in part on the stock image.

18. The machine-readable hardware medium of claim 16 , wherein the operations further comprise:

determining that the plurality of 2D images do not depict a certain angle of the item; and

retrieving a stock image of the item from the certain angle based at least in part on the determining, wherein the 3D model is generated based at least in part on the stock image.

19. The machine-readable hardware medium of claim 16 , wherein the operations further comprise:

causing presentation of a plurality of 3D models, including the generated 3D model;

receiving input manipulating a first 3D model of the plurality of 3D models; and

manipulating a second 3D model of the plurality of 3D models to keep the second 3D model similarly oriented with respect to the first 3D model.

20. The machine-readable hardware medium of claim 16 , wherein the operations further comprise:

receiving a plurality of images depicting a portion of a person;

generating a 3D model of the portion of the person;

combining the 3D model of the item with the 3D model of the portion of the person in a three-dimensional environment;

manipulating the 3D model of the item and the 3D model of the portion of the person in the three-dimensional environment to determine whether the portion of the person fits inside the item; and

outputting a notification indicating whether the item fits the portion of the person.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: WANG, QIAOSONG; DOWDELL, JAMES THOMAS; XIE, JINRONG; PIRAMUTHU, ROBINSON
To: EBAY INC.
Reel/Frame 057785/0146 →
Continuity (4)
Continuation 16776547 · Jan 30, 2020
Continuation 15709997 · Sep 20, 2017
Provisional Application 62468748 · Mar 8, 2017
Related Publication 20220068011A1 · Mar 3, 2022
Cited By (1)
US 12,260,509