IP Library › Granted Patent US 12,159,345
Granted Patent B2
US 12,159,345 · App. 17/587,254 · Granted Dec 3, 2024

Three-dimensional modelling from photographs in series

Inventor: Kevin D. Fialko (La Jolla, CA)
G06T17/00G06T7/38G06T7/80G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,159,345
App. No.
17/587,254
Granted
Dec 3, 2024
Kind
B2
Abstract

Modeling a product, including taking a first picture of a product at a first position and at a first distance with a camera, taking a second picture of a product at the first distance and a second position with the camera, combining the pictures based on overlapping portions of the respective pictures, and generating an interactable model of the combined pictures.

Claims (64)

1. A method of modeling a product, comprising:

taking a first picture of the product at a first position and at a first distance with a camera;

taking a second picture of the product at the first distance and a second position with the camera, wherein the camera is rotated about the product from the first position to the second position;

combining the first picture and the second picture based on overlapping portions of the respective pictures to form a combined product image, comprising:

selecting an overlaid position of the first picture and the second picture in which a count of one or more similar overlapping pixels is maximized, wherein maximization of similar overlapping pixels is determined by color value, position, time of flight, radius, respective positions of the camera, and height, width, and depth of the product,

wherein time of flight is measured from the camera to the surface of the product and height, width, and depth of the product is maintained by the overlaid position relative to the position of the camera,

retaining the one or more similar overlapping pixels corresponding to the height, width, and depth of the product in the combined product image, and

appending one or more nonoverlapping pixels to a corresponding pixel position corresponding to the height, width, and depth of the product to generate the combined product image; and

taking an additional picture of the product at the first distance and at an additional position with the camera;

combining the additional picture with the combined product image based on overlapping portions of the additional picture and the combined product image to further form the combined product image, comprising:

selecting an overlaid position of the additional picture and the combined product image in which a count of one or more similar overlapping pixels is maximized, wherein maximization of similar overlapping pixels is determined by color value, position, time of flight, radius, respective positions of the camera, and the height, width, and depth of the product,

wherein time of flight is measured from the camera to the surface of the product and height, width, and depth of the product is maintained by the overlaid position relative to the position of the camera,

retaining the one or more similar overlapping pixels corresponding to the height, width, and depth of the product in the combined product image, and

appending one or more nonoverlapping pixels to a corresponding pixel position corresponding to the height, width, and depth of the product in the combined product image; and

providing an interactable model of the combined product image.

2. The method of claim 1 , wherein the camera is placed inside a lightbox.

3. The method of claim 1 , wherein combining the pictures further comprising:

image registration, calibration, and blending.

4. The method of claim 1 , wherein the first picture and the second picture overlap by about 90 percent or greater.

5. The method of claim 1 , further comprising:

receiving a first user input by a processor; and

rotating, by a processor, the model about a first axis based on the first user input.

6. The method of claim 1 , further comprising:

taking a first picture of a product at a third position and at a second distance;

taking a second picture of a product at the second distance and a fourth position;

combining the pictures based on overlapping portions of the respective pictures at the second distance; and

providing an interactable model of the combined pictures at the second distance on a website.

7. The method of claim 5 , further comprising:

receiving, by a processor, a second user input; and

displaying, by a processor through a screen, a different zoom level model based on the second user input.

8. The method of claim 1 , further comprising:

repeating taking the additional picture and combining the additional picture with the combined product image until the interactable model corresponds to a 360-degree view of the product based on the combined product image.

9. The method of claim 1 , further comprising:

repeating taking the additional picture and combining the additional picture with the combined product image until the interactable model corresponds to a three-dimensional view of the product based on the combined product image.

10. A system, comprising:

a product within a lightbox;

a camera within the lightbox, the camera configured to orbit about the product;

a processor configured to combine multiple pictures taken by the camera into a three-dimensional model of the product by

receiving from the camera a first picture of the product at a first position and at a first distance with a camera;

receiving from the camera a second picture of the product at the first distance and a second position with the camera, wherein the camera is rotated about the product from the first position to the second position;

combining the first picture and the second picture based on overlapping portions of the respective pictures to form a combined product image, comprising:

selecting an overlaid position of the first picture and the second picture in which a count of one or more similar overlapping pixels is maximized, wherein maximization of similar overlapping pixels is determined by color value, position, time of flight, radius, respective positions of the camera, and height, width, and depth of the product,

wherein time of flight is measured from the camera to the surface of the product and height, width, and depth of the product is maintained by the overlaid position relative to the position of the camera,

retaining the one or more similar overlapping pixels corresponding to the height, width, and depth of the product in the combined product image, and

appending one or more nonoverlapping pixels to a corresponding pixel position corresponding to the height, width, and depth of the product to generate the combined product image; and

providing an interactable model of the combined product image.

11. The system of claim 10 , further comprising:

an orbital pole configured to support the camera, the orbital pole configured to extend from a platform configured to support the product to the camera; and

a motor configured to drive rotation of the orbital pole about an axis of the platform.

12. The system of claim 11 , further comprising the processor configured to control rate of revolution of the orbital pole and the length of the orbital pole.

13. The system of claim 12 , wherein the processor is configured to control the rate of revolution and length of the orbital pole based on a user input.

14. The system of claim 10 , further comprising a processor configured to combine two or more neighboring pictures taken from an orbit into a product model.

15. The system of claim 14 , further comprising:

a server configured to provide the product model to a user.

16. The system of claim 10 , wherein the processor is further configured to combine multiple pictures taken by the camera into a three-dimensional model of the product by:

receiving an additional picture of the product at an additional at the first distance and at an additional position with the camera;

combining the additional picture and the combined product image based on overlapping portions of the additional picture and the combined product image to further form the combined product image, comprising:

selecting an overlaid position of the first picture and the second picture in which a count of one or more similar overlapping pixels is maximized, wherein maximization of similar overlapping pixels is determined by color value, position, time of flight, radius, respective positions of the camera, and the height, width, and depth of the product,

wherein time of flight is measured from the camera to the surface of the product and height, width, and depth of the product is maintained by the overlaid position relative to the position of the camera,

retaining the one or more similar overlapping pixels corresponding to the height, width, and depth of the product in the combined product image, and

appending one or more nonoverlapping pixels from the additional picture to a corresponding pixel position corresponding to the height, width, and depth of the product in the combined product image.

17. The system of claim 16 , wherein the processor is further configured to combine multiple pictures taken by the camera into a three-dimensional model of the product by:

repeating receiving the additional picture and combining the additional picture with the combined product image until the interactable model corresponds to a 360-degree view of the product based on the combined product image.

18. The system of claim 16 , wherein the processor is further configured to repeat receiving the additional picture and combine the additional picture with the combined product image until the interactable model corresponds to a three-dimensional view of the product based on the combined product image.

Continuity (2)
Provisional Application 63143506 · Jan 29, 2021
Related Publication 20220245890A1 · Aug 4, 2022
Cited By (1)
US 12,579,729