IP Library Granted Patent US 11,176,400
Granted Patent B2
US 11,176,400 · App. 16/675,319 · Granted Nov 16, 2021

Multi-angle product imaging device

Inventors: Yi-Ting Shen (Toronto, CA); Riyad Twahir (Milton, CA); Wencheng Wu (Rochester, NY); Dennis L. Venable (Marion, NY); Charles D. Rizzolo (Fairport, NY); Thomas F. Wade (Rochester, NY); Daniel S. Hann (Williamson, NY); Adrien P. Cote (Kitchener, CA)
Assignee: Conduent Business Services, LLC
G06K9/3208G06F16/51G06K7/10722G06K7/10861G06K7/1443G06K9/4604G06T7/10G06T7/11G06T7/13G06T7/246G06T7/70G06T7/73H04N1/00204H04N1/00562H04N5/222H04N5/28H04N7/18G06T7/194H04N2201/0084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,176,400
App. No.
16/675,319
Granted
Nov 16, 2021
Kind
B2
Abstract

A system for acquiring multi-angle images of a product includes a workstation having a working surface for placing a product, a camera supporting member having a vertical axis, and an image capturing device movably attached to the camera supporting member so that it may move along the vertical axis of the camera supporting member. The system captures and analyzes a digital image of a product to detect the vertical center of the product, and adjusts the position of the image capturing device along the vertical axis so that the vertical center of the product is proximate to the vertical center of the image. The system may also have a turntable and additionally rotate the turntable at multiple capturing angles and capture one or more additional digital images of the product at various capturing angles and store the one or more additional images in a product database.

Claims (87)

1. A method of acquiring images of a product, comprising:

placing a product on a workstation comprising at least one background wall and a camera supporting member having a vertical axis, wherein the camera supporting member is configured to movably attach an image capturing device so that the image capturing device may be moved along the vertical axis of the camera supporting member;

capturing, by the image capturing device, a first image of the product;

analyzing, by a computing device, the captured first image and detecting a vertical center of the product;

determining, by the computing device, when the vertical center of the product is within a proximate distance to the vertical center of the first image;

upon determining that the vertical center of the product is not within the proximate distance to the vertical center of the first image, causing, by the computing device, the image capturing device to move along the vertical axis to a location on the vertical axis that is based on the distance between the vertical center of the product and the vertical center of the first image;

capturing one or more additional images of the product at a plurality of image capturing angles after the image capturing device has moved to the location;

while capturing the one or more additional images, analyzing each of the additional images and continuing to do so until the analyzing detects a barcode on the product;

comparing the detected barcode with one or more product barcodes, each of which is associated with one or more product images stored in the product database; and

when the detected barcode of the product matches at least one of the one or more product barcodes stored in the product database:

comparing the one or more captured additional images of the product with one or more product images associated with the matching product barcode, and

based on the comparing, identifying a product packaging change for the product over a period of time.

2. The method of claim 1 , wherein the workstation further comprises a turntable, and capturing the one or more additional images of the product comprises:

rotating the turntable, which in turn rotates the product; and

capturing the one or more additional images at the plurality of capturing angles as the product rotates.

3. The method of claim 1 , wherein detecting the vertical center of the product comprises:

calculating an image intensity profile of the first image;

calculating a derivative of the image intensity profile;

detecting an upper edge and a lower edge of the product based on the derivative of the image intensity profile; and

determining the vertical center of the product based on the detected upper edge and the lower edge of the product.

4. The method of claim 1 , wherein detecting the vertical center of the product comprises:

segmenting the first image; and

detecting a foreground of the first image based on the segmented image.

5. The method of claim 1 , further comprising:

embedding the detected barcode in one or more image files that include one or more of the additional images; and

storing the one or more image files with the embedded barcode in a product database.

6. The method of claim 1 further comprising:

receiving, by the computing device, a distance between the image capturing device and the product from a laser based range sensor; and

determining, by the computing device, a dimension of the product based on the one or more captured additional images and the distance between the image capturing device and the product.

7. The method of claim 1 , wherein the plurality of capturing angles comprise approximately 0, approximately 90, approximately 180 and approximately 270 degrees.

8. A system for acquiring images of a product, comprising:

a computing device;

a workstation comprising:

at least one background wall, and

a camera supporting member having a vertical axis,

wherein the camera supporting member is configured to movably attach an image capturing device so that the image capturing device may be moved along the vertical axis of the camera supporting member; and

a non-transitory, computer readable medium containing program instructions that are configured to cause the computing device to:

cause the image capturing device to capture a first digital image of the product,

analyze the captured first digital image and detect a vertical center of the product,

determine when the vertical center of the product is proximate to a vertical center of the first digital image,

upon determining that the vertical center of the product is not proximate to the vertical center of the first digital image, cause the image capturing device to move along the vertical axis to a location based on the distance between the vertical center of the product and the vertical center of the first image,

cause the image capturing device to capture one or more additional digital images of the product at a plurality of image capturing angles after the image capturing device has moved to the location on the vertical axis,

while capturing the one or more additional digital images, analyzing each of the additional digital images and continuing to do so until the analyzing detects a barcode on the product,

comparing the detected barcode with one or more product barcodes, each of which is associated with one or more product images stored in the product database, and

when the detected barcode of the product matches at least one of the one or more product barcodes stored in the product database:

comparing the one or more captured additional images of the product with one or more product images associated with the matching product barcode; and

based on the comparing, identifying a product packaging change for the product over a period of time.

9. The system of claim 1 , wherein:

the workstation further comprises a turntable;

the program instructions to capture the one or more additional images of the product comprise instructions to:

rotate the turntable, which in turn rotates the product, and

capturing the one or more additional images at the plurality of capturing angles as the product rotates.

10. The system of claim 8 further comprising one or more light panels.

11. The system of claim 8 :

further comprising a laser based range sensor mounted on the camera supporting member, wherein the laser based range sensor is configured to detect a distance between the image capturing device and the product; and

wherein the program instructions comprise additional program instructions that are configured to cause the computing device to calculate a dimension of the product based on the one or more captured additional images and the detected distance between the image capturing device and the product.

12. The system of claim 8 , wherein the background wall and the working surface of the workstation intersect at a curved corner.

13. The system of claim 8 , wherein the image capturing angles comprise approximately 0, approximately 90, approximately 180 and approximately 270 degrees.

14. The system of claim 9 , wherein a surface of the turntable is mounted flush to the working surface of the workstation.

15. A system for acquiring images of a product, comprising:

a computing device;

a workstation comprising:

at least one background wall,

a camera supporting member having a vertical axis, and

an image capturing device movably attached to the camera supporting member so that the image capturing device may be moved along the vertical axis of the camera supporting member; and

a non-transitory, computer readable medium containing program instructions that are configured to cause the computing device to:

cause the image capturing device to capture a first digital image of the product,

analyze the captured first digital image and detect a vertical center of the product,

determine when the vertical center of the product is proximate to a vertical center of the first digital image,

upon determining that the vertical center of the product is not proximate to the vertical center of the first digital image, cause the image capturing device to move along the vertical axis to a location based on the distance between the vertical center of the product and the vertical center of the first image,

cause the image capturing device to capture one or more additional digital images of the product at a plurality of image capturing angles after the image capturing device has moved to the location on the vertical axis,

while capturing the one or more additional digital images, analyzing each of the additional digital images and continuing to do so until the analyzing detects a barcode on the product,

comparing the detected barcode with one or more product barcodes, each of which is associated with one or more product images stored in the product database, and

when the detected barcode of the product matches at least one of the one or more product barcodes stored in the product database:

comparing the one or more captured additional images of the product with one or more product images associated with the matching product barcode; and

based on the comparing, identifying a product packaging change for the product over a period of time.

16. The system of claim 15 , wherein:

the workstation further comprises a turntable;

the program instructions to capture the one or more additional images of the product comprise instructions to:

rotate the turntable, which in turn rotates the product, and

capturing the one or more additional images at the plurality of capturing angles as the product rotates.

17. The system of claim 15 further comprising one or more light panels.

18. The system of claim 15 :

further comprising a laser based range sensor mounted on the camera supporting member, wherein the laser based range sensor is configured to detect a distance between the image capturing device and the product; and

wherein the program instructions comprise additional program instructions that are configured to cause the computing device to calculate a dimension of the product based on the one or more captured additional images and the detected distance between the image capturing device and the product.

19. The system of claim 15 , wherein the background wall and the working surface of the workstation intersect at a curved corner.

20. The system of claim 15 , wherein a surface of the turntable is mounted flush to the working surface of the workstation.

Assignments (4)
SECURITY INTEREST Recorded Oct 19, 2021
From: CONDUENT BUSINESS SERVICES, LLC
To: U.S. BANK, NATIONAL ASSOCIATION
Reel/Frame 057969/0445 →
SECURITY INTEREST Recorded Oct 19, 2021
From: CONDUENT BUSINESS SERVICES, LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 057970/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2021
From: SHEN, YI-TING; TWAHIR, RIYAD; WU, WENCHENG; VENABLE, DENNIS L; RIZZOLO, CHARLES D; WADE, THOMAS F; HAHN, DANIEL S; COLE, ADRIEN P
To: XEROX CORPORATION
Reel/Frame 057767/0304 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2021
From: XEROX CORPORATION
To: CONDUENT BUSINESS SERVICES, LLC
Reel/Frame 057787/0256 →