IP Library › Granted Patent US 11,164,300
Granted Patent B2
US 11,164,300 · App. 16/548,162 · Granted Nov 2, 2021

System and method for automated electronic catalogue management and electronic image quality assessment

Inventors: Mani Kanteswara Garlapati (Bangalore, IN); Souradip Chakraborty (Bengaluru, IN); Rajesh Shreedhar Bhat (Kumta, IN)
Assignee: Walmart Apollo, LLC
G06T7/0002G06K9/6215G06K9/6255G06Q30/0603G06T5/002G06T7/70G06T2207/20081G06T2207/20084G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,164,300
App. No.
16/548,162
Granted
Nov 2, 2021
Kind
B2
Abstract

Systems, methods, and computer-readable storage media for cataloguing and assessing images. This is performed by a system which receives images of an item, and identifying, within each image, the item. The system performs a structural similarity analysis of the item and for each image applies a plurality of distortions, such that for each image in the images multiple distorted images are generated. The system identifies within the distorted images at least one feature and applies a regression model to the images using the at least one feature and the structural similarity score.

Claims (44)

1. A method comprising:

receiving a plurality of electronic images of an item;

identifying, via a processor configured to perform image analysis, and within each image in the plurality of images, the item;

performing, via the processor, a structural similarity analysis of the item, to yield a structural similarity score;

for each image in the plurality of images applying, via the processor, a plurality of distortions, such that for each image in the plurality of images a plurality of distorted images are generated;

identifying, via the processor, within the plurality of distorted images associated with each image in the plurality of images, at least one feature; and

applying, via the processor, a regression model to the plurality of images using the at least one feature and the structural similarity score.

2. The method of claim 1 , further comprising:

ordering, via the processor, the plurality of images based on applying the regression model to the plurality of images.

3. The method of claim 1 , wherein the plurality of distortions comprises a mean blur, a Gaussian blur, and a bilateral blur.

4. The method of claim 1 , wherein the regression model is a ridge regression.

5. The method of claim 1 , wherein the structural similarity identifies at least luminance, contrast, and structure of the item.

6. The method of claim 1 , wherein the plurality of images comprises a front image, a side image, and a back view of the item.

7. The method of claim 1 , further comprising: training a convolution neural network using the at least one feature, to yield a trained convolution neural network; and using the trained convolution neural network during the applying of the regression model to the plurality of images.

8. A system, comprising:

a processor configured to perform image analysis; and

a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising:

receiving a plurality of electronic images of an item;

identifying, within each image in the plurality of images, the item;

performing a structural similarity analysis of the item, to yield a structural similarity score;

for each image in the plurality of images applying a plurality of distortions, such that for each image in the plurality of images a plurality of distorted images are generated;

identifying within the plurality of distorted images associated with each image in the plurality of images, at least one feature; and

applying a regression model to the plurality of images using the at least one feature and the structural similarity score.

9. The system of claim 8 , the computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising:

ordering the plurality of images based on applying the regression model to the plurality of images.

10. The system of claim 8 , wherein the plurality of distortions comprises a mean blur, a Gaussian blur, and a bilateral blur.

11. The system of claim 8 , wherein the regression model is a ridge regression.

12. The system of claim 8 , wherein the structural similarity identifies at least luminance, contrast, and structure of the item.

13. The system of claim 8 , wherein the plurality of images comprises a front image, a side image, and a back view of the item.

14. The system of claim 8 , the computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising:

training a convolution neural network using the at least one feature, to yield a trained convolution neural network; and

using the trained convolution neural network during the applying of the regression model to the plurality of images.

15. A non-transitory computer-readable storage medium having instructions stored which, when executed by a computing device configured to perform image processing, cause the computing device to perform operations comprising:

receiving a plurality of electronic images of an item; identifying, within each image in the plurality of images, the item;

performing a structural similarity analysis of the item, to yield a structural similarity score;

for each image in the plurality of images applying a plurality of distortions, such that for each image in the plurality of images a plurality of distorted images are generated;

identifying within the plurality of distorted images associated with each image in the plurality of images, at least one feature; and

applying a regression model to the plurality of images using the at least one feature and the structural similarity score.

16. The non-transitory computer-readable storage medium of claim 15 , having instructions stored which, when executed by the computing device, cause the computing device to perform operations comprising:

ordering the plurality of images based on applying the regression model to the plurality of images.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the plurality of distortions comprises a mean blur, a Gaussian blur, and a bilateral blur.

18. The non-transitory computer-readable storage medium of claim 15 , wherein the regression model is a ridge regression.

19. The non-transitory computer-readable storage medium of claim 15 , wherein the structural similarity identifies at least luminance, contrast, and structure of the item.

20. The non-transitory computer-readable storage medium of claim 15 , wherein the plurality of images comprises a front image, a side image, and a back view of the item.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2019
From: GARLAPATI, MANI KANTESWARA; CHAKRABORTY, SOURADIP; BHAT, RAJESH SHREEDHAR
To: WALMART APOLLO, LLC
Reel/Frame 050583/0955 →
Priority Claims (1)
IN 201811031632 · Aug 23, 2018 · national
Continuity (2)
Provisional Application 62778962 · Dec 13, 2018
Related Publication 20200065955A1 · Feb 27, 2020