IP Library Granted Patent US 11,113,572
Granted Patent B2
US 11,113,572 · App. 16/672,227 · Granted Sep 7, 2021

Systems, methods, and storage media for evaluating images

Inventors: Jehan Hamedi (South Boston, MA); Zachary Halloran (Braintree, MA); Elham Saraee (Jamaica Plain, MA)
Assignee: Vizit Labs, Inc.
G06K9/6256G06K9/46G06K9/6201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,113,572
App. No.
16/672,227
Granted
Sep 7, 2021
Kind
B2
Abstract

Embodiments may: select a set of training images; extract a first set of features from each training image of the set of training images to generate a first feature tensor for each training image; extract a second set of features from each training image to generate a second feature tensor for each training image; reduce a dimensionality of each first feature tensor to generate a first modified feature tensor for each training image; reduce a dimensionality of each second feature tensor to generate a second modified feature tensor for each training image; construct a first generative model representing the first set of features and a second generative model representing the second set of features of the set of training images; identify a first candidate image; and apply a regression algorithm to the first candidate image and each of the first generative model and the second generative model to determine whether the first candidate image is similar to the set of training images.

Claims (65)

1. A system comprising:

one or more hardware processors including machine-readable instructions to:

identify a first image;

extract a first set of features from the first image to generate a first feature tensor for the first image;

extract a second set of features from the first image to generate a second feature tensor for the first image;

identify a second image;

extract a third set of features from the second image to generate a third feature tensor for the second image;

extract a fourth set of features from the second image to generate a fourth feature tensor for the second image;

apply a first regression analysis to determine a first geometrical distance between the first feature tensor of the first image and the third feature tensor of the second image;

apply a second regression analysis to determine a second geometrical distance between the second feature tensor of the first image and the fourth feature tensor of the second image; and

determine a similarity between the first image and the second image based on the first geometrical distance and the second geometrical distance.

2. The system of claim 1 , wherein the one or more hardware processors further include machine-readable instructions to calculate a similarity score representing a degree of visual similarity between the first image and the second image.

3. The system of claim 2 , wherein the one or more hardware processors further include machine-readable instructions to calculate a uniqueness score of the first image with respect to the second image.

4. The system of claim 3 , wherein the one or more hardware processors further include machine-readable instructions to calculate the uniqueness score of the first image by:

calculating an inverse of the similarity score; and

identifying the inverse as the uniqueness score.

5. The system of claim 1 , wherein the one or more hardware processors further include machine-readable instructions to reduce a dimensionality of the first feature tensor prior to applying the first regression analysis to determine the first geometrical distance between the first feature tensor of the first image and the third feature tensor of the second image.

6. The system of claim 5 , wherein the one or more hardware processors further include machine-readable instructions to apply a weight to the first set of features extracted from the first image to generate a set of weighted first features, wherein the first feature tensor is generated based on the set of weighted first features.

7. The system of claim 1 , wherein:

the first set of features extracted from the first image comprises object features; and

the one or more hardware processors further include machine-readable instructions to extract the first set of features from the first image by:

propagating data corresponding to the first image through at least one network including at least one of an object detection neural network, an object classification neural network, or an object recognition neural network, wherein the network comprises an input layer, a plurality of intermediate layers, and an output layer; and

extracting outputs from at least one of the plurality of intermediate layers of the network.

8. The system of claim 1 , wherein the one or more hardware processors further include machine-readable instructions to extract the first set of features from the first image by extracting at least one of a set of object features, a set of scene features, a set of intensity features, a set of contrast features, a set of color features, and a set of blurriness features from the first image.

9. A method comprising:

identifying a first image;

extracting a first set of features from the first image to generate a first feature tensor for the first image;

extracting a second set of features from the first image to generate a second feature tensor for the first image;

identifying a second image;

extracting a third set of features from the second image to generate a third feature tensor for the second image;

extracting a fourth set of features from the second image to generate a fourth feature tensor for the second image;

applying a first regression analysis to determine a first geometrical distance between the first feature tensor of the first image and the third feature tensor of the second image;

applying a second regression analysis to determine a second geometrical distance between the second feature tensor of the first image and the fourth feature tensor of the second image; and

determining a similarity between the first image and the second image based on the first geometrical distance and the second geometrical distance.

10. The method of claim 9 , further comprising calculating a similarity score representing a degree of visual similarity between the first image and the second image.

11. The method of claim 10 , further comprising calculating a uniqueness score of the first image with respect to the second image.

12. The method of claim 11 , wherein calculating the uniqueness score of the first image comprises:

calculating an inverse of the similarity score; and

identifying the inverse as the uniqueness score.

13. The method of claim 9 , further comprising reducing a dimensionality of the first feature tensor prior to applying the first regression analysis to determine the first geometrical distance between the first feature tensor of the first image and the third feature tensor of the second image.

14. The method of claim 13 , further comprising applying a weight to the first set of features extracted from the first image to generate a set of weighted first features, wherein the first feature tensor is generated based on the set of weighted first features.

15. The method of claim 9 , wherein the first set of features extracted from the first image comprises object features, and extracting the first set of features from the first image comprises:

propagating data corresponding to the first image through at least one network including at least one of an object detection neural network, an object classification neural network, or an object recognition neural network, wherein the network comprises an input layer, a plurality of intermediate layers, and an output layer; and

extracting outputs from at least one of the plurality of intermediate layers of the network.

16. The method of claim 9 , wherein extracting the first set of features from the first image comprises extracting at least one of a set of object features, a set of scene features, a set of intensity features, a set of contrast features, a set of color features, and a set of blurriness features from the first image.

17. A non-transitory computer-readable storage medium having instructions embodied thereon, the instructions being executable by one or more processors to perform a method comprising:

identifying a first image;

extracting a first set of features from the first image to generate a first feature tensor for the first image;

extracting a second set of features from the first image to generate a second feature tensor for the first image;

identifying a second image;

extracting a third set of features from the second image to generate a third feature tensor for the second image;

extracting a fourth set of features from the second image to generate a fourth feature tensor for the second image;

applying a first regression analysis to determine a first geometrical distance between the first feature tensor of the first image and the third feature tensor of the second image;

applying a second regression analysis to determine a second geometrical distance between the second feature tensor of the first image and the fourth feature tensor of the second image; and

determining a similarity between the first image and the second image based on the first geometrical distance and the second geometrical distance.

18. The computer-readable storage medium of claim 17 , wherein the method further comprises:

calculating a similarity score representing a degree of visual similarity between the first image and the second image;

calculating an inverse of the similarity score; and

identifying the inverse as a uniqueness score of the first image with respect to the second image.

19. The computer-readable storage medium of claim 17 , wherein the method further comprises:

reducing a dimensionality of the first feature tensor prior to applying the first regression analysis to determine the first geometrical distance between the first feature tensor of the first image and the third feature tensor of the second image; and

applying a weight to the first set of features extracted from the first image to generate a set of weighted first features, wherein the first feature tensor is generated based on the set of weighted first features.

20. The computer-readable storage medium of claim 17 , wherein the first set of features extracted from the first image comprises object features, and extracting the first set of features from the first image comprises:

propagating data corresponding to the first image through at least one network including at least one of an object detection neural network, an object classification neural network, or an object recognition neural network, wherein the network comprises an input layer, a plurality of intermediate layers, and an output layer; and

extracting outputs from at least one of the plurality of intermediate layers of the network.

Assignments (2)
CHANGE OF NAME Recorded Aug 3, 2021
From: ADHARK, INC.
To: VIZIT LABS, INC.
Reel/Frame 057063/0122 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2020
From: HAMEDI, JEHAN; HALLORAN, ZACHARY; SARAEE, ELHAM
To: ADHARK, INC.
Reel/Frame 052882/0696 →
Continuity (2)
Division 16271780 · Feb 8, 2019
Related Publication 20200257938A1 · Aug 13, 2020