IP Library Granted Patent US 11,443,469
Granted Patent B2
US 11,443,469 · App. 16/994,273 · Granted Sep 13, 2022

System and method for reducing similar photos for display and product design

Inventor: Omer Moshe Moussaffi (Haifa, IL)
Assignee: Shutterfly, LLC
G06T11/60G06F16/51G06K9/6215G06Q30/0621G06Q30/0643G06V40/161G06V40/172G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,443,469
App. No.
16/994,273
Granted
Sep 13, 2022
Kind
B2
Abstract

A photo design smart assistant system for reducing similar photos for display and product design includes a similarity distance computation module that can calculate hash values of images and to calculate similarity distances between the images using at least the hash values, a burst grouping module that can automatically group the images into a burst based at least in part on the similarity distances of the images, wherein at least one image is automatically selected from the burst of images, an intelligent design creation engine that can automatically create a photo product design using the selected image from the burst, and a printing and finishing facility that can automatically make a physical photo product based on the photo product design.

Claims (62)

1. A computer-implemented method for reducing similar photos for display and product design, comprising:

calculating hash values of images, wherein the images includes a first image and a second image;

calculating similarity distances between the images using at least the hash values by a similarity distance computation module in the computer system;

automatically grouping the images into a burst by a burst grouping module in the computer system when the similarity distances of the images are below a burst threshold value;

designating the first image as a duplicate image if a similarity distance between the first image and the second image is below a duplicate threshold value, wherein the duplicate threshold value is smaller than the burst threshold value;

designating the first image as a new image if similarity distances between the first image and other images in the burst are above the duplicate threshold value, wherein the new image is assigned to the burst when the similarity distances between the new image and other images in the burst are below the burst threshold value;

automatically selecting at least one image from the burst of images; and

automatically creating a photo product design using the selected image from the burst by an intelligent design creation engine in the computer system.

2. The computer-implemented method of claim 1 , wherein the duplicate image is discarded before or in step of selecting at least one image from the burst of images.

3. The computer-implemented method of claim 1 , further comprising:

sequencing the images in a chronological sequence, wherein the similarity distances are calculated between adjacent images in the chronological sequence.

4. The computer-implemented method of claim 1 , wherein the images are grouped into a burst based further on at least one of image capture times or image capture locations.

5. The computer-implemented method of claim 1 , wherein the images are automatically grouped into the burst further based on image compositions, facial expressions, orientations of the faces, sizes of the faces, light exposures of the faces and persons in the image, importance of person(s) in the image, scene composition, dominant colors, color histograms, block color histograms, or cloth colors and patterns.

6. The computer-implemented method of claim 1 , wherein at least one image is automatically selected from the burst of images based on detection of faces, faces recognized presence of faces of family and close friends, or positions and focus of the faces in the image.

7. The computer-implemented method of claim 1 , further comprising:

automatically selecting a product type, a product layout, or a product style for the photo product design by the intelligent design creation engine.

8. The computer-implemented method of claim 1 , further comprising:

automatically presenting multiple images in a burst by the intelligent design creation engine for user selection of a different image from the burst in the photo product design or the photo display.

9. The computer-implemented method of claim 1 , further comprising:

automatically displaying the selected image from the burst on a device by the intelligent design creation engine.

10. The computer-implemented method of claim 1 , wherein step of calculating similarity distances comprises:

automatically calculating a Hamming Distance between hash values of the first image and the second image.

11. The computer-implemented method of claim 10 , wherein the hash values of the first image and the second image are calculated by a hashing method including pHash, Radial-Hash, or Wavelet-based hash.

12. A computer-implemented method for reducing similar photos for display and product design, comprising:

calculating hash values of images by a similarity distance computation module in a computer system, wherein the images includes a first image and a second image;

calculating similarity distances between the images using at least the hash values by a similarity distance computation module in the computer system, wherein step of calculating similarity distances further includes:

calculating differences in color densities, edge orientations, or edge densities between the images;

automatically grouping the images into a burst based at least in part on the similarity distances of the images by a burst grouping module in the computer system;

automatically selecting at least one image from the burst of images, wherein automatically selecting at least one image from the burst of images comprises:

designating the first image as a duplicate image if a similarity distance between the first image and the second image is below a duplicate threshold value, wherein the duplicate image is discarded before step of selecting and the duplicate threshold value is smaller than the burst threshold value; and

automatically creating a photo product design using the selected image from the burst by an intelligent design creation engine in the computer system.

13. The computer-implemented method of claim 12 , wherein the images are grouped into the burst when the similarity distances of the images are below a burst threshold value.

14. A computer-implemented method for reducing similar photos for display and product design, comprising:

calculating hash values of images by a similarity distance computation module in a computer system, wherein the images includes a first image and a second image;

calculating similarity distances between the images using at least the hash values by a similarity distance computation module in the computer system;

automatically grouping the images into a burst based at least in part on the similarity distances of the images by a burst grouping module in the computer system, wherein automatically grouping the images comprises:

designating the first image as a new image if similarity distances between the first image and other images in the images are above the duplicate threshold value, wherein the new image is assigned into the burst when the similarity distances between the new image and other images in the burst are below the burst threshold value;

automatically selecting at least one image from the burst of images based in part on detection of faces, faces recognized presence of faces of family and close friends, or positions and focus of the faces in the image; and

automatically creating a photo product design using the selected image from the burst by an intelligent design creation engine in the computer system.

15. The computer-implemented method of claim 14 , wherein step of automatically selecting comprises:

designating the first image as a duplicate image if a similarity distance between the first image and the second image is below a duplicate threshold value, wherein the duplicate image is discarded before step of selecting.

16. A computer-implemented method for reducing similar photos for display and product design, comprising:

calculating hash values of images, wherein the images includes a first image and a second image;

calculating similarity distances between the images using at least the hash values by a similarity distance computation module in the computer system;

automatically grouping the images into a burst by a burst grouping module in the computer system when the similarity distances of the images are below a burst threshold value, wherein the images are automatically grouped into the burst further based on image compositions, facial expressions, orientations of the faces, sizes of the faces, light exposures of the faces and persons in the image, importance of person(s) in the image, scene composition, dominant colors, color histograms, block color histograms, or cloth colors and patterns;

designating the first image as a duplicate image if a similarity distance between the first image and the second image is below a duplicate threshold value, wherein the duplicate threshold value is smaller than the burst threshold value;

automatically selecting at least one image from the burst of images; and

automatically creating a photo product design using the selected image from the burst by an intelligent design creation engine in the computer system.

17. The computer-implemented method of claim 16 , wherein the duplicate image is discarded before or in step of selecting at least one image from the burst of images.

18. The computer-implemented method of claim 16 , further comprising:

sequencing the images in a chronological sequence, wherein the similarity distances are calculated between adjacent images in the chronological sequence.

19. The computer-implemented method of claim 16 , wherein the images are grouped into a burst based further on at least one of image capture times or image capture locations.

20. The computer-implemented method of claim 16 , wherein at least one image is automatically selected from the burst of images based on detection of faces, faces recognized presence of faces of family and close friends, or positions and focus of the faces in the image.

21. The computer-implemented method of claim 16 , further comprising:

automatically selecting a product type, a product layout, or a product style for the photo product design by the intelligent design creation engine.

22. The computer-implemented method of claim 16 , further comprising:

automatically presenting multiple images in a burst by the intelligent design creation engine for user selection of a different image from the burst in the photo product design or the photo display.

23. The computer-implemented method of claim 16 , further comprising:

automatically displaying the selected image from the burst on a device by the intelligent design creation engine.

24. The computer-implemented method of claim 16 , wherein step of calculating similarity distances comprises:

automatically calculating a Hamming Distance between hash values of the first image and the second image.

25. The computer-implemented method of claim 24 , wherein the hash values of the first image and the second image are calculated by a hashing method including pHash, Radial-Hash, or Wavelet-based hash.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE RECEIVING PARTY'S NAME PREVIOUSLY RECORDED AT REEL: 60481 FRAME: 316. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 11, 2024
From: MOUSSAFFI, OMER MOSHE
To: SHUTTERFLY, INC.
Reel/Frame 069602/0700 →
SECURITY INTEREST Recorded Jun 13, 2023
From: SHUTTERFLY, LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 063934/0366 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2022
From: MOUSSAFFI, OMER MOSHE
To: SHUTTERFLY INC.
Reel/Frame 060481/0316 →
CHANGE OF NAME Recorded Jul 12, 2022
From: SHUTTERFLY INC.
To: SHUTTERFLY, LLC
Reel/Frame 060636/0963 →
Continuity (2)
Continuation In Part 15716832 · Sep 27, 2017
Related Publication 20200380748A1 · Dec 3, 2020
Cited By (1)
US 12,511,826