IP Library Granted Patent US 11,423,558
Granted Patent B2
US 11,423,558 · App. 17/329,278 · Granted Aug 23, 2022

System for assembling composite group image from individual subject images

Inventors: Keith A. Benson (Eden Prairie, MN); Brent Peterson (Chanhassen, MN)
Assignee: Shutterfly, LLC
G06T7/521G01B11/25G03B15/02H04N5/2256H04N13/254
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,423,558
App. No.
17/329,278
Granted
Aug 23, 2022
Kind
B2
Abstract

A system for assembling a group composite image from individual subject images is described. Often subjects of a group vary in height. Additionally, as each subject is photographed individually, different zoom factors can be applied by a camera that affects a pixel density of the image captured. The system includes a fiducial marking device that emits collimated light to form one or more fiducial markers on a subject while an image is captured by the camera. Based on a location of the fiducial markers in the image, a pixel density of the image and a reference height of the subject can be determined. The individual subject image can be scaled based on the pixel density and reference height to account for the varying subject heights and zoom factors to generate a group composite image that accurately represents the subjects of the group relative to one another.

Claims (35)

1. A computer-implemented method comprising:

receiving a fiducially marked image of a subject that is captured by a camera while the subject is illuminated with at least a first collimated light and a second collimated light parallel to the first collimated light, the fiducially marked image including a first fiducial marker formed on the subject by the first collimated light and a second fiducial marker formed on the subject by the second collimated light;

determining a first location of the first fiducial marker;

determining a second location of the second fiducial marker;

determining a pixel density of the fiducially marked image and a reference height of the subject based on the first location, the second location, and a compensation for a three-dimensional shape of the subject;

receiving at least one other image of the subject captured by the camera; and

generating a photography product using the at least one other image, the pixel density of the fiducially marked image, and the reference height of the subject.

2. The method of claim 1 , wherein determining the first location of the first fiducial marker and the second location of the second fiducial marker further comprises:

creating a new image;

for each pixel of a plurality of pixels in the new image, setting a value of the pixel to a first value or a second value based on a set of conditions associated with values of the pixel in a set of images that include the fiducially marked image;

resetting the value of one or more pixels having the first value that are surrounded by pixels having the second value to the second value;

identifying clusters from remaining pixels having the first value, a first cluster of pixels corresponding to the first fiducial marker and a second cluster of pixels corresponding to the second fiducial marker; and

determining a first horizontal pixel location and a first vertical pixel location at a center of the first cluster as the first location of the first fiducial marker and a second horizontal pixel location and a second vertical pixel location at a center of the second cluster as the second location of the second fiducial marker.

3. The method of claim 1 , wherein the compensation for the three-dimensional shape of the subject accounts for a location shift of at least one of the first fiducial marker and the second fiducial marker included in the fiducially marked image due to the three-dimensional shape of the subject.

4. The method of claim 1 , wherein:

the first location of the first fiducial marker comprises a first horizontal pixel location and a first vertical pixel location,

the second location of the second fiducial marker comprises a second horizontal pixel location and a second vertical pixel location, and

the compensation is based on at least one of:

a relative horizontal pixel location of the first fiducial marker and the second fiducial marker, and

a tilt angle of the camera.

5. The method of claim 4 , further comprising:

determining the pixel density of the fiducially marked image based on a coefficient dependent on the first horizontal pixel location relative to the second horizontal pixel location and a vertical distance between the first collimated light and the second collimated light emitted to illuminate the subject.

6. The method of claim 4 , further comprising:

when the first horizontal pixel location is less than or equal to the second horizontal pixel location, determining the reference height of the subject based on the first vertical pixel location, the first horizontal pixel location, the second horizontal pixel location, and the tilt angle of the camera.

7. The method of claim 4 , further comprising:

when the first horizontal pixel location is greater than the second horizontal pixel location, determining the reference height of the subject as the first vertical pixel location.

8. A system comprising:

at least one processor; and

a memory coupled to the at least one processor and storing instructions that, when executed by the at least one processor, cause the at least one processor to:

receive a fiducially marked image of a subject that is captured by a camera while the subject is illuminated with a first collimated light and a second collimated light parallel to the first collimated light, the fiducially marked image including a first fiducial marker formed on the subject by the first collimated light and a second fiducial marker formed on the subject by the second collimated light;

determine a first location of the first fiducial marker;

determine a second location of the second fiducial marker;

determine a pixel density of the fiducially marked image and a reference height of the subject based on the first location, the second location, and a compensation for a three-dimensional shape of the subject;

receive at least one other image of the subject captured by the camera; and

generate a photography product using the at least one other image, the pixel density of the fiducially marked image, and the reference height of the subject.

Assignments (3)
SECURITY INTEREST Recorded Jun 22, 2026
From: SNAPFISH, LLC; SHUTTERFLY, LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 075800/0581 →
SECURITY INTEREST Recorded Jun 13, 2023
From: SHUTTERFLY, LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 063934/0366 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2021
From: BENSON, KEITH A.; PETERSON, BRENT
To: SHUTTERFLY, LLC
Reel/Frame 057079/0193 →
Continuity (2)
Continuation 16731190 · Dec 31, 2019
Related Publication 20210350558A1 · Nov 11, 2021