IP Library Granted Patent US 11,854,178
Granted Patent B2
US 11,854,178 · App. 17/070,729 · Granted Dec 26, 2023

Photography session assistant

Inventors: Leo Cyrus (Eden Prairie, MN); Keith Benson (Eden Prairie, MN)
Assignee: Shutterfly, LLC
G06T7/0002G06F3/0482G06V40/103G06V40/175H04N5/222G06T2207/30168G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,854,178
App. No.
17/070,729
Granted
Dec 26, 2023
Kind
B2
Abstract

Devices and methods for evaluating at least one photograph during a photography session are described. In some instances, a camera may be used to capture images during a photography session and a computing device may be used to identify a portrait order specification for the photography session including a set of required photographs, each having associated required criteria. The computing device may evaluate the images and determine whether the images can be associated with any of the required photographs based on features included in the images being associated with the required criteria of the required photographs. The images associated with required photographs may be displayed, and a determination of whether the images qualify as a required photograph may be made using a graphical user interface, or may be made automatically.

Claims (53)

1. A system comprising:

a display;

a processor; and

a memory storing instructions that, when executed by the processor, cause the system to:

generate and provide a user interface for presentation via the display, the user interface comprising a session status report that includes a list of photographs to be captured in a photography session and associated indicators to visually indicate whether the photographs have been captured;

receive an image of a human subject comprising at least one face captured by a camera;

evaluate the image to determine whether the image meets criteria of at least one photograph of the photographs to be captured, wherein the criteria is at least one of a facial expression or a pose;

in response to a determination that the image meets the criteria of the at least one photograph, update the session status report presented via the display, the update including an update to the associated indicator of the at least one photograph in the list to visually indicate that the at least one photograph has been captured;

in response to the session status report being updated, generate and provide a view within the user interface for presentation via the display, the view comprising the image and one or more selectable controls to enable confirmation of whether the image meets the criteria of the at least one photograph; and

receive a selection of one of the selectable controls that indicates whether the image meets the criteria of the at least one photograph.

2. The system of claim 1 , wherein the session status report further includes criteria for each photograph in the list of photographs.

3. The system of claim 1 , wherein the system is caused to update the session status report to further include a preview of the image in association with the at least one photograph in the list.

4. The system of claim 1 , wherein when the system receives one or more additional images captured by the camera that, upon evaluation, are determined to meet the criteria of the at least one photograph, the system is further caused to determine a ranking for the image and the one or more additional images.

5. The system of claim 4 , wherein the system is caused to update the session status report to further include an identifier of the ranking for each of the image and the one or more additional images in association with the at least one photograph in the list.

6. The system of claim 4 , wherein the system is caused to update the session status report to further include a preview of the highest ranking image in association with the at least one photograph in the list.

7. The system of claim 4 , wherein to determine the ranking for the image and the one or more additional images, the system is caused to:

for each of the image and the one or more additional images,

detect features of the respective image corresponding to the criteria of the at least one photograph;

determine a level of quality for each of the detected features; and

aggregate the level of quality determined for each of the detected features to generate a quality score; and

compare the quality score generated for each of the image and the one or more additional images to determine the ranking for the image and the one or more additional images.

8. The system of claim 7 , wherein the level of quality determined for one or more of the detected features is weighted.

9. The system of claim 7 , wherein the system is caused to update the session status report to further include an identifier of each of the image and the one or more additional images that exceeds one or more of a threshold ranking, a threshold level of quality, or a threshold quality score, the identifier displayed in association with the at least one photograph in the list.

10. The system of claim 1 , wherein the system is caused to update the session status report to further include one or more of an identifier and a preview of the image in association with the at least one photograph in the list, and the view is generated and provided in response to a selection of the one or more of the identifier or the preview of the image.

11. The system of claim 1 , wherein responsive to receiving one or more additional images that, upon evaluation, are determined to meet the criteria of the at least one photograph, the view comprises each of the image and the one or more additional images in a single view.

12. The system of claim 1 , wherein the system is further caused to:

in response to receiving a selection of one of the selectable controls that indicates the image does not meet the criteria of the at least one photograph, reversing the update to the associated indicator of the at least one photograph in the list to visually indicate that the at least one photograph has not been captured.

13. The system of claim 1 , wherein the system is a mobile computing device, the camera is a camera of the mobile computing device, and the display is a screen of the mobile computing device.

14. A method comprising:

generating a user interface for display during a photography session, the user interface comprising a session status report that includes a list of photographs to be captured in the photography session and associated indicators to visually indicate whether the photographs have been captured;

receiving an image of a human subject comprising at least one face captured by a camera;

evaluating the image to determine whether the image meets criteria of at least one photograph of the photographs to be captured, wherein the criteria is at least one of a facial expression or a pose;

in response to a determination that the image meets the criteria of the at least one photograph, updating, within the session status report, the associated indicator of the at least one photograph in the list to visually indicate that the at least one photograph has been captured

in response to the session status report being updated, generating and providing a view within the user interface, the view comprising the image and one or more selectable controls to enable confirmation of whether the image meets the criteria of the at least one photograph; and

receiving a selection of one of the selectable controls that indicates whether the image meets the criteria of the at least one photograph.

15. The method of claim 14 , wherein evaluating the image further comprises:

detecting one or more features of the image;

determining whether the one or more features of the image are associated with the criteria of the at least one photograph of the photographs to be captured during the photography session; and

determining a level of quality of each of the one or more features of the image determined to be associated with the criteria of the at least one photograph.

16. The method of claim 14 , further comprising:

during the photography session, determining that images meeting criteria of one or more photographs from the list of photographs have not been captured; and

in response to the determination, displaying a prompt to capture images that meet the criteria of the one or more of photographs in order to complete the photography session.

17. The method of claim 14 , further comprising:

receiving a photograph specification that includes the photographs to be captured during the photography session and criteria of each of the photographs; and

generating the session status report based on the received photograph specification.

18. The method of claim 17 , wherein receiving the photograph specification comprises:

displaying a plurality of photograph specifications, including the photograph specification, in the user interface; and

receiving a selection of the photograph specification via the user interface.

19. A computer readable storage medium storing instructions that, when executed by a processor, cause the processor to:

generate a user interface for display, the user interface comprising a session status report that includes a list of photographs of a human subject comprising at least one face to be captured in a photography session and associated indicators to visually indicate whether the photographs have been captured;

in response to a determination that an image captured in the photography session meets criteria of at least one photograph of the photographs to be captured, update, within the displayed session status report, the associated indicator of the at least one photograph in the list to visually indicate that the at least one photograph has been captured, wherein the criteria is at least one of a facial expression or a pose;

in response to the session status report being updated, generate and provide a view within the user interface, the view comprising the image and one or more selectable controls to enable confirmation of whether the image meets the criteria of the at least one photograph; and

receive a selection of one of the selectable controls that indicates whether the image meets the criteria of the at least one photograph.

Assignments (5)
SECURITY INTEREST Recorded Jun 20, 2024
From: SHUTTERFLY, LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 067788/0387 →
SECURITY INTEREST Recorded Jun 13, 2023
From: SHUTTERFLY, LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 063934/0366 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2020
From: CYRUS, LEO; BENSON, KEITH
To: LIFETOUCH INC.
Reel/Frame 054056/0719 →
MERGER Recorded Oct 14, 2020
From: LIFETOUCH, LLC
To: SHUTTERFLY, LLC
Reel/Frame 054056/0809 →
CHANGE OF NAME Recorded Oct 14, 2020
From: LIFETOUCH INC.
To: LIFETOUCH, LLC
Reel/Frame 054084/0383 →