IP Library Granted Patent US 11,405,539
Granted Patent B2
US 11,405,539 · App. 16/920,211 · Granted Aug 2, 2022

Background replacement system and methods

Inventor: Keith A. Benson (Eden Prairie, MN)
Assignee: SHUTTERFLY, LLC
H04N5/2256G06T7/11G06T7/194G06V10/141G06V10/751H04N5/2354G06T2207/10152
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,405,539
App. No.
16/920,211
Granted
Aug 2, 2022
Kind
B2
Abstract

A method of illuminating a subject during photography is disclosed. The method includes illuminating a background lighting system during a first image capture, illuminating a subject lighting system during a second image capture, and illuminating the background lighting system during a third image capture. The time from the first image capture to the third image capture is less than about 100 milliseconds. Also disclosed is a method for generating a composite mask of a subject, including receiving the three images, determining any movements of the subject between the first and third images, estimating an intermediate position of the subject during the second image, and generating a composite mask at the estimated intermediate position.

Claims (67)

1. A method of illuminating a subject during a photography session, the method comprising:

receiving an image capture signal; and

in response to receiving the image capture signal, initiating an illumination sequence for a single image capture sequence, including:

initiating an illumination of a background using a background lighting system while a first image is captured;

initiating an illumination of the subject using a main light of a subject lighting system while a second image is captured; and

initiating an illumination of the background using the background lighting system while a third image is captured.

2. The method of claim 1 , wherein a new image is generated from the first image, the second image, and the third image.

3. The method of claim 1 , wherein initiating the illumination sequence for the single image capture sequence further includes initiating an illumination of the background using the background lighting system while a fourth image is captured.

4. The method of claim 1 , wherein initiating the illumination sequence for the single image capture sequence further includes initiating the illumination of the subject while a fourth image is captured by illuminating the subject using a fill light of the subject lighting system.

5. The method of claim 1 , wherein initiating the illumination sequence for the single image capture sequence further includes initiating an ambient lighting condition while a fourth image is captured.

6. The method of claim 5 , wherein the ambient lighting condition is an illumination without using the subject lighting system or the background lighting system.

7. The method of claim 1 , wherein the background lighting system is not illuminated when the second image is captured.

8. The method of claim 1 , wherein the subject lighting system is not illuminated when the first image is captured and when the third image is captured.

9. The method of claim 1 , wherein the illumination sequence for the single image capture sequence is for a single pose of the subject.

10. A photography system for capturing multiple images of a subject, the photography system comprising:

a controller;

a camera that captures at least a first image, a second image, and a third image; and

a lighting system synchronized by the controller, the lighting system including:

a background lighting system in communication with the controller; and

a subject lighting system in communication with the controller;

wherein the controller includes a non-transitory storage medium and one or more processors, the non-transitory storage medium storing instructions that, when executed by the one or more processors, cause the controller to:

receive an image capture signal;

initiate an illumination of a background using the background lighting system while the camera captures the first image;

initiate an illumination of the subject using the subject lighting system while the camera captures the second image;

initiate an illumination of the background using the background lighting system while the camera captures the third image; and

initiate an illumination of the background using the background lighting system while the camera captures a fourth image.

11. The photography system of claim 10 , further comprising a light block positioned relative to the background lighting system and the subject such that the light block prevents light emitted from the background lighting system from illuminating the subject while the camera captures the first image and the third image.

12. The photography system of claim 10 , wherein a time difference between the capture of the first image and the second image and a time difference between the capture of the second image and the third image are equal.

13. The photography system of claim 10 , further comprising an image processing system that generates a new image from the first image, the second image, and the third image.

14. The photography system of claim 13 , wherein, to generate the new image, the image processing system generates a composite mask using the first image and the third image, overlays the composite mask onto the second image to remove a background from the second image, and inserts a new background into the second image.

15. A method of illuminating a subject during a photography session, the method comprising:

receiving an image capture signal; and

in response to receiving the image capture signal, initiating an illumination sequence for a single image capture sequence, including:

initiating an illumination of the subject using a main light of a subject lighting system—while a first image is captured;

initiating an illumination of a background using a background lighting system while a second image is captured; and

initiating an illumination of the subject using a fill light of the subject lighting system while a third image is captured.

16. The method of claim 15 , wherein the background lighting system is not illuminated when the first image is captured and when the third image is captured.

17. The method of claim 15 , wherein the subject lighting system is not illuminated when the second image is captured.

18. The method of claim 15 , wherein initiating the illumination sequence for the single image capture sequence further includes initiating an illumination condition while a fourth image is captured, wherein the illumination condition is one of an illumination of the background using the background lighting system and an ambient lighting condition.

19. A method of illuminating a subject during a photography session, the method comprising:

receiving an image capture signal; and

in response to receiving the image capture signal, initiating an illumination sequence for a single image capture sequence, including:

initiating an illumination of a background using a background lighting system while a first image is captured;

initiating an illumination of the subject using a subject lighting system while a second image is captured;

initiating an illumination of the background using the background lighting system while a third image is captured; and

initiating an ambient lighting condition while a fourth image is captured.

20. A method of illuminating a subject during a photography session, the method comprising:

receiving an image capture signal; and

in response to receiving the image capture signal, initiating an illumination sequence for a single image capture sequence, including:

initiating an illumination of a background using a background lighting system while a first image is captured;

initiating an illumination of the subject using a subject lighting system while a second image is captured; and

initiating an illumination of the background using the background lighting system while a third image is captured,

wherein the background lighting system is not illuminated when the second image is captured.

21. A method of illuminating a subject during a photography session, the method comprising:

receiving an image capture signal; and

in response to receiving the image capture signal, initiating an illumination sequence for a single image capture sequence, including:

initiating an illumination of a background using a background lighting system while a first image is captured;

initiating an illumination of the subject using a subject lighting system while a second image is captured; and

initiating an illumination of the background using the background lighting system while a third image is captured,

wherein the subject lighting system is not illuminated when the first image is captured and when the third image is captured.

22. A method of illuminating a subject during a photography session, the method comprising:

receiving an image capture signal; and

in response to receiving the image capture signal, initiating an illumination sequence for a single image capture sequence, including:

initiating an illumination of the subject using a subject lighting system—while a first image is captured;

initiating an illumination of a background using a background lighting system while a second image is captured;

initiating an illumination of the subject using the subject lighting system while a third image is captured; and

initiating an illumination condition while a fourth image is captured, wherein the illumination condition is one of: an illumination of the background using the background lighting system and an ambient lighting condition.

Assignments (5)
SECURITY INTEREST Recorded Jun 13, 2023
From: SHUTTERFLY, LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 063934/0366 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE ASSIGNEE ADDRESS PREVIOUSLY RECORDED AT REEL: 053779 FRAME: 0214. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 23, 2022
From: LIFETOUCH, LLC
To: SHUTTERFLY, LLC
Reel/Frame 060438/0288 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2020
From: BENSON, KEITH A.
To: LIFETOUCH INC.
Reel/Frame 053779/0120 →
MERGER Recorded Sep 15, 2020
From: LIFETOUCH, LLC
To: SHUTTERFLY, LLC
Reel/Frame 053779/0214 →
CHANGE OF NAME Recorded Sep 15, 2020
From: LIFETOUCH INC.
To: LIFETOUCH, LLC
Reel/Frame 053785/0196 →