IP Library Granted Patent US 9,251,394
Granted Patent B2
US 9,251,394 · App. 13/440,754 · Granted Feb 2, 2016

System and method for estimating/determining the date of a photo

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,251,394
App. No.
13/440,754
Granted
Feb 2, 2016
Kind
B2
Abstract

Undated photos are organized by estimating the date of each photo. The date is estimated by building a model based on a set of reference photos having established dates, and comparing image characteristics of the undated photo to the image characteristics of the reference photos. The photo characteristics can include hues, saturation, intensity, contrast, sharpness and graininess as represented by image pixel data. Once the date of a photo is estimated, it can be tagged with identifying information, such as by using the estimated date to associate the photo with a node in a family tree.

Claims (33)

1. A method of identifying a photo, comprising:

displaying, by a processor, a photo at a user interface;

estimating, by the processor, an image capture date of the displayed photo, comprising:

identifying, by the processor, image characteristics of the displayed photo from pixel data representing the image in the displayed photo;

comparing, by the processor, the image characteristics of the displayed photo to image characteristics corresponding to a plurality of reference photos, each of the plurality of reference photos having an established date; and

estimating, by the processor, the date of the displayed photo based on a similarity of the image characteristics of the displayed photo to one or more of the image characteristics of the reference photos, wherein the image characteristics are represented by frequency domain data and comprise graininess, and wherein graininess is determined by the frequency of Fourier series signals represented across the image in the displayed photo;

displaying at the user interface, by the processor, a data structure having a plurality of data nodes, each data node representing one or more data records having a subject associated with one or more dates;

determining, by the processor, whether there is a relationship between the displayed photo and a data record at one or more of the data nodes, based on the estimated date of the displayed photo;

identifying at the displayed data structure, by the processor, one or more data nodes that have a relationship to the displayed photo based on the dates associated with the subject of the one or more data nodes;

displaying, by the processor, a tagging data entry window at the user interface for receiving tagging information from a user viewing the displayed photo and the displayed data structure; and

receiving, by the processor, tagging information at the tagging data entry window at the user interface concerning the displayed photo based on the identified one or more data nodes.

2. The method of claim 1 , wherein the data structure is a family tree, and wherein the subject of each node is a person.

3. The method of claim 2 , wherein the displayed photo and the family tree are displayed together at the user interface.

4. A system of identifying a photo, comprising one or more processors programmed to:

display a photo at a user interface;

estimate an image capture date of the displayed photo, by:

identifying image characteristics of the displayed photo from pixel data representing the image in the displayed photo, wherein the image characteristics are represented by frequency domain data and comprise graininess, and wherein graininess is determined by the frequency of Fourier series signals represented across the image in the displayed photo;

comparing the image characteristics of the displayed photo to image characteristics of a plurality of reference photos, each of the plurality of reference photos having an established date; and

estimating the date of the displayed photo based on a similarity of the image characteristics of the displayed photo to one or more of the image characteristics of the reference photos;

display at the user interface a data structure having a plurality of data nodes, each data node representing one or more data records having a subject associated with one or more dates;

determine whether there is a relationship between the displayed photo and a data record at one or more of the data nodes, based on the estimated date of the displayed photo;

identify at the displayed data structure one or more data nodes that have a relationship to the displayed photo based on the dates associated with the subject of the one or more data nodes;

display a tagging data entry window at the user interface for receiving tagging information from a user viewing the displayed photo and the displayed data structure; and

receive tagging information at the tagging data entry window at the user interface concerning the displayed photo based on the identified one or more data nodes.

5. The system of claim 4 , wherein the data structure is a family tree, and wherein the subject of each node is a person.

6. The system of claim 5 , wherein the one or more processors are further programmed to display the displayed photo and the family tree together at the user interface.

7. The method of claim 1 , wherein identifying image characteristics of the displayed photo comprises calculating an average graininess of the displayed photo based on the frequency of Fourier series signals represented across the image in the displayed photo.

8. The method of claim 1 , wherein the plurality of reference photos comprise photos stored in a database system maintaining family trees and having information associated with dates that the stored photos were taken.

9. The method of claim 1 , wherein the data structure having a plurality of data nodes comprises a family tree, with each data node in the family tree associated with a person, and wherein the method further comprises:

storing the displayed photo as a data record at the one or more identified data nodes that have a determined relationship to the displayed photo.

10. The method of claim 1 , wherein the data structure having a plurality of data nodes comprises a family tree, with each data node in the family tree associated with a person, and wherein identifying one or more data nodes that have a relationship to the displayed photo further comprises:

graphically identifying, in the family tree, persons associated with data nodes that were alive on the estimated date of the displayed photo.

11. The method of claim 1 , wherein receiving tagging information at the tagging data entry window further comprises automatically populating the tagging data entry window with tagging information representing the estimated date of the displayed photo.

Assignments (11)
RELEASE OF FIRST LIEN SECURITY INTEREST Recorded Dec 7, 2020
From: JPMORGAN CHASE BANK, N.A.
To: ANCESTRY.COM OPERATIONS INC.; IARCHIVES, INC.; ANCESTRY.COM DNA, LLC; ANCESTRYHEALTH.COM, LLC; ADPAY, INC.
Reel/Frame 054618/0298 →
SECURITY INTEREST Recorded Dec 7, 2020
From: ANCESTRY.COM DNA, LLC; ANCESTRY.COM OPERATIONS INC.; IARCHIVES, INC.; ANCESTRYHEALTH.COM, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054627/0212 →
SECURITY INTEREST Recorded Dec 7, 2020
From: ANCESTRY.COM DNA, LLC; ANCESTRY.COM OPERATIONS INC.; IARCHIVES, INC.; ANCESTRYHEALTH.COM, LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 054627/0237 →
RELEASE OF SECURITY INTEREST Recorded Nov 29, 2017
From: DEUTSCHE BANK AG NEW YORK BRANCH
To: ANCESTRY.COM LLC; ANCESTRY US HOLDINGS INC.; ANCESTRY.COM INC.; ANCESTRY.COM OPERATIONS INC.
Reel/Frame 044529/0025 →
SECOND LIEN SECURITY AGREEMENT Recorded Oct 24, 2016
From: ANCESTRY.COM OPERATIONS INC.; IARCHIVES, INC.; ANCESTRY.COM DNA, LLC; ANCESTRYHEALTH.COM, LLC; ADPAY, INC.
To: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
Reel/Frame 040259/0978 →
FIRST LIEN SECURITY AGREEMENT Recorded Oct 21, 2016
From: ANCESTRY.COM OPERATIONS INC.; IARCHIVES, INC.; ANCESTRY.COM DNA, LLC; ANCESTRYHEALTH.COM, LLC; ADPAY, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 040449/0663 →
RELEASE OF SECURITY INTEREST Recorded Oct 20, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ANCESTRY.COM OPERATIONS INC.; ANCESTRY.COM DNA, LLC; IARCHIVES, INC.
Reel/Frame 040424/0354 →
SECURITY AGREEMENT Recorded Sep 1, 2015
From: ANCESTRY.COM OPERATIONS INC.; IARCHIVES, INC.; ANCESTRY.COM DNA, LLC
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 036519/0853 →
RELEASE (REEL 029537/ FRAME 0064) Recorded Aug 31, 2015
From: BARCLAYS BANK PLC
To: ANCESTRY.COM OPERATIONS INC.; ANCESTRY.COM DNA, LLC; IARCHIVES, INC.
Reel/Frame 036514/0816 →
PATENT SECURITY AGREEMENT Recorded Dec 28, 2012
From: ANCESTRY.COM OPERATIONS INC.; ANCESTRY.COM DNA, LLC; IARCHIVES, INC.
To: BARCLAYS BANK PLC, COLLATERAL AGENT
Reel/Frame 029537/0064 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2012
From: BROOKHART, CHRIS; REESE, JACK
To: ANCESTRY.COM OPERATIONS INC.
Reel/Frame 028164/0480 →