IP Library Granted Patent US 9,400,942
Granted Patent B2
US 9,400,942 · App. 14/988,135 · Granted Jul 26, 2016

System and method for estimating/determining the date of a photo

Inventors: Christopher Brookhart (Lehi, UT); Jack Reese (Lindon, UT)
Assignee: Ancestry.com Operations Inc.
G06K9/6202G06F17/3028G06F17/30247G06F17/30268G06K9/627G06K9/6215G06K9/6255G06F17/30056
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,400,942
App. No.
14/988,135
Granted
Jul 26, 2016
Kind
B2
Abstract

Undated photos are organized by estimating the date of each photo. The date is estimated by building a model based on a set of reference photos having established dates, and comparing image characteristics of the undated photo to the image characteristics of the reference photos. The photo characteristics can include hues, saturation, intensity, contrast, sharpness and graininess as represented by image pixel data. Once the date of a photo is estimated, it can be tagged with identifying information, such as by using the estimated date to associate the photo with a node in a family tree.

Claims (26)

1. A method for estimating an image capture date of a photo, comprising:

identifying, by a processor, image characteristics of an undated photo;

comparing, by the processor, the image characteristics of the undated photo to image characteristics relating to a plurality of reference photos, each of the plurality of reference photos having an established date, wherein the compared image characteristics comprise graininess and wherein graininess is represented by frequency domain data;

estimating, by the processor, an image capture date of the undated photo based on a similarity of the image characteristics of the undated photo to one or more of the image characteristics of the reference photos;

displaying at a user interface, by the processor, the undated photo;

displaying at the user interface, by the processor, a data structure having a plurality of data nodes, each data node representing one or more data records having a subject associated with one or more dates;

identifying at the displayed data structure, by the processor, one or more data nodes that have a relationship to the undated photo based on the estimated image capture date of the undated photo and the dates associated with the subject of the one or more data nodes;

displaying, by the processor, a tagging data entry window at the user interface for receiving tagging information from a user viewing the undated photo and the displayed data structure; and

receiving, by the processor, tagging information at the tagging data entry window at the user interface concerning the undated photo based on the identified one or more data nodes.

2. The method of claim 1 , wherein the image characteristics are characteristics of pixel data resulting from digital processing of an image in the undated photo.

3. The method of claim 2 , wherein the image characteristics further comprise sharpness, and wherein sharpness is represented by frequency domain data.

4. The method of claim 2 , wherein the image characteristics further comprise color, and wherein color is represented by an HSI (Hue, Saturation, Intensity) color model data.

5. The method of claim 2 , wherein the pixel data comprises:

pixel data transformed into a Fourier series representing frequency domain data.

6. The method of claim 1 , further comprising creating an estimation model for estimating image capture dates by:

determining, by the processor, the image characteristics of the reference photos;

assigning, by the processor, the image characteristics of the reference photos to reference dates; and

developing, by the processor, rules for the estimation model for associating image characteristics of undated photos to image characteristics of the reference photos, based on the image characteristics of the reference photos assigned to reference dates;

wherein the step of comparing the image characteristics of the undated photo comprises applying, by the processor, the image characteristics of the undated photo to the rules developed for the estimation model.

7. The method of claim 1 , wherein graininess is determined by the frequency of Fourier series signals represented across the image of the undated photo.

8. The method of claim 1 , wherein the data structure is a family tree, and wherein the subject of each node is a person.

9. The method of claim 8 , wherein the undated photo and the family tree are displayed together at the user interface.

10. The method of claim 1 , wherein the data structure having a plurality of data nodes comprises a family tree, with each data node in the family tree associated with a person, and wherein the method further comprises:

storing the undated photo as a data record at the one or more identified data nodes that have a relationship to the undated photo.

11. The method of claim 1 , wherein identifying image characteristics of the undated photo comprises calculating an average graininess of the undated photo based on the frequency of Fourier series signals represented across the image in the undated photo.

12. The method of claim 1 , wherein the plurality of reference photos comprise photos stored in a database system maintaining family trees and having information associated with dates that the stored photos were taken.

Assignments (7)
SECURITY INTEREST Recorded Dec 7, 2020
From: ANCESTRY.COM DNA, LLC; ANCESTRY.COM OPERATIONS INC.; IARCHIVES, INC.; ANCESTRYHEALTH.COM, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054627/0212 →
RELEASE OF FIRST LIEN SECURITY INTEREST Recorded Dec 7, 2020
From: JPMORGAN CHASE BANK, N.A.
To: ANCESTRY.COM OPERATIONS INC.; IARCHIVES, INC.; ANCESTRY.COM DNA, LLC; ANCESTRYHEALTH.COM, LLC; ADPAY, INC.
Reel/Frame 054618/0298 →
SECURITY INTEREST Recorded Dec 7, 2020
From: ANCESTRY.COM DNA, LLC; ANCESTRY.COM OPERATIONS INC.; IARCHIVES, INC.; ANCESTRYHEALTH.COM, LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 054627/0237 →
RELEASE OF SECURITY INTEREST Recorded Nov 29, 2017
From: DEUTSCHE BANK AG NEW YORK BRANCH
To: ANCESTRY.COM LLC; ANCESTRY US HOLDINGS INC.; ANCESTRY.COM INC.; ANCESTRY.COM OPERATIONS INC.
Reel/Frame 044529/0025 →
SECOND LIEN SECURITY AGREEMENT Recorded Oct 24, 2016
From: ANCESTRY.COM OPERATIONS INC.; IARCHIVES, INC.; ANCESTRY.COM DNA, LLC; ANCESTRYHEALTH.COM, LLC; ADPAY, INC.
To: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
Reel/Frame 040259/0978 →
FIRST LIEN SECURITY AGREEMENT Recorded Oct 21, 2016
From: ANCESTRY.COM OPERATIONS INC.; IARCHIVES, INC.; ANCESTRY.COM DNA, LLC; ANCESTRYHEALTH.COM, LLC; ADPAY, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 040449/0663 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2016
From: BROOKHART, CHRIS; REESE, JACK
To: ANCESTRY.COM OPERATIONS INC.
Reel/Frame 037413/0087 →
Continuity (2)
Division 13440754 · Apr 5, 2012
Related Publication 20160132751A1 · May 12, 2016