IP Library Granted Patent US 7,519,200
Granted Patent B2
US 7,519,200 · App. 11/246,742 · Granted Apr 14, 2009

System and method for enabling the use of captured images through recognition

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,519,200
App. No.
11/246,742
Granted
Apr 14, 2009
Kind
B2
Abstract

An embodiment provides for enabling retrieval of a collection of captured images that form at least a portion of a library of images. For each image in the collection, a captured image may be analyzed to recognize information from image data contained in the captured image, and an index may be generated, where the index data is based on the recognized information. Using the index, functionality such as search and retrieval is enabled. Various recognition techniques, including those that use the face, clothing, apparel, and combinations of characteristics may be utilized. Recognition may be performed on, among other things, persons and text carried on objects.

Claims (28)

1. A method for enabling retrieval of a collection of captured images that form at least a portion of a collection of images, the method comprising: for individual images in the collection, using a processor to perform steps comprising:

(a) detecting one or more persons depicted in the captured image;

(b) performing normalization on a face of the detected one or more persons, including normalizing effects of lighting when the image was captured using at least one of a histogram or linear ramp intensity analysis;

(c) performing image analysis on the captured image to determine recognition information about the one or more persons in the captured image using image data contained in the captured image that depicts the face of the one or more persons, further including determining information about a clothing or apparel of the detected one or more persons;

(d) using a probabilistic model and the recognition information to determine an identity assignment for the one or more persons in the captured image, wherein the probability model is based at least on a time when the image was captured and the information about the clothing or apparel, wherein the identify assignment is determined according to a combination that includes at least the time information and the clothing or apparel information.

2. The method of claim 1 , further comprising:

generating an index that correlates at least one of each captured image or depicted persons to a determined identity assignment, and

enabling the index to be used for searching images in the collection using input.

3. The method of claim 2 , wherein enabling the index to be searched includes enabling the index to be searched using input that corresponds to a portion of an image containing a person.

4. The method of claim 1 , wherein performing image analysis includes:

determining a recognition signature that identifies at least one of the one or more persons from other persons recognized in the collection.

5. The method of claim 1 , further comprising:

generating a recognition signature based at least in part on the recognition information and information used in the probabilistic model.

6. The method of claim 1 , further comprising:

receiving an input that includes an image depicting a person

determining an identity assignment of the depicted person of the input by performing steps (a) through (d); and

performing a search using the input by associating the image of the input with one or more other images in the collection that have the same identity assignment.

7. A system for enabling retrieval of a collection of captured images that form at least a portion of a library of images, the system comprising:

an image analysis module that operates to:

receive images for the library, the images being captured by one or more consumer-level users that operate corresponding image capturing devices;

detect whether individual images depict persons;

normalize the individual images for lighting and pose of the depicted persons using at least one of a histogram or linear ramp intensity analysis;

perform recognition on the normalized images to determine recognition information for the depicted persons, the recognition information including information about a clothing or apparel of the detected one or more persons;

use a probabilistic model and the recognition information to determine an identity assignment for the one or more persons in the captured image, wherein the probabilistic model is based at least on a time when the image captured and the information about the clothing or apparel, wherein the identity assignment is determined according to a combination that includes at least the time information and the clothing or apparel information;

an indexer that generates index data, wherein the index data associates the recognition information determined from the one or more persons depicted in the received images with a corresponding captured image that contained that person.

8. The system of claim 7 , wherein the recognition information includes recognition signatures that include quantitative data, and wherein the system comprises an index that maintains recognition signatures in association with captured images that contained the one or more persons from which the recognition information is determined from.

9. The system of claim 7 , wherein the image analysis module generates one or more modules are configured to generate recognition information for persons using one or more facial features of the person.

10. The system of claim 9 , wherein the image analysis module generates one or more modules are configured to generate a recognition signature for persons appearing in each image in the collection using the one or more features of the person and at least one of (i) a clothing or apparel worn by the person, (ii) metadata associated with each image in the collection from which a person is recognized.

Assignments (5)
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044101/0610 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2012
From: LIKE.COM
To: GOOGLE INC.
Reel/Frame 028862/0105 →
CHANGE OF NAME Recorded Feb 11, 2009
From: RIYA, INC.
To: LIKE.COM
Reel/Frame 022245/0565 →
CHANGE OF NAME Recorded Feb 23, 2007
From: OJOS, INC.
To: RIYA, INC.
Reel/Frame 018929/0169 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 23, 2005
From: GOKTURK, SALIH BURAK; SHAH, MUNJAL; KHAN, AZHAR; ANGUELOV, DRAGOMIR; VANHOUCKE, VINCENT; LEE, KUANG-CHIH; VU, DIEM; YANG, DANNY
To: OJOS, INC.
Reel/Frame 017058/0365 →