IP Library Granted Patent US 7,409,144
Granted Patent B2
US 7,409,144 · App. 10/006,480 · Granted Aug 5, 2008

Video and audio information processing

Assignee: Sony United Kingdom Limited
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,409,144
App. No.
10/006,480
Granted
Aug 5, 2008
Kind
B2
Abstract

A camera-recorder apparatus comprises an image capture device operable to capture a plurality of video images; a storage medium by which the video images are stored for later retrieval; a feature extraction unit operable to derive image property data from the image content of at least one of the video images substantially in real time at the capture of the video images, the image property data being associated with respective images or groups of images; and a data path by which the camera-recorder apparatus is operable to transfer the derived image property data to an external data processing apparatus.

Claims (36)

1. A camera-recorder apparatus comprising:

an image capture device operable to capture a plurality of video images;

a storage medium by which said video images are stored for later retrieval;

a feature extraction unit operable to derive image feature vector data from said image content of at least one of said video images substantially in real time at said capture of said video images, said image feature vector data including color distribution data associated with respective images;

a metadata extraction unit operable to derive image property data from said image feature vector data substantially in real time at said capture of said video images, said image property data being associated with said respective images, and including sub shot segmentation data derived from said color distribution data; and

a data path by which said camera-recorder apparatus is operable to transfer said derived image property data to an external data processing apparatus.

2. The apparatus according to claim 1 , in which said image feature vector data includes face recognition data.

3. A camera-recorder apparatus comprising:

an image capture device operable to capture a plurality of video images;

a storage medium by which said video images are stored for later retrieval;

a feature extraction unit operable to derive image feature vector data from image content of at least one of said video images substantially in real time at said capture of said video images, said image feature vector data including color distribution data associated with respective images;

a metadata extraction unit operable to derive image property data from said image feature vector data substantially in real time at said capture of said video images, said image property data being associated with said respective images, said image property data including activity measure data derived from a variance of said color distribution data and indicative of a change of said image content or said audio content between said video images; and

a data path by which said camera-recorder apparatus is operable to transfer said derived image property data to an external data processing apparatus.

4. The apparatus according to claim 3 , in which said image feature vector data includes face recognition data.

5. A camera-recorder apparatus comprising:

an image capture device operable to capture a plurality of video images;

a storage medium by which said video images are stored for later retrieval;

a feature extraction unit operable to derive image feature vector data from said image content of at least one of said video images substantially in real time at said capture of said video images, said image feature vector data including color distribution data associated with respective images;

a metadata extraction unit operable to derive image property data from said image feature vector data substantially in real time at said capture of said video images, said image property data being associated with said respective images, said image property data includes a representative key frame derived from said color distribution data and indicative of a predominant overall content of said video images; and

a data path by which said camera-recorder apparatus is operable to transfer said derived image property data to an external data processing apparatus.

6. The apparatus according to claim 5 , in which said image vector data includes face recognition data.

7. A camera-recorder apparatus comprising:

an image capture device operable to capture a plurality of video images;

a storage medium by which said video images are stored for later retrieval;

a feature extraction unit operable to derive image feature vector data from said image content of at least one of said video images substantially in real time at said capture of said video images, said image feature vector data being associated with respective images;

a metadata extraction unit operable to derive image property data from said image feature vector data substantially in real time at said capture of said video images, said image property data being associated with said respective images or groups of images; and

a data path by which said camera-recorder apparatus is operable to transfer said derived image property data to an external data processing apparatus,

in which:

said camera-recorder apparatus is operable to capture an audio signal associated with said video images;

said feature extraction unit is operable to derive audio feature vector data identifying speech content for portions of said audio signal associated with at least one of said video images; and

said image property data includes interview detection data indicative of an interview sequence of said video images, said video images of said interview sequence including identified facial images co-occurring with respect to said audio signal that is associated with said video images of said interview sequence comprising speech.

8. The apparatus according to claim 7 , in which said image feature vector data includes at least color distribution data and/or face recognition data.

9. The apparatus according to claim 7 , in which said audio feature vector data comprises speech detection data.

10. The apparatus according to claim 9 , in which:

said audio feature vector data comprises speech detection data; and

said metadata extraction unit is operable to derive said interview detection data from said face recognition data and said speech detection data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 4, 2002
From: MCGRATH, MARK JOHN; DAVID, MORGAN WILLIAM AMOS; THORPE, JONATHAN
To: SONY UNITED KINGDOM LIMITED
Reel/Frame 012686/0604 →
Priority Claims (1)
GB 0029880.2 · Dec 7, 2000 · national
Continuity (1)
Related Publication 20020122659A1 · Sep 5, 2002