IP Library › Granted Patent US 7,372,991
Granted Patent B2
US 7,372,991 · App. 10/672,436 · Granted May 13, 2008

Method and apparatus for summarizing and indexing the contents of an audio-visual presentation

Assignee: Seiko Epson Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,372,991
App. No.
10/672,436
Granted
May 13, 2008
Kind
B2
Abstract

A method for creating a summary of an audiovisual presentation initiates with segmenting a frame of the audiovisual presentation. Then, a slide region of the segmented frame is identified. Next, a histogram representing lines in the slide region is generated. Next, moving regions associated with successive frames from the histogram are suppressed. A computer readable medium, a system for providing a real time summarization of a meeting and an integrated circuit are also provided.

Claims (46)

1. A method for creating a summary of an audiovisual presentation, comprising method operations of:

segmenting a frame of the audiovisual presentation;

identifying a slide region of the segmented frame;

generating a histogram representing lines in the slide region; and

suppressing moving regions associated with successive frames from the histogram, the suppressing including,

assigning a foreground silhouette a most recent timestamp; and

generating a motion mask, wherein edges located within the motion mask are excluded from the histogram.

2. The method of claim 1 , further comprising:

generating a histogram from a stored slide associated with the slide region; and

matching the histogram representing lines in the slide region with the histogram from the stored slide.

3. The method of claim 1 , wherein the method operation of identifying a slide region of the segmented frame includes,

determining a shape ratio of the slide region.

4. The method of claim 1 , wherein the method operation of generating a histogram representing lines in the slide region includes,

detecting edges of text and figures of the slide region; and

transforming data representing the edges into a parameter space.

5. The method of claim 1 , wherein the method operation of suppressing moving regions associated with successive frames from the histogram includes,

generating the silhouette through differences of luminance channels between frames.

6. The method of claim 1 , wherein the method operation of segmenting a frame of the audiovisual presentation includes,

comparing each pixel value of the frame with neighbor pixel values in causal order.

7. The method of claim 6 , wherein the neighbor pixel values include five neighbor pixel values.

8. The method of claim 7 , wherein the five neighbor pixel values include two previous adjacent pixel values from the frame, a corresponding pixel value from a previous frame, and two adjacent pixel values from the previous frame.

9. A computer readable medium having program instructions for creating a summary of an audiovisual presentation, comprising:

program instructions for segmenting a frame of the audiovisual presentation;

program instructions for identifying a slide region of the segmented frame;

program instructions for generating a histogram representing lines in the slide region; and

program instructions for suppressing moving regions associated with successive frames from the histogram the program instructions for suppressing including,

assigning a foreground silhouette a most recent timestamp; and

generating a motion mask, wherein edges located within the motion mask are excluded from the histogram.

10. The computer readable medium of claim 9 , further comprising:

program instructions for generating a histogram from a stored slide associated with the slide region; and

program instructions for matching the histogram representing lines in the slide region with the histogram from the stored slide.

11. The computer readable medium of claim 9 , wherein the program instructions for identifying a slide region of the segmented frame includes,

program instructions for determining a shape ratio of the slide region.

12. The computer readable medium of claim 9 , wherein the program instructions for generating a histogram representing lines in the slide region includes,

program instructions for detecting edges of text and figures of the slide region; and

program instructions for transforming data representing the edges into a parameter space.

13. The computer readable medium of claim 9 , wherein the program instructions for suppressing moving regions associated with successive frames from the histogram includes,

program instructions for generating the silhouette through differences of luminance channels between frames.

14. A method for creating a summary of an audiovisual presentation, comprising method operations of:

segmenting a frame of the audiovisual presentation, the segmenting including;

comparing each pixel value of the frame with a plurality of neighbor pixel values, the plurality of neighbor pixel values including pixel values from the frame and from a previous frame;

identifying a slide region of the segmented frame;

generating a histogram representing lines in the slide region; and

suppressing moving regions associated with successive frames from the histogram;

the suppressing including, capturing a foreground silhouette; copying the foreground silhouette; assigning the copied foreground silhouette a most recent timestamp; and generating a motion mask, wherein the edges located within the motion mask are excluded from the histogram.

15. The method of claim 14 , wherein the plurality of neighbor pixel values include five pixel values.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2004
From: EPSON RESEARCH AND DEVELOPMENT, INC.
To: SEIKO EPSON CORPORATION
Reel/Frame 015029/0090 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 26, 2003
From: CHEN, WILLIAM; CHEN, JAU-YUEN
To: EPSON RESEARCH AND DEVELOPMENT, INC.
Reel/Frame 014561/0320 →
Continuity (1)
Related Publication 20050078868A1 · Apr 14, 2005