IP Library Granted Patent US 8,643,746
Granted Patent B2
US 8,643,746 · App. 13/110,056 · Granted Feb 4, 2014

Video summary including a particular person

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,643,746
App. No.
13/110,056
Granted
Feb 4, 2014
Kind
B2
Abstract

A digital video camera system that provides a video summary using a method that includes: designating a reference image containing a particular person; capturing a video sequence of the scene using the image sensor, the video sequence including a time sequence of image frames; processing the captured video sequence using a video processing path to form a digital video file; during the capturing of the video sequence, analyzing the captured image frames using a person recognition algorithm to identify a subset of the image frames that contain the particular person; forming the video summary including fewer than all of the image frames in the captured video sequence, wherein the video summary includes at least part of the identified subset of image frames containing the particular person; storing the digital video file in the storage memory; and storing a representation of the video summary in the storage memory.

Claims (52)

1. A digital video camera comprising:

an image sensor configured to capture digital images;

a data processing system;

a storage memory; and

a program memory communicatively connected to the data processing system and storing instructions configured to cause the data processing system to implement a method comprising:

designating a reference image, wherein the reference image contains a particular person;

capturing a video sequence of a scene using the image sensor, the video sequence including a time sequence of image frames;

analyzing the captured image frames using a person recognition algorithm to identify a subset of the image frames that contain the particular person;

forming a video summary including fewer than all of the image frames in the captured video sequence, wherein the video summary includes at least part of the identified subset of image frames containing the particular person;

storing the captured video sequence in the storage memory; and

storing the video summary in the storage memory as a separate summary digital video file.

2. The digital video camera system of claim 1 wherein the reference image is captured using the image sensor.

3. The digital video camera system of claim 2 wherein the reference image is selected by a user by activating a user control.

4. The digital video camera system of claim 1 wherein the reference image is downloaded to the digital video camera system.

5. The digital video camera system of claim 1 , wherein the summary digital video file is formed from the image frames of the captured video sequence using a different video processing path than is used to form the digital video file.

6. The digital video camera system of claim 1 , wherein the summary digital video file is at least partially formed concurrently with the digital video file.

7. The digital video camera system of claim 1 wherein the video summary also includes additional image frames besides the identified subset of image frames containing the particular person.

8. The digital video camera system of claim 7 wherein the additional image frames include image frames immediately before or after the image frames in the identified subset of image frames containing the particular person.

9. The digital video camera system of claim 8 wherein the image frames of the video sequence are compressed for storage in the digital video file, and wherein the image frames immediately before or after the image frames in the identified subset of image frames containing the particular person are selected such that the video summary includes groups of image frames that can be extracted from the digital video file without the need to decode the compressed image frames.

10. The digital video camera system of claim 7 wherein the additional image frames include other portions of the captured video sequence that are determined to be important portions.

11. The digital video camera system of claim 10 wherein the important portions of the captured video sequence include key image frames identified using a key-frame extraction algorithm.

12. The digital video camera system of claim 1 wherein the step of analyzing the captured image frames is performed during the capturing of the video sequence.

13. The digital video camera system of claim 1 wherein a plurality of reference images are designated, each reference image containing the particular person.

14. The digital video camera system of claim 1 wherein the video summary is a collection of still images selected from the identified subset of image frames containing the particular person.

15. The digital video camera system of claim 1 , wherein storing the captured video sequence comprises:

processing the captured video sequence using a video processing path to form a digital video file; and

storing the digital video file in the storage memory.

16. A method comprising:

receiving a video sequence including a time sequence of image frames;

receiving a designation with respect to a reference image, wherein the reference image contains a particular person;

using a data processor to automatically analyze the image frames using a person recognition algorithm to identify a subset of the image frames that contain the particular person;

forming a video summary including fewer than all of the image frames in the video sequence, wherein the video summary includes at least part of the identified subset of image frames containing the particular person;

storing the received video sequence in a storage memory; and

storing the video summary in the storage memory as a separate summary digital video file.

17. The method of claim 16 , wherein the image frames of the video sequence are compressed for storage in the digital video file, and wherein the image frames of the video summary are not compressed for storage in the summary digital video file.

18. The method of claim 16 , wherein the video summary also includes additional image frames that are not contained in the identified subset of image frames.

19. The method of claim 16 , wherein the person recognition algorithm uses at least facial recognition techniques to identify the subset of image frames that contain the particular person.

20. A non-transitory computer readable medium having stored thereon instructions executable to cause a processing system to perform functions, the functions comprising:

receiving a video sequence including a time sequence of image frames;

receiving a designation with respect to a reference image, wherein the reference image contains a particular person;

using a data processor of the processing system to automatically analyze the image frames using a person recognition algorithm to identify a subset of the image frames that contain the particular person;

forming a video summary including fewer than all of the image frames in the video sequence, wherein the video summary includes at least part of the identified subset of image frames containing the particular person;

storing the received video sequence in a storage memory as a digital video file; and

storing the video summary in the storage memory as a separate summary digital video file.

21. The computer readable medium of claim 20 , wherein the image frames of the video sequence are compressed for storage in the digital video file, and wherein the image frames of the video summary are not compressed for storage in the summary digital video file.

22. An apparatus comprising a processing system, wherein the processing system comprises a processor and a storage memory, and the processing system is configured to:

receive a video sequence including a time sequence of image frames;

receive a designation with respect to a reference image, wherein the reference image contains a particular person;

automatically analyze, using the processor, the image frames using a person recognition algorithm to identify a subset of the image frames that contain the particular person;

form a video summary including fewer than all of the image frames in the video sequence, wherein the video summary includes at least part of the identified subset of image frames containing the particular person;

store the received video sequence in the storage memory; and

store the video summary in the storage memory as a separate summary digital video file.

Assignments (7)
RELEASE OF SECURITY INTEREST Recorded Aug 15, 2023
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 064599/0304 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2017
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 041941/0079 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY NAME ON THE RECORDATION COVER SHEET PREVIOUSLY RECORDED ON REEL 026297 FRAME 0810. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 25, 2013
From: KARN, KEITH STOLL; PILLMAN, BRUCE HAROLD; DEEVER, AARON THOMAS; MCCOY, JOHN ROBERT; RAZAVI, FRANK; GRETZINGER, ROBERT
To: EASTMAN KODAK COMPANY
Reel/Frame 031719/0934 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2013
From: EASTMAN KODAK COMPANY
To: INTELLECTUAL VENTURES FUND 83 LLC
Reel/Frame 029959/0085 →
PATENT RELEASE Recorded Feb 1, 2013
From: CITICORP NORTH AMERICA, INC.; WILMINGTON TRUST, NATIONAL ASSOCIATION
To: EASTMAN KODAK COMPANY; EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC.; FAR EAST DEVELOPMENT LTD.; KODAK (NEAR EAST), INC.; KODAK AMERICAS, LTD.; KODAK PORTUGUESA LIMITED; KODAK REALTY, INC.; LASER-PACIFIC MEDIA CORPORATION; KODAK AVIATION LEASING LLC; KODAK PHILIPPINES, LTD.; NPEC INC.; FPC INC.; KODAK IMAGING NETWORK, INC.; PAKON, INC.; QUALEX INC.; CREO MANUFACTURING AMERICA LLC
Reel/Frame 029913/0001 →
SECURITY INTEREST Recorded Feb 21, 2012
From: EASTMAN KODAK COMPANY; PAKON, INC.
To: CITICORP NORTH AMERICA, INC., AS AGENT
Reel/Frame 028201/0420 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2011
From: KARN, KEITH STOLL; PILLMAN, BRUCE HAROLD; DEEVER, AARON THOMAS; MCCOY, JOHN ROBERT; RAZAVI, FRANK; GRETZINGER, ROBERT
To: EASTMAN KODAK
Reel/Frame 026297/0810 →