IP Library Granted Patent US 10,885,346
Granted Patent B2
US 10,885,346 · App. 16/153,465 · Granted Jan 5, 2021

Method, system and apparatus for selecting frames of a video sequence

Inventors: Mark Ronald Tainsh (Pymble, AU); Rajanish Calisa (Artarmon, AU); Sammy Chan (Beecroft, AU)
Assignee: Canon Kabushiki Kaisha
G06K9/00765G06K9/00362G06K9/00664G06K9/00744G06K9/6202G06T7/246G06T7/60H04N5/232G06K2209/27G06T2207/10016G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,885,346
App. No.
16/153,465
Granted
Jan 5, 2021
Kind
B2
Abstract

A method of selecting frames of a video sequence. Image data for a plurality of consecutive frames of the video sequence is captured using a camera. Frames from the plurality of consecutive frames where the camera is moving are identified using the captured image data, wherein each of the identified frames comprises a subject. A size of the subject captured in each of the identified frames is determined. The identified frames are selected by detecting that the camera is moving towards and with the subject based on the size of the subject within each of a plurality of the identified frames.

Claims (40)

1. A method of selecting frames of a video sequence, the method comprising:

capturing image data for a plurality of consecutive frames of the video sequence using a camera;

identifying frames from the plurality of consecutive frames where the camera is moving using the captured image data, wherein each of the identified frames comprises a subject;

determining a size of the subject captured in each of the identified frames; and

selecting, in a case where the size of the subject within each of a plurality of the identified frames is consistent without becoming larger or smaller with elapse of time, the plurality of the identified frames as frames in which movements of the camera and the subject are synchronized.

2. The method according to claim 1 , wherein the size of the subject remains substantially similar for the plurality of the identified frames.

3. The method according to claim 1 , further comprising processing the consecutive frames to determine if the camera operator is walking.

4. The method according to claim 1 , further comprising determining if an operator of the camera is walking based on video metadata.

5. The method according to claim 4 , wherein the metadata is global positioning system metadata.

6. The method according to claim 4 , wherein the metadata is accelerometer metadata.

7. The method according to claim 4 , further comprising determining if an operator of the camera is walking based on gyro data associated with the camera.

8. The method according to claim 1 , further comprising processing a low resolution representation of the identified frames to determine the size of the subject.

9. The method according to claim 8 , wherein the low resolution representation is a luminance matrix.

10. The method according to claim 8 , wherein the low resolution representation is included in video metadata associated with the frames.

11. The method according to claim 1 , further comprising processing pixel data for one or more of the identified frames to determine a size of the subject.

12. The method according to claim 1 , further comprising matching a template to the subject to identify the subject.

13. The method according to claim 1 , further comprising matching a template to the subject to track changes in size of the subject.

14. The method according to claim 1 , wherein the captured image data is pixel data.

15. The method according to claim 1 , wherein the captured image data is metadata.

16. The method according to claim 1 , wherein the captured image data is pixel data in addition to metadata.

17. The method according to claim 1 , wherein a face of the subject is unidentifiable in the frames.

18. An apparatus for selecting frames of a video sequence, the apparatus comprising:

a memory for storing data and a computer program;

a processor coupled to the memory for executing the computer program, the program comprising instructions for:

capturing image data for a plurality of consecutive frames of the video sequence using a camera;

identifying frames from the plurality of consecutive frames where the camera is moving using the captured image data, wherein each of the identified frames comprises a subject;

determining a size of the subject captured in each of the identified frames; and

selecting, in a case where the size of the subject within each of a plurality of the identified frames is consistent without becoming larger or smaller with elapse of time, the plurality of the identified frames as frames in which movements of the camera and the subject are synchronised.

19. A system for selecting frames of a video sequence, the system comprising:

a memory for storing data and a computer program;

a processor coupled to the memory for executing computer program, the program comprising instructions for:

capturing image data for a plurality of consecutive frames of the video sequence using a camera;

identifying frames from the plurality of consecutive frames where the camera is moving using the captured image data, wherein each of the identified frames comprises a subject;

determining a size of the subject captured in each of the identified frames; and

selecting, in a case where the size of the subject within each of a plurality of the identified frames is consistent without becoming larger or smaller with elapse of time, the plurality of the identified frames as frames in which movements of the camera and the subject are synchronised.

20. A non-transitory computer readable storage medium having a program for selecting frames of a video sequence, the program comprising:

code for capturing image data for a plurality of consecutive frames of the video sequence using a camera;

code for identifying frames from the plurality of consecutive frames where the camera is moving using the captured image data, wherein each of the identified frames comprises a subject;

code for determining a size of the subject captured in each of the identified frames; and

code for selecting, in a case where the size of the subject within each of a plurality of the identified frames is consistent without becoming larger or smaller with elapse of time, the plurality of the identified frames as frames in which movements of the camera and the subject are synchronised.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2018
From: TAINSH, MARK RONALD; CALISA, RAJANISH; CHAN, SAMMY
To: CANON KABUSHIKI KAISHA
Reel/Frame 047484/0858 →
Priority Claims (1)
AU 2017245322 · Oct 10, 2017 · national
Continuity (1)
Related Publication 20190108402A1 · Apr 11, 2019