IP Library Granted Patent US 10,726,877
Granted Patent B2
US 10,726,877 · App. 16/290,559 · Granted Jul 28, 2020

System and method for generating a compression invariant motion timeline

Inventor: Zvi Figov (Modiin, IL)
Assignee: Verint Americas Inc.
G11B27/34G06K9/00744G06T7/20G11B27/102G11B27/3081G06F3/04842G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,726,877
App. No.
16/290,559
Granted
Jul 28, 2020
Kind
B2
Abstract

The present invention generates a compression invariant motion timeline for a video. For each second in the video, the method uses an identification procedure to determine a stored key frame size, a frame counter, and an accumulated size of frames. The method then calculates and stores a motion value for the second using the stored key frame size, the frame counter, and the accumulated size of frames. The motion values for each second may be used to construct a timeline for the video.

Claims (75)

1. A method for generating a compression invariant motion timeline for a video, comprising:

repeating for each second in the video:

identifying each frame in a given second by repeating for each frame in a given second:

reading the frame header,

extracting the frame size and frame type, wherein the frame type is selected from the group consisting of: key frame and non-key frame, and

storing the last key frame size if the frame is a key frame, or storing a frame counter and accumulating the size of frames if the frame is a non-key frame;

calculating and storing a motion value for the second using the stored key frame size, the frame counter and the accumulated size of frames; and

zeroing the frame counter and the accumulated size of frames; and

creating the timeline using each motion value for each second.

2. The method of claim 1 , wherein the motion value is calculated using the formula:

motion

value

=

(

accumulated

frame

size

frame

counter

)

last

key

frame

size

.

3. The method of claim 1 , further comprising correlating the motion values to the corresponding seconds.

4. The method of claim 3 , further comprising creating the timeline by plotting the correlated motion values and corresponding seconds to produce the timeline.

5. The method of claim 1 , further comprising applying a smoothing technique to the motion values.

6. The method of claim 1 , further comprising calculating at least one threshold based on data extracted from the video or the motion values.

7. The method of claim 6 , wherein the at least one threshold comprises a cutoff for the beginning of at least one time span of interest in the timeline, and a cutoff for the end of the at least one time span of interest in the timeline.

8. The method of claim 6 , further comprising updating a pregenerated threshold with the threshold.

9. The method of claim 6 , further comprising applying the threshold to the timeline.

10. The method of claim 1 , further comprising visually highlighting at least one time span of interest on the timeline.

11. The method of claim 1 , further comprising correlating at least one time span of interest to the video.

12. The method of claim 11 , further comprising extracting from the video at least one video segment corresponding to the at least one time span of interest.

13. The method of claim 12 , further comprising operatively linking the at least one video segment to the timeline.

14. The method of claim 13 , wherein the operative link between the at least one video segment to the timeline is a graphical link.

15. The method of claim 14 , wherein the graphical link is a visually highlighted time span of interest on the timeline.

16. The method of claim 13 , further comprising playing the video segment when a user selects the operative link.

17. A system for generating a compression invariant motion timeline for a video, comprising:

a processor; and

a non-transitory computer readable medium programmed with computer readable code that upon execution by the processor causes the processor to execute a method for generating a compression invariant motion timeline for a video, comprising:

repeating for each second in the video:

identifying each frame in a given second by repeating for each frame in a given second:

reading the frame header,

extracting the frame size and frame type, wherein the frame type is selected from the group consisting of: key frame and non-key frame, and

storing the last key frame size if the frame is a key frame, or storing a frame counter and accumulating the size of frames if the frame is a non-key frame,

calculating and storing a motion value for the second using the stored key frame size, the frame counter and the accumulated size of frames, and

zeroing the frame counter and the accumulated size of frames; and

creating the timeline using each motion value for each second.

18. The system of claim 17 , wherein the processor is operatively coupled to at least one video camera, at least one data storage unit, or at least one codec.

19. The system of claim 17 , wherein the processor receives the video from the at least one video camera, at least one data storage unit, or at least one codec.

20. A non-transitory computer readable medium programmed with computer readable code that upon execution by a processor causes the processor to execute a method for generating a compression invariant motion timeline for a video, comprising:

repeating for each second in the video:

identifying each frame in a given second by repeating for each frame in a given second:

reading the frame header,

extracting the frame size and frame type, wherein the frame type is selected from the group consisting of: key frame and non-key frame, and

storing the last key frame size if the frame is a key frame, or storing a frame counter and accumulating the size of frames if the frame is a non-key frame;

calculating and storing a motion value for the second using the stored key frame size, the frame counter and the accumulated size of frames; and

zeroing the frame counter and the accumulated size of frames; and

creating the timeline using each motion value for each second.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2022
From: COGNYTE SOFTWARE LTD.
To: COGNYTE TECHNOLOGIES ISRAEL LTD
Reel/Frame 061675/0724 →
CHANGE OF NAME Recorded Apr 20, 2022
From: VERINT SYSTEMS LTD.
To: COGNYTE TECHNOLOGIES ISRAEL LTD
Reel/Frame 059710/0742 →
CHANGE OF NAME Recorded Dec 23, 2021
From: VERINT SYSTEMS LTD.
To: COGNYTE TECHNOLOGIES ISRAEL LTD
Reel/Frame 060751/0532 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2021
From: VERINT AMERICAS INC.
To: COGNYTE SOFTWARE LTD.
Reel/Frame 057569/0475 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2019
From: FIGOV, ZVI
To: VERINT AMERICAS INC.
Reel/Frame 048688/0698 →
Continuity (2)
Provisional Application 62768262 · Nov 16, 2018
Related Publication 20200160888A1 · May 21, 2020