IP Library Granted Patent US 8,879,888
Granted Patent B2
US 8,879,888 · App. 13/796,904 · Granted Nov 4, 2014

Video clip selection via interaction with a hierarchic video segmentation

Inventors: Andreas Girgensohn (Palo Alto, CA); Lynn Donelle Wilcox (Redwood City, CA); Frank M. Shipman, III (College Station, TX)
Assignee: Fuji Xerox Co., Ltd.
H04N9/79H04N19/0029G06F17/30843
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,879,888
App. No.
13/796,904
Granted
Nov 4, 2014
Kind
B2
Abstract

A video segment selection method and system that determines a set of segment boundaries in the video, determines a segment boundary tree from the set of segment boundaries, presents a video timeline that shows a plurality of segment boundaries from a first level of the segment boundary tree, receives a first selection point and a first request to change a zoom factor for an interval of the video timeline around the first selection point, and, in response to the first request to change the zoom factor for the interval of the video timeline around the first selection point, updates the video timeline in the interval around the first selection point to show a plurality of segment boundaries from a second level of the segment boundary tree corresponding to the changed zoom factor.

Claims (76)

1. A method for selecting a segment of a video, the method comprising:

determining, using a processor, a set of segment boundaries in the video;

determining a segment boundary tree from the set of segment boundaries;

presenting a video timeline that shows a plurality of segment boundaries from a first level of the segment boundary tree;

receiving a first selection point and a first request to change a zoom factor for an interval of the video timeline around the first selection point; and

in response to the first request to change the zoom factor for the interval of the video timeline around the first selection point, updating the video timeline in the interval around the first selection point to show a plurality of segment boundaries from a second level of the segment boundary tree corresponding to the changed zoom factor.

2. The method of claim 1 , wherein the presenting the video timeline further comprises presenting keyframes corresponding to the plurality of segment boundaries from the first level of the segment boundary tree.

3. The method of claim 2 , wherein the updating the video timeline further comprises presenting keyframes corresponding to the plurality of segment boundaries from the second level of the segment boundary tree.

4. The method of claim 1 , further comprising:

receiving a refined selection point corresponding to one of the plurality of segment boundaries from the second level of the segment boundary tree,

wherein the refined selection point is a start point or an end point for the segment of the video.

5. The method of claim 3 , further comprising:

receiving a second request to change the zoom factor for the interval of the video timeline around the first selection point;

in response to the second request to change the zoom factor, updating the video timeline in the interval around the first selection point to show a plurality of segment boundaries from a third level of the segment boundary tree corresponding to the changed zoom factor and keyframes corresponding to the plurality of segment boundaries from the third level of the segment boundary tree; and

receiving a refined selection point corresponding to one of the plurality of segment boundaries from the third level of the segment boundary tree,

wherein the refined selection point is a start point or an end point for the segment of the video.

6. The method of claim 1 , wherein the video timeline is linear in a first interval comprising at least a portion of the interval around the first selection point, linear in a second interval, and non-linear between the first interval and the second interval.

7. The method of claim 1 , further comprising:

receiving a second selection point and a request to change a zoom factor for an interval of the video timeline around the second selection point; and

in response to the request to change the zoom factor for the interval of the video timeline around the second selection point, updating the video timeline in the interval around the second selection point to show a plurality of segment boundaries from a third level of the segment boundary tree corresponding to the changed zoom factor,

wherein the first selection point specifies a beginning of the segment of the video and the second selection point specifies an end of the segment of the video.

8. A method for selecting a segment of a media clip, the method comprising:

determining, using a processor, a set of segment boundaries in the media clip;

determining a segment boundary tree from the set of segment boundaries;

presenting a timeline that shows a plurality of segment boundaries from a first level of the segment boundary tree;

receiving a selection point and a request to change a zoom factor for an interval in the timeline,

updating the interval in the timeline to show a plurality of segment boundaries from a second level of the segment boundary tree; and

selecting the segment of the media clip such that a beginning of the segment of the media clip corresponds with a first segment boundary and an end of the segment of the media clip corresponds with a second segment boundary; and

wherein the interval in the timeline is located around the selection point, and

wherein the updating the interval in the timeline performed in response to the request to change the zoom factor for the interval in the timeline.

9. The method of claim 8 , wherein the first segment boundary is selected from the plurality of segment boundaries from the first level of the segment boundary tree and the plurality of segment boundaries from the second level of the segment boundary tree, and

wherein the second segment boundary is selected from the plurality of segment boundaries from the first level of the segment boundary tree and the plurality of segment boundaries from the second level of the segment boundary tree.

10. The method of claim 8 , wherein the media clip comprises a video file.

11. The method of claim 8 , wherein the media clip comprises an audio file.

12. A non-transitory computer readable medium storing a program causing a computer to execute a method for selecting a segment of a video, the method comprising:

determining a set of segment boundaries in the video;

determining a segment boundary tree from the set of segment boundaries;

presenting a video timeline that shows a plurality of segment boundaries from a first level of the segment boundary tree;

receiving a first selection point and a first request to change a zoom factor for an interval of the video timeline around the first selection point; and

in response to the first request to change the zoom factor for the interval of the video timeline around the first selection point, updating the video timeline in the interval around the first selection point to show a plurality of segment boundaries from a second level of the segment boundary tree corresponding to the changed zoom factor.

13. The non-transitory computer readable medium of claim 12 , wherein the presenting the video timeline further comprises presenting keyframes corresponding to the plurality of segment boundaries from the first level of the segment boundary tree.

14. The non-transitory computer readable medium of claim 13 , wherein the updating the video timeline further comprises presenting keyframes corresponding to the plurality of segment boundaries from the second level of the segment boundary tree.

15. The non-transitory computer readable medium of claim 12 , further comprising:

receiving a refined selection point corresponding to one of the plurality of segment boundaries from the second level of the segment boundary tree,

wherein the refined selection point is a start point or an end point for the segment of the video.

16. The non-transitory computer readable medium of claim 14 , further comprising:

receiving a second request to change the zoom factor for the interval of the video timeline around the first selection point;

in response to the second request to change the zoom factor, updating the video timeline in the interval around the first selection point to show a plurality of segment boundaries from a third level of the segment boundary tree corresponding to the changed zoom factor and keyframes corresponding to the plurality of segment boundaries from the third level of the segment boundary tree; and

receiving a refined selection point corresponding to one of the plurality of segment boundaries from the third level of the segment boundary tree,

wherein the refined selection point is a start point or an end point for the segment of the video.

17. The non-transitory computer readable medium of claim 12 , wherein the video timeline is linear in a first interval comprising at least a portion of the interval around the first selection point, linear in a second interval, and non-linear between the first interval and the second interval.

18. The non-transitory computer readable medium of claim 12 , further comprising:

receiving a second selection point and a request to change a zoom factor for an interval of the video timeline around the second selection point; and

in response to the request to change the zoom factor for the interval of the video timeline around the second selection point, updating the video timeline in the interval around the second selection point to show a plurality of segment boundaries from a third level of the segment boundary tree corresponding to the changed zoom factor,

wherein the first selection point specifies a beginning of the segment of the video and the second selection point specifies an end of the segment of the video.

19. A system for selecting a segment of a video, the system comprising:

a segment boundary determining unit, comprising a processor, that determines a set of segment boundaries in the video;

a segment boundary tree determining unit that determines a segment boundary tree from the set of segment boundaries determined by the segment boundary determining unit;

a video timeline presenting unit that presents a video timeline that shows a plurality of segment boundaries from a first level of the segment boundary tree determined by the segment boundary tree determining unit; and

a selection point receiving unit that receives a first selection point and a first request to change a zoom factor for an interval of the video timeline around the first selection point,

wherein the video timeline presenting unit, in response to the first request to change the zoom factor for the interval of the video timeline around the first selection point, updates the video timeline in the interval around the first selection point to show a plurality of segment boundaries from a second level of the segment boundary tree corresponding to the changed zoom factor.

20. The system of claim 19 , wherein the video timeline presenting unit further presents keyframes corresponding to the plurality of segment boundaries from the first level of the segment boundary tree.

21. The system of claim 20 , wherein the video timeline presenting unit updating the video timeline in the interval around the first selection point further comprises the video timeline presenting unit presenting keyframes corresponding to the plurality of segment boundaries from the second level of the segment boundary tree.

22. The system of claim 19 , wherein:

the selection point receiving unit receives a refined selection point corresponding to one of the plurality of segment boundaries from the second level of the segment boundary tree; and

the refined selection point is a start point or an end point for the segment of the video.

23. The system of claim 21 , wherein:

the selection point receiving unit receives a second request to change the zoom factor for the interval of the video timeline around the first selection point; and

the video timeline presenting unit, in response to the second request to change the zoom factor received by the selection point receiving unit, displays a plurality of segment boundaries from a third level of the segment boundary tree corresponding to the changed zoom factor and keyframes corresponding to the plurality of segment boundaries from the third level of the segment boundary tree;

the selection point receiving unit receives a refined selection point corresponding to one of the plurality of segment boundaries from the third level of the segment boundary tree; and

the refined selection point is a start point or an end point for the segment of the video.

24. The system of claim 19 , wherein the video timeline presented by the video timeline presenting unit is linear in a first interval comprising at least a portion of the interval around the first selection point, linear in a second interval, and non-linear between the first interval and the second interval.

25. The system of claim 19 , wherein:

the selection point receiving unit receives a second selection point and a request to change a zoom factor for an interval of the video timeline around the second selection point;

the video timeline presenting unit, in response to the request to change the zoom factor for the interval of the video timeline around the second selection point, updates the video timeline in the interval around the second selection point to show a plurality of segment boundaries from a third level of the segment boundary tree corresponding to the changed zoom factor; and

the first selection point specifies a beginning of the segment of the video and the second selection point specifies an end of the segment of the video.

Assignments (2)
CHANGE OF NAME Recorded Aug 12, 2021
From: FUJI XEROX CO., LTD.
To: FUJIFILM BUSINESS INNOVATION CORP.
Reel/Frame 058287/0056 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2013
From: GIRGENSOHN, ANDREAS; WILCOX, LYNN DONELLE; SHIPMAN, III, FRANK M.
To: FUJI XEROX CO., LTD.
Reel/Frame 029984/0517 →
Continuity (1)
Related Publication 20140270708A1 · Sep 18, 2014