IP Library Granted Patent US 11,776,579
Granted Patent B2
US 11,776,579 · App. 17/378,324 · Granted Oct 3, 2023

Scene and activity identification in video summary generation

Inventors: David A. Newman (San Diego, CA); Adam Silver (San Carlos, CA)
Assignee: GoPro, Inc.
G11B27/10G06T7/246G06V20/41G06V20/47G10L15/063G10L15/22G10L25/57G11B27/031G11B27/13G11B27/28G11B27/3081G11B27/34H04N5/77H04N5/772H04N5/91H04N9/8205H04N19/513G06V20/44G10L25/54G10L2015/0631G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,776,579
App. No.
17/378,324
Granted
Oct 3, 2023
Kind
B2
Abstract

Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.

Claims (61)

1. A system configured to generate a video summary, the system comprising:

one or more physical processors configured by machine readable instructions to:

obtain metadata for one or more videos;

analyze the metadata for the one or more videos to identify events of interest in the one or more videos;

identify video portions of the one or more videos as candidates for inclusion in the video summary based on the events of interest in the one or more videos, the video summary being characterized b a given length, the identified video portions including a first video portion and a second video portion;

rank the identified video portions, wherein the first video portion is ranked higher than the second video portion; and

select among the identified video portions for inclusion in the video summary based on rankings of the identified video portions, wherein the first video portion is selected over the second video portion for inclusion in the video summary based on the first video portion being ranked higher than the second video portion; and

generate the video summary from the selected video portions.

2. The system of claim 1 , wherein:

the metadata for the one or more videos includes location information identifying capture locations for the one or more videos;

one or more of the events of interests are identified in the one or more videos based on corresponding capture location for the one or more videos being within a threshold distance of a pre-determined location; and

one or more of the video portions are identified from the one or more videos as having been captured within the threshold distance of the pre-determined location.

3. The system of claim 1 , wherein:

the metadata for the one or more videos includes time stamps representing capture times for the one or more videos;

one or more of the events of interests are identified in the one or more videos based on corresponding capture time of the one or more videos being within a threshold time of a pre-determined time; and

one or more of the video portions are identified from the one or more videos as having been captured within the threshold time of the pre-determined time.

4. The system of claim 1 , wherein:

the metadata for the one or more videos includes location information identifying capture locations for the one or more videos;

one or more of the events of interests are identified in the one or more videos based on corresponding capture location for the one or more videos being within a threshold distance of a user; and

one or more of the video portions are identified from the one or more videos as having been captured within the threshold distance of the user.

5. The system of claim 1 , wherein the identified video portions are ranked based on lengths of the identified video portions, with longer video portions being ranked higher than shorter video portions.

6. The system of claim 1 , wherein the identified video portions are ranked based on types of the metadata used to identify the events of interest.

7. The system of claim 6 , wherein the first video portion is ranked higher than the second video portion based on the first video portion being associated with a first event of interest identified based on image capture device velocity and the second video portion being associated with a second event of interest identified based on user heart rate.

8. The system of claim 1 , wherein the identified video portions are ranked based on activities associated with the identified video portions.

9. The system of claim 8 , wherein the first video portion is ranked higher than the second video portion based on the first video portion being associated with a jump or a crash and the second video portion being associated with sitting down or walking.

10. A method for generating a video summary, the method performed by a computing system including one or more processors, the method comprising:

obtaining, by the computing system, metadata for one or more videos;

analyzing, by the computing system, the metadata for the one or more videos to identify events of interest in the one or more videos;

identifying by the computing system, video portions of the one or more videos as candidates for inclusion in the video summary based on the events of interest in the one or more videos, the video summary being characterized by a given length, the identified video portions including a first video portion and a second video portion;

ranking, by the computing system, the identified video portions, wherein the first video portion is ranked higher than the second video portion; and

selecting, by the computing system, among the identified video portions for inclusion in the video summary based on rankings of the identified video portions, wherein the first video portion is selected over the second video portion for inclusion in the video summary based on the first video portion being ranked higher than the second video portion; and

generating, by the computing system, the video summary from the selected video portions.

11. The method of claim 10 , wherein:

the metadata for the one or more videos includes location information identifying capture locations for the one or more videos;

one or more of the events of interests are identified in the one or more videos based on corresponding capture location for the one or more videos being within a threshold distance of a pre-determined location; and

one or more of the video portions are identified from the one or more videos as having been captured within the threshold distance of the pre-determined location.

12. The method of claim 10 , wherein:

the metadata for the one or more videos includes time stamps representing capture times for the one or more videos;

one or more of the events of interests are identified in the one or more videos based on corresponding capture time of the one or more videos being within a threshold time of a pre-determined time; and

one or more of the video portions are identified from the one or more videos as having been captured within the threshold time of the pre-determined time.

13. The method of claim 10 , wherein:

the metadata for the one or more videos includes location information identifying capture locations for the one or more videos;

one or more of the events of interests are identified in the one or more videos based on corresponding capture location for the one or more videos being within a threshold distance of a user; and

one or more of the video portions are identified from the one or more videos as having been captured within the threshold distance of the user.

14. The method of claim 10 , wherein the identified video portions are ranked based on lengths of the identified video portions, with longer video portions being ranked higher than shorter video portions.

15. The method of claim 10 , wherein the identified video portions are ranked based on types of the metadata used to identify the events of interest.

16. The method of claim 15 , wherein the first video portion is ranked higher than the second video portion based on the first video portion being associated with a first event of interest identified based on image capture device velocity and the second video portion being associated with a second event of interest identified based on user heart rate.

17. The method of claim 10 , wherein the identified video portions are ranked based on activities associated with the identified video portions.

18. The method of claim 17 , wherein the first video portion is ranked higher than the second video portion based on the first video portion being associated with a jump or a crash and the second video portion being associated with sitting down or walking.

19. A system configured to generate a video summary, the system comprising:

one or more physical processors configured by machine readable instructions to:

obtain metadata for one or more videos;

analyze the metadata for the one or more videos to identify events of interest in the one or more videos;

identify video portions of the one or more videos as candidates for inclusion in the video summary based on the events of interest in the one or more videos, the video summary being characterized by a given length, the identified video portions including a first video portion and a second video portion;

rank the identified video portions, wherein the first video portion is ranked higher than the second video portion; further wherein identified video portions are ranked based on lengths of the identified video portions, or types of the metadata used to identify the events of interest; or activities associated with the identified video portions; and

select among the identified video portions for inclusion in the video summary based on rankings of the identified video portions, wherein the first video portion is selected over the second video portion for inclusion in the video summary based on the first video portion being ranked higher than the second video portion; and

generate the video summary from the selected video portions.

20. The system of claim 19 , wherein:

ranking of the identified video portions based on the lengths of the identified video portions includes longer video portions being ranked higher than shorter video portions;

ranking of the identified video portions based on the types of the metadata used to identify the events of interest includes the first video portion being ranked higher than the second video portion based on the first video portion being associated with a first event of interest identified based on image capture device velocity and the second video portion being associated with a second event of interest identified based on user heart rate; and

ranking of the identified video portions based on the activities associated with the identified video portions includes the first video portion being ranked higher than the second video portion based on the first video portion being associated with a jump or a crash and the second video portion being associated with sitting down or walking.

Assignments (3)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 17, 2021
From: NEWMAN, DAVID; SILVER, ADAM
To: GOPRO, INC.
Reel/Frame 056892/0235 →
Cited By (1)
US 12,243,307