IP Library Granted Patent US 10,685,680
Granted Patent B2
US 10,685,680 · App. 16/359,928 · Granted Jun 16, 2020

Generating videos of media items associated with a user

Inventors: Shengyang Dai (Dublin, CA); Timothy Sepkoski St. Clair (Menlo Park, CA); Koji Ashida (Mountain View, CA); Jingyu Cui (Milpitas, CA); Jay Steele (Los Angeles, CA); Qi Gu (Redwood, CA); Erik Murphy-Chutorian (Palo Alto, CA); Ivan Neulander (Los Angeles, CA); Flavio Lerda (London, GB); Eric Charles Henry (San Francisco, CA); Shinko Yuanhsien Cheng (Cupertino, CA); Aravind Krishnaswamy (San Jose, CA); David Cohen (San Jose, CA); Pardis Beikzadeh (Mountain View, CA)
Assignee: Google LLC
G11B27/036G11B27/034G11B27/10G11B27/105G11B27/28G11B27/34H04N5/2628H04N5/7605
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,685,680
App. No.
16/359,928
Granted
Jun 16, 2020
Kind
B2
Abstract

A method includes grouping media items associated with a user into segments based on a timestamp associated with each media item and a total number of media items. The method also includes selecting target media from the media items for each of the segments based on media attributes associated with the media item. The method also includes generating a video that includes the target media for each of the segments by generating a first animation that illustrates a first transition from a first item from the target media to a second item from the target media with movement of the first item from an onscreen location to an offscreen location, wherein the first item is adjacent to the second item in the first animation and determining whether the target media includes one or more additional items. The method also includes adding a song to the video.

Claims (53)

1. A computer-implemented method to generate a video, the method comprising:

grouping media items associated with a user into segments;

selecting target media from the media items for each of the segments based on media attributes associated with the media items, wherein the target media includes two or more of the media items;

generating the video that includes the target media for each of the segments by:

illustrating a first transition from a first media item from the target media to a second media item from the target media with movement of the first media item from an onscreen location to an offscreen location;

determining whether the target media includes one or more additional media items; and

responsive to determining that the target media includes one or more additional media items, illustrating a second transition from the second media item to a first additional item and that further illustrates additional transitions between a remainder of the one or more additional media items; and

adding a song to the video, wherein one or more features of the song are synchronized with the video.

2. The method of claim 1 , wherein:

grouping the media items associated with the user into segments is based on a respective timestamp associated with the media items; and

the respective timestamp associated with each media item represents at least one of an upload time associated with uploading the media item, a capture time associated with capture of the media item, a creation time associated with the media item, or a last modification time associated with the media item.

3. The method of claim 1 , wherein grouping the media items associated with the user into segments is based on the media items including a face of the user and at least one additional face.

4. The method of claim 1 , wherein illustrating the first transition further comprises:

illustrating a zoom-out effect on the first media item, wherein the zoom-out effect is synchronized to the one or more features of the song.

5. The method of claim 1 , wherein grouping the media items associated with the user into the segments includes grouping media items associated with an event into two or more segments based on an event number of media items associated with the event as compared to a total number of media items.

6. The method of claim 1 , wherein selecting the target media from the media items for each of the segments based on the media attributes associated with the media items includes selecting based on a share tendency associated with each of the media items.

7. The method of claim 1 , wherein grouping the media items is based on one or more of the media items being associated with a landmark score that meets a threshold value, wherein the landmark score that meets the threshold value indicates that an important landmark is depicted in the one or more of the media items.

8. A system to generate a video, the system comprising:

one or more processors coupled to a memory;

a media selector module stored in the memory and executable by the one or more processors, the media selector module executable by the one or more processors to:

group media items associated with a user into segments;

select target media from the media items for each of the segments based on media attributes associated with the media items, wherein the target media includes two or more of the media items;

a video generation module stored in the memory and coupled to the media selector module, the video generation module executable by the one or more processors to:

generate the video that includes the target media for each of the segments by:

illustrating a first transition from a first media item from the target media to a second media item from the target media with movement of the first media item from an onscreen location to an offscreen location;

determining whether the target media includes one or more additional media items; and

responsive to determining that the target media includes one or more additional media items, illustrating a second transition from the second media item to a first additional item and that further illustrates additional transitions between a remainder of the one or more additional media items; and

a music module stored on the memory and executable by the one or more processors to add a song to the video, wherein one or more features of the song are synchronized with the video.

9. The system of claim 8 , wherein:

grouping the media items associated with the user into segments is based on a respective timestamp associated with the media items; and

the respective timestamp associated with each media item represents at least one of an upload time associated with uploading the media item, a capture time associated with capture of the media item, a creation time associated with the media item, or a last modification time associated with the media item.

10. The system of claim 8 , wherein grouping the media items associated with the user into segments is based on the media items including a face of the user and at least one additional face.

11. The system of claim 8 , wherein illustrating the first transition further comprises:

illustrating a zoom-out effect on the first media item, wherein the zoom-out effect is synchronized to the one or more features of the song.

12. The system of claim 8 , wherein grouping the media items associated with the user into the segments includes grouping media items associated with an event into two or more segments based on an event number of media items associated with the event as compared to a total number of media items.

13. The system of claim 8 , wherein selecting the target media from the media items for each of the segments based on the media attributes associated with the media items includes selecting based on a share tendency associated with each of the media items.

14. The system of claim 8 , wherein grouping the media items is based on one or more of the media items being associated with a landmark score that meets a threshold value, wherein the landmark score that meets the threshold value indicates that an important landmark is depicted in the one or more of the media items.

15. A non-transitory computer storage medium encoded with a computer program, the computer program comprising instructions that, when executed by one or more computers, cause the one or more computers generate a video by performing operations comprising:

grouping media items associated with a user into segments;

selecting target media from the media items for each of the segments based on media attributes associated with the media items, wherein the target media includes two or more of the media items;

generating the video that includes the target media for each of the segments by:

illustrating a first transition from a first media item from the target media to a second media item from the target media with movement of the first media item from an onscreen location to an offscreen location;

determining whether the target media includes one or more additional media items; and

responsive to determining that the target media includes one or more additional media items, illustrating a second transition from the second media item to a first additional item and that further illustrates additional transitions between a remainder of the one or more additional media items; and

adding a song to the video, wherein one or more features of the song are synchronized with the video.

16. The computer storage medium of claim 15 , wherein:

grouping the media items associated with the user into segments is based on a respective timestamp associated with the media items; and

the respective timestamp associated with each media item represents at least one of an upload time associated with uploading the media item, a capture time associated with capture of the media item, a creation time associated with the media item, or a last modification time associated with the media item.

17. The computer storage medium of claim 15 , wherein grouping the media items associated with the user into segments is based on the media items including a face of the user and at least one additional face.

18. The computer storage medium of claim 15 , wherein illustrating the first transition further comprises:

illustrating a zoom-out effect on the first media item, wherein the zoom-out effect is synchronized to the one or more features of the song.

19. The computer storage medium of claim 15 , wherein grouping the media items associated with the user into the segments includes grouping media items associated with an event into two or more segments based on an event number of media items associated with the event as compared to a total number of media items.

20. The computer storage medium of claim 15 , wherein selecting the target media from the media items for each of the segments based on the media attributes associated with the media items includes selecting based on a share tendency associated with each of the media items.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2019
From: DAI, SHENGYANG; ST. CLAIR, TIMOTHY SEPKOWSKI; ASHIDA, KOJI; CUI, JINGYU; STEELE, JAY; GU, QI; MURPHY-CHUTORIAN, ERIK; NEULANDER, IVAN; LERDA, FLAVIO; HENRY, ERIC CHARLES; CHENG, SHINKO YUANHSIEN; KRISHNASWAMY, ARAVIND; COHEN, DAVID; BEIKZADEH, PARDIS
To: GOOGLE INC.
Reel/Frame 049088/0464 →
CHANGE OF NAME Recorded May 6, 2019
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 049088/0557 →
Continuity (3)
Continuation 15633011 · Jun 26, 2017
Continuation 14885285 · Oct 16, 2015
Related Publication 20190252001A1 · Aug 15, 2019