IP Library Granted Patent US 12,189,921
Granted Patent B2
US 12,189,921 · App. 18/233,823 · Granted Jan 7, 2025

Motion stills experience

Inventors: Matthias Grundmann (San Jose, CA); Jokubas Zukerman (San Francisco, CA); Marco Paglia (San Francisco, CA); Kenneth Conley (Mountain View, CA); Karthik Raveendran (San Francisco, CA); Reed Morse (Palo Alto, CA)
Assignee: Google LLC
G06F3/0482G06F3/0485G06F3/04883G11B27/028G11B27/029H04N5/2628
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,189,921
App. No.
18/233,823
Granted
Jan 7, 2025
Kind
B2
Abstract

The technology disclosed herein includes a user interface for viewing and combining media items into a video. An example method includes presenting a user interface that displays media items in a first portion of the user interface; receiving user input in the first portion that comprises a selection of a first media item; upon receiving the user input, adding the first media item to a set of selected media items in a second portion of the user interface, and presenting a selectable control element in the second portion of the user interface, wherein the control element enables a user to initiate an operation pertaining to the creation of the video based on the set of selected media items, and creating the video based on video content of the set of selected media items.

Claims (41)

1. A method comprising:

presenting, by a processing device, a user interface facilitating a creation of a video from a plurality of media items that comprise video content, wherein the plurality of media items comprise a first media item and a second media item and the user interface displays the first media item and the second media item in a first portion of the user interface, wherein the first portion is scrollable along an axis;

receiving user input in the first portion of the user interface, wherein the user input comprises a selection of the first media item in the first portion of the user interface;

upon receiving the user input, adding the first media item to a set of selected media items in a second portion of the user interface, and presenting a selectable control element in the second portion of the user interface, wherein the control element enables a user to initiate an operation pertaining to the creation of the video based on the set of selected media items; and

creating the video based on the set of selected media items.

2. The method of claim 1 , wherein the first media item comprises a still image and a video clip that are captured in parallel, wherein the still image is displayed in the second portion and wherein the video clip is played in the first portion and comprises video content from before and after the still image is captured.

3. The method of claim 2 , wherein the still image of the first media item and the video clip of the first media item are linked together and are stored in different formats.

4. The method of claim 1 , wherein the second portion of the user interface displays a still image for each media item in the set of selected media items.

5. The method of claim 1 , wherein the user input comprises user input of a first type and wherein the method of claim 1 further comprises:

receiving first additional user input;

in response to determining that the first additional user input is of a second type, scrolling the plurality of media items in the first portion of the user interface;

receiving second additional user input; and

in response to determining that the second additional user input is of a third type, removing the first media item from the first portion of the user interface.

6. The method of claim 5 , wherein the first type, the second type, and the third type of user inputs comprise swiping gestures in different directions.

7. The method of claim 1 , wherein the first portion and the second portion are displayed concurrently and are scrollable along different axes.

8. The method of claim 7 , wherein the first portion of the user interface presents a playing video clip of the second media item adjacent a still image of a third media item when image processing of the third media item is incomplete.

9. The method of claim 1 , further comprising:

performing image stabilization on the first media item after retrieving the first media item from persistent data storage.

10. The method of claim 9 , wherein the image stabilization is performed by a computing process that is separate from a computing process that initiates a capture of the first media item.

11. The method of claim 9 , wherein the image stabilization crops and zooms a portion of a video clip of the first media item to reduce movement of an object without changing dimensions of the portion of the video clip.

12. The method of claim 9 , wherein the image stabilization trims a portion of a video clip of the first media item in response to detecting movement that exceeds a predefined threshold, wherein the portion of the video clip that is trimmed is at an end of the video clip.

13. The method of claim 1 , further comprising:

searching a persistent data storage for multiple media items that each comprise a still image and a video clip; and

modifying video content of each video clip of the multiple media items before presenting a respective media item in the first portion of the user interface.

14. The method of claim 1 , wherein creating the video comprises combining a video clip of the first media item and a video clip of the second media item.

15. A client device comprising:

a memory; and

a processing, device communicably coupled to the memory, to perform operations comprising:

presenting a user interface facilitating a creation of a video from a plurality of media items that comprise video content, wherein the plurality of media items comprise a first media item and a second media item and the user interface displays the first media item and the second media item in a first portion of the user interface, wherein the first portion is scrollable along an axis;

receiving user input in the first portion of the user interface, wherein the user input comprises a selection of the first media item in the first portion of the user interface;

upon receiving the user input, adding the first media item to a set of selected media items in a second portion of the user interface, and presenting a selectable control element in the second portion of the user interface, wherein the control element enables a user to initiate an operation pertaining to the creation of the video based on the set of selected media items; and

creating the video based on the set of selected media items.

16. The client device of claim 15 , wherein the first media item comprises a still image and a video clip that are captured in parallel, wherein the still image is displayed in the second portion and wherein the video clip is played in the first portion and comprises video content from before and after the still image is captured.

17. The client device of claim 16 , wherein the still image of the first media item and the video clip of the first media item are linked together and are stored in different formats.

18. A non-transitory machine-readable storage medium storing instructions which, when executed, cause a processing device to perform operations comprising:

presenting, by the processing device, a user interface facilitating a creation of a video from a plurality of media items that comprise video content, wherein the plurality of media items comprise a first media item and a second media item and the user interface displays the first media item and the second media item in a first portion of the user interface, wherein the first portion is scrollable along an axis;

receiving user input in the first portion of the user interface, wherein the user input comprises a selection of the first media item in the first portion of the user interface;

upon receiving the user input, adding the first media item to a set of selected media items in a second portion of the user interface, and presenting a selectable control element in the second portion of the user interface, wherein the control element enables a user to initiate an operation pertaining to the creation of the video based on the set of selected media items; and

creating the video based on the set of selected media items.

19. The non-transitory machine-readable storage medium of claim 18 , wherein the first media item comprises a still image and a video clip that are captured in parallel, wherein the still image is displayed in the second portion and wherein the video clip is played in the first portion and comprises video content from before and after the still image is captured.

20. The non-transitory machine-readable storage medium of claim 19 , wherein the still image of the first media item and the video clip of the first media item are linked together and are stored in different formats.

Assignments (2)
CHANGE OF NAME Recorded Feb 1, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 066488/0574 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 30, 2023
From: GRUNDMANN, MATTHIAS; ZUKERMAN, JOKUBAS; PAGLIA, MARCO; CONLEY, KENNETH; RAVEENDRAN, KARTHIK; MORSE, REED
To: GOOGLE INC.
Reel/Frame 065379/0307 →
Continuity (6)
Continuation 17978086 · Oct 31, 2022
Continuation 17536350 · Nov 29, 2021
Continuation 16741091 · Jan 13, 2020
Continuation 15187960 · Jun 21, 2016
Provisional Application 62345984 · Jun 6, 2016
Related Publication 20230384911A1 · Nov 30, 2023
References Cited (16)
US 20020180774A1 · Errico · 2002 [cited by applicant]
US 20050071782A1 · Barrett · 2005 [cited by examiner]
US 20060064733A1 · Norton · 2006 [cited by applicant]
US 20070244984A1 · Svendsen · 2007 [cited by applicant]
US 20100254672A1 · Gottlieb · 2010 [cited by applicant]
US 20100313166A1 · Nakayama · 2010 [cited by applicant]
US 20110075727A1 · Van Vleck · 2011 [cited by examiner]
US 20110193978A1 · Wu · 2011 [cited by applicant]
US 20120328025A1 · Chang · 2012 [cited by examiner]
US 20140229894A1 · Vinna · 2014 [cited by applicant]
US 20160225408A1 · Khan · 2016 [cited by examiner]
US 20170357382A1 · Miura · 2017 [cited by examiner]
“PHLivePhoto”, https://developer.apple.com/library/ios/documentation/Photos/Reference/PHLivePhoto_Class/index.html#//apple_ref/occ/cl/PHLivePhoto, Oct. 21, 2015, 2 pages. [cited by applicant]
“IOS 9.1”, https://developer.apple.com/library/ios/releasenotes/General/WhatsNewIniOS/Articles/iOS9_1.html, Mar. 1, 2016, 2 pages. [cited by applicant]
https://developer.apple.com/library/ios/releasenotes/General/WhatsNewIniOS/Articles/iOS9_1.html, Mar. 1, 2016. [cited by applicant]
Zibreg, Christian, “Instagram Update brings the Ability to Combine Several Clips into one Video”, Apr. 11, 2016, https://www.idownloadblog.com/2016/04/11/instagramcombine-multiple-clips/, 4 pages. [cited by applicant]