IP Library Granted Patent US 12,260,880
Granted Patent B2
US 12,260,880 · App. 17/958,129 · Granted Mar 25, 2025

Media editing using storyboard templates

Inventors: Daniel J. Wiersema (San Jose, CA); Teresa F. Perera (Fairfield, CT); Jennifer L. Nassef Anderson (Sierra Madre, CA); David R. Black (San Jose, CA); Ivan Pinzon (Cupertino, CA); Nathalie Castel (Sunnyvale, CA); Andrea L. Angquist (Los Altos Hills, CA); Kain Osterholt (San Jose, CA); Peter A. Steinauer (San Francisco, CA); Shawn M. Spencer (Sunnyvale, CA); Hans H. Kim (Santa Monica, CA)
Assignee: Apple Inc.
G11B27/031G11B27/34
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,260,880
App. No.
17/958,129
Granted
Mar 25, 2025
Kind
B2
Abstract

In some implementations, a computing device can guide a user of the computing device through creation of media content using storyboard templates. For example, the user may invoke a media editing application on the computing device. The media editing application can be configured with a plurality of different storyboard templates to be used for the creation of different types or categories of content. A storyboard template corresponding to a particular type of content can include suggested media segments and suggested media clips for the particular type, or topic, of content. Thus, a particular storyboard template can include suggested media segments and suggested media clips that are different from other storyboard templates. The media editing application can include features that allow the user to edit the storyboard template and/or the media content corresponding to a storyboard project created by the user.

Claims (79)

1. A method comprising:

presenting, by a computing device, a plurality of storyboard templates on a display of the computing device;

receiving, by the computing device, a first user input selecting a particular one of the storyboard templates, wherein the particular storyboard template includes recommended segment types;

presenting, by the computing device, a plurality of style templates on the display of the computing device, where each style template includes style attributes that define how media items of the storyboard media project will appear when presented on the display;

receiving, by the computing device, a second user input selecting a particular one of the style templates,

creating, by the computing device, a storyboard media project based on the particular storyboard template selected by the user and the particular style template selected by the user;

displaying, by the computing device, one or more representations of the recommended segment types based on the particular storyboard template selected by the user;

subsequent to displaying the one or more representations of the recommended segment types:

receiving, by the computing device, content corresponding to at least one of the recommended segment types;

wherein the storyboard media project is created or updated based on the content received by the computing device; and

presenting, by the computing device, a graphical representation of the storyboard media project.

2. The method of claim 1 , further comprising: presenting, by the computing device, a graphical representation of the particular storyboard template on the display of the computing device, the graphical representation including at least one of the recommended segment types and a recommended shot associated with the at least one recommended segment.

3. The method of claim 2 , further comprising:

receiving, by the computing device, a third user input selecting a media item for the recommended shot;

associating, by the computing device, the media item with the recommended shot; and

presenting, by the computing device, a graphical representation of the media item associated with the recommended shot on the graphical representation of the storyboard template.

4. The method of claim 3 , further comprising:

receiving, by the computing device, a fourth user input initiating playback of the media item associated with the recommended shot; and

presenting, by the computing device, the media item on the display of the computing device according to the particular style template selected by the user.

5. The method of claim 4 , further comprising:

receiving, by the computing device, a fifth user input selecting a layout for presenting the media item; and

presenting, by the computing device, the media item on the display of the computing device according to the particular style template and the layout selected by the user, where an appearance of graphical elements of the layout is determined based on the style attributes of the particular style template.

6. The method of claim 1 , further comprising:

receiving, by the computing device, a sixth user input to selecting a storyboard element to add to the particular storyboard template, where the storyboard element is selected from a group of elements that includes a storyboard segment and a storyboard shot;

in response to the sixth input, adding the storyboard element to the particular storyboard template; and

presenting, by the computing device, a graphical representation of the particular storyboard template on the display of the computing device, the graphical representation including the added storyboard element.

7. A computing device comprising:

a one or more processors; and

a non-transitory computer readable medium including one or more sequences of instructions that, when executed by the one or more processors, cause the processors to perform operations comprising:

presenting, by the computing device, a plurality of storyboard templates on a display of the computing device;

receiving, by the computing device, a first user input selecting a particular one of the storyboard templates, wherein the particular storyboard template includes recommended segment types;

presenting, by the computing device, a plurality of style templates on the display of the computing device, where each style template includes style attributes that define how media items of the storyboard media project will appear when presented on the display;

receiving, by the computing device, a second user input selecting a particular one of the style templates,

creating, by the computing device, a storyboard media project based on the particular storyboard template selected by the user and the particular style template selected by the user;

displaying, by the computing device, one or more representations of the recommended segment types based on the particular storyboard template selected by the user;

subsequent to displaying the one or more representations of the recommended segment types: receiving, by the computing device, content corresponding to at least one of the recommended segment types;

wherein the storyboard media project is created or updated based on the content received by the computing device; and

presenting, by the computing device, a graphical representation of the storyboard media project.

8. The computing device of claim 7 , wherein the instructions cause the processors to perform operations comprising:

presenting, by the computing device, a graphical representation of the particular storyboard template on the display of the computing device, the graphical representation including at least one of the recommended segments and a recommended shot associated with the at least one recommended segment.

9. The computing device of claim 8 , wherein the instructions cause the processors to perform operations comprising:

receiving, by the computing device, a third user input selecting a media item for the recommended shot;

associating, by the computing device, the media item with the recommended shot; and

presenting, by the computing device, a graphical representation of the media item associated with the recommended shot on the graphical representation of the storyboard template.

10. The computing device of claim 9 , wherein the instructions cause the processors to perform operations comprising:

receiving, by the computing device, a fourth user input initiating playback of the media item associated with the recommended shot; and

presenting, by the computing device, the media item on the display of the computing device according to the particular style template selected by the user.

11. The computing device of claim 10 , wherein the instructions cause the processors to perform operations comprising:

receiving, by the computing device, a fifth user input selecting a layout for presenting the media item; and

presenting, by the computing device, the media item on the display of the computing device according to the particular style template and the layout selected by the user, where an appearance of graphical elements of the layout is determined based on the style attributes of the particular style template.

12. The computing device of claim 7 , wherein the instructions cause the processors to perform operations comprising:

receiving, by the computing device, a sixth user input to selecting a storyboard element to add to the particular storyboard template, where the storyboard element is selected from a group of elements that includes a storyboard segment and a storyboard shot;

in response to the sixth input, adding the storyboard element to the particular storyboard template; and

presenting, by the computing device, a graphical representation of the particular storyboard template on the display of the computing device, the graphical representation including the added storyboard element.

13. A non-transitory computer readable medium including one or more sequences of instructions that, when executed by one or more processors, cause the processors to perform operations comprising:

presenting, by the computing device, a plurality of storyboard templates on a display of the computing device;

receiving, by the computing device, a first user input selecting a particular one of the storyboard templates, wherein the particular storyboard template includes recommended segment types;

presenting, by the computing device, a plurality of style templates on the display of the computing device, where each style template includes style attributes that define how media items of the storyboard media project will appear when presented on the display;

receiving, by the computing device, a second user input selecting a particular one of the style templates,

creating, by the computing device, a storyboard media project based on the particular storyboard template selected by the user and the particular style template selected by the user;

displaying, by the computing device, one or more representations of the recommended segment types based on the particular storyboard template selected by the user;

subsequent to displaying the one or more representations of the recommended segment types: receiving, by the computing device, content corresponding to at least one of the recommended segment types;

wherein the storyboard media project is created or updated based on the content received by the computing device; and

presenting, by the computing device, a graphical representation of the storyboard media project.

14. The non-transitory computer readable medium of claim 13 , wherein the instructions cause the processors to perform operations comprising:

presenting, by the computing device, a graphical representation of the particular storyboard template on the display of the computing device, the graphical representation including at least one of the recommended segments and a recommended shot associated with the at least one recommended segment.

15. The non-transitory computer readable medium of claim 14 , wherein the instructions cause the processors to perform operations comprising:

receiving, by the computing device, a third user input selecting a media item for the recommended shot;

associating, by the computing device, the media item with the recommended shot; and

presenting, by the computing device, a graphical representation of the media item associated with the recommended shot on the graphical representation of the storyboard template.

16. The non-transitory computer readable medium of claim 15 , wherein the instructions cause the processors to perform operations comprising:

receiving, by the computing device, a fourth user input initiating playback of the media item associated with the recommended shot;

presenting, by the computing device, the media item on the display of the computing device according to the particular style template selected by the user;

receiving, by the computing device, a fifth user input selecting a layout for presenting the media item; and

presenting, by the computing device, the media item on the display of the computing device according to the particular style template and the layout selected by the user, where an appearance of graphical elements of the layout is determined based on the style attributes of the particular style template.

17. The non-transitory computer readable medium of claim 13 , wherein the instructions cause the processors to perform operations comprising:

receiving, by the computing device, a sixth user input to selecting a storyboard element to add to the particular storyboard template, where the storyboard element is selected from a group of elements that includes a storyboard segment and a storyboard shot;

in response to the sixth input, adding the storyboard element to the particular storyboard template; and

presenting, by the computing device, a graphical representation of the particular storyboard template on the display of the computing device, the graphical representation including the added storyboard element.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2022
From: WIERSEMA, DANIEL J; PERERA, TERESA F; NASSEF ANDERSON, JENNIFER L; BLACK, DAVID R; PINZON, IVAN; CASTEL, NATHALIE; ANGQUIST, ANDREA L; STEINAUER, PETER A; KIM, HANS H; OSTERHOLT, KAIN
To: APPLE INC.
Reel/Frame 061293/0718 →
Continuity (2)
Provisional Application 63317434 · Mar 7, 2022
Related Publication 20230282240A1 · Sep 7, 2023
References Cited (9)
US 9998722B2 · Swearingen · 2018 [cited by examiner]
US 20130272673A1 · Swearingen · 2013 [cited by examiner]
US 20170092331A1 · Eppolito · 2017 [cited by examiner]
US 20170109585A1 · Matias · 2017 [cited by examiner]
US 20180024705A1 · Silano · 2018 [cited by examiner]
US 20180068019A1 · Novikoff · 2018 [cited by examiner]
US 20190130192A1 · Kauffmann · 2019 [cited by examiner]
US 20200382723A1 · Pena · 2020 [cited by examiner]
US 20240205516A1 · Ehrhard · 2024 [cited by examiner]