IP Library Granted Patent US 12,299,266
Granted Patent B2
US 12,299,266 · App. 18/751,711 · Granted May 13, 2025

Systems, methods, and user interfaces for editing digital assets

Inventors: Melanie Perkins (Surry Hills, AU); Jessica Faccin (Rockdale, AU); Andrew James Peacock (Rozelle, AU); Lucinda Phoebe Ogden-Doyle (Newcastle, AU)
Assignee: Canva Pty Ltd
G06F3/04842G06F3/04847
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,299,266
App. No.
18/751,711
Granted
May 13, 2025
Kind
B2
Abstract

Described herein is a computer implemented method. The method includes accessing asset data defining a plurality of components. An overview GUI that includes a plurality of corresponding component previews is displayed, the plurality of component previews being displayed adjacent one another along an axis in an order that is based on a component order. The overview GUI further includes an audio element preview corresponding to an audio element, the audio element preview being aligned with the plurality of component previews in order to indicate the audio element's start time and end time. A first user input changing the display width of the first component preview is detected. In response, a new duration for the first component is determined and a determination that adjustment of the audio element is required is also determined.

Claims (63)

1. A method comprising:

accessing, by one or more computer devices, asset data defining a document-type asset that includes one or more document pages in a page order, wherein the document-type asset is initially a non-playable document-type asset that does not include any playable design elements;

displaying, on a display device, an overview graphical user interface (GUI), the overview GUI including one or more previews, each preview corresponding to a document page;

while displaying the overview GUI, concurrently displaying an editing GUI on the display device, the editing GUI displaying a view of a particular document page;

detecting, by the one or more computer devices, a first conversion event comprising a first user input that adds a first playable design element to the particular document page of the non-playable document-type asset; and

in response to detecting the first conversion event:

adding, by the one or more computer devices, the first playable design element to the particular document page of the document-type asset thereby converting the non-playable document-type asset into a playable asset; and

updating, by the one or more computer devices, the overview GUI to display one or more playable asset controls while continuing to display the one or more previews in the overview GUI, wherein the one or more playable asset controls enable playback functionality for the playable asset; and

storing, in a non-transitory computer-readable storage medium, the playable asset including the first playable design element.

2. The computer implemented method of claim 1 , wherein the one or more playable asset controls includes a play control which can be activated to cause playback of the playable asset.

3. The computer implemented method of claim 1 , wherein the one or more playable asset controls includes a playhead, the playhead marking a current playback position within the playable asset.

4. The computer implemented method of claim 1 , wherein:

the playable asset data defines a plurality of document pages; and

displaying the overview GUI includes displaying, on the display device, a plurality of previews, wherein each preview corresponds to a document page and the plurality of previews are displayed adjacent one another along an axis in an order that is based on the page order as defined by the asset data.

5. The computer implemented method of claim 1 , wherein in response to detecting the first conversion event the method further includes displaying, on the display device, a zoom mode control, the zoom mode control operable by a user to switch between an overview zoom mode and an editor zoom mode.

6. The computer implemented method of claim 1 , wherein the first user input is a drag and drop input.

7. The computer implemented method of claim 6 , wherein the drag and drop input is input that drags the first playable design element to the view of the particular document page that is displayed in the editor GUI and drops the first playable design element onto the view of the particular document page that is displayed in the editor GUI.

8. The computer implemented method of claim 1 , wherein the first playable design element is selected from a group comprising: a video design element; and an audio design element.

9. The computer implemented method of claim 1 , wherein following detection of the first conversion event and displaying the one or more playable asset controls, the method further includes:

detecting, by the one or more computer devices, a second conversion event comprising a second user input that removes the first playable design element from the particular document page of the playable asset; and

in response to detecting the second conversion event:

removing the first playable design element from the particular document page of the playable asset; and

hiding the one or more playable asset controls.

10. A system comprising:

one or more computer devices;

a display device; and

one or more non-transitory computer-readable storage media storing instructions, which when executed by the one or more computer devices, cause the one or more computer devices to implement a method including:

accessing asset data defining a document-type asset that includes one or more document pages in a page order, wherein the document-type asset is initially a non-playable document-type asset that does not include any playable design elements;

displaying, on the display device, an overview graphical user interface (GUI), the overview GUI including one or more previews, each preview corresponding to a document page;

while displaying the overview GUI, concurrently displaying an editing GUI on the display device, the editing GUI displaying a view of a particular document page;

detecting a first conversion event comprising a first user input that adds a first playable design element to the particular document page of the non-playable document-type asset; and

in response to detecting the first conversion event:

adding the first playable design element to the particular document page of the non-playable document-type asset thereby converting the non-playable document-type asset into a playable asset; and

updating the overview GUI to display one or more playable asset controls while continuing to display the one or more previews in the overview GUI, wherein the one or more playable asset controls enable playback functionality for the playable asset; and

storing, in the one or more non-transitory computer-readable storage media, the playable asset including the first playable design element.

11. The computer processing system of claim 10 , wherein the one or more playable asset controls includes a play control which can be activated to cause playback of the playable asset.

12. The computer processing system of claim 10 , wherein the one or more playable asset controls includes a playhead, the playhead marking a current playback position within the playable asset.

13. The computer processing system of claim 10 , wherein:

the playable asset data defines a plurality of document pages; and

displaying the overview GUI includes displaying, on the display device, a plurality of previews, wherein each preview corresponds to a document page and the plurality of previews are displayed adjacent one another along an axis in an order that is based on the page order as defined by the asset data.

14. The computer processing system of claim 10 , wherein in response to detecting the first conversion event the method further includes displaying, on the display device, a zoom mode control, the zoom mode control operable by a user to switch between an overview zoom mode and an editor zoom mode.

15. The computer processing system of claim 10 , wherein the first user input is a drag and drop input.

16. The computer processing system of claim 15 , wherein the drag and drop input is input that drags the first playable design element to the view of the particular document page that is displayed in the editor GUI and drops the first playable design element onto the view of the particular document page that is displayed in the editor GUI.

17. The computer processing system of claim 10 , wherein the first playable design element is selected from a group comprising: a video design element; and an audio design element.

18. The computer processing system of claim 10 , wherein following detection of the first conversion event and displaying the one or more playable asset controls, the method further includes:

detecting a second conversion event, the second conversion event being a second user input that removes the first playable design element from the particular document page of the playable asset; and

in response to detecting the second conversion event:

removing the first playable design element from the particular document page of the playable asset; and

hiding the one or more playable asset controls.

19. One or more non-transitory computer-readable storage media storing instructions, which when executed by one or more computer devices, cause the one or more computer devices to implement a method including:

accessing asset data defining a document-type asset that includes one or more document pages in a page order, wherein the document-type asset is initially a non-playable document-type asset that does not include any playable design elements;

displaying, on a display device, an overview graphical user interface (GUI), the overview GUI including one or more previews, each preview corresponding to a document page;

while displaying the overview GUI, concurrently displaying an editing GUI on the display device, the editing GUI displaying a view of a particular document page;

detecting a first conversion event comprising a first user input that adds a first playable design element to the particular document page of the non-playable document-type asset; and

in response to detecting the first conversion event:

adding the first playable design element to the particular document page of the non-playable document-type asset, thereby converting the non-playable document-type asset into a playable asset; and

updating the overview GUI to display one or more playable asset controls, while continuing to display the one or more previews in the overview GUI, wherein the one or more playable asset controls enable playback functionality for the playable asset; and

storing the playable asset including the first playable design element.

20. The one or more non-transitory computer-readable storage media of claim 19 , wherein following detection of the first conversion event and displaying the one or more playable asset controls, the method further includes:

detecting a second conversion event comprising a second user input that removes the first playable design element from the particular document page of the playable asset; and

in response to detecting the second conversion event:

removing the first playable design element from the particular document page of the playable asset; and

hiding the one or more playable asset controls.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2024
From: PERKINS, MELANIE; FACCIN, JESSICA; PEACOCK, ANDREW JAMES; OGDEN-DOYLE, LUCINDA PHOEBE
To: CANVA PTY LTD
Reel/Frame 067813/0942 →
Priority Claims (1)
AU 2022203064 · May 6, 2022 · national
Continuity (2)
Continuation 18144196 · May 6, 2023
Related Publication 20240353989A1 · Oct 24, 2024
References Cited (33)
US 7512886B1 · Herberger et al. · 2009 [cited by applicant]
US 7788605B1 · Shoemaker · 2010 [cited by applicant]
US 7890867B1 · Margulis · 2011 [cited by examiner]
US 8458595B1 · Margulis · 2013 [cited by applicant]
US 8489468B2 · Robbin et al. · 2013 [cited by applicant]
US 8812969B2 · Hart et al. · 2014 [cited by applicant]
US 8875025B2 · Ubillos et al. · 2014 [cited by applicant]
US 10506003B1 · Cabanero et al. · 2019 [cited by applicant]
US 20120185772A1 · Kotelly et al. · 2012 [cited by applicant]
US 20130124992A1 · Lyons et al. · 2013 [cited by applicant]
US 20140219636A1 · Shah · 2014 [cited by applicant]
US 20150019972A1 · Matsuda et al. · 2015 [cited by applicant]
US 20160139871A1 · Farshi et al. · 2016 [cited by applicant]
US 20170294208A1 · Balabhadrapatruni et al. · 2017 [cited by applicant]
EP 1587111B1 · 2019 [cited by applicant]
WO 2020198792A1 · 2020 [cited by applicant]
Examination Report No. 1 for Australian Patent Application No. 2021202306, mailed on Apr. 1, 2022, pp. 1-4. [cited by applicant]
Examination Report No. 1 for Australian Patent Application No. 2022203064, mailed on Jul. 25, 2022, pp. 1-6. [cited by applicant]
Examination Report No. 1 for Australian Patent Application No. 2022203656, mailed on Jul. 25, 2022, pp. 1-6. [cited by applicant]
Examination Report No. 1 for Australian Patent Application No. 2022203658, mailed Jul. 25, 2022, pp. 1-6. [cited by applicant]
Examination Report No. 1 for Australian Patent Application No. 2022203659, mailed on Jul. 25, 2022, pp. 1-6. [cited by applicant]
Examination Report No. 2 for Australian Patent Application No. 2022203658, mailed on Mar. 9, 2023, pp. 1-5. [cited by applicant]
Examination Report No. 2 for Australian Patent Application No. 2022203659, mailed on Mar. 9, 2023, pp. 1-6. [cited by applicant]
Get Better Music Tracks for Video Editing with Adobe Remix | Premiere Pro Effects for Audio, https://www.youtube.com/watch?v=d7K0WBU5-1o, Published on Feb. 9, 2022, Transcript enclosed, pp. 1-2. [cited by applicant]
How to Adjust Song Length to Fit Video / Auto Remix | PowerDirector, https://www.youtube.com/watch?v=pgBA8WG72f4, Published on Mar. 3, 2018, Transcript enclsoed, pp. 1-13. [cited by applicant]
How to Start using WeVideo—Storyboard/Timeline, https://www.youtube.com/watch?v=ZPd_zzZREyw, Published on Sep. 4, 2020, Transcript enclosed, pp. 1-21. [cited by applicant]
How To Zoom In And Out On The DaVinci Resolve Edit Viewer, https://www.youtube.com/watch?v=1Lljt6cH8XU, Published on May 31, 2020, Transcript enclosed, pp. 1-4. [cited by applicant]
Import Photoshop Files into Premiere | Video Editing Tutorials, https://www.youtube.com/watch?v=doqk9BS48bc, Published Mar. 13, 2018, Transcript enclosed, pp. 1-9. [cited by applicant]
Import Powerpoint Slides into Camtasia 2020, https://www.youtube.com/watch?v=Z7xS-cRceho, Published on Sep. 23, 2017, Transcript enclosed, pp. 1-6. [cited by applicant]
Move Around The Timeline in Final Cut Pro with Ease, https://www.youtube.com/watch?v=hTjEeHoRU8s, Published on Nov. 20, 2016, Transcript enclosed, pp. 1-10. [cited by applicant]
PowerDirector—How to effectively use the storyboard view, https://www.youtube.com/watch?v=_fRq2yFR2GI, Published on Jul. 4, 2017, Transcript enclosed, pp. 1-8. [cited by applicant]
Premiere Pro Program Monitor Panel Zoom Tip, https://www.youtube.com/watch?v=8ou2eFq_Be0, Published on Sep. 20, 2017, Transcript enclosed, pp. 1-5. [cited by applicant]
Use AI to Retime Your Music with Remix in Premiere Pro, https://www.youtube.com/watch?v=d7K0WBU5-1o, Published on Feb. 9, 2022, Transcript enclosed, pp. 1-2. [cited by applicant]