IP Library Granted Patent US 9,454,838
Granted Patent B2
US 9,454,838 · App. 14/289,487 · Granted Sep 27, 2016

Multi-character authoring interface for large scale animations

Inventors: Michael Chann (San Francisco, CA); Jon Collins (San Francisco, CA); Benjamin Morse (Berkeley, CA); Lucas R. A. Ives (Menlo Park, CA); Martin Reddy (San Francisco, CA); Oren M. Jacob (Piedmont, CA)
Assignee: PULLSTRING, INC.
G06T13/00A63F13/60H04N21/8146H04N21/8541G06T2213/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,454,838
App. No.
14/289,487
Granted
Sep 27, 2016
Kind
B2
Abstract

Various of the disclosed embodiments relate to systems and methods for providing animated multimedia, e.g. animated shows, to an audience over a network. Particularly, some embodiments provide systems and methods for generating and providing audio, animation, and other experience-related information so that user's may readily experience the content in a seamless manner (e.g., as an audience member watching a show, playing a video game, etc.). Various embodiments animate “to the audience” based, e.g., on what content the audience is consuming. The animations may be generated in real-time from constituent components and assets in response to user behavior.

Claims (47)

1. A computer-implemented method for generating multi-character interactions, the method comprising:

presenting an interface that enables a content creator to generate an animated, multi-character interaction, wherein the interface includes

a first timeline associated with animation keyframes of a first character,

a second timeline associated with animation keyframes of a second character,

a third timeline depicting a waveform that represents a performance of a line of dialogue by at least one voice actor, and

a textual representation of the line of dialogue,

wherein at least a portion of the first timeline, at least a portion of the second timeline, and at least a portion of the third timeline correspond to a same interval in time;

receiving, from the content creator, user input at the interface that specifies a placement of a desired keyframe at a particular time along the first timeline;

enabling the content creator to associate, via the interface, specific portions of the waveform with one or more tags; and

generating metadata indicating that the first character is to be animated using the desired keyframe at the particular time.

2. The computer-implemented method of claim 1 , wherein the user input includes an indication of a class of desired keyframes that may be placed at the particular time, and wherein generating the metadata comprises generating metadata that includes an indication of the class of desired keyframes.

3. The computer-implemented method of claim 1 , wherein the interface further includes a region depicting a list of lines in a dialogue, the region indicating the likelihood a user will encounter a particular line during an interaction with the first and second characters.

4. The computer-implemented method of claim 3 , wherein the region further comprises a depiction of one or more preceding lines of dialogue the user must encounter prior to encountering the particular line.

5. The computer-implemented method of claim 1 , the method further comprising:

indicating, in the metadata, two or more different resolutions for an asset related to the desired keyframe.

6. The computer-implemented method of claim 5 , the method further comprising:

indicating, in the metadata, a memory size needed to accommodate each of the two or more different resolutions for the asset related to the desired keyframe.

7. The computer-implemented method of claim 1 , wherein the one or more tags enable a group of keyframes to be dynamically determined for each specific portion of the waveform.

8. A non-transitory computer readable medium comprising instructions configured to cause at least one processor to perform a method comprising:

presenting a first timeline associated with animation keyframes of a first character;

presenting a second timeline associated with animation keyframes of a second character;

presenting a third timeline depicting a waveform that represents a performance of a line of dialogue by at least one voice actor,

wherein at least a portion of the first timeline, at least a portion of the second timeline, and at least a portion of the third timeline correspond to a same interval in time;

receiving, from a content creator, user input specifying a placement of a desired keyframe at a particular time along the first timeline; and

generating metadata indicating that the first character is to be animated using the desired keyframe at the particular time.

9. The non-transitory computer readable medium of claim 8 , wherein the user input includes an indication of a class of desired keyframes that may be placed at the particular time, and wherein generating the metadata comprises generating metadata that includes an indication of the class of desired keyframes.

10. The non-transitory computer readable medium of claim 8 , the method further comprising:

presenting a region depicting a list of lines in a dialogue, the region indicating the likelihood a user will encounter a particular line during an interaction with the first and second characters.

11. The non-transitory computer readable medium of claim 10 , wherein the region further comprises a depiction of one or more preceding lines of dialogue the user must encounter prior to encountering the particular line.

12. The non-transitory computer readable medium of claim 8 , wherein the metadata includes an indication of two or more different resolutions for an asset related to the desired keyframe.

13. The non-transitory computer readable medium of claim 12 , wherein the metadata includes an indication of a memory size needed to accommodate each of the two or more different resolutions for the asset related to the desired keyframe.

14. A computer system comprising:

at least one processor;

at least one memory comprising instructions configured to cause the at least one processor to perform a method for generating multi-character interactions, the method comprising:

presenting an interface that enables a content creator to generate an animated interaction, wherein the interface includes

a first timeline associated with animation keyframes of a first character,

a second timeline associated with animation keyframes of a second character,

a third timeline depicting a waveform that represents a performance of a line of dialogue by at least one voice actor, and

a textual representation of the line of dialogue,

wherein at least a portion of the first timeline, at least a portion of the second timeline, and at least a portion of the third timeline correspond to a same interval in time;

receiving, from the content creator, user input at the interface that specifies a placement of a desired keyframe at a particular time along the first timeline; and

generating metadata indicating that the first character is to be animated using the desired keyframe at the particular time.

15. The computer system of claim 14 , wherein the user input includes an indication of a class of desired keyframes that may be placed at the particular time, and wherein generating the metadata comprises generating metadata that includes an indication of the class of desired keyframes.

16. The computer system of claim 14 , wherein the interface further includes a region depicting a list of lines in a dialogue, the region indicating the likelihood a user will encounter a particular line during an interaction with the first and second characters.

17. The computer system of claim 16 , wherein the region further comprises a depiction of one or more preceding lines of dialogue the user must encounter prior to encountering the particular line.

18. The computer system of claim 14 , wherein the metadata includes an indication of two or more different resolutions for an asset related to the desired keyframe.

19. The computer system of claim 18 , wherein the metadata includes an indication of a memory size needed to accommodate each of the two or more different resolutions for the asset related to the desired keyframe.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2019
From: PULLSTRING, INC.
To: CHATTERBOX CAPITAL LLC
Reel/Frame 050670/0006 →
CHANGE OF NAME Recorded May 2, 2016
From: TOYTALK, INC.
To: PULLSTRING, INC.
Reel/Frame 038589/0639 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2014
From: CHANN, MICHAEL; COLLINS, JON; MORSE, BENJAMIN; IVES, LUCAS; REDDY, MARTIN; JACOB, OREN
To: TOYTALK, INC.
Reel/Frame 034127/0209 →
Continuity (2)
Provisional Application 61874314 · Sep 5, 2013
Related Publication 20150062132A1 · Mar 5, 2015