IP Library › Granted Patent US 10,810,780
Granted Patent B2
US 10,810,780 · App. 16/045,446 · Granted Oct 20, 2020

Systems and methods for real-time complex character animations and interactivity

Inventors: Michael Scott Hutchinson (San Carlos, CA); Nathaniel Christopher Dirksen (Redwood City, CA); Lawrence David Cutler (San Francisco, CA); Apostolos Lerios (Austin, TX)
Assignee: Baobab Studios Inc.
G06T13/40G06F17/16G06K9/6223G06K9/6247G06T9/001G06T13/20G06T15/04G06T17/05G06T17/20G06T19/003G06T19/006G06T19/20G10L19/038H04L65/4053H04N19/124H04N19/46H04N19/463G06T2210/12G06T2219/2021G10L19/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,810,780
App. No.
16/045,446
Granted
Oct 20, 2020
Kind
B2
Abstract

Systems, methods, and non-transitory computer-readable media can receive virtual model information associated with a virtual deformable geometric model. The virtual model information comprises a complex rig comprising a plurality of transforms and a first plurality of vertices defined by a default model, and a simplified rig comprising a second plurality of transforms and a second plurality of vertices. The second plurality of vertices correspond to the first plurality of vertices defined by the default model. The simplified rig and the complex rig are deformed based on an animation to be applied to the virtual deformable geometric model. A set of offset data is calculated. The set of offset data comprises, for each vertex in the first plurality of vertices, an offset between the vertex and a corresponding vertex in the second plurality of vertices.

Claims (49)

1. A computer-implemented method comprising:

receiving, by a computing system, virtual model information associated with a virtual deformable geometric model, the virtual model information comprising

a complex rig comprising a first plurality of transforms and a first plurality of vertices defined by a default model, and

a simplified rig comprising a second plurality of transforms and a second plurality of vertices, wherein the second plurality of vertices correspond to the first plurality of vertices defined by the default model, wherein the simplified rig is derived based on the complex rig and excludes at least one control joint of the complex character rig;

deforming, by the computing system, the simplified rig and the complex rig based on an animation to be applied to the virtual deformable geometric model; and

calculating, by the computing system, a set of offset data, the set of offset data comprising, for each vertex in the first plurality of vertices, an offset between the vertex and a corresponding vertex in the second plurality of vertices.

2. The computer-implemented method of claim 1 , wherein

the animation comprises a plurality of frames, and

the set of offset data comprises, for each vertex in the first plurality of vertices and for each frame in the plurality of frames, an offset between the vertex and a corresponding vertex in the second plurality of vertices.

3. The computer-implemented method of claim 1 , further comprising receiving an indication that the animation is to be applied to the virtual deformable geometric model in real-time in an immersive environment.

4. The computer-implemented method of claim 3 , further comprising:

deforming the simplified rig in real-time based on the animation; and

generating a complex model deformation based on the deforming the simplified rig and the set of offset data.

5. The computer-implemented method of claim 1 , wherein the second plurality of transforms represents a subset of the first plurality of transforms.

6. The computer-implemented method of claim 5 , wherein the first plurality of transforms comprise a plurality of deformation transforms and a plurality of control transforms, and the second plurality of transforms comprises a subset of the plurality of deformation transforms.

7. The computer-implemented method of claim 1 , wherein at least some of the first plurality of transforms are arranged hierarchically.

8. The computer-implemented method of claim 7 , wherein at least some of the second plurality of transforms are arranged hierarchically.

9. The computer-implemented method of claim 1 , wherein the simplified rig further comprises a set of skinning weights that define a relationship between the second plurality of transforms and the second plurality of vertices.

10. The computer-implemented method of claim 9 , wherein each vertex in the second plurality of vertices is associated with no more than four transforms of the second plurality of transforms.

11. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform a method comprising:

receiving virtual model information associated with a virtual deformable geometric model, the virtual model information comprising

a complex rig comprising a first plurality of transforms and a first plurality of vertices defined by a default model, and

a simplified rig comprising a second plurality of transforms and a second plurality of vertices, wherein the second plurality of vertices correspond to the first plurality of vertices defined by the default model, wherein the simplified rig is derived based on the complex rig and excludes at least one control joint of the complex character rig;

deforming the simplified rig and the complex rig based on an animation to be applied to the virtual deformable geometric model; and

calculating a set of offset data, the set of offset data comprising, for each vertex in the first plurality of vertices, an offset between the vertex and a corresponding vertex in the second plurality of vertices.

12. The system of claim 11 , wherein

the animation comprises a plurality of frames, and

the set of offset data comprises, for each vertex in the first plurality of vertices and for each frame in the plurality of frames, an offset between the vertex and a corresponding vertex in the second plurality of vertices.

13. The system of claim 11 , wherein the instructions, when executed by the at least one processor, further cause the system to perform: receiving an indication that the animation is to be applied to the virtual deformable geometric model in real-time in an immersive environment.

14. The system of claim 13 , wherein the instructions, when executed by the at least one processor, further cause the system to perform:

deforming the simplified rig in real-time based on the animation; and

generating a complex model deformation based on the deforming the simplified rig and the set of offset data.

15. The system of claim 11 , wherein the second plurality of j oints represents a subset of the first plurality of joints.

16. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:

receiving virtual model information associated with a virtual deformable geometric model, the virtual model information comprising

a complex rig comprising a first plurality of transforms and a first plurality of vertices defined by a default model, and

a simplified rig comprising a second plurality of transforms and a second plurality of vertices, wherein the second plurality of vertices correspond to the first plurality of vertices defined by the default model, wherein the simplified rig is derived based on the complex rig and excludes at least one control joint of the complex character rig;

deforming the simplified rig and the complex rig based on an animation to be applied to the virtual deformable geometric model; and

calculating a set of offset data, the set of offset data comprising, for each vertex in the first plurality of vertices, an offset between the vertex and a corresponding vertex in the second plurality of vertices.

17. The non-transitory computer-readable storage medium of claim 16 , wherein

the animation comprises a plurality of frames, and

the set of offset data comprises, for each vertex in the first plurality of vertices and for each frame in the plurality of frames, an offset between the vertex and a corresponding vertex in the second plurality of vertices.

18. The non-transitory computer-readable storage medium of claim 16 , wherein the instructions, when executed by the at least one processor of the computing system, further cause the computing system to perform: receiving an indication that the animation is to be applied to the virtual deformable geometric model in real-time in an immersive environment.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the instructions, when executed by the at least one processor of the computing system, further cause the computing system to perform:

deforming the simplified rig in real-time based on the animation; and

generating a complex model deformation based on the deforming the simplified rig and the set of offset data.

20. The non-transitory computer-readable storage medium of claim 16 , wherein the second plurality of joints represents a subset of the first plurality of joints.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2020
From: HUTCHINSON, MICHAEL SCOTT; DIRKSEN, NATHANIEL CHRISTOPHER; CUTLER, LAWRENCE DAVID; LERIOS, APOSTOLOS
To: BAOBAB STUDIOS INC.
Reel/Frame 052551/0942 →
Continuity (2)
Provisional Application 62538590 · Jul 28, 2017
Related Publication 20190035130A1 · Jan 31, 2019
Cited By (5)
US 12,236,510 US 12,387,409 US 12,456,245 US 12,518,170 US 12,569,761