IP Library › Granted Patent US 11,321,919
Granted Patent B2
US 11,321,919 · App. 17/206,480 · Granted May 3, 2022

Volumetric data post-production and distribution system

Inventors: Devin Horsman (Halifax, CA); Andrew MacIntyre (Halifax, CA); Simon McIlhargey (Halifax, CA)
Assignee: ARCTURUS STUDIOS INC.
G06T17/205G06T7/0014G06T7/70G06T15/08G06T15/503
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,321,919
App. No.
17/206,480
Granted
May 3, 2022
Kind
B2
Abstract

Various post-production and distribution tools for volumetric video data are enabled. For instance, a method comprises receiving, by a device comprising a processor, a group of images, determining, by the device, first points of interest of a first image of the group of images and second points of interest of a second image of the group of images, comparing, by the device, the first points of interest to the second points of interest, and determining, by the device, from the first points of interest and the second points of interest and based on a result of the comparing, sets of candidate coordinate positions of a joint of a character represented in the first image and the second image.

Claims (34)

1. A method, comprising:

comparing, by a device comprising a processor, a first frame of a video to a second frame of the video, wherein the video is a first version of the video from multiple versions of the video;

based on the comparing, determining, by the device, a set of three-dimensional points defining a position of a joint of a character represented in the video; and

in response to receiving an edit that adjusts the position of the joint in the first version of the video, concurrently making, by the device, respective corresponding adjustments to the position of the joint in one or more second versions of the video from the multiple versions of the video different than the first version.

2. The method of claim 1 , wherein the first frame is captured from a first vantage point applicable to a scene in which the character is represented, and the second frame is captured from a second vantage point applicable to the scene.

3. The method of claim 1 , wherein the concurrently making the respective corresponding adjustments to the position of the joint in the one or more second versions of the video comprises varying a corresponding adjustment of the respective corresponding adjustments of the position of the joint in at least one of the one or more second versions of the video.

4. The method of claim 1 , further comprising:

in response to receiving another edit that adjusts a rotation of the joint in the first version of the video, concurrently making, by the device, respective corresponding adjustments to the rotation of the joint in the one or more second versions of the video.

5. The method of claim 4 , wherein the concurrently making the respective corresponding adjustments to the rotation of the joint in the one or more second versions of the video, comprises varying a corresponding adjustment of the rotation of the joint in at least one of the one or more second versions of the video.

6. The method of claim 1 , further comprising, generating, by the device, a skeletal rig comprising the joint based on the set of three-dimensional points.

7. The method of claim 1 , wherein the video is a volumetric video generated from two-dimensional videos.

8. A system, comprising:

a processor; and

a memory communicatively coupled to the processor, the memory having stored therein computer-executable instructions, comprising:

an edit unit that:

compares a first frame of a video to a second frame of the video, wherein the video is a first version of the video from multiple versions of the video, and the edit unit;

based on the comparing, determines a group of three-dimensional points defining a position of a joint of a character represented in the video;

in response to receiving an edit that adjusts a rotation of the joint in the first version of the video, concurrently performs respective corresponding adjustments to the rotation of the joint in one or more second versions of the video from the multiple versions of the video different than the first version.

9. The system of claim 8 , wherein the first frame is captured from a first perspective to a scene in which the character is represented, and the second frame is captured from a second perspective to the scene different than the first perspective.

10. The system of claim 8 , wherein the edit unit, in response to receiving another edit that adjusts the position of the joint in the first version of the video, concurrently performs respective corresponding adjustments to the position of the joint in the one or more second versions of the video.

11. The system of claim 10 , wherein the edit unit further varies a corresponding adjustment of the position of the joint in at least one of the one or more second versions of the video.

12. The system of claim 8 , wherein the edit unit generates a skeletal rig comprising the joint based on the group of three-dimensional points.

13. The system of claim 8 , wherein the video is a volumetric video generated from two-dimensional videos.

14. The system of claim 8 , wherein the edit unit further varies a corresponding adjustment of the rotation of the joint in at least one of the one or more second versions of the video.

15. A non-transitory machine-readable medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations, comprising:

comparing a first frame of a video to a second frame of the video, wherein the video is a first version of the video from multiple versions of the video;

based on the comparing, determining three-dimensional points defining a position of a joint of a character represented in the video; and

in response to receiving an edit that adjusts the position of the joint in the first version of the video, concurrently generating respective corresponding adjustments to the position of the joint in one or more second versions of the video from the multiple versions of the video different than the first version.

16. The non-transitory machine-readable medium of claim 15 , wherein the first frame is captured from a first vantage point applicable to a scene in which the character is represented, and the second frame is captured from a second vantage point applicable to the scene.

17. The non-transitory machine-readable medium of claim 15 , wherein the concurrently generating the respective corresponding adjustments to the position of the joint in the one or more second versions of the video, comprises varying a corresponding adjustment of the position of the joint in at least one of the one or more second versions of the video.

18. The non-transitory machine-readable medium of claim 15 , wherein the operations further comprise:

in response to receiving another edit that adjusts a rotation of the joint in the first version of the video, concurrently generating respective corresponding adjustments to the rotation of the joint in second versions of the video from the multiple versions of the video different than the first version.

19. The non-transitory machine-readable medium of claim 18 , wherein the concurrently generating the respective corresponding adjustments to the rotation of the joint in the second versions of the video, comprises varying a corresponding adjustment of the rotation of the joint in at least one of the second versions of the video.

20. The non-transitory machine-readable medium of claim 15 , wherein the operations further comprise generating a skeletal rig comprising the joint based on the three-dimensional points.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2021
From: HORSMAN, DEVIN; MACINTYRE, ANDREW; MCILHARGEY, SIMON
To: ARCTURUS STUDIOS INC.
Reel/Frame 055648/0928 →
Continuity (3)
Continuation 16523014 · Jul 26, 2019
Provisional Application 62711419 · Jul 27, 2018
Related Publication 20210225079A1 · Jul 22, 2021
Cited By (1)
US 12,597,445