IP Library Granted Patent US 7,116,324
Granted Patent B2
US 7,116,324 · App. 10/674,688 · Granted Oct 3, 2006

Method for minimizing visual artifacts converting two-dimensional motion pictures into three-dimensional motion pictures

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,116,324
App. No.
10/674,688
Granted
Oct 3, 2006
Kind
B2
Abstract

A method for converting two-dimensional images into three-dimensional images includes: tracking an object in an image, the object having an object edge and an object outline thereabout, from frame to frame over a sequence of images; and creating object outlines in subsequent frames for converting two-dimensional images into three-dimensional images maintaining an object outline to object edge distance spacing relationship as the object moves or changes from frame to frame.

Claims (96)

1. A method for converting two-dimensional images into three-dimensional images, comprising:

tracking an object in an image, the object having an object edge and an object outline thereabout, from frame to frame over a sequence of images; and

creating object outlines in subsequent frames for converting two-dimensional images into three-dimensional images maintaining an object outline to object edge distance spacing relationship as the object moves or changes from frame to frame;

wherein a virtual object corresponding to the object is defined such that the virtual object is tracked and the object outlines generated independent of whether the object is obstructed from view in a subsequent frame by another object moving into the foreground.

2. The method for converting two-dimensional images into three-dimensional images of claim 1 , wherein:

one or more sub-objects contained within the object are defined such that the sub-objects are linked together and tracked as the object moves or changes from frame to frame.

3. The method for converting two-dimensional images into three-dimensional images of claim 1 , wherein the object outlines obey a maximum error threshold relative to an initial frame of definition.

4. The method for converting two-dimensional images into three-dimensional images of claim 1 , wherein:

the object outlines are created employing a pixel image data tracking technique.

5. A method for converting two-dimensional images into three-dimensional images, comprising:

tracking an object in an image, the object having an object edge and an object outline thereabout, from frame to frame over a sequence of images; and

creating object outlines in subseciuent frames for converting two-dimensional images into three-dimensional images maintaining an object outline to object edge distance spacing relationship as the object moves or changes from frame to frame;

wherein one or more points contained within the object are associated with depth information and defined such that the one or more points track the object as the object moves or changes from frame to frame.

6. The method for converting two-dimensional images into three-dimensional images of claim 5 , wherein:

one or more sub-objects contained within the object are defined such that the sub-objects are linked together and tracked as the object moves or changes from frame to frame.

7. The method for converting two-dimensional images into three-dimensional images of claim 5 , wherein the object outlines obey a maximum error threshold relative to an initial frame of definition.

8. The method for converting two-dimensional images into three-dimensional images of claim 5 , wherein:

the object outlines are created employing a pixel image data tracking technique.

9. A method for converting two-dimensional images into three-dimensional images, comprising:

tracking an object in an image, the object having an object edge and an object outline thereabout, from frame to frame over a sequence of images; and

creating object outlines in subseciuent frames for converting two-dimensional images into three-dimensional images maintaining an object outline to object edge distance spacing relationship as the object moves or changes from frame to frame;

wherein one or more contour pathlines contained within the object are associated with depth contour information and defined such that the one or more contour pathlines track the object as the object moves or changes from frame to frame.

10. The method for converting two-dimensional images into three-dimensional images of claim 9 , wherein:

one or more sub-objects contained within the object are defined such that the sub-objects are linked together and tracked as the object moves or changes from frame to frame.

11. The method for converting two-dimensional images into three-dimensional images of claim 9 , wherein the object outlines obey a maximum error threshold relative to an initial frame of definition.

12. The method for converting two-dimensional images into three-dimensional images of claim 9 , wherein:

the object outlines are created employing a pixel image data tracking technique.

13. A method for converting two-dimensional images into three-dimensional, comprising:

tracking an object in an image, the object having an object edge and an object outline thereabout, from frame to frame over a sequence of images;

creating object outlines in subsequent frames for converting two-dimensional images into three-dimensional images maintaining an object outline to object edge distance spacing relationship as the object moves or changes from frame to frame; and

selecting a severity of regulation for the distance spacing relationship to force errors in the object outlines to an acceptable tolerance.

14. The method for converting two-dimensional images into three-dimensional images of claim 13 , wherein:

one or more sub-objects contained within the object are defined such that the sub-objects are linked together and tracked as the object moves or changes from frame to frame.

15. The method for converting two-dimensional images into three-dimensional images of claim 13 , wherein the object outlines obey a maximum error threshold relative to an initial frame of definition.

16. The method for converting two-dimensional images into three-dimensional images of claim 13 , wherein:

the object outlines are created employing a pixel image data tracking technique.

17. A method for converting two-dimensional images into three-dimensional images, comprising:

tracking an object in an image, the object having an object edge and an object outline thereabout, from frame to frame over a sequence of images; and

creating object outlines in subseciuent frames for converting two-dimensional images into three-dimensional images maintaining an object outline to object edge distance spacing relationship as the object moves or changes from frame to frame;

wherein the object outlines are created employing a key frame curve interpolation technique.

18. The method for converting two-dimensional images into three-dimensional images of claim 17 , wherein:

one or more sub-objects contained within the object are defined such that the sub-objects are linked together and tracked as the object moves or changes from frame to frame.

19. The method for converting two-dimensional images into three-dimensional images of claim 17 , wherein the object outlines obey a maximum error threshold relative to an initial frame of definition.

20. The method for converting two-dimensional images into three-dimensional images of claim 17 , wherein:

the object outlines are created employing a pixel image data tracking technique.

21. A method for converting two-dimensional images into three-dimensional images, comprising:

tracking an object in an image, the object having an object edge and an object outline thereabout, from frame to frame over a sequence of images; and

creating object outlines in subseciuent frames for converting two-dimensional images into three-dimensional images maintaining an object outline to object edge distance spacing relationship as the object moves or changes from frame to frame;

wherein the object outlines are created employing a combination of pixel image data tracking and key frame curve interpolation techniques.

22. The method for converting two-dimensional images into three-dimensional images of claim 21 , wherein:

one or more sub-objects contained within the object are defined such that the sub-objects are linked together and tracked as the object moves or changes from frame to frame.

23. The method for converting two-dimensional images into three-dimensional images of claim 21 , wherein the object outlines obey a maximum error threshold relative to an initial frame of definition.

24. The method for converting two-dimensional images into three-dimensional images of claim 21 , wherein:

the object outlines are created employing a pixel image data tracking technique.

25. A method for converting two-dimensional images into three-dimensional images, comprising:

defining an area of pixels around an object within an image frame of an image sequence, resulting in an outline of the object spaced a particular distance from edges of the object;

tracking the object as the object moves or changes from frame to frame; and

re-creating the outline in a different frame of the image sequence maintaining relative distances between the edges of the object and the outline to create a different perspective for a three-dimensional image.

26. The method for converting two-dimensional images into three-dimensional images of claim 25 , further comprising:

defining a virtual object corresponding to the object such that the virtual object is tracked and the outlines generated independent of whether the object is obstructed from view in a subsequent frame by another object moving into the foreground.

27. The method for converting two-dimensional images into three-dimensional images of claim 25 , further comprising:

defining one or more sub-objects contained within the object such that the sub-objects are linked together and tracked as the object moves or changes from frame to frame.

28. The method for converting two-dimensional images into three-dimensional images of claim 25 , further comprising:

defining one or more points contained within the object and associated with depth information such that the one or more points track the object as the object moves or changes from frame to frame.

29. The method for converting two-dimensional images into three-dimensional images of claim 25 , further comprising:

defining one or more contour pathlines contained within the object and associated with depth contour information such that the one or more contour pathlines track the object as the object moves or changes from frame to frame.

30. The method for converting two-dimensional images into three-dimensional images of claim 25 , wherein the outlines obey a maximum error threshold relative to an initial frame of definition.

31. The method for converting two-dimensional images into three-dimensional images of claim 25 , further comprising:

selecting a severity of regulation for the distance spacing relationship to force errors in the outlines to an acceptable tolerance.

32. The method for converting two-dimensional images into three-dimensional images of claim 25 , wherein:

the outlines are created employing a pixel image data tracking technique.

33. The method for converting two-dimensional images into three-dimensional images of claim 25 , wherein:

the outlines are created employing a key frame curve interpolation technique.

34. The method for converting two-dimensional images into three-dimensional images of claim 25 , wherein:

the outlines are created employing a combination of pixel image data tracking and key frame curve interpolation techniques.

35. A method for converting two-dimensional images into three-dimensional images, comprising:

defining an object within an image frame of an image sequence, resulting in an outline of the object spaced a particular distance from a perimeter of the object;

tracking the object as the object moves or changes from frame to frame; and

re-creating the outline in different frames of the image sequence maintaining relative distances between the perimeter of the object and the outline to create an alternate perspective for a three-dimensional image sequence.

36. The method for converting two-dimensional images into three-dimensional images of claim 35 , further comprising:

defining a virtual object corresponding to the object such that the virtual object is tracked and the outlines generated independent of whether the object is obstructed from view in a subsequent frame by another object moving into the foreground.

37. The method for converting two-dimensional images into three-dimensional images of claim 35 , further comprising:

defining one or more sub-objects contained within the object such that the sub-objects are linked together and tracked as the object moves or changes from frame to frame.

38. The method for converting two-dimensional images into three-dimensional images of claim 35 , further comprising:

defining one or more points contained within the object and associated with depth information such that the one or more points track the object as the object moves or changes from frame to frame.

39. The method for converting two-dimensional images into three-dimensional images of claim 35 , further comprising:

defining one or more contour pathlines contained within the object and associated with depth contour information such that the one or more contour pathlines track the object as the object moves or changes from frame to frame.

40. The method for converting two-dimensional images into three-dimensional images of claim 35 , wherein the outlines obey a maximum error threshold relative to an initial frame of definition.

41. The method for converting two-dimensional images into three-dimensional images of claim 35 , further comprising:

selecting a severity of regulation for the distance spacing relationship to force errors in the outlines to an acceptable tolerance.

42. The method for converting two-dimensional images into three-dimensional images of claim 35 , wherein:

the outlines are created employing a pixel image data tracking technique.

43. The method for converting two-dimensional images into three-dimensional images of claim 35 , wherein:

the outlines are created employing a key frame curve interpolation technique.

44. The method for converting two-dimensional images into three-dimensional images of claim 35 , wherein:

the outlines are created employing a combination of pixel image data tracking and key frame curve interpolation techniques.

Assignments (13)
RELEASE OF SECURITY INTEREST Recorded Dec 7, 2018
From: HPS INVESTMENT PARTNERS, LLC, AS COLLATERAL AGENT
To: REALD INC.; STEREOGRAPHICS CORPORATION; COLORLINK, INC.; REALD DDMG ACQUISITION, LLC
Reel/Frame 047741/0621 →
SECURITY INTEREST Recorded Mar 24, 2016
From: REALD INC.; STEREOGRAPHICS CORPORATION; COLORLINK INC.; REALD DDMG ACQUISITION, LLC
To: HIGHBRIDGE PRINCIPAL STRATEGIES, LLC
Reel/Frame 038243/0526 →
RELEASE FROM PATENT SECURITY AGREEMENT AT REEL/FRAME NO. 29855/0189 Recorded Mar 23, 2016
From: CITY NATIONAL BANK
To: REALD DDMG ACQUISITION, LLC
Reel/Frame 038216/0933 →
PATENT SECURITY AGREEMENT Recorded Feb 22, 2013
From: REALD DDMG ACQUISITION, LLC
To: CITY NATIONAL BANK
Reel/Frame 029855/0189 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2013
From: DIGITAL DOMAIN MEDIA GROUP, INC.; DIGITAL DOMAIN STEREO GROUP, INC.
To: REALD DDMG ACQUISITION, LLC
Reel/Frame 029617/0396 →
SECURITY AGREEMENT Recorded Aug 23, 2012
From: DIGITAL DOMAIN MEDIA GROUP, INC.; D2 SOFTWARE, INC.; DDH LAND HOLDINGS, LLC; DDH LAND HOLDINGS II, LLC; DIGITAL DOMAIN; DIGITAL DOMAIN INSTITUTE, INC.; DIGITAL DOMAIN INTERNATIONAL, INC.; DIGITAL DOMAIN PRODUCTIONS, INC.; DIGITAL DOMAIN STEREO GROUP, INC.; DIGITAL DOMAIN TACTICAL, INC.; MOTHERSHIP MEDIA, INC.; TRADITION STUDIOS, INC.
To: HUDSON BAY MASTER FUND LTD., AS COLLATERAL AGENT
Reel/Frame 028833/0753 →
SECURITY AGREEMENT Recorded May 14, 2012
From: DIGITAL DOMAIN MEDIA GROUP, INC.; D2 SOFTWARE, INC.; DDH LAND HOLDINGS, LLC; DDH LAND HOLDINGS II, LLC; DIGITAL DOMAIN; DIGITAL DOMAIN INSTITUTE, INC.; DIGITAL DOMAIN INTERNATIONAL, INC.; DIGITAL DOMAIN PRODUCTIONS, INC.; DIGITAL DOMAIN STEREO GROUP, INC.; DIGITAL DOMAIN TACTICAL, INC.; MOTHERSHIP MEDIA, INC.; TRADITION STUDIOS, INC.
To: COMVEST CAPITAL II, L.P., AS SECOND LIEN ADMINISTRATIVE AGENT
Reel/Frame 028206/0498 →
SECURITY AGREEMENT Recorded Feb 24, 2012
From: DIGITAL DOMAIN MEDIA GROUP, INC.; DIGITAL DOMAIN; DDH LAND HOLDINGS, LLC; DIGITAL DOMAIN INSTITUTE, INC.; DIGITAL DOMAIN STEREO GROUP, INC.; DDH LAND HOLDINGS II, LLC; DIGITAL DOMAIN INTERNATIONAL, INC.; TRADITION STUDIOS, INC.; DIGITAL DOMAIN PRODUCTIONS, INC.; MOTHERSHIP MEDIA, INC.; D2 SOFTWARE, INC.; DD ENTERTAINMENT PRODUCTIONS, INC.; INSTANT KARMA FILMS, LLC
To: COMVEST CAPITAL II, L.P., AS ADMINISTRATIVE AGENT
Reel/Frame 027756/0671 →
SECURITY AGREEMENT Recorded Feb 23, 2012
From: DIGITAL DOMAIN MEDIA GROUP, INC.; DIGITAL DOMAIN; DDH LAND HOLDINGS, LLC; DIGITAL DOMAIN INSTITUTE, INC.; DIGITAL DOMAIN STEREO GROUP, INC.; DDH LAND HOLDINGS II, LLC; DIGITAL DOMAIN INTERNATIONAL, INC.; TRADITION STUDIOS, INC.; DIGITAL DOMAIN PRODUCTIONS, INC.; MOTHERSHIP MEDIA, INC.; D2 SOFTWARE, INC.; DD ENTERTAINMENT PRODUCTIONS, INC.; INSTANT KARMA FILMS, LLC
To: COMVEST CAPITAL II, L.P., AS ADMINISTRATIVE AGENT
Reel/Frame 027755/0573 →
CHANGE OF NAME Recorded Nov 30, 2011
From: DD3D, INC.
To: DIGITAL DOMAIN STEREO GROUP, INC.
Reel/Frame 027306/0167 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2011
From: IN-THREE, INC.
To: DD3D, INC.
Reel/Frame 025618/0260 →
RELEASE OF SECURITY INTEREST Recorded Oct 22, 2007
From: KAYE, MICHAEL C.
To: IN-THREE, INC.
Reel/Frame 019995/0184 →
SECURITY AGREEMENT Recorded Oct 31, 2006
From: IN-THREE, INC.
To: FELDMAN, NEIL BRIAN; KAYE, MICHAEL CURTIS
Reel/Frame 018454/0376 →