IP Library Granted Patent US 8,730,232
Granted Patent B2
US 8,730,232 · App. 13/019,171 · Granted May 20, 2014

Director-style based 2D to 3D movie conversion system and method

Inventor: Charles Passmore (San Diego, CA)
Assignee: Legend3D, Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,730,232
App. No.
13/019,171
Granted
May 20, 2014
Kind
B2
Abstract

Automated or semi-automated conversion of 2D movies into 3D movies through generation and use of director-style statistics or characteristics to determine which processes to apply to convert regions of images based on the director's movie making style, without requiring the creation, moving or reshaping of masks. System works by breaking a movie down into scenes and shots and identifying lighting, lens, camera moves and color schemes habitually utilized by a director. The characteristics or statistical information is stored in a database accessible by a computer over a network for example. Swarms of computers or any other architecture employing any required amount of computing power allows for the desired speed of conversion to take place. Once a director's style has been analyzed, embodiments utilize the director-style characteristics to determine the specific processes to utilize to convert the movie from 2D to 3D.

Claims (58)

1. A system for director-style based 2D to 3D movie conversion comprising:

memory configured to store at least one director-style characteristic;

at least one computer configured to

break a series of related images comprising a motion picture made by a particular director into one or more shots that each comprise one or more two-dimensional or 2D format images wherein said particular director is a particular person that directs said motion picture;

analyze a current shot selected from said one or more shots and determine at least one director-style characteristic associated with said current shot;

access a director-style parameters data structure in said memory to obtain existing director-style characteristics associated with said particular director;

check said existing director-style characteristics associated with said particular director accessed from said director-style parameter data structure to determine if any existing director-style shot associated with said particular director have said at least one director-style characteristic associated with said current shot;

compare said at least one director-style characteristic associated with said current shot with said existing director-style characteristics associated with said particular director and associated with said existing director-style shot and

if said current shot is not similar to any said existing director-style shot,

accept inputs for processing component settings and store said processing component settings in said memory; and

if said current shot is similar to any said existing director-style shot,

retrieve said processing component settings associated with said existing director-style shot and store said processing component settings in said memory to convert said current shot from 2D to 3D format;

apply said processing component settings to said processing components;

convert said shot from said 2D to said 3D format;

accept any modifications to said processing component settings and update said director-style parameters data structure associated with said current shot.

2. The system of claim 1 wherein said director-style characteristic comprises camera characteristics, and wherein said camera characteristics comprise one or more of camera angle, camera motion, shot intimacy, actor positions, or any combination thereof.

3. The system of claim 2 , wherein said camera motion comprises one or more of lock down, crane, tracking, handheld, tripod shot, or any combination thereof.

4. The system of claim 1 wherein said director-style characteristic comprises priority of progressive refinement processing, wherein said at least one computer is further configured to determine areas to spend more processing time than other areas of said shot.

5. The system of claim 1 wherein said director-style characteristic comprises lighting characteristics, and wherein said lighting characteristics are determined as one or more of foreground, midground, background, ground planes, sky domes, or any combination thereof.

6. The system of claim 1 wherein said director-style characteristic comprises lighting characteristics comprising a first brightness in an area of said one or more 2D format images that denotes a background distance.

7. The system of claim 1 wherein said director-style characteristic comprises lighting characteristics comprising a second brightness in an area of said one or more 2D format images that denotes a midrange distance.

8. The system of claim 1 wherein said director-style characteristic comprises lighting characteristics comprising a third brightness in an area of said 2D one or more format images that denotes a foreground distance.

9. The system of claim 1 wherein said director-style characteristic comprises color characteristics.

10. The system of claim 1 wherein said director-style characteristic comprises color characteristics comprising a first color and/or first saturation in an area of said one or more 2D format images that denotes a background distance.

11. The system of claim 1 wherein said director-style characteristic comprises color characteristics comprising a second color and/or second saturation in an area of said one or more 2D format images that denotes a midrange distance.

12. The system of claim 1 wherein said director-style characteristic comprises color characteristics comprising a third color and/or second saturation in an area of said one or more 2D format images that denotes a foreground distance.

13. The system of claim 1 wherein said at least one computer is further configured to operate in conjunction with a positive integer number of other computers to convert said movie from said 2D format images to said 3D format.

14. The system of claim 1 wherein said at least one computer is further configured to white balance a shot before said analyze said shot occurs.

15. The system of claim 1 wherein said at least one computer is further configured to obtain an order in which to execute said processing components.

16. The system of claim 1 wherein said at least one computer is further configured to tween processing component settings between keyframes.

17. The system of claim 16 wherein said at least one computer is further configured to store timing history of said processing component settings applied, wherein percentages of said processing component setting vary in time such that said at least one computer is further configured to automatically identify which processing component setting of said processing component settings to use in varying time based on said percentages and tween said processing component settings between keyframes based on said percentages.

18. The system of claim 1 wherein said at least one computer is further configured to display and obtain settings for workflow status values associated with said shot.

19. The system of claim 1 wherein said at least one computer is further configured to display and obtain a depth range for said one or more 2D format images.

20. The system of claim 1 wherein said at least one computer is further configured to utilize face recognition software to automatically apply depth to said one or more 2D format images.

21. The system of claim 1 wherein said at least one computer is further configured to utilize texture detection software to automatically apply depth to said one or more 2D format images.

22. The system of claim 1 wherein said at least one computer is further configured to ignore areas of an image that have been masked and add depth to areas of an image that have not been masked.

23. A system for director-style based 2D to 3D movie conversion comprising:

memory configured to store at least one director-style characteristic;

at least one computer configured to

break a series of related images comprising a motion picture made by a particular director into one or more shots that each comprise one or more two-dimensional or 2D format images wherein said particular director is a particular person that directs said motion picture;

analyze a current shot selected from said one or more shots and determine at least one director-style characteristic associated with said current shot;

access a director-style parameters data structure in said memory to obtain existing director-style characteristics associated with said particular director;

check said existing director-style characteristics associated with said particular director accessed from said director-style parameter data structure to determine if any existing director-style shot associated with said particular director have said at least one director-style characteristic associated with said current shot;

compare said at least one director-style characteristic associated with said current shot with said existing director-style characteristics associated with said particular director and associated with said existing director-style shot and

if said current shot is not similar to any said existing director-style shot,

accept inputs for processing component settings and store said processing component settings in said memory; and

if said current shot is similar to any said existing director-style shot,

retrieve said processing component settings associated with said existing director-style shot and store said processing component settings in said memory to convert said current shot from 2D to 3D format;

apply said processing component settings to said processing components;

convert said shot from said 2D to said 3D format;

accept any modifications to said processing component settings and update said director-style parameters data structure associated with said current shot;

store timing history of said processing component settings applied, wherein percentages of said processing component setting vary in time such that said at least one computer is further configured to automatically identify which processing component setting of said processing component settings to use in varying time based on said percentages and tween said processing component settings between keyframes based on said percentages;

ignore areas of an image that have been masked and add depth to areas of an image that have not been masked; and

wherein said director-style characteristic comprises camera characteristics, lighting and priority of progressive refinement processing, and wherein

said camera characteristics comprise one or more of camera angle, camera motion, shot intimacy, actor positions, or any combination thereof,

said camera motion comprises one or more of lock down, crane, tracking, handheld, tripod shot, or any combination thereof,

said lighting characteristics are determined as one or more of foreground, midground, background, ground planes, sky domes, or any combination thereof, and

said at least one computer is further configured to determine areas to spend more processing time than other areas of said shot.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2021
From: SILICON VALLEY BANK
To: LEGEND3D, INC.
Reel/Frame 056682/0704 →
RELEASE OF SECURITY INTEREST Recorded May 28, 2021
From: IP SUCCESSOR FUND 21 L.P.
To: LEGEND3D, INC.
Reel/Frame 056385/0697 →
RELEASE OF SECURITY INTEREST Recorded May 28, 2021
From: IP SUCCESSOR FUND 21 L.P.
To: LEGEND3D, INC.
Reel/Frame 056422/0735 →
SECURITY AGREEMENT Recorded Apr 10, 2017
From: PAR INVESTMENT PARTNERS, L.P.
To: IP SUCCESSOR FUND 21 L.P.
Reel/Frame 042198/0013 →
SECURITY INTEREST Recorded Dec 7, 2016
From: LEGEND3D, INC.
To: IP SUCCESSOR FUND 21 L.P.
Reel/Frame 040589/0472 →
SECURITY INTEREST Recorded Jan 5, 2015
From: LEGEND3D, INC.
To: SILICON VALLEY BANK
Reel/Frame 034637/0193 →
SECURITY INTEREST Recorded May 22, 2014
From: LEGEND3D, INC.
To: PAR INVESTMENT PARTNERS, L.P.
Reel/Frame 032999/0689 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2011
From: PASSMORE, CHARLES
To: LEGEND3D, INC.
Reel/Frame 026284/0734 →
Continuity (1)
Related Publication 20120194506A1 · Aug 2, 2012