IP Library Granted Patent US 8,749,618
Granted Patent B2
US 8,749,618 · App. 13/158,288 · Granted Jun 10, 2014

Distributed three-dimensional video conversion system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,749,618
App. No.
13/158,288
Granted
Jun 10, 2014
Kind
B2
Abstract

A project network application can provide functionality for a plurality of worker systems to perform digital video editing so as to at least partially perform two- to three-dimensional conversion of a video. The project network application may, for instance, include tools for performing rotoscoping, depth mapping, object offsetting, occlusion filling, and the like.

Claims (49)

1. A method of performing computer-aided video image processing, the method comprising:

receiving a video comprising a plurality of video frames;

programmatically assigning processing of the video frames to a plurality of workers;

electronically inserting digital watermarks in at least some of the video frames, the digital watermarks comprising references to the workers assigned to process the video frames;

providing a network application having functionality for allocating compressed versions of the video frames to worker systems operated by the plurality of workers over a network, the network application configured to:

output a digital video editor user interface comprising functionality for the workers to perform at least a part of a two-dimensional to three-dimensional conversion process on the compressed video frames, the two-to-three dimensional conversion process comprising performing two or more of the following: rotoscoping, depth mapping, occlusion filling, pixel shifting, three dimensional modeling, and camera matching, and

collect processed frame information from the worker systems; and

providing the processed frame information to a provider of the video as part of at least partially two-dimensional to three-dimensional converted video;

wherein at least said providing the network application is implemented at least in part by a computer system comprising computer hardware.

2. The method of claim 1 , wherein the digital video editor user interface further comprises functionality for the workers to perform the rotoscoping, the depth mapping, and the occlusion filling.

3. The method of claim 1 , further comprising providing a user interface that allows an administrator to monitor progress of the workers in editing the video frames.

4. The method of claim 1 , further comprising rating performance of the workers based on the collected processed frame information.

5. The method of claim 4 , wherein said rating comprises evaluating the workers based on one or more of the following factors: timeliness, editing quality, thoroughness, availability, and rate.

6. The method of claim 5 , wherein the factors further comprise professionalism and infrastructure of the worker systems.

7. The method of claim 1 , further comprising encrypting the frames so that transmission of the encrypted frames to the worker systems from the network application reduces a risk of obtaining actual frames from the encrypted frames.

8. The method of claim 7 , wherein the worker systems comprise functionality to decrypt a portion of each frame while editing each frame so that not all of a frame is decrypted at any given time.

9. The method of claim 1 , wherein the computer system comprises a plurality of computing devices.

10. Non-transitory physical computer storage comprising instructions stored thereon for implementing, in one or more processors, operations for performing computer-aided video image processing, the operations comprising:

receiving a video comprising a plurality of video frames;

programmatically assigning processing of the video frames to a plurality of workers;

electronically inserting digital watermarks in at least some of the video frames, the digital watermarks comprising references to the workers assigned to process the video frames;

providing a network application having functionality for allocating compressed versions of the video frames of the video to worker systems operated by the plurality of workers over a network, the network application configured to:

output a digital video editor user interface comprising functionality for the workers to perform at least a part of a two-dimensional to three-dimensional conversion process on the compressed video frames, the two-to-three dimensional conversion process comprising performing two or more of the following: rotoscoping, depth mapping, occlusion filling, pixel shifting, three dimensional modeling, and camera matching, and

collect processed frame information from the worker systems; and

providing the processed frame information to a provider of the video as part of an at least partially two-dimensional to three-dimensional converted video;

wherein at least said providing the network application is implemented by a computer system comprising computer hardware.

11. The non-transitory physical computer storage of claim 10 , wherein the digital video editor user interface further comprises functionality for the workers to perform the rotoscoping, the depth mapping, and the occlusion filling.

12. The non-transitory physical computer storage of claim 10 , wherein the operations further comprise providing a user interface that allows an administrator to monitor progress of the workers in editing the video frames.

13. The non-transitory physical computer storage of claim 10 , wherein the operations further comprise rating performance of the workers based on the collected processed frame information.

14. The non-transitory physical computer storage of claim 13 , wherein said rating comprises evaluating the workers based on one or more of the following factors: timeliness, editing quality, thoroughness, and availability.

15. The non-transitory physical computer storage of claim 10 , in combination with a computer system comprising computer hardware.

16. The non-transitory physical computer storage of claim 10 , wherein the operations further comprise compressing the frames.

17. The non-transitory physical computer storage of claim 10 , wherein the digital watermarks comprising references to the workers assigned to process the frames.

18. A system for computer-aided video image processing, the system comprising:

a network application comprising computer hardware, the network application comprising functionality for:

receiving a video comprising a plurality of video frames;

programmatically assigning processing of the video frames to a plurality of workers;

electronically inserting digital watermarks in at least some of the video frames, the digital watermarks comprising references to the workers assigned to process the video frames;

allocating compressed versions of the video frames to the worker systems operated by the plurality of workers over a network,

the network application configured to:

output a digital video editor user interface comprising functionality for the workers to perform at least a part of a two-dimensional to three-dimensional conversion process on the compressed video frames, the two-to-three dimensional conversion process comprising performing two or more of the following: rotoscoping, depth mapping, occlusion filling, pixel shifting, three dimensional modeling, and camera matching, and

collect processed frame information from the worker systems; and

a project management module configured to provide the processed frame information to a provider of the video as part of at least partially two-dimensional to three-dimensional converted video.

19. The system of claim 18 , wherein the digital video editor user interface further comprises functionality for the workers to perform the rotoscoping, the depth mapping, and the occlusion filling.

20. The system of claim 18 , wherein the project management module is further configured to provide a user interface that allows an administrator to monitor progress of the workers in editing the video frames.

21. The system of claim 18 , further comprising a worker ratings module configured to rate performance of the workers based on the collected processed frame information.

22. The system of claim 21 , wherein the worker ratings module is further configured to rate the performance by at least evaluating the workers based on one or more of the following factors: timeliness, editing quality, thoroughness, and availability.

23. The system of claim 18 , wherein digital video editor interface is configured to be output on a 3-D enabled display, thereby enabling a worker to evaluate the quality of the processed frame information.

24. The system of claim 18 , wherein the compressed and watermarked frames comprises digital watermarks that reference the workers.

Assignments (37)
RELEASE OF SECURITY INTEREST Recorded Apr 4, 2023
From: PNC BANK, NATIONAL ASSOCIATION
To: DELUXE MEDIA INC.; SOFTITLER NET, INC.; DELUXE LABORATORIES LLC; DELUXE ONE LLC
Reel/Frame 063213/0909 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Apr 2, 2023
From: LOAN ADMIN CO LLC, AS COLLATERAL AGENT
To: DELUXE MEDIA INC.; SOFTITLER NET, INC.; DELUXE ONE LLC
Reel/Frame 063237/0243 →
GRANT OF SECURITY INTEREST IN UNTED STATES PATENTS Recorded Aug 21, 2020
From: DELUXE MEDIA INC.; SOFTITLER NET, INC.; DELUXE ONE LLC
To: LOAN ADMIN CO LLC
Reel/Frame 054153/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 21, 2020
From: DELUXE MEDIA INC.; SOFTITLER NET, INC.; DELUXE LABORATORIES LLC; DELUXE ONE LLC
To: PNC BANK, NATIONAL ASSOCIATION
Reel/Frame 053265/0329 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Jul 1, 2020
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: DELUXE ENTERTAINMENT SERVICES INC.; DELUXE MEDIA INC. (F/K/A DELUXE DIGITAL STUDIOS, INC.); SOFTITLER NET, INC.; DELUXE ONE LLC (F/K/A DELUXE MEDIUSONE LLC); DELUXE LABORATORIES LLC
Reel/Frame 053117/0015 →
RELEASE OF SECURITY INTEREST Recorded Jul 1, 2020
From: PNC BANK, NATIONAL ASSOCIATION
To: DELUXE MEDIA INC.; DELUXE LABORATORIES LLC; DELUXE ONE LLC; SOFTITLER NET, INC.
Reel/Frame 053102/0558 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Jul 1, 2020
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: DELUXE ENTERTAINMENT SERVICES INC.; DELUXE MEDIA INC. (F/K/A DELUXE DIGITAL STUDIOS, INC.); SOFTITLER NET, INC.; DELUXE ONE LLC (F/K/A DELUXE MEDIUSONE LLC); DELUXE LABORATORIES LLC
Reel/Frame 053116/0566 →
COURT ORDER Recorded Jun 29, 2020
From: CREDIT SUISSE AG (RELEASING REEL/FRAME 50609/0083)
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES INC. (AS SUCCESSOR BY MERGER TO DELUXE ENTERTAINMENT SERVICES GROUP INC.); DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 053081/0672 →
RELEASE OF SECURITY INTEREST Recorded Jun 29, 2020
From: CORTLAND CAPITAL MARKET SERVICES LLC (AS SUCCESSOR COLLATERAL AGENT TO CREDIT SUISSE AG) (REEL/FRAME 50609/0590)
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES INC. (AS SUCCESSOR BY MERGER TO DELUXE ENTERTAINMENT SERVICES GROUP INC.); DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 053074/0274 →
COURT ORDER Recorded Jun 29, 2020
From: CREDIT SUISSE AG (RELEASING REEL/FRAME 40581/0309)
To: SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 053081/0527 →
RELEASE OF SECURITY INTEREST Recorded Jun 29, 2020
From: CORTLAND CAPITAL MARKET SERVICES LLC (AS SUCCESSOR COLLATERAL AGENT TO CREDIT SUISSE AG) (REEL/FRAME 49924/0706)
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES INC. (AS SUCCESSOR BY MERGER TO DELUXE ENTERTAINMENT SERVICES GROUP INC.); DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 053074/0294 →
COURT ORDER Recorded Jun 29, 2020
From: CREDIT SUISSE AG (RELEASING REEL/FRAME 49924/0596)
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES INC. (AS SUCCESSOR BY MERGER TO DELUXE ENTERTAINMENT SERVICES GROUP INC.); DELUXE MEDIA INC.; DELUXE ONE LLC; SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 053083/0373 →
MERGER Recorded Mar 10, 2020
From: SFERA LABS, LLC
To: SOFTITLER NET, INC.
Reel/Frame 052074/0072 →
SECURITY INTEREST Recorded Jan 8, 2020
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE MEDIA INC.; DELUXE ENTERTAINMENT SERVICES INC.; DELUXE LABORATORIES LLC; DELUXE ONE LLC; DELUXE BROADCAST SERVICES LTD; DELUXE UK HOLDINGS LIMITED
To: PNC BANK, NATIONAL ASSOCIATION
Reel/Frame 051521/0411 →
RELEASE OF SECURITY AGREEMENT Recorded Jan 7, 2020
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE ONE LLC; DELUXE MEDIA INC.; DELUXE ENTERTAINMENT SERVICES INC.; DELUXE LABORATORIES LLC; SOFTITLER NET, INC.
Reel/Frame 051541/0396 →
SECURITY INTEREST Recorded Nov 13, 2019
From: DELUXE 3D LLC; DELUXE ENTERTAINMENT SERVICES INC.; DELUXE MEDIA INC. (F/K/A DELUXE DIGITAL STUDIOS, INC.); DELUXE CREATIVE SERVICES INC. (F/K/A DELUXE MEDIA CREATIVE SERVICES INC.); SOFTITLER NET, INC.; DELUXE ONE LLC (F/K/A DELUXE MEDIUSONE LLC); DELUXE LABORATORIES LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC
Reel/Frame 050994/0428 →
SECURITY INTEREST Recorded Nov 13, 2019
From: DELUXE 3D LLC; DELUXE ENTERTAINMENT SERVICES INC.; DELUXE MEDIA INC. (F/K/A DELUXE DIGITAL STUDIOS, INC.); DELUXE CREATIVE SERVICES INC. (F/K/A DELUXE MEDIA CREATIVE SERVICES INC.); SOFTITLER NET, INC.; DELUXE ONE LLC (F/K/A DELUXE MEDIUSONE LLC); DELUXE LABORATORIES LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC
Reel/Frame 050994/0293 →
RELEASE OF SECURITY INTEREST Recorded Nov 12, 2019
From: CORTLAND CAPITAL MARKET SERVICES LLC (AS SUCCESSOR COLLATERAL AGENT TO CREDIT SUISSE AG)
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE ENTERTAINMENT SERVICES INC. (AS SUCCESSOR BY MERGER TO DELUXE ENTERTAINMENT SERVICES GROIUP INC.); DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 050983/0730 →
RELEASE OF SECURITY INTEREST Recorded Nov 11, 2019
From: CORTLAND CAPITAL MARKET SERVICES LLC (AS SUCCESSOR COLLATERAL AGENT TO CREDIT SUISSE AG)
To: SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 050974/0026 →
RELEASE OF SECURITY INTEREST Recorded Nov 11, 2019
From: CORTLAND CAPITAL MARKET SERVICES LLC (AS SUCCESSOR COLLATERAL AGENT TO CREDIT SUISSE AG)
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE ONE LLC (AS SUCCESSOR BY MERGER TO DELUXE DIGITAL DISTRIBUTION INC.); DELUXE MEDIA INC.; SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC); DELUXE ENTERTAINMENT SERVICES INC.
Reel/Frame 050974/0439 →
SECURITY INTEREST Recorded Nov 7, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE ONE LLC; DELUXE MEDIA INC.; DELUXE ENTERTAINMENT SERVICES INC.; DELUXE LABORATORIES LLC; SOFTITLER NET, INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 050949/0192 →
RELEASE OF SECURITY AGREEMENT Recorded Nov 7, 2019
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: SFERA LABS, LLC
Reel/Frame 050965/0287 →
RELEASE OF SECURITY AGREEMENT Recorded Nov 7, 2019
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
Reel/Frame 050965/0381 →
RELEASE OF SECURITY AGREEMENT Recorded Nov 7, 2019
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
Reel/Frame 050965/0459 →
RELEASE OF SECURITY AGREEMENT Recorded Oct 9, 2019
From: CREDIT SUISSE AG, AS COLLATERAL AGENT
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
Reel/Frame 050673/0247 →
SECURITY INTEREST Recorded Oct 2, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: CREDIT SUISSE AG, AS COLLATERAL AGENT
Reel/Frame 050609/0590 →
SECURITY INTEREST Recorded Oct 2, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: CREDIT SUISSE AG, AS COLLATERAL AGENT
Reel/Frame 050609/0083 →
SECURITY INTEREST Recorded Oct 2, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 050609/0255 →
SECURITY INTEREST Recorded Sep 20, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: CREDIT SUISSE AG, AS COLLATERAL AGENT
Reel/Frame 050451/0712 →
SECURITY INTEREST Recorded Jul 31, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: CREDIT SUISSE AG, AS COLLATERAL AGENT
Reel/Frame 049924/0706 →
SECURITY INTEREST Recorded Jul 31, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 049924/0645 →
SECURITY INTEREST Recorded Jul 31, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: CREDIT SUISSE AG, AS COLLATERAL AGENT
Reel/Frame 049924/0596 →
SECURITY AGREEMENT Recorded Nov 9, 2016
From: SFERA LABS, LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 040581/0334 →
SECURITY AGREEMENT Recorded Nov 9, 2016
From: SFERA LABS, LLC
To: CREDIT SUISSE AG, AS COLLATERAL AGENT
Reel/Frame 040581/0309 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2016
From: FIUMI, MORGAN
To: SFERA LABS, LLC
Reel/Frame 040159/0450 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2016
From: FIUMI, MORGAN
To: MEDIASTUDIO, INC.
Reel/Frame 040159/0314 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2016
From: MEDIASTUDIO, INC.
To: FIUMI, MORGAN
Reel/Frame 040159/0389 →