IP Library Granted Patent US 8,532,469
Granted Patent B2
US 8,532,469 · App. 13/158,274 · Granted Sep 10, 2013

Distributed digital video processing system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,532,469
App. No.
13/158,274
Granted
Sep 10, 2013
Kind
B2
Abstract

A project network application can provide functionality for a plurality of worker systems to perform digital video editing so as to at least partially perform two- to three-dimensional conversion of a video. The project network application may, for instance, include tools for performing rotoscoping, depth mapping, object offsetting, occlusion filling, and the like.

Claims (21)

1. A method of performing distributed video processing, the method comprising: programmatically managing a distributed video editing project by at least: subdividing frames of a video into a plurality of frame groups, each of the frame groups comprising a subset of the frames, distributing the frame groups to a plurality of worker systems operated by remote workers, such that a given remote worker is provided with electronic access to one or more of the frame groups, and obtaining, via a computer network, processed frame information from the plurality of worker systems, the processed frame information comprising information for adjusting a characteristic of at least some of the frames; calculating numerical performance ratings for the remote workers based at least partly on performance of the remote workers in producing the processed frame information, said calculating the numerical performance ratings for the remote workers comprising taking into account accuracy of traced objects in one or more of the frames and one or more of the following factors: on-time performance, work quality, thoroughness, professionalism, accuracy, worker availability, worker infrastructure, worker rate, and a helpfulness factor; andusing the numerical performance ratings to determine how to allocate frames of a subsequent distributed video editing project to at least a portion of the remote workers; wherein at least said calculating is implemented by a computer system comprising computer hardware.

2. The method of claim 1 , wherein said distributing comprises assigning a number of the frames to the remote workers based on an estimated throughput of the remote workers.

3. The method of claim 1 , wherein said distributing comprises assigning a number of the frames to the remote workers based on a security level of the video.

4. The method of claim 3 , wherein said distributing further comprises assigning relatively fewer sequential frames for a higher security level of the video and relatively more sequential frames for a lower security level of the video.

5. The method of claim 1 , further comprising applying a security feature to at least some of the frames prior to said distributing.

6. The method of claim 1 , further comprising applying a security feature to at least some of the frames prior to said distributing, wherein the security feature comprises compression of at least some of the frames.

7. The method of claim 1 , further comprising applying a security feature to at least some of the frames prior to said distributing, wherein the security feature comprises a digital watermark configured to identify a recipient of a given one of the frames, to thereby enable tracking of potential copyright infringement.

8. The method of claim 1 , wherein the computer system comprises a plurality of computing devices.

9. A system, including an electronic device, for performing distributed video processing, the system comprising: a project management module operative to manage a distributed video editing project, the project management module configured to at least: select workers, based at least partly on numerical performance ratings of the workers, to receive frames of a video for video processing, and obtain processed frame information from the workers, the processed frame information comprising information for adjusting a characteristic of at least some of the frames; and a worker ratings calculator comprising computer hardware, the worker ratings calculator configured to update the numerical performance ratings of the workers based at least partly on the performance of the workers in producing the processed frame information, wherein the worker ratings calculator is configured to update the numerical performance ratings based on accuracy of traced objects in one or more of the frames and one or more of the following performance factors: on-time performance, work quality, thoroughness, professionalism, accuracy, worker availability, worker infrastructure, worker rate, and a helpfulness factor; wherein the project management module is further configured to use the updated performance ratings to select a subset of the workers to receive frames of a subsequent video for video processing.

10. The system of claim 9 , wherein the project management module is further configured to select the workers by giving a first portion of the workers having higher performance ratings priority access to the frames over a second portion of the workers having lower performance ratings.

11. The system of claim 9 , wherein the worker ratings calculator is further configured to weight the performance factors differently, wherein weights applied to the performance factors depend on a characteristic of the distributed video editing project emphasized by a provider of the video.

12. The system of claim 11 , wherein the project management module is further configured to select the subset of the workers to receive the frames of the subsequent video based on the subset of workers achieving updated numerical performance ratings that are greater than the updated numerical performance ratings of other of the workers.

13. The system of claim 9 , further comprising a security module configured to deter the workers from sharing accounts with other users to thereby deter subcontracting by the workers.

14. The system of claim 9 , further comprising a digital video editor accessible over a network and configured to provide a user interface for the workers to edit the frames.

15. The system of claim 14 , wherein the digital video editor comprises features for performing one or more of the following digital editing functions: rotoscoping, digital restoration, color correction, camera tracking, color balancing, color mapping, color grading, depth grading, occlusion filling, matte painting, and matte cleanup.

16. Non-transitory physical computer storage comprising instructions stored thereon for implementing, in one or more processors, operations for performing distributed video processing, the operations comprising: selecting workers, based at least partly on numerical performance ratings of the workers, to receive frames of a video for video processing; obtaining processed frame information from the workers, the processed frame information comprising information for adjusting a characteristic of at least some of the frames; updating the numerical performance ratings of the workers based at least partly on the performance of the workers in producing the processed frame information, said updating the numerical performance ratings of the workers comprising taking into account accuracy of traced objects in one or more of the frames and one or more of the following factors: on-time performance, work quality, thoroughness, professionalism, accuracy, worker availability, worker infrastructure, worker rate, and a helpfulness factor; and using the updated performance ratings to select from the workers a subset of the workers to work on a subsequent video processing project.

17. The non-transitory physical computer storage of claim 16 , wherein said selecting the workers comprises providing the workers with priority access to receive the frames over other workers having lower performance ratings than the performance ratings of the workers.

18. The non-transitory physical computer storage of claim 16 , further comprising paying a higher rate of pay to selected ones of the workers having higher performance ratings than a rate of pay paid to other ones of the workers having lower performance ratings.

19. The non-transitory physical computer storage of claim 16 , wherein said using the updated performance ratings to select a subset of the workers comprises assigning a higher priority project to first ones of the workers having higher performance ratings and a lower priority project to second ones of the workers having lower performance ratings.

20. The non-transitory physical computer storage of claim 16 , wherein the video comprises one or more of the following: a movie, a television show, and a video game.

21. The non-transitory physical computer storage of claim 16 , in combination with a computer system comprising computer hardware.

Assignments (37)
RELEASE OF SECURITY INTEREST Recorded Apr 4, 2023
From: PNC BANK, NATIONAL ASSOCIATION
To: DELUXE MEDIA INC.; SOFTITLER NET, INC.; DELUXE LABORATORIES LLC; DELUXE ONE LLC
Reel/Frame 063213/0909 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Apr 2, 2023
From: LOAN ADMIN CO LLC, AS COLLATERAL AGENT
To: DELUXE MEDIA INC.; SOFTITLER NET, INC.; DELUXE ONE LLC
Reel/Frame 063237/0243 →
GRANT OF SECURITY INTEREST IN UNTED STATES PATENTS Recorded Aug 21, 2020
From: DELUXE MEDIA INC.; SOFTITLER NET, INC.; DELUXE ONE LLC
To: LOAN ADMIN CO LLC
Reel/Frame 054153/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 21, 2020
From: DELUXE MEDIA INC.; SOFTITLER NET, INC.; DELUXE LABORATORIES LLC; DELUXE ONE LLC
To: PNC BANK, NATIONAL ASSOCIATION
Reel/Frame 053265/0329 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Jul 1, 2020
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: DELUXE ENTERTAINMENT SERVICES INC.; DELUXE MEDIA INC. (F/K/A DELUXE DIGITAL STUDIOS, INC.); SOFTITLER NET, INC.; DELUXE ONE LLC (F/K/A DELUXE MEDIUSONE LLC); DELUXE LABORATORIES LLC
Reel/Frame 053117/0015 →
RELEASE OF SECURITY INTEREST Recorded Jul 1, 2020
From: PNC BANK, NATIONAL ASSOCIATION
To: DELUXE MEDIA INC.; DELUXE LABORATORIES LLC; DELUXE ONE LLC; SOFTITLER NET, INC.
Reel/Frame 053102/0558 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Jul 1, 2020
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: DELUXE ENTERTAINMENT SERVICES INC.; DELUXE MEDIA INC. (F/K/A DELUXE DIGITAL STUDIOS, INC.); SOFTITLER NET, INC.; DELUXE ONE LLC (F/K/A DELUXE MEDIUSONE LLC); DELUXE LABORATORIES LLC
Reel/Frame 053116/0566 →
COURT ORDER Recorded Jun 29, 2020
From: CREDIT SUISSE AG (RELEASING REEL/FRAME 50609/0083)
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES INC. (AS SUCCESSOR BY MERGER TO DELUXE ENTERTAINMENT SERVICES GROUP INC.); DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 053081/0672 →
RELEASE OF SECURITY INTEREST Recorded Jun 29, 2020
From: CORTLAND CAPITAL MARKET SERVICES LLC (AS SUCCESSOR COLLATERAL AGENT TO CREDIT SUISSE AG) (REEL/FRAME 50609/0590)
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES INC. (AS SUCCESSOR BY MERGER TO DELUXE ENTERTAINMENT SERVICES GROUP INC.); DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 053074/0274 →
COURT ORDER Recorded Jun 29, 2020
From: CREDIT SUISSE AG (RELEASING REEL/FRAME 40581/0309)
To: SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 053081/0527 →
RELEASE OF SECURITY INTEREST Recorded Jun 29, 2020
From: CORTLAND CAPITAL MARKET SERVICES LLC (AS SUCCESSOR COLLATERAL AGENT TO CREDIT SUISSE AG) (REEL/FRAME 49924/0706)
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES INC. (AS SUCCESSOR BY MERGER TO DELUXE ENTERTAINMENT SERVICES GROUP INC.); DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 053074/0294 →
COURT ORDER Recorded Jun 29, 2020
From: CREDIT SUISSE AG (RELEASING REEL/FRAME 49924/0596)
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES INC. (AS SUCCESSOR BY MERGER TO DELUXE ENTERTAINMENT SERVICES GROUP INC.); DELUXE MEDIA INC.; DELUXE ONE LLC; SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 053083/0373 →
MERGER Recorded Mar 10, 2020
From: SFERA LABS, LLC
To: SOFTITLER NET, INC.
Reel/Frame 052074/0072 →
SECURITY INTEREST Recorded Jan 8, 2020
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE MEDIA INC.; DELUXE ENTERTAINMENT SERVICES INC.; DELUXE LABORATORIES LLC; DELUXE ONE LLC; DELUXE BROADCAST SERVICES LTD; DELUXE UK HOLDINGS LIMITED
To: PNC BANK, NATIONAL ASSOCIATION
Reel/Frame 051521/0411 →
RELEASE OF SECURITY AGREEMENT Recorded Jan 7, 2020
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE ONE LLC; DELUXE MEDIA INC.; DELUXE ENTERTAINMENT SERVICES INC.; DELUXE LABORATORIES LLC; SOFTITLER NET, INC.
Reel/Frame 051541/0396 →
SECURITY INTEREST Recorded Nov 13, 2019
From: DELUXE 3D LLC; DELUXE ENTERTAINMENT SERVICES INC.; DELUXE MEDIA INC. (F/K/A DELUXE DIGITAL STUDIOS, INC.); DELUXE CREATIVE SERVICES INC. (F/K/A DELUXE MEDIA CREATIVE SERVICES INC.); SOFTITLER NET, INC.; DELUXE ONE LLC (F/K/A DELUXE MEDIUSONE LLC); DELUXE LABORATORIES LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC
Reel/Frame 050994/0428 →
SECURITY INTEREST Recorded Nov 13, 2019
From: DELUXE 3D LLC; DELUXE ENTERTAINMENT SERVICES INC.; DELUXE MEDIA INC. (F/K/A DELUXE DIGITAL STUDIOS, INC.); DELUXE CREATIVE SERVICES INC. (F/K/A DELUXE MEDIA CREATIVE SERVICES INC.); SOFTITLER NET, INC.; DELUXE ONE LLC (F/K/A DELUXE MEDIUSONE LLC); DELUXE LABORATORIES LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC
Reel/Frame 050994/0293 →
RELEASE OF SECURITY INTEREST Recorded Nov 12, 2019
From: CORTLAND CAPITAL MARKET SERVICES LLC (AS SUCCESSOR COLLATERAL AGENT TO CREDIT SUISSE AG)
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE ENTERTAINMENT SERVICES INC. (AS SUCCESSOR BY MERGER TO DELUXE ENTERTAINMENT SERVICES GROIUP INC.); DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 050983/0730 →
RELEASE OF SECURITY INTEREST Recorded Nov 11, 2019
From: CORTLAND CAPITAL MARKET SERVICES LLC (AS SUCCESSOR COLLATERAL AGENT TO CREDIT SUISSE AG)
To: SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC)
Reel/Frame 050974/0026 →
RELEASE OF SECURITY INTEREST Recorded Nov 11, 2019
From: CORTLAND CAPITAL MARKET SERVICES LLC (AS SUCCESSOR COLLATERAL AGENT TO CREDIT SUISSE AG)
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE ONE LLC (AS SUCCESSOR BY MERGER TO DELUXE DIGITAL DISTRIBUTION INC.); DELUXE MEDIA INC.; SOFTITLER NET, INC. (AS SUCCESSOR BY MERGER TO SFERA LABS, LLC); DELUXE ENTERTAINMENT SERVICES INC.
Reel/Frame 050974/0439 →
SECURITY INTEREST Recorded Nov 7, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE ONE LLC; DELUXE MEDIA INC.; DELUXE ENTERTAINMENT SERVICES INC.; DELUXE LABORATORIES LLC; SOFTITLER NET, INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 050949/0192 →
RELEASE OF SECURITY AGREEMENT Recorded Nov 7, 2019
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: SFERA LABS, LLC
Reel/Frame 050965/0287 →
RELEASE OF SECURITY AGREEMENT Recorded Nov 7, 2019
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
Reel/Frame 050965/0381 →
RELEASE OF SECURITY AGREEMENT Recorded Nov 7, 2019
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
Reel/Frame 050965/0459 →
RELEASE OF SECURITY AGREEMENT Recorded Oct 9, 2019
From: CREDIT SUISSE AG, AS COLLATERAL AGENT
To: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
Reel/Frame 050673/0247 →
SECURITY INTEREST Recorded Oct 2, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: CREDIT SUISSE AG, AS COLLATERAL AGENT
Reel/Frame 050609/0590 →
SECURITY INTEREST Recorded Oct 2, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: CREDIT SUISSE AG, AS COLLATERAL AGENT
Reel/Frame 050609/0083 →
SECURITY INTEREST Recorded Oct 2, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 050609/0255 →
SECURITY INTEREST Recorded Sep 20, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE LABORATORIES LLC; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: CREDIT SUISSE AG, AS COLLATERAL AGENT
Reel/Frame 050451/0712 →
SECURITY INTEREST Recorded Jul 31, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: CREDIT SUISSE AG, AS COLLATERAL AGENT
Reel/Frame 049924/0706 →
SECURITY INTEREST Recorded Jul 31, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 049924/0645 →
SECURITY INTEREST Recorded Jul 31, 2019
From: DELUXE 3D LLC; DELUXE CREATIVE SERVICES INC.; DELUXE DIGITAL DISTRIBUTION INC.; DELUXE DIGITAL STUDIOS, INC.; DELUXE ENTERTAINMENT SERVICES GROUP INC.; DELUXE MEDIA INC.; DELUXE ONE LLC; SFERA LABS, LLC
To: CREDIT SUISSE AG, AS COLLATERAL AGENT
Reel/Frame 049924/0596 →
SECURITY AGREEMENT Recorded Nov 9, 2016
From: SFERA LABS, LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 040581/0334 →
SECURITY AGREEMENT Recorded Nov 9, 2016
From: SFERA LABS, LLC
To: CREDIT SUISSE AG, AS COLLATERAL AGENT
Reel/Frame 040581/0309 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2016
From: FIUMI, MORGAN
To: SFERA LABS, LLC
Reel/Frame 040159/0649 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2016
From: FIUMI, MORGAN
To: MEDIASTUDIO, INC.
Reel/Frame 040159/0510 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2016
From: MEDIASTUDIO, INC.
To: FIUMI, MORGAN
Reel/Frame 040159/0583 →