IP Library Granted Patent US 10,839,500
Granted Patent B2
US 10,839,500 · App. 16/378,415 · Granted Nov 17, 2020

Digital media enhancement system, method, and apparatus

Inventors: Gary Shuster (Vancouver, CA); Brian Shuster (Vancouver, CA)
G06T5/50G06K9/00677G06K9/62G06T5/003G06T7/0002G06T11/60H04N5/225G06T2207/10004G06T2207/10016G06T2207/10024G06T2207/20201G06T2207/20221G06T2207/30168G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,839,500
App. No.
16/378,415
Granted
Nov 17, 2020
Kind
B2
Abstract

Aspects are disclosed for enhancing digital media. In an aspect, a target object in a primary image is identified, and reference images that include the target object are located. The target object is then modified within the primary image according to data derived from analyzing the reference image. In another aspect, a primary file is received, and at least one reference file is referenced to generate enhancement data that facilitates enhancing the primary file from an extrapolation of the reference file. In yet another aspect, media files corresponding to a common event are aggregated, and a desired enhancement of a primary file is identified. Here, the desired enhancement corresponds to a modification of an obstruction included in the primary file. A reference file which includes data associated with the desired enhancement is then referenced, and the obstructed data is modified based on replacement data extrapolated from the reference file.

Claims (37)

1. A device comprising:

a computer;

a computer readable memory having one or more computer executable components stored thereon; and

a processor configured to execute the one or more computer executable components to cause the computer to perform the following actions, comprising:

identifying, in a primary digital file, one or more objects (“Target Objects”);

searching a plurality of digital files to locate at least one reference file containing an image of one or more objects substantially similar to the Target Objects (“Reference Objects”), where the Reference Objects are selected, at least in part, based on a projected accuracy of identifying at least one of the edges of the Reference Objects;

utilizing the Reference Objects to identify, at least in part, an edge of at least one of the Target Objects; and

selecting for editing at least one of the Target Objects based at least in part on the identifying.

2. The device of claim 1 , where the identifying of the Target Objects is done, at least in part, based on user input.

3. The device of claim 1 , where Target Objects that have been matched with Reference Objects are presented to a user for selection of at least one of the Target Objects.

4. The device of claim 3 , where a projected accuracy of the selecting is indicated to the user in conjunction with each of the presented Target Objects.

5. The device of claim 1 , where the Reference Objects are identified, at least in part, by a projected accuracy of the selecting.

6. The device of claim 1 , where a background behind a potential Reference Objects is utilized at least in part as a criteria for selecting at least one of the Reference Objects.

7. The device of claim 6 , where the background is selected at least in part because the background is similar to a background behind the Target Objects.

8. The device of claim 6 , where the background is selected at least in part based on an ability to easily identify at least one of the edges of the Reference Objects against the background.

9. A device comprising:

a computer;

a computer readable memory having one or more computer executable components stored thereon; and

a processor configured to execute the one or more computer executable components to cause the computer to perform the following actions, comprising:

identifying, in a primary digital file, one or more objects (“Target Objects”);

searching a plurality of digital files to locate at least one reference file containing an image of one or more objects substantially similar to the Target Objects (“Reference Objects”);

comparing the Target Objects and Reference Objects to determine one or more selected characteristics of opacity, light reflection, or light refraction;

quantifying the one or more selected characteristics in at least one of the Target Objects and at least one of the Reference Objects;

incorporating the Reference Objects into the primary digital file;

where the incorporating is modified at least in part on comparing the selected characteristics of the one or more Target Objects to the selected characteristics of the one or more Reference Objects.

10. The device of claim 9 , where the selected characteristics are utilized at least in part to identify the edges of the Target Objects.

11. A device comprising:

a computer;

a computer readable memory having one or more computer executable components stored thereon; and

a processor configured to execute the one or more computer executable components to cause the computer to perform the following actions, comprising:

identifying, in a primary digital file containing audio, one or more words;

inferring a context from the one or more words;

searching a plurality of digital files to locate at least one reference file containing an image associated with the context inferred from the one or more words; and

displaying the at least one reference file on a display when the primary digital file is played.

12. The device of claim 11 , where a portion of the audio file analyzed for word identification is subsequent to the portion currently being played to the user.

13. The device of claim 11 , where the primary digital file is an audio book.

14. The device of claim 11 , where the primary digital file is a song.

Assignments (2)
SECURITY INTEREST Recorded Aug 6, 2025
From: NIYA HOLDINGS, LLC
To: SHUSTER, BRIAN, MR.; UTHERVERSE DIGITAL, INC.
Reel/Frame 071950/0423 →
LIEN Recorded May 30, 2025
From: UTHERVERSE DIGITAL, INC.; SHUSTER, BRIAN, MR.
To: NIYA HOLDINGS, LLC
Reel/Frame 071469/0405 →