IP Library › Granted Patent US 12,136,190
Granted Patent B2
US 12,136,190 · App. 18/197,378 · Granted Nov 5, 2024

Systems and methods for selective enhancement of objects in images

Inventor: Dmitry Sytnik (Kyiv, UA)
Assignee: Shinyfields Limited
G06T5/30G06F3/0482G06F3/04845G06T5/50G06T5/70G06T5/92G06T2207/10024G06T2207/20084G06T2207/20212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,136,190
App. No.
18/197,378
Granted
Nov 5, 2024
Kind
B2
Abstract

Exemplary embodiments are directed to a system for selective enhancement of an object in an image. The system includes an interface configured to receive as input an original image, and a processing device in communication with the interface. The processing device is configured to process the original image using a neural network to detect one or more objects in the original image, generate a neural network mask of the original image for the one or more objects in the original image, apply one or more enhancements to the objects associated with the neural network mask, the one or more modules generating an enhanced image including the one or more enhancements to the objects, and generate a combined image, the combined image including the original image combined with the one or more enhancements to the objects of the enhanced image.

Claims (34)

1. A method for selective enhancement of an object in an image, the method comprising:

receiving as input at an interface an original image;

processing the original image using a neural network to detect one or more objects in the original image, wherein the original image includes a foreground and a background, and wherein the one or more objects include the background of the original image;

generating a neural network mask of the original image for the one or more objects in the original image;

applying one or more enhancements to the objects associated with the neural network mask and generating an enhanced image including the one or more enhancements to the objects, wherein applying the one or more enhancements includes:

generating a refined mask for each pixel of at least the original image associated with the background; and

generating a dilated mask including a dilation or indentation from a border extending between the foreground and the background; and

generating a combined image, the combined image including the original image combined with the one or more enhancements to the objects of the enhanced image.

2. The method of claim 1 , wherein the one or more objects include a sky in the original image.

3. The method of claim 2 , further comprising determining a category type of the sky in the original image.

4. The method of claim 3 , wherein the category type includes at least one of a blue day sky, a sunset sky, a dawn sky, a cloudy sky, a stormy sky, a night sky, or a foggy sky.

5. The method of claim 1 , further comprising generating a blurred mask, the blurred mask including a blur along a border extending between the foreground and the background.

6. The method of claim 1 , wherein the one or more enhancements applied to the objects associated with the neural network mask are applied to the background independently from the foreground of the original image.

7. The method of claim 1 , wherein the one or more enhancements applied to the objects associated with the neural network mask are applied to the background without affecting the foreground of the original image.

8. The method of claim 1 , further comprising generating a saturation corrected image including saturation enhancement of the original image.

9. The method of claim 1 , further comprising generating a color improved image including color enhancement of the original image.

10. The method of claim 1 , further comprising generating a reduced noise image by reducing noise associated with a night sky in the original image.

11. A non-transitory computer-readable medium storing instructions at least for selective enhancement of an object in an image that are executable by a processing device, wherein execution of the instructions by the processing device causes the processing device to:

receive as input at an interface an original image;

process the original image using a neural network to detect one or more objects in the original image, wherein the original image includes a foreground and a background, and wherein the one or more objects include the background of the original image;

generate a neural network mask of the original image for the one or more objects in the original image;

apply one or more enhancements to the objects associated with the neural network mask and generating an enhanced image including the one or more enhancements to the objects, wherein applying the one or more enhancements includes:

generating a refined mask for each pixel of at least the original image associated with the background; and

generating a dilated mask including a dilation or indentation from a border extending between the foreground and the background; and

generate a combined image, the combined image including the original image combined with the one or more enhancements to the objects of the enhanced image.

12. The non-transitory computer-readable medium of claim 11 , wherein the one or more objects include a sky in the original image.

13. The non-transitory computer-readable medium of claim 12 , wherein the processing device determines a category type of the sky in the original image.

14. The non-transitory computer-readable medium of claim 13 , wherein the category type includes at least one of a blue day sky, a sunset sky, a dawn sky, a cloudy sky, a stormy sky, a night sky, or a foggy sky.

15. The non-transitory computer-readable medium of claim 11 , wherein the processing device generates a blurred mask, the blurred mask including a blur along a border extending between the foreground and the background.

16. The non-transitory computer-readable medium of claim 11 , wherein the one or more enhancements applied to the objects associated with the neural network mask are applied to the background independently from the foreground of the original image.

17. The non-transitory computer-readable medium of claim 11 , wherein the one or more enhancements applied to the objects associated with the neural network mask are applied to the background without affecting the foreground of the original image.

18. The non-transitory computer-readable medium of claim 11 , wherein the processing device generates a saturation corrected image including saturation enhancement of the original image.

19. The non-transitory computer-readable medium of claim 11 , wherein the processing device generates a color improved image including color enhancement of the original image.

20. The non-transitory computer-readable medium of claim 11 , wherein the processing device generates a reduced noise image by reducing noise associated with a night sky in the original image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 16, 2023
From: SYTNIK, DMITRY
To: SHINYFIELDS LIMITED
Reel/Frame 064601/0852 →
Continuity (3)
Continuation 16951908 · Nov 18, 2020
Provisional Application 62936856 · Nov 18, 2019
Related Publication 20230281767A1 · Sep 7, 2023