IP Library Granted Patent US 12,394,113
Granted Patent B2
US 12,394,113 · App. 17/351,303 · Granted Aug 19, 2025

Pixel blending for neural network-based image generation

Inventors: Robert Pottorff (Santa Clara, CA); Karan Sapra (Pasadena, CA); Andrew Tao (Los Altos, CA); Bryan Catanzaro (Los Altos Hills, CA); Jarmo Lunden (Uusimaa, FI)
Assignee: NVIDIA Corporation
G06T11/001G06T7/215G06T7/90G06T2200/24G06T2207/10024G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,394,113
App. No.
17/351,303
Granted
Aug 19, 2025
Kind
B2
Abstract

Apparatuses, systems, and techniques are presented to generate one or more images. In at least one embodiment, two or more pixels from two or more images are blended based, at least in part, on a distance of the two or more pixels from a region of the two or more images, in which pixel colors are substantially similar.

Claims (36)

1. A processor, comprising:

one or more circuits to blend two or more pixels from two or more images based, at least in part, on a distance of the two or more pixels from a region of the two or more images, in which pixel colors are substantially similar.

2. The processor of claim 1 , wherein the two or more images are adjacent images in an image sequence, and wherein the two or more pixels correspond to correlated pixel locations in the two or more images.

3. The processor of claim 1 , wherein the region includes correlated pixels with color values that agree within a determined agreement threshold or agreement range.

4. The processor of claim 1 , wherein the two or more pixels are to be blended using a blending algorithm that is to produce one or more blending factors as a function of the distance.

5. The processor of claim 4 , wherein the blending algorithm includes one or more user-adjustable parameters to control a value of the one or more blending factors.

6. The processor of claim 1 , wherein the one or more circuits are further to blend the two or more pixels after error correction is applied to the two or more images based on at least one of optical flow or geometric motion data.

7. A system comprising:

one or more processors to blend two or more pixels from two or more images based, at least in part, on a distance of the two or more pixels from a region of the two or more images, in which pixel colors are substantially similar.

8. The system of claim 7 , wherein the two or more images are adjacent images in an image sequence, and wherein the two or more pixels correspond to correlated pixel locations in the two or more images.

9. The system of claim 7 , wherein the region includes correlated pixels with color values that agree within a determined agreement threshold or agreement range.

10. The system of claim 7 , wherein the two or more pixels are to be blended using a blending algorithm that is to produce one or more blending factors as a function of the distance.

11. The system of claim 10 , wherein the blending algorithm includes one or more user-adjustable parameters to control a value of the one or more blending factors.

12. The system of claim 7 , wherein the one or more circuits are further to blend the two or more pixels after error correction is applied to the two or more images based on at least one of optical flow or geometric motion data.

13. A method comprising:

blending two or more pixels from two or more images based, at least in part, on a distance of the two or more pixels from a region of the two or more images, in which pixel colors are substantially similar.

14. The method of claim 13 , wherein the two or more images are adjacent images in an image sequence, and wherein the two or more pixels correspond to correlated pixel locations in the two or more images.

15. The method of claim 13 , wherein the region includes correlated pixels with color values that agree within a determined agreement threshold or agreement range.

16. The method of claim 13 , wherein the two or more pixels are to be blended using a blending algorithm that is to produce one or more blending factors as a function of the distance.

17. The method of claim 16 , wherein the blending algorithm includes one or more user-adjustable parameters to control a value of the one or more blending factors.

18. The method of claim 13 , wherein the one or more circuits are further to blend the two or more pixels after error correction is applied to the two or more images based on at least one of optical flow or geometric motion data.

19. A machine-readable medium having stored thereon a set of instructions, which if performed by one or more processors, cause the one or more processors to at least:

blend two or more pixels from two or more images based, at least in part, on a distance of the two or more pixels from a region of the two or more images, in which pixel colors are substantially similar.

20. The machine-readable medium of claim 19 , wherein the two or more images are adjacent images in an image sequence, and wherein the two or more pixels correspond to correlated pixel locations in the two or more images.

21. The machine-readable medium of claim 19 , wherein the region includes correlated pixels with color values that agree within a determined agreement threshold or agreement range.

22. The machine-readable medium of claim 19 , wherein the two or more pixels are to be blended using a blending algorithm that is to produce one or more blending factors as a function of the distance.

23. The machine-readable medium of claim 22 , wherein the blending algorithm includes one or more user-adjustable parameters to control a value of the one or more blending factors.

24. The machine-readable medium of claim 19 , wherein the one or more circuits are further to blend the two or more pixels after error correction is applied to the two or more images based on at least one of optical flow or geometric motion data.

25. An image blending system, comprising:

one or more processors to blend two or more pixels from two or more images based, at least in part, on a distance of the two or more pixels from a region of the two or more images, in which pixel colors are substantially similar; and

memory for storing image data comprising the pixel colors for the blended pixels.

26. The image blending system of claim 25 , wherein the two or more images are adjacent images in an image sequence, and wherein the two or more pixels correspond to correlated pixel locations in the two or more images.

27. The image blending system of claim 25 , wherein the region includes correlated pixels with color values that agree within a determined agreement threshold or agreement range.

28. The image blending system of claim 25 , wherein the two or more pixels are to be blended using a blending algorithm that is to produce one or more blending factors as a function of the distance.

29. The image blending system of claim 28 , wherein the blending algorithm includes one or more user-adjustable parameters to control a value of the one or more blending factors.

30. The image blending system of claim 25 , wherein the one or more circuits are further to blend the two or more pixels after error correction is applied to the two or more images based on at least one of optical flow or geometric motion data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2021
From: POTTORFF, ROBERT; SAPRA, KARAN; TAO, ANDREW; CATANZARO, BRYAN; LUNDEN, JARMO
To: NVIDIA CORPORATION
Reel/Frame 056615/0957 →
Continuity (1)
Related Publication 20220405987A1 · Dec 22, 2022
References Cited (24)
US 6442203B1 · Demos · 2002 [cited by examiner]
US 6816552B2 · Demos · 2004 [cited by examiner]
US 20040075660A1 · Liao et al. · 2004 [cited by applicant]
US 20080247462A1 · Demos · 2008 [cited by examiner]
US 20090123089A1 · Karlov · 2009 [cited by examiner]
US 20140362173A1 · Doepke · 2014 [cited by examiner]
US 20170178395A1 · Pharr · 2017 [cited by applicant]
US 20180144438A1 · Li et al. · 2018 [cited by applicant]
US 20190007607A1 · Lin et al. · 2019 [cited by applicant]
US 20190356918A1 · Demos · 2019 [cited by examiner]
US 20220014697A1 · Cote · 2022 [cited by examiner]
CN 101477695A · 2009 [cited by applicant]
CN 102081284A · 2011 [cited by applicant]
CN 103856727A · 2014 [cited by applicant]
CN 106462997A · 2017 [cited by applicant]
GB 2552238A · 2018 [cited by applicant]
KR 20070065112A · 2007 [cited by applicant]
KR 100968378B1 · 2010 [cited by applicant]
WO 9811510A1 · 1998 [cited by applicant]
WO WO2008140656 · 2008 [cited by examiner]
WO 2021183246A1 · 2021 [cited by applicant]
IEEE, “IEEE Standard 754-2008 (Revision of IEEE Standard 754-1985): IEEE Standard for Floating-Point Arithmetic,” Aug. 29, 2008, 70 pages. [cited by applicant]
United Kingdom Combined Search and Examination Report for Application No. GB2208729.0, mailed Dec. 9, 2022, 6 pages. [cited by applicant]
Chinese Office Action for Application No. 202210620543.8 dated Jun. 24, 2025, 12 pages. [cited by applicant]