IP Library › Granted Patent US 11,893,668
Granted Patent B2
US 11,893,668 · App. 17/705,678 · Granted Feb 6, 2024

Imaging system and method for generating a final digital image via applying a profile to image information

Inventor: Thomas Edward Bishop (San Francisco, CA)
G06T11/60G06T3/0056G06T7/571G06T7/97H04N19/124
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,893,668
App. No.
17/705,678
Granted
Feb 6, 2024
Kind
B2
Abstract

A method of generating an image may include obtaining a profile of a combination of a full-frame camera and a lens; obtaining image information from an electronic sensor of a mobile electronic device; and/or generating, via an electronic control unit of the mobile electronic device, a final digital image via applying a profile of the one or more profiles to the image information.

Claims (56)

1. A method of generating a digital image, the method comprising:

obtaining a profile of a combination of a full-frame camera and a lens;

obtaining image information from an electronic sensor of a mobile electronic device;

generating, via an electronic control unit of the mobile electronic device, a final digital image via applying the profile to the image information;

wherein the image information includes color information and depth information;

wherein the depth information includes a depth map;

wherein generating the final digital image includes:

identifying a focus area in the depth map;

converting the depth map to a blur radius map;

applying guided upscaling to the blur radius map;

quantizing the upscaled blur radius map to the closest indices in PSF information of the profile;

preprocessing the PSF information;

looking up front and back neighbor PSFs in the PSF information for the quantized upscaled blur radius map;

calculating interpolation factors;

modifying the neighbor PSFs;

converting the image information to a linear tone curve;

applying a per-pixel render procedure based, at least in part, on the converted image information and the modified PSFs, to provide an intermediate image;

restoring the tone curve for the intermediate image; and

blending back sharp pixels in the foreground of the intermediate image.

2. The method of claim 1 , wherein the profile includes a point spread function.

3. The method of claim 1 , wherein obtaining the profile includes operating the full-frame camera and the lens to generate a point spread function.

4. The method of claim 3 , wherein operating the full-frame camera and the lens to generate the point spread function includes capturing one or more profile images of an electronic display.

5. The method of claim 4 , wherein the electronic display displays a plurality of white circles on a black background; and

the electronic display incudes an OLED display.

6. The method of claim 1 , wherein the profile is obtained from an electronic library of profiles of respective combinations of full-frame cameras and lenses.

7. The method of claim 6 , wherein the electronic library is stored on a memory of the mobile electronic device.

8. The method of claim 6 , wherein the electronic library is stored on a remote server; and

obtaining the profile includes the mobile electronic device wirelessly communicating via a global computer network to access the profile from the electronic library.

9. The method of claim 1 , wherein the mobile electronic device includes a cellular transceiver.

10. The method of claim 1 , wherein the full-frame camera includes a color sensor that has a larger area than an area of the electronic sensor of the mobile electronic device.

11. The method of claim 1 , including deleting or ignoring default profile information of the mobile electronic device.

12. An imaging system, comprising:

a plurality of electronic profiles of combinations of full-frame cameras and lenses stored in an electronic memory; and

a mobile electronic device configured to obtain image information via an electronic sensor of the mobile electronic device;

wherein the mobile electronic device is configured to generate, via an electronic control unit of the mobile electronic device, a final digital image via applying a profile of the plurality of electronic profiles to the image information;

wherein the image information includes color information and depth information;

the depth information includes a depth map,

wherein generating the final digital image includes:

identifying a focus area in the depth map;

converting the depth map to a blur radius map;

applying guided upscaling to the blur radius map;

quantizing the upscaled blur radius map to the closest indices in PSF information of the profile;

preprocessing the PSF information;

looking up front and back neighbor PSFs in the PSF information for the quantized upscaled blur radius map;

calculating residual interpolation factors;

modifying the neighbor PSFs;

converting the image information to a linear tone curve;

applying a per-pixel render procedure based, at least in part, on the converted image information and the modified PSFs, to provide an intermediate image;

restoring the tone curve for the intermediate image; and

blending back sharp pixels in the foreground of the intermediate image to generate the final digital image.

13. The system of claim 12 , wherein the mobile electronic device includes the electronic memory.

14. The system of claim 12 , including a remote computer server including the electronic memory;

wherein the mobile electronic device is configured to communicate with the remote server wirelessly to access the plurality of electronic profiles.

15. The system of claim 12 , wherein the profile includes point spread function information stored in the electronic memory as a one-dimensional array; and

applying the profile includes applying the point spread function information as a function of radial distance.

16. The system of claim 12 , wherein the plurality of electronic profiles include a plurality of PSFs for a plurality of depths and focal distances for each combination of full-frame camera and lens.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2023
From: ERNST LEITZ LABS LLC
To: LEICA CAMERA AG
Reel/Frame 064229/0636 →
Continuity (2)
Provisional Application 63168768 · Mar 31, 2021
Related Publication 20220319080A1 · Oct 6, 2022
Cited By (1)
US 12,639,867