IP Library › Granted Patent US 11,671,702
Granted Patent B2
US 11,671,702 · App. 17/666,585 · Granted Jun 6, 2023

Real time assessment of picture quality

Inventor: Ishay Sivan (Tel Aviv, IL)
Assignee: SNAPAID LTD.
H04N23/64G06T7/0002G06T7/97G06V20/64H04N23/67H04N23/6812H04N23/80H04N23/951H05K999/99G06T2207/10016G06T2207/10032G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,671,702
App. No.
17/666,585
Granted
Jun 6, 2023
Kind
B2
Abstract

A computerized method for computing the photo quality of a captured image in a device image acquisition system, comprising on-board combining of a plurality of quality indicators computed from said captured image and its previous image frames quality indicators and a confidence level for at least one of said quality indicators; and using a processor to determine, based on said combining, whether photo quality is acceptable and taking differential action depending on whether quality is or is not acceptable.

Claims (29)

1. A method for estimating quality of at least one image from a stream of images, for use with a device that comprises in a single enclosure a digital camera module or functionality that comprises at least one optical lens for focusing received light from a scene and an image sensor coupled to at least one optical lens for capturing an image of the scene; a motion or location sensor for sensing the device motion; and a processor coupled to the image sensor and to the digital camera for receiving data therefrom, the method by the processor comprising use of at least one value from the following QI1 to QI4:

obtaining a first value (QI1) responsive to the device motion from at least one motion or location sensor;

obtaining a second value (QI2), where value is a measurement of under or over exposure of at least one of a part of image or face exposure;

analyzing the captured image for detecting or recognizing zero or more faces in the picture, calculates properties of at least one of said faces if exist, where said properties are at least one of: looking at camera, smiling, crying, face detection quality, face exposure or subject movement to obtain a third value (QI3);

obtaining a forth value (QI4) responsive to obstruction of at least one optical lens; and

estimating a forth weight (c4) associated with the forth value;

to select, based on values QI1, QI2, QI3, QI4, at least one appropriate suggestion from a pre-stored table of suggestions of how a user of the system may cause at least on said value to be above or below a threshold and to present said appropriate suggestion to the user.

2. The method according to claim 1 , where suggestions to the user can be “blurred image due to camera shake”, or “blurred subject due to subject movement”, or “Image dynamic range is beyond the sensor dynamic abilities—choose area of interest or take a high dynamic range (HDR) shot”.

3. The method according to claim 1 , further comprising grading the image quality according to, or based on, the total value, and wherein the total value is calculated based on at least one of QI1, QI2, QI3, QI4.

4. The method according to claim 1 , wherein the first value QI1 is estimated according to, or based on, the recognition value of at least one of said faces as a known face or unknown face, based on a pre-stored list of configured faces.

5. The method according to claim 1 , wherein QI1 is estimated according to, or based on, the detection value of at least one face detection.

6. The method according to claim 1 , wherein the third value is estimated according to, or based on, the estimated error in the analyzing the captured image for detecting or recognizing objects in the image.

7. The method according to claim 1 , wherein at least one of said values are calculated at least partially over a time-dependent confidence level defined over at least one of said values QI1, QI2, QI3, QI4.

8. The method according to claim 1 , where second value (QI2) is further based on object recognition done for third value (QI3), where object recognition can change importance of certain areas in image for the purpose calculation of said second value (QI2): over or under exposure value.

9. The method according to claim 1 , wherein at least one of the values (QI 1 , QI 2 , QI3, QI4, total value) causes change of one of focus point, ISO or aperture of at least of lens module.

10. The method according to claim 1 , wherein total value is above threshold, an image is saved into user persistent memory.

11. A method for estimating quality of at least one image from a plurality of images, for use with a device that comprises in a single enclosure a digital camera module or functionality that comprises at least one optical lens for focusing received light from a scene and an image sensor coupled to the optical lens for capturing an image of the scene; a motion sensor for sensing the device motion; wherein the motion sensor consists of, or comprises, an accelerometer, a gyroscope or both, and a processor coupled to at least one image sensor and to the digital camera for receiving data therefrom, the method by the processor comprising use of at least one value and weight:

obtaining a first value (QI1) responsive to device angle to the horizon; and

obtaining a second value (QI2) associated with aesthetic quality of image based on composition;

wherein at least one of the values is below a threshold, to select, at least one appropriate suggestion from a pre-stored table of suggestions of how a user of the system may cause at least one of QI1 or QI2, to be the threshold and to present the appropriate suggestion to the user.

12. The method according to claim 11 , wherein the suggestion may suggest to the user to move to another location.

13. The method according to claim 11 , further comprising calculating a total image quality according to, or based on, the total value, and wherein the total value is calculated based on, QI1 and QI2, and when the total quality is above or below the threshold, give the user feedback or save image to a user storage.

14. The method according to claim 11 , wherein the first, or second value is respectively associated with an estimated error in the first or second values.

15. The method according to claim 11 , wherein at least one of the values are defined at least partially over a time-dependent confidence level defined over at least one of the values QI1, QI2.

16. The method according to claim 13 , wherein at least one of the values are defined at least partially over a time-dependent confidence level defined over at least one of the values QI1, QI2.

17. The method according to claim 11 , further comprising analyzing the captured image for detecting or recognizing one or more objects in the image, wherein second value (QI2) associated with aesthetic quality is partially based on detected objects.

18. The method according to claim 12 , further comprising analyzing the captured image for detecting or recognizing one or more objects in the image, wherein second value (QI2) associated with aesthetic quality is partially.

19. The method according to claim 13 , further comprising analyzing the captured image for detecting or recognizing one or more objects in the image, wherein second value (QI2) associated with aesthetic quality is partially.

20. The method according to claim 16 , wherein the analyzing of the captured image comprises applying multiple algorithms selected from a group consisting of an aesthetic algorithm, an artificial neural network employing deep learning algorithm, a corner detection algorithm, a blur detecting algorithm, and Peak Signal-to-Noise Ratio (PSNR) calculation, and the method further comprising obtaining a respective second value (QI2i) associated with each of multiple algorithms, and calculating or estimating the third value (QI2) based on the multiple third values (QI2i) from the multiple algorithms.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2022
From: SIVAN, ISHAY
To: SNAPAID LTD.
Reel/Frame 058916/0435 →
Continuity (9)
Continuation 17189587 · Mar 2, 2021
Continuation 16867919 · May 6, 2020
Continuation 15992217 · May 30, 2018
Continuation 15582722 · Apr 30, 2017
Continuation 15007253 · Jan 27, 2016
Continuation 14437105
Provisional Application 61759643 · Feb 1, 2013
Provisional Application 61717216 · Oct 23, 2012
Related Publication 20220166920A1 · May 26, 2022