IP Library Granted Patent US 10,740,887
Granted Patent B2
US 10,740,887 · App. 16/434,891 · Granted Aug 11, 2020

Method and system for automated video image focus change detection and classification

Inventors: Roger B. Greenway, Jr. (Franklin, TN); Jonathan N. Thompson (Houston, TX); James H. Whitcomb, Jr. (Houston, TX); Stephen B. Greenway (Hot Springs, AR)
Assignee: PANASONIC I-PRO SENSING SOLUTIONS CORPORATION OF AMERICA
G06T7/0002G06K9/20G06K9/6267G06K9/6269H04N17/002G06T2207/10016G06T2207/30168G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,740,887
App. No.
16/434,891
Granted
Aug 11, 2020
Kind
B2
Abstract

Various embodiments are provided for evaluating a focus status of a camera. A reference image is stored in a memory based on first image data received from the camera. Second image data is received from the camera in accordance with a predetermined schedule. A focus status of a test image of the second image data is classified, and it is determined whether the camera is in a state of focus based on the focus status of the test image. A focus of the camera is changed when the camera is determined not to be in the state of focus. A new reference image is stored in the memory based on third image data received from the camera, with the third image data being received after changing the focus of the camera.

Claims (72)

1. A system for evaluating a focus status of a camera, the system comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including:

storing a reference image in the memory based on first image data received from the camera;

receiving second image data from the camera in accordance with a predetermined schedule;

segmenting each of a test image of the second image data and the reference image into a respective array of sub-images;

calculating a sub-image focus metric for each sub-image of the test image and the reference image;

comparing focus metrics between the sub-images of the test image and the sub-images of the reference image;

determining whether the camera is in a state of focus based on a result of the comparing of the focus metrics;

changing a focus of the camera when the camera is determined not to be in the state of focus; and

storing a new reference image in the memory based on third image data received from the camera, the third image data being received after changing the focus of the camera.

2. The system according to claim 1 , wherein the operations further include:

outputting an alarm report including the reference image, the test image, and the new reference image.

3. The system according to claim 1 , wherein the operations further include:

clearing a warning count when the camera is determined to be in the state of focus; and

setting an alarm indication when the warning count exceeds a predetermined threshold.

4. The system according to claim 1 , further comprising:

a display,

wherein the operations further include:

displaying, on the display, the reference image, the test image, and the new reference image.

5. The system according to claim 4 , wherein

the reference image, the test image, and the new reference image are simultaneously displayed on the display, with the test image being between the reference image and the new reference image.

6. The system according to claim 4 , wherein

the new reference image is stored in the memory after changing the focus of the camera in response to an acceptance message being received while the reference image, the test image, and the new reference image are displayed on the display.

7. The system according to claim 1 , wherein

the test image is captured by the camera.

8. The system according to claim 1 , wherein

the second image data includes a plurality of images captured by the camera, and

the test image is generated from the plurality of images.

9. The system according to claim 8 , wherein

the test images is a background image generated from the plurality of images.

10. The system according to claim 1 , wherein

the new reference image is captured by the camera.

11. A system for evaluating a focus status of a camera, the system comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including:

storing a reference image in the memory based on first image data received from the camera;

receiving second image data from the camera in accordance with a predetermined schedule;

classifying a focus status of a test image of the second image data;

determining whether the camera is in a state of focus based on the focus status of the test image;

changing a focus of the camera when the camera is determined not to be in the state of focus; and

storing a new reference image in the memory based on third image data received from the camera, the third image data being received after changing the focus of the camera, wherein

the camera waits for foreground objects to disappear before capturing the new reference image, and

the new reference image is captured in a state having no foreground objects.

12. A method for evaluating a focus status of a camera, the method comprising:

storing, in a memory, a reference image based on first image data received from the camera;

receiving second image data from the camera in accordance with a predetermined schedule;

segmenting, by a processor, each of a test image of the second image data and the reference image into a respective array of sub-images;

calculating, by the processor, a sub-image focus metric for each sub-image of the test image and the reference image;

comparing, by the processor, focus metrics between the sub-images of the test image and the sub-images of the reference image;

determining, by the processor, whether the camera is in a state of focus based on a result of the comparing of the focus metrics;

changing a focus of the camera when the camera is determined not to be in the state of focus; and

storing, in the memory, a new reference image based on third image data received from the camera, the third image data being received after changing the focus of the camera.

13. The method according to claim 12 , further comprising:

outputting an alarm report including the reference image, the test image, and the new reference image.

14. The method according to claim 12 , further comprising:

clearing a warning count when the camera is determined to be in the state of focus; and

setting an alarm indication when the warning count exceeds a predetermined threshold.

15. A non-transitory computer readable storage medium that stores a set of executable instructions for evaluating a focus status of a camera, the set of executable instructions, when executed by a processor, causing operations to be performed, the operations comprising:

storing a reference image based on first image data received from the camera;

receiving second image data from the camera in accordance with a predetermined schedule;

segmenting each of a test image of the second image data and the reference image into a respective array of sub-images;

calculating a sub-image focus metric for each sub-image of the test image and the reference image;

comparing focus metrics between the sub-images of the test image and the sub-images of the reference image;

determining whether the camera is in a state of focus based on a result of the comparing of the focus metrics;

changing a focus of the camera when the camera is determined not to be in the state of focus; and

storing a new reference image based on third image data received from the camera, the third image data being received after changing the focus of the camera.

16. The non-transitory computer readable storage medium according to claim 15 , wherein the operations further comprise:

outputting an alarm report including the reference image, the test image, and the new reference image.

17. The non-transitory computer readable storage medium according to claim 15 , wherein the operations further comprise:

clearing a warning count when the camera is determined to be in the state of focus; and

setting an alarm indication when the warning count exceeds a predetermined threshold.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 25, 2019
From: PANASONIC CORPORATION OF NORTH AMERICA
To: PANASONIC I-PRO SENSING SOLUTIONS CORPORATION OF AMERICA
Reel/Frame 051107/0194 →
MERGER AND CHANGE OF NAME Recorded Nov 15, 2019
From: VIDEO INSIGHT, INC.; PANASONIC CORPORATION OF NORTH AMERICA
To: PANASONIC CORPORATION OF NORTH AMERICA
Reel/Frame 051057/0702 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2019
From: GREENWAY, ROGER B., JR.; THOMPSON, JONATHAN N.; WHITCOMB, JAMES H., JR.; GREENWAY, STEPHEN B.
To: VIDEO INSIGHT, INC.
Reel/Frame 051012/0046 →
Continuity (3)
Continuation 15211378 · Jul 15, 2016
Provisional Application 62193795 · Jul 17, 2015
Related Publication 20190295243A1 · Sep 26, 2019
Cited By (1)
US 12,499,655