IP Library › Granted Patent US 12,254,618
Granted Patent B2
US 12,254,618 · App. 17/411,441 · Granted Mar 18, 2025

Circuit apparatus, electronic instrument, and error detection method

Inventors: Kumar Anandabairavasamy Anand (Richmond, CA); Hideki Matsuda (Chino, JP); Sebdani Mahmood Mazrouei (Markham, CA)
Assignee: SEIKO EPSON CORPORATION
G06T7/001G06T2207/10024G06T2207/20021G06T2207/20056G06T2207/20072G06T2207/30108
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,254,618
App. No.
17/411,441
Granted
Mar 18, 2025
Kind
B2
Abstract

A circuit apparatus includes an image acquisition circuit, an error detection circuit, and a search circuit. The error detection circuit determines an indicator representing the degree of dissimilarity between a foreground image and a background image out of a display image based on the result of correlation operation and performs error detection on the display image based on the indicator. The search circuit searches the display image for the display position of the foreground image based on the reference image, which serves as a reference for the foreground image. The error detection circuit performs the error detection based on the display position searched for by the search circuit.

Claims (52)

1. A circuit apparatus comprising:

an image acquisition circuit configured to acquire a display image including a foreground image in a given area of the display image and a background image corresponding to a background of the foreground image out of the display image;

an error detection circuit configured to:

determine histograms of pixel values of the display image to perform a correlation operation using the histograms;

determine an indicator representing a degree of dissimilarity between the foreground image and the background image based on a result of the correlation operation; and

perform an error detection on the display image based on the indicator; and

a search circuit configured to:

divide the display image into a plurality of band-shaped areas and divide each of the plurality of band-shaped areas into a plurality of individual areas;

perform fast Fourier transform processing on each edge image of the plurality of individual areas of the display image to obtain a first two-dimensional fast Fourier transform result including a plurality of first spatial frequency components;

perform the fast Fourier transform processing on an edge image of a reference image of the foreground image to obtain a second two-dimensional fast Fourier transform result including a plurality of second spatial frequency components, wherein the plurality of first and second spatial frequency components have the same number of rows and columns; and

perform inverse fast Fourier transform processing on the first and second two-dimensional fast Fourier transform results, by comparing every component of the plurality of first spatial frequency components with every corresponding component of the plurality of second spatial frequency components, to obtain an inverse fast Fourier transform result, the inverse fast Fourier transform result corresponding to a first plurality of cross-correlations between every edge image of the plurality of individual areas of the display image and the edge image of the reference image of the foreground image,

wherein the error detection circuit is further configured to:

generate a second cross-correlation between the display image and the reference image based on the first plurality of cross-correlations;

determine whether the second cross-correlation contains a value that is equal to or more than a threshold value;

detect a foreground image position where the second cross-correlation contains the value that is equal to or more than the threshold value as a position of the foreground image in the display image;

set a target area in the display image based on the detected foreground image position, the target area being a rectangular area in which the detected foreground image position is a center thereof and the foreground image is contained; and

perform the error detection with respect to the target area of the display image based on the indicator.

2. The circuit apparatus according to claim 1 ,

wherein the error detection circuit is configured to perform the error detection when the foreground image position is detected, and

the error detection circuit does not perform the error detection when the foreground image position is not detected.

3. The circuit apparatus according to claim 2 ,

wherein the error detection circuit does not detect the foreground image position when the second cross-correlation contains the value that is less than the threshold value.

4. The circuit apparatus according to claim 1 ,

wherein the error detection circuit is further configured to:

determine a histogram of each of components that form a color space;

perform an autocorrelation operation on the histogram of each of the components to determine a distance at which an autocorrelation value peaks for each of the components; and

determine the indicator based on a largest distance out of the determined distances.

5. The circuit apparatus according to claim 1 ,

wherein the error detection circuit is further configured to:

determine a first histogram of each of components that form a color space from the display image and a second histogram of each of the components from the reference image;

perform a cross-correlation operation on the first histogram and the second histogram for each of the components; and

determine the indicator based on a peak value of a peak provided by the cross-correlation.

6. The circuit apparatus according to claim 1 ,

wherein the error detection circuit is further configured to:

determine a second indicator representing a degree of agreement between the foreground image and the reference image based on the pixel values of the display image and pixel values of the reference image or pixel values of an edge image of the display image and pixel values of an edge image of the reference image; and

perform the error detection based on the indicator and the second indicator.

7. The circuit apparatus according to claim 1 ,

wherein the image acquisition circuit is configured to generate the display image by overlaying a second image on the given area of a first image, and

the background image corresponds to the first image.

8. An error detection method comprising:

acquiring a display image including a foreground image in a given area of the display image and a background image corresponding to a background of the foreground image out of the display image;

determining histograms of pixel values of the display image to perform a correlation operation using the histograms;

determining an indicator representing a degree of dissimilarity between the foreground image and the background image based on a result of the correlation operation;

dividing the display image into a plurality of band-shaped areas and divide each of the plurality of band-shaped areas into a plurality of individual areas;

performing fast Fourier transform processing on each edge image of the plurality of individual areas of the display image to obtain a first two-dimensional fast Fourier transform result including a plurality of first spatial frequency components;

performing the fast Fourier transform processing on an edge image of a reference image of the foreground image to obtain a second two-dimensional fast Fourier transform result including a plurality of second spatial frequency components, wherein the plurality of first and second spatial frequency components have the same number of rows and columns;

performing inverse fast Fourier transform processing on the first and second two-dimensional fast Fourier transform results, by comparing every component of the plurality of first spatial frequency components with every corresponding component of the plurality of second spatial frequency components, to obtain an inverse fast Fourier transform result, the inverse fast Fourier transform result corresponding to a first plurality of cross-correlations between every edge image of the plurality of individual areas of the display image and the edge image of the reference image of the foreground image;

generating a second cross-correlation between the display image and the reference image based on the first plurality of cross-correlations;

determining whether the second cross-correlation contains a value that is equal to or more than a threshold value;

detecting a foreground image position where the second cross-correlation contains the value that is equal to or more than the threshold value as a position of the foreground image in the display image;

setting a target area in the display image based on the detected foreground image position, the target area being a rectangular area in which the detected foreground image position is a center thereof and the foreground image is contained; and

performing an error detection with respect to the target area of the display image based on the indicator.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2021
From: ANAND, KUMAR ANANDABAIRAVASAMY; MATSUDA, HIDEKI; MAZROUEI, SEBDANI MAHMOOD
To: SEIKO EPSON CORPORATION
Reel/Frame 057284/0612 →
Priority Claims (1)
JP 2020-142188 · Aug 26, 2020 · national
Continuity (1)
Related Publication 20220067900A1 · Mar 3, 2022
References Cited (24)
US 5692072A · Hashimoto · 1997 [cited by applicant]
US 20050074160A1 · Miyashita · 2005 [cited by applicant]
US 20070078922A1 · Sano et al. · 2007 [cited by applicant]
US 20120036418A1 · Morino et al. · 2012 [cited by applicant]
US 20190213071A1 · Anand et al. · 2019 [cited by applicant]
US 20190250981A1 · Anand · 2019 [cited by examiner]
DE 102015012889A1 · 2017 [cited by applicant]
JP H04174306A · 1992 [cited by applicant]
JP H06231254A · 1994 [cited by applicant]
JP 11185018A · 1999 [cited by examiner]
JP 2000003444A · 2000 [cited by applicant]
JP 2004326728A · 2004 [cited by applicant]
JP 2005116626A · 2005 [cited by applicant]
JP 2005208739A · 2005 [cited by applicant]
JP 2007072394A · 2007 [cited by applicant]
JP 2007078511A · 2007 [cited by applicant]
JP 2007101691A · 2007 [cited by applicant]
JP 2007188174A · 2007 [cited by applicant]
JP 2008015848A · 2008 [cited by applicant]
JP 2012035677A · 2012 [cited by applicant]
JP 2020107351A · 2020 [cited by applicant]
WO 2015097855A1 · 2015 [cited by applicant]
Suzuki et al., “Data Position Detection Using Fast Fourier Transform Cross-Correlation Method for Holographic Memory,” Japanese Journal of Applied Physics, vol. 47, No. 1, pp. 183-188 (Year: 2008). [cited by examiner]
Debella-Gilo et al., “Sub-pixel precision image matching for measuring surface displacements on mass movements using normalized cross-correlation,” Remote Sensing of Environment, vol. 115, pp. 130-142 (Year: 2011). [cited by examiner]