Granted Patent B2

US 12,626,408 · App. 18/482,065 · Granted May 12, 2026

Inventors: Motoki Yako (Osaka, JP); Takayuki Kiyohara (Osaka, JP)

Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.

G06T9/00G01J3/2823G06V10/761H04N23/95

Abstract

Claims (78)

1 . An image processing apparatus comprising:

a storage device storing coding information indicating light transmission characteristics of an encoding mask including optical filters that are arranged in two dimensions and whose light transmission characteristics are different from one another; and

a signal processing circuit that generates, on a basis of a compressed image generated through imaging that employs the encoding mask and the coding information, reconstructed images including more signals than signals included in the compressed image,

wherein the signal processing circuit estimates an error in the reconstructed images on a basis of the compressed image, the reconstructed images, and the coding information, and outputs a signal indicating the error.

2 . The image processing apparatus according to claim 1 ,

wherein the signal processing circuit estimates the error on a basis of values of an evaluation function based on the compressed image, the reconstructed images, and the coding information.

3 . The image processing apparatus according to claim 1 ,

wherein the storage device also stores a reference image indicating a reference subject,

wherein the compressed image is generated by capturing, using the encoding mask, an image of a scene including the reference subject and a target subject to be obtained through reconstruction, and

wherein the signal processing circuit estimates the error on a basis of comparison between the reference image and an area in the reconstructed image indicating the reference subject.

4 . The image processing apparatus according to claim 1 ,

wherein the storage device also stores reference information indicating a spectrum of a reference subject,

wherein the compressed image is generated by capturing, using the encoding mask, an image of a scene including the reference subject and a target subject to be obtained through reconstruction, and

wherein the signal processing circuit estimates the error on a basis of a difference between spectra of an area in the reconstructed images corresponding to the reference subject and the spectrum indicated by the reference information.

5 . The image processing apparatus according to claim 4 ,

wherein the reference information is generated on a basis of an image obtained by capturing, using the encoding mask, an image of a scene including the reference subject.

6 . The image processing apparatus according to claim 1 ,

wherein the storage device also stores reference information indicating a spatial frequency of a reference subject,

wherein the compressed image is generated by capturing, using the encoding mask, an image of a scene including the reference subject and a target subject to be obtained through reconstruction, and

wherein the signal processing circuit estimates the error on a basis of a difference between spatial frequencies of an area in the reconstructed images corresponding to the reference subject and the spatial frequency indicated by the reference information.

7 . The image processing apparatus according to claim 1 ,

wherein the signal processing circuit outputs a warning if magnitude of the error exceeds a threshold.

8 . The image processing apparatus according to claim 1 ,

wherein the signal processing circuit stores the estimated error, predicts, on a basis of temporal changes in the error, a time when the error will exceed a threshold, and outputs a signal indicating the predicted time.

9 . The image processing apparatus according to claim 1 ,

wherein the optical filters have different spectral transmittances, and

wherein the reconstructed images include image information regarding wavelength bands.

10 . The image processing apparatus according to claim 1 ,

wherein the signal processing circuit displays the error and spatial variation in pixel values in the reconstructed images on a display device in a distinguishable manner.

11 . The image processing apparatus according to claim 1 , wherein the estimated error is different from an error calculated using a correct image.

12 . The image processing apparatus according to claim 1 further comprising:

the encoding mask; and

an image sensor.

13 . A method executed by a processor, the method comprising:

obtaining coding information indicating light transmission characteristics of an encoding mask including optical filters that are arranged in two dimensions and whose light transmission characteristics are different from one another;

obtaining a compressed image generated through imaging that employs the encoding mask;

generating, on a basis of the coding information, reconstructed images including more signals than signals included in the compressed image;

estimating an error in the reconstructed images on a basis of the compressed image, the reconstructed images, and the coding information; and

outputting a signal indicating the error.

14 . An image processing apparatus comprising:

a storage device storing coding information corresponding to photoresponse characteristics of an imaging device including areas whose photoresponse characteristics are different from one another; and

a signal processing circuit that generates, on a basis of a compressed image generated by the imaging device and the coding information, reconstructed images including more signals than signals included in the compressed image,

wherein the signal processing circuit estimates an error in the reconstructed images on a basis of the compressed image, the reconstructed images, and the coding information, and outputs a signal indicating the error.

15 . The image processing apparatus according to claim 14 ,

wherein the imaging device receives light through an optical element, and

wherein the coding information is information corresponding to optical characteristics of the optical element.

16 . A method executed by a processor, the method comprising:

obtaining coding information indicating light transmission characteristics of an encoding mask including optical filters that are arranged in two dimensions and whose light transmission characteristics are different from one another;

obtaining a compressed image generated through imaging that employs the encoding mask;

generating, on a basis of the coding information, reconstructed images including more signals than signals included in the compressed image; and

obtaining a reference image indicating a reference subject or reference information indicating a spectrum of the reference subject,

wherein the compressed image is generated by capturing, using the encoding mask, an image of a scene including the reference subject and a target subject to be obtained through reconstruction, and

the method further comprises:

(i) estimating an error in the reconstructed images on a basis of comparison between the reference image and an area in the reconstructed image indicating the reference subject, or

(ii) estimating the error on a basis of a difference between spectra of an area in the reconstructed images corresponding to the reference subject and the spectrum indicated by the reference information; and

outputting a signal indicating the error.

17 . A method executed by a processor, the method comprising:

obtaining coding information indicating light transmission characteristics of an encoding mask including optical filters that are arranged in two dimensions and whose light transmission characteristics are different from one another;

obtaining a compressed image generated through imaging that employs the encoding mask;

generating, on a basis of the coding information, reconstructed images including more signals than signals included in the compressed image;

estimating an error in the reconstructed images;

storing the estimated error;

predicting, on a basis of temporal changes in the error, a time when the error will exceed a threshold; and

outputting a signal indicating the predicted time.

18 . A method executed by a processor, the method comprising:

obtaining coding information indicating light transmission characteristics of an encoding mask including optical filters that are arranged in two dimensions and whose light transmission characteristics are different from one another;

obtaining a compressed image generated through imaging that employs the encoding mask;

generating, on a basis of the coding information, reconstructed images including more signals than signals included in the compressed image;

estimating an error in the reconstructed images; and

outputting a signal indicating the error,

wherein the optical filters have different spectral transmittances, and

wherein the reconstructed images include image information regarding wavelength bands.

19 . A method executed by a processor, the method comprising:

obtaining coding information indicating light transmission characteristics of an encoding mask including optical filters that are arranged in two dimensions and whose light transmission characteristics are different from one another;

obtaining a compressed image generated through imaging that employs the encoding mask;

generating, on a basis of the coding information, reconstructed images including more signals than signals included in the compressed image;

estimating an error in the reconstructed images; and

displaying the error and spatial variation in pixel values in the reconstructed images on a display device in a distinguishable manner.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (18)