Granted Patent B2

US 12,488,440 · App. 17/794,698 · Granted Dec 2, 2025

Inventors: Kengo Akimoto (Isehara, JP); Daichi Mishima (Hadano, JP)

Assignee: Semiconductor Energy Laboratory Co., Ltd.

G06T5/77G06T2207/20081G06T2207/20084

Abstract

Claims (80)

1 . An image processing system comprising a display device, an image capturing device, and a learning device,

wherein the display device comprises an input portion, a machine learning processing portion, and a display portion in which m rows and n columns of pixels are arranged in a matrix,

wherein the learning device comprises a database, an image processing portion, an image generation portion, and a learning portion,

wherein the database stores a table generated in accordance with first image data input to the input portion and second image data acquired by display of an image corresponding to the first image data on the display portion and image capturing by the image capturing device in a manner to include the image displayed on the display portion,

wherein the first image data comprises m rows and n columns of first grayscale values,

wherein the second image data comprises m rows and n columns of second grayscale values,

wherein the table represents the first grayscale values and the second grayscale values at coordinates corresponding to coordinates of the first grayscale values,

wherein the image processing portion is configured to perform, in accordance with a second learning image data, image processing on a first learning image data input to the input portion and thereby generating a third learning image data,

wherein the second learning image data is image data acquired by display of an image corresponding to the first learning image data on the display portion and image capturing by the image capturing device in a manner to include the image displayed on the display portion,

wherein the third learning image data comprises m rows and n columns of third grayscale values,

wherein the image generation portion is configured to generate a fourth learning image data that is image data comprising the first grayscale values corresponding to the second grayscale values selected in accordance with the third grayscale values,

wherein the learning portion is configured to generate a machine learning model using the first learning image data and the fourth learning image data,

wherein the learning portion is configured to output the machine learning model to the machine learning processing portion,

wherein the machine learning processing portion is configured to perform processing based on the machine learning model on content image data input to the input portion, and

wherein m and n are each an integer of greater than or equal to 2.

2 . The image processing system according to claim 1 ,

wherein the first learning image data comprises m rows and n columns of fourth grayscale values,

wherein the second learning image data comprises m rows and n columns of fifth grayscale values, and

wherein the image processing portion is configured to perform the image processing in a manner to make a difference between a sum of the third grayscale values and a sum of the fifth grayscale values smaller than a difference between a sum of the fourth grayscale values and a sum of the fifth grayscale values.

3 . The image processing system according to claim 1 ,

wherein the machine learning model is a neural network model.

4 . An image processing system comprising a display device, an image capturing device, and a generator,

wherein the display device comprises an input portion, a bright spot correction portion, and a display portion in which m rows and n columns of pixels are arranged in a matrix,

wherein the generator comprises a database and an image generation portion,

wherein the database stores a table generated in accordance with a first database image data input to the input portion and a second database image data acquired by display of an image corresponding to the first database image data on the display portion and image capturing by the image capturing device in a manner to include the image displayed on the display portion,

wherein the first database image data comprises m rows and n columns of first grayscale values,

wherein the second database image data comprises m rows and n columns of second grayscale values,

wherein the table represents the first grayscale values and the second grayscale values at coordinates corresponding to coordinates of the first grayscale values,

wherein the image capturing device is configured to perform image capturing of, when the display portion displays an image corresponding to a first bright spot correction image data input to the input portion, the image displayed on the display portion and thereby acquiring a second bright spot correction image data,

wherein the second bright spot correction image data comprises m rows and n columns of third grayscale values,

wherein the image generation portion is configured to generate a third bright spot correction image data that is image data comprising the first grayscale values corresponding to the second grayscale values selected in accordance with the third grayscale values,

wherein the bright spot correction portion is configured to detect, as bright spot coordinates, coordinates of the first grayscale values smaller than or equal to a threshold value among m rows and n columns of the first grayscale values of the third bright spot correction image data,

wherein the bright spot correction portion is configured to reduce, when content image data comprising m rows and n columns of fourth grayscale values is input to the input portion, the fourth grayscale values at coordinates that are the same as the bright spot coordinates, and

wherein m and n are each an integer of greater than or equal to 2.

5 . The image processing system according to claim 4 ,

wherein the display device comprises a machine learning processing portion,

wherein the generator comprises an image processing portion and a learning portion,

wherein the image processing portion is configured to perform, in accordance with a second learning image data, image processing on a first learning image data input to the input portion and thereby generating a third learning image data,

wherein the second learning image data is image data acquired by display of an image corresponding to the first learning image data on the display portion and image capturing by the image capturing device in a manner to include the image displayed on the display portion,

wherein the third learning image data comprises m rows and n columns of fifth grayscale values,

wherein the image generation portion is configured to generate a fourth learning image data that is image data comprising the first grayscale values corresponding to the second grayscale values selected in accordance with the fifth grayscale values,

wherein the learning portion is configured to generate a machine learning model using the first learning image data and the fourth learning image data,

wherein the learning portion is configured to output the machine learning model to the machine learning processing portion, and

wherein the machine learning processing portion is configured to perform processing based on the machine learning model on the content image data input to the input portion.

6 . The image processing system according to claim 5 ,

wherein the first learning image data comprises m rows and n columns of sixth grayscale values,

wherein the second learning image data comprises m rows and n columns of seventh grayscale values, and

wherein the image processing portion is configured to perform the image processing in a manner to make a difference between a sum of the fifth grayscale values and a sum of the seventh grayscale values smaller than a difference between a sum of the sixth grayscale values and a sum of the seventh grayscale values.

7 . The image processing system according to claim 5 ,

wherein the machine learning model is a neural network model.

8 . An image processing system comprising a display device, an image capturing device, and a generator,

wherein the display device comprises an input portion, a bright spot correction portion, and a display portion in which m rows and n columns of pixels are arranged in a matrix,

wherein the generator comprises a database and an image generation portion,

wherein the database stores a table generated in accordance with a first database image data input to the input portion and a second database image data acquired by display of an image corresponding to the first database image data on the display portion and image capturing by the image capturing device in a manner to include the image displayed on the display portion,

wherein the first database image data comprises m rows and n columns of first grayscale values,

wherein the second database image data comprises m rows and n columns of second grayscale values,

wherein the table represents the first grayscale values and the second grayscale values at coordinates corresponding to coordinates of the first grayscale values,

wherein the image capturing device is configured to perform image capturing of, when the display portion displays an image corresponding to a first bright spot correction image data input to the input portion, the image displayed on the display portion and thereby acquiring a second bright spot correction image data,

wherein the second bright spot correction image data comprises m rows and n columns of third grayscale values,

wherein the image generation portion is configured to generate a third bright spot correction image data that is image data comprising the first grayscale values corresponding to the second grayscale values selected in accordance with the third grayscale values,

wherein the bright spot correction portion is configured to detect, as first bright spot coordinates, coordinates of the first grayscale values smaller than or equal to a first threshold value among m rows and n columns of the first grayscale values of the third bright spot correction image data,

wherein the bright spot correction portion is configured to detect, as second bright spot coordinates, coordinates of the third grayscale values larger than or equal to a second threshold value among the m rows and n columns of third grayscale values of the second bright spot correction image data,

wherein the bright spot correction portion is configured to reduce, when content image data comprising m rows and n columns of fourth grayscale values is input to the input portion, the fourth grayscale values at coordinates that are the same as the first or second bright spot coordinates, and

wherein m and n are each an integer of greater than or equal to 2.

9 . The image processing system according to claim 8 ,

wherein the display device comprises a machine learning processing portion,

wherein the generator comprises an image processing portion and a learning portion,

wherein the image processing portion is configured to perform, in accordance with a second learning image data, image processing on a first learning image data input to the input portion and thereby generating a third learning image data,

wherein the second learning image data is image data acquired by display of an image corresponding to the first learning image data on the display portion and image capturing by the image capturing device in a manner to include the image displayed on the display portion,

wherein the third learning image data comprises m rows and n columns of fifth grayscale values,

wherein the image generation portion is configured to generate a fourth learning image data that is image data comprising the first grayscale values corresponding to the second grayscale values selected in accordance with the fifth grayscale values,

wherein the learning portion is configured to generate a machine learning model using the first learning image data and the fourth learning image data,

wherein the learning portion is configured to output the machine learning model to the machine learning processing portion, and

wherein the machine learning processing portion is configured to perform processing based on the machine learning model on the content image data input to the input portion.

10 . The image processing system according to claim 9 ,

wherein the first learning image data comprises m rows and n columns of sixth grayscale values,

wherein the second learning image data comprises m rows and n columns of seventh grayscale values, and

wherein the image processing portion is configured to perform the image processing in a manner to make a difference between a sum of the fifth grayscale values and a sum of the seventh grayscale values smaller than a difference between a sum of the sixth grayscale values and a sum of the seventh grayscale values.

11 . The image processing system according to claim 9 ,

wherein the machine learning model is a neural network model.

Assignments (1)

Priority Claims (2)

Continuity (1)

References Cited (35)