IP Library › Granted Patent US 11,404,016
Granted Patent B2
US 11,404,016 · App. 16/931,793 · Granted Aug 2, 2022

Display device and electronic device having neural network for calculating set values of luminance and color tone

Inventor: Yoshiyuki Kurokawa (Sagamihara, JP)
Assignee: Semiconductor Energy Laboratory Co., Ltd.
G09G3/3648G09G3/3233G09G3/367G09G3/3629G09G2300/0465G09G2360/144
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,404,016
App. No.
16/931,793
Granted
Aug 2, 2022
Kind
B2
Abstract

A display device that performs image correction in accordance with external light environment is provided. The display device includes a host device and an optical sensor. In addition, the display device includes a processing circuit. The host device has a function of performing arithmetic processing using a neural network on software and a function of performing supervised learning with the neural network. The processing circuit has a function of performing arithmetic processing using a neural network on hardware. The optical sensor has a function of obtaining illuminance of external light. The obtained illuminance of external light is inputted to the host device, and a luminance and color tone preferred by users are regarded as teacher data, whereby learning is performed on the neural network of the host device. A weight coefficient obtained through the learning is used as a weight coefficient of the neural network of the processing circuit. By inputting illuminance of external light to the processing circuit, set values of luminance and color tone selected by the users are calculated in the neural network of the processing circuit.

Claims (55)

1. A display system comprising:

a host device;

a display portion; and

an image processing portion comprising a processing circuit,

wherein the host device is configured to perform a supervised learning based on learning data and teacher data by using a neural network on software,

wherein the host device is configured to generate a plurality of weight coefficients based on the supervised learning and to input the plurality of the weight coefficients to the processing circuit,

wherein the processing circuit is configured to perform an arithmetic operation using a neural network on hardware and to generate output data based on input data and the plurality of the weight coefficients,

wherein the number of layers of the neural network of the processing circuit is equivalent to the number of layers of the neural network of the software,

wherein each of the learning data and the input data comprises data of an illuminance of external light,

wherein the teacher data comprises a first set value corresponding to a first luminance and a first color tone,

wherein the output data comprises a second set value corresponding to a second luminance and a second color tone,

wherein the processing circuit comprises a first memory cell, a second memory cell, and an offset circuit,

wherein the first memory cell is configured to output a first current corresponding to a first analog data stored in the first memory cell,

wherein the second memory cell is configured to output a second current corresponding to a reference analog data stored in the second memory cell,

wherein the offset circuit is configured to output a third current corresponding to a differential current between the first current and the second current,

wherein the first memory cell is configured to output a fourth current corresponding to the first analog data stored in the first memory cell when a second analog data is supplied as a selection signal,

wherein the second memory cell is configured to output a fifth current corresponding to the reference analog data stored in the second memory cell when the second analog data is supplied as the selection signal,

wherein the processing circuit is configured to obtain a sixth current corresponding to a differential current between the fourth current and the fifth current and to output a seventh current depending on a sum of products of the first analog data and the second analog data, and

wherein the first analog data is a data corresponding to a first weight coefficient of the plurality of the weight coefficients.

2. The display system according to claim 1 , further comprising a source driver circuit,

wherein the image processing portion is configured to supply image data to the source driver circuit.

3. The display system according to claim 1 ,

wherein the processing circuit is configured to output the seventh current by subtracting the third current from the sixth current.

4. The display system according to claim 1 , further comprising a sensor,

wherein the display portion comprises a display element,

wherein the sensor is configured to obtain the illuminance of external light, and

wherein the display element is configured to display an image corresponding to the output data.

5. The display system according to claim 1 , further comprising a sensor,

wherein the display portion comprises a first display element and a second display element,

wherein the sensor is configured to obtain the illuminance of external light,

wherein the output data further comprises a third set value corresponding to a third luminance and a third color tone,

wherein the first display element is configured to display an image corresponding to the second luminance and the second color tone by reflection of external light, and

wherein the second display element is configured to display an image corresponding to the third luminance and the third color tone by self emission.

6. The display system according to claim 1 ,

wherein the first memory cell, the second memory cell, and the offset circuit comprises a first transistor, and

wherein the first transistor comprises a metal oxide in a channel formation region.

7. The display system according to claim 1 ,

wherein the offset circuit comprises a first current generation circuit, and a second current generation circuit,

wherein the first current generation circuit is configured to generate the third current when an amount of the first current is smaller than an amount of the second current, and to retain a potential corresponding to the third current,

wherein the second current generation circuit is configured to generate an eighth current corresponding to a difference between the first current and the second current when the amount of the first current is larger than the amount of the second current, and to retain a potential corresponding to the eighth current, and

wherein the processing circuit is configured to output the seventh current by subtracting the third current or the eighth current from the sixth current.

8. The display system according to claim 1 , further comprising:

a base; and

an integrated circuit,

wherein the display portion is formed over the base,

wherein the integrated circuit is mounted over the base,

wherein the processing circuit is formed over the base,

wherein the integrated circuit comprises the image processing portion, and

wherein the image processing portion is configured to process image data based on the output data.

9. The display system according to claim 8 ,

wherein the integrated circuit comprises a second transistor, and

wherein the second transistor comprises silicon in a channel formation region.

10. The display system according to claim 8 ,

wherein the integrated circuit comprises a third transistor, and

wherein the third transistor comprises a metal oxide in a channel formation region.

Priority Claims (2)
JP 2016-165511 · Aug 26, 2016 · national
JP 2016-165512 · Aug 26, 2016 · national
Continuity (2)
Continuation 15682919 · Aug 22, 2017
Related Publication 20200349898A1 · Nov 5, 2020
Cited By (2)
US 12,276,889 US 12,632,718