IP Library Granted Patent US 11,182,022
Granted Patent B2
US 11,182,022 · App. 16/090,008 · Granted Nov 23, 2021

Coordinate detection method, coordinate detection program, and coordinate detection system

Inventor: Masayuki Terao (Tokyo, JP)
Assignee: SHARP NEC DISPLAY SOLUTIONS, LTD.
G06F3/042G06F3/0425
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,182,022
App. No.
16/090,008
Granted
Nov 23, 2021
Kind
B2
Abstract

A coordinate detection system includes a camera configured to capture an image of a face opposite to a display face of a transmissive display panel including a plurality of luminous parts and to thereby produce video information, and a video processor configured to detect coordinates instructed on the display face of the transmissive display panel based on the luminance or chromaticity of reflected light, which occurs when reflecting light emitted from each luminous part of the transmissive display panel, according to the captured video information.

Claims (34)

1. A coordinate detection method, comprising:

capturing images of a face opposite to a display face of a transmissive display panel including a plurality of luminous parts and thereby producing video information; and

detecting coordinates instructed on the display face of the transmissive display panel based on a chromaticity of reflected light, which occurs when reflecting light emitted from each luminous part of the transmissive display panel, according to the video information,

wherein, upon detecting the coordinates, a difference of a luminance of the reflected light between a frame, in a first state that an object is before being touched with a display screen, and a frame in a second state that the object is in touch with the display screen so that the display light from the display screen is reflected by the object resulting in a certain amount of the reflection light, is calculated according to the video information and the existence/nonexistence of an instruction is determined by determining whether or not the difference exceeds a threshold.

2. The coordinate detection method according to claim 1 , wherein, upon detecting the coordinates, the difference of the luminance of the reflected light between the frame before being instructed and the frame after being instructed is calculated according to the video information and the existence of the instruction is determined by determining whether or not the difference exceeds the threshold when the chromaticity of the reflected light matches chromaticity of a video object being outputted on the display face.

3. The coordinate detection method according to claim 1 , wherein, upon detecting the coordinates, the difference of the luminance of the reflected light between the frame before being instructed and the frame after being instructed is calculated according to the video information and the existence of an instruction is determined by determining whether or not the difference exceeds the threshold when the video information includes a video of a person.

4. The coordinate detection method according to claim 1 , wherein a video output on the display face includes a plurality of video objects.

5. The coordinate detection method according to claim 1 , wherein the plurality of luminous parts of the transmissive display panel include a plurality of organic electroluminescence elements.

6. The coordinate detection method according to claim 1 , further comprising:

detecting the luminance of reflected light; and

detecting the chromaticity of reflected light,

wherein the detecting of the coordinates is based on the luminance of reflected light and the chromaticity of reflected light.

7. The coordinate detection method according to claim 1 , wherein the object includes an operator's finger.

8. The coordinate detection method according to claim 1 , wherein the object includes a touch pen.

9. A non-transitory computer-readable storage medium having stored a coordinate detection program causing a computer to implement:

capturing images of a face opposite to a display face of a transmissive display panel including a plurality of luminous parts and thereby producing video information; and

detecting coordinates instructed on the display face of the transmissive display panel based on a chromaticity of reflected light, which occurs when reflecting light emitted from each luminous part of the transmissive display panel, according to the video information,

wherein, upon detecting the coordinates, a difference of a luminance of the reflected light between a frame, in a first state that an object is before being touched with a display screen, and a frame in a second state that the object is in touch with the display screen so that the display light from the display screen is reflected by the object resulting in a certain amount of the reflection light, is calculated according to the video information and the existence/nonexistence of an instruction is determined by determining whether or not the difference exceeds a threshold.

10. The non-transitory computer-readable storage medium according to claim 9 , wherein the program further causes the computer to implement:

detecting the luminance of reflected light; and

detecting the chromaticity of reflected light; and

wherein the detecting of the coordinates is based on the luminance of reflected light and the chromaticity of reflected light.

11. The non-transitory computer-readable storage medium according to claim 9 , wherein the object includes an operator's finger.

12. The non-transitory computer-readable storage medium according to claim 9 , wherein the object includes a touch pen.

13. A coordinate detection system, comprising:

a camera configured to capture images of a face opposite to a display face of a transmissive display panel including a plurality of luminous parts and to thereby produce video information; and

a video processor configured to detect coordinates instructed on the display face of the transmissive display panel based on a chromaticity of reflected light, which occurs when reflecting light emitted from each luminous part of the transmissive display panel, according to the video information,

wherein, when the video processor detects the coordinates, a difference of a luminance of the reflected light between a frame, in a first state that an object is before being touched with a display screen, and a frame in a second state that the object is in touch with the display screen so that the display light from the display screen is reflected by the object resulting in a certain amount of the reflection light, is calculated according to the video information and the existence/nonexistence of an instruction is determined by determining whether or not the difference exceeds a threshold.

14. The coordinate detection system according to claim 13 , wherein the video processor is further configured to:

detect the luminance of reflected light; and

detect the chromaticity of reflected light, and

wherein the video processor detects the coordinates based on the luminance of reflected light and the chromaticity of reflected light.

15. The coordinate detection system according to claim 13 , wherein the object includes an operator's finger.

16. The coordinate detection system according to claim 13 , wherein the object includes a touch pen.

Assignments (3)
MERGER Recorded Jun 26, 2026
From: SHARP NEC DISPLAY SOLUTIONS, LTD.
To: SHARP KABUSHIKI KAISHA
Reel/Frame 075830/0097 →
CHANGE OF NAME Recorded Oct 8, 2021
From: NEC DISPLAY SOLUTIONS, LTD.
To: SHARP NEC DISPLAY SOLUTIONS, LTD.
Reel/Frame 057758/0968 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2018
From: TERAO, MASAYUKI
To: NEC DISPLAY SOLUTIONS, LTD.
Reel/Frame 047011/0208 →
Continuity (1)
Related Publication 20200319730A1 · Oct 8, 2020