IP Library › Granted Patent US 12,026,417
Granted Patent B2
US 12,026,417 · App. 18/269,703 · Granted Jul 2, 2024

Information presentation system, terminal device, and recording medium

Inventors: Yoshiaki Kobayashi (Muko, JP); Yuta Nagata (Kyoto, JP); Yuya Watanabe (Muko, JP)
Assignee: OMRON CORPORATION
G06F3/14G06F3/013G09G3/32G09G5/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,026,417
App. No.
18/269,703
Granted
Jul 2, 2024
Kind
B2
Abstract

An information presentation system includes a controller that controls a device included in a production line, a terminal including a display and a camera that captures an image of the device, and a server that communicates with the controller and the terminal. The camera has an image capture range including a view field of the display. The controller transmits a light emission command to the device, the light emission command causing a light emitter included in the device to emit light in a predetermined light emission pattern. The terminal displays information regarding the device in association with a display position in a display area of the display, the display position corresponding to a position of a partial image representing the light emission pattern in a captured image of the camera.

Claims (21)

1. An information presentation system comprising: a controller configured to control a device included in a production line; a terminal including a display and a camera configured to capture an image of the device; and a server configured to communicate with the controller and the terminal, wherein the camera has an image capture range including a view field of the display, the controller includes a module configured to transmit a light emission command to the device, the light emission command causing a light emitting unit included in the device to emit light in a predetermined light emission pattern, and the terminal includes a module configured to display information regarding the device in association with a display position in a display area of the display, the display position corresponding to a position of a partial image representing the light emission pattern in a captured image of the camera; and wherein the controller further includes a module configured to cause a light emitting unit included in another device near the device to emit light in a pattern different from the light emission pattern.

2. The information presentation system according to claim 1 , wherein the information regarding the device includes information indicating a state of the device.

3. The information presentation system according to claim 1 , wherein the server transmits a notification for specifying the light emission pattern to the controller.

4. The information presentation system according to claim 1 , wherein the server includes:

an image processing module configured to process the captured image received from the terminal, and detect a position of the partial image representing the light emission pattern in the captured image; and

a module configured to transmit the position of the partial image detected by the image processing module to the terminal.

5. The information presentation system according to claim 1 , wherein

the server transmits a notification for specifying the light emission pattern to the terminal, and

the terminal further includes an image processing module configured to process the captured image of the camera, and detect a position of the partial image representing the light emission pattern in the captured image.

6. The information presentation system according to claim 1 , wherein the server determines the light emission pattern based on identification information of the device.

7. The information presentation system according to claim 1 , wherein the server determines the light emission pattern based on a state of the device.

8. The information presentation system according to claim 6 , wherein the controller determines a state of the device based on a state value output from the device, and transmits a notification of the determined state to the server.

9. The information presentation system according to claim 6 , wherein

the controller transmits a database operation command to the server, the database operation command being for storing information indicating a state of the device in a database included in the server, and

the server determines the state of the device based on the information stored in the database.

10. The information presentation system according to claim 1 , wherein the controller outputs the light emission command to a device designated based on a user operation.

11. The information presentation system according to claim 1 , wherein

the terminal further includes a gaze sensor configured to detect a gazing direction of a user operating the terminal, and

an image capturing direction of the camera coincides with the gazing direction.

12. A terminal device comprising: a module configured to communicate with a controller that controls a device included in a production line; a display; and a camera configured to capture an image of the device, wherein the camera has an image capture range including a view field of the display, the device includes a light source configured to emit light in a predetermined light emission pattern based on a light emission command from the controller, and the terminal device further includes a module configured to display information regarding the device in association with a display position in a display area of the display, the display position corresponding to a position of a partial image representing the light emission pattern in a captured image of the camera; and wherein the controller further includes a module configured to cause a light emitting unit included in another device near the device to emit light in a pattern different from the light emission pattern.

13. A non-transitory machine-readable recording medium having stored thereon a program which, when executed by a processor, causes the processor included in a terminal device to perform an information presentation method, wherein the terminal device includes: a module configured to communicate with a controller that controls a device included in a production line; a display; and a camera configured to capture an image of the device, the camera has an image capture range including a view field of the display, the device includes a light source configured to emit light in a predetermined light emission pattern based on a light emission command from the controller, and the information presentation method includes: acquiring a position that is a display position in a display area of the display and that is a position of a partial image representing the light emission pattern in a captured image of the camera; and controlling the display to display information regarding the device in association with the acquired display position in the display area of the display; and wherein the controller further includes a module configured to cause a light emitting unit included in another device near the device to emit light in a pattern different from the light emission pattern.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2023
From: KOBAYASHI, YOSHIAKI; NAGATA, YUTA; WATANABE, YUYA
To: OMRON CORPORATION
Reel/Frame 064061/0158 →
Priority Claims (1)
JP 2021-004730 · Jan 15, 2021 · national
Continuity (1)
Related Publication 20240061632A1 · Feb 22, 2024