IP Library Granted Patent US 12691580
Granted Patent B2
US 12691580 · App. 18/824,493 · Granted Jul 28, 2026

Control system, control method, and non-transitory computer-readable medium

Inventors: Takashi Yamamoto (Toyota Aichi-ken, JP); Yuka Iwanaga (Toyokawa Aichi-ken, JP); Masayoshi Tsuchinaga (Nisshin Aichi-ken, JP); Takemitsu Mori (Nisshin Aichi-ken, JP); Kosei Tanada (Toyota Aichi-ken, JP); Masahiro Takahashi (Nagakute Aichi-ken, JP)
Assignees: TOYOTA JIDOSHA KABUSHIKI KAISHA; NAGOYA DENKI EDUCATIONAL FOUNDATION
B25J9/1666B25J9/1612B25J9/163B25J11/0015
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12691580
App. No.
18/824,493
Granted
Jul 28, 2026
Kind
B2
Abstract

A control system, a control method, and a program that interact with a user with regard to correction of handwritten input information are provided. A control system determines an operation to be performed by a robot based on handwritten input information input to an interface and controls the operation performed by the robot. The control system includes: a handwritten input information reception unit that receives an input of the handwritten input information; a determination unit that determines whether or not the handwritten input information needs to be corrected based on feasibility or efficiency of the operation to be performed based on the handwritten input information; and a presentation unit that presents information about the correction of the handwritten input information to a user when the handwritten input information needs to be corrected.

Claims (22)

1 . A control system configured to determine an operation to be performed by a robot based on handwritten input information input to an interface and control the operation performed by the robot, the control system comprising a central processing unit configured to:

receive an input of the handwritten input information;

determine whether or not the handwritten input information needs to be corrected based on feasibility or efficiency of the operation to be performed based on the handwritten input information; and

present information about the correction of the handwritten input information to a user when the handwritten input information needs to be corrected,

wherein when the central processing unit displays the input handwritten input information, the central processing unit sets a thickness of a line included in the handwritten input information based on a size of the robot, wherein the thickness of the line at a position farther from the current position of the robot is thinner than the thickness of the line at a position closer to the current position of the robot.

2 . The control system according to claim 1 , wherein the handwritten input information includes trajectory information of the input performed using a finger, a stylus pen, a pointing device, an Augmented Reality (AR) device, a Virtual Reality (VR) device, or a Mixed Reality (MR) device.

3 . The control system according to claim 1 , wherein when the handwritten input information needs to be corrected, the central processing unit corrects the handwritten input information and presents the corrected handwritten input information to the user.

4 . The control system according to claim 1 , wherein when the handwritten input information needs to be corrected, the central processing unit presents information about a part of the robot that interferes with an obstacle to the user, the robot operating based on the handwritten input information.

5 . The control system according to claim 1 , wherein

when a part or all of the handwritten input information is included in a predetermined area of an input screen, the central processing unit determines that the handwritten input information needs to be corrected, and

when the central processing unit displays the input screen, the central processing unit displays the predetermined area and an area other than the predetermined area so that they are distinguishable from each other.

6 . The control system according to claim 1 , wherein the central processing unit corrects a position of the handwritten input information using segmentation information based on a machine learning.

7 . A control method for determining an operation to be performed by a robot based on handwritten input information input to an interface and controlling the operation performed by the robot, the control method comprising:

receiving an input of the handwritten input information;

determining whether or not the handwritten input information needs to be corrected based on feasibility or efficiency of the operation to be performed based on the handwritten input information; and

presenting information about the correction of the handwritten input information to a user when the handwritten input information needs to be corrected,

wherein displaying the input handwritten input information, setting a thickness of a line included in the handwritten input information based on a size of the robot, wherein the thickness of the line at a position farther from the current position of the robot is thinner than the thickness of the line at a position closer to the current position of the robot.

8 . A non-transitory computer readable medium storing a program for causing a computer to perform a control method for determining an operation to be performed by a robot based on handwritten input information input to an interface and controlling the operation performed by the robot, the control method comprising:

receiving an input of the handwritten input information;

determining whether or not the handwritten input information needs to be corrected based on feasibility or efficiency of the operation to be performed based on the handwritten input information; and

presenting information about the correction of the handwritten input information to a user when the handwritten input information needs to be corrected,

wherein displaying the input handwritten input information, setting a thickness of a line included in the handwritten input information based on a size of the robot, wherein the thickness of the line at a position farther from the current position of the robot is thinner than the thickness of the line at a position closer to the current position of the robot.