IP Library Granted Patent US 12673430
Granted Patent B2
US 12673430 · App. 18/509,852 · Granted Jul 7, 2026

Control device, control method, and non-transitory recording medium

Inventors: Eiji Ichihara (Tokyo, JP); Kosei Kobayashi (Tokyo, JP); Satsuki Hamaguchi (Tokyo, JP); Taiga Iyoku (Tokyo, JP); Arisa Morozumi (Tokyo, JP); Ryosuke Shirai (Tokyo, JP); Yoji Ohnishi (Tokyo, JP); Hiroaki Aminaka (Tokyo, JP)
Assignee: NEC CORPORATION
B25J11/008B25J11/0005B25J19/023G06V10/70G06V40/172G06V40/174
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12673430
App. No.
18/509,852
Granted
Jul 7, 2026
Kind
B2
Abstract

A control device according to one aspect of the present disclosure identifies a first person, acquires information on a second person related to the first person, and reads out an action information using the information on the second person, the action information representing an action of the second person for the first person.

Claims (77)

1 . A control device comprising:

one or more memories storing instructions; and

one or more processors configured to execute the instructions to:

identify a first person, the identifying including receiving at least one of an image from an imaging device or physical-feature data from a sensor;

acquire information on a second person related to the first person;

read out an action information using the information on the second person, the action information representing an action of the second person for the first person;

generate, based on the action information, a control instruction including at least one of a grip position, an applied force, a movement speed, a timing of utterance, or an angle;

transmit the control instruction to a robot to cause the robot to perform the action for the first person, the transmitting being triggered by a distance between the robot and the first person detected by a sensor being equal to or smaller than a predetermined threshold;

adjust, during execution of the action by the robot, the control instruction using the distance between the robot and the first person acquired from the sensor;

specify a person in charge of the first person as the second person;

determine, as the second person, a person of which an evaluation by the first person is equal to or greater than a predetermined threshold value; and

receive, from the first person, an input of the evaluation.

2 . The control device according to claim 1 , wherein

the action information includes a feature of the action taken by the second person with respect to the first person.

3 . The control device according to claim 2 , wherein the one or more processors are configured to execute the instructions to: estimate a person in charge of the first person, using at least one of a distance between persons, a time when the distance is equal to or smaller than a predetermined threshold value, conversation information between persons, an action relationship between persons, or attribute information of persons; and specify the estimated person in charge as the second person.

4 . The control device according to claim 3 , wherein the one or more processors are further configured to execute the instructions to: estimate an emotion of the first person; and calculate the evaluation using information about the estimated emotion.

5 . The control device according to claim 2 , wherein the information on the second person is acquired using a model generated by machine learning, and the action information includes information about an optimized service for the first person.

6 . The control device according to claim 1 , wherein

the one or more processors are further configured to execute the instructions to:

estimate a state of the first person; and

read out the action information using the information on the second person and information on the estimated state of the first person.

7 . The control device according to claim 1 , wherein

the first person is a user of a service, and

the second person is a provider of the service.

8 . The control device according to claim 7 , wherein

the one or more processors are configured to execute the instructions to read out the action information from an action model of the second person generated using information in which data indicating a state of the first person is associated with data regarding the action of the second person performed in the state of the first person.

9 . The control device according to claim 8 , wherein

the service is a physical care service,

the user of the service is a physical care receiver, and

the provider of the service is a physical care giver in charge of the physical care receiver.

10 . The control device according to claim 8 , wherein

the service is a customer service,

the user of the service is a customer, and

the provider of the service is a store clerk in charge of servicing the customer.

11 . The control device of claim 1 ,

wherein the one or more processors are configured to:

support decision-making by the first person by presenting a confirmation regarding the service and receiving, from the first person, an input indicating approval or disapproval; and

control the robot based on the decision.

12 . A control method performed by a computer, the control method comprising:

identifying a first person, the identifying including receiving at least one of an image from an imaging device or physical-feature data from a sensor;

acquiring information on a second person related to the first person;

reading out an action information using the information on the second person, the action information representing an action of the second person for the first person;

generating, based on the action information, a control instruction including at least one of a grip position, an applied force, a movement speed, a timing of utterance, or an angle;

transmitting the control instruction to a robot to cause the robot to perform the action for the first person, the transmitting being triggered by a distance between the robot and the first person detected by a sensor being equal to or smaller than a predetermined threshold;

adjusting, during execution of the action by the robot, the control instruction using the distance between the robot and the first person acquired from the sensor;

specifying a person in charge of the first person as the second person;

determining, as the second person, a person of which an evaluation by the first person is equal to or greater than a predetermined threshold value; and

receiving, from the first person, an input of the evaluation.

13 . The control method according to claim 12 , further comprising:

estimating a state of the first person; and

reading out the action information using the information on the second person and information on the estimated state of the first person.

14 . The control method according to claim 12 , wherein

the first person is a user of a service, and

the second person is a provider of the service.

15 . The control method according to claim 14 , wherein

the service is a physical care service,

the user of the service is a physical care receiver, and

the provider of the service is a physical care giver in charge of the physical care receiver.

16 . The control method according to claim 12 , further comprising:

supporting decision-making by the first person by presenting a confirmation regarding the service and receiving, from the first person, an input indicating approval or disapproval; and

controlling the robot based on the decision.

17 . A non-transitory recording medium recording a program for causing a computer to execute:

identifying a first person, the identifying including receiving at least one of an image from an imaging device or physical-feature data from a sensor;

acquiring information on a second person related to the first person;

reading out an action information using the information on the second person, the action information representing an action of the second person for the first person;

generating, based on the action information, a control instruction including at least one of a grip position, an applied force, a movement speed, a timing of utterance, or an angle;

transmitting the control instruction to a robot to cause the robot to perform the action for the first person, the transmitting being triggered by a distance between the robot and the first person detected by a sensor being equal to or smaller than a predetermined threshold;

adjusting, during execution of the action by the robot, the control instruction using the distance between the robot and the first person acquired from the sensor;

specifying a person in charge of the first person as the second person;

determining, as the second person, a person of which an evaluation by the first person is equal to or greater than a predetermined threshold value; and

receiving, from the first person, an input of the evaluation.

18 . The non-transitory recording medium according to claim 17 , wherein the program further causes the computer to execute:

estimating a state of the first person; and

reading out the action information using the information on the second person and information on the estimated state of the first person.

19 . The non-transitory recording medium according to claim 17 , wherein the program further causes the computer to execute:

supporting decision-making by the first person by presenting a confirmation regarding the service and receiving, from the first person, an input indicating approval or disapproval; and

controlling the robot based on the decision.