IP Library › Granted Patent US 12,145,273
Granted Patent B2
US 12,145,273 · App. 17/100,196 · Granted Nov 19, 2024

Information processing apparatus and method, robot controlling apparatus and method, and non-transitory computer-readable storage medium

Inventor: Yuichiro Hirota (Tokyo, JP)
Assignee: Canon Kabushiki Kaisha
B25J9/163B25J9/161B25J9/1697G05B19/4155G06F18/214G06F18/217G06F18/285G06N3/08G06V10/774G06V10/7784G06V20/10G06V20/64B25J13/08G05B2219/40499
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,145,273
App. No.
17/100,196
Filed
Nov 20, 2020
Granted
Nov 19, 2024
Kind
B2
Examiner
KC, SAGAR
Art Unit
3657
USPC
700/246
Abstract

The invention provides an information processing apparatus comprising a first acquiring unit which acquires, from an external apparatus which can communicate with the information processing apparatus via a network, a first learning model which outputs recognition information in response to input of image information; a learning unit which causes the first model to learn a result of control by the information processing apparatus using recognition information that is output from a second learning model in response to input of the image information in an execution environment; and an output unit which causes the first learning model learned by the learning unit to output recognition information by inputting image information in the execution environment to the first learning model.

Claims (25)

1. An information processing apparatus comprising:

a first acquiring unit configured to acquire, from an external apparatus which can communicate with the information processing apparatus via a network, a first learning model which outputs recognition information in response to input of image information;

a learning unit configured to cause the first learning model to learn a result of control by the information processing apparatus using recognition information that is output from a second learning model in response to input of the image information in an execution environment;

an evaluation unit configured to evaluate the first learning model based on image information in the execution environment and recognition information that is output as ground truth in response to input of the image information to a learning model;

a replacing unit configured to replace the second learning model with the first learning model that has been learned by the learning unit, in a case where the result of evaluation by the evaluation unit meets the a requirement; and

an output unit configured to cause the first learning model learned by the learning unit to output recognition information by inputting image information in the execution environment to the first learning model.

2. The information processing apparatus according to claim 1 , wherein the learning unit updates a coupled weighting coefficient for the first learning model based on the evaluation result of the first learning model obtained by the evaluation unit and recognition information as ground truth associated with the image information.

3. The information processing apparatus according to claim 1 , wherein the recognition information as ground truth associated with the image information is learning data obtained by performing a task based on the second learning model, which receives image information as an input and outputs recognition information, and

the learning unit updates the first learning model based on the learning data in a case where performance of the first learning model evaluated by the evaluation unit does not meet a predetermined performance level.

4. The information processing apparatus according to claim 1 , wherein the replacing unit replaces the second learning model with the first learning model in a case where performance of the first learning model evaluated by the evaluation unit meets performance that is set as performance required to perform a task.

5. The information processing apparatus according to claim 1 , wherein the replacing unit replaces the second learning model with the first learning model in a case where performance of the first learning model evaluated by the evaluation unit meets performance of the second learning model.

6. The information processing apparatus according to claim 1 , wherein each of the first learning model and the second learning model has a different neural network structure to each other.

7. The information processing apparatus according to claim 1 , wherein the recognition information that is output as ground truth in response to input of image information in the execution environment to a learning model is obtained by adding, to image information in the execution environment, a result of controlling the information processing apparatus based on recognition information output from the second model in response to image information in the execution environment.

8. An information processing method that is performed by an information processing apparatus, the method comprising:

(a) acquiring, from an external apparatus which can communicate with the information processing apparatus via a network, a first learning model which outputs recognition information in response to input of image information;

(b) causing the first model to learn a result of control by the information processing apparatus using recognition information that is output from a second learning model in response to input of the image information in an execution environment;

(c) evaluating the first learning model based on image information in the execution environment and recognition information that is output as ground truth in response to input of the image information to a learning model;

(d) replacing the second learning model with the first learning model that has been learned by the learning unit, in a case where the result of evaluation by an evaluation unit meets a requirement; and

e) causing the first learning model learned in the learning (b) to output recognition information by inputting image information in the execution environment to the first learning model.

9. A non-transitory computer-readable storage medium storing a program which, when read and executed by a computer, cause the computer to executes the step of an information processing method, the method comprising:

(a) acquiring, from an external apparatus which can communicate with the information processing apparatus via a network, a first learning model which outputs recognition information in response to input of image information;

(b) causing the first model to learn a result of control by the information processing apparatus using recognition information that is output from a second learning model in response to input of the image information in an execution environment; and

(c) evaluating the first learning model based on image information in the execution environment and recognition information that is output as ground truth in response to input of the image information to a learning model;

(d) replacing the second learning model with the first learning model that has been learned by the learning unit, in a case where the result of evaluation by an evaluation unit meets a requirement; and

(e) causing the first learning model learned in the learning (b) to output recognition information by inputting image information in the execution environment to the first learning model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 5, 2021
From: HIROTA, YUICHIRO
To: CANON KABUSHIKI KAISHA
Reel/Frame 057722/0785 →
Priority Claims (1)
JP 2018-101357 · May 28, 2018 · national
Continuity (2)
Continuation PCTJP2019019318 · May 15, 2019
Related Publication 20210072734A1 · Mar 11, 2021