IP Library Granted Patent US 12,663,764
Granted Patent B2
US 12,663,764 · App. 17/109,870 · Granted Jun 23, 2026

Inference apparatus, training apparatus, and inference method

Inventors: Kento Kawaharazuka (Tokyo-to, JP); Toru Ogawa (Tokyo-to, JP)
Assignee: Preferred Networks, Inc.
G05B13/027G06N3/044G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,663,764
App. No.
17/109,870
Filed
Dec 2, 2020
Granted
Jun 23, 2026
Kind
B2
Art Unit
2144
USPC
706/23
Abstract

An inference apparatus includes one or more memories; and one or more processors. The one or more processors configured to acquire a latent state from input data regarding a control target; acquire a future latent state from the latent state and control data; infer, from the future latent state, a time series of a task to be executed by the control target to be controlled based on the control data; calculate a loss between the time series of the task and data indicating a target state; and update the control data based on the loss.

Claims (46)

1 . An inference method, comprising:

acquiring data on a state of a control target;

inferring, based on at least (i) the data on the state of the control target and (ii) control data for controlling the control target, a time series of a task to be executed by the control target to be controlled based on the control data;

calculating at least a loss between the time series of the task and data indicating a target state; and

updating at least a part of the control data based on at least the loss, the updated control data being utilized to control the control target, wherein

the control target is an industrial plant to produce a predetermined chemical compound,

the data on the state of the control target is observable data in the industrial plant,

the control data is related to a valve opening to control the industrial plant,

the time series of the task is related to an actual yield of the predetermined chemical compound produced in the industrial plant, and

the data indicating the target state is related to a production amount of the predetermined chemical compound.

2 . An inference apparatus, comprising:

one or more memories; and

one or more processors configured to:

acquire data on a state of a control target;

infer, based on at least (i) the data on the state of the control target and (ii) control data for controlling the control target, a time series of a task to be executed by the control target to be controlled based on the control data;

calculate at least a loss between the time series of the task and data indicating a target state; and

update at least a part of the control data based on at least the loss, the updated control data being utilized to control the control target, wherein

the control target is an industrial plant to produce a predetermined chemical compound,

the data on the state of the control target is observable data in the industrial plant,

the control data is related to a valve opening to control the industrial plant,

the time series of the task is related to an actual yield of the predetermined chemical compound produced in the industrial plant, and

the data indicating the target state is related to a production amount of the predetermined chemical compound.

3 . An inference apparatus, comprising:

one or more memories; and

one or more processors configured to:

acquire data on a state of a control target;

infer, based on at least (i) the data on the state of the control target and (ii) control data for controlling the control target, a time series of a task to be executed by the control target to be controlled based on the control data;

calculate at least a loss between the time series of the task and data indicating a target state; and

update at least a part of the control data based on at least the loss, the updated control data being utilized to control the control target, wherein

the control target is an industrial plant having one or more valves adjusting at least one of a temperature, a flow, a pressure, a level, or a density to produce a predetermined chemical compound,

the data on the state of the control target is observed data of the industrial plant,

the control data includes data on a valve opening of a valve in the industrial plant,

the time series of the task is related to an actual yield of the predetermined chemical compound produced in the industrial plant, and

the data indicating the target state is related to a production amount of the predetermined chemical compound.

4 . A non-transitory computer readable medium storing a program for executing a method, the method comprising:

acquiring observable data on a state of an industrial plant producing a predetermined chemical compound;

inferring, based on at least (i) the observable data on the state of the industrial plant and (ii) control data related to a valve opening for controlling the industrial plant, data related to an amount of the predetermined chemical compound produced if the industrial plant is controlled based on the control data;

calculating at least a loss between the inferred data related to the amount of the predetermined chemical compound and target data related to an amount of the predetermined chemical compound; and

updating at least a part of the control data based on at least the loss, the updated control data being utilized to control the industrial plant.

5 . A system comprising:

one or more memories; and

one or more processors configured to:

acquire observable data on a state of an industrial plant producing a predetermined chemical compound;

infer, based on at least (i) the observable data on the state of the industrial plant and (ii) control data related to a valve opening for controlling the industrial plant, data related to an amount of the predetermined chemical compound produced if the industrial plant is controlled based on the control data;

calculate at least a loss between the inferred data related to the amount of the predetermined chemical compound and target data related to an amount of the predetermined chemical compound; and

update at least a part of the control data based on at least the loss, the updated control data being utilized to control the industrial plant.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2021
From: KAWAHARAZUKA, KENTO; OGAWA, TORU
To: PREFERRED NETWORKS, INC.
Reel/Frame 055169/0244 →
Priority Claims (1)
JP 2019-219013 · Dec 3, 2019 · national
Continuity (1)
Related Publication 20210165374A1 · Jun 3, 2021
References Cited (33)
US 11254002B1 · Ebrahimi Afrouzi · 2022 [cited by examiner]
US 20070239641A1 · Ito · 2007 [cited by examiner]
US 20170154413A1 · Yu · 2017 [cited by examiner]
US 20180218262A1 · Okada · 2018 [cited by examiner]
US 20190005374A1 · Shankar · 2019 [cited by examiner]
US 20190018398A1 · Nakagawa · 2019 [cited by examiner]
US 20190361409A1 · Bettinger · 2019 [cited by examiner]
US 20200201313A1 · Kludt · 2020 [cited by examiner]
US 20200379442A1 · Chan · 2020 [cited by examiner]
US 20210109687A1 · Harai · 2021 [cited by examiner]
US 20210302926A1 · Kawaharazuka et al. · 2021 [cited by applicant]
US 20210387343A1 · Imajo et al. · 2021 [cited by applicant]
US 20220274255A1 · Okawa · 2022 [cited by examiner]
JP 2020095471A · 2020 [cited by applicant]
JP 2020140641A · 2020 [cited by applicant]
Chiang, Leo, Bo Lu, and Ivan Castillo. “Big data analytics in chemical engineering.” Annual review of chemical and biomolecular engineering 8.1 (2017): 63-85 (Year: 2017). [cited by examiner]
Chang Tai Kiang, et.al., “Review of Control and Sensor System of Flexible Manipulator,” Journal of Intelligent & Robotic Systems, vol. 77, No. 1, pp. 187-213, 2015. [cited by applicant]
Wayne J. Book, “Recursive Lagrangian Dynamics of Flexible Manipulator Arms,” The International Journal of Robotics Research, vol. 3, No. 3, pp. 87-101, 1984. [cited by applicant]
Paul T Kotnik, et.al., “Acceleration feedback for control of a flexible manipulator arm,” Journal of Robotic Systems, pp. 322-323, 1988. [cited by applicant]
V. G. Moudgal, et.al., “Fuzzy learning control for a flexible-link robot,” IEEE Transactions on Fuzzy Systems, vol. 3, No. 2, pp. 199-210, 1995. [cited by applicant]
S. K. Pradhan, et.al., “Real-Time Adaptive Control of a Flexible Manipulator Using Reinforcement Learning,” IEEE Transactions on Automation Science and Engineering, vol. 9, No. 2, pp. 237-249, 2012. [cited by applicant]
Zhihong Su, et.al., “A neural-network-based controller for a single-link flexible manipulator using the inverse dynamics approach,” IEEE Transactions on Industrial Electronics, vol. 48, No. 6, pp. 1074-1086, 2001. [cited by applicant]
C. Sun, et.al., “Neural Network Control of a Flexible Robotic Manipulator Using the Lumped Spring-Mass Model,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 47, No. 8, pp. 1863-1874, 2017. [cited by applicant]
M. Inaba, et.al., “Rope handling by a robot with visual feedback,” Advanced Robotics, vol. 2, No. 1, pp. 39-54, 1987. [cited by applicant]
Y. Yamakawa, et.al., “Motion planning for dynamic folding of a cloth with two high-speed robot hands and two high-speed sliders,” ICRA2011, pp. 5486-5491, 2011. [cited by applicant]
Y. Yamakawa, et.al., “Motion planning for dynamic knotting of a flexible rope with a high-speed robot arm,” IROS2010, pp. 49-54, 2010. [cited by applicant]
D. Tanaka, et.al., “EMD Net: An Encode-Manipulate-Decode Network for Cloth Manipulation,” RAL, vol. 3, No. 3, pp. 1771-1778, 2018. [cited by applicant]
Kento Kawaharazuka, et.al., “Dynamic Manipulation of Flexible Objects with Torque Sequence Using a Deep Neural Network,” ICRA2019, 2019. [cited by applicant]
P. Yang, et.al., “Repeatable Folding Task by Humanoid Robot Worker Using Deep Learning,” RAL, vol. 2, No. 2, pp. 397-403, 2017. [cited by applicant]
A. X. Lee, et.al., “Learning force-based manipulation of deformable objects from multiple demonstrations,” ICRA2015, pp. 177-184, 2015. [cited by applicant]
Yuheng Wu, et.al., “Dynamic Motion Generation by Flexible-Joint Robot based on Deep Learning using Images,” EPIROB2018, 2018. [cited by applicant]
K. Kawaharazuka, et.al., “Dynamic Manipulation of Flexible Objects with Torque Sequence Using a Deep Neural Network,” arXiv:1901.10142 (2019), https://arxiv.org/abs/1901.10142. [cited by applicant]
Kento Kawaharazuka et.al., “Dynamic Task Control Method of a Flexible Manipulator Using a Deep Recurrent Neural Network”, IROS 2019 Conference, Nov. 7, 2019. [cited by applicant]