IP Library Granted Patent US 12,491,633
Granted Patent B2
US 12,491,633 · App. 18/028,911 · Granted Dec 9, 2025

Trajectory generation device, trajectory generation method, and recording medium storing trajectory generation program

Inventors: Masashi Hamaya (Tokyo, JP); Takamitsu Matsubara (Ikoma, JP)
Assignees: OMRON CORPORATION; NATIONAL UNIVERSITY CORPORATION NARA INSTITUTE OF SCIENCE AND TECHNOLOGY
B25J9/1664B25J9/161B25J9/163G05B2219/40116G05B2219/40499
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,491,633
App. No.
18/028,911
Granted
Dec 9, 2025
Kind
B2
Abstract

A trajectory generation device includes an acquisition unit, a clustering unit and a generation unit. The acquisition unit acquires successful trajectory information and failed trajectory information that are trajectory information representing sequences of states of a controlled object being taught by a teacher. The successful trajectory information is trajectory information when a task performed by the controlled object is successful, and the failed trajectory information is trajectory information when the task is failed. From the states of the controlled object belonging to the successful trajectory information and the states belonging to the failed trajectory information, the clustering unit generates clusters of successful classes of the states. On the basis of the clusters of successful classes, the generation unit generates target trajectory information representing a sequence of states of the controlled object, the sequence of states being usable as control targets when the controlled object is caused to execute the task.

Claims (54)

1 . A trajectory generation device, comprising:

a processor configured to:

acquire trajectory information representing sequences of states of a controlled object being taught by a teacher, the trajectory information including successful trajectory information and failed trajectory information, the successful trajectory information being trajectory information when a task performed by the controlled object is successful, and the failed trajectory information being trajectory information when the task is failed;

from the states of the controlled object belonging to the successful trajectory information and the states of the controlled object belonging to the failed trajectory information, generate a cluster of a successful class of the states of the controlled object;

on the basis of the cluster of the successful class, generate target trajectory information representing a sequence of states of the controlled object, the sequence of states being used as control targets when the controlled object is caused to execute the task; and

render a display for providing guidance on a trajectory that is to be taught,

wherein the states of the controlled object are positions of the controlled object or positions and attitudes of the controlled object, the processor is configured to calculate a speed of the controlled object in each state, from the positions or the positions and attitudes included in the states of the controlled object belonging to the successful trajectory information and the failed trajectory information and the processor is configured to calculate degrees of similarity among the states of the controlled object belonging to the successful trajectory information and the failed trajectory information based on the positions or the positions and attitudes in the states and speeds in the states,

wherein the processor is configured specify an adjustment parameter to adjust the degrees of similarity so as to:

increase a degree of similarity between states of the controlled object that respectively belong to the successful trajectory information, and

reduce a degree of similarity between a state of the controlled object that belongs to the successful trajectory information and a state of the controlled object that belongs to the failed trajectory information.

2 . The trajectory generation device according to claim 1 , wherein the processor is configured to:

apply a clustering method that uses a Gaussian mixture model,

and

generate the cluster of the successful class on the basis of the calculated degrees of similarity.

3 . The trajectory generation device according to claim 2 , wherein the processor is configured to adjust the degrees of similarity among the states of the controlled object with the adjustment parameter.

4 . The trajectory generation device according to claim 2 , wherein the processor is configured to apply a Gaussian mixture regression method to the cluster of the successful class for generating the target trajectory information.

5 . A trajectory generation method, comprising a computer executing processing including:

acquiring trajectory information representing sequences of states of a controlled object being taught by a teacher, the trajectory information including successful trajectory information and failed trajectory information, the successful trajectory information being trajectory information when a task performed by the controlled object is successful, and the failed trajectory information being trajectory information when the task is failed;

from the states of the controlled object belonging to the successful trajectory information and the states of the controlled object belonging to the failed trajectory information, generating a cluster of a successful class of the states of the controlled object;

on the basis of the cluster of the successful class, generating target trajectory information representing a sequence of states of the controlled object, the sequence of states being used as control targets when the controlled object is caused to execute the task; and

rendering a display for providing guidance on a trajectory that is to be taught,

wherein the states of the controlled object are positions of the controlled object or positions and attitudes of the controlled object,

wherein generating a cluster of a successful class of the states of the controlled object comprises: calculating a speed of the controlled object in each state from the positions or the positions and attitudes included in the states of the controlled object belonging to the successful trajectory information and the failed trajectory information; and

calculating degrees of similarity among the states of the controlled object belonging to the successful trajectory information and the failed trajectory information based on the positions or the positions and attitudes in the states and speeds in the states,

wherein generating a cluster of a successful class of the states of the controlled object comprises:

specifying an adjustment parameter to adjust the degrees of similarity so as to:

increase a degree of similarity between states of the controlled object that respectively belong to the successful trajectory information, and

reduce a degree of similarity between a state of the controlled object that belongs to the successful trajectory information and a state of the controlled object that belongs to the failed trajectory information.

6 . The trajectory generation method according to claim 5 , wherein generating a cluster of a successful class of the states of the controlled object comprises:

applying a clustering method that uses a Gaussian mixture model; and

generating the cluster of the successful class on the basis of the calculated degrees of similarity.

7 . The trajectory generation method according to claim 5 , wherein generating target trajectory information comprises:

applying a Gaussian mixture regression method to the cluster of the successful class for generating the target trajectory information.

8 . The trajectory generation method according to claim 5 , wherein generating a cluster of a successful class of the states of the controlled object comprises:

adjusting the degrees of similarity among the states of the controlled object with the adjustment parameter.

9 . A non-transitory recording medium storing a trajectory generation program that is executable by a computer to perform processing, the processing comprising:

acquiring successful trajectory information relating to a successful trajectory when an operation by a controlled object is successful and failed trajectory information relating to a failed trajectory when an operation by the controlled object fails;

on the basis of the successful trajectory information and the failed trajectory information, clustering positions of the controlled object on the successful trajectory and positions of the controlled object on the failed trajectory into a successful class and a failed class by a clustering method specified in advance;

on the basis of the positions of the controlled object clustered in the successful class, generating target trajectory information relating to a target trajectory of the controlled object; and

rendering a display for providing guidance on a trajectory that is to be taught,

wherein clustering positions of the controlled object on the successful trajectory and positions of the controlled object on the failed trajectory into a successful class and a failed class by a clustering method specified in advance comprises:

calculating a speed of the controlled object from the positions of the controlled object on the successful trajectory and positions of the controlled object on the failed trajectory; and

calculating degrees of similarity among positions of the controlled object on the successful trajectory and positions of the controlled object on the failed trajectory based on the positions and speeds in the positions,

wherein clustering positions of the controlled object on the successful trajectory and positions of the controlled object on the failed trajectory into a successful class and a failed class by a clustering method specified in advance comprises:

specifying an adjustment parameter to adjust the degrees of similarity so as to:

increase a degree of similarity between positions of the controlled object that respectively belong to the successful trajectory information, and

reduce a degree of similarity between a position of the controlled object that belongs to the successful trajectory information and a position of the controlled object that belongs to the failed trajectory information.

10 . The non-transitory recording medium according to claim 9 , wherein clustering positions of the controlled object on the successful trajectory and positions of the controlled object on the failed trajectory into a successful class and a failed class by a clustering method specified in advance comprises:

applying the clustering method that uses a Gaussian mixture model; and

generating the cluster of the successful class on the basis of the calculated degrees of similarity.

11 . The non-transitory recording medium according to claim 9 , wherein clustering positions of the controlled object on the successful trajectory and positions of the controlled object on the failed trajectory into a successful class and a failed class by a clustering method specified in advance comprises:

adjusting the degrees of similarity among the positions of the controlled object with the adjustment parameter that adjusts the degrees of similarity.

12 . The non-transitory recording medium according to claim 9 , wherein generating target trajectory information comprises:

applying a Gaussian mixture regression method to the cluster of the successful class for generating the target trajectory information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2023
From: HAMAYA, MASASHI; MATSUBARA, TAKAMITSU
To: OMRON CORPORATION; NATIONAL UNIVERSITY CORPORATION NARA INSTITUTE OF SCIENCE AND TECHNOLOGY
Reel/Frame 063160/0942 →
Priority Claims (1)
JP 2020-175009 · Oct 16, 2020 · national
Continuity (1)
Related Publication 20230339111A1 · Oct 26, 2023
References Cited (24)
US 20180164781A1 · Kubo et al. · 2018 [cited by applicant]
US 20190202053A1 · Tan · 2019 [cited by examiner]
US 20200139539A1 · Hasunuma et al. · 2020 [cited by applicant]
US 20200230815A1 · Nikovski et al. · 2020 [cited by applicant]
JP H11085240A · 1999 [cited by applicant]
JP 2018097616A · 2018 [cited by applicant]
JP 2018206286A · 2018 [cited by applicant]
JP 2019101799A · 2019 [cited by applicant]
Xie, X., et al., “Learning Virtual Grasp with Failed Demonstrations via Bayesian Inverse Reinforcement Learning”, Nov. 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1812-1817… [cited by examiner]
Zhang, H., et al., “Long Time Sequential Task Learning From Unstructured Demonstrations”, Jul. 23, 2019, IEEE Access, vol. 7, pp. 96240-96252 (Year: 2019). [cited by examiner]
Hamaya, M., et al., “Learning Soft Robotic Assembly Strategies from Successful and Failed Demonstrations”, Oct. 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 8309-8315 (Year:… [cited by examiner]
Choi, S., et al., “Robust Learning From Demonstrations With Mixed Qualities Using Leveraged Gaussian Processes”, Jun. 2019, IEEE Transactions On Robotics, vol. 35, No. 3, pp. 564-576 (Year: 2019). [cited by examiner]
Esteban, D., et al., “Learning Deep Robot Controllers by Exploiting Successful and Failed Executions”, Nov. 2018, 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids), pp. 1087-1094 (Year: 2018). [cited by examiner]
Cederborg, T., et al., “Incremental Local Online Gaussian Mixture Regression for Imitation Learning of Multiple Tasks”, Oct. 2010, The 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 267-27… [cited by examiner]
Nishimura et al., “Peg-in-hole under state uncertainties via a passive wrist joint with push-activate-rotation function,” 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids), 67-74 (2020). [cited by applicant]
Esteban et al., “Learning Deep Robot Controllers by Exploiting Successful and Failed Executions,” 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids), 1-9 (2018). [cited by applicant]
Shiarlis et al., “Inverse reinforcement learning from failure,” International Conference on Autonomous Agents & Multiagent Systems, 1060-1068 (2016). [cited by applicant]
Enayati et al., Variable-Impedance and Force Control for Robust Learning of Contact-rich Manipulation Tasks from User Demonstration, IFAC-PapersOnline, Apr. 14, 2021, vol. 53, Issue 2, 2020, pp. 9834-9840 [online], [Sci… [cited by applicant]
International Search Report issued in corresponding International Application No. PCT/JP2021/035669 dated Dec. 14, 2021. [cited by applicant]
Written Opinion issued in corresponding International Application No. PCT/JP2021/035669 dated Dec. 14, 2021. [cited by applicant]
Cao et al., “Robot Programming by Demonstration with Local Human Correction for Assembly”, Proceeding of the IEEE International Conference on Robotics and Biomimetics, 2019, pp. 166-171. [cited by applicant]
Grollman et al., “Donut as I do: Learning from failed demonstrations”, IEEE International Conference on Robotics and Automation, 2011, pp. 3804-3809. [cited by applicant]
Grollman et al., “Robot Learning from Failed Demonstrations”, International Journal of Social Robotics, vol. 4, 2012, pp. 331-342. [cited by applicant]
Extended European Search Report issued in corresponding European Patent Application No. 21879873.4, dated Nov. 26, 2024. [cited by applicant]