IP Library › Granted Patent US 11,069,086
Granted Patent B2
US 11,069,086 · App. 16/668,708 · Granted Jul 20, 2021

Non-transitory computer-readable storage medium for storing position detection program, position detection method, and position detection apparatus

Inventors: Yasuto Yokota (Kawasaki, JP); Kanata Suzuki (Kawasaki, JP)
Assignee: FUJITSU LIMITED
G06T7/75B25J9/163B25J9/1697G06N3/0454G06N3/08G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,069,086
App. No.
16/668,708
Granted
Jul 20, 2021
Kind
B2
Abstract

A non-transitory computer-readable storage medium storing a position detection program which causes a processor to perform processing for object recognition, the processing includes: acquiring a plurality of pieces of three-dimensional data of simple shapes that are not similar to each other; carrying out learning by using the plurality of acquired pieces of data; acquiring an image obtained by imaging by an imaging unit; and detecting a position of an object from the acquired image by using a first learning model generated based on the learning.

Claims (29)

1. A non-transitory computer-readable storage medium storing a position detection program which causes a processor to perform processing for object recognition, the processing comprising:

acquiring, as training data, a plurality of pieces of three-dimensional shape data of simple shapes that are not similar to each other, each of the plurality of pieces of three-dimensional shape data being three-dimensional shape data representing a simple shape obtained from a three-dimensional model, the simple shape being a shape simplified more than a shape of a target object;

carrying out learning by using, as an input to a neural network, the simple shape represented by each of the plurality of acquired pieces of three-dimensional shape data;

acquiring an image obtained by imaging by an imaging device; and

detecting a position of the target object from the acquired image by using a first learning model generated based on the learning.

2. The position detection program according to claim 1 , the processing further comprising:

detecting a gripping position of the object from the position.

3. The position detection program according to claim 1 , wherein

the first learning model is an ensemble learning model based on a plurality of second learning models generated through carrying out learning by using each of the plurality of pieces of data.

4. The position detection program according to claim 3 , wherein

the second learning model is a convolutional neutral network using deep learning and creates, from the image, a plurality of bounding boxes that represent a detected position of an object as position candidates in such a manner as to associate the bounding boxes with reliability that represents likelihood of a detected object, and

the ensemble learning model acquires a second number of position candidates from each of a first number of second learning models and, when an overlapping region exists in bounding boxes of position candidates in a number obtained by multiplying the first number by the second number, the ensemble learning model groups position candidates having the overlapping region and employs sum of reliabilities of the grouped position candidates as reliability of the group to output a bounding box of the group or position candidate with highest reliability as information on the position of the object.

5. The position detection program according to claim 1 , wherein

the pieces of data are pieces of data created from three-dimensional models of the simple shapes by a simulator.

6. The position detection program according to claim 1 , wherein

the simple shapes include a circular column, a rectangular parallelepiped, a cube, a sphere, and a spring.

7. A position detection method comprising:

by a computer,

acquiring, as training data, a plurality of pieces of three-dimensional shape data of simple shapes that are not similar to each other, each of the plurality of pieces of three-dimensional shape data being three-dimensional shape data representing a simple shape obtained from a three-dimensional model, the simple shape being a shape simplified more than a shape of a target object;

carrying out learning by using, as an input to a neural network, the simple shape represented by each of the plurality of acquired pieces of three-dimensional shape data;

acquiring an image obtained by imaging by an imaging device; and

detecting a position of the target object from the acquired image by using a first learning model generated based on the learning.

8. A position detection apparatus comprising:

memory; and

processor circuitry coupled to the memory, the processor circuitry being configured to:

acquire, as training data, a plurality of pieces of three-dimensional shape data of simple shapes that are not similar to each other, each of the plurality of pieces of three-dimensional shape data being three-dimensional shape data representing a simple shape obtained from a three-dimensional model, the simple shape being a shape simplified more than a shape of a target object;

carry out learning by using, as an input to a neural network, the simple shape represented by each of the plurality of acquired pieces of three-dimensional shape data;

acquire an image obtained by imaging by an imaging device; and

detect a position of the target object from the acquired image by using a first learning model generated based on the learning.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 30, 2019
From: YOKOTA, YASUTO; SUZUKI, KANATA
To: FUJITSU LIMITED
Reel/Frame 050895/0372 →
Priority Claims (1)
JP JP2018-210460 · Nov 8, 2018 · national
Continuity (1)
Related Publication 20200151906A1 · May 14, 2020
Cited By (1)
US 12,466,078