IP Library Granted Patent US 10,922,541
Granted Patent B2
US 10,922,541 · App. 16/091,235 · Granted Feb 16, 2021

Object type identifying apparatus, object type identifying method, and recording medium

Inventor: Soma Shiraishi (Tokyo, JP)
Assignee: NEC CORPORATION
G06K9/00624G06K9/00362G06Q10/087G06Q30/0185G06T7/20G06T7/70G08B25/00G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,922,541
App. No.
16/091,235
Granted
Feb 16, 2021
Kind
B2
Abstract

Provided is an object type identifying apparatus that is capable of correctly identifying the types of objects held in a hand of a person. This object type identifying apparatus is provided with: a memory storing instructions; a storage device storing information indicating a type of an object at a position of each object; and one or more processors configured to execute the instructions to: acquire a position of an object; determine whether an object is picked up or an object is placed, based on sensor information; when determined that an object is picked up, identify a type of the picked-up object, based on the position of the object acquired and information stored in the storage device; and when determined that an object is placed, update information stored in the storage device, using an image captured by a camera that captures arrangement of each object from a front side.

Claims (49)

1. An object type identifying apparatus comprising:

a memory configured to store instructions; and

one or more processors configured to execute the instructions to:

store information indicating each object, among one or more objects displayed on one or more shelves, at a position on the one or more shelves of said each object;

determine whether an object is picked up or the object is placed on a different position, based on sensor information;

based on a determination that the object is picked up, identify the picked-up object, using an image captured by a camera; and

based on a determination that the object is placed on a different position on the one or more shelves using the sensor information, update the stored position to the different position.

2. The object type identifying apparatus according to claim 1 , wherein

the one or more processors is further configured to execute the instructions to:

based on the determination that the object is placed on the different position within a predetermined range, update the stored position to the different position.

3. The object type identifying apparatus according to claim 1 wherein,

the one or more processors is further configured to:

store display information in which the position of the object is associated with a type and a count of the object, and

the one or more processors are further configured to execute the instructions to:

update the display information, according to the type of the object.

4. The object type identifying apparatus according to claim 3 , wherein,

the one or more processors is further configured to execute the instructions to:

based on the determination that the object is picked up, decrease a count of picked up object at a picked-up position out of the stored display information, and update the stored information when the count becomes zero.

5. The object type identifying apparatus according to claim 1 , wherein,

the one or more processors is further configured to execute the instructions to:

when an object or a person other than a target is not detected in the image captured by the camera, update the stored information.

6. The object type identifying apparatus according to claim 1 , wherein,

the one or more processors is further configured to execute the instructions to:

when a difference between a previous used in previous update and a newly captured image exceeds a threshold value determined in advance, update the stored information.

7. The object type identifying apparatus according to claim 1 ,

the one or more processors is further configured to execute the instructions to:

convert the image captured by the camera into a format that is able to be used for identification of a type of the object.

8. The object type identifying apparatus according to claim 1 , wherein the sensor information is based on a pressure sensor provided at a place where an object is placed.

9. An object type identifying method comprising:

storing information indicating an object, among one or more objects displayed on one or more shelves, at a position on the one or more shelves of each object;

determining whether an object is picked up or an object is placed on a different position, based on sensor information;

based on determining that the object is picked up, identifying the picked-up object using an image captured by a camera and

based on determining that the object is placed on a different position on the one or more shelves using the sensor information, updating the stored position to the different position.

10. The object type identifying method according to claim 9 , further comprising:

based on the determination that the object is placed on the different position within a predetermined range, updating the stored position to the different position.

11. A non-transitory computer readable storage medium storing an object type identifying program that causes a computer to execute:

storing information indicating an object, among one or more objects displayed on one or more shelves, at a position on the one or more shelves of each object;

determining whether an object is picked up or an object is placed on a different position, based on sensor information;

based on determining that the object is picked up, identifying the picked-up object using an image captured by a camera; and

based on determining that the object is placed on a different position, updating the position stored in the storage device to the different position,

based on determining that the object is placed on a different position on the one or more shelves using the sensor information, updating the stored position to the different position.

12. The non-transitory computer readable storage medium according to claim 11 , wherein storing the object type identifying program that causes a computer to execute:

at the updating process, based on the determination that the object is placed on the different position within a predetermined range, update the stored position to the different position.

13. The object type identifying apparatus according to claim 1 , wherein the one or more processors is further configured to detect whether or not a person performs an operation of placing a hand into the one or more shelves comprising the one or more objects.

14. The object type identifying apparatus according to claim 1 , wherein the one or more processors is further configured to:

identify the picked-up object using the captured image, in response the determination that the object is picked up, and

update the position stored in the storage device to the different position, in response to the determination that the object is placed on the different position.

15. The object type identifying apparatus according to claim 1 , wherein the one or more processors is further configured to:

update the stored position corresponding to the picked-up object to the different position on the one or more shelves.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2018
From: SHIRAISHI, SOMA
To: NEC CORPORATION
Reel/Frame 047069/0479 →
Priority Claims (1)
JP 2016-076511 · Apr 6, 2016 · national
Continuity (1)
Related Publication 20190130180A1 · May 2, 2019
Cited By (5)
US 12,190,333 US 12,299,697 US 12,299,698 US 12,417,681 US 12,693,150