IP Library Granted Patent US 12,067,581
Granted Patent B2
US 12,067,581 · App. 18/085,743 · Granted Aug 20, 2024

Object type identifying apparatus, object type identifying method, and recording medium

Inventor: Soma Shiraishi (Tokyo, JP)
Assignee: NEC CORPORATION
G06Q30/0185G06Q10/087G06T7/20G06T7/70G06V20/00G06V20/52G06V40/10G08B25/00G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,067,581
App. No.
18/085,743
Granted
Aug 20, 2024
Kind
B2
Abstract

Provided is an object type identifying apparatus that is capable of correctly identifying the types of objects held in a hand of a person. This object type identifying apparatus is provided with: a memory storing instructions; a storage device storing information indicating a type of an object at a position of each object; and one or more processors configured to execute the instructions to: acquire a position of an object; determine whether an object is picked up or an object is placed, based on sensor information; when determined that an object is picked up, identify a type of the picked-up object, based on the position of the object acquired and information stored in the storage device; and when determined that an object is placed, update information stored in the storage device, using an image captured by a camera that captures arrangement of each object from a front side.

Claims (45)

1. An object identifying system comprising:

one or more sensors acquiring sensor information;

one or more cameras capturing one or more images;

one or more memories configured to store instructions; and

one or more processors configured to execute the instructions to:

determine whether an object is picked up or not, based on the sensor information;

based on a determination that the object is picked up, identify the picked-up object, using the one or more images; and

generate a list including the picked-up object based on the determination that the object is picked up.

2. The object identifying system according to claim 1 , wherein the one or more sensors comprises an image sensor.

3. The object identifying system according to claim 1 , wherein

the one or more processors is further configured to execute the instructions to:

store information indicating a position of one or more objects displayed on one or more shelves;

determine whether the object is placed on a different position or not, based on the sensor information; and

based on a determination that the object is placed on the different, update the stored position to the different position.

4. The object identifying system according to claim 3 , wherein

the one or more processors is further configured to execute the instructions to:

based on the determination that the object is placed on the different position within a predetermined range, update the stored position to the different position.

5. The object identifying system according to claim 3 wherein,

the one or more processors is further configured to:

store display information in which the position of the object is associated with a type and a count of the object, and

the one or more processors are further configured to execute the instructions to:

update the display information, according to the type of the object.

6. The object identifying system according to claim 5 , wherein,

the one or more processors are further configured to execute the instructions to:

based on the determination that the object is picked up, decrease a count of picked up object at a picked-up position out of the stored display information, and update the stored display information in a case where the count becomes zero.

7. The object identifying system according to claim 3 , wherein,

the one or more processors is further configured to execute the instructions to:

in a case where an object or a person other than a target is not detected in the one or more images captured by the one or more cameras, update the stored information.

8. The object identifying system according to claim 3 , wherein,

the one or more processors is further configured to execute the instructions to:

in a case where a difference between a previous used in previous update and a newly captured image exceeds a threshold value determined in advance, update the stored information.

9. The object identifying system according to claim 1 ,

the one or more processors is further configured to execute the instructions to:

convert the one or more images captured by the one or more cameras into a format that is able to be used for identification of a type of the object.

10. The object identifying system according to claim 1 , wherein the sensor information is based on a pressure sensor provided at a place where an object is placed.

11. An object identifying method comprising:

determining whether an object is picked up or not, based on the sensor information;

based on a determination that the object is picked up, identifying the picked-up object, using the one or more images; and

generating a list including the picked-up object based on the determination that the object is picked up.

12. An object identifying apparatus comprising:

one or more memories configured to store instructions; and

one or more processors configured to execute the instructions to:

determine whether an object is picked up or not, based on the sensor information;

based on a determination that the object is picked up, identify the picked-up object, using the one or more images; and

generate a list including the picked-up object based on the determination that the object is picked up.

Priority Claims (1)
JP 2016-076511 · Apr 6, 2016 · national
Continuity (3)
Continuation 17137756 · Dec 30, 2020
Continuation 16091235
Related Publication 20230129862A1 · Apr 27, 2023