IP Library Granted Patent US 12,299,697
Granted Patent B2
US 12,299,697 · App. 18/236,219 · Granted May 13, 2025

Object type identifying apparatus, object type identifying method, and recording medium

Inventor: Soma Shiraishi (Tokyo, JP)
Assignee: NEC CORPORATION
G06Q30/0185G06Q10/087G06T7/20G06T7/70G06V20/00G06V20/52G06V40/10G08B25/00G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,299,697
App. No.
18/236,219
Granted
May 13, 2025
Kind
B2
Abstract

Provided is an object type identifying apparatus that is capable of correctly identifying the types of objects held in a hand of a person. This object type identifying apparatus is provided with: a memory storing instructions; a storage device storing information indicating a type of an object at a position of each object; and one or more processors configured to execute the instructions to: acquire a position of an object; determine whether an object is picked up or an object is placed, based on sensor information; when determined that an object is picked up, identify a type of the picked-up object, based on the position of the object acquired and information stored in the storage device; and when determined that an object is placed, update information stored in the storage device, using an image captured by a camera that captures arrangement of each object from a front side.

Claims (38)

1. An object identifying apparatus comprising:

one or more memories configured to store instructions; and

one or more processors configured to execute the instructions to:

determine whether an object is picked up or not, based on one or more images captured by a camera;

based on a determination that the object is picked up, identify the picked-up object, using the one or more images; and

generate a list of the picked-up object based on the determination that the object is picked up.

2. The object identifying apparatus according to claim 1 , wherein

the one or more processors are further configured to execute the instructions to:

store information indicating each object, among one or more objects displayed on one or more shelves, the each object being located at a position on the one or more shelves;

determine whether the object is placed on a different position or not, based on the one or more images; and

based on a determination that the object is placed on a different position on the one or more shelves using the one or more images, update a stored position to the different position.

3. The object identifying apparatus according to claim 2 , wherein

the one or more processors are further configured to execute the instructions to:

based on the determination that the object is placed on the different position within a predetermined range, update the stored position to the different position.

4. The object identifying apparatus according to claim 2 wherein,

the one or more processors are further configured to execute the instructions to:

store display information in which the position of the object is associated with a type and a count of the object, and

update the display information, according to the type of the object.

5. The object identifying apparatus according to claim 2 , wherein,

the one or more processors are further configured to execute the instructions to:

based on the determination that the object is picked up, decrease a count of picked up object at a picked-up position out of the stored display information, and update the stored information in a case where the count becomes zero.

6. The object identifying apparatus according to claim 2 , wherein,

the one or more processors are further configured to execute the instructions to:

in a case where an object or a person other than a target is not detected in the image captured by the camera, update the stored information.

7. The object identifying apparatus according to claim 2 , wherein,

the one or more processors are further configured to execute the instructions to:

in a case where a difference between a previous used in previous update and a newly captured image exceeds a threshold value determined in advance, update the stored information.

8. The object identifying apparatus according to claim 1 ,

the one or more processors are further configured to execute the instructions to:

convert the image captured by the camera into a format that is able to be used for identification of a type of the object.

9. An object identifying method comprising:

determining whether an object is picked up or not, based on one or more images captured by a camera;

based on a determination that the object is picked up, identifying the picked-up object, using the one or more images; and

generating a list of the picked-up object based on the determination that the object is picked up.

10. A non-transitory computer readable storage medium storing an object identifying program that causes a computer to execute:

determining whether an object is picked up or not, based on one or more images captured by a camera;

based on a determination that the object is picked up, identifying the picked-up object, using the one or more images; and

generating a list of the picked-up object based on the determination that the object is picked up.

Priority Claims (1)
JP 2016-076511 · Apr 6, 2016 · national
Continuity (4)
Continuation 18085743 · Dec 21, 2022
Continuation 17137756 · Dec 30, 2020
Continuation 16091235
Related Publication 20230394502A1 · Dec 7, 2023
References Cited (18)
US 8410927B2 · Gabara · 2013 [cited by applicant]
US 9171278B1 · Kong et al. · 2015 [cited by applicant]
US 10922541B2 · Shiraishi · 2021 [cited by applicant]
US 11562559B2 · Shiraishi · 2023 [cited by examiner]
US 20140132728A1 · Verano et al. · 2014 [cited by applicant]
US 20150010204A1 · Iwai · 2015 [cited by applicant]
US 20160260161A1 · Atchley et al. · 2016 [cited by applicant]
JP 2004171240A · 2004 [cited by applicant]
JP 2007065950A · 2007 [cited by applicant]
JP 2008201569A · 2008 [cited by applicant]
JP 2009009231A · 2009 [cited by applicant]
JP 5673888B1 · 2015 [cited by applicant]
WO 2014136559A1 · 2014 [cited by applicant]
WO 2015140851A1 · 2015 [cited by applicant]
International Search Report for PCT/JP2017/013917 dated Jun. 27, 2017 [PCT/ISA/210]. [cited by applicant]
Written Opinion for PCT/JP2017/013917 dated Jun. 27, 2017 [PCT/ISA/237]. [cited by applicant]
U.S. Office Action for U.S. Appl. No. 18/085,743, mailed on Sep. 28, 2023. [cited by applicant]
JP Office Action for JP Application No. 2023-093619, mailed on May 28, 2024 with English Translation. [cited by applicant]