IP Library Granted Patent US 12,299,698
Granted Patent B2
US 12,299,698 · App. 18/236,231 · Granted May 13, 2025

Object type identifying apparatus, object type identifying method, and recording medium

Inventor: Soma Shiraishi (Tokyo, JP)
Assignee: NEC CORPORATION
G06Q30/0185G06Q10/087G06T7/20G06T7/70G06V20/00G06V20/52G06V40/10G08B25/00G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,299,698
App. No.
18/236,231
Granted
May 13, 2025
Kind
B2
Abstract

Provided is an object type identifying apparatus that is capable of correctly identifying the types of objects held in a hand of a person. This object type identifying apparatus is provided with: a memory storing instructions; a storage device storing information indicating a type of an object at a position of each object; and one or more processors configured to execute the instructions to: acquire a position of an object; determine whether an object is picked up or an object is placed, based on sensor information; when determined that an object is picked up, identify a type of the picked-up object, based on the position of the object acquired and information stored in the storage device; and when determined that an object is placed, update information stored in the storage device, using an image captured by a camera that captures arrangement of each object from a front side.

Claims (30)

1. An object identifying apparatus comprising:

one or more memories configured to store instructions; and

one or more processors configured to execute the instructions to:

store display information in which a position of an object is associated with a count and a type of the object;

determine whether an object is picked up or an object is placed, based on sensor information acquired by one or more sensors;

identify the type of the object picked up or placed based on the sensor information; and

update the stored information of the identified object based on the determination result indicating whether the object is picked up or the object is placed.

2. The object identifying apparatus according to claim 1 , wherein the one or more sensors are image sensors.

3. The object identifying apparatus according to claim 1 , wherein

the one or more processors are further configured to execute the instructions to:

store information indicating each object, among one or more objects displayed on one or more shelves, the each object being located at a position on the one or more shelves;

determine whether the object is placed on a different position or not, based on the sensor information; and

based on the determination that the object is placed on a different position on the one or more shelves using sensor information, update a stored position to the different position.

4. The object identifying apparatus according to claim 3 , wherein

the one or more processors are further configured to execute the instructions to:

based on the determination that the object is placed on the different position within a predetermined range, update the stored position to the different position.

5. The object identifying apparatus according to claim 3 , wherein,

the one or more processors are further configured to execute the instructions to:

based on the determination that the object is picked up, decrease the count of picked up object at a picked-up position out of the stored display information, and update the stored information in a case where the count becomes zero.

6. The object identifying apparatus according to claim 1 , wherein the sensor information is based on a pressure sensor provided at a place where an object is placed.

7. An object identifying method comprising:

storing display information in which a position of an object is associated with a count and a type of the object;

determining whether an object is picked up or an object is placed, based on sensor information acquired by one or more sensors;

identifying the type of the object picked up or placed based on the sensor information; and

updating the stored information of the identified object based on the determination result indicating whether the object is picked up or the object is placed.

8. A non-transitory computer readable storage medium storing an object identifying program that causes a computer to execute:

storing display information in which a position of an object is associated with a count and a type of the object;

determining whether an object is picked up or an object is placed, based on sensor information acquired by one or more sensors;

identifying the type of the object picked up or placed based on the sensor information; and

updating the stored information of the identified object based on the determination result indicating whether the object is picked up or the object is placed.

Priority Claims (1)
JP 2016-076511 · Apr 6, 2016 · national
Continuity (4)
Continuation 18085743 · Dec 21, 2022
Continuation 17137756 · Dec 30, 2020
Continuation 16091235
Related Publication 20230394503A1 · Dec 7, 2023
References Cited (18)
US 8410927B2 · Gabara · 2013 [cited by applicant]
US 9171278B1 · Kong et al. · 2015 [cited by applicant]
US 10922541B2 · Shiraishi · 2021 [cited by applicant]
US 11562559B2 · Shiraishi · 2023 [cited by examiner]
US 20140132728A1 · Verano et al. · 2014 [cited by applicant]
US 20150010204A1 · Iwai · 2015 [cited by applicant]
US 20160260161A1 · Atchley et al. · 2016 [cited by applicant]
JP 2004171240A · 2004 [cited by applicant]
JP 2007065950A · 2007 [cited by applicant]
JP 2008201569A · 2008 [cited by applicant]
JP 2009009231A · 2009 [cited by applicant]
JP 5673888B1 · 2015 [cited by applicant]
WO 2014136559A1 · 2014 [cited by applicant]
WO 2015140851A1 · 2015 [cited by applicant]
US Office Action for U.S. Appl. No. 18/085,743, mailed on Sep. 28, 2023. [cited by applicant]
International Search Report for PCT/JP2017/013917 dated Jun. 27, 2017 [PCT/ISA/210]. [cited by applicant]
Written Opinion for PCT/JP2017/013917 dated Jun. 27, 2017 [PCT/ISA/237]. [cited by applicant]
JP Office Action for JP Application No. 2023-093619, mailed on May 28, 2024 with English Translation. [cited by applicant]