IP Library › Granted Patent US 12,190,333
Granted Patent B2
US 12,190,333 · App. 18/236,250 · Granted Jan 7, 2025

Object type identifying apparatus, object type identifying method, and recording medium

Inventor: Soma Shiraishi (Tokyo, JP)
Assignee: NEC CORPORATION
G06Q30/0185G06Q10/087G06T7/20G06T7/70G06V20/00G06V20/52G06V40/10G08B25/00G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,190,333
App. No.
18/236,250
Granted
Jan 7, 2025
Kind
B2
Abstract

Provided is an object type identifying apparatus that is capable of correctly identifying the types of objects held in a hand of a person. This object type identifying apparatus is provided with: a memory storing instructions; a storage device storing information indicating a type of an object at a position of each object; and one or more processors configured to execute the instructions to: acquire a position of an object; determine whether an object is picked up or an object is placed, based on sensor information; when determined that an object is picked up, identify a type of the picked-up object, based on the position of the object acquired and information stored in the storage device; and when determined that an object is placed, update information stored in the storage device, using an image captured by a camera that captures arrangement of each object from a front side.

Claims (22)

1. An object identifying apparatus comprising:

one or more memories configured to store instructions; and

one or more processors configured to execute the instructions to:

store display information in which a position of an object is associated with a count and a type of the object;

determine whether an object is picked up or an object is placed, based on sensor information acquired by one or more sensors;

identify the type of the object picked up or placed, based on the sensor information; and

when the count of the object at a picked-up position becomes zero, or when the type of the object at the position is changed, update the stored information.

2. The object identifying apparatus according to claim 1 , wherein the one or more sensors are image sensors.

3. The object identifying apparatus according to claim 1 , wherein

the one or more processors are further configured to execute the instructions to:

based on the determination that the object is placed on a different position within a predetermined range, update the stored position to the different position.

4. The object identifying apparatus according to claim 1 , wherein the sensor information is based on a pressure sensor provided at a place where an object is placed.

5. An object identifying method comprising:

storing display information in which a position of an object is associated with a count and a type of the object;

determining whether an object is picked up or an object is placed, based on sensor information acquired by one or more sensors;

identifying the type of the object picked up or placed, based on the sensor information; and

when the count of the object at a picked-up position becomes zero, or when the type of the object at the position is changed, updating the stored information.

6. A non-transitory computer readable storage medium storing an object identifying program that causes a computer to execute:

storing display information in which a position of an object is associated with a count and a type of the object;

determining whether an object is picked up or an object is placed, based on sensor information acquired by one or more sensors;

identifying the type of the object picked up or placed, based on the sensor information; and

when the count of the object at a picked-up position becomes zero, or when the type of the object at the position is changed, updating the stored information.

Priority Claims (1)
JP 2016-076511 · Apr 6, 2016 · national
Continuity (4)
Continuation 18085743 · Dec 21, 2022
Continuation 17137756 · Dec 30, 2020
Continuation 16091235
Related Publication 20230394504A1 · Dec 7, 2023
References Cited (18)
US 8410927B2 · Gabara · 2013 [cited by applicant]
US 9171278B1 · Kong et al. · 2015 [cited by applicant]
US 10922541B2 · Shiraishi · 2021 [cited by examiner]
US 11562559B2 · Shiraishi · 2023 [cited by applicant]
US 20140132728A1 · Verano et al. · 2014 [cited by applicant]
US 20150010204A1 · Iwai · 2015 [cited by applicant]
US 20160260161A1 · Atchley et al. · 2016 [cited by applicant]
JP 2004171240A · 2004 [cited by applicant]
JP 2007065950A · 2007 [cited by applicant]
JP 2008201569A · 2008 [cited by applicant]
JP 2009009231A · 2009 [cited by applicant]
JP 5673888B1 · 2015 [cited by applicant]
WO 2014136559A1 · 2014 [cited by applicant]
WO 2015140851A1 · 2015 [cited by applicant]
International Search Report for PCT/JP2017/013917 dated Jun. 27, 2017 [PCT/ISA/210]. [cited by applicant]
Written Opinion for PCT/JP2017/013917 dated Jun. 27, 2017 [PCT/ISA/237]. [cited by applicant]
US Office Action for U.S. Appl. No. 18/085,743, mailed on Sep. 28, 2023. [cited by applicant]
JP Office Action for JP Application No. 2023-093619, mailed on May 28, 2024 with English Translation. [cited by applicant]