IP Library Granted Patent US 12,469,157
Granted Patent B2
US 12,469,157 · App. 17/967,066 · Granted Nov 11, 2025

Filling rate measurement method, information processing device, and recording medium

Inventors: Ukyou Katsura (Osaka, JP); Toru Matsunobu (Osaka, JP); Toshiyasu Sugio (Osaka, JP); Tomokazu Ichiriki (Kanagawa, JP); Masanori Kimura (Osaka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
G06T7/60G06V10/469G06V20/64
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,469,157
App. No.
17/967,066
Granted
Nov 11, 2025
Kind
B2
Abstract

A filling rate measurement method includes: obtaining a space three-dimensional model generated by measuring a first storage having an opening and a first storage space in which a measurement target is to be stored, the measuring being performed using a range sensor facing the first storage; obtaining a storage three-dimensional model that is a three-dimensional model of the first storage in which the measurement target is not stored; extracting a target portion corresponding to the measurement target from the space three-dimensional model using the space three-dimensional model and the storage three-dimensional model; calculating a first three-dimensional coordinate system; estimating a target three-dimensional model using the target portion and the first three-dimensional coordinate system, the target three-dimensional model being a three-dimensional model of the measurement target in the first storage space; and calculating a first filling rate of the measurement target with respect to the first storage space.

Claims (48)

1 . A filling rate measurement method comprising:

obtaining a space three-dimensional model generated by measuring a first storage having an opening and a first storage space in which a measurement target is to be stored, the measuring being performed through the opening using a range sensor facing the first storage;

obtaining a storage three-dimensional model that is a three-dimensional model of the first storage in which the measurement target is not stored;

extracting a target portion corresponding to the measurement target from the space three-dimensional model using the space three-dimensional model obtained and the storage three-dimensional model obtained;

calculating a first three-dimensional coordinate system by determining an origin thereof to be a point on a shape of the opening of the first storage;

estimating a target three-dimensional model using the target portion extracted and the first three-dimensional coordinate system calculated, the target three-dimensional model being a three-dimensional model of the measurement target in the first storage space; and

calculating a first filling rate of the measurement target with respect to the first storage space, using the storage three-dimensional model and the target three-dimensional model.

2 . The filling rate measurement method according to claim 1 , wherein

the estimating of the target three-dimensional model is performed, based on a first three-dimensional coordinate system based on a position of a marker provided to the first storage.

3 . The filling rate measurement method according to claim 1 , wherein

the estimating of the target three-dimensional model is performed by estimating a shape of a second portion of the measurement target which does not face the range sensor in a direction from the range sensor toward the measurement target, based on a shape of a first portion of the measurement target which faces the range sensor in the direction.

4 . The filling rate measurement method according to claim 3 , wherein

the first storage further includes a cover part including a through hole, the cover part being opened and closed, and covering the opening when the cover part is in a closed state,

the first portion faces, in the direction, the through hole of the cover part in the closed state,

the second portion is hidden in the direction by the cover part in the closed state,

the filling rate measurement method further comprises

determining whether the cover part is in an open state or the closed state,

when the cover part is in the open state, the extracting and the estimating of the target three-dimensional model are performed to estimate the target three-dimensional model, and

when the cover part is in the closed state, the second portion is estimated based on the first portion, and the target three-dimensional model is estimated using the first portion, the second portion estimated, and the storage three-dimensional model.

5 . The filling rate measurement method according claim 4 , wherein

the direction is horizontal.

6 . The filling rate measurement method according to claim 1 , wherein

the calculating of the first filling rate is performed by calculating, as the first filling rate, a proportion of a volume of the measurement target stored in the first storage space to a capacity of an available space for storing the measurement target in the first storage space.

7 . The filling rate measurement method according to claim 1 , wherein

the first storage and an additional first storage are stored in a second storage space included in a second storage, and

the filling rate measurement method further comprises

calculating a second filling rate of the first storage and the additional first storage with respect to the second storage space.

8 . The filling rate measurement method according to claim 1 , wherein

the storage three-dimensional model is a three-dimensional model measured by the range sensor and an additional range sensor.

9 . The filling rate measurement method according to claim 1 , wherein

the range sensor includes at least two cameras for generating the space three-dimensional model and is fixed to a position above the first storage.

10 . An information processing device comprising:

a processor; and

a memory,

wherein, using the memory, the processor:

obtains a space three-dimensional model generated by measuring a first storage having an opening and a first storage space in which a measurement target is to be stored, the measuring being performed through the opening using a range sensor facing the first storage;

obtains a storage three-dimensional model that is a three-dimensional model of the first storage in which the measurement target is not stored;

extracts a target portion corresponding to the measurement target from the space three-dimensional model using the space three-dimensional model obtained and the storage three-dimensional model obtained;

calculates a first three-dimensional coordinate system by determining an origin thereof to be a point on a shape of the opening of the first storage;

estimates a target three-dimensional model using the target portion extracted and the first three-dimensional coordinate system calculated, the target three-dimensional model being a three-dimensional model of the measurement target in the first storage space; and

calculates a first filling rate of the measurement target with respect to the first storage space, using the storage three-dimensional model and the target three-dimensional model.

11 . A non-transitory computer-readable recording medium having recorded thereon a program causing a computer to perform a filling rate measurement method, the filling rate measurement method including:

obtaining a space three-dimensional model generated by measuring a first storage having an opening and a first storage space in which a measurement target is to be stored, the measuring being performed through the opening using a range sensor facing the first storage;

obtaining a storage three-dimensional model that is a three-dimensional model of the first storage in which the measurement target is not stored;

extracting a target portion corresponding to the measurement target from the space three-dimensional model using the space three-dimensional model obtained and the storage three-dimensional model obtained;

calculating a first three-dimensional coordinate system by determining an origin thereof to be a point on a shape of the opening of the first storage;

estimating a target three-dimensional model using the target portion extracted and the first three-dimensional coordinate system calculated, the target three-dimensional model being a three-dimensional model of the measurement target in the first storage space; and

calculating a first filling rate of the measurement target with respect to the first storage space, using the storage three-dimensional model and the target three-dimensional model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2023
From: KATSURA, UKYOU; MATSUNOBU, TORU; SUGIO, TOSHIYASU; ICHIRIKI, TOMOKAZU; KIMURA, MASANORI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 062364/0646 →
Priority Claims (1)
JP 2020-079081 · Apr 28, 2020 · national
Continuity (2)
Continuation PCTJP2021015149 · Apr 12, 2021
Related Publication 20230035883A1 · Feb 2, 2023
References Cited (20)
US 9940730B2 · Zhang · 2018 [cited by examiner]
US 11308314B2 · Hashimoto · 2022 [cited by examiner]
US 11481093B1 · Diaz · 2022 [cited by examiner]
US 12039488B2 · Marquette · 2024 [cited by examiner]
US 20200096623A1 · Okada · 2020 [cited by examiner]
US 20200302237A1 · Hennings Yeomans · 2020 [cited by examiner]
US 20210289161A1 · Huang · 2021 [cited by examiner]
US 20210326593A1 · Bonsignore · 2021 [cited by examiner]
US 20210357896A1 · Masuda · 2021 [cited by examiner]
US 20220180560A1 · Nakano · 2022 [cited by examiner]
JP 2009053147A · 2009 [cited by examiner]
JP 4492654B2 · 2010 [cited by examiner]
JP 2014035702A · 2014 [cited by examiner]
JP 201587319 · 2015 [cited by applicant]
JP 2017067704A · 2017 [cited by examiner]
KR 102093042B1 · 2020 [cited by examiner]
WO 2017175312 · 2017 [cited by applicant]
WO WO2017175312A1 · 2017 [cited by examiner]
WO WO2019012687A1 · 2019 [cited by examiner]
International Search Report (ISR) issued on Jul. 6, 2021 in International (PCT) Application No. PCT/JP2021/015149. [cited by applicant]