IP Library Granted Patent US 12,080,015
Granted Patent B2
US 12,080,015 · App. 17/271,905 · Granted Sep 3, 2024

Method(s) and system(s) for vehicular cargo management

Inventors: Naveen Sangeneni (Fremont, CA); Amruta Kulkarni (Santa Clara, CA); Kevin Abas (Fremont, CA); Reddy Avula Srinivas (Fremont, CA); Sreenjoy Chatterjee (San Francisco, CA); Andrew Kaneshiro (Los Altos, CA); Jyh-Yung Lin (Santa Clara, CA); Gagandeep Singh (San Jose, CA)
Assignee: Mercedes-Benz Group AG
G06T7/62G06Q10/08G06Q10/087G06T7/50G06T7/70G06T2207/10028G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,080,015
App. No.
17/271,905
Granted
Sep 3, 2024
Kind
B2
Abstract

A method of determining volume of a cargo space of a vehicle in real-time includes generating an initial spatial model of the cargo space using images from a plurality of cameras including cameras for capturing at least one of depth and color, positioned in and around the cargo space, where the images are stitched together into a dense point cloud in real-time, generating an updated spatial model of the cargo space using the images, upon detection of items being loaded or unloaded into the cargo space, where the updated spatial model includes changes to the cargo space, estimating a volume of loaded items in the updated spatial model, and determining a remaining volume of the cargo space based on the estimated volume of the loaded items and a total volume of the cargo space, where the total volume is calculated based on the initial spatial model.

Claims (22)

1. A method of determining volume of a cargo space of a vehicle in real-time, comprising the steps of:

generating an initial spatial model of the cargo space using images from a plurality of cameras including cameras for capturing at least one of depth and color, positioned in and around the cargo space, wherein the images from each camera of the plurality of cameras are stitched together into a dense point cloud (DPC) in real-time;

generating an updated spatial model of the cargo space using the images from the plurality of cameras, upon detection of items being loaded or unloaded into the cargo space, wherein the updated spatial model includes changes to the cargo space;

estimating a volume of loaded items in the updated spatial model; and

determining a remaining volume of the cargo space based on the estimated volume of the loaded items and a total volume of the cargo space, wherein the total volume is calculated based on the initial spatial model.

2. The method as claimed in claim 1 , wherein the items are loaded on shelves inside the cargo space.

3. The method as claimed in claim 2 , wherein the volume of the loaded items is estimated based on a volume between outer edges of a bounding box corresponding to each loaded item and a depth of a shelf accommodating the corresponding loaded item in the cargo space.

4. The method as claimed in claim 3 , wherein depth of each shelf is calculated based on the initial spatial model.

5. The method as claimed in claim 1 further comprising transmitting information indicating the remaining volume of the cargo space to at least one device.

6. The method as claimed in claim 5 , wherein the information indicating the remaining volume is transmitted as at least one of an absolute number, a percentage of the total volume of the cargo space, and an estimated number of items which can be loaded into the remaining volume.

7. The method as claimed in claim 1 , wherein the stitching of images comprises:

receiving calibration patterns with respect to each of the plurality of cameras to identify relative positions of each of the plurality of cameras;

identifying the calibration patterns for the images captured by each of the plurality of cameras;

generating a point cloud for each of the images; and

merging the point clouds to form the DPC by overlapping shared portions of the cargo space in each of the images, wherein shared portions are identified based on the calibration patterns, the intrinsic patterns and the extrinsic patterns.

8. A system for continuous volume determination of the cargo space of a vehicle, comprising:

a model generation unit configured to generate an initial spatial model of the cargo space using images from a plurality of cameras including cameras for capturing at least one of depth and color, positioned in and around the cargo space, wherein the images from each camera of the plurality of cameras are stitched together into a dense point cloud in real-time;

the model generation unit is further configured to generate an updated spatial model of the cargo space using the images from the plurality of cameras, upon detection of items being loaded or unloaded into the cargo space, wherein the updated spatial model includes changes to the cargo space;

a volume estimation unit configured to estimate a volume of loaded items in the updated spatial model; and

the volume estimation unit is further configured to determine a remaining volume of the cargo space based on the estimated volume of the loaded items and a total volume of the cargo space, wherein the total volume is calculated based on the initial spatial model.

9. The system as claimed in claim 8 , wherein the items are loaded on shelves inside the cargo space and wherein the volume estimation unit estimates the volume of the loaded items based on a volume between outer edges of a bounding box corresponding to each loaded item and a depth of a shelf accommodating the corresponding loaded item in the cargo space.

10. The system as claimed in claim 9 , wherein the volume estimation unit is further configured to calculate the depth of each shelf based on the initial spatial model.

Assignments (4)
CHANGE OF NAME Recorded Jul 29, 2025
From: DAIMLER AG
To: MERCEDES BENZ GROUP AG
Reel/Frame 072886/0467 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2022
From: MERCEDES-BENZ RESEARCH & DEVELOPMENT NORTH AMERICA, INC.
To: MERCEDES-BENZ GROUP AG
Reel/Frame 061780/0358 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2022
From: ABAS, KEVIN; CHATTERJEE, SREENJOY; KANESHIRO, ANDREW; LIN, JYH-YUNG
To: MERCEDES-BENZ RESEARCH & DEVELOPMENT NORTH AMERICA, INC.
Reel/Frame 060571/0180 →
EMPLOYMENT AGREEMENT Recorded Jul 20, 2022
From: SANGENENI, NAVEEN; KULKARNI, AMRUTA; SRINIVAS, REDDY AVULA; SINGH, GAGANDEEP
To: MERCEDES-BENZ RESEARCH & DEVELOPMENT NORTH AMERICA, INC.
Reel/Frame 060777/0951 →
Priority Claims (1)
DE 10 2018 006 765.4 · Aug 27, 2018 · national
Continuity (1)
Related Publication 20210319582A1 · Oct 14, 2021
Cited By (1)
US 12,223,460