IP Library Granted Patent US 11,244,466
Granted Patent B2
US 11,244,466 · App. 16/802,846 · Granted Feb 8, 2022

Automated capacity management using artificial intelligence techniques

Inventors: Hung T. Dinh (Austin, TX); Bijan K. Mohanty (Austin, TX)
Assignee: Dell Products L.P.
G06T7/62G06N3/0454G06T7/11G06T11/20G06T2207/20081G06T2207/20084G06T2210/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,244,466
App. No.
16/802,846
Granted
Feb 8, 2022
Kind
B2
Abstract

Methods, apparatus, and processor-readable storage media for automated capacity management using artificial intelligence techniques are provided herein. An example computer-implemented method includes obtaining image data pertaining to occupancy of a confined space; determining a level of occupancy in the confined space and one or more types of entities occupying the confined space by processing the image data using a first set of one or more artificial intelligence techniques comprising at least a first machine learning model; automatically determining one or more capacity management parameters with respect to the confined space by analyzing the determined level of occupancy and the one or more determined types of entities using a second set of one or more artificial intelligence techniques comprising at least a second machine learning model; and performing one or more automated actions based at least in part on the one or more determined capacity management parameters.

Claims (44)

1. A computer-implemented method comprising:

obtaining image data pertaining to occupancy of a confined space;

determining a level of occupancy in the confined space and one or more types of entities occupying the confined space by processing the image data using a first set of one or more artificial intelligence techniques comprising at least a first machine learning model, wherein processing the image data using the first set of one or more artificial intelligence techniques comprising at least the first machine learning model comprises performing at least one object identification task and at least one instance segmentation task using a mask regional-convolutional neural network (R-CNN);

automatically determining one or more capacity management parameters with respect to the confined space by analyzing the determined level of occupancy and the one or more determined types of entities using a second set of one or more artificial intelligence techniques comprising at least a second machine learning model; and

performing one or more automated actions based at least in part on the one or more determined capacity management parameters;

wherein the method is performed by at least one processing device comprising a processor coupled to a memory.

2. The computer-implemented method of claim 1 , wherein processing the image data using the mask R-CNN comprises:

identifying one or more areas within the image data likely to contain one or more entities by scanning the image data using at least one feature pyramid network;

generating one or more bounding boxes within the image data based at least in part on the one or more identified areas; and

generating at least one mask at pixel-level within at least a portion of the one or more identified areas.

3. The computer-implemented method of claim 2 , wherein the at least one feature pyramid network comprises information pertaining to three-dimensional geometry and information pertaining to one or more colors.

4. The computer-implemented method of claim 2 , wherein the image data comprise three-dimensional image data, and wherein using the mask R-CNN comprises linking one or more voxels in the three-dimensional image data to at least one class label.

5. The computer-implemented method of claim 1 , wherein the second machine learning model comprises at least one random forest model, and wherein analyzing the determined level of occupancy and the one or more determined types of entities using the at least one random forest model comprises performing one of more classifications across multiple capacity management parameters using multiple decision trees corresponding thereto.

6. The computer-implemented method of claim 1 , wherein the one or more capacity management parameters comprises at least one parameter pertaining to entity entry into the confined space.

7. The computer-implemented method of claim 1 , wherein the one or more capacity management parameters comprises at least one parameter pertaining to energy utilization in the confined space.

8. The computer-implemented method of claim 1 , wherein performing the one or more automated actions comprises automatically outputting instructions to at least one capacity management-related controller associated with the confined space.

9. The computer-implemented method of claim 8 , wherein the at least one capacity management-related controller comprises at least one Internet of Things device which controls one or more variables within the confined space.

10. The computer-implemented method of claim 1 , wherein performing the one or more automated actions comprises automatically notifying at least one user with the one or more determined capacity management parameters.

11. A non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device:

to obtain image data pertaining to occupancy of a confined space;

to determine a level of occupancy in the confined space and one or more types of entities occupying the confined space by processing the image data using a first set of one or more artificial intelligence techniques comprising at least a first machine learning model, wherein processing the image data using the first set of one or more artificial intelligence techniques comprising at least the first machine learning model comprises performing at least one object identification task and at least one instance segmentation task using a mask R-CNN;

to automatically determine one or more capacity management parameters with respect to the confined space by analyzing the determined level of occupancy and the one or more determined types of entities using a second set of one or more artificial intelligence techniques comprising at least a second machine learning model; and

to perform one or more automated actions based at least in part on the one or more determined capacity management parameters.

12. The non-transitory processor-readable storage medium of claim 11 , wherein processing the image data using the mask R-CNN comprises:

identifying one or more areas within the image data likely to contain one or more entities by scanning the image data using at least one feature pyramid network;

generating one or more bounding boxes within the image data based at least in part on the one or more identified areas; and

generating at least one mask at pixel-level within at least a portion of the one or more identified areas.

13. The non-transitory processor-readable storage medium of claim 12 , wherein the at least one feature pyramid network comprises information pertaining to three-dimensional geometry and information pertaining to one or more colors.

14. The non-transitory processor-readable storage medium of claim 11 , wherein the second machine learning model comprises at least one random forest model, and wherein analyzing the determined level of occupancy and the one or more determined types of entities using the at least one random forest model comprises performing one of more classifications across multiple capacity management parameters using multiple decision trees corresponding thereto.

15. An apparatus comprising:

at least one processing device comprising a processor coupled to a memory;

the at least one processing device being configured:

to obtain image data pertaining to occupancy of a confined space;

to determine a level of occupancy in the confined space and one or more types of entities occupying the confined space by processing the image data using a first set of one or more artificial intelligence techniques comprising at least a first machine learning model, wherein processing the image data using the first set of one or more artificial intelligence techniques comprising at least the first machine learning model comprises performing at least one object identification task and at least one instance segmentation task using a mask R-CNN;

to automatically determine one or more capacity management parameters with respect to the confined space by analyzing the determined level of occupancy and the one or more determined types of entities using a second set of one or more artificial intelligence techniques comprising at least a second machine learning model; and

to perform one or more automated actions based at least in part on the one or more determined capacity management parameters.

16. The apparatus of claim 15 , wherein processing the image data using the mask R-CNN comprises:

identifying one or more areas within the image data likely to contain one or more entities by scanning the image data using at least one feature pyramid network;

generating one or more bounding boxes within the image data based at least in part on the one or more identified areas; and

generating at least one mask at pixel-level within at least a portion of the one or more identified areas.

17. The apparatus of claim 15 , wherein the second machine learning model comprises at least one random forest model, and wherein analyzing the determined level of occupancy and the one or more determined types of entities using the at least one random forest model comprises performing one of more classifications across multiple capacity management parameters using multiple decision trees corresponding thereto.

18. The apparatus of claim 15 , wherein performing the one or more automated actions comprises automatically outputting instructions to at least one capacity management-related controller associated with the confined space.

19. The apparatus of claim 15 , wherein the at least one capacity management-related controller comprises at least one Internet of Things device which controls one or more variables within the confined space.

20. The apparatus of claim 15 , wherein performing the one or more automated actions comprises automatically notifying at least one user with the one or more determined capacity management parameters.

Assignments (13)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052851/0917) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0509 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052852/0022) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0582 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0742 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052851/0081) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0441 →
RELEASE OF SECURITY INTEREST AT REEL 052771 FRAME 0906 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0298 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 053311/0169 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC; THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052851/0081 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052851/0917 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052852/0022 →
SECURITY AGREEMENT Recorded May 28, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 052771/0906 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2020
From: DINH, HUNG T.; MOHANTY, BIJAN K.
To: DELL PRODUCTS L.P.
Reel/Frame 051950/0421 →