IP Library Granted Patent US 11,948,127
Granted Patent B2
US 11,948,127 · App. 17/868,168 · Granted Apr 2, 2024

Systems and methods for augmented reality inventory tracking

Inventors: Roumen Kassabov (Orlando, FL); Peter Kassabov (Winter Park, FL)
Assignee: Fortress Cyber Security, LLC
G06Q10/087G06T7/50G06T19/006G06V10/44G06V20/20G06V20/52G06V30/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,948,127
App. No.
17/868,168
Granted
Apr 2, 2024
Kind
B2
Abstract

The present disclosure describes systems and methods for augmented reality inventory tracking and analysis that identifies devices based on a combination of features, retrieves a configuration or other characteristics of the selected device and presents the configuration as a rendered overlay on a live image from the camera.

Claims (36)

1. A system for augmented reality inventory analysis, comprising:

a computing device comprising a processor, a display, a network interface, and an optical sensor;

wherein the processor is configured to:

identify an entity in an image captured by the optical sensor,

select, from a reference library of candidate devices, a candidate device visually similar to the identified entity,

retrieve, via the network interface from the entity based on the selection of the candidate device, a configuration of the entity, and

render, via the display, an identification of the configuration of the entity as an overlay on a live image of the entity captured via the optical sensor.

2. The system of claim 1 , wherein selecting a candidate device visually similar to the identified entity comprises generating a depth map from the image captured by the optical sensor, and comparing the generated depth map to a depth map of the candidate device; and

wherein selecting the candidate device is performed responsive to the generated depth map matching the depth map of the candidate device.

3. The system of claim 2 , wherein selecting the candidate device further comprises comparing a predetermined image associated with the candidate device to the image captured by the optical sensor; and

wherein selecting the candidate device is further performed responsive to the image captured by the optical sensor matching the predetermined image.

4. The system of claim 1 , wherein selecting a candidate device visually similar to the identified entity comprises extracting an alphanumeric identifier from the image captured by the optical sensor, and comparing the extracted identifier to an alphanumeric identifier of the candidate device.

5. The system of claim 4 , wherein the alphanumeric identifier comprises a serial or model number; and wherein selecting the candidate device is further performed responsive to the extracted alphanumeric identifier matching the alphanumeric identifier of the candidate device.

6. The system of claim 1 , wherein the processor is further configured to compare the retrieved configuration of the entity to a predetermined configuration, and render via the display, an identification of a difference between the retrieved configuration and the predetermined configuration as an overlay on the live image of the entity captured via the optical sensor.

7. A method for augmented reality inventory analysis, comprising:

identifying, by a processor of a computing device, an entity in an image captured by an optical sensor of the computing device;

selecting, by the processor from a reference library of candidate devices, a candidate device visually similar to the identified entity;

retrieving, from the entity based on the selection of the candidate device, a configuration of the entity; and

rendering, by the processor via a display of the computing device, an identification of the configuration of the entity as an overlay on a live image of the entity captured via the optical sensor.

8. The method of claim 7 , wherein selecting a candidate device visually similar to the identified entity comprises generating a depth map from the image captured by the optical sensor, and comparing the generated depth map to a depth map of the candidate device; and

wherein selecting the candidate device is performed responsive to the generated depth map matching the depth map of the candidate device.

9. The method of claim 8 , wherein selecting the candidate device further comprises comparing a predetermined image associated with the candidate device to the image captured by the optical sensor; and

wherein selecting the candidate device is further performed responsive to the image captured by the optical sensor matching the predetermined image.

10. The method of claim 7 , wherein selecting a candidate device visually similar to the identified entity comprises extracting an alphanumeric identifier from the image captured by the optical sensor, and comparing the extracted identifier to an alphanumeric identifier of the candidate device.

11. The method of claim 10 , wherein the alphanumeric identifier comprises a serial or model number; and wherein selecting the candidate device is further performed responsive to the extracted alphanumeric identifier matching the alphanumeric identifier of the candidate device.

12. The method of claim 7 , further comprising comparing, by the processor, the retrieved configuration of the entity to a predetermined configuration, and rendering in real time via the display, an identification of a difference between the retrieved configuration and the predetermined configuration as an overlay on the live image of the entity captured via the optical sensor.

13. A non-transitory computer readable medium comprising instructions that, when executed by a processor of a computing device, causes the computing device to:

identify an entity in an image captured by an optical sensor of the computing device;

select, from a reference library of candidate devices, a candidate device visually similar to the identified entity;

retrieve, via a network interface from the entity based on the selection of the candidate device, a configuration of the entity; and

render, via a display of the computing device, an identification of the configuration of the entity as an overlay on a live image of the entity captured via the optical sensor.

14. The computer readable medium of claim 13 , further causing instructions to cause the computing device to generate a depth map from the image captured by the optical sensor, and compare the generated depth map to a depth map of the candidate device; and

wherein selecting the candidate device is performed responsive to the generated depth map matching the depth map of the candidate device.

15. The computer readable medium of claim 13 , further causing instructions to cause the computing device to:

compare the retrieved configuration of the entity to a predetermined configuration; and

render in real time via the display, an identification of a difference between the retrieved configuration and the predetermined configuration as an overlay on the live image of the entity captured via the optical sensor.

Assignments (2)
SECURITY INTEREST Recorded Jun 30, 2025
From: FORTRESS INFORMATION SECURITY, LLC
To: WESTERN ALLIANCE BANK
Reel/Frame 071570/0917 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 17, 2025
From: KASSABOV, ROUMEN; KASSABOV, PETER
To: FORTRESS INFORMATION SECURITY
Reel/Frame 070229/0926 →
Continuity (2)
Continuation 16595276 · Oct 7, 2019
Related Publication 20220351512A1 · Nov 3, 2022