IP Library Granted Patent US 12,249,093
Granted Patent B2
US 12,249,093 · App. 17/681,291 · Granted Mar 11, 2025

System and method for geo-referencing object on floor

Inventors: Brian Earp (Merrimack, NH); Jan-Phillipp Mohr (Hamburg, DE)
G06T7/73G06T7/246G06T7/60G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,249,093
App. No.
17/681,291
Granted
Mar 11, 2025
Kind
B2
Abstract

Disclosed is a system and a method for geo-referencing an object on a floor. The method comprises receiving a camera frame providing view of a section of the floor, receiving a detailed floor plan of the floor, selecting a first area from the section of the floor in which the object needs to be tracked and defining a plurality of reference points. Herein, at least one of the pluralities of reference points is close to a mid-point along one of corresponding axes of the first area. The method further comprises mapping the plurality of reference points to the floor plan, processing the camera frame to determine if the object has been placed in the first area and geo-referencing the one or more object in the floor plan if the object is determined to be placed in the first area.

Claims (26)

1. A method for geo-referencing an object on a floor, the method comprising:

receiving a camera frame providing view of a section of the floor;

receiving a detailed floor plan of the floor;

selecting a first area from the section of the floor in which the object needs to be tracked;

defining a plurality of reference points, wherein

at least one of the plurality of reference points is close to a mid-point along one of corresponding axes of the first area, and

the mid-point is chosen based on a correlation between pixel distance and distance on the floor plan;

mapping the plurality of reference points to the floor plan;

processing the camera frame to determine if the object has been placed in the first area; and

geo-referencing the one or more object in the floor plan if the object is determined to be placed in the first area.

2. A method according to claim 1 , wherein the plurality of reference points comprises at least four points.

3. A method according to claim 1 further comprising processing the camera frame to determine one or more dimensions related to the first area by using at least two points defined in the first area with a known distance therebetween.

4. A method according to any of preceding claims further comprising obscuring one or more portions of the camera frame corresponding to a section of the floor other than the first area in the section of the floor.

5. A system for geo-referencing an object on a floor, the system comprising a server arrangement configured to:

receive a camera frame providing view of a section of the floor;

receive a detailed floor plan of the floor;

select a first area from the section of the floor in which the object needs to be tracked;

define a plurality of reference points, wherein

at least one of the plurality of reference points is close to a mid-point along one of corresponding axes of the first area, and

the mid-point is chosen based on a correlation between pixel distance and distance on the floor plan;

map the plurality of reference points to the floor plan;

process the camera frame to determine if the object has been placed in the first area; and

geo-reference the one or more object in the floor plan if the object is determined to be placed in the first area.

6. A system according to claim 5 , wherein the plurality of reference points comprises at least four points.

7. A system according to claim 5 , wherein the server arrangement is further configured to process the camera frame to determine one or more dimensions related to the first area by using at least two points defined in the first area with a known distance therebetween.

8. A system according to any of claims 5 to 7 , wherein the server arrangement is further configured to obscure one or more portions of the camera frame corresponding to a section of the floor other than the first area in the section of the floor.

Continuity (2)
Provisional Application 63154141 · Feb 26, 2021
Related Publication 20220277474A1 · Sep 1, 2022
References Cited (7)
US 11113879B2 · Núñez · 2021 [cited by examiner]
US 11252329B1 · Cier · 2022 [cited by examiner]
US 20190005719A1 · Fleischman · 2019 [cited by examiner]
Hullo (“Multi-Sensor As-Build Models of Complex Industrial Architectures”, Remote Sensing, vol. 7, 2015, pp. 16339-16362) (Year: 2015). [cited by examiner]
Combined Search and Examination Report under Sections 17 and 18(3) issued for United Kingdom Patent Application GB2102821.2, on Dec. 14, 2021, 10 Pages. [cited by applicant]
François Hullo, Jean, et al., “Multi-Sensor As-Built Models of Complex Industrial Architectures”, MDPI, Remote Sensing, Special Issue—Remote Sensed Data and Processing Methodologies for 3D Virtual Reconstruction and Vis… [cited by applicant]
Jo, Junghee, et al., “Geospatial Information System Based on Indoor Plan UKM”, MDPI, Special Issue—Distributed and Parallel Architectures for Spatial Data, vol. 32, Issue 3, Aug. 30, 2020, pp. 539-549. [cited by applicant]