IP Library Granted Patent US 11,475,177
Granted Patent B2
US 11,475,177 · App. 17/398,804 · Granted Oct 18, 2022

Method and apparatus for improved position and orientation based information display

Inventors: Michael A. Wodrich (Jacksonville, FL); Michael S. Santarone (Jacksonville, FL); Jason E. Duff (Jacksonville, FL); Fred Flitsch (New Windsor, NY); Randall Pugh (Jacksonville, FL)
Assignee: Middle Chart, LLC
G06F30/13G01S19/48G06Q99/00G06T17/05G06T19/006G01S19/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,475,177
App. No.
17/398,804
Filed
Aug 10, 2021
Granted
Oct 18, 2022
Kind
B2
Art Unit
2647
USPC
703/1
Abstract

Apparatus and methods for enhanced wireless determination of a position and direction of a smart device are describe which support the display of a virtual tag upon a user interface of the smart device. Wireless transceivers controlled by the smart device communicate with reference point transceivers to generate data sufficient to determine relative positions of the wireless transceivers and a direction of interest. Operation of LIDAR may be operative to verify the position and direction of the Smart Device as well as a topography of the environment.

Claims (42)

1. Method for displaying a virtual tag on a smart device, the method comprising the steps of:

a) supporting a first transceiver and a magnetic field sensor via an agent at a first geospatial position;

b) generating respective logical communications between the first transceiver and each of a first set of three reference point transceivers, the three reference point transceivers fixedly positioned at disparate points in a structure;

c) with a controller, determining X, Y and Z coordinates of the first transceiver based upon the respective logical communications between the first transceiver and each of the first set of three reference point transceivers;

d) with the controller, determining a direction of interest based upon a quantification of a magnetic field with the magnetic field sensor;

e) capturing an image with a camera located within the smart device;

f) calculating a field of view, based upon an algorithmic calculation comprising input parameters of a set of camera parameters, the generated location and the first direction of interest;

g) accessing data associated with the field of view and determining a presence of at least a first virtual tag within a digital representation of the field of view; and

h) generating a user interface on the smart device, the user interface comprising a display of at least a first data value associated with the first virtual tag.

2. The method of claim 1 wherein the capturing of the image of step h) further includes an acquisition of a LiDAR scan of the field of view.

3. The method of claim 2 additionally comprising the steps of:

reorienting the smart device;

generating a topographical representation of at least a portion of an environment within an area capable of wireless communication with the smart device; and

generating a second direction of interest based upon the topographical representation.

4. The method of claim 1 wherein the capturing of the image of step h) detects infrared energy.

5. The method of claim 1 wherein the capturing of the image of step h) detects ultraviolet energy.

6. The method of claim 1 further comprising displaying an icon on the user interface, wherein the icon is interactive.

7. The method of claim 1 wherein one of the first transceiver and the second transceiver comprises a smart watch.

8. The method of claim 1 wherein the smart device comprises both the first transceiver and the magnetic field sensor.

9. The method of claim 1 wherein at least one of the first set of three reference point transceivers comprises a multi-modality transceiver capable of transceiving in multiple frequency bandwidths.

10. The method of claim 9 wherein the multiple frequency bandwidths comprise bandwidths associated with two or more of: WiFi, Bluetooth, Ultra Wideband, infrared and ultrasonic modalities.

11. Apparatus for displaying a virtual tag on a smart device, the apparatus comprising:

l) a controller comprising a processor and a digital storage, said controller in logical communication with a user interface display;

m) a first transceiver supportable by an Agent at a first geospatial position and in logical communication with the controller;

n) and magnetic field sensor supportable by the Agent at the first geospatial position and in logical communication with the controller;

o) the smart device with at least a first camera device in logical communication with the controller; and

p) executable code stored on the digital storage and executable by the processor to cause the controller to:

I) determine X, Y and Z coordinates of the first transceiver based upon the respective logical communications between the first transceiver and each of a first set of three reference point transceivers;

II) generate a first direction of interest based upon an output of the magnetic field sensor;

V) receive and process a captured image from a camera located within the smart device;

VI) calculate a field of view comprising input parameters of a set of camera parameters, the generated location and the first direction of interest;

VII) access data associated with the field of view and determining a presence of at least a first virtual tag within a digital representation of the field of view; and

VIII) generate a user interface on the smart device, the user interface comprising a display of at least a first data value associated with the first virtual tag.

12. The apparatus of claim 11 wherein the executable code stored on the digital storage and executable by the processor additionally causes the controller to generate an icon for the first virtual tag.

13. The apparatus of claim 12 wherein a touch screen of the smart device senses a user selection of the icon and the executable code stored on the digital storage and executable by the processor causes a display of data associated with the icon for the first virtual tag.

14. The apparatus of claim 12 wherein the smart device additionally comprises a LiDAR camera.

15. The apparatus of claim 11 wherein one of the first transceiver and the second transceiver comprises a smart watch.

16. The apparatus of claim 11 wherein one of the first transceiver and the second transceiver comprises a smart ring.

17. The apparatus of claim 14 wherein the first camera device detects infrared energy.

18. The apparatus of claim 14 wherein the first camera device detects ultraviolet energy.

19. The apparatus of claim 11 wherein at least one of the first set of three reference point transceivers comprises a multi-modality transceiver capable of transceiving in multiple frequency bandwidths.

20. The apparatus of claim 19 wherein the multiple frequency bandwidths comprise bandwidths associated with two or more of: WiFi, Bluetooth, Ultra Wideband, infrared and ultrasonic modalities.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2022
From: SANTARONE, MICHAEL S.; WODRICH, MICHAEL A.; DUFF, JASON E.; PUGH, RANDALL; FLITSCH, FRED
To: MIDDLE CHART, LLC
Reel/Frame 060294/0668 →
Continuity (39)
Continuation 17183062 · Feb 23, 2021
Continuation 16898602 · Jun 11, 2020
Continuation In Part 16817926 · Mar 13, 2020
Continuation In Part 16688775 · Nov 19, 2019
Continuation In Part 16657660 · Oct 18, 2019
Continuation In Part 16597271 · Oct 9, 2019
Continuation 16161823 · Oct 16, 2018
Continuation In Part 15716133 · Sep 26, 2017
Continuation In Part 15703310 · Sep 13, 2017
Continuation 15887637 · Feb 2, 2018
Continuation 15716133 · Sep 26, 2017
Continuation 15703310 · Sep 13, 2017
Continuation In Part 16549503
Continuation In Part 16297383 · Mar 8, 2019
Continuation In Part 16176002 · Oct 31, 2018
Continuation In Part 16171593 · Oct 26, 2018
Continuation In Part 16165517 · Oct 19, 2018
Continuation In Part 16161823 · Oct 16, 2018
Continuation In Part 16142275 · Sep 26, 2018
Continuation In Part 15887637 · Feb 2, 2018
Continuation In Part 16249574 · Jan 16, 2019
Continuation In Part 16176002 · Oct 31, 2018
Continuation In Part 16528104 · Jul 31, 2019
Continuation In Part 16504919 · Jul 8, 2019
Continuation In Part 16503878 · Jul 5, 2019
Continuation In Part 16297383 · Mar 8, 2019
Continuation In Part 16249574 · Jan 16, 2019
Continuation 16775233 · Jan 28, 2020
Continuation In Part 16721906 · Dec 19, 2019
Continuation 16688775 · Nov 19, 2019
Provisional Application 62531955 · Jul 13, 2017
Provisional Application 62531975 · Jul 13, 2017
Provisional Application 62462347 · Feb 22, 2017
Provisional Application 62909061 · Oct 1, 2019
Provisional Application 62712714 · Jul 31, 2018
Provisional Application 62793714 · Jan 17, 2019
Provisional Application 62871499 · Jul 8, 2019
Provisional Application 62769133 · Nov 19, 2018
Related Publication 20210374300A1 · Dec 2, 2021
Cited By (1)
US 12,693,372