IP Library Granted Patent US 12,493,891
Granted Patent B2
US 12,493,891 · App. 17/544,835 · Granted Dec 9, 2025

Sight information collection in head worn computing

Inventors: Edward H Nortrup (Stoneham, MA); John N. Border (Eaton, NH)
Assignee: Mentor Acquisition One, LLC
G06Q30/0201G06F3/013
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,493,891
App. No.
17/544,835
Filed
Dec 7, 2021
Granted
Dec 9, 2025
Kind
B2
Art Unit
3624
USPC
705/7.29
Abstract

Aspects of the present invention relate to methods and systems for collecting an using eye heading and sight heading information in head worn computing.

Claims (46)

1 . A method, comprising:

receiving, via a GPS sensor of a wearable head device of a user, a first GPS location of the wearable head device at a first time;

determining, by a processor of the wearable head device, via an output of an orientation sensor of the wearable head device, an orientation of the wearable head device;

determining, by a processor of the wearable head device, based on the first GPS location, whether the wearable head device is in proximity to an object, the object at a pre-determined first geo-spatial location;

determining, by a processor of the wearable head device, based on the orientation of the wearable head device and based further on an image of an eye of the user, a level of an alignment of the wearable head device with a pre-determined sight heading associated with the first geo-spatial location;

determining, based on the level of the alignment, whether the wearable head device is aligned with the pre-determined sight heading;

in accordance with a determination that the wearable head device is in proximity to the object, and further in accordance with a determination that the wearable head device is aligned with the pre-determined sight heading, storing in a memory a first personal profile for the user, the first personal profile:

comprising a duration of the alignment of the wearable head device with the pre-determined sight heading, and

identifying a relationship between the object and a movement of the user, the movement determined using the first GPS location and a second GPS location of the wearable head device at a second time later than the first time; and

determining a crowd profile associated with the object, wherein the crowd profile comprises a plurality of personal profiles comprising the first personal profile and personal profiles associated with other users, and further comprises a viewing pattern of a plurality of users comprising the user and the other users.

2 . The method of claim 1 , wherein the crowd profile further identifies a relationship between the object and a characteristic of the user.

3 . The method of claim 1 , further comprising:

determining, based on the first GPS location, whether the wearable head device is in proximity to a second object at a pre-determined second geo-spatial location; and

determining, based on the orientation of the wearable head device, whether the wearable head device is aligned with a pre-determined second sight heading associated with the second geo-spatial location,

wherein the first personal profile further comprises a duration of an alignment between the orientation of the wearable head device and the second sight heading.

4 . The method of claim 1 , further comprising capturing the image of the eye of the user via a camera of the wearable head device, wherein the viewing pattern is determined based on the image.

5 . The method of claim 4 , wherein the image of the eye of the user includes a reflection of an image displayed via the wearable head device.

6 . The method of claim 5 , wherein the image displayed via the wearable head device comprises a view of the object.

7 . The method of claim 4 , wherein the camera is disposed in line with an optical path internal to display optics of the wearable head device.

8 . The method of claim 4 , further comprising, based on the image of the eye of the user:

determining an amount of eye convergence of the user; and

determining a focal plane of the user,

wherein the viewing pattern is determined further based on the amount of eye convergence and on the focal plane.

9 . A non-transitory computer-readable medium storing instructions which, when executed by one or more processors cause the one or more processors to perform a method comprising:

receiving, via a GPS sensor of a wearable head device of a user, a first GPS location of the wearable head device at a first time;

determining, via an output of an orientation sensor of the wearable head device, an orientation of the wearable head device;

determining, based on the first GPS location, whether the wearable head device is in proximity to an object, the object at a pre-determined first geo-spatial location;

determining, based on the orientation of the wearable head device and based further on an image of an eye of the user, a level of an alignment of the wearable head device with a pre-determined sight heading associated with the first geo-spatial location;

determining, based on the level of the alignment, whether the wearable head device is aligned with the pre-determined sight heading;

in accordance with a determination that the wearable head device is in proximity to the object, and further in accordance with a determination that the wearable head device is aligned with the pre-determined sight heading, storing in a memory a first personal profile for the user, the first personal profile:

comprising a duration of the alignment of the wearable head device with the pre-determined sight heading, and

identifying a relationship between the object and a movement of the user, the movement determined using the first GPS location and a second GPS location of the wearable head device at a second time later than the first time; and

determining a crowd profile associated with the object, wherein the crowd profile comprises a plurality of personal profiles comprising the first personal profile and personal profiles associated with other users, and further comprises a viewing pattern of a plurality of users comprising the user and the other users.

10 . The non-transitory computer-readable medium of claim 9 , wherein the crowd profile further identifies a relationship between the object and a characteristic of the user.

11 . The non-transitory computer-readable medium of claim 9 , wherein the method further comprises capturing the image of the eye of the user via a camera of the wearable head device, wherein the viewing pattern is determined based on the image.

12 . The non-transitory computer-readable medium of claim 11 , wherein the image of the eye of the user includes a reflection of an image displayed via the wearable head device.

13 . The non-transitory computer-readable medium of claim 12 , wherein the image displayed via the wearable head device comprises a view of the object.

14 . The non-transitory computer-readable medium of claim 11 , wherein the camera is disposed in line with an optical path internal to display optics of the wearable head device.

15 . The non-transitory computer-readable medium of claim 14 , the method further comprising, based on the image of the eye of the user:

determining an amount of eye convergence of the user; and

determining a focal plane of the user,

wherein the viewing pattern is determined further based on the amount of eye convergence and on the focal plane.

16 . The non-transitory computer-readable medium of claim 9 , wherein the method further comprises:

determining, based on the first GPS location, whether the wearable head device is in proximity to a second object at a pre-determined second geo-spatial location; and

determining, based on the orientation of the wearable head device, whether the wearable head device is aligned with a pre-determined second sight heading associated with the second geo-spatial location,

wherein the first personal profile further comprises a duration of an alignment between the orientation of the wearable head device and the second sight heading.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2025
From: NORTRUP, EDWARD H.; BORDER, JOHN N.
To: OSTERHOUT GROUP, INC.
Reel/Frame 073063/0854 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →