IP Library Granted Patent US 12,477,057
Granted Patent B2
US 12,477,057 · App. 18/607,391 · Granted Nov 18, 2025

Laser projected wayfinding interface

Inventors: Imran A. Chaudhri (San Francisco, CA); Kenneth Luke Kocienda (Mill Valley, CA)
Assignee: Hewlett-Packard Development Company, L.P.
G06F3/0425G06F1/163G06F1/1694G06F3/0482
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,477,057
App. No.
18/607,391
Granted
Nov 18, 2025
Kind
B2
Abstract

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device determines a plurality of points of interest and, for each of the points of interest, a heading of that point of interest relative to the device, and a distance between that point of interest and the device. The device presents a user interface including a plurality of user interface elements arranged according to one or more curved layers. Each of the user interface elements corresponds to a different one of the points of interest. A position of each of the user interface elements relative to each of the other user interface elements in the user interface is determined based on the first data and the second data.

Claims (55)

1 . A method comprising:

determining, by an electronic device worn by a user, first data regarding a location and an orientation of the electronic device;

determining, by the electronic device, a plurality of points of interest;

determining, by the electronic device, second data regarding the points of interest, wherein the second data comprises, for each of the points of interest, a heading of that point of interest relative to the electronic device; and

projecting, by the electronic device onto a surface of the user, a two-dimensional user interface representing the points of interest,

wherein the two-dimensional user interface comprises a plurality of user interface elements projected on the surface and arranged according to one or more curved layers on the surface, each of the user interface elements corresponding to a different one of the points of interest, and

wherein a position of each of the user interface elements on the surface relative to each of the other user interface elements in the two-dimensional user interface is determined based on the first data.

2 . The method of claim 1 , wherein the two-dimensional user interface is projected onto the surface of the user using a laser projector of the electronic device.

3 . The method of claim 1 , wherein an angular position of each of the user interface elements on the one or more curved layers represents the heading of a corresponding one of the points of interest relative to the electronic device.

4 . The method of claim 3 , wherein the angular positions of the user interface elements are within a 360° angular range about an origin point.

5 . The method of claim 3 , wherein the angular positions of the user interface elements are within a pre-determined angular range about an origin point, wherein the angular range is less than 360°.

6 . The method of claim 1 , wherein the first data is determined based on at least one of:

sensor data obtained by at least one of a compass or a gyroscope of the electronic device, or

an output of a location processor of the electronic device.

7 . The method of claim 1 , wherein at least a portion of the second data is retrieved from one or more computer systems remote from the electronic device.

8 . The method of claim 1 , further comprising:

determining, based on the first data, that the orientation of the electronic device has changed, and

responsive to determining that the orientation of the electronic device has changed, modifying a position of at least one of the user interface elements in the two-dimensional user interface.

9 . The method of claim 1 , further comprising:

receiving user input indicating a selection of a first user interface element from among the plurality of user interface elements, the first user interface element representing a first point of interest from among the plurality of points of interest; and

responsive to receiving the user input, presenting third data regarding the first point of interest using the two-dimensional user interface.

10 . The method of claim 9 , wherein the third data comprises at least one of:

a telephone number associated with the first point of interest,

a physical address of the first point of interest,

instructions for navigating to the first point of interest,

a web address associated with the first point of interest,

operating hours of the first point of interest, or

media content representing the first point of interest.

11 . The method of claim 1 , further comprising:

receiving user input indicating a selection of a first user interface element from among the plurality of user interface elements, the first user interface element representing a first point of interest from among the plurality of points of interest; and

responsive to receiving the user input, causing the first point of interest to perform one or more operations.

12 . The method of claim 1 , wherein at least one of the points of interests represents a venue.

13 . The method of claim 1 , wherein at least one of the points of interests represents one or more people.

14 . The method of claim 1 , wherein at least one of the points of interests represents one or more items.

15 . The method of claim 14 , wherein the one or more items comprises a vehicle.

16 . The method of claim 14 , wherein the one or more items comprises a lighting device.

17 . The method of claim 14 , wherein the one or more items comprises a second electronic device.

18 . The method of claim 14 , wherein the one or more items comprises an appliance.

19 . The method of claim 14 , wherein the one or more items comprises a tracking device configured to be attached to an object.

20 . A wearable device, comprising:

at least one processor; and

memory storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:

determining first data regarding a location and an orientation of the wearable device;

determining a plurality of points of interest;

determining second data regarding the points of interest, wherein the second data comprises, for each of the points of interest, a heading of that point of interest relative to the wearable device; and

projecting, onto a surface of a user, a two-dimensional user interface representing the points of interest,

wherein the two-dimensional user interface comprises a plurality of user interface elements projected on the surface and arranged according to one or more curved layers on the surface, each of the user interface elements corresponding to a different one of the points of interest, and

wherein a position of each of the user interface elements on the surface relative to each of the other user interface elements in the two-dimensional user interface is determined based on the first data.

21 . One or more non-transitory computer-readable media storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:

determining first data regarding a location and an orientation of an electronic device worn by a user;

determining a plurality of points of interest;

determining second data regarding the points of interest, wherein the second data comprises, for each of the points of interest, a heading of that point of interest relative to the electronic device; and

causing a two-dimensional user interface representing the points of interest to be projected onto a surface of the user,

wherein the two-dimensional user interface comprises a plurality of user interface elements projected on the surface and arranged according to one or more curved layers on the surface, each of the user interface elements corresponding to a different one of the points of interest, and

wherein a position of each of the user interface elements on the surface relative to each of the other user interface elements in the two-dimensional user interface is determined based on the first data.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2025
From: CHAUDHRI, IMRAN A.; KOCIENDA, KENNETH LUKE
To: HUMANE, INC.
Reel/Frame 071634/0501 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2025
From: HUMANE, INC.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 071859/0448 →
Continuity (2)
Continuation 17687524 · Mar 4, 2022
Related Publication 20250291442A1 · Sep 18, 2025
References Cited (17)
US 10284753B1 · Naik · 2019 [cited by examiner]
US 11936802B2 · Chaudhri et al. · 2024 [cited by applicant]
US 20170123487A1 · Hazra et al. · 2017 [cited by applicant]
US 20170227655A1 · Kim et al. · 2017 [cited by applicant]
US 20190121522A1 · Davis · 2019 [cited by examiner]
US 20230283705A1 · Chaudhri et al. · 2023 [cited by applicant]
KR 1020160037526A · 2016 [cited by applicant]
WO WO2017062621A1 · 2017 [cited by examiner]
International Preliminary Report on Patentability in International Appln. No. PCT/US2023/014491, mailed on Sep. 19, 2024, 10 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln. No. PCT/US2023/014491, mailed on Apr. 5, 2023, 11 pages. [cited by applicant]
Kanel, “Sixth Sense Technology,” Thesis for the Bachelor Degree of Engineering in Information and Technology, Centria University of Applied Sciences, May 2014, 46 pages. [cited by applicant]
Mann et al., “Telepointer: Hands-free completely self-contained wearable visual augmented reality without headwear and without any infrastructural reliance”, IEEE Fourth International Symposium on Wearable Computers, At… [cited by applicant]
Mann, Steve “Wearable Computing: A First Step Toward Personal Imaging,” IEEE Computer, Feb. 1997, vol. 30, No. 2, pp. 25-32. [cited by applicant]
Mann, Steve, “Wearable, tetherless computer-mediated reality,” American Association of Artificial Intelligence Technical Report, Feb. 1996, pp. 62-69. [cited by applicant]
Metavision.com [online], “Sensularity with a Sixth Sense,” available on or before Apr. 7, 2015, via Internet Archive: Wayback Machine URL <http://web.archive.org/web/20170901072037/https://blog.metavision.com/professor-… [cited by applicant]
Mistry et al., “WUW—wear Ur world: a wearable gestural interface”, Proceedings of the 27th international conference Extended Abstracts on Human Factors in Computing Systems—CHI EA '09, Boston, MA, USA, Apr. 4-9, 2009, 6… [cited by applicant]
Shetty et al., “Sixth Sense Technology,” International Journal of Science and Research, Dec. 2014, vol. 3, No. 12, pp. 1068-1073. [cited by applicant]