IP Library Granted Patent US 11,061,527
Granted Patent B2
US 11,061,527 · App. 16/817,447 · Granted Jul 13, 2021

Audible and visual operational modes for a head-mounted display device

Inventors: Christopher Iain Parkinson (Richland, WA); Sanjay Subir Jhawar (Menlo Park, CA); Stephen A. Pombo (Campbell, CA); Kenneth Lustig (Mercer Island, WA)
Assignee: REALWEAR, INC.
G06F3/0481G06F1/163G06F1/1694G06F3/011G06F3/013G06F3/0362H04R1/028H04R1/1041H04S7/304G08B3/10G08B5/36H04R1/1008H04S2400/11H04S2400/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,061,527
App. No.
16/817,447
Granted
Jul 13, 2021
Kind
B2
Abstract

The invention is directed towards wearable devices and operating wearable devices in a visual mode when a display device of the wearable device is within a line-of-sight (LOS) of a user and operating the wearable device in an audible mode when the wearable device is outside the LOS of the user. The position of the display device, relative to the user's LOS, is automatically determined. The operational mode of the wearable device is automatically transitioned when a transition of position of the display device is detected. The wearable device may be a head-mounted display (HMD) device. A visual mode provides visual-based presentations of UIs, content, information, and data, via the display device. In contrast to a visual mode, an audible mode provides audio-based presentations of UIs, content, information, and data, via one or more audible speakers included in the wearable device.

Claims (39)

1. A method for operating a computing device that presents a user interface (UI), comprising:

in response to detecting a transition in an orientation of a display of the computing device, transitioning a mode of operation of the computing device from a first mode to a second mode, wherein information presented by the UI in the first mode includes visual-based content and the information presented by the UI in the second mode excludes the visual-based content.

2. The method of claim 1 , wherein the computing device is incorporated into a wearable device, wherein the display of the computing device is arranged such that the position of the display rotates about an axis relative to a frame of the wearable device.

3. The method of claim 1 , further comprising:

receiving one or more signals generated by one or more sensors;

based on the received one or more signals, detecting a relative motion between the display and a wearable device; and

in response to detecting the relative motion between the display and the wearable device, detecting the transition in the orientation of the display.

4. The method of claim 3 , wherein the one or more sensors are position-detecting sensors and include at least one of a Hall Effect sensor, a Hall Effect switch, an optical sensor, a mechanical switch, a capacitive sensor, a conductive switch, or a magnetic switch.

5. The method of claim 1 , wherein information presented by the UI in the second mode includes audible-based content.

6. The method of claim 1 , wherein operating the computing device in the first mode includes operating a first microphone and operating the display device in the second mode includes operating a second microphone.

7. The method of claim 1 , wherein the transition in the orientation of the display causes transitioning a position of the display between a first position that is within a line-of-sight (LOS) of the user and a second position that is excluded from the LOS of the user.

8. A wearable computing device that provides a user interface (UI), comprising:

a display device;

a speaker device;

a frame configured to be worn by a user;

at least one processor device; and

at least one computer-readable storage media storing computer-useable instructions that, when executed by the at least one processor device, causes that at least one processor device to perform actions for operating the wearable computing device, wherein the actions comprise:

in response to detecting a transition in an orientation of the display device, transitioning a mode of operation of the wearable computing device from a first mode to a second mode, wherein information presented by the UI in the first mode includes visual-based content and the information presented by the UI in the second mode excludes the visual-based content.

9. The wearable computing device of claim 8 , further comprising:

a boom arm that rotatably couples the display to the frame, and wherein detecting the transition in the orientation of the display includes detecting a relative rotation between the boom arm and the frame.

10. The wearable computing device of claim 8 , further comprising one or more sensor devices and the actions further comprise:

receiving, at the one or more processor devices, one or more signals generated by the one or more sensor devices;

based on the received one or more signals, detecting a relative motion between the display and the frame; and

in response to detecting the relative motion between the display and the frame, detecting the transition in the orientation of the display.

11. The wearable computing device of claim 10 , wherein the one or more sensor devices are position-detecting sensor devices and include at least one of a Hall Effect sensor, a Hall Effect switch, an optical sensor, a mechanical switch, a capacitive sensor, a conductive switch, or a magnetic switch.

12. The wearable computing device of claim 8 , wherein information presented by the UI in the second mode includes audible-based content.

13. The device of claim 8 , wherein operating the wearable computing device in the first mode includes operating a first microphone and operating the display device in the second mode includes operating a second microphone.

14. The wearable computing device of claim 8 , wherein the transition in the orientation of the display relative to the frame causes transitioning a position of the display between a first position that is within a line-of-sight (LOS) of the user and a second position that is excluded from the LOS of the user.

15. A non-transitory computer-readable storage medium having instructions stored thereon for operating a head-mounted display (HMD) device, which presents a user interface (UI), the HMD device including a display and a frame configured to be worn on a head of a user, which, when executed by a processor of the HMD device cause the HMD device to perform actions comprising:

in response to determining a change in a position of the display relative to the frame of the HMD device, updating a mode of operation of the HMD device from a visual mode to an audio mode.

16. The computer-readable storage medium of claim 15 , wherein the HMD device further rotatably couples the display to the frame and detecting the transition in the orientation of the display comprises:

detecting a relative rotation between the display and the frame.

17. The computer-readable storage medium of claim 15 , wherein the HMD device further includes one or more sensors and the actions further comprise:

receiving one or more signals generated by the one or more sensors;

based on the received one or more signals, detecting a relative motion between the display and the frame; and

in response to detecting the relative motion between the display and the frame, detecting the transition in the orientation of the display.

18. The computer-readable storage medium of claim 17 , wherein the one or more sensors are position-detecting sensors and include at least one of a Hall Effect sensor, a Hall Effect switch, an optical sensor, a mechanical switch, a capacitive sensor, a conductive switch, or a magnetic switch.

19. The computer-readable storage medium of claim 15 , wherein information presented by the UI in the second mode includes audible-based content.

20. The computer-readable storage medium of claim 15 , wherein the transition in the orientation of the display relative to the frame causes transitioning a position of the display between a first position that is within a line-of-sight (LOS) of the user and a second position that is excluded from the LOS of the user.

Assignments (2)
SECURITY INTEREST Recorded Jun 6, 2024
From: REALWEAR, INC.
To: WESTERN ALLIANCE BANK
Reel/Frame 067646/0492 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2020
From: PARKINSON, CHRISTOPHER IAIN; JHAWAR, SANJAY SUBIR; POMBO, STEPHEN A.; LUSTIG, KENNETH
To: REALWEAR, INCORPORATED
Reel/Frame 052389/0714 →
Continuity (3)
Continuation 16420025 · May 22, 2019
Continuation 15697281 · Sep 6, 2017
Related Publication 20200225808A1 · Jul 16, 2020