IP Library Granted Patent US 10,558,325
Granted Patent B2
US 10,558,325 · App. 14/556,593 · Granted Feb 11, 2020

Systems and methods for controlling operation of an on-board component

Inventors: James Leighton Athey (Washington, DC); Todd Richard Reily (Stoneham, MA); Michael Anthony Sciscenti (Ashburn, VA)
Assignee: Upskill, Inc.
G06F3/0482A45C11/00G02B27/0093G02B27/017G06F1/163G06F3/012G06F3/013G06F3/017G06F3/0346G06F3/0485G06F3/0487G06F3/04812G06F3/04817G06F3/04842G06F3/04883G06F3/167G06F21/71G06T19/006H04L12/1822H04L67/18H04M1/72569H04N5/2252H04N5/23293H04W4/08H04W12/08H04W76/10A45C2011/002G02B2027/014G02B2027/0138G02B2027/0141G02B2027/0178G06F3/0486G06F3/04845G06F3/04847
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,558,325
App. No.
14/556,593
Granted
Feb 11, 2020
Kind
B2
Abstract

Systems and methods allow a user to interact with an augmented reality device. In one implementation, a wearable device for controlling operation of an on-board component includes a display; at least one sensor configured to provide an output indicative of a viewing direction of a user; and at least one processing device. The at least one processing device is configured to cause at least one graphical icon associated with a control of at least one aspect of the on-board component to be shown on the display; determine, based on the output of the at least one sensor, whether the user is looking in a direction of the at least one graphical icon; and initiate the control of the at least one aspect of the on-board component when the user is determined to be looking in the direction of the at least one graphical icon.

Claims (43)

1. A wearable device for controlling operation of an on-board component, the wearable device comprising:

a display;

at least one sensor configured to provide an output indicative of a viewing direction of a user; and

at least one processing device configured to:

cause at least one graphical icon associated with a control of at least one aspect of the on-board component to be shown on the display;

cause a reticle to be displayed on the display;

move, based on an output of the at least one sensor indicating a change in the viewing direction of the user, the reticle relative to the display in a first direction corresponding to the change in the viewing direction of the user;

move the at least one graphical icon in a second direction toward the reticle as the reticle moves relative to the display in the first direction, such that the reticle intercepts a portion of the at least one graphical icon;

change, based on the reticle having intercepted the portion of the at least one graphical icon, at least one aspect of the reticle to provide a visual indication to the user that the at least one graphical icon can be selected by looking in the direction of the at least one graphical icon for a predetermined period of time;

select the at least one graphical icon when it is determined that the user has been looking in the direction of the at least one graphical icon for the predetermined period of time; and

cause the on-board component to capture an image of a field of view of the user when the at least one graphical icon is selected.

2. The wearable device of claim 1 , wherein the on-board component includes a camera.

3. The wearable device of claim 2 , wherein the at least one graphical icon is associated with a power-on function of the on-board camera.

4. The wearable device of claim 2 , wherein the at least one graphical icon is associated with an image capture function of the on-board camera.

5. The wearable device of claim 2 , wherein the at least one processing device is configured to show a menu of camera control icons on the display.

6. The wearable device of claim 5 , wherein the menu of camera control icons comprises icons associated with one or more of shutter speed, aperture, ISO, and flash.

7. The wearable device of claim 1 , wherein the at least one processing device is configured to update a position at which the at least one graphical icon is shown on the display based on the output of the at least one sensor.

8. The wearable device of claim 1 , wherein the at least one sensor is configured to provide an output indicative of the viewing direction of the user by tracking a pattern of movement of an orientation of a head of the user.

9. The wearable device of claim 1 , wherein the at least one sensor is configured to provide an output indicative of the viewing direction of the user by tracking a gaze of the user's eyes.

10. A method for controlling operation of an on-board component of a wearable device, the method comprising:

causing at least one graphical icon associated with a control of at least one aspect of the on-board component to be shown on a display of the wearable device;

causing a reticle to be displayed on the display;

moving, based on an output of at least one sensor of the wearable device indicating a change in a viewing direction of the user of the wearable device, the reticle relative to the display in a first direction corresponding to the change in the viewing direction of the user;

moving the at least one graphical icon in a second direction toward the reticle as the reticle moves relative to the display in the first direction, such that the reticle intercepts a portion of the at least one graphical icon;

changing, based on the reticle having intercepted the portion of the at least one graphical icon, at least one aspect of the reticle to provide a visual indication to the user that the at least one graphical icon can be selected by looking in the direction of the at least one graphical icon for a predetermined period of time;

selecting the at least one graphical icon when it is determined that the user has been looking in the direction of the at least one graphical icon for the predetermined period of time; and

causing the on-board component to capture an image of a field of view of the user when at least one graphical icon is selected.

11. The method of claim 10 , wherein the on-board component includes a camera.

12. The method of claim 11 , wherein the at least one graphical icon is associated with a power on function of the on-board camera.

13. The method of claim 11 , wherein the at least one graphical icon is associated with an image capture function of the on-board camera.

14. The method of claim 11 , wherein a menu of camera control icons is shown on the display.

15. The method of claim 14 , wherein the menu of camera control icons comprises icons associated with one or more of shutter speed, aperture, ISO, and flash.

16. The method of claim 10 , further comprising updating a position at which the at least one graphical icon is shown on the display based on the output of the at least one sensor.

17. The method of claim 10 , further comprising monitoring a pattern of movement of an orientation of a head of the user.

18. The method of claim 10 , further comprising monitoring a gaze of the user's eyes.

19. A non-transitory computer-readable storage medium storing program instructions executable by at least one processor to perform a method for controlling operation of an on-board component of a wearable device, the method comprising:

causing at least one graphical icon associated with a control of at least one aspect of the on-board component to be shown on a display of the wearable device;

causing a reticle to be displayed on the display;

moving, based on an output of at least one sensor of the wearable device indicating a change in a viewing direction of the user of the wearable device, the reticle relative to the display in a first direction corresponding to the change in the viewing direction of the user;

moving the at least one graphical icon in a second direction toward the reticle as the reticle moves relative to the display in the first direction, such that the reticle intercepts a portion of the at least one graphical icon;

changing, based on the reticle having intercepted the portion of the at least one graphical icon, at least one aspect of the reticle to provide a visual indication to the user that the at least one graphical icon can be selected by looking in the direction of the at least one graphical icon for a predetermined period of time;

selecting the at least one graphical icon when it is determined that the user has been looking in the direction of the at least one graphical icon for the predetermined period of time; and

causing the on-board component to capture an image of a field of view of the user when the at least one graphical icon is selected.

Assignments (4)
ASSIGNEE CHANGE OF ADDRESS Recorded Nov 8, 2017
From: UPSKILL, INC.
To: UPSKILL, INC.
Reel/Frame 044396/0713 →
SECURITY INTEREST Recorded Aug 21, 2017
From: UPSKILL, INC.
To: SILICON VALLEY BANK
Reel/Frame 043340/0227 →
CHANGE OF NAME Recorded Mar 10, 2017
From: APX LABS, INC.
To: UPSKILL, INC.
Reel/Frame 041974/0954 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2015
From: ATHEY, JAMES LEIGHTON; REILY, TODD RICHARD; SCISCENTI, MICHAEL ANTHONY
To: APX LABS, INC.
Reel/Frame 034876/0664 →
Continuity (4)
Provisional Application 61910419 · Dec 1, 2013
Provisional Application 61910425 · Dec 1, 2013
Provisional Application 62043759 · Aug 29, 2014
Related Publication 20160350971A1 · Dec 1, 2016