IP Library Granted Patent US 9,460,314
Granted Patent B2
US 9,460,314 · App. 14/556,607 · Granted Oct 4, 2016

Systems and methods for providing task-based instructions

Inventors: Brian Adams Ballard (Herndon, VA); James Leighton Athey (Washington, DC); Wonjae Kim (Arlington, VA); Jeffrey Edward Jenkins (Clarksburg, MD); Edward Robert English (Falls Church, VA); Todd Richard Reily (Stoneham, MA); Michael Anthony Sciscenti (Ashburn, VA)
Assignee: APX LABS, INC.
G06F21/71A45C11/00G02B27/017G06F3/012G06F3/013G06F3/017G06F3/0482G06F3/0485G06F3/0487G06F3/04812G06F3/04842G06F3/167G06T19/006H04L12/1822H04L67/18H04M1/72569H04W4/08H04W12/08H04W76/02A45C2011/002G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,460,314
App. No.
14/556,607
Granted
Oct 4, 2016
Kind
B2
Abstract

Systems and methods allow a user to interact with an augmented reality device. In one implementation, a wearable device for providing task-based instructions to a user includes a display; a network interface; a data input device configured to capture information relating to progress of a task; and at least one processing device. The at least one processing device is configured to provide to a server system, via the network interface, the captured information relating to progress of the task; receive from the server system, via the network interface, information relating to a next step in the task; and cause the information relating to the next step in the task to be shown on the display.

Claims (48)

1. A wearable device for providing a user of the wearable device with task-based instructions, the wearable device comprising:

a display;

a network interface;

a data input device configured to capture information relating to progress of a task; and

at least one processing device configured to:

provide to a server system, via the network interface, the captured information relating to progress of the task, wherein the captured information includes an identifier of the wearable device, and the identifier is associated with at least one property of the wearable device;

receive from the server system, via the network interface, information relating to a next step in the task; and

cause the information relating to the next step in the task to be shown on the display based on the at least one property of the wearable device.

2. The wearable device of claim 1 , wherein the data input device includes an image capture device configured to acquire image data during performance of steps in the task.

3. The wearable device of claim 1 , wherein the data input device includes a voice recognition module configured to determine when the user audibly confirms completion of a task step.

4. The wearable device of claim 1 , wherein the data input device includes a button for the user to press to confirm completion of a task step.

5. The wearable device of claim 1 , wherein the network interface includes one or more of an Internet connection, a cellular connection, a WAN connection, or a LAN connection.

6. The wearable device of claim 1 , wherein the information received from the server includes a video instruction for performing the next step in the task.

7. The wearable device of claim 1 , wherein the information received from the server includes a text-based instruction for performing the next step in the task.

8. The wearable device of claim 1 , wherein the information received from the server includes a graphical-based instruction for performing the next step in the task.

9. The wearable device of claim 1 , wherein the information received from the server includes an audible instruction for performing the next step in the task.

10. The wearable device of claim 1 , wherein the server system includes an enterprise resource planning system.

11. The wearable device of claim 1 , wherein the at least one property of the wearable device is used to identify at least one of hardware and software configurations of the wearable device for the next step in the task.

12. The wearable device of claim 1 , the wearable device further comprises receiving, from a user interface, a location on the display at which to display information relating to one or more steps in the task.

13. The wearable device of claim 12 , wherein causing the information relating to the next step in the task to be shown on the display comprises causing the information relating to the next step in the task to be shown on the display at the location.

14. A method for providing a user of a wearable device with task-based instructions, the method comprising:

capturing, via a data input device of the wearable device, information relating to progress of a task;

providing to a server system, via a network interface, the captured information relating to progress of the task, wherein the captured information includes an identifier of the wearable device, and the identifier is associated with at least one property of the wearable device;

receiving from the server system, via the network interface, information relating to a next step in the task; and

causing the information relating to the next step in the task to be shown on a display of the wearable device based on the at least one property of the wearable device.

15. The method of claim 14 , wherein the data input device includes an image capture device configured to acquire image data during performance of steps in the task.

16. The method of claim 14 , wherein the data input device includes a voice recognition module configured to determine when the user audibly confirms completion of a task step.

17. The method of claim 14 , wherein the data input device includes a button for the user to press to confirm completion of a task step.

18. The method of claim 14 , further comprising using a voice recognition module to determine when the user audibly confirms completion of a task step.

19. The method of claim 14 , wherein the captured information relating to progress of the task is received via a button for the user to press to confirm completion of a task step.

20. The method of claim 14 , wherein the network interface includes one or more of an Internet connection, a cellular connection, a WAN connection, or a LAN connection.

21. The method of claim 14 , wherein the information received from the server includes a video instruction for performing the next step in the task.

22. The method of claim 14 , wherein the information received from the server includes a text-based instruction for performing the next step in the task.

23. The method of claim 14 , wherein the information received from the server includes a graphical-based instruction for performing the next step in the task.

24. The method of claim 14 , wherein the information received from the server includes an audible instruction for performing the next step in the task.

25. A non-transitory computer-readable storage medium storing program instructions executable by at least one processor to perform a method for providing a user of a wearable device with task-based instructions, the method comprising:

capturing, via a data input device of the wearable device, information relating to progress of a task;

providing to a server system, via a network interface, the captured information relating to progress of the task, wherein the captured information includes an identifier of the wearable device, and the identifier is associated with at least one property of the wearable device;

receiving from the server system, via the network interface, information relating to a next step in the task; and

causing the information relating to the next step in the task to be shown on a display of the wearable device based on the at least one property of the wearable device.

26. A wearable device for providing a user of the wearable device with task-based instructions, the wearable device comprising:

a display;

a network interface;

a data input device configured to capture information relating to progress of a task; and

at least one processing device configured to:

provide to a server system, via the network interface, the captured information relating to progress of the task, wherein the captured information includes an identifier of the wearable device, and the identifier is associated with at least one property of the wearable device;

receive from the server system, via the network interface, annotation information and information relating to a next step in the task, wherein the annotation information is associated with at least one object in an environment of the user; and

cause the information relating to the next step in the task and the annotation information to be shown on the display based on the at least one property of the wearable device.

Assignments (4)
ASSIGNEE CHANGE OF ADDRESS Recorded Nov 8, 2017
From: UPSKILL, INC.
To: UPSKILL, INC.
Reel/Frame 044396/0659 →
SECURITY INTEREST Recorded Aug 21, 2017
From: UPSKILL, INC.
To: SILICON VALLEY BANK
Reel/Frame 043340/0227 →
CHANGE OF NAME Recorded Mar 10, 2017
From: APX LABS, INC.
To: UPSKILL, INC.
Reel/Frame 041974/0942 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2015
From: BALLARD, BRIAN ADAMS; ATHEY, JAMES LEIGHTON; KIM, WONJAE; JENKINS, JEFFREY EDWARD; ENGLISH, EDWARD ROBERT; REILY, TODD RICHARD; SCISCENTI, MICHAEL ANTHONY
To: APX LABS, INC.
Reel/Frame 034876/0537 →
Continuity (4)
Provisional Application 61910419 · Dec 1, 2013
Provisional Application 61910425 · Dec 1, 2013
Provisional Application 62043759 · Aug 29, 2014
Related Publication 20150153571A1 · Jun 4, 2015