IP Library Granted Patent US 9,779,517
Granted Patent B2
US 9,779,517 · App. 14/212,525 · Granted Oct 3, 2017

Method and system for representing and interacting with augmented reality content

Inventors: Brian Adams Ballard (Herndon, VA); Jeff Jenkins (Clarksburg, MD); Edward Robert English (Falls Church, VA); Todd Richard Reily (Stoneham, MA); James Leighton Athey (Washington, DC)
Assignee: Upskill, Inc.
G06T11/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,779,517
App. No.
14/212,525
Granted
Oct 3, 2017
Kind
B2
Abstract

Systems and methods for displaying augmented reality (AR) content are disclosed. The AR device may include a display configured to display real-world content overlaid with AR content and at least one sensor configured to provide an output indicative of an orientation, location, or motion of the AR device. The system may also include a processor device configured to: cause the AR content to be shown on the display at an initial location on the display; determine a change in orientation of the AR device based on the output of the at least one sensor; and change a position of the AR content on the display to a second location on the display, wherein the change in position of the AR content from the initial location to the second location is related to the determined change in orientation of the AR device.

Claims (28)

1. An augmented reality (AR) device, comprising:

a display configured to display real-world content overlayed with AR content;

at least one sensor configured to provide an output of a movement of a head of a user on which the AR device is worn, the output being indicative of an orientation, location, or motion of the AR device; and

a processor device configured to:

cause the AR content to be shown on the display;

in response to receiving a first input from the user activating a locked mode, lock the AR content on the display such that the AR content does not move relative to the display when the head changes orientation with respect to a body of the user, wherein when the AR content becomes locked, the head is at a first orientation with respect to the body, and the AR content is at an initial location in a virtual space;

detect a change in the orientation of the head from the first orientation to a second orientation with respect to the body while the AR content is locked on the display, and as the orientation of the head changes from the first orientation to the second orientation, move the AR content from the initial location in the virtual space to a new location in the virtual space;

receive a second input from the user deactivating the locked mode after the head becomes positioned at the second orientation and after the AR content is moved to the new location in the virtual space; and

after deactivating the locked mode, fix the AR content at the new location in the virtual space such that the AR content does not move in the virtual space as the head changes orientation with respect to the body.

2. The device of claim 1 , wherein fixing the AR content at the new location in the virtual space such that the AR content does not move in the virtual space as the head changes orientation with respect to the body is configured to cause the user to perceive the AR content as fixed at the new location relative to real-world content.

3. The device of claim 1 , wherein the initial location on the display is located away from a center of a field of view of the AR device, the new location is closer to the center of the field of view of the AR device than the initial location, and moving the AR content from the initial location to the new location is caused by rotation of the head in the direction of the new location of the AR content.

4. The device of claim 1 , wherein the processor device is configured to receive information relating to a user selection of the initial location of the AR content.

5. The device of claim 4 , where selection of the initial location is facilitated by a user input device.

6. The device of claim 5 , wherein the user input device includes one or more of a mouse, pointer device, gesture recognition unit, push button device, touch sensitive surface, or voice recognition unit.

7. The device of claim 1 , wherein the processor device is configured to move the AR content within the virtual space in response to a rotational orientation change of the head.

8. The device of claim 1 , wherein the processor device is configured to activate a translation-locked viewing mode in response to receiving a user input activating the translation-locked viewing mode, in which mode the AR content does not move relative to the head when the head undergoes a translational orientation change.

9. The device of claim 1 , wherein causing the AR content to be shown is in response to a recognized glyph.

10. The device of claim 9 , wherein the AR content is shown on the display such that the AR content resides at a predetermined perceived location relative to the recognized glyph.

11. The device of claim 1 , further including a data interface configured to receive information associated with the AR content from a location remote from the AR device.

12. The device of claim 11 , wherein the data interface includes a data connection to the Internet.

13. The device of claim 11 , wherein the data interface includes a wireless transceiver device.

14. The device of claim 1 , wherein the processor device is further configured to snap the AR content to a location in physical space to make the AR content accessible to other users within a predetermined distance to the location in physical space.

15. A method of displaying augmented reality (AR) content comprising:

causing the AR content to be shown on a display associated with an AR device worn on a head of a user;

in response to receiving a first input from the user activating a locked mode, locking the AR content on the display such that the AR content does not move relative to the display when the head changes orientation with respect to a body of the user, wherein when the AR content becomes locked, the head is at a first orientation with respect to the body, and the AR content is at an initial location in a virtual space;

detecting a change in the orientation of the head from the first orientation to a second orientation with respect to the body while the AR content is locked on the display, and as the orientation of the head changes from the first orientation to the second orientation, moving the AR content from the initial location in the virtual space to a new location in the virtual space;

receiving a second input from the user deactivating the locked mode after the head becomes positioned at the second orientation and after the AR content is moved to the new location in the virtual space; and

after deactivating the locked mode, fixing the AR content at the new location in the virtual space such that the AR content does not move in the virtual space as the head changes orientation with respect to the body.

Assignments (5)
ASSIGNEE CHANGE OF ADDRESS Recorded Nov 8, 2017
From: UPSKILL, INC.
To: UPSKILL, INC.
Reel/Frame 044395/0735 →
SECURITY INTEREST Recorded Aug 21, 2017
From: UPSKILL, INC.
To: SILICON VALLEY BANK
Reel/Frame 043340/0227 →
CHANGE OF NAME Recorded Jun 28, 2017
From: APX LABS LLC
To: APX LABS INC.
Reel/Frame 043020/0107 →
CHANGE OF NAME Recorded Jun 28, 2017
From: APX LABS INC.
To: UPSKILL INC.
Reel/Frame 043020/0331 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2014
From: BALLARD, BRIAN ADAMS; JENKINS, JEFF; ENGLISH, EDWARD ROBERT; REILY, TODD RICHARD; ATHEY, JAMES LEIGHTON
To: APX LABS, LLC
Reel/Frame 033923/0177 →
Continuity (2)
Provisional Application 61798846 · Mar 15, 2013
Related Publication 20140267419A1 · Sep 18, 2014