IP Library Granted Patent US 10,008,044
Granted Patent B2
US 10,008,044 · App. 15/390,336 · Granted Jun 26, 2018

Interactions of virtual objects with surfaces

Inventors: Adam G. Poulos (Sammamish, WA); Evan Michael Keibler (Bellevue, WA); Arthur Tomlin (Kirkland, WA); Cameron Brown (Redmond, WA); Daniel McCulloch (Kirkland, WA); Brian Mount (Seattle, WA); Dan Kroymann (Kirkland, WA); Gregory Lowell Alt (Seattle, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G06T19/006G02B27/0172G06F3/013G02B2027/0112G02B2027/0138G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,008,044
App. No.
15/390,336
Granted
Jun 26, 2018
Kind
B2
Abstract

Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a display system. For example, one disclosed embodiment includes displaying a virtual object via the display system as free-floating, detecting a trigger to display the object as attached to a surface, and, in response to the trigger, displaying the virtual object as attached to the surface via the display system. The method may further include detecting a trigger to detach the virtual object from the surface and, in response to the trigger to detach the virtual object from the surface, detaching the virtual object from the surface and displaying the virtual object as free-floating.

Claims (39)

1. A wearable augmented reality computing device, comprising:

a see-through display device;

a sensor system including one or more sensors;

a logic subsystem; and

a storage subsystem comprising instructions stored thereon that are executable by the logic subsystem to

identify a surface via image data acquired with the augmented reality computing device;

detect a condition in which a virtual object can attach to the surface, the condition comprising a color of the surface; and

based at least on detecting the condition, display the virtual object as attached to the surface.

2. The wearable augmented reality computing device of claim 1 , wherein the condition further comprises one or more of size, a location, and an orientation of a surface.

3. The wearable augmented reality computing device of claim 1 , wherein the condition further comprises a type of a surface.

4. The wearable augmented reality computing device of claim 1 , wherein the condition further comprises a transparency of a surface.

5. The wearable augmented reality computing device of claim 1 , wherein the condition further comprises an unobstructed area of a wall.

6. The wearable augmented reality computing device of claim 1 , wherein the condition further comprises a table surface.

7. The wearable augmented reality computing device of claim 1 , wherein the condition further comprises a padding space around the virtual object, and wherein the instructions executable to display the virtual object as attached to the surface are executable to display the virtual object as attached to the surface with the padding space around the virtual object.

8. The wearable augmented reality computing device of claim 1 , wherein the condition further comprises a state of the virtual object.

9. The wearable augmented reality computing device of claim 1 , wherein code defining the virtual object comprises the condition.

10. The wearable augmented reality computing device of claim 1 , wherein the condition is based at least in part on user input.

11. The wearable augmented reality computing device of claim 1 , wherein the instructions executable to display the virtual object as attached to the surface are further executable to detect a trigger to display the virtual object as attached to the surface, and display the virtual object as attached to the surface in response to the trigger based upon the condition.

12. The wearable augmented reality computing device of claim 1 , wherein the instructions are further executable to detect a trigger to detach the virtual object from the surface, and detach the virtual object from the surface in response to the trigger.

13. The wearable augmented reality computing device of claim 1 , wherein the surface is a real-world surface.

14. A wearable augmented reality computing device, comprising:

a see-through display device;

a sensor system including one or more sensors;

a logic subsystem; and

a storage subsystem comprising instructions stored thereon that are executable by the logic subsystem to

identify a surface via image data acquired with the augmented reality computing device;

detect a condition in which a virtual object can attach to the surface, the condition comprising a padding space around the virtual object; and

based at least on detecting the condition, display the virtual object as attached to the surface with the padding space around the virtual object.

15. The wearable augmented reality computing device of claim 14 , wherein the instructions executable to display the virtual object as attached to the surface are further executable to detect a trigger to display the virtual object as attached to the surface, and display the virtual object as attached to the surface in response to the trigger based upon the condition.

16. The wearable augmented reality computing device of claim 14 , wherein the condition further comprises one or more of size, a location, and an orientation of a surface.

17. The wearable augmented reality computing device of claim 14 , wherein the condition further comprises a type of a surface.

18. On an augmented reality computing device, a method, comprising:

identifying a surface via image data acquired with the augmented reality computing device;

detecting a condition in which a virtual object can attach to the surface, the condition comprising a type of a surface; and

based at least on detecting the condition, displaying the virtual object as attached to the surface.

19. The method of claim 18 , wherein the condition further comprises one or more of size, a location, and an orientation of a surface.

20. The method of claim 18 , wherein displaying the virtual object as attached to the surface comprises:

detecting a trigger to display the virtual object as attached to the surface; and

displaying the virtual object as attached to the surface in response to the trigger based upon the condition.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2016
From: POULOS, ADAM G.; KEIBLER, EVAN MICHAEL; TOMLIN, ARTHUR; BROWN, CAMERON; MCCULLOCH, DANIEL; MOUNT, BRIAN; KROYMANN, DAN; ALT, GREGORY LOWELL
To: MICROSOFT CORPORATION
Reel/Frame 040761/0361 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2016
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 040761/0383 →
Continuity (3)
Continuation 15005530 · Jan 25, 2016
Continuation 13893146 · May 13, 2013
Related Publication 20170103583A1 · Apr 13, 2017