IP Library Granted Patent US 9,530,252
Granted Patent B2
US 9,530,252 · App. 15/005,530 · Granted Dec 27, 2016

Interactions of virtual objects with surfaces

Inventors: Adam G. Poulos (Sammamish, WA); Evan Michael Keibler (Bellevue, WA); Arthur Tomlin (Kirkland, WA); Cameron Brown (Redmond, WA); Daniel McCulloch (Kirkland, WA); Brian Mount (Seattle, WA); Dan Kroymann (Kirkland, WA); Gregory Lowell Alt (Seattle, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G06T19/006G02B27/017G02B27/0172G06F3/013G06F3/147G02B2027/014G02B2027/0112G02B2027/0138G02B2027/0178G02B2027/0187G09G2340/0464
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,530,252
App. No.
15/005,530
Granted
Dec 27, 2016
Kind
B2
Abstract

Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a display system. For example, one disclosed embodiment includes displaying a virtual object via the display system as free-floating, detecting a trigger to display the object as attached to a surface, and, in response to the trigger, displaying the virtual object as attached to the surface via the display system. The method may further include detecting a trigger to detach the virtual object from the surface and, in response to the trigger to detach the virtual object from the surface, detaching the virtual object from the surface and displaying the virtual object as free-floating.

Claims (38)

1. A method for operating a user interface of an augmented reality computing device comprising a display system, the method comprising:

identifying a surface via image data acquired with the augmented reality computing device;

identifying a discontinuity of the surface via the image data acquired with the augmented reality computing device;

comparing the discontinuity of the surface to a policy associated with a virtual object; and

based at least on comparing the discontinuity of the surface to the policy associated with the virtual object, displaying the virtual object entirely on one side of the discontinuity or displaying a different portion of the virtual object on each side of the discontinuity.

2. The method of claim 1 , wherein the surface is a first surface, further comprising identifying a second surface via the image data, comparing the second surface to the policy associated with the virtual object, and not displaying the virtual object as attached to the second surface based upon comparing the second surface to the policy associated with the virtual object.

3. The method of claim 1 , wherein the surface comprises a real-world surface.

4. The method of claim 1 , further comprising updating displaying of the virtual object on the display system based on a change in a location of a gaze of a user.

5. The method of claim 1 , further comprising:

detecting a trigger to detach the virtual object from the surface; and

in response to the trigger to detach the virtual object from the surface, detaching the virtual object from the surface and displaying the virtual object as free-floating.

6. The method of claim 1 , further comprising:

detecting a location of user focus on the surface; and

displaying the virtual object on the surface at a location based upon the location of user focus.

7. The method of claim 6 , further comprising detecting a change in the location of user focus and maintaining the virtual object attached at a fixed location.

8. The method of claim 6 , further comprising detecting a change in the location of user focus, and in response detaching the virtual object from the surface at the discontinuity and then reattaching the virtual object at a location past the discontinuity.

9. The method of claim 6 , further comprising detecting a change in the location of user focus, and displaying the virtual object on one side of the discontinuity or another side of the discontinuity based at least upon an angle between a direction of user focus after the change in the location and the surface meeting a threshold condition.

10. The method of claim 1 , wherein the policy specifies one or more of a color and a texture of a surface to which the virtual object can attach.

11. The method of claim 1 , wherein the policy specifies one or more of size, a location, and an orientation of a surface to which the virtual object can attach.

12. A method for operating a user interface of an augmented reality computing device comprising a see-through display system, the method comprising:

identifying a surface of a first orientation and a surface of a second, different orientation via image data acquired with the augmented reality computing device;

based at least on comparing the surface to a policy associated with the virtual object, displaying the virtual object as attached to the surface of the first orientation when the virtual object is closer than a threshold distance from the surface of the first orientation, and not displaying the virtual object as attached to the surface of the second orientation when the virtual object is closer than the threshold distance from the surface of the second orientation.

13. The method of claim 12 , wherein the policy specifies one or more of which real-world surfaces the virtual object may be attached to and under what conditions the virtual object may be attached to a real-world surface, and displaying the virtual object on the see-through display system based on the one or more policies associated with the virtual object.

14. The method of claim 12 , further comprising, after displaying the virtual object attached at the fixed location on the first real-world surface on the see-through display system, detecting a second change in location of user focus on the first real-world surface and maintaining the virtual object attached at the fixed location on the first real-world surface.

15. The method of claim 12 , further comprising:

detecting a trigger to detach the virtual object from the first real-world surface; and

in response to the trigger to detach the virtual object from the first real-world surface, detaching the virtual object from the first real-world surface and displaying the virtual object as free-floating.

16. A wearable augmented reality computing device, comprising:

a see-through display device;

a sensor system including one or more sensors;

a logic subsystem; and

a storage subsystem comprising instructions stored thereon that are executable by the logic subsystem to

identify a surface via image data acquired with the augmented reality computing device;

identify a discontinuity of the surface via the image data acquired with the augmented reality computing device

compare the discontinuity of the surface to a policy associated with a virtual object; and

based at least on comparing the discontinuity of the surface to the policy associated with the virtual object, display the virtual object entirely on one side of the discontinuity or display a different portion of the virtual object on each side of the discontinuity.

17. The device of claim 16 , wherein the policy specifies one or more of a color and a texture of a surface to which the virtual object can attach.

18. The device of claim 16 , wherein the policy specifies one or more of size, a location, and an orientation of a surface to which the virtual object can attach.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2016
From: POULOS, ADAM G.; KEIBLER, EVAN MICHAEL; TOMLIN, ARTHUR; BROWN, CAMERON; MCCULLOCH, DANIEL; MOUNT, BRIAN; KROYMANN, DAN; ALT, GREGORY LOWELL
To: MICROSOFT CORPORATION
Reel/Frame 037574/0631 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2016
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 037574/0664 →
Continuity (2)
Continuation 13893146 · May 13, 2013
Related Publication 20160155270A1 · Jun 2, 2016