IP Library Granted Patent US 9,489,774
Granted Patent B2
US 9,489,774 · App. 14/235,958 · Granted Nov 8, 2016

Three dimensional user interface in augmented reality

Inventor: Ezekiel Kruglick (Poway, CA)
Assignee: Empire Technology Development LLC
G06T19/006G06F3/04815G06F3/04842H04N13/0402G06T2200/04G06T2215/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,489,774
App. No.
14/235,958
Granted
Nov 8, 2016
Kind
B2
Abstract

Technologies are generally described for a three dimensional user interface in augmented reality. In some examples, a method for generating a virtual object in a display area may include generating a first virtual object in the display area with use of at least two viewing cones generated by a display. The method may further include receiving spatial data that relates to a location of a real object in the display area and determining that the real object is interfering with at least one of the viewing cones. The method may further include generating a second virtual object corresponding to the first virtual object. The second virtual object may be located between the display and the location of the real object.

Claims (48)

1. A method to generate a virtual object, the method comprising, by a processor:

controlling a free space three dimensional display to generate at least two first viewing cones to generate an image of a first virtual object at a first location of a display area;

receiving spatial data that relates to a second location of a real object in the display area;

determining that the real object is between the display and the first location;

determining that the real object is interfering with at least one of the first viewing cones; and

controlling the free space three dimensional display to generate at least two second viewing cones to generate an image of a second virtual object corresponding to the first virtual object at a third location of the display area, the third location being different from the first location, wherein the third location is between the display and the location of the real object.

2. The method of claim 1 , wherein the second virtual object is a two dimensional image of the first virtual object.

3. The method of claim 1 , further comprising stopping generation of the first virtual object.

4. The method of claim 1 , wherein determining that the real object is interfering with at least one of the first viewing cones includes determining an interfered visual area around the real object, where the interfered visual area includes a buffer region that surrounds the real object.

5. The method of claim 1 , wherein:

the real object interferes with an interfered area in the display area;

the first virtual object has a size larger than the interfered area; and

the second virtual object corresponds to the whole first virtual object.

6. The method of claim 1 , wherein:

the real object interferes with an interfered area in the display area;

the first virtual object has a size larger than the interfered area; and

the second virtual object corresponds to a portion of the first virtual object.

7. The method of claim 1 , wherein the real object includes one of a hand, a foot, or a finger.

8. The method of claim 1 , wherein determining that the real object is interfering with at least one of the first viewing cones includes determining that the real object is travelling along a path that would interfere with at least one of the first viewing cones.

9. The method of claim 1 , wherein:

generating the at least two second viewing cones by the display includes replacing the at least two first viewing cones used to generate the image of the first virtual object.

10. The method of claim 1 , wherein the second virtual object is the same scale as the first virtual object.

11. The method of claim 1 , wherein the second virtual object is of a scale that is either bigger or smaller than the first virtual object.

12. The method of claim 1 , wherein the generating the second virtual object includes generating an animation.

13. The method of claim 12 , wherein the animation includes at least one of compressing the first virtual object, changing a color of the first virtual object, performing a color overlay of the first virtual object, or displaying a movement of the first virtual object to the location of the second virtual object.

14. A system effective to generate a virtual object, the system comprising:

a memory;

a free space three dimensional display that includes a display area; and

a processor configured to be in communication with the memory and the display;

wherein the processor is configured to:

control the display to generate at least two first viewing cones to generate an image of a first virtual object at a first location of the display area;

receive spatial data that relates to a second location of a real object in the display area;

determine that the real object is between the display and the first location;

determine that the real object interferes with at least one of the first viewing cones; and

control the free space three dimensional display to generate at least two second viewing cones to generate an image of a second virtual object that corresponds to the first virtual object at a third location of the display area, the third location being different from the first location, wherein the third location is between the display and the location of the real object.

15. The system of claim 14 , wherein the second virtual object is a two dimensional image of the first virtual object.

16. The system of claim 14 , wherein the determination as to whether the real object interferes with at least one of the first viewing cones includes a determination of an interfered visual area around the real object, where the interfered visual area includes a buffer region that surrounds the real object.

17. The system of claim 14 , wherein the processor is further effective to generate an animation, wherein the animation includes at least one of compression of the first virtual object, change of a color of the first virtual object, performance of a color overlay of the first virtual object, or display of a movement of the first virtual object to the location of the second virtual object.

18. A system effective to generate a virtual object, the system comprising:

a memory; and

a processor configured to be in communication with the memory and the spatial detector;

wherein the processor is configured to:

generate first virtual object data, the first virtual object data effective to control a free space three dimensional display to generate at least two first viewing cones to generate an image of a first virtual object at a first location of the display area, where the first viewing cones are generated by the display;

receive spatial data that relates to a second location of a real object in the display area;

determining that the real object is between the display and the first location;

determine that the real object interferes with at least one of the first viewing cones; and

generate second virtual object data, the second virtual object data effective to control the free space three dimensional display to generate at least two second viewing cones to generate an image of a second virtual object in the display area at a third location of the display area, the third location being different from the first location, wherein the third location is between the display and the location of the real object, where the second virtual object corresponds to the first virtual object.

19. The system of claim 18 , wherein the second virtual object is a two dimensional image of the first virtual object.

Assignments (2)
RELEASE OF SECURITY INTEREST IN PATENTS, RECORDED ON JANUARY 29, 2019 AT REEL 048373 FRAME 0217 Recorded Sep 22, 2025
From: CRESTLINE DIRECT FINANCE, L.P., AS COLLATERAL AGENT
To: EMPIRE TECHNOLOGY DEVELOPMENT LLC
Reel/Frame 072936/0464 →
SECURITY INTEREST Recorded Jan 29, 2019
From: EMPIRE TECHNOLOGY DEVELOPMENT LLC
To: CRESTLINE DIRECT FINANCE, L.P.
Reel/Frame 048373/0217 →
Continuity (1)
Related Publication 20150221132A1 · Aug 6, 2015