IP Library Granted Patent US 9,978,182
Granted Patent B2
US 9,978,182 · App. 15/198,983 · Granted May 22, 2018

Technique for more efficiently displaying text in virtual image generation system

Inventors: Ivan Li Chuen Yeoh (Fort Lauderdale, FL); Samuel A. Miller (Hollywood, FL); Randall E. Hand (Clinton, MS); Lionel Ernest Edwin (Hollywood, FL); Philip O'Connor (Miami Beach, FL); Brian David Schwab (Sunrise, FL); Spencer Lindsay (Plantation, FL)
Assignee: MAGIC LEAP, INC.
G06T19/006G02B27/0172G06F3/011G06F3/017G06F17/211G06K9/00335G06K9/00442G06K9/4661G06K9/52G06T7/20G06T7/60G06T19/00G02B2027/014G02B2027/0141G02B2027/0178G06T2207/20112G06T2219/004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,978,182
App. No.
15/198,983
Granted
May 22, 2018
Kind
B2
Abstract

A virtual image generation system and method of operating same is provided. An end user is allowed to visualize the object of interest in a three-dimensional scene. A text region is spatially associated with the object of interest. A textual message that identifies at least one characteristic of the object of interest is generated. A textual message is streamed within the text region.

Claims (40)

1. A method of operating a virtual image generation system, the method comprising:

allowing an end user to visualize an object of interest in a three-dimensional scene;

spatially associating a text region within a field of view of the user, wherein the text region is spatially associated with the object of interest;

generating a gesture reference associated with the object of interest;

generating a textual message that identifies at least one characteristic of the object of interest;

streaming the textual message within the text region;

sensing gestural commands from the end user by detecting an angular position of an anatomical part of the end user relative to a plurality of different regions of the gesture reference; and

controlling the streaming of the textual message in response to the sensed gestural commands, wherein the gesture reference is an annular ring surrounding the object of interest, and

wherein a first side of the annular ring forms one of the different regions, and

a second side of the annular ring opposite of the first side of the annular ring forms another one of the different regions.

2. The method of claim 1 , further comprising displaying the gesture reference as a gesture reference object adjacent the object of interest.

3. The method of claim 1 , wherein the anatomical part of the end user is a head of the end user.

4. The method of claim 3 , wherein the anatomical part of the end user is a finger or hand of the end user.

5. The method of claim 1 , wherein the gesture reference is separate and distinct from the object of interest.

6. The method of claim 1 , wherein the annular ring comprises a plurality of concentric rings, and an interface between two adjacent ones of the concentric rings forms one of the different regions.

7. The method of claim 6 , wherein an inner or outer edge of the annular ring forms another one of the different regions.

8. The method of claim 1 , wherein the gesture reference is the object of interest.

9. The method of claim 1 , wherein the streaming of the textual message is controlled in response to the sensed gestural commands by initiating the streaming of the textual message when the anatomical part of the end user is pointed at the one region of the gesture reference, and terminating the streaming of the textual message when the anatomical part of the end user is pointed at another different region of the gesture reference.

10. The method of claim 1 , wherein the streaming of the textual message is controlled in response to the sensed gestural commands by displaying at least one word of the textual message when the anatomical part of the end user is pointed at the one region of the gesture reference, and displaying at least another word of the textual message when the anatomical part of the end user is pointed at another different region of the gesture reference.

11. The method of claim 1 , wherein the gestural commands are sensed from the end user as the anatomical part of the end user is scanned across the gesture reference.

12. The method of claim 1 , wherein the one or more sensors are configured for sending the gestural commands from the end user as the anatomical part of the end user is scanned across the gesture reference.

13. A virtual image generation system for use by an end user, comprising: a display system configured for allowing the end user to visualize an object of interest in a three dimensional scene;

a control system configured for spatially associating a text region with a field of view of the end user, wherein the text region is spatially associated with the object of interest,

generating a gesture reference associated with the object of interest,

generating a textual message that identifies at least one characteristic of the object of interest, and

instructing the display system to stream the textual message within the text region; and

one or more sensors configured for sensing gestural commands from the end user by detecting an angular position of an anatomical part of the end user relative to a plurality of different regions of the gesture reference, wherein the control system is further configured for controlling the streaming of the textual message in response to the sensed gestural commands,

wherein the gesture reference is an annular ring surrounding the object of interest, and

wherein a first side of the annular ring forms one of the different regions, and

a second side of the annular ring opposite of the first side of the annular ring forms another one of the different regions.

14. The virtual image generation system of claim 13 , wherein the control system is further configured for instructing the display system to display the gesture reference as a gesture reference object adjacent the object of interest.

15. The virtual image generation system of claim 13 , wherein the anatomical part of the end user is a head of the end user.

16. The virtual image generation system of claim 15 , wherein the anatomical part of the end user is a finger or hand of the end user.

17. The virtual image generation system of claim 13 , wherein the gesture reference is separate and distinct from the object of interest.

18. The virtual image generation system of claim 13 , wherein the annular ring comprises a plurality of concentric rings, and an interface between two adjacent ones of the concentric rings forms one of the different regions.

19. The virtual image generation system of claim 18 , wherein an inner or outer edge of the annular ring forms another one of the different regions.

20. The virtual image generation system of claim 19 , wherein the gesture reference is the object of interest.

21. The virtual image generation system of claim 13 , wherein the control system is configured for controlling the streaming of the textual message in

response to the sensed gestural commands by instructing the display system to initiate the streaming of the textual message when the anatomical part of the end user is pointed at the one region of the gesture reference, and terminate the streaming of the textual message when the anatomical part of the end user is pointed at another different region of the gesture reference.

22. The virtual image generation system of claim 13 , wherein the control system is configured for controlling the streaming of the textual message in response to the sensed gestural commands by instructing the display system to display at least one word of the textual message when the anatomical part of the end user is pointed at the one region of the gesture reference, and display at least another word of the textual message when the anatomical part of the end user is pointed at another different region of the gesture reference.

Assignments (3)
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2018
From: YEOH, IVAN LI CHUEN; MILLER, SAMUEL A; HAND, RANDALL E.; SCHWAB, BRIAN DAVID; EDWIN, LIONEL ERNEST; O'CONNOR, PHILIP; LINDSAY, SPENCER
To: MAGIC LEAP, INC.
Reel/Frame 046021/0208 →
Continuity (2)
Provisional Application 62187062 · Jun 30, 2015
Related Publication 20170032575A1 · Feb 2, 2017