IP Library Granted Patent US 10,168,791
Granted Patent B2
US 10,168,791 · App. 15/653,719 · Granted Jan 1, 2019

Extramissive spatial imaging digital eye glass apparatuses, methods and systems for virtual or augmediated vision, manipulation, creation, or interaction with objects, materials, or other entities

Inventors: Meron Gribetz (Belmont, CA); W. Steve G. Mann (Toronto, CA)
Assignee: Meta Company
G06F3/017G02B27/017G06F3/011G06F3/013G06F3/0482G06F3/04815G06F3/04842G02B2027/014G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,168,791
App. No.
15/653,719
Granted
Jan 1, 2019
Kind
B2
Abstract

A sensing and display apparatus, comprising: a first phenomenon interface configured to operatively interface with a first augmediated-reality space, and a second phenomenon interface configured to operatively interface with a second augmediated-reality space, is implemented as an extramissive spatial imaging digital eye glass.

Claims (33)

1. An apparatus, comprising:

at least one spatial imaging device;

at least one head-mounted output display;

at least one computational device communicatively coupled to the at least one spatial imaging device and at least one head mounted output display, wherein the at least one computational device is configured to execute program instructions that cause the at least one computational device to:

receive data from the at least one spatial imaging device;

determine a spatial coordinate system corresponding to the data;

provide a virtual object for display by the at least one head-mounted output display in an augmented-reality (AR) space, the virtual object occupying a space within the spatial coordinate system;

process the data to determine spatial coordinates associated with a user gesture that change dynamically over time;

determine a relationship between the spatial coordinates associated with the user gesture relative to the space occupied by the virtual object in the spatial coordinate system;

determine the relationship indicates a particular type of user manipulation of the virtual object within the AR space by a user of the apparatus; and

display a result of the indicated user manipulation of the virtual object by the at least one head-mounted output display.

2. The apparatus of claim 1 , wherein the determination of the relationship by the at least one computational device includes estimating a degree of intrusion of the user gesture with regard to the space occupied by the virtual object.

3. The apparatus of claim 2 , wherein the estimated degree of intrusion of the user gesture with regard to the space occupied by the virtual object is indicative of a particular user gesture.

4. The apparatus of claim 1 , wherein the determination of the relationship by the at least one computational device includes estimating a degree of extrusion of the user gesture with regard to the space occupied by the virtual object.

5. The apparatus of claim 4 , wherein the estimated degree of extrusion of the user gesture with regard to the space occupied by the virtual object is indicative of a particular user gesture.

6. The apparatus of claim 1 , wherein the virtual object occupies a 2-dimensional space within the spatial coordinate system and the determination of the relationship by the at least one computational device includes determining whether movement associated with the user gesture occurs substantially within the 2-dimensional space, wherein determining the user gesture occurs within the 2-dimensional space results in a different manipulation of the virtual object than the user gesture occurring outside of the 2-dimensional space.

7. The apparatus of claim 6 , wherein determination of the relationship by the at least one computational device includes determining a direction of movement of the gesture relative to the 2-dimensional space occupied by the virtual object.

8. The apparatus of claim 1 , wherein the determination of the relationship by the at least one computational device includes determining a direction of movement of the user gesture relative to the space occupied by the virtual object.

9. The apparatus of claim 1 , wherein the virtual object occupies a 2-dimensional space within the spatial coordinate system and the determination of the relationship by the at least one computational device includes determining whether movement associated with the user gesture occurs substantially along a line within the 2-dimensional space, and wherein determining the user gesture occurs along the line results in a different manipulation of the virtual object than other movement of the user gesture.

10. The apparatus of claim 1 , wherein the at least one computational device executes further program instructions that cause the at least one computational device to:

process the data to determine the location of a real-world object; wherein the space occupied by the virtual object in the spatial coordinate system corresponds to the space occupied by the real-world object in the spatial coordinate system and the determination of the relationship by the at least one computational device includes determining an amount of taction of the user gesture with regard to the real world object by an appendage of a user making the user gesture.

11. The apparatus of claim 10 , wherein the determined amount of taction the user gesture supplies to the real world object by the appendage of the user is indicative of a particular type of user gesture.

12. The apparatus of claim 1 , wherein the at least one computational device executes further program instructions that cause the at least one computational device to:

process the determined relationship to identify a particular gesture from a plurality of predetermined gestures.

13. The apparatus of claim 1 , wherein the at least one computational device executes further program instructions that cause the at least one computational device to:

determine that the relationship between the spatial coordinates associated with the user gesture relative to the space occupied by the virtual object in the spatial coordinate system indicate that the user gesture has been performed within a predefined proximity to a spatial volume associated with the virtual object.

14. The apparatus of claim 13 , wherein the determination of the relationship between the spatial coordinates associated with the user gesture relative to the spatial coordinate system occupied by the virtual object includes integrating the reciprocal displacement of a predetermined spatial volume around the virtual object with respect to the spatial coordinates associated with the user gesture.

15. The apparatus of claim 1 , wherein the at least one computational device executes further program instructions that cause the at least one computational device to:

process the data to determine a body part of a user is making the user gesture;

process the data to determine the location of a real-world object;

determine that spatial coordinates of the body part of the user indicate that the user is touching the real-world object;

determine that the touching indicates a particular type of manipulation of the virtual object within the AR space by the user; and

display a manipulation of the virtual object by the at least one head-mounted output display corresponding to the determined particular type of manipulation.

Assignments (9)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2024
From: CAMPFIRE 3D, INC.
To: QUALCOMM INCORPORATED
Reel/Frame 067209/0066 →
CHANGE OF NAME Recorded Feb 16, 2024
From: META VIEW, INC.
To: CAMPFIRE 3D, INC.
Reel/Frame 066619/0413 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2024
From: GRIBETZ, MERON; MANN, W. STEVE G.
To: META COMPANY
Reel/Frame 066440/0043 →
CHANGE OF NAME Recorded Apr 4, 2022
From: META VIEW, INC.
To: CAMPFIRE 3D, INC.
Reel/Frame 059492/0028 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT APPL. NO. 15/587,105 PREVIOUSLY RECORDED AT REEL: 047240 FRAME: 0864. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Apr 22, 2019
From: META COMPANY
To: K&L GATES LLP
Reel/Frame 048964/0953 →
RELEASE OF SECURITY INTEREST Recorded Mar 1, 2019
From: K&L GATES LLP
To: META VIEW, INC.
Reel/Frame 050110/0688 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2019
From: VENTURE LENDING & LEASING VII, INC.; VENTURE LENDING & LEASING VIII, INC.
To: META VIEW, INC.
Reel/Frame 049038/0277 →
SECURITY INTEREST Recorded Oct 16, 2018
From: META COMPANY
To: K&L GATES LLP
Reel/Frame 047240/0864 →
SECURITY INTEREST Recorded Oct 10, 2017
From: META COMPANY
To: VENTURE LENDING & LEASING VII, INC.; VENTURE LENDING & LEASING VIII, INC.
Reel/Frame 043829/0038 →
Continuity (4)
Continuation 14147199 · Jan 3, 2014
Provisional Application 61916773 · Dec 16, 2013
Provisional Application 61748468 · Jan 3, 2013
Related Publication 20180095541A1 · Apr 5, 2018
Cited By (1)
US 12,493,358