IP Library Granted Patent US 10,019,845
Granted Patent B2
US 10,019,845 · App. 15/410,616 · Granted Jul 10, 2018

Method and apparatus for content association and history tracking in virtual and augmented reality

Inventors: Sina Fateh (Mountain View, CA); Ron Butterworth (Sunnyvale, CA); Mohamed Nabil Hajj Chehade (Los Angeles, CA); Allen Yang Yang (Richmond, CA); Sleiman Itani (East Palo Alto, CA)
Assignee: Atheer, Inc.
G06T19/006G06F17/30309G06F17/30321G06F17/30519G06T1/20G06T1/60G06T7/70G06T2215/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,019,845
App. No.
15/410,616
Granted
Jul 10, 2018
Kind
B2
Abstract

A machine-implemented method includes establishing a virtual or augmented reality entity, and establishing a state for the entity having a state time and state properties including a state spatial arrangement. The data entity and state are stored, and are subsequently received and outputted at a time other than the state time so as to exhibit a “virtual time machine” functionality. An apparatus includes a processor, a data store, and an output. A data entity establisher, a state establisher, a storer, a data entity receiver, a state receiver, and an outputter are instantiated on the processor.

Claims (68)

1. A method comprising:

instantiating a data entity establisher comprising executable instructions on a processor, said data entity establisher being adapted to establish data entities;

instantiating a state establisher comprising executable instructions on said processor, said state establisher being adapted to establish states for said data entities;

instantiating a storer comprising executable instructions on said processor, said storer being adapted to store said data entities and said states in a data store in communication with said processor;

instantiating an outputter comprising executable instructions on said processor, said outputter being adapted to output said data entities and said states to an output in communication with said processor;

establishing a first data entity via said data entity establisher;

establishing a first state for said first data entity via said state establisher;

establishing a second state for said first data entity via said state establisher, said second state being distinct from said first state;

establishing a second data entity via said data entity establisher, said second data entity being distinct from said first data entity;

establishing a third state for said second data entity via said state establisher, said third state being distinct from said first and second states;

wherein each of said states comprises a state time and a plurality of state properties at least substantially corresponding to a respective of said data entities substantially at said state time and comprising a state spatial arrangement thereof;

wherein a first state time of said first state is substantially different from a second state time of said second state;

wherein a third state time of said third state is substantially different from said first state time of said first state;

storing said first and second data entities and said first, second, and third states in said data store via said storer;

retrieving from said data store and outputting via said outputter to at least one of an augmented reality environment and a virtual reality environment at a same output time:

a first iteration of said first data entity exhibiting at least a portion of said first state and a second iteration of said first data entity exhibiting at least a portion of said second state, said output time being substantially different from said first and second state times; and

said first iteration of said first data entity exhibiting said at least said portion of said first state and a first iteration of said second data entity exhibiting at least a portion of said third state, said output time being substantially different from said first and third state times.

2. A method comprising:

establishing a first data entity via a data entity establisher instantiated on a processor;

establishing a first state for said first data entity via a state establisher instantiated on said processor;

establishing a second state for said first data entity via said state establisher, said second state being distinct from said first state;

establishing a second data entity via said data entity establisher, said second data entity being distinct from said first data entity;

establishing a third state for said second data entity via said state establisher, said third state being distinct from said first and second states;

wherein each of said states comprises a state time and a plurality of state properties at least substantially corresponding to a respective of said data entities substantially at said state time and comprising a state spatial arrangement thereof;

wherein a first state time of said first state is substantially different from a second state time of said second state;

wherein a third state time of said third state is substantially different from said first state time of said first state;

storing said first and second data entities and said first, second, and third states in a data store in communication with said processor via a storer instantiated on said processor;

retrieving from said data store and outputting to an output in communication with said processor via an outputter instantiated on said processor at a same output time:

a first iteration of said first data entity exhibiting at least a portion of said first state and a second iteration of said first data entity exhibiting at least a portion of said second state, said output time being substantially different from said first and second state times; and

said first iteration of said first data entity exhibiting said at least said portion of said first state and a first iteration of said second data entity exhibiting at least a portion of said third state, said output time being substantially different from said first and third state times.

3. The method of claim 2 , wherein:

establishing said first and second data entities comprises selecting said first and second data entities, said first and second data entities being in existence prior to a selection thereof.

4. The method of claim 2 , wherein:

establishing said first and second data entities comprises creating said first and second data entities.

5. The method of claim 2 , wherein:

establishing said first data entity comprises generating said first data entity from a first parent entity; and

establishing said second data entity comprises generating said second data entity from a second parent entity.

6. The method of claim 5 , wherein:

said first parent entity comprises at least one of a group consisting of a physical object, a physical background, a physical environment, a physical creature, and a physical phenomenon; and

said second parent entity comprises at least one of said group consisting of said physical object, said physical background, said physical environment, said physical creature, and said physical phenomenon.

7. The method of claim 6 , wherein:

generating said first data entity from said first parent entity comprises sensing said first parent entity with a sensor in communication with said processor; and

generating said second data entity from said second parent entity comprises sensing said second parent entity with said sensor.

8. The method of claim 5 , wherein:

said first parent entity comprises at least one of a group consisting of an augmented reality object and a virtual reality object; and

said second parent entity comprises at least one of said group consisting of said augmented reality object and said virtual reality object.

9. The method of claim 2 , wherein:

at least a portion of each said state is incorporated within a respective of said data entities.

10. The method of claim 2 , wherein:

at least a portion of each said state is distinct from said data entities.

11. The method of claim 2 , wherein:

at least one of said state properties comprises an identity of a respective of said data entities.

12. The method of claim 2 , wherein:

said state spatial arrangement comprises at least one of a group consisting of an absolute position of a respective of said data entities and an absolute orientation of said respective data entity.

13. The method of claim 2 , wherein:

said state spatial arrangement comprises at least one of a group consisting of a relative position of a respective of said data entity and a relative orientation of said respective data entity.

14. The method of claim 2 , wherein:

said plurality of state properties comprises at least one of a group consisting of a still image, a video, audio, olfactory data, a 2D model, a 3D model, text, numerical data, an environmental condition, animation, resolution, frame rate, bit depth, sampling rate, color, color distribution, spectral signature, brightness, brightness distribution, reflectivity, transmissivity, absorptivity, surface texture, geometry, mobility, motion, speed, direction, acceleration, temperature, temperature distribution, composition, chemical concentration, electrical potential, electrical current, mass, mass distribution, density, density distribution, price, quantity, nutritional information, user review, presence, visibility, RFID data, barcode data, a file, executable instructions, a hyperlink, a data connection, a communication link, contents, association, creator, and system ID.

15. The method of claim 2 , wherein:

establishing said first and second data entities comprises distinguishing said first and data entities from surroundings thereof.

16. The method of claim 2 , wherein:

said first data entity comprises a graphical entity;

said second data entity comprises a second graphical entity; and

said output is a graphical display.

17. The method of claim 2 , wherein:

said processor, said data store, and said output are disposed on a head mounted display.

18. The method of claim 7 , wherein:

said processor, said data store, said output, and said sensor are disposed on a head mounted display.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2022
From: ATHEER, INC.
To: WEST TEXAS TECHNOLOGY PARTNERS, LLC
Reel/Frame 058962/0067 →
SECURITY INTEREST Recorded Nov 20, 2018
From: ATHEER, INC.
To: COTA CAPITAL MASTER FUND, L.P., AS COLLATERAL AGENT
Reel/Frame 048154/0759 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2017
From: FATEH, SINA; BUTTERWORTH, RON; CHEHADE, MOHAMED NABIL HAJJ; YANG, ALLEN YANG; ITANI, SLEIMAN
To: ATHEER, INC.
Reel/Frame 041021/0304 →
Continuity (3)
Continuation 14014296 · Aug 29, 2013
Provisional Application 61695268 · Aug 30, 2012
Related Publication 20170132844A1 · May 11, 2017