IP Library Granted Patent US 10,796,491
Granted Patent B2
US 10,796,491 · App. 16/252,706 · Granted Oct 6, 2020

Virtual work of expression within a virtual environment

Inventor: Stephen Constantinides (New York, NY)
G06T19/006G06K9/00302
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,796,491
App. No.
16/252,706
Granted
Oct 6, 2020
Kind
B2
Abstract

A system and method for displaying a virtual three-dimensional environment, including: displaying at least a portion of the virtual three-dimensional environment in a head-mounted display, where the head-mounted display includes a retinal tracking device; enabling a user to interact with the virtual three-dimensional environment; displaying a virtual representation of a written work within the virtual three-dimensional environment in the head-mounted display; enabling the user to interact with the virtual representation of the written work; tracking the user's reading position in the representation of the written work via the retinal tracking device; determining the content of the representation of the written book at the user's reading position; and modifying the virtual three-dimensional environment based at least in part on the content at the user's reading position.

Claims (49)

1. A system for displaying an environment, the system comprising:

a computer processor;

a head-mounted display including a retinal tracking device; and

a content engine executing on the computer processor and configured to:

display a virtual three-dimensional environment in the head-mounted display, wherein the virtual three-dimensional environment completely fills a field of view of a user;

enable the user to interact with the virtual three-dimensional environment;

display a virtual representation of a written work within the virtual three-dimensional environment in the head-mounted display;

enable the user to interact with the virtual representation of the written work;

track the user's reading position in the representation of the written work via the retinal tracking device;

determine the content of the representation of the written book at the user's reading position; and

modify the virtual three-dimensional environment based at least in part on the content at the user's reading position.

2. The system of claim 1 :

further comprising accessing a set of resources that provide contextual information associated with the content of the representation of the written book at the user's reading position; and

wherein modifying the virtual three-dimensional environment is based at least in part on the contextual information.

3. The system of claim 2 , wherein the set of resources comprises at least one selected from a group consisting of an Internet website, encyclopedia, research database, patent, government database, dictionary, periodical, magazine, and newspaper.

4. The system of claim 1 , wherein modifying the virtual three-dimensional environment comprises producing a visual representation of a character described in the written work, and wherein the visual representation of the character speaks at least a portion of the written work.

5. The system of claim 1 , wherein modifying the virtual three-dimensional environment comprises modifying a visual scene.

6. The system of claim 1 , wherein the virtual three-dimensional environment comprises an avatar, wherein the avatar is based on a character included in the written work.

7. The system of claim 1 , wherein the retinal tracking device comprises at least one selected from a group consisting of a camera, infrared camera, and EEG sensor.

8. The system of claim 1 , wherein the written work comprises at least one selected from a group consisting of a book, journal, work of literature, work of expression, sheet music, text document.

9. A method for displaying an environment, the method comprising:

displaying at least a portion of a virtual three-dimensional environment in a head-mounted display, wherein the head-mounted display includes a retinal tracking device;

enabling a user to interact with the virtual three-dimensional environment;

displaying a virtual representation of a written work within the virtual three-dimensional environment in the head-mounted display, wherein the virtual three-dimensional environment completely fills a field of view of the user;

enabling the user to interact with the virtual representation of the written work;

tracking the user's reading position in the representation of the written work via the retinal tracking device;

determining the content of the representation of the written book at the user's reading position; and

modifying, by a computer processor, the virtual three-dimensional environment based at least in part on the content at the user's reading position.

10. The system of claim 9 :

further comprising accessing a set of resources that provide contextual information associated with the content of the representation of the written book at the user's reading position; and

wherein modifying the virtual three-dimensional environment is based at least in part on the contextual information.

11. The system of claim 10 , wherein the set of resources comprises at least one selected from a group consisting of an Internet website, encyclopedia, research database, patent, government database, dictionary, periodical, magazine, and newspaper.

12. The system of claim 9 , wherein modifying the virtual three-dimensional environment comprises producing a visual representation of a character described in the written work, and wherein the visual representation of the character speaks at least a portion of the written work.

13. The system of claim 9 , wherein modifying the virtual three-dimensional environment comprises modifying a visual scene.

14. The system of claim 9 , wherein the virtual three-dimensional environment comprises an avatar, wherein the avatar is based on a character included in the written work.

15. The system of claim 9 , wherein the retinal tracking device comprises at least one selected from a group consisting of a camera, infrared camera, and EEG sensor.

16. The system of claim 9 , wherein the written work comprises at least one selected from a group consisting of a book, journal, work of literature, work of expression, sheet music, text document.

17. A non-transitory computer-readable storage medium comprising a plurality of instructions for displaying an environment, the plurality of instructions configured to execute on at least one computer processor to enable the at least one computer processor to:

display at least a portion of a virtual three-dimensional environment in a head-mounted display, wherein the head-mounted display includes a retinal tracking device;

enable a user to interact with the virtual three-dimensional environment, wherein the virtual three-dimensional environment completely fills a field of view of a user;

display a virtual representation of a written work within the virtual three-dimensional environment in the head-mounted display;

enable the user to interact with the virtual representation of the written work;

track the user's reading position in the representation of the written work via the retinal tracking device;

determine the content of the representation of the written book at the user's reading position; and

modify the virtual three-dimensional environment based at least in part on the content at the user's reading position.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the plurality of instructions are configured to execute on the at least one computer processor to further enable the at least one computer processor to:

access a set of resources that provide contextual information associated with the content of the representation of the written book at the user's reading position, and wherein modifying the virtual three-dimensional environment is based at least in part on the contextual information.

19. The non-transitory computer-readable storage medium of claim 17 , wherein modifying the virtual three-dimensional environment comprises producing a visual representation of a character described in the written work, and wherein the visual representation of the character speaks at least a portion of the written work.

20. The non-transitory computer-readable storage medium of claim 17 , wherein modifying the virtual three-dimensional environment comprises modifying a visual scene.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2022
From: CONSTANTINIDES, STEPHEN
To: YOU MAP INC.
Reel/Frame 059886/0155 →
Continuity (5)
Continuation 15587128 · May 4, 2017
Continuation 15007162 · Jan 26, 2016
Provisional Application 62109533 · Jan 29, 2015
Provisional Application 62107313 · Jan 23, 2015
Related Publication 20190172267A1 · Jun 6, 2019