IP Library Granted Patent US 11,302,084
Granted Patent B2
US 11,302,084 · App. 17/063,635 · Granted Apr 12, 2022

Virtual work of expression within a virtual environment

Inventor: Stephen Constantinides (Baltimore, MD)
G06T19/006G06K9/00302
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,302,084
App. No.
17/063,635
Granted
Apr 12, 2022
Kind
B2
Abstract

A system and method for displaying a virtual three-dimensional environment, including: displaying at least a portion of the virtual three-dimensional environment in a head-mounted display, where the head-mounted display includes a retinal tracking device; enabling a user to interact with the virtual three-dimensional environment; displaying a virtual representation of a written work within the virtual three-dimensional environment in the head-mounted display; enabling the user to interact with the virtual representation of the written work; tracking the user's reading position in the representation of the written work via the retinal tracking device; determining the content of the representation of the written book at the user's reading position; and modifying the virtual three-dimensional environment based at least in part on the content at the user's reading position.

Claims (50)

1. A system for displaying an environment, the system comprising:

a computer processor;

a head-mounted display including a tracking device operable to track a user's reading position; and

a content engine executing on the computer processor and configured to:

display at least a portion of a virtual three-dimensional environment in the head-mounted display;

enable a user to interact with the virtual three-dimensional environment;

display a virtual representation of a written work within the virtual three-dimensional environment in the head-mounted display;

enable the user to interact with the virtual representation of the written work;

receive the user's reading position in the representation of the written work from the tracking device;

identify the content of the representation of the written book at the user's reading position; and

modify the virtual three-dimensional environment based at least in part on the content at the user's reading position, wherein modifying includes producing a visual representation of a character described in the written work, and wherein the visual representation of the character speaks at least a portion of the written work corresponding to the user's reading position.

2. The system of claim 1 , wherein:

the content engine is further configured to access a set of resources that provide contextual information associated with the content of the representation of the written book at the user's reading position; and

modifying the virtual three-dimensional environment is based at least in part on the contextual information.

3. The system of claim 2 , wherein the set of resources comprises at least one selected from a group consisting of an Internet website, encyclopedia, research database, patent, government database, dictionary, periodical, magazine, and newspaper.

4. The system of claim 1 , wherein producing the visual representation of the character includes representing the character acting in chronological sync with the content of the representation of the written book at the user's reading position.

5. The system of claim 1 , wherein the character speaks in chronological sync with the content of the representation of the written book at the user's reading position.

6. The system of claim 1 , wherein the virtual three-dimensional environment comprises an avatar, wherein the avatar is based on a character included in the written work.

7. The system of claim 1 , wherein the tracking device comprises at least one selected from a group consisting of a camera, infrared camera, and EEG sensor.

8. The system of claim 1 , wherein the written work comprises at least one selected from a group consisting of a book, journal, work of literature, work of expression, sheet music, text document.

9. A method for displaying an environment, the method comprising:

displaying at least a portion of a virtual three-dimensional environment in a head-mounted display, wherein the head-mounted display includes a tracking device operable to track a user's reading position;

enabling a user to interact with the virtual three-dimensional environment;

displaying a virtual representation of a written work within the virtual three-dimensional environment in the head-mounted display;

enabling the user to interact with the virtual representation of the written work;

receiving the user's reading position in the representation of the written work from the tracking device;

identifying the content of the representation of the written book at the user's reading position; and

modifying, by a computer processor, the virtual three-dimensional environment based at least in part on the content at the user's reading position, wherein modifying includes producing a visual representation of a character described in the written work, and wherein the visual representation of the character speaks at least a portion of the written work corresponding to the user's reading position.

10. The system of claim 9 :

further comprising accessing a set of resources that provide contextual information associated with the content of the representation of the written book at the user's reading position; and

wherein modifying the virtual three-dimensional environment is based at least in part on the contextual information.

11. The system of claim 10 , wherein the set of resources comprises at least one selected from a group consisting of an Internet website, encyclopedia, research database, patent, government database, dictionary, periodical, magazine, and newspaper.

12. The system of claim 9 , wherein producing the visual representation of the character includes representing the character acting in chronological sync with the content of the representation of the written book at the user's reading position.

13. The system of claim 9 , wherein the character speaks in chronological sync with the content of the representation of the written book at the user's reading position.

14. The system of claim 9 , wherein the virtual three-dimensional environment comprises an avatar, wherein the avatar is based on a character included in the written work.

15. The system of claim 9 , wherein the tracking device comprises at least one selected from a group consisting of a camera, infrared camera, and EEG sensor.

16. The system of claim 9 , wherein the written work comprises at least one selected from a group consisting of a book, journal, work of literature, work of expression, sheet music, text document.

17. A non-transitory computer-readable storage medium comprising a plurality of instructions for displaying an environment, the plurality of instructions configured to execute on at least one computer processor to enable the at least one computer processor to:

display at least a portion of a virtual three-dimensional environment in a head-mounted display, wherein the head-mounted display includes a tracking device operable to track a user's reading position;

enable a user to interact with the virtual three-dimensional environment;

display a virtual representation of a written work within the virtual three-dimensional environment in the head-mounted display;

enable the user to interact with the virtual representation of the written work;

receive the user's reading position in the representation of the written work from the tracking device;

identify the content of the representation of the written book at the user's reading position; and

modify the virtual three-dimensional environment based at least in part on the content at the user's reading position, wherein modifying includes producing a visual representation of a character described in the written work, and wherein the visual representation of the character speaks at least a portion of the written work corresponding to the user's reading position.

18. The non-transitory computer-readable storage medium of claim 17 , wherein:

the plurality of instructions are configured to execute on the at least one computer processor to further enable the at least one computer processor to access a set of resources that provide contextual information associated with the content of the representation of the written book at the user's reading position; and

modifying the virtual three-dimensional environment is based at least in part on the contextual information.

19. The non-transitory computer-readable storage medium of claim 17 , wherein producing the visual representation of the character includes representing the character acting in chronological sync with the content of the representation of the written book at the user's reading position.

20. The non-transitory computer-readable storage medium of claim 17 , wherein the character speaks in chronological sync with the content of the representation of the written book at the user's reading position.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2022
From: CONSTANTINIDES, STEPHEN
To: YOU MAP INC.
Reel/Frame 059886/0155 →
Continuity (6)
Continuation 16252706 · Jan 20, 2019
Continuation 15587128 · May 4, 2017
Continuation 15007162 · Jan 26, 2016
Provisional Application 62109533 · Jan 29, 2015
Provisional Application 62107313 · Jan 23, 2015
Related Publication 20210174595A1 · Jun 10, 2021