IP Library Granted Patent US 10,943,382
Granted Patent B2
US 10,943,382 · App. 16/082,338 · Granted Mar 9, 2021

Virtual reality

Inventors: Elisheva Shapiro (London, GB); Martin Shenton (London, GB); Martin Echenique (London, GB); Claire Blackshaw (London, GB)
G06T13/40A63F13/211A63F13/213A63F13/215A63F13/26A63F13/428A63F13/56A63F13/87G02B27/017G02B27/0172G06F3/011G06F3/013G06F3/017G06F3/0304G06F3/0346G06F3/04815G06F3/167G06K9/00355G06T11/60G06T19/003G06T19/006G06T19/20H04N7/157A63F13/58G02B2027/014G02B2027/0141G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,943,382
App. No.
16/082,338
Granted
Mar 9, 2021
Kind
B2
Abstract

A virtual reality apparatus includes an image generator configured to generate images representing a user of a virtual environment. The image generator is responsive to selection of a predetermined input by the user. The apparatus also includes a video camera for use in image-based tracking of a user by the image generator. The predetermined input selected by the user is the performing of a predetermined physical gesture in view of the video camera. The image generator is arranged to select a respective emoji responsive to the predetermined physical gesture of the user for display to other users.

Claims (43)

1. A virtual reality apparatus comprising:

an image generator configured to generate images representing a user of a virtual environment, the image generator being responsive to selection of a predetermined input by the user; and

a video camera configured for use in image-based tracking of a user by the image generator;

in which the predetermined input selected by the user is the performing of a predetermined physical gesture in view of the video camera, and

the image generator is configured to select a respective emoji responsive to the predetermined physical gesture of the user for display to other users,

in which:

the image generator is configured to revert the emoji representing the user to a default configuration in response to one or more selected from the list consisting of:

i. elapse of a predetermined period of time; and

ii. occurrence of a predetermined event other than a user selection of a facial expression.

2. Apparatus according to claim 1 , in which:

the virtual environment includes an avatar representation of the user positioned within the virtual environment so that the user's viewpoint of the virtual environment substantially corresponds to the viewpoint of an avatar corresponding to that user; and

the image generator is configured to generate respective facial configurations of the avatar responsive to the predetermined physical gesture of the user for display to other users viewing the virtual environment.

3. Apparatus according to claim 1 , in which the predetermined input further comprises adopting a predetermined pose in view of the video camera.

4. Apparatus according to claim 1 , in which the predetermined input selected by the user corresponds to a configuration of hands of the avatar, and the image generator is configured to generate respective hand configurations of the avatar for display to other users viewing the virtual environment.

5. Apparatus according to claim 1 , in which the predetermined input selected by the user corresponds to a configuration of some or all of a body of the avatar, and the image generator is configured to generate respective body configurations of the avatar for display to other users viewing the virtual environment.

6. Apparatus according to claim 4 , in which:

each of the hand configurations corresponds to a single respective emoji.

7. Apparatus according to claim 4 , in which:

plural hand configurations correspond to a single respective emoji.

8. Apparatus according to claim 1 , in which a single predetermined input is associated with the configuration of two or more emojis, from which the selection of one configuration is in dependence upon one or more selected from the list consisting of:

i. metadata associated with the virtual environment;

ii. metadata associated with a virtual object in the virtual environment with which the user's avatar is interacting;

iii. metadata associated with another avatar with which the user's avatar is interacting; and

iv. a time of day.

9. Apparatus according to claim 1 , in which:

an object in the virtual environment is associated with emotion preference metadata indicative of an emoji; and

the image generator is responsive to interaction by the user with the object to select an emoji representing the user in accordance with the emotion preference metadata.

10. Apparatus according to claim 1 , in which the image generator is configured to generate emojis representing other users within the virtual environment.

11. Apparatus according to claim 1 , further comprising a memory adapted to store a look-up table associating a lexicon of predetermined physical gestures with a corresponding lexicon of emojis.

12. Apparatus according to any claim 1 , further comprising a head mountable display.

13. A method of generating images representing a user of a virtual environment, the method comprising:

using a video camera for image-based tracking of a user;

detecting a predetermined physical gesture performed by the user in view of the video camera; and

selecting, by an image generator, a respective emoji responsive to the predetermined physical gesture performed by the user, for display to other users,

in which:

the emoji representing the user is reverted to a default configuration in response to one or more selected from the list consisting of:

i. elapse of a predetermined period of time; and

ii. occurrence of a predetermined event other than a user selection of a facial expression.

14. A non-transitory computer-readable recording medium having computer-readable instructions stored thereon, the instructions, when executed by a computer, causing the computer to execute the method of claim 13 .

15. Apparatus according to claim 5 , in which:

each of the body configurations corresponds to a single respective emoji.

16. Apparatus according to claim 5 , in which:

plural body configurations correspond to a single respective emoji.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2020
From: SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 052167/0398 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2019
From: SHAPIRO, ELISHEVA; SHENTON, MARTIN; ECHENIQUE, MARTIN; BLACKSHAW, CLAIRE
To: SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED
Reel/Frame 050118/0372 →
Cited By (9)
US 12,405,700 US 12,406,490 US 12,462,005 US 12,542,862 US 12,602,154 US 12,619,303 US 12,619,304 US 12,619,701 US 12,645,778