IP Library Granted Patent US 12,475,652
Granted Patent B2
US 12,475,652 · App. 18/685,017 · Granted Nov 18, 2025

Virtual space providing device, virtual space providing method, and computer-readable storage medium

Inventors: Shin Norieda (Tokyo, JP); Kenta Fukuoka (Tokyo, JP); Yoshiyuki Tanaka (Tokyo, JP)
Assignee: NEC CORPORATION
G06T19/00G06F3/012G06F3/013G06F2203/011G06T2200/24G06T2219/024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,475,652
App. No.
18/685,017
Granted
Nov 18, 2025
Kind
B2
Abstract

Provided are a virtual space provision device and the like capable of more accurately estimating the line of sight of a user who uses an avatar to use a virtual space. A virtual space provision device according to an embodiment of the present disclosure is provided with: a detection unit that detects the orientation of an avatar in a virtual space, the orientation of the avatar changing in response to a user's operation; an output control unit that performs control to output, to the user, an output image which corresponds to the orientation of the avatar in the virtual space, and in which the display mode of the outside of a prescribed region has been changed; and an estimation unit that estimates the line of sight of the user on the basis of the prescribed region in the output image.

Claims (49)

1 . A virtual space providing device comprising:

one or more memories storing instructions; and

one or more processors configured to execute the instructions to:

detect a direction of an avatar in a virtual space, the direction of which changes according to an operation of a user;

control a display to output an image, according to the direction of the avatar in the virtual space, in which a first portion of the image that is outside of a predetermined range is changed to a different shade of color than a second portion of the image that is inside the predetermined range,

wherein the first portion of the image is changed to a lighter shade of color than the second portion of the image.

2 . The virtual space providing device according to claim 1 ,

wherein the one or more processors are configured to execute the instructions to perform control to output to the user the image in which the outside of the predetermined range is blurred.

3 . The virtual space providing device according to claim 1 ,

wherein, when a plurality of objects are included in the predetermined range, the one or more processors estimate that a line of sight of the user is directed to an object closer to a center of the predetermined range.

4 . The virtual space providing device according to claim 1 ,

wherein the one or more processors are configured to further execute the instructions to:

generate, as the image, an image from a viewpoint of the avatar in which a display mode of the outside of the predetermined range has been changed; and

transmit the generated image to a display device used by the user.

5 . The virtual space providing device according to claim 4 ,

wherein, when an object appears within a predetermined distance from a center of the predetermined range and the object appearing within the predetermined distance also appears outside the predetermined range, the one or more processors generate the image in which a display mode of a range not including the object appearing within the predetermined distance and outside the predetermined range has been changed.

6 . The virtual space providing device according to claim 1

wherein the one or more processors are configured to further execute the instructions to receive setting of at least one of a position, a size, and a shape of the predetermined range.

7 . The virtual space providing device according to claim 1 ,

wherein, when a cursor indicated by the user operating a device is located inside the predetermined range, the one or more processors estimate that the user is facing an object pointed to by the cursor.

8 . The virtual space providing device according to claim 1

wherein the one or more processors are configured to further execute the instructions to estimate the user's emotion for an object appearing in the predetermined range based on a captured image that is captured by an imaging device and in which the user appears.

9 . The virtual space providing device according to claim 1 ,

wherein the predetermined range is a range including a center of the image.

10 . A virtual space providing method comprising:

by a computer,

detecting a direction of an avatar in a virtual space, the direction of which changes according to an operation of a user;

controlling a display to output an image, according to the direction of the avatar in the virtual space, in which a first portion of the image that is outside of a predetermined range is changed to a different shade of color than a second portion of the image that is inside the predetermined range,

wherein the first portion of the image is changed to a lighter shade of color than the second portion of the image.

11 . The virtual space providing method according to claim 10 ,

wherein, in the performing of control, the image in which the outside of the predetermined range is blurred is controlled to be output to the user.

12 . The virtual space providing method according to claim 10 ,

wherein, in the estimating of the user's line of sight, when a plurality of objects are included in the predetermined range, it is estimated that a line of sight of the user is directed to an object closer to a center of the predetermined range.

13 . The virtual space providing method according to claim 10 ,

wherein, the performing of control includes:

generating, as the image, an image from a viewpoint of the avatar in which a display mode of the outside of the predetermined range has been changed; and

transmitting the generated image to a display device used by the user.

14 . The virtual space providing method according to claim 13 ,

wherein, in the generating, when an object appears within a predetermined distance from a center of the predetermined range and the object appearing within the predetermined distance also appears outside the predetermined range, the image in which a display mode of a range not including the object appearing within the predetermined distance and outside the predetermined range has been changed is generated.

15 . The virtual space providing method according to claim 10 , further comprising:

receiving setting of at least one of a position, a size, and a shape of the predetermined range.

16 . The virtual space providing method according to claim 10 ,

wherein, in the estimating of the user's line of sight, when a cursor indicated by the user operating a device is located inside the predetermined range, it is estimated that the user is facing an object pointed to by the cursor.

17 . The virtual space providing method according to claim 10 , further comprising:

estimating the user's emotion for an object appearing in the predetermined range based on a captured image that is captured by an imaging device and in which the user appears.

18 . A non-transitory computer-readable storage medium storing a program causing a computer to execute:

processing for detecting a direction of an avatar in a virtual space, the direction of which changes according to an operation of a user;

processing for controlling a display to output an image, according to the direction of the avatar in the virtual space, in which a first portion of the image that is outside of a predetermined range is changed to a different shade of color than a second portion of the image that is inside the predetermined range,

wherein the first portion of the image is changed to a lighter shade of color than the second portion of the image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2024
From: NORIEDA, SHIN; FUKUOKA, KENTA; TANAKA, YOSHIYUKI
To: NEC CORPORATION
Reel/Frame 066500/0576 →
Continuity (1)
Related Publication 20250131654A1 · Apr 24, 2025
References Cited (23)
US 10719127B1 · Keith · 2020 [cited by examiner]
US 20090015679A1 · Hayakawa · 2009 [cited by examiner]
US 20110190059A1 · Otani · 2011 [cited by examiner]
US 20120272179A1 · Stafford · 2012 [cited by examiner]
US 20180061084A1 · Mitchell · 2018 [cited by examiner]
US 20180188534A1 · Stafford · 2018 [cited by examiner]
US 20180373328A1 · Sawaki · 2018 [cited by examiner]
US 20220237849A1 · Lindh · 2022 [cited by examiner]
JP 2005018212A · 2005 [cited by applicant]
JP 2009123001A · 2009 [cited by applicant]
JP 2019128683A · 2019 [cited by applicant]
JP 2019193697A · 2019 [cited by applicant]
JP 2020004060A · 2020 [cited by applicant]
JP 2021021889A · 2021 [cited by applicant]
JP 2021507355A · 2021 [cited by applicant]
WO 2020217326A1 · 2020 [cited by applicant]
WO 2020250377A1 · 2020 [cited by applicant]
WO 2021153577A1 · 2021 [cited by applicant]
International Search Report for PCT Application No. PCT/JP2021/032507, mailed on Oct. 19, 2021. [cited by applicant]
English translation of Written opinion for PCT Application No. PCT/JP2021/032507, mailed on Oct. 19, 2021. [cited by applicant]
Kaoru Tanaka, visual information tracking system using HMD with limited field of view, [online], 2002, pp. 257 to 266, https://www.jstage.jst.go.jp/article/tvrsj/7/2/7_KJ00007553778/_article/-char/ja/, [Search date: Oct… [cited by applicant]
JP Office Action for JP Application No. 2023-544953, mailed on Mar. 18, 2025 with English Translation. [cited by applicant]
Matsumura et al., “Team Sports Situation Grasping Skill Fostering Support System by Eye Movement Detection Using AR and HMD”, Proceedings of the 80th National Convention of the Information Processing Society of Japan, M… [cited by applicant]