IP Library Granted Patent US 10,969,861
Granted Patent B2
US 10,969,861 · App. 16/480,857 · Granted Apr 6, 2021

Image processing device, image processing method, and image system

Inventor: Yuichi Hasegawa (Tokyo, JP)
Assignee: SONY CORPORATION
G06F3/012A63F13/525A63F13/833G06F3/013G06T15/20A63F2300/8082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,969,861
App. No.
16/480,857
Granted
Apr 6, 2021
Kind
B2
Abstract

There is provided an image processing device, an image processing method, and an image system capable of reducing discomfort of a user, such as “VR sickness.” The image processing device includes: an image generation unit configured to generate an avatar viewpoint image according to a viewpoint of an avatar corresponding to a user in a virtual world as a first presentation image to be presented to the user, and generate a second presentation image different from the avatar viewpoint image in a case in which posture difference occurs between an actual posture of the user based on a result of detecting motion of the user and a posture of the avatar. The present technique is applicable, for example, to an image processing device etc. for generating an image to be displayed on a head mounted display.

Claims (40)

1. An image processing device comprising:

an image generation unit configured to generate an avatar viewpoint image according to a viewpoint of an avatar corresponding to a user in a virtual world as a first presentation image to be presented to the user, and generate a second presentation image different from the avatar viewpoint image in a case in which a posture difference occurs between an actual posture of the user based on a result of detecting motion of the user and a posture of the avatar,

wherein the actual posture and the posture of the avatar are each defined by a plurality of parameters,

wherein the first presentation image includes an image corresponding to each parameter of the plurality of parameters defining the posture of the avatar and the second presentation image includes an image not corresponding to each parameter of the plurality of parameters defining the posture of the avatar, and

wherein the image generation unit is implemented via at least one processor.

2. The image processing device according to claim 1 , wherein

the plurality of parameters include a head position and a gaze direction, and

the image generation unit generates the second presentation image different from the avatar viewpoint image in a case in which a difference in azimuth angle or elevation angle between the actual posture of the user and the posture of the avatar is equal to or greater than a first threshold.

3. The image processing device according to claim 1 , wherein

the plurality of parameters include a head position and a gaze direction, and

the image generation unit generates the second presentation image different from the avatar viewpoint image in a case in which a difference in azimuth angle or elevation angle between the actual posture of the user and the posture of the avatar is equal to or greater than a first threshold, or in a case in which a difference in a head position between the actual posture of the user and the posture of the avatar is equal to or greater than a first threshold.

4. The image processing device according to claim 1 , wherein

the second presentation image includes an image corresponding to a posture of the user.

5. The image processing device according to claim 1 , wherein

the second presentation image includes an image corresponding to a head position of the posture of the avatar and a gaze direction of a posture of the user.

6. The image processing device according to claim 1 , wherein

the second presentation image includes an image corresponding to a head position and an azimuth angle of the posture of the avatar, and an elevation angle of a posture of the user.

7. The image processing device according to claim 1 , wherein

the second presentation image includes an image corresponding to a head position and an elevation angle of the posture of the avatar, and an azimuth angle of a posture of the user.

8. The image processing device according to claim 1 , wherein

the image generation unit generates the second presentation image different from the avatar viewpoint image when a case in which the posture difference between the actual posture of the user and the posture of the avatar is equal to or greater than a first threshold occurs for a predetermined number of times or continuously for a predetermined period of time.

9. The image processing device according to claim 1 , wherein

the image generation unit further generates the second presentation image so as to gradually approach the avatar viewpoint image in a case in which the posture difference between the actual posture of the user and the posture of the avatar is within a second threshold.

10. The image processing device according to claim 1 , further comprising:

a handling unit configured to instruct an operation of the avatar corresponding to the user,

wherein the image generation unit generates the second presentation image different from the avatar viewpoint image in a case in which the posture difference occurs between the actual posture of the user and the posture of the avatar by operating the avatar in response to an instruction from the handling unit.

11. An image processing method comprising:

generating an avatar viewpoint image according to a viewpoint of an avatar corresponding to a user in a virtual world as a first presentation image to be presented to the user and generating a second presentation image different from the avatar viewpoint image in a case in which a posture difference occurs between an actual posture of the user based on a result of detecting motion of the user and a posture of the avatar;

wherein the actual posture and the posture of the avatar are each defined by a plurality of parameters, and

wherein the first presentation image includes an image corresponding to each parameter of the plurality of parameters defining the posture of the avatar and the second presentation image includes an image not corresponding to each parameter of the plurality of parameters defining the posture of the avatar.

12. An image system comprising:

an image generation unit configured to generate an avatar viewpoint image according to a viewpoint of an avatar corresponding to a user in a virtual world as a first presentation image to be presented to the user, and generate a second presentation image different from the avatar viewpoint image in a case in which a posture difference occurs between an actual posture of the user based on a result of detecting motion of the user and a posture of the avatar; and

a display configured to display the first presentation image and the second presentation image,

wherein the actual posture and the posture of the avatar are each defined by a plurality of parameters,

wherein the first presentation image includes an image corresponding to each parameter of the plurality of parameters defining the posture of the avatar and the second presentation image includes an image not corresponding to each parameter of the plurality of parameters defining the posture of the avatar, and

wherein the image generation unit is implemented via at least one processor.

13. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute an image processing method, the method comprising:

generating an avatar viewpoint image according to a viewpoint of an avatar corresponding to a user in a virtual world as a first presentation image to be presented to the user and generating a second presentation image different from the avatar viewpoint image in a case in which a posture difference occurs between an actual posture of the user based on a result of detecting motion of the user and a posture of the avatar,

wherein the actual posture and the posture of the avatar are each defined by a plurality of parameters, and

wherein the first presentation image includes an image corresponding to each parameter of the plurality of parameters defining the posture of the avatar and the second presentation image includes an image not corresponding to each parameter of the plurality of parameters defining the posture of the avatar.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2019
From: HASEGAWA, YUICHI
To: SONY CORPORATION
Reel/Frame 049869/0901 →