IP Library › Granted Patent US 11,361,497
Granted Patent B2
US 11,361,497 · App. 16/606,391 · Granted Jun 14, 2022

Information processing device and information processing method

Inventors: Tsuyoshi Ishikawa (Kanagawa, JP); Kei Takahashi (Tokyo, JP)
Assignee: SONY CORPORATION
G06T15/20G06F3/011G06F3/165H04S7/303H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,361,497
App. No.
16/606,391
Granted
Jun 14, 2022
Kind
B2
Abstract

An information processing device and an information processing method are provided. The information processing device including a display controller that controls display for a first user on the basis of a background image arranged in a virtual space with reference to a position of the first user in the virtual space, and an object related to a second user arranged in the virtual space so as to maintain a relative positional relationship between the first user and the second user in the virtual space.

Claims (41)

1. An information processing device, comprising:

a display controller configured to:

arrange a background image in a virtual space with reference to a position of a first user in the virtual space;

arrange an object related to a second user in the virtual space so as to maintain a relative positional relationship between the first user and the second user in the virtual space;

control, based on a pointing operation of the first user towards a specific position in the background image, a posture of the object related to the second user such that the object related to the second user faces towards the specific position in the background image; and

control a display operation of a display screen based on the background image and the posture of the object related to the second user.

2. The information processing device according to claim 1 , wherein the display controller is further configured to:

generate a field of view image from a viewpoint,

wherein the viewpoint is in a position corresponding to the position of the first user in the virtual space; and

control the display screen to display the field of view image.

3. The information processing device according to claim 2 , wherein the background image is arranged such that the position of the viewpoint is a specific viewing position.

4. The information processing device according to claim 2 , wherein the display controller is further configured to control a direction of the viewpoint based on an orientation of the first user.

5. The information processing device according to claim 1 , wherein the display controller is further configured to control the display screen to display a message sent by the second user.

6. The information processing device according to claim 1 , further comprising a sound output controller configured to control sound output of a message sent by the second user.

7. The information processing device according to claim 6 , wherein the sound output controller is further configured to control the sound output such that the message is audible from a position of the object related to the second user.

8. The information processing device according to claim 5 , wherein the display controller is further configured to control, in a case where the second user sends the message to the first user, the display screen to emphasize the object related to the second user.

9. The information processing device according to claim 1 , wherein the display controller is further configured to control the display operation based on an object related to the first user.

10. The information processing device according to claim 1 , wherein the display controller is further configured to control, based on user information, an object related to the first user corresponding to the user information.

11. The information processing device according to claim 10 , wherein

the user information includes posture information regarding a posture of each of the first user and the second user, and

the display controller is further configured to control, based on the posture information, a posture of the object related to the first user.

12. The information processing device according to claim 11 , wherein, in a case where the posture information regarding the posture of the second user satisfies a specific condition, the display controller is further configured to control the posture of the object related to the second user based on the background image arranged in the virtual space.

13. The information processing device according to claim 10 , wherein the display controller is further configured to control, based on past user information, the display screen to display the object related to the second user.

14. The information processing device according to claim 13 , wherein the display controller is further configured to control, based on real-time user information, the display screen to display the object related to the first user such that the object related to the first user is distinguished from the object related to the second user.

15. The information processing device according to claim 13 , wherein the relative positional relationship between the first user and the second user is identified based on the past user information.

16. The information processing device according to claim 1 , wherein the relative positional relationship between the first user and the second user changes based on a positional movement of at least one of the first user or the second user.

17. The information processing device according to claim 1 , wherein the display controller is further configured to:

generate a bird's-eye view image from a viewpoint,

wherein the viewpoint is in a specific bird's-eye view position in the virtual space; and

control the display screen to display the bird's-eye view image.

18. The information processing device according to claim 1 , wherein the display screen is in a device wearable by the first user.

19. An information processing method, comprising:

arranging, by a processor, a background image in a virtual space with reference to a position of a first user in the virtual space;

arranging, by the processor, an object related to a second user in the virtual space so as to maintain a relative positional relationship between the first user and the second user in the virtual space;

controlling, by the processor, based on a pointing operation of the first user towards a specific position in the background image, a posture of the object related to the second user such that the object related to the second user faces towards the specific position in the background image; and

controlling, by the processor, a display operation of a display screen based on the background image and the posture of the object related to the second user.

20. A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by a processor, cause the processor to execute operations, the operations comprising:

arranging a background image in a virtual space with reference to a position of a first user in the virtual space;

arranging an object related to a second user in the virtual space so as to maintain a relative positional relationship between the first user and the second user in the virtual space;

controlling, based on a pointing operation of the first user towards a specific position in the background image, a posture of the object related to the second user such that the object related to the second user faces towards the specific position in the background image; and

controlling a display operation of a display screen based on the background image and the posture of the object related to the second user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 18, 2019
From: ISHIKAWA, TSUYOSHI; TAKAHASHI, KEI
To: SONY CORPORATION
Reel/Frame 050767/0544 →
Priority Claims (1)
JP JP2017-102868 · May 24, 2017 · national
Continuity (1)
Related Publication 20210110596A1 · Apr 15, 2021
Cited By (1)
US 12,705,779