IP Library › Granted Patent US 12,487,662
Granted Patent B2
US 12,487,662 · App. 18/782,474 · Granted Dec 2, 2025

Information processing device, information processing method, and program

Inventors: Atsushi Ishihara (Kanagawa, JP); Hirotake Ichikawa (Kanagawa, JP)
Assignee: SONY GROUP CORPORATION
G06F3/012G06F3/017G06T11/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,487,662
App. No.
18/782,474
Granted
Dec 2, 2025
Kind
B2
Abstract

An information processing device (TM) includes a head information acquisition unit ( 21 ), a physical information acquisition unit ( 22 ), and a display control unit ( 30 ). The head information acquisition unit ( 21 ) acquires the position and posture of a head of a user. The physical information acquisition unit ( 22 ) acquires a position and posture of a portion of a body other than the head of the user. The display control unit ( 30 ) controls display of a virtual object corresponding to the portion of the body, on the basis of a history of the position and posture of the portion of the body and on the basis of the position and posture of the head, in a period before the position and posture of the portion of the body are acquired by the physical information acquisition unit ( 21 ).

Claims (55)

1 . An information processing system comprising:

circuitry configured to:

receive a first information of a first user's position and posture from a first information processing system;

receive a second information of a first real object from the first information processing system;

control a displaying of a first avatar corresponding to the first user based on the first information in a first status;

control a displaying of a virtual object based on the second information in the first status;

receive a first failure information that indicates a failure of detecting the first real object;

control a displaying of the first avatar based on a third information of the first user's position and posture in a second status; and

stop the display of the virtual object based on the first failure information in the second status,

wherein the first real object is an object which is grasped by the first user.

2 . The information processing system according to claim 1 , wherein

the second information includes a position and posture of the first real object.

3 . The information processing system according to claim 1 , wherein

the first failure information is outputted from the first information processing system based on a duration of the failure of detecting the first real object exceeding a predetermined time.

4 . The information processing system according to claim 1 , wherein

a part of the first avatar is displayed at a default position in the second status.

5 . The information processing system according to claim 4 , wherein

the part of the first avatar corresponds to a hand of the first user.

6 . The information processing system according to claim 4 , wherein

the circuitry is further configured to control to move the part of the first avatar to the default position based on receiving a fourth information from the first information processing system.

7 . The information processing system according to claim 4 , wherein

the circuitry is further configured to control to move the part of the first avatar to the default position based on a duration of the failure of detecting the first real object exceeding a predetermined time.

8 . The information processing system according to claim 1 , wherein

the circuitry is further configured to control a displaying of a first failure notification based on the first failure information.

9 . The information processing system according to claim 8 , wherein

the first failure notification is a pop-up display.

10 . An information processing method executed by a computer, the method comprising:

receiving a first information of a first user's position and posture from a first information processing system;

receiving a second information of a first real object from the first information processing system;

displaying a first avatar corresponding to the first user based on the first information in a first status;

displaying a virtual object based on the second information in the first status;

receiving a first failure information that indicates a failure of detecting the first real object;

displaying the first avatar based on a third information of the first user's position and posture in a second status; and

stopping the display of the virtual object based on the first failure information in the second status,

wherein the first real object is an object which is grasped by the first user.

11 . The information processing method according to claim 10 , wherein

the second information includes a position and posture of the first real object.

12 . The information processing method according to claim 10 , wherein

the first failure information is outputted from the first information processing system based on a duration of the failure of detecting the first real object exceeding a predetermined time.

13 . The information processing method according to claim 10 , wherein

a part of the first avatar is displayed at a default position in the second status.

14 . The information processing method according to claim 13 , wherein

the part of the first avatar corresponds to a hand of the first user.

15 . The information processing method according to claim 13 , further comprising:

moving the part of the first avatar to the default position based on receiving a fourth information from the first information processing system.

16 . The information processing method according to claim 13 , further comprising:

moving the part of the first avatar to the default position based on a duration of the failure of detecting the first real object exceeding a predetermined time.

17 . The information processing method according to claim 10 , further comprising:

displaying a first failure notification based on the first failure information.

18 . The information processing method according to claim 17 , wherein

the first failure notification is a pop-up display.

19 . The information processing system according to claim 1 , wherein

wherein the displayed virtual object is grasped by the first user in a virtual space.

20 . The information processing system according to claim 1 , wherein

wherein the displayed virtual object is different than the displayed first avatar and the first real object is different than the first user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2024
From: ISHIHARA, ATSUSHI; ICHIKAWA, HIROTAKE
To: SONY GROUP CORPORATION
Reel/Frame 068069/0409 →
Priority Claims (1)
JP 2021-020823 · Feb 12, 2021 · national
Continuity (2)
Continuation 18270407
Related Publication 20240377881A1 · Nov 14, 2024
References Cited (11)
US 11086124B2 · Gullicksen · 2021 [cited by examiner]
US 20180299948A1 · Kikuchi · 2018 [cited by examiner]
US 20190339767A1 · Andrew · 2019 [cited by examiner]
US 20200089316A1 · Raskar · 2020 [cited by examiner]
US 20210322853A1 · Lockhart · 2021 [cited by examiner]
JP 2012526334A · 2012 [cited by applicant]
JP 2018120520A · 2018 [cited by applicant]
JP 2020004388A · 2020 [cited by applicant]
WO WO2018211798A1 · 2018 [cited by applicant]
WO WO2019212793A1 · 2018 [cited by applicant]
Azad et al., Robust Real-time Stereo-based Markerless Human Motion Capture, 2008 8th IEEE-RAS International Conference on Humanoid Robots, Dec. 1-3, 2008, pp. 700-707, XP031825335. [cited by applicant]