IP Library › Granted Patent US 12,524,979
Granted Patent B2
US 12,524,979 · App. 18/550,341 · Granted Jan 13, 2026

Information processing apparatus, information processing method, and information processing system

Inventors: Yusuke Nakagawa (Tokyo, JP); Taha Moriyama (Tokyo, JP); Masanori Okazaki (Tokyo, JP); Osamu Ito (Tokyo, JP); Yohei Fukuma (Tokyo, JP); Ayumi Nakagawa (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G06T19/20G06F3/016G06T19/006G06T2219/2004G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,524,979
App. No.
18/550,341
Granted
Jan 13, 2026
Kind
B2
Abstract

There is provided an information processing apparatus including an information acquisition unit that acquires operation information concerning user operation performed a virtual object superimposed and displayed on a real space or a virtual space and a sense of force control unit that outputs, based on the operation information, via a sense-of-force device attached to a part of a body of a user, a sense of force for causing the user to recognize weight.

Claims (45)

1 . An information processing apparatus, comprising:

a processor configured to:

acquire operation information corresponding to a user operation on a virtual object, wherein the virtual object is superimposed and displayed on a one of real space or a virtual space;

acquire attribute information of the virtual object, wherein the attribute information corresponds to volume information of the virtual object;

determine a delay amount of a delay in movement of the virtual object, wherein the determination of the delay amount is based on the attribute information; and

output, based on the determined delay amount, via a sense-of-force device attached to a part of a body of a user, a sense of force that causes the user to recognize weight of the virtual object.

2 . The information processing apparatus according to claim 1 , wherein the processor is further configured to control, based on the operation information and the determined delay amount, an effect that causes the user to recognize the weight of the virtual object.

3 . The information processing apparatus according to claim 2 , wherein, as the effect, the processor is further configured to add the delay to the movement of the virtual object based on the user operation.

4 . The information processing apparatus according to claim 3 , wherein the processor is further configured to determine the delay amount of the delay based on weight information of the virtual object as the attribute information.

5 . The information processing apparatus according to claim 3 , wherein the processor is further configured to determine the delay amount of the delay based on color information of the virtual object as the attribute information.

6 . The information processing apparatus according to claim 3 , wherein the processor is further configured to:

acquire information corresponding to a state of the user operation, and

determine the delay amount of the delay based on the state of the user operation.

7 . The information processing apparatus according to claim 6 , wherein

the part of the body of the user is a hand of the user, and

the processor is further configured to acquire information corresponding to a state of an arm of the hand as the information corresponding to the state of the user operation.

8 . The information processing apparatus according to claim 3 , wherein the processor is further configured to:

acquire environment information corresponding to an environment of one of the real space or the virtual space, and

determine the delay amount of the delay based on the environment information.

9 . The information processing apparatus according to claim 3 , wherein

the processor is further configured to add, as the effect, the delay to the movement of the virtual object, and

the delay is based on application of a smoothing process to the movement of the virtual object.

10 . The information processing apparatus according to claim 3 , wherein, in a case where a load amount based on the determined delay amount of the delay exceeds a movable range of the sense-of-force device,

the processor is further configured to control a specific device that is different from the sense-of-force device and that presents a modal different from a modal presented by the sense-of-force device.

11 . The information processing apparatus according to claim 3 , wherein the processor is further configured to control, via a display device, the movement of the virtual object involving the delay.

12 . The information processing apparatus according to claim 3 , wherein the processor is further configured to present vibration to the user via one of a vibration device loaded on the sense-of-force device or an operation device held by the user.

13 . The information processing apparatus according to claim 3 , wherein the operation information includes:

operation position information indicating a relative position of the user operation to the virtual object; and

operation direction information indicating a direction of the user operation applied to the virtual object.

14 . The information processing apparatus according to claim 13 , wherein the processor is further configured to:

apply, via the sense-of-force device, a first load having a specific load amount and a direction opposite to the direction of the user operation-to the user; and

apply, via the sense-of-force device, a second load having the specific load amount and a direction opposite to the direction of the first load.

15 . The information processing apparatus according to claim 13 , wherein the processor is further configured to determine the delay amount of the delay based on the direction of the user operation.

16 . The information processing apparatus according to claim 13 , wherein the operation position information is information corresponding to a position of the part of the body of the user, which virtually comes into contact with the virtual object, with respect to the virtual object.

17 . An information processing method, comprising:

acquiring operation information corresponding to a user operation on a virtual object, wherein the virtual object is superimposed and displayed on one of a real space or a virtual space;

acquiring attribute information of the virtual object, wherein the attribute information corresponds to volume information of the virtual object;

determining a delay amount of a delay in movement of the virtual object, wherein the determination of the delay amount is based on the attribute information; and

outputting, based on the determined delay amount, via a sense-of-force device attached to a part of a body of a user, a sense of force that causes the user to recognize weight of the virtual object.

18 . An information processing system, comprising:

a processor configured to:

acquire operation information corresponding to a user operation on a virtual object, wherein the virtual object is superimposed and displayed on a real space or a virtual space;

acquire attribute information of the virtual object, wherein the attribute information corresponds to volume information of the virtual object;

determine a delay amount of a delay in movement of the virtual object, wherein the determination of the delay amount is based on the attribute information; and

output, based on the determined delay amount, via a sense-of-force device attached to a part of a body of a user, a sense of force that causes the user to recognize weight of the virtual object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2023
From: NAKAGAWA, YUSUKE; MORIYAMA, TAHA; OKAZAKI, MASANORI; ITO, OSAMU; FUKUMA, YOHEI; NAKAGAWA, AYUMI
To: SONY GROUP CORPORATION
Reel/Frame 064888/0802 →
Priority Claims (1)
JP 2021-051638 · Mar 25, 2021 · national
Continuity (1)
Related Publication 20240161438A1 · May 16, 2024
References Cited (7)
US 20170011602A1 · Brav · 2017 [cited by examiner]
JP 2001166676A · 2001 [cited by applicant]
JP 2002182817A · 2002 [cited by applicant]
JP 2011059862A · 2011 [cited by applicant]
WO 2009035100A1 · 2009 [cited by applicant]
Hirao, et al., “T-01A: Proposal and evaluation of weight sensation presentation method by visual and deep sense cross-modal”, Proceedings of the Annual Conference of the Virtual Reality Society of Japan, Sep. 27, 2017, … [cited by applicant]
International Search Report and Written Opinion of PCT Application No. PCT/JP2022/004821, issued on May 17, 2022, 10 pages of ISRWO. [cited by applicant]