IP Library Granted Patent US 12,693,177
Granted Patent B2
US 12,693,177 · App. 18/271,951 · Granted Jul 28, 2026

Information processing apparatus, information processing method, and program for presenting information based on a force estimated by user preparation to handle an object and a force presented to the user when the user handles the object

Inventors: Shingo Utsuki (Kanagawa, JP); Tsuyoshi Ishikawa (Kanagawa, JP); Junki Inoue (Kanagawa, JP); Takayuki Kurihara (Kanagawa, JP); Takanobu Omata (Kanagawa, JP); Shin Shiroma (Tokyo, JP); Kaoru Koike (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G01L1/005G06F3/0481
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,693,177
App. No.
18/271,951
Filed
Jul 12, 2023
Granted
Jul 28, 2026
Kind
B2
Art Unit
2855
USPC
73/763
Abstract

An information processing apparatus including circuitry configured to acquire state information of a user during a preparatory motion of the user as the user prepares to handle a tangible object, estimate, based on the acquired state information, a first amount corresponding to a magnitude of a force predicted by the user regarding the tangible object, and control presentation of information to the user based on the first amount and a second amount stored in a memory in association with a force to be presented to the user when the user handles the tangible object.

Claims (50)

1 . An information processing apparatus comprising:

circuitry configured to

acquire state information of a user during a preparatory motion of the user as the user prepares to handle a tangible object,

estimate, based on the acquired state information, a first amount corresponding to a force predicted by the user regarding the tangible object, and

control presentation of information to the user based on the first amount and a second amount stored in a memory in association with a force to be provided to the user when the user handles the tangible object.

2 . The information processing apparatus according to claim 1 ,

wherein the circuitry controls the presentation of the information to the user based on a difference that is calculated between the second amount and the first amount.

3 . The information processing apparatus according to claim 2 ,

wherein the circuitry performs control to present predetermined information to the user, based on the difference exceeding a predetermined threshold.

4 . The information processing apparatus according to claim 3 ,

wherein the circuitry performs control to display a virtual object for increasing or reducing a size of the tangible object recognized by the user, based on the difference exceeding the threshold.

5 . The information processing apparatus according to claim 3 ,

wherein the circuitry performs control to display a virtual object with brightness different from brightness of the tangible object, in at least a partial area of the tangible object in a field of view of the user, based on the difference exceeding the threshold.

6 . The information processing apparatus according to claim 3 ,

wherein the circuitry performs control to display a video depicting a motion of a subject handling the tangible object, based on the difference exceeding the threshold.

7 . The information processing apparatus according to claim 6 ,

wherein the motion of the subject is a motion in which the subject is holding the tangible object to represent a light weight or a motion in which the subject is holding the tangible object to represent a heavy weight.

8 . The information processing apparatus according to claim 3 ,

wherein the circuitry performs control to display a virtual object at a predetermined position corresponding to an area of the tangible object in a field of view of the user, based on the difference exceeding the threshold.

9 . The information processing apparatus according to claim 3 ,

wherein the circuitry performs control to present at least either predetermined text or a predetermined sound, based on the difference exceeding the threshold.

10 . The information processing apparatus according to claim 2 ,

wherein the circuitry performs control to display a virtual object whose motion corresponds to the difference.

11 . The information processing apparatus according to claim 10 ,

wherein the motion includes at least one a motion of traveling at a velocity corresponding to the difference or a motion of rebounding to a degree of rebound corresponding to the difference.

12 . The information processing apparatus according to claim 2 ,

wherein the circuitry is further configured to

adjust the second amount based on the difference, and

perform control to provide the user with a force corresponding to the adjusted second amount.

13 . The information processing apparatus according to claim 12 ,

wherein, in a case where the adjusted second amount is above a predetermined upper limit, the circuitry performs control to provide the user with force corresponding to the upper limit and performs control to display a virtual object corresponding to an amount by which the adjusted second amount exceeds the upper limit.

14 . The information processing apparatus according to claim 2 ,

wherein the circuitry is further configured to calculate the difference based on subtraction of the first amount from the second amount.

15 . The information processing apparatus according to claim 14 ,

wherein the circuitry calculates the difference based on subtraction of the first amount from the second amount to which an amount corresponding to a difficulty level of handling of the tangible object or an amount corresponding to an importance level of the tangible object has been added.

16 . The information processing apparatus according to claim 1 ,

wherein the first amount is an amount that is predicted by the user with regard to a magnitude of the force or a mass of the tangible object, and

wherein the second amount is magnitude of the force or a mass of the tangible object stored in the memory.

17 . The information processing apparatus according to claim 1 ,

wherein the state information includes posture information regarding the user.

18 . The information processing apparatus according to claim 1 ,

wherein the tangible object is a real object or a virtual object.

19 . An information processing method, executed by at least one processor, the method comprising:

acquiring state information of a user during a preparatory motion of the user as the user prepares to handle a tangible object;

estimating, based on the acquired state information, a first amount corresponding to a force predicted by the user regarding the tangible object; and

controlling presentation of information to the user based on the first amount and a second amount stored in a memory in association with a force to be provided to the user when the user handles the tangible object.

20 . A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by a computer causes the computer to function as execute a method, the method comprising:

acquiring state information of a user during a preparatory motion of the user as the user prepares to handle a tangible object;

estimating, based on the acquired state information, a first amount corresponding to a force predicted by the user regarding the tangible object; and

controlling presentation of information to the user based on the first amount and a second amount stored in a memory in association with a force to be provided to the user when the user handles the tangible object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2023
From: UTSUKI, SHINGO; ISHIKAWA, TSUYOSHI; INOUE, JUNKI; KURIHARA, TAKAYUKI; OMATA, TAKANOBU; SHIROMA, SHIN; KOIKE, KAORU
To: SONY GROUP CORPORATION
Reel/Frame 064537/0418 →
Priority Claims (1)
JP 2021-006687 · Jan 19, 2021 · national
Continuity (1)
Related Publication 20240085250A1 · Mar 14, 2024
References Cited (43)
US 4882677A · Curran · 1989 [cited by examiner]
US 4912638A · Pratt, Jr. · 1990 [cited by examiner]
US 5275045A · Johnston · 1994 [cited by examiner]
US 5348519A · Prince · 1994 [cited by examiner]
US 5498162A · Schaefer · 1996 [cited by examiner]
US 5555894A · Doyama · 1996 [cited by examiner]
US 5577981A · Jarvik · 1996 [cited by examiner]
US 5621667A · Waters · 1997 [cited by examiner]
US 5898111A · Blankenship · 1999 [cited by examiner]
US 6056671A · Marmer · 2000 [cited by examiner]
US 6706003B2 · Perrad · 2004 [cited by examiner]
US 7127376B2 · Nashner · 2006 [cited by examiner]
US 9161708B2 · Elliott · 2015 [cited by examiner]
US 9804672B2 · Anderson · 2017 [cited by examiner]
US 9868026B2 · Marcandelli · 2018 [cited by examiner]
US 9916011B1 · Berme · 2018 [cited by examiner]
US 10299738B2 · Raghavan · 2019 [cited by examiner]
US 10646153B1 · Berme · 2020 [cited by examiner]
US 11325029B2 · Nakamura · 2022 [cited by examiner]
US 11406289B2 · Elhawary · 2022 [cited by examiner]
US 11422626B2 · Ishikawa · 2022 [cited by examiner]
US 11524226B2 · Nakagawa · 2022 [cited by examiner]
US 12053890B2 · Kelch · 2024 [cited by examiner]
US 12056281B2 · Kim · 2024 [cited by examiner]
US 12130630B2 · Kasuya · 2024 [cited by examiner]
US 20040127337A1 · Nashner · 2004 [cited by examiner]
US 20070093989A1 · Nashner · 2007 [cited by examiner]
US 20090119030A1 · Fang · 2009 [cited by examiner]
US 20120303332A1 · Mangione-Smith · 2012 [cited by examiner]
US 20130286004A1 · McCulloch · 2013 [cited by examiner]
US 20160112279A1 · Kalanithi · 2016 [cited by examiner]
US 20180000407A1 · Johnson · 2018 [cited by examiner]
US 20230090384A1 · Spenninger · 2023 [cited by examiner]
CN 115586832A · 2023 [cited by examiner]
JP 2020116684A · 2020 [cited by applicant]
JP 2020124464A · 2020 [cited by applicant]
KR 20220158155A · 2022 [cited by examiner]
English Translation of CN-115586832-A (Year: 2023). [cited by examiner]
English Translation of KR-20220158155-A (Year: 2022). [cited by examiner]
Terada et al., An Analysis Method of Baggage Lifting Motion for Lower Backache Prevention, IEEJ Transactions on Electronics, Information and Systems, The Institute of Electrical Engineers of Japan, Dec. 2020, pp. 1369-1… [cited by applicant]
Taima et al., Basic study on modifying weight perception by changing the visual movement while lifting an object, IEICE Technical Report, Jun. 2013, pp. 1-6. [cited by applicant]
Yanagisawa, Computational model of the expectation effect in perception of physical properties, The Transactions of Human interface Society, 2016, pp. 309-317, vol. 18, No. 4. [cited by applicant]
Translation of Jan. 18, 2022, International Search Report issued for related PCT application No. PCT/JP2021/043338. [cited by applicant]