IP Library › Granted Patent US 12,632,105
Granted Patent B2
US 12,632,105 · App. 18/838,242 · Granted May 19, 2026

Information processing apparatus, information processing method, and information processing program

Inventors: Naofumi Fukasawa (Tokyo, JP); Yasutaka Fukumoto (Tokyo, JP); Tetsuro Sato (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G06F3/011A61B5/0077A61B5/1116A61B5/1128G06T7/251G06T7/75G06T11/00A61B2562/0219G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,632,105
App. No.
18/838,242
Granted
May 19, 2026
Kind
B2
Abstract

An information processing apparatus ( 100 ) according to an embodiment of the present disclosure includes: a first acquisition unit configured to acquire, from an inertial sensor attached to a moving body, inertial information associated with a movement of the moving body; a second acquisition unit configured to acquire first image information obtained by imaging the moving body from a first camera; and a calculation unit configured to calculate third posture information on the basis of first posture information of the moving body obtained on the basis of the inertial information acquired by the first acquisition unit and second posture information of the moving body obtained on the basis of the first image information acquired by the second acquisition unit.

Claims (60)

1 . An information processing method comprising:

receiving, from at least one inertial sensor attached to a moving body, first posture information associated with a movement of the moving body;

receiving second posture information obtained by capturing at least one image of the moving body; and

calculating third posture information based on

the first posture information of the moving body, and

the second posture information of the moving body,

wherein the third posture information is calculated using a combination of the first posture information and the second posture information.

2 . The information processing method according to claim 1 ,

wherein the moving body includes a human or an animal.

3 . The information processing method according to claim 1 ,

wherein the third posture information is calculated by correcting the first posture information based on the second posture information.

4 . The information processing method according to claim 1 , further comprising:

controlling a display to display an avatar corresponding to the movement of the moving body based on the third posture information.

5 . The information processing method according to claim 4 , further comprising:

performing, in a case of detecting contact of at least one part of the moving body with a target object based on the at least one image, display control of the avatar in response to the detected contact.

6 . The information processing method according to claim 4 , further comprising:

detecting expression information of the moving body based on the at least one image; and

performing display control of the avatar based on the detected expression information.

7 . The information processing method according to claim 4 , further comprising:

detecting finger information of the moving body based on the at least one image; and

performing display control of the avatar based on the detected finger information.

8 . The information processing method according to claim 1 ,

wherein a number of the at least one inertial sensor is six.

9 . The information processing method according to claim 8 ,

wherein one inertial sensor is configured to be attached to a waist of the moving body, two inertial sensors are configured to be attached to wrists of the moving body, two inertial sensors are configured to be attached to ankles of the moving body, and one inertial sensor is configured to be attached to a head of the moving body.

10 . The information processing method according to claim 1 ,

wherein a number of the at least one inertial sensor is twelve.

11 . The information processing method according to claim 1 , further comprising:

controlling a display to display an avatar to which the calculated third posture information is applied.

12 . The information processing method according to claim 1 , further comprising:

controlling a display to display an image of the moving body captured by a camera; and

controlling the display to display skeletal information superimposed on the captured image of the moving body.

13 . The information processing method according to claim 1 , further comprising:

controlling capture of an upright posture of the moving body during a calibration process.

14 . The information processing method according to claim 13 ,

wherein the moving body is required to walk at least one step toward to the camera during the calibration process.

15 . An information processing system comprising:

circuitry configured to

receive, from at least one inertial sensor attached to a moving body, first posture information associated with a movement of the moving body,

receive second posture information obtained by capturing at least one image of the moving body, and

calculate third posture information based on

the first posture information of the moving body, and

the second posture information of the moving body,

wherein the circuitry calculates the third posture information using a combination of the first posture information and the second posture information.

16 . A non-transitory computer-readable storage medium having embodied thereon an information processing program, which when executed by a computer causes the computer to execute a method, the method comprising:

receiving, from at least one inertial sensor attached to a moving body, first posture information associated with a movement of the moving body;

receiving second posture information obtained by capturing at least one image of the moving body; and

calculating third posture information based on

the first posture information of the moving body, and

the second posture information of the moving body,

wherein the third posture information is calculated using a combination of the first posture information and the second posture information.

17 . The non-transitory computer-readable storage medium according to claim 16 , wherein the method further comprises:

controlling a display to display an avatar to which the calculated third posture information is applied.

18 . The non-transitory computer-readable storage medium according to claim 16 , wherein the method further comprises:

controlling a display to display an image of the moving body captured by a camera; and

controlling the display to display skeletal information superimposed on the captured image of the moving body.

19 . The non-transitory computer-readable storage medium according to claim 16 , wherein the method further comprises:

controlling capture of an upright posture of the moving body during a calibration process.

20 . The non-transitory computer-readable storage medium according to claim 16 ,

wherein the moving body is required to walk at least one step toward to the camera during the calibration process.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2024
From: FUKASAWA, NAOFUMI; FUKUMOTO, YASUTAKA; SATO, TETSURO
To: SONY GROUP CORPORATION
Reel/Frame 068274/0041 →
Priority Claims (1)
JP 2022-041155 · Mar 16, 2022 · national
Continuity (1)
Related Publication 20250147576A1 · May 8, 2025
References Cited (11)
US 10139914B2 · Elangovan · 2018 [cited by applicant]
US 20100164862A1 · Sullivan · 2010 [cited by applicant]
US 20150339026A1 · Phang · 2015 [cited by examiner]
US 20160049011A1 · Kasahara · 2016 [cited by examiner]
US 20160360970A1 · Tzvieli · 2016 [cited by examiner]
US 20200364447A1 · Nishiyama · 2020 [cited by applicant]
US 20210263333A1 · Amano · 2021 [cited by examiner]
US 20220066544A1 · Kwon · 2022 [cited by examiner]
US 20250216931A1 · Butcher · 2025 [cited by examiner]
JP 2003106812A · 2003 [cited by applicant]
WO WO2019203188A1 · 2019 [cited by applicant]