IP Library Granted Patent US 11,983,962
Granted Patent B2
US 11,983,962 · App. 17/691,285 · Granted May 14, 2024

Information processing apparatus, and method

Inventors: Sachiko Yamagishi (Tokyo, JP); Kenjiro Kobayashi (Tokyo, JP)
Assignee: SHOSABI INC.
G06V40/25A63B24/0062A63B24/0075A63B71/0622G06T13/40G06T13/80G06T19/20A63B2024/0096A63B2071/0647A63B2230/625G06T2210/56G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,983,962
App. No.
17/691,285
Granted
May 14, 2024
Kind
B2
Abstract

An information processing apparatus includes a processor and a memory with instructions thereon. The instructions upon execution by the processor, causes the processor to: sequentially sense a movement of a body of a user; present, to the user, an avatar corresponding to the user, rather than a photographed image of an appearance of the user, based on a result of the sensing so that the user perceives a shape of a surface of the body of the user; determine a position of a figure object to be drawn that serves as a guide for movement of the body of the user in association with the avatar based on the result of the sensing; and display the figure object at the determined position.

Claims (55)

1. An information processing apparatus comprising a processor and a memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

sequentially sense a movement of a body of a user including a plurality of points of the user;

present, to the user, an avatar corresponding to the user, rather than a photographed image of an appearance of the user, whereby the plurality of points of the user correspond to equivalent points on the avatar corresponding to the user, based on a result of the sensing so that the user perceives a shape of a surface of the body of the user;

determine a position of a figure object to be drawn that serves as a guide for movement of the body of the user in association with the avatar based on the result of the sensing; and

display the figure object at the determined position.

2. The apparatus according to claim 1 , wherein in the processor presents the avatar to the user with a reduced amount of information compared with the photographed image.

3. The apparatus according to claim 1 , wherein the processor presents the avatar to the user each time the result of the sensing is obtained.

4. The apparatus according to claim 1 , wherein in the processor presents the avatar such that an avatar corresponding to the user viewed in a first direction and an avatar corresponding to the user viewed in a second direction that is different from the first direction are drawn side by side and presented to the user.

5. The apparatus according to claim 1 , wherein the processor senses the movement of the body of the user as point cloud data, and

the processor presents the avatar such that the avatar is drawn as a set of graphic elements based on point cloud data and presented to the user.

6. The apparatus according to claim 1 , wherein the instructions upon execution by the processor, cause the processor to:

estimate positions of a plurality of particular parts of the user based on the result of the sensing of the movement of the body of the user; and

draw the avatar while not drawing a result of the estimation of the positions of the particular parts, and evaluate a way of movement of the body of the user based on the result of the estimation of the positions of the particular parts.

7. The apparatus according to claim 1 , wherein the processor presents the avatar such that the avatar drawn is updated in response to the result of the sensing of the movement of the body of the user, and

the processor displays the figure object at a fixed position regardless of the movement of the body of the user.

8. The apparatus according to claim 7 , wherein the instructions upon execution by the processor, cause the processor to:

estimate a position of a particular part of the user based on the result of the sensing of the movement of the body of the user; and

draw, along with the avatar, a time-series history of positions of a first part of the user obtained by the sensing, the first part being a subject of the measurement of the movement of the body of the user.

9. The apparatus according to claim 7 , wherein the processor determines to draw a linear figure object in parallel with a body axis of the user at a fixed position regardless of the movement of the body of the user based on the result of the sensing of the user.

10. The apparatus according to claim 1 , wherein the processor determines the position of the figure object to be drawn based on a result of sensing of a first posture of the user before starting a particular movement, the figure object serving as a guide for the user to make the particular movement.

11. The apparatus according to claim 10 , wherein the particular movement is a predetermined movement for measurement of the movement of the body of the user, and

the processor determines the position of the figure object to be drawn based on the first posture, the figure object serving as a guide for movement of the body of the user at a predetermined timing in the particular movement.

12. The apparatus according to claim 10 , wherein the processor determines the position of the figure object to be drawn based on the first posture, the figure object serving as a guide for at least one of a group consisting of a front-rear balance and a left-right balance of the body of the user.

13. The apparatus according to claim 10 , wherein the processor determines the position of the figure object to be drawn based on the first posture, the figure object serving as a guide for a second posture that can be assumed by the user while the user is making the particular movement.

14. The apparatus according to claim 13 , wherein the particular movement is a movement made by the user in a state where the user has taken a big step forward, and

the processor determines the position of the figure object to be drawn based on the first posture, the figure object serving as a guide for a posture of the user in which the user has stepped a front foot forward.

15. The apparatus according to claim 14 , wherein the instructions upon execution by the processor, cause the processor to estimate a position of a lower limb of the user based on the result of the sensing of the movement of the body of the user, and

the processor determines the position of the figure object to be drawn based on the result of the estimation, the figure object serving as a guide for a step position of the user having taken a big step forward.

16. The apparatus according to claim 13 , wherein the instructions upon execution by the processor, cause the processor to:

estimate a position of a particular part of the user based on the result of the sensing of the movement of the body of the user; and

evaluate whether the user is properly assuming the second posture based on a positional relationship between the estimated position of the particular part and the position of the figure object.

17. The apparatus according to claim 16 , wherein when the processor evaluates that the user is properly assuming the second posture, the processor presents that the user is properly assuming the second posture to the user.

18. The apparatus according to claim 16 , wherein the particular movement involves a body movement made by the user in the second posture, and

in response to evaluation that the user is properly assuming the second posture, the processor starts measurement of the particular movement, and presents the start of the measurement to the user.

19. The apparatus according to claim 1 , wherein the instructions upon execution by the processor, cause the processor to estimate positions of a plurality of particular parts of the user based on the result of the sensing of the movement of the body of the user, and

the processor determines, a position of a linear figure object to be drawn based on the estimated positions of the particular parts, the linear figure object allowing the user to perceive whether the particular parts are properly moving in the movement of the body of the user.

20. The apparatus according to claim 19 , wherein the processor displays a line segment as the figure object along with the avatar, the line segment being an extension of a line extending from a peripheral part of a particular part to the particular part.

21. The apparatus according to claim 20 , wherein the processor draws and displays a figure object having a large size compared with a width of the line segment at an end point of the line segment.

22. The apparatus according to claim 21 , wherein the processor displays the figure object corresponding to the end point of the line segment in such a manner that the figure object moves in association with the result of the sensing of the movement of the body of the user, and

a way of display of the figure object is changed based on a positional relationship between the figure object arranged in a fixed manner regardless of the movement of the body of the user and the figure object corresponding to the end point.

23. The apparatus according to claim 19 , wherein the instructions upon execution by the processor, cause the processor to estimate positions of a plurality of particular parts of the user based on the result of the sensing of the movement of the user, and

the processor draws and displays a figure object indicating an inclination of a first part of the user and a figure object indicating an inclination of a second part that is different from the first part in association with the first part and the second part, respectively.

24. The apparatus according to claim 19 , wherein the instructions upon execution by the processor, cause the processor to estimate a position of a particular part of the user based on the result of the sensing of the movement of the body of the user, and

the processor determines the position of the figure object to be drawn based on the estimated position of the particular part and a shape of a body surface of the user.

25. The apparatus according to claim 1 , wherein the particular movement is a predetermined movement for measurement of the movement of the body of the user, and

the processor presents the avatar to the user each time the result of the sensing is obtained, the result of the sensing of the user at a predetermined timing at a breakpoint of the particular movement is stored in a storage unit, and an avatar at the predetermined timing arranged side by side with the avatar is presented to the user.

26. The apparatus according to claim 1 , wherein the instructions upon execution by the processor, cause the processor to:

estimate positions of at least three particular parts of the user based on the result of the sensing of the movement of the body of the user; and

determine a position of an object to be drawn that indicates a positional relationship, with respect to any of the at least three particular parts, between others of the particular parts in a horizontal plane to display the object at the determined position, and

the processor determines the position of the figure object to be drawn in association with the avatar based on a result of the estimation of the positions of the at least three parts.

27. A method of making a computer execute:

a step of sequentially sensing a movement of a body of a user including a plurality of points of the user;

a step of presenting, to the user, an avatar corresponding to the user, whereby the plurality of points of the user correspond to equivalent points on the avatar corresponding to the user, based on a result of the sensing so that the user perceives a shape of a surface of the body of the user;

a step of determining a position of a figure object to be drawn that serves as a guide for movement of the body of the user in association with the avatar based on the result of the sensing; and

a step of displaying the figure object at the determined position.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2024
From: MITSUBISHI CHEMICAL GROUP CORPORATION
To: SHOSABI INC.
Reel/Frame 066414/0154 →
CHANGE OF NAME Recorded Mar 20, 2023
From: MITSUBISHI CHEMICAL HOLDINGS CORPORATION
To: MITSUBISHI CHEMICAL GROUP CORPORATION
Reel/Frame 063141/0292 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2022
From: YAMAGISHI, SACHIKO; KOBAYASHI, KENJIRO
To: MITSUBISHI CHEMICAL HOLDINGS CORPORATION
Reel/Frame 059221/0844 →
Priority Claims (4)
JP 2020-136049 · Aug 11, 2020 · national
JP 2021-063763 · Apr 2, 2021 · national
JP 2021-063771 · Apr 2, 2021 · national
JP 2021-096232 · Jun 8, 2021 · national
Continuity (2)
Continuation PCTJP2021026675 · Jul 15, 2021
Related Publication 20220198835A1 · Jun 23, 2022