IP Library › Granted Patent US 11,361,541
Granted Patent B2
US 11,361,541 · App. 16/964,030 · Granted Jun 14, 2022

Information processing apparatus, information processing method, and recording medium

Inventors: Takuya Ikeda (Tokyo, JP); Fumihiko Iida (Kanagawa, JP); Kentaro Ida (Tokyo, JP)
Assignee: SONY CORPORATION
G06V20/20A63F7/07G06T7/20G06T7/70A63F2250/10G06F3/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,361,541
App. No.
16/964,030
Granted
Jun 14, 2022
Kind
B2
Abstract

An information processing apparatus includes an acquisition unit that acquires information indicating an estimation result of movement of a predetermined target object in accordance with a history of chronological detection results of positions of the target object and a recognition result of a surrounding environment of the target object, and a control unit that causes display information to be presented in a display mode corresponding to the estimation result.

Claims (100)

1. An information processing apparatus, comprising:

a Central Processing Unit (CPU) configured to:

control recognition of a surrounding environment of a target object to obtain a recognition result;

detect a first position of the target object to obtain a detection result;

switch between a first process and a second process to predict a movement of the target object;

predict, in the first process, the movement of the target object based on:

a history of chronological detection results of a plurality of positions of the target object, and

the recognition result of the surrounding environment of the target object;

control, in the second process, a chronological range related to the prediction of the movement of the target object at a detection timing of the detection of the first position of the target object and after the detection timing,

wherein the chronological range is controlled based on the detection result and the recognition result;

predict, in the second process, the movement of the target object each of at the detection timing and after the detection timing based on:

the control of the chronological range, and

the history of the chronological detection results of the plurality of positions of the target object; and

control presentation of display information in a display mode, wherein the display mode corresponds to one of:

the predicted movement of the target object in the first process, or

the predicted movement of the target object in the second process.

2. The information processing apparatus according to claim 1 , wherein the CPU is further configured to:

control recognition of an external factor that is estimated to affect motion of the target object; and

predict the movement of the target object based on the recognition of the external factor.

3. The information processing apparatus according to claim 2 , wherein the CPU is further configured to predict the movement of the target object based on at least one of:

a positional relationship between the target object and a specific object, wherein the specific object is different from the target object,

a friction force that acts on the target object, or

an external force that acts on the target object.

4. The information processing apparatus according to claim 3 , wherein the CPU is further configured to:

predict a collision of the target object with the specific object;

estimate a change of a motion direction of the target object based on the predicted collision; and

predict the movement of the target object based on the estimated change of the motion direction of the target object.

5. The information processing apparatus according to claim 1 , wherein

the CPU is further configured to switch between the first process and the second process based on positional relationship between the target object and a specific object, and

the specific object is different from the target object.

6. The information processing apparatus according to claim 1 , wherein

the CPU is further configured to limit the chronological range related to the prediction of the movement of the target object at the detection timing and after the detection timing,

the chronological range is limited based on at least one of a positional relationship between the target object and a specific object, a frictional force that acts on the target object, or an external force that acts on the target object, and

the specific object is different from the target object.

7. The information processing apparatus according to claim 6 , wherein the CPU is further configured to:

estimate a collision of the target object with the specific object; and

limit the chronological range related to the prediction of the movement of the target object to a range corresponding to a timing at which the collision is estimated to occur and before the timing at which the collision is estimated to occur.

8. The information processing apparatus according to claim 1 , wherein the CPU is further configured to control the presentation of the display information at a second position corresponding to one of:

the predicted movement of the target object in the first process, or

the predicted movement of the target object in the second process.

9. The information processing apparatus according to claim 1 , wherein the CPU is further configured to control superimposition of the display information on the target object based on one of:

the predicted movement of the target object in the first process, or

the predicted movement of the target object in the second process.

10. The information processing apparatus according to claim 1 , wherein

the CPU is further configured to:

estimate arrival of the target object at a second position at a specific time; and

control the presentation of the display information at the second position based on one of:

the predicted movement of the target object in the first process, or

the predicted movement of the target object in the second process.

11. The information processing apparatus according to claim 1 , wherein the CPU is further configured to control, as the display mode, at least one of a size, a color, or a shape of the display information.

12. The information processing apparatus according to claim 1 , wherein the CPU is further configured to control the display mode in synchronization with one of:

the predicted movement of the target object in the first process, or

the predicted movement of the target object in the second process.

13. The information processing apparatus according to claim 12 , wherein the CPU is further configured to:

estimate a change in a motion of the target object to obtain an estimation result; and

control the display mode based on the estimation result of the change of the motion of the target object.

14. The information processing apparatus according to claim 1 , wherein the CPU is further configured to:

control recognition of an external factor that is estimated to affect a motion of the target object; and

control the presentation of the display information based on:

the external factor that is estimated to affect the motion of the target object, and

one of the predicted movement of the target object in the first process or the predicted movement of the target object in the second process.

15. An information processing method, comprising:

controlling recognition of a surrounding environment of a target object to obtain a recognition result;

detecting a position of the target object to obtain a detection result;

switching between a first process and a second process to predict a movement of the target object;

predicting, in the first process, the movement of the target object based on:

a history of chronological detection results of a plurality of positions of the target object, and

the recognition result of the surrounding environment of the target object;

controlling, in the second process, a chronological range related to the prediction of the movement of the target object at a detection timing of the detection of the position of the target object and after the detection timing,

wherein the chronological range is controlled based on the detection result and the recognition result;

predicting, in the second process, the movement of the target object each of at the detection timing and after the detection timing based on:

the control of the chronological range, and

the history of the chronological detection results of the plurality of positions of the target object; and

controlling presentation of display information in a display mode, wherein the display mode corresponds to one of:

the predicted movement of the target object in the first process, or

the predicted movement of the target object in the second process.

16. A non-transitory computer-readable medium having stored thereon, computer-executable instructions, which when executed by a computer, cause the computer to execute operations, the operations comprising:

controlling recognition of a surrounding environment of a target object to obtain a recognition result;

detecting a position of the target object to obtain a detection result;

switching between a first process and a second process to predict a movement of the target object;

predicting, in the first process, the movement of the target object based on:

a history of chronological detection results of a plurality of positions of the target object, and

the recognition result of the surrounding environment of the target object;

controlling, in the second process, a chronological range related to the prediction of the movement of the target object at a detection timing of the detection of the position of the target object and after the detection timing,

wherein the chronological range is controlled based on the detection result and the recognition result;

predicting, in the second process, the movement of the target object each of at the detection timing and after the detection timing based on:

the control of the chronological range, and

the history of the chronological detection results of the plurality of positions of the target object; and

controlling presentation of display information in a display mode, wherein the display mode corresponds to one of:

the predicted movement of the target object in the first process, or

the predicted movement of the target object in the second process.

17. An information processing apparatus, comprising:

a Central Processing Unit (CPU) configured to:

control recognition of a surrounding environment of a target object to obtain a recognition result;

detect a position of the target object to obtain a detection result;

estimate a collision of the target object with a specific object, wherein the specific object is different from the target object;

limit a chronological range related to estimation of a movement of the target object to a range corresponding to a timing at which the collision is estimated to occur and before the timing at which the collision is estimated to occur,

wherein the chronological range is limited based on the detection result, the recognition result, and at least one of a positional relationship between the target object and the specific object, a frictional force that acts on the target object, or an external force that acts on the target object;

estimate the movement of the target object based on the limited chronological range, a history of chronological detection results of a plurality of positions of the target object, and the recognition result; and

control presentation of display information in a display mode, wherein the display mode corresponds to an estimation result of the estimation of the movement of the target object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 18, 2021
From: IKEDA, TAKUYA; IIDA, FUMIHIKO; IDA, KENTARO
To: SONY CORPORATION
Reel/Frame 056627/0941 →
Priority Claims (1)
JP JP2018-040920 · Mar 7, 2018 · national
Continuity (1)
Related Publication 20210042526A1 · Feb 11, 2021