Granted Patent B2

US 12,233,782 · App. 18/548,237 · Granted Feb 25, 2025

Inventors: Tetsuo Ikeda (Tokyo, JP); Maho Hayashi (Tokyo, JP); Hiroshi Imamura (Tokyo, JP); Mikinori Matsuda (Tokyo, JP); Yuya Takayama (Tokyo, JP)

Assignee: SONY GROUP CORPORATION

B60R1/001G06F3/011G06T19/006G06V20/58B60R2300/308

Abstract

Claims (72)

1. An information processing apparatus, comprising:

a recognition section configured to:

recognize a scene visible from within a mobile body,

wherein the scene is visible from within the mobile body through one of a transparent display surface or a translucent display surface of a side window of the mobile body;

extract a target object in the scene; and

recognize a distance between the mobile body and the target object; and

a display control section configured to:

control display of content on the one of the transparent display surface or the translucent display surface based on the recognized scene,

wherein the content includes presentation information presented with respect to the target object;

control a display position of the presentation information based on the distance between the mobile body and the target object; and

control a positional relation between the display position of the presentation information and a position of the target object, based on the distance between the mobile body and the target object.

2. The information processing apparatus according to claim 1 , wherein

the recognition section is further configured to recognize at least one of a state of the mobile body or a state of a user in the mobile body, and

the display control section is further configured to control the display of the content based on the at least one of the state of the mobile body or the state of the user in the mobile body.

3. The information processing apparatus according to claim 2 , wherein

the recognition section is further configured to recognize the user as a target user in the mobile body, and

the display control section is further configured to control the display of the content for the target user based on a result of recognition of the target user.

4. The information processing apparatus according to claim 3 , wherein

the recognition section is further configured to recognize at least one of a number of target users in the mobile body, a position of the target user of the number of target users in the mobile body, a line of sight of the target user, a face orientation of the target user, or a motion of the target user, and

the display control section is further configured to control, based on the at least one of the number of target users, the position of the target user, the line of sight of the target user, the face orientation of the target user, or the motion of the target user, at least one of a description of the content, a display position of the content, a motion of the content, or a method of the display of the content.

5. The information processing apparatus according to claim 4 , wherein, in a case where the number of target users is one and a speed of the mobile body is equal to or lower than a specific threshold, the display control section is further configured to exactly superimpose the content on the scene.

6. The information processing apparatus according to claim 4 , wherein

the content includes a game play screen, and

the display control section is further configured to control a motion of the game play screen, based on the recognized scene and the motion of the target user.

7. The information processing apparatus according to claim 3 , wherein the recognition section is further configured to recognize the target user based on at least one of a position of the user in the mobile body, a line of sight of the user, and a face orientation of the user in the mobile body.

8. The information processing apparatus according to claim 2 , wherein the display control section is further configured to control, based on a speed of the mobile body, at least one of a description of the content, a display position of the content, a motion of the content, or a method of the display of the content.

9. The information processing apparatus according to claim 1 , wherein the display control section is further configured to control, based on the distance between the mobile body and the target object, at least one of a description of the presentation information or a method of display of the presentation information.

10. The information processing apparatus according to claim 1 , wherein the presentation information includes at least one of an attribute of the target object or a display item indicating a location of the target object in the scene.

11. The information processing apparatus according to claim 1 , wherein the display control section is further configured to control the display position of the presentation information, based on locations of the target object and a sky in the scene.

12. The information processing apparatus according to claim 1 , wherein

the content further includes related information, and

the related information is regarding the scene and a first object in the scene.

13. The information processing apparatus according to claim 12 , wherein

the related information includes:

at least one of past information or future information regarding at least one of the scene or the first object in the scene, and

information regarding a second object that is present in a space different from the scene, and

the second object is related to at least one of the scene or the first object in the scene.

14. The information processing apparatus according to claim 1 , wherein the display control section is further configured to control at least one of a description of the content, a display position of the content, a motion of the content, and a method of the display of the content.

15. The information processing apparatus according to claim 1 , wherein the display control section is further configured to:

generate an image of an object virtually disposed in the scene, by occlusion of obstructions present between the object and the mobile body; and

control display of the generated image on the one of the transparent display surface or the translucent display surface.

16. An information processing method, comprising:

recognizing a scene visible from within a mobile body,

wherein the scene is visible from within the mobile body through one of a transparent display surface or a translucent display surface of a side window of the mobile body;

extracting a target object in the scene;

recognizing a distance between the mobile body and the target object;

controlling display of content on the one of the transparent display surface or the translucent display surface based on the recognized scene,

wherein the content includes presentation information presented with respect to the target object;

controlling a display position of the presentation information based on the distance between the mobile body and the target object; and

controlling a positional relation between the display position of the presentation information and a position of the target object, based on the distance between the mobile body and the target object.

17. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations:

recognizing a scene visible from within a mobile body,

wherein the scene is visible from within the mobile body through one of a transparent display surface or a translucent display surface of a side window of the mobile body;

extracting a target object in the scene;

recognizing a distance between the mobile body and the target object;

controlling display of content on the one of the transparent display surface or the translucent display surface based on the recognized scene,

wherein the content includes presentation information presented with respect to the target object;

controlling a display position of the presentation information based on the distance between the mobile body and the target object; and

controlling a positional relation between the display position of the presentation information and a position of the target object, based on the distance between the mobile body and the target object.

18. An information processing system, comprising:

a display section that includes one of a transparent display surface or a translucent display surface of a side window of a mobile body,

wherein the one of the transparent display surface or the translucent display surface is configured to transmit light from an outside of the mobile body;

a recognition section configured to:

recognize a scene visible from within the mobile body,

wherein the scene is visible from within the mobile body through the one of the transparent display surface or the translucent display surface of the side window;

extract a target object in the scene; and

recognize a distance between the mobile body and the target object; and

a display control section configured to:

control display of content on the one of the transparent display surface or the translucent display surface based on the recognized scene,

wherein the content includes presentation information presented with respect to the target object;

control a display position of the presentation information based on the distance between the mobile body and the target object; and

control a positional relation between the display position of the presentation information and a position of the target object, based on the distance between the mobile body and the target object.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (15)