Granted Patent B2

US 12,650,752 · App. 17/756,127 · Granted Jun 9, 2026

Inventors: Yusuke Sakai (Tokyo, JP); Masanori Seto (Kochi, JP)

Assignee: SONY GROUP CORPORATION

G06F3/0481G06T7/70H04N7/141

Abstract

Claims (73)

1 . A first information processing apparatus, comprising:

circuitry configured to:

acquire analysis target data, wherein

a first imaging device and a first display device are installed in a first space,

a second imaging device and a second display device are installed in a second space,

the analysis target data is obtained from a device installed in at least one of the first space or the second space,

a first captured image captured by the first imaging device in the first space is displayed in real time by the second display device in the second space, and

a second captured image captured by the second imaging device in the second space is displayed in real time by the first display device in the first space;

analyze a state of a user based on the acquired analysis target data, wherein the state of the user is analyzed based on a human visual characteristic; and

control a shape of a display area of at least one of the first display device or the second display device based on an analysis result of the analyzed state of the user, wherein

the first captured image captured by the first imaging device is displayed in the display area of the second display device, and

the second captured image captured by the second imaging device is displayed in the display area of the first display device.

2 . The first information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

analyze a context based on the acquired analysis target data; and

control the shape of the display area based on at least one of the analysis result of the analyzed state of the user or an analysis result of the analyzed context.

3 . The first information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

analyze a relative relationship of the user with a partner user based on the acquired analysis target data; and

control the shape of the display area based on at least one of the analysis result of the analyzed state of the user or an analysis result of the analyzed relative relationship.

4 . The first information processing apparatus according to claim 1 , wherein the circuitry is further configured to

change the shape of the display area from a first shape to a second shape.

5 . The first information processing apparatus according to claim 4 , wherein the circuitry is further configured to:

determine to change the shape of the display area from the first shape at a current point of time to the second shape based on the analysis result of the analyzed state of the user; and

change the shape of the display area from the first shape to the second shape based on the determination to change the shape from the first shape at the current point of time to the second shape.

6 . The first information processing apparatus according to claim 1 , wherein

the shape of the display area includes one of a rectangular shape, a circular shape, an elliptical shape, a polygonal shape, or a shape of a symbol.

7 . The first information processing apparatus according to claim 1 , wherein the circuitry is further configured to

analyze the state of the user by using based on the analysis target data, wherein the state of the user is analyzed based on a human field of view characteristic.

8 . The first information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

analyze a cognitive state of the user based on the analysis target data; and

control the shape of the display area based on an analysis result of the analyzed cognitive state of the user.

9 . The first information processing apparatus according to claim 8 , wherein the circuitry is further configured to:

analyze a context based on the analysis target data;

analyze an influence on the user caused by the context; and

analyze the cognitive state of the user based on an analysis result of the analyzed influence on the user.

10 . The first information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

analyze a position of the user based on the analysis target data; and

control the shape of the display area based on an analysis result of the analyzed position of the user.

11 . The first information processing apparatus according to claim 10 , wherein the circuitry is further configured to

set an initial shape of the display area to a shape corresponding to the position of the user, wherein the shape corresponding to the position of the user is assumed in advance.

12 . The first information processing apparatus according to claim 4 , wherein the circuitry is further configured to

continuously change the shape of the display area from the first shape to the second shape based on the change of the shape of the display area.

13 . The first information processing apparatus according to claim 4 , wherein the circuitry is further configured to:

control a graphical display or drive a mechanism to change the shape of the display area; and

change the shape of the display area from the first shape to the second shape based on the controlled graphical display or the driven mechanism.

14 . The first information processing apparatus according to claim 7 , wherein

the human field of view characteristic includes a discriminative field of view, an effective field of view, and a gaze stable field of view.

15 . The first information processing apparatus according to claim 4 , wherein the circuitry is further configured to

change the shape of the display area to the second shape estimated from the analysis target data, wherein

the second shape is estimated based on by using a determination model learned by machine learning, and

the machine learning uses learning data regarding the shape of the display area.

16 . The first information processing apparatus according to claim 1 , wherein

the device includes an imaging device and a sensor device, and

the analysis target data includes captured image data and sensor data.

17 . The first information processing apparatus according to claim 2 , wherein

the context includes at least one of information regarding one of the first space or the second space, information regarding a climate around one of the first space or the second space, or information regarding a building in which one of the first space or the second space exists or an equipment of the building.

18 . The first information processing apparatus according to claim 1 , wherein

the first imaging device and the first display device installed in the first space are integrally formed in the first information processing apparatus,

the second imaging device and the second display device installed in the second space are integrally formed in a second information processing apparatus, and

the first information processing apparatus and the second information processing apparatus are mutually connected via a network.

19 . The first information processing apparatus according to claim 18 , wherein the circuitry is further configured to:

analyze a state of a first user in the first space based on the analysis target data, wherein the state of the first user is analyzed based on the human visual characteristic; and

control the shape of the display area of the first display device based on an analysis result of the analyzed state of the first user.

20 . An information processing method, comprising:

acquiring analysis target data, wherein

a first imaging device and a first display device are installed in a first space,

a second imaging device and a second display device are installed in a second space,

the analysis target data is obtained from a device installed in at least one of the first space or the second space,

a first captured image captured by the first imaging device in the first space is displayed in real time by the second display device in the second space, and

a second captured image captured by the second imaging device in the second space is displayed in real time by the first display device in the first space;

analyzing a state of a user based on the acquired analysis target data, wherein the state of the user is analyzed based on a human visual characteristic; and

controlling a shape of a display area of at least one of the first display device or the second display device based on an analysis result of the analyzed state of the user, wherein

the first captured image captured by the first imaging device is displayed in the display area of the second display device, and

the second captured image captured by the second imaging device is displayed in the display area of the first display device.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (16)