IP Library › Granted Patent US 11,366,631
Granted Patent B2
US 11,366,631 · App. 17/058,230 · Granted Jun 21, 2022

Information processing device, information processing method, and program

Inventors: Yusuke Sakai (Kanagawa, JP); Ryusei Koike (Kanagawa, JP); Haruo Oba (Kanagawa, JP); Motoki Higashide (Tokyo, JP); Daisuke Miki (Tokyo, JP)
Assignee: SONY CORPORATION
G06F3/1454G06F3/1446G06T7/0004G06T11/00G06T2200/24G06T2207/30164
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,366,631
App. No.
17/058,230
Granted
Jun 21, 2022
Kind
B2
Abstract

Provided is an information processing device provided with an obtaining unit ( 211 ) that obtains first physical information of a first user present in a first space, and second physical information of a second user present in a second space, a virtual space generation unit ( 213 ) that generates a virtual space on the basis of the first physical information or the second physical information, as operation mode control unit ( 211 ) that switches an operation mode in a case where a trigger caused by at least any one of the first user or the second user occurs, and a control unit ( 210 ) that interlocks switch of the operation mode with at least one device present is the first space or at least one device present in the second space.

Claims (55)

1. An information processing device comprising:

an obtaining unit configured to

obtain first physical information of a first user present in a first space, and

obtain second physical information of a second user present in a second space;

a virtual space generation unit configured to generate a virtual space based on at least one of the first physical information or the second physical information;

an operation mode control unit configured to switch an operation mode among a plurality of operation modes in a case where a trigger caused by at least any one of the first user or the second user occurs; and

a control unit configured to interlock the switch of the operation mode with at least one device present in the first space or at least one device present in the second space,

wherein each operation mode of the plurality of operation modes relates to a positional relationship between the first user and the second user in the virtual space, and

wherein the obtaining unit, the virtual space generation unit, the operation mode control unit, and the control unit are each implemented via at least one processor.

2. The information processing device according to claim 1 ,

wherein the obtaining unit is further configured to

obtain first environmental information including information regarding an object present in the first space, or

obtain second environmental information including information regarding an object present in the second space, and

the virtual space generation unit generates the virtual space further based on the first environmental information or the second environmental information.

3. The information processing device according to claim 2 ,

wherein the operation mode control unit switches the operation mode based on a change in the positional relationship between the first user and the second user in the virtual space.

4. The information processing device according to claim 3 ,

wherein the positional relationship includes at least any one of a relationship in which the first user and the second user are located face-to-face with each other, a relationship in which the first user and the second user are located side-by-side in a state of facing in a same direction, or a relationship in which the first user and the second user are located such that one covers the other from behind in a state of facing in the same direction.

5. The information processing device according to claim 1 ,

wherein each device includes at least one display.

6. The information processing device according to claim 5 ,

wherein each device includes a first display a display surface of which is located perpendicular to a ground surface, and a second display a display surface of which is located parallel to the ground surface.

7. The information processing device according to claim 6 ,

wherein the second display of each device is further configured as a working table for the first user or the second user.

8. The information processing device according to claim 7 ,

wherein the control unit is further configured to initiate the first display or the second display present in the first space to display at least a part of the second physical information.

9. The information processing device according to claim 8 , further comprising:

an analysis unit configured to analyze a captured image in which at least a part of the second physical information and a display image of the second display present in the second space are captured to extract at least a part of the second physical information from the captured image,

wherein the analysis unit is implemented via at least one processor.

10. The information processing device according to claim 9 ,

wherein, in a case where there are a plurality of second spaces and a plurality of second users,

the control unit is further configured to initiate the first display or the second display to display at least a part of the second physical information of each of the plurality of second users.

11. The information processing device according to claim 10 ,

wherein the analysis unit is further configured to analyze the second physical information of each of the plurality of second users to evaluate work of each of the second users.

12. The information processing device according to claim 1 ,

wherein the control unit controls the at least one device present in the second space based on an input by the first user.

13. The information processing device according to claim 12 ,

wherein, in a case where there are a plurality of second spaces and a plurality of second users,

the control unit specifies at least any one of the plurality of second spaces based on the input by the first user, and controls at least one device present in the specified second space.

14. The information processing device according to claim 1 ,

wherein each device includes at least one of a speaker or a tactile sense presentation device.

15. An information processing method executed by a computer, the method comprising:

obtaining first physical information of a first user present in a first space;

obtaining second physical information of a second user present in a second space;

generating a virtual space based on at least one of the first physical information or the second physical information;

switching an operation mode among a plurality of operation modes in a case where a trigger caused by at least any one of the first user or the second user occurs; and

interlocking the switching of the operation mode with at least one device present in the first space or at least one device present in the second space,

wherein each operation mode of the plurality of operation modes relates to a positional relationship between the first user and the second user in the virtual space.

16. A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising that allows a computer to realize:

obtaining first physical information of a first user present in a first space;

obtaining second physical information of a second user present in a second space;

generating a virtual space based on at least one of the first physical information or the second physical information;

switching an operation mode among a plurality of operation modes in a case where a trigger caused by at least any one of the first user or the second user occurs; and

interlocking the switching of the operation mode with at least one device present in the first space or at least one device present in the second space,

wherein each operation mode of the plurality of operation modes relates to a positional relationship between the first user and the second user in the virtual space.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2021
From: SAKAI, YUSUKE; KOIKE, RYUSEI; OBA, HARUO; HIGASHIDE, MOTOKI; MIKI, DAISUKE
To: SONY CORPORATION
Reel/Frame 054996/0864 →
Priority Claims (1)
JP JP2018-105824 · Jun 1, 2018 · national
Continuity (1)
Related Publication 20210157541A1 · May 27, 2021
Cited By (1)
US 12,231,614