IP Library › Granted Patent US 10,356,382
Granted Patent B2
US 10,356,382 · App. 15/840,742 · Granted Jul 16, 2019

Information processing device, information processing method, and program

Inventor: Tsuyoshi Ishikawa (Kanagawa, JP)
Assignee: SONY CORPORATION
H04N13/117G11B27/10H04N13/128H04N13/189H04N13/279H04N13/344
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,356,382
App. No.
15/840,742
Granted
Jul 16, 2019
Kind
B2
Abstract

There is provided an information processing device including a change unit configured to change arrangement of a first object corresponding to a first user and a second object corresponding to a second user from first arrangement to second arrangement in accordance with reproduction of a video including depth information, in a virtual space corresponding to the video.

Claims (63)

1. An information processing device comprising:

a change unit configured to change arrangement of a first object corresponding to a first user and a second object corresponding to a second user from first arrangement to second arrangement in accordance with reproduction of a video including depth information, in a virtual space corresponding to the video; and

a specification unit configured to specify, on a basis of the depth information, information regarding an empty space in a surrounding of a point of view at the corresponding time of recording the video for each of the respective reproduction timings of the video,

wherein the change unit is configured to change the arrangement of the first object and the second object from the first arrangement to the second arrangement in accordance with change in the depth information and change in the information regarding the empty space depending on the reproduction of the video,

wherein the depth information indicates depth values at respective reproduction timings, each of the depth values being set to the surrounding of the point of view in the video at a corresponding time of recording the video, and

wherein the change unit and the specification unit are each implemented via at least one processor.

2. The information processing device according to claim 1 , wherein

the first object and the second object are three-dimensional virtual objects, and

the change unit is configured to change the arrangement of the first object and the second object from the first arrangement to the second arrangement further in accordance with a size of the first object and a size of the second object.

3. The information processing device according to claim 2 , wherein

the first arrangement corresponds to a first row of the first object and the second object,

the second arrangement corresponds to a second row of the first object and the second object,

the specification unit further determines, at each of the respective reproduction timing of the video, whether the first row is within a space indicated by the information regarding the empty space, and

when it is determined that the first row is not within the space, the change unit changes the arrangement of the first object and the second object from the first arrangement to the second arrangement.

4. The information processing device according to claim 3 ,

wherein an arrangement direction of the first object and the second object corresponding to the second arrangement is different from an arrangement direction of the first object and the second object corresponding to the first arrangement.

5. The information processing device according to claim 3 ,

wherein an orientation of the first object corresponding to the second arrangement is different from an orientation of the first object corresponding to the first arrangement.

6. The information processing device according to claim 3 ,

wherein, each time it is determined that a current row of the first object and the second object is not within the space indicated by the information regarding the empty space corresponding to a current reproduction timing, the change unit changes the row of the first object and the second object such that the row of the first object and the second object falls within the space.

7. The information processing device according to claim 1 , wherein

a plurality of users including the first user and the second user are users who view the video, and

the change unit is further configured to change a number of objects to be arranged in the virtual space among respective objects corresponding to the plurality of users, in accordance with change in the depth information depending on the reproduction of the video.

8. The information processing device according to claim 7 , wherein

the change unit is further configured to change display forms of a plurality of objects to be arranged in the virtual space in accordance with a number of the plurality of users.

9. The information processing device according to claim 1 ,

wherein the change unit is further configured to change a display form of the first object or the second object in accordance with change in the depth information depending on the reproduction of the video.

10. The information processing device according to claim 1 ,

wherein the change unit is further configured to

change arrangement of the first object in the virtual space on a basis of a result of recognizing movement of the first user in a first real space where the first user is located, and

change arrangement of the second object in the virtual space on a basis of a result of recognizing movement of the second user in a second real space where the second user is located.

11. The information processing device according to claim 1 ,

wherein the video is associated with information indicating a scene change timing,

wherein the specification unit is further configured to specify the scene change timing in accordance with the reproduction of the video, and

wherein, in a case where the scene change timing is specified, the change unit changes arrangement of the first object and the second object in the virtual space from the first arrangement to the second arrangement.

12. The information processing device according to claim 11 ,

wherein the second arrangement is arrangement of the first object and the second object indicated by setting information associated with the scene change timing.

13. The information processing device according to claim 1 ,

wherein the video is a first video,

wherein the information processing device further comprises a display control unit configured to cause a first display unit and a second display unit to display a second video depending on the first video and the arrangement of the first object and the second object in the virtual space, and

wherein the display control unit is implemented via at least one processor.

14. The information processing device according to claim 13 ,

wherein, each time the change unit changes the arrangement of the first object and the second object, the display control unit causes the first display unit and the second display unit to display the second video depending on the changed arrangement of the first object and the second object.

15. An information processing device comprising:

a change unit configured to change arrangement of a first object corresponding to a first user and a second object corresponding to a second user from first arrangement to second arrangement in accordance with reproduction of a video including depth information, in a virtual space corresponding to the video; and

a specification unit configured to specify information regarding an empty space in a surrounding of a point of view at the corresponding time of recording the video for each of the respective reproduction timings of the video, on a basis of the depth information,

wherein the change unit is configured to change the arrangement of the first object and the second object from the first arrangement to the second arrangement in accordance with change in the depth information depending on the reproduction of the video,

wherein the depth information indicates depth values at respective reproduction timings, each of the depth values being set to the surrounding of the point of view in the video at a corresponding time of recording the video,

wherein a plurality of users including the first user and the second user are users who view the video,

wherein respective objects corresponding to the plurality of users are three-dimensional virtual objects,

wherein the change unit is configured to change a number of objects to be arranged in the virtual space in accordance with sizes of the respective objects corresponding to the plurality of users and change in the information regarding the empty space depending on the reproduction of the video,

wherein the change unit further configured to change the number of objects to be arranged in the virtual space among respective objects corresponding to the plurality of users, in accordance with change in the depth information depending on the reproduction of the video, and

wherein the change unit and the specification unit are each implemented via at least one processor.

16. An information processing method comprising:

changing, by a processor, arrangement of a first object corresponding to a first user and a second object corresponding to a second user from first arrangement to second arrangement in accordance with reproduction of a video including depth information, in a virtual space corresponding to the video; and

specifying, on a basis of the depth information, information regarding an empty space in a surrounding of a point of view at the corresponding time of recording the video for each of the respective reproduction timings of the video,

wherein changing the arrangement of the first object and the second object from the first arrangement to the second arrangement is performed in accordance with change in the depth information and change in the information regarding the empty space depending on the reproduction of the video, and

wherein the depth information indicates depth values at respective reproduction timings, each of the depth values being set to the surrounding of the point of view in the video at a corresponding time of recording the video.

17. At least one non-transitory computer-readable medium encoded with instructions which, when executed by at least one processor of an apparatus, cause the apparatus to execute a method, the method comprising:

changing arrangement of a first object corresponding to a first user and a second object corresponding to a second user from first arrangement to second arrangement in accordance with reproduction of a video including depth information, in a virtual space corresponding to the video; and

specifying, on a basis of the depth information, information regarding an empty space in a surrounding of a point of view at the corresponding time of recording the video for each of the respective reproduction timings of the video,

wherein changing the arrangement of the first object and the second object from the first arrangement to the second arrangement is performed in accordance with change in the depth information and change in the information regarding the empty space depending on the reproduction of the video, and

wherein the depth information indicates depth values at respective reproduction timings, each of the depth values being set to the surrounding of the point of view in the video at a corresponding time of recording the video.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2017
From: ISHIKAWA, TSUYOSHI
To: SONY CORPORATION
Reel/Frame 044388/0671 →
Priority Claims (1)
JP 2017-003423 · Jan 12, 2017 · national
Continuity (1)
Related Publication 20180199023A1 · Jul 12, 2018