IP Library Granted Patent US 10,638,091
Granted Patent B2
US 10,638,091 · App. 16/315,449 · Granted Apr 28, 2020

Information processing device and information processing method

Inventors: Atsushi Izumihara (Kanagawa, JP); Yusuke Sakai (Kanagawa, JP)
Assignee: Sony Corporation
H04N7/157G10L25/63H04N7/144
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,638,091
App. No.
16/315,449
Granted
Apr 28, 2020
Kind
B2
Abstract

There is provided an information processing device including a reception unit that receives data from a communication destination, a generation unit that generates spatial image information placed at a predetermined position in a three-dimensional space by using captured images of a plurality of the communication destinations, and a display control unit that performs control so as to display the generated spatial image information on a display unit.

Claims (36)

1. An information processing device, comprising:

a reception unit configured to receive data from a first communication destination, wherein the received data includes an image of the first communication destination;

a generation unit configured to:

superimpose a virtual object at a specific position in a three-dimensional space;

add the image into an opening of the virtual object; and

generate spatial image based on the addition of the image; and

a display control unit configured to control display of the generated spatial image on a display unit.

2. The information processing device according to claim 1 , wherein the generation unit is further configured to determine a communication state between the first communication destination and a second communication destination in the three-dimensional space.

3. The information processing device according to claim 2 , wherein

the generation unit is further configured to determine an activity of conversation between the first communication destination and the second communication destination, and

the display control unit is further configured to control the display of the generated spatial image on the display unit based on the activity of the conversation.

4. The information processing device according to claim 3 , wherein the generation unit is further configured to determine the activity of the conversation based on at least one of voice data or video data associated with the conversation.

5. The information processing device according to claim 2 , wherein

the generation unit is further configured to estimate a mood of conversation between the first communication destination and the second communication destination, and

the display control unit is further configured to control the display of the generated spatial image on the display unit based on the mood of the conversation.

6. The information processing device according to claim 5 , wherein the generation unit is further configured to estimate the mood based on at least one of voice data or video data associated with the conversation.

7. The information processing device according to claim 2 , wherein

the generation unit is further configured to:

determine an activity of conversation between the first communication destination and the second communication destination; and

estimate a mood of the conversation between the first communication destination and the second communication destination; and

the display control unit is further configured to control the display of the generated spatial image based on the activity of the conversation and the mood of the conversation.

8. The information processing device according to claim 1 , wherein

the display control unit is further configured to control the display of the generated spatial image inside a frame image, and

the generation unit is further configured to determine the specific position of the virtual object based on a distance between the frame image and the virtual object.

9. An information processing method, comprising:

receiving, by a processor of an information processing device, data from a communication destination, wherein the received data includes an image of the communication destination;

superimposing, by the processor, a virtual object at a specific position in a three-dimensional space;

adding, by the processor, the image into an opening of the virtual object;

generating, by the processor, spatial image based on the addition of the image; and

displaying the generated spatial image on a display unit.

10. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

receiving data from a communication destination, wherein the received data includes an image of the communication destination;

superimposing a virtual object at a specific position in a three-dimensional space;

adding the image into an opening of the virtual object;

generating spatial image based on the addition of the image; and

displaying the generated spatial image on a display unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2019
From: IZUMIHARA, ATSUSHI; SAKAI, YUSUKE
To: SONY CORPORATION
Reel/Frame 048018/0335 →
Priority Claims (1)
JP 2016-148671 · Jul 28, 2016 · national
Continuity (1)
Related Publication 20190320143A1 · Oct 17, 2019
Cited By (1)
US 12,650,752