IP Library › Granted Patent US 10,511,807
Granted Patent B2
US 10,511,807 · App. 15/778,721 · Granted Dec 17, 2019

Information processing apparatus, information processing method, and program

Inventors: Yusuke Sakai (Kanagawa, JP); Atsushi Izumihara (Kanagawa, JP); Daisuke Miki (Tokyo, JP)
Assignee: Sony Corporation
H04N7/15G10L21/0324H04M11/00H04N7/157H04R3/00H04S7/303
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,511,807
App. No.
15/778,721
Granted
Dec 17, 2019
Kind
B2
Abstract

To provide an information processing apparatus, an information processing method, and a program capable of aurally producing distance in a virtual three-dimensional space by using the space for a connection to a communication partner, and realizing more comfortable communication. An information processing apparatus including: a reception unit configured to receive data from a communication destination; and a reproduction control unit configured to perform control such that sound data of a space of the communication destination is reproduced from a sound output unit in a space of a communication source with an output value in accordance with separation distance between the communication destination and the communication source disposed in a virtual three-dimensional space, the output value being different for each sound source type.

Claims (26)

1. An information processing apparatus comprising:

a reception unit configured to receive space data from a communication destination; and

a reproduction control unit configured to perform control such that sound data of a space of the communication destination is reproduced from a sound output unit in a space of a communication source with an output value in accordance with a separation distance between the communication destination and the communication source disposed in a virtual three-dimensional space, the output value being different for each sound source type.

2. The information processing apparatus according to claim 1 , further comprising:

a distance control unit configured to control virtual separation distance between the communication source and the communication destination in the three-dimensional space, wherein

the distance control unit controls the separation distance in accordance with a connection degree adjusted on a basis of a connection request level from the communication source and a connection request level from the communication destination.

3. The information processing apparatus according to claim 2 , wherein

the connection request level is calculated in accordance with a context of a user, the context being determined on a basis of space information.

4. The information processing apparatus according to claim 1 , wherein

the sound data of the space of the communication destination is sound data received by the reception unit from the communication destination, or sound data extracted from a predetermined database on a basis of the data received by the reception unit from the communication destination.

5. The information processing apparatus according to claim 1 , wherein

the reproduction control unit performs control such that uttered sound data and object sound data of the space of the communication destination increase and environment sound in the space of the communication destination decreases as the space of the communication destination is closer to the space of the communication source disposed in the three-dimensional space, and performs control such that the uttered sound data and the object sound data decrease and the environment sound increases as the space of the communication destination is more distant from the space of the communication source disposed in the three-dimensional space.

6. The information processing apparatus according to claim 5 , wherein

the reproduction control unit performs sound image localization control such that the uttered sound data and the object sound data of the sound data are reproduced at corresponding sound image positions, and performs control such that the environment sound is reproduced from a whole of a reference plane of the space of the communication source.

7. The information processing apparatus according to claim 1 , further comprising:

a sound source separation unit configured to perform sound source separation for sound data acquired from the space of the communication source; and

a transmission unit configured to transmit data including the sound data subjected to the sound source separation to the communication destination, the data being acquired from the space of the communication source.

8. The information processing apparatus according to claim 1 , further comprising:

a generation unit configured to generate space image information in which an image corresponding to the space of the communication destination is disposed at a predetermined position corresponding to the separation distance in the three-dimensional space; and

a display control unit configured to perform control such that the generated space image information is displayed on a display unit in the space of the communication source.

9. An information processing method performed by a processor, the method comprising:

receiving space data from a communication destination; and

performing control such that sound data of a space of the communication destination is reproduced from a sound output unit in a space of a communication source with an output value in accordance with a separation distance between the communication destination and the communication source disposed in a virtual three-dimensional space, the output value being different for each sound source type.

10. A non-transitory computer readable medium storing instructions that when executed by a processor cause the processor:

receive space data from a communication destination; and

perform control such that sound data of a space of the communication destination is reproduced from a sound output unit in a space of a communication source with an output value in accordance with a separation distance between the communication destination and the communication source disposed in a virtual three-dimensional space, the output value being different for each sound source type.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2018
From: SAKAI, YUSUKE; IZUMIHARA, ATSUSHI; MIKI, DAISUKE
To: SONY CORPORATION
Reel/Frame 045902/0639 →
Priority Claims (1)
JP 2015-242438 · Dec 11, 2015 · national
Continuity (1)
Related Publication 20180352193A1 · Dec 6, 2018
Cited By (1)
US 12,650,752