IP Library Granted Patent US 10,057,706
Granted Patent B2
US 10,057,706 · App. 14/850,414 · Granted Aug 21, 2018

Information processing device, information processing system, control method, and program

Inventor: Masaomi Nishidate (Tokyo, JP)
Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
H04S7/303H04R1/403H04R2201/025H04S2400/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,057,706
App. No.
14/850,414
Granted
Aug 21, 2018
Kind
B2
Abstract

An information processing device includes: a reflecting surface determining section configured to determine a reflecting surface as an object for reflecting a sound; a reflecting surface information obtaining section configured to obtain reflecting surface information indicating a reflection characteristic of the determined reflecting surface; and an output control portion configured to output a directional sound according to the obtained reflecting surface information to the determined reflecting surface.

Claims (54)

1. An information processing device comprising:

a reflecting surface determining section configured to determine a sound reflecting surface as an object reflecting a sound while the information processing device is concurrently outputting audio,

wherein the sound reflecting surface determining section determines the sound reflecting surface by:

a) obtaining an image of a room captured by a camera;

b) identifying a position of a user in the room using the image;

c) dividing the image into a plurality of zones;

d) identifying the sound reflecting surface to be used in a zone from the plurality of zones; and

e) periodically repeating steps a) to d) to determine if the sound reflecting surface has changed or if the position of the user blocks the sound reflecting surface;

a sound reflecting surface information obtaining section configured to obtain sound reflecting surface information indicating a sound reflection characteristic of the determined sound reflecting surface by determining a material of the sound reflecting surface from the image; and

an output control portion configured to output a directional sound toward the identified sound reflecting surface according to the obtained sound reflecting surface information.

2. The information processing device according to claim 1 ,

wherein the reflecting surface information obtaining section obtains a sound reflectance value of the sound reflecting surface as the sound reflecting surface information using the image.

3. The information processing device according to claim 2 ,

wherein the output control portion determines an output volume of the directional sound according to the obtained sound reflectance value.

4. The information processing device according to claim 1 ,

wherein the sound reflecting surface information obtaining section obtains, as the sound reflecting surface information, an angle of incidence at which the directional sound is incident on the sound reflecting surface by calculating the angle of incidence from the image.

5. The information processing device according to claim 4 ,

wherein the output control portion determines an output volume of the directional sound according to the obtained angle of incidence.

6. The information processing device according to claim 1 ,

wherein the sound reflecting surface information obtaining section obtains, as the sound reflecting surface information, an arrival distance to be traveled by the directional sound before arriving at a user via the sound reflecting surface reflecting the directional sound,

wherein the arrival distance is periodically calculated and updated using the images from the camera.

7. The information processing device according to claim 6 ,

wherein the output control portion determines an output volume of the directional sound according to the obtained arrival distance.

8. The information processing device according to claim 1 ,

wherein the sound reflecting surface information obtaining section obtains the sound reflecting surface information of each of a plurality of candidate sound reflecting surfaces as candidates for the sound reflecting surface by analyzing the plurality of zones, and

the information processing device further includes a sound reflecting surface selecting section configured to select a candidate sound reflecting surface having a greatest sound reflection characteristic indicated by the sound reflecting surface information of the candidate sound reflecting surface among the plurality of candidate sound reflecting surfaces.

9. An information processing system comprising:

a directional speaker configured to make a nondirectional sound generated by making a directional sound reflected by a predetermined sound reflecting surface reach a user;

a sound reflecting surface determining section configured to determine the sound reflecting surface as an object reflecting the directional sound by:

a) obtaining an image of a room captured by a camera;

b) identifying a position of a user in the room using the image;

c) dividing the image into a plurality of zones;

d) identifying the sound reflecting surface in a zone from the plurality of zones; and

e) periodically repeating steps a) to d) to determine if the sound reflecting surface has changed or if the position of the user blocks the sound reflecting surface;

a sound reflecting surface information obtaining section configured to obtain sound reflecting surface information indicating a sound reflection characteristic of the determined sound reflecting surface by determining a material of the sound reflecting surface from the image; and

an output control portion configured to output the directional sound from the directional speaker toward the identified sound reflecting surface according to the obtained sound reflecting surface information.

10. A control method for outputting directional audio comprising:

periodically obtaining an image of a room captured by a camera;

for each captured image

a) identifying a position of a user in the room using the image;

b) dividing the image into a plurality of zones;

c) identifying a sound reflecting surface in each of the plurality of zones

d) obtaining sound reflecting surface information for each identified reflecting surface by determining a material of the sound reflecting surface from the image;

e) outputting a directional sound to each of the identified sound reflecting surfaces according to the obtained sound reflecting surface information.

11. A non-transitory computer readable medium having stored thereon a program for a computer, the program comprising:

by a sound reflecting surface determining section, determining a sound reflecting surface as an object reflecting a sound while the computer is concurrently outputting audio,

wherein the sound reflecting surface determining section determines the sound reflecting surface by:

a) obtaining an image of a room captured by a camera;

b) identifying a position of a user in the room using the image;

c) dividing the image into a plurality of zones;

d) identifying the sound reflecting surface in a zone from the plurality of zones; and

e) periodically repeating steps a) to d) to determine if the sound reflecting surface has changed or if the position of the user blocks the sound reflecting surface;

by a sound reflecting surface information obtaining section, obtaining sound reflecting surface information indicating a sound reflection characteristic of the determined sound reflecting surface by determining a material of the sound reflecting surface from the image; and

by a sound output control portion, outputting a directional sound toward the determined sound reflecting surface according to the obtained sound reflecting surface information.

Assignments (2)
CHANGE OF NAME Recorded Apr 4, 2018
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 045435/0114 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 10, 2015
From: NISHIDATE, MASAOMI
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 036534/0810 →
Priority Claims (1)
JP 2014-239088 · Nov 26, 2014 · national
Continuity (1)
Related Publication 20160150314A1 · May 26, 2016