Information processing apparatus, information processing method, and video sound output system
View Patent ↗The information processing apparatus includes a control section that detects a position of a sound source appearing in a video displayed on a screen of a display unit and that uses one or more vibrators to vibrate the display unit and thereby control output of sound such that a sound image of sound in synchronization with the video is localized at the position where the sound source appears on the screen displaying the video. In a case of displaying videos of two or more video sources on individual windows, the control section localizes a sound image of a sound source detected from the video of each video source at a position where the sound source appears in the corresponding window.
1. An information processing apparatus comprising:
circuitry configured to
detect a position of a sound source appearing in a video displayed on a screen of a display, the sound source being placed in a plane of an image frame of the video; and
control one or more vibrators to vibrate the display, and thereby control output of sound such that a sound image of sound in synchronization with the video is localized at a position corresponding to the position, on the screen displaying the image frame of the video, of the sound source placed in the plane.
2. The information processing apparatus according to claim 1 , wherein
the circuitry is configured to detect the sound source appearing in a video of broadcast or an OTT service or in an externally input video.
3. The information processing apparatus according to claim 1 , wherein
the circuitry is configured to detect the sound source appearing in a video of visual communication.
4. The information processing apparatus according to claim 1 , wherein
the circuitry is configured to detect, as the position of the sound source, a position of a graphic displayed on the screen and localize a sound image of sound related to the graphic.
5. The information processing apparatus according to claim 4 , wherein
the circuitry is configured to detect, as the position of the graphic displayed on the screen, a position of a graphic of a sound agent executed on the information processing apparatus.
6. The information processing apparatus according to claim 5 , further comprising:
a sensor configured to detect a user interacting with the sound agent, wherein
the circuitry is configured to control a display position of a character according to a position of the user.
7. The information processing apparatus according to claim 4 , wherein
the circuitry is configured to detect, as the position of the graphic displayed on the screen, a position of a graphic of OSD or UI appearing on the screen and localize a sound image of a sound effect associated with the graphics in synchronization with display of the graphics on the screen.
8. The information processing apparatus according to claim 1 , wherein,
the circuitry is configured to, in a case of displaying videos of two or more video sources on individual windows, localize a sound image of a sound source detected from the video of each video source at a position corresponding to a position of the sound source appearing in the corresponding window.
9. An information processing method comprising:
detecting a position of a sound source appearing in a video displayed on a screen of a display, the sound source being placed in a plane of an image frame of the video; and
using one or more vibrators to vibrate the display, and thereby control output of sound such that a sound image of sound in synchronization with the video is localized at a position corresponding to the position, on the screen displaying the image frame of the video, of the sound source placed in the plane.
10. A video sound output system comprising:
a display;
one or more vibrators configured to vibrate the display, and thereby output sound; and
circuitry to detect a position of a sound source appearing in a video displayed on a screen of the display, the sound source being placed in a plane of an image frame of the video, and to control the output of sound such that a sound image of sound in synchronization with the video is localized at a position corresponding to the position, on the screen displaying the image frame of the video, of the sound source placed in the plane.
11. The information processing apparatus according to claim 1 , wherein
the plane is configured such that a video signal of the video is allocated thereto and is stored in a video memory.
12. The information processing apparatus according to claim 1 , wherein
the image frame of the video comprises a plurality of planes, and
the circuitry is configured to place the sound source in one of the plurality of planes according to a type of the video including the sound source.