IP Library Granted Patent US 9,860,486
Granted Patent B2
US 9,860,486 · App. 15/218,137 · Granted Jan 2, 2018

Communication apparatus, communication method, and communication system

Inventors: Masato Takahashi (Tokyo, JP); Hiroaki Uchiyama (Kanagawa, JP); Koji Kuwata (Kanagawa, JP); Kiyoto Igarashi (Kanagawa, JP); Tomoyuki Goto (Kanagawa, JP); Kazuki Kitazawa (Kanagawa, JP); Nobumasa Gingawa (Kanagawa, JP)
Assignee: RICOH COMPANY, LTD.
H04N7/15H04N5/23238H04N5/2628H04N7/142
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,860,486
App. No.
15/218,137
Granted
Jan 2, 2018
Kind
B2
Abstract

An apparatus includes: an acquirer acquiring an image; a locator that, upon receiving coordinate information of a specified area being a part of a video displayed on an output device connected to the other apparatus, locates coordinates on the image corresponding to the coordinate information based on association information, in which coordinates on the video and coordinates on the image are associated; a cropping part that crops, from the image, an image of an area defined by the coordinates on the image; a controller that controls directionality of a microphone array including a plurality of microphones on the apparatus so that the directionality of one microphone related to the coordinates on the image is focused to a position indicated by the coordinate on the image; and a first transmission controller that controls transmitting output information containing the cropped image and voice captured with the controlled directionality to the other apparatus.

Claims (32)

1. A communication terminal comprising:

a capturer configured to capture an image;

an acquirer configured to acquire the captured image from the capturer;

a locator configured to, upon receiving coordinate information representing coordinates of a specified area from another communication terminal in communication with the communication terminal, the specified area being a part of a displayed video displayed on an output device connected to the other communication terminal, locate coordinates on the image corresponding to the coordinate information based on association information, in which coordinates on the displayed video and coordinates on the image are associated;

a cropping part configured to crop, from the image, a cropped image of the area specified by the coordinates, on the image located by the locator;

a microphone array including a plurality of microphones arranged in a cabinet of the communication terminal along a lateral direction when viewed from the capturer;

a directionality controller configured to control directionality of the microphone array including the plurality of microphones so that the directionality of one microphone, to which the coordinates on the image located by the locator are related, amongst the plurality of microphones, is focused to a position indicated by the coordinates on the image; and

a first transmission controller configured to perform control for transmitting output information containing (i) the cropped image cropped by the cropping part, and (ii) voice captured with the directionality controlled by the directionality controller, to the other communication terminal.

2. The communication terminal according to claim 1 , wherein the association information is information, in which coordinates on the displayed video are associated with coordinates on the image for each of display modes of the output device.

3. The communication terminal according to claim 1 , wherein the directionality controller determines the one microphone, to which the coordinates on the image located by the locator are related, based on positional information indicating relationship between positions of the microphones included in the microphone array and the coordinates on the image.

4. The communication terminal according to claim 1 , wherein the image is a panoramic image created by combining a plurality of images.

5. A communication method to be performed by a communication terminal, the communication method comprising:

(a) acquiring a captured image captured by a capturer of the communication terminal;

(b) locating, upon receiving coordinate information representing coordinates of a specified area from another communication terminal in communication with the communication terminal, the specified area being a part of a displayed video displayed on an output device connected to the other communication terminal, coordinates on the image corresponding to the coordinate information based on association information, in which coordinates on the displayed video and coordinates on the image are associated;

(c) cropping, from the image, a cropped image of an area defined by the coordinates on the image located in (b);

(d) controlling directionality of a microphone array including a plurality of microphones arranged in a cabinet of the communication terminal along a lateral direction when viewed from the capturer so that the directionality of one microphone, to which the coordinates on the image located in (b) are related, of the plurality of microphones, is focused to a position indicated by the coordinates on the image; and

(e) performing control for transmitting output information containing the cropped image cropped in (c), and voice captured with the directionality controlled in (d), to the other communication terminal.

6. A communication system comprising:

a first communication terminal; and

a second communication terminal configured to exchange data with the first communication terminal,

the first communication terminal including

a capturer configured to capture an image,

an acquirer configured to acquire a captured image from the capturer,

a locator configured to, upon receiving coordinate information representing coordinates of a specified area from the second communication terminal, the specified area being a part of a displayed video displayed on an output device connected to the second communication terminal, locate coordinates on the image corresponding to the coordinate information based on association information indicating association relationship between coordinates on the displayed video and the coordinates,

a cropping part configured to crop, from the image, a cropped image of an area defined by the coordinates on the image located by the locator,

a directionality controller configured to control directionality of a microphone array including a plurality of microphones arranged in a cabinet of the first communication terminal along a lateral direction when viewed from the capturer so that the directionality of one microphone, to which the coordinates located on the image by the locator are related, amongst the plurality of microphones, is focused to a position indicated by the coordinates on the image, and

a first transmission controller configured to perform control for transmitting output information containing (i) the cropped image cropped by the cropping part, and (ii) voice captured with the directionality controlled by the directionality controller, to the second communication terminal, and

the second communication terminal including

a second transmission controller configured to perform control for transmitting the coordinate information to the first communication terminal, and

an output controller configured to perform control for outputting the output information received from the first communication terminal.

7. The communication terminal according to claim 1 , wherein the microphone array including the plurality of microphones is arranged in a fixed positional relationship relative to the capturer.

8. The communication terminal according to claim 1 , wherein each microphone amongst the plurality of microphones in the microphone array is an omnidirectional microphone and is arranged in a fixed positional relationship relative to the capturer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2016
From: TAKAHASHI, MASATO; UCHIYAMA, HIROAKI; KUWATA, KOJI; IGARASHI, KIYOTO; GOTO, TOMOYUKI; KITAZAWA, KAZUKI; GINGAWA, NOBUMASA
To: RICOH COMPANY, LTD.
Reel/Frame 039240/0402 →
Priority Claims (1)
JP 2015-153374 · Aug 3, 2015 · national
Continuity (1)
Related Publication 20170041570A1 · Feb 9, 2017