IP Library › Granted Patent US 11,082,660
Granted Patent B2
US 11,082,660 · App. 16/315,398 · Granted Aug 3, 2021

Information processing device and information processing method

Inventors: Daisuke Miki (Tokyo, JP); Atsushi Izumihara (Kanagawa, JP); Yusuke Sakai (Kanagawa, JP)
Assignee: SONY CORPORATION
H04N7/147G01B11/25G06T7/0002G06T7/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,082,660
App. No.
16/315,398
Granted
Aug 3, 2021
Kind
B2
Abstract

There is provided an information processing device and an information processing method capable of giving a sense of realism as if a partner connected in video communication is present in one's sight. The information processing device including a communication unit configured to transmit and receive an image to and from a communication connection destination. Further, a control unit is configured to control a display range and a position of the image, on the basis of a display size and installation position information of a display device that displays the image and distance information of a subject appearing in the image that is acquired from the image.

Claims (40)

1. An information processing device, comprising:

communication circuitry configured to transmit and receive an image to and from a communication connection destination; and

control circuitry configured to:

estimate a distance between a camera and a subject that appears in the image, wherein

the estimated distance is based on a relationship between a size of a face of the subject and at least one of an age or a sex of the subject, and

the camera is associated with the communication connection destination;

calculate an actual height from a ground to the face of the subject based on spec information of the camera and the estimated distance from the camera to the subject, wherein the spec information includes first angle-of-view information of the camera in a direction horizontal to the ground and second angle-of-view information of the camera in a direction perpendicular to the ground; and

control a display range of the image and a position of the image based on installation position information of a display device that displays the image, a display size of the display device, the calculated actual height, and

the estimated distance of the subject.

2. The information processing device according to claim 1 , wherein

the installation position information includes height information of the display device from the ground,

the control circuitry is further configured to

control execution of a life-size display of the subject based on a standing position of the subject, and

the standing position is a same position as a position of the display device.

3. The information processing device according to claim 2 , wherein

the control circuitry is further configured to determine the display range of the image based on the standing position of the subject and the face of the subject,

the face of the subject is at the actual height, and

the standing position is the same position as the position of the display device.

4. The information processing device according to claim 2 , wherein the control circuitry is further configured to

estimate the distance based on the size of the face and the age of the subject.

5. The information processing device according to claim 4 , wherein the distance between the camera and the subject is based on at least one of the age or the sex of the subject.

6. The information processing device according to claim 3 , wherein based on the face is outside the determined display range, the control circuitry is further configured to notify the communication connection destination that the face of the subject is outside the determined display range.

7. The information processing device according to claim 6 , wherein

the control circuitry is further configured to output the notification to guide the communication connection destination in a manner that the face enters the determined display range.

8. The information processing device according to claim 3 , wherein based on the determined display range includes a portion that lacks in image information, the control circuitry is further configured to control complement of the image information of the portion.

9. An information processing method, comprising:

transmitting and receiving an image to and from a communication connection destination;

estimating a distance between a camera and a subject that appears in the image, wherein

the estimated distance is based on a relationship between a size of a face of the subject and at least one of an age or a sex of the subject, and

the camera is associated with the communication connection destination;

calculating an actual height from a ground to the face of the subject based on spec information of the camera and the estimated distance from the camera to the subject, wherein the spec information includes first angle-of-view information of the camera in a direction horizontal to the ground and second angle-of-view information of the camera in a direction perpendicular to the ground; and

controlling a display range of the image and a position of the image based on installation position information of a display device that displays the image, a display size of the display device, the calculated actual height, and the estimated distance of the subject.

10. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a processor, cause the processor to execute operations, the operations comprising:

transmitting and receiving an image to and from a communication connection destination;

estimating a distance between a camera and a subject that appears in the image, wherein

the estimated distance is based on a relationship between a size of a face of the subject and at least one of an age or a sex of the subject, and

the camera is associated with the communication connection destination;

calculating an actual height from a ground to the face of the subject based on spec information of the camera and the estimated distance from the camera to the subject, wherein the spec information includes first angle-of-view information of the camera in a direction horizontal to the ground and second angle-of-view information of the camera in a direction perpendicular to the ground; and

controlling a display range of the image and a position of the image based on installation position information of a display device that displays the image, a display size of the display device, the calculated actual height, and the estimated distance of the subject.

11. The information processing device according to claim 1 , wherein the spec information further includes a first number of pixels of the image in a direction horizontal to the ground and a second number of pixels of the image in a direction perpendicular to the ground.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2019
From: MIKI, DAISUKE; IZUMIHARA, ATSUSHI; SAKAI, YUSUKE
To: SONY CORPORATION
Reel/Frame 047904/0427 →
Priority Claims (1)
JP JP2016-151268 · Aug 1, 2016 · national
Continuity (1)
Related Publication 20190313055A1 · Oct 10, 2019