IP Library Granted Patent US 10,776,641
Granted Patent B2
US 10,776,641 · App. 16/095,298 · Granted Sep 15, 2020

Information processing device and method of determining an image data displayed on the same

Inventor: Masafumi Tsuji (Kanagawa, JP)
Assignees: Nissan Motor Co., Ltd.; RENAULT S.A.S.
G06K9/00832B60K35/00B60K37/02B60R11/02B60R11/04G06K9/00228G06T7/70B60K2370/15B60K2370/70B60K2370/736G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,776,641
App. No.
16/095,298
Granted
Sep 15, 2020
Kind
B2
Abstract

An information processing device installed inside a vehicle includes a first input port inputting a first image data imaged by a first imaging device, a second input port inputting a second image data imaged by a second imaging device, a display displaying an image data, and a controller determining the image data displayed on the display in accordance with an installation location of the information processing device inside the vehicle. The controller estimates the installation location of the information processing device based on a position of a human being's face detected by the first image data and distance information to an object detected by the second image data.

Claims (36)

1. An information processing device installed inside a vehicle, comprising:

a display displaying an image data;

a first imaging device provided on a surface of the information processing device on which the display is provided;

a second imaging device provided on a surface opposite to the surface of the information processing device on which the display is provided;

a first input port inputting a first image data imaged by the first imaging device;

a second input port inputting a second image data imaged by the second imaging device; and

a controller determining the image data displayed on the display in accordance with an installation location of the information processing device inside the vehicle,

wherein the controller estimates the installation location of the information processing device based on a position of a face of a person detected by the first image data and distance information to an object detected by the second image data.

2. The information processing device according to claim 1 , wherein the image data displayed on the display is an image data of an object outside of the vehicle.

3. The information processing device according to claim 1 , wherein the controller determines an image data captured ahead of the vehicle as the image data displayed on the display when the installation location of the information processing device is estimated at an upper side as viewed from the person.

4. The information processing device according to claim 1 , wherein the controller determines navigation information or an image data of a meter panel as the image data displayed on the display when the installation location of the information processing device is estimated at a lower side as viewed from the person.

5. The information processing device according to claim 1 ,

wherein the controller:

estimates that the installation location of the information processing device is in front of a center console when the position of the face of the person imaged by the first imaging device is at upper right or upper left of a captured image;

estimates that the installation location of the information processing device is on a dashboard when the position of the face of the person imaged by the first imaging device is not at upper right or upper left of the captured image and a distance to an object acquired by the second imaging device is equal to or more than a predetermined distance, the object being located ahead of the vehicle; and

estimates that the installation location of the information processing device is in front of the dashboard when the position of the face of the person imaged by the first imaging device is not at upper right or upper left of the captured image and the distance to the object acquired by the second imaging device is less than the predetermined distance.

6. A method of determining an image data displayed on a display of an information processing device installed inside a vehicle, the method comprising:

estimating an installation location of the information processing device based on a position of a face of a person detected by a first image data captured by a first imaging device of the information processing device and distance information to an object detected by a second image data captured by a second imaging device of the information processing device; and

determining the image data displayed on the display in accordance with the installation location of the information processing device inside the vehicle,

wherein the first imaging device is provided on a surface of the information processing device on which the display is provided, and the second imaging device is provided on a surface opposite to the surface of the information processing device on which the display is provided.

7. The method according to claim 6 , wherein the image data displayed on the display is an image data of an object existed outside of the vehicle.

8. The method according to claim 6 , wherein an image data captured ahead of the vehicle is determined as the image data displayed on the display when the installation location of the information processing device is estimated at an upper side as viewed from the person.

9. The method according to claim 6 , wherein navigation information or an image data of a meter panel is determined as the image data displayed on the display when the installation location of the information processing device is estimated at a lower side as viewed from the person.

10. The method according to claim 6 , further comprising:

estimating that the installation location of the information processing device is in front of a center console when the position of the face of the person imaged by the first imaging device is at upper right or upper left of a captured image;

estimating that the installation location of the information processing device is on a dashboard when the position of the face of the person imaged by the first imaging device is not at upper right or upper left of the captured image and a distance to an object acquired by the second imaging device is equal to or more than a predetermined distance, the object being located ahead of the vehicle; and

estimating that the installation location of the information processing device is in front of the dashboard when the position of the face of the person imaged by the first imaging device is not at upper right or upper left of the captured image and the distance to the object acquired by the second imaging device is less than the predetermined distance.

11. The method according to claim 6 , comprising:

imaging the face of the person using the first imaging device provided on a surface of the information processing device on which the display is provided;

estimating the location of the information processing device based on a direction of the face of the person imaged by the first imaging device;

imaging a front side of the vehicle using the second imaging device provided on a surface opposite to the surface of the information processing device on which the display is provided; and

estimating that the location of the information processing device is in front of a meter panel when luminance of an imaging range acquired by the second imaging device varies in cooperation with a light amount selection switch of the meter panel.

12. The method according to claim 6 , comprising:

estimating the location of the information processing device as a location on a left side as viewed from the person when the face of the person imaged by the first imaging device is rightward while the vehicle is traveling straight ahead;

estimating the location of the information processing device as a location facing the person when the face of the person imaged by the first imaging device is in a front direction while the vehicle is traveling straight ahead; and

estimating the location of the information processing device as a location on a right side as viewed from the person when the face of the person imaged by the first imaging device is leftward while the vehicle is traveling straight ahead.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2024
From: RENAULT S.A.S.
To: AMPERE S.A.S.
Reel/Frame 067526/0311 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2018
From: TSUJI, MASAFUMI
To: NISSAN MOTOR CO., LTD.; RENAULT S.A.S.
Reel/Frame 047307/0266 →
Continuity (1)
Related Publication 20190095732A1 · Mar 28, 2019