IP Library Granted Patent US 10,864,856
Granted Patent B2
US 10,864,856 · App. 16/092,334 · Granted Dec 15, 2020

Mobile body surroundings display method and mobile body surroundings display apparatus

Inventors: Yoshinori Kusayanagi (Kanagawa, JP); Takura Yanagi (Kanagawa, JP); Seigo Watanabe (Kanagawa, JP); Norimasa Kishi (Kanagawa, JP)
Assignee: Nissan Motor Co., Ltd.
B60R1/002H04N7/18G08G1/165G08G1/166G08G1/168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,864,856
App. No.
16/092,334
Granted
Dec 15, 2020
Kind
B2
Abstract

A mobile body surroundings display method is performed by a mobile body surroundings display apparatus that includes an image capturing element that acquires surroundings information on a mobile body by image capturing, a controller that creates a captured image using the surroundings information and a virtual image representing a situation around the mobile body, and a display that displays the virtual image. The method detects an attention-required range around the mobile body, creates a captured image of the attention-required range, and displays the captured image of the attention-required range on the display.

Claims (24)

1. A mobile body surroundings display method performed by a mobile body surroundings display apparatus including an image capturing element that is mounted on a mobile body and acquires surroundings information by image capturing, a controller that creates a captured image using the surroundings information and a virtual image representing a situation around the mobile body, and a display that displays the virtual image, the method comprising:

dividing the virtual image around the mobile body into a plurality of parts, calculating a level of attention for each of regions corresponding to the divided parts of the virtual image, and detecting a region the level of attention of which is equal to or above a predetermined value, as an attention-required range;

creating the captured image of the attention-required range;

displaying the attention-required range by use of the captured image, wherein the captured image is an actual captured image, and the virtual image is different from the actual captured image and is created such that information contained in the image is less than that of the actual captured image; and

displaying a synthesized image in which the attention-required range on the virtual image is replaced with the actual captured image on the display, wherein the virtual image is a computer graphic image representing the surroundings information of the mobile body.

2. The mobile body surroundings display method according to claim 1 , wherein the attention-required range is a region on a road where a vehicle and a vehicle or a vehicle and a person travel across each other.

3. The mobile body surroundings display method according to claim 1 , comprising:

detecting an attention-required object around the mobile body;

when detecting the attention-required object, detecting a region including the attention-required object as the attention-required range; and

displaying the attention-required range by use of the captured image.

4. The mobile body surroundings display method according to claim 1 , comprising:

detecting an attention-required object around the mobile body within the attention-required range;

when detecting the attention-required object within the attention-required range, detecting a region including the attention-required object as a highlight portion; and

displaying the highlight portion by use of the captured image.

5. The mobile body surroundings display method according to claim 3 , wherein the attention-required object is a pedestrian, an animal, a bicycle, a vehicle, or a road sign located around the mobile body.

6. A mobile body surroundings display apparatus comprising:

an image capturing element that is mounted on a mobile body and acquires surroundings information by image capturing;

a controller that creates a captured image using the surroundings information and a virtual image representing a situation around the mobile body; and

a display that displays the virtual image, wherein:

the controller divides the virtual image around the mobile body into a plurality of parts, calculates a level of attention for each of regions corresponding to the divided parts of the virtual image, detects a region the level of attention of which is equal to or above a predetermined value, as an attention-required range, creates the captured image of the attention-required range detected, and displays the captured image of the attention-required range on the display;

the captured image is an actual captured image;

the virtual image is different from the actual captured image and is created such that information contained in the image is less than that of the actual captured image;

the controller displays a synthesized image in which the attention-required range on the virtual image is replaced with the actual captured image on the display; and

the virtual image is a computer graphic image representing the surroundings information of the mobile body.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2018
From: KUSAYANAGI, YOSHINORI; YANAGI, TAKURA; WATANABE, SEIGO; KISHI, NORIMASA
To: NISSAN MOTOR CO., LTD.
Reel/Frame 047107/0449 →
Continuity (1)
Related Publication 20190337455A1 · Nov 7, 2019
Cited By (1)
US 12,233,782