IP Library › Granted Patent US 10,632,915
Granted Patent B2
US 10,632,915 · App. 15/755,285 · Granted Apr 28, 2020

Surroundings monitoring apparatus

Inventors: Kinji Yamamoto (Anjo, JP); Naotaka Kubota (Kariya, JP); Kazuya Watanabe (Anjo, JP); Takayuki Nakasho (Anjo, JP)
Assignee: AISIN SEIKI KABUSHIKI KAISHA
B60R1/00B60R11/02G06T3/60H04N5/44504H04N7/18H04N7/181H04N13/111B60R2300/102B60R2300/20B60R2300/303B60R2300/307B60R2300/308B60R2300/605B60R2300/607B60R2300/8066B60R2300/8093H04N13/243
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,632,915
App. No.
15/755,285
Granted
Apr 28, 2020
Kind
B2
Abstract

A surroundings monitoring apparatus includes an image acquisition portion acquiring captured image data, an image conversion portion converting the captured image data to virtual image data with a plurality of virtual viewpoints, and a data control portion sequentially displaying the virtual image data at a display unit in a state where each of the virtual viewpoints moves from a first virtual viewpoint position at which an opposite side of the vehicle is viewed, through a second virtual viewpoint position at which the vehicle is viewed from an overhead region of the vehicle, and to a third virtual viewpoint position at which the one side of the vehicle is viewed. The data control portion rotates the virtual image data with reference to a line of sight of the virtual viewpoint while the virtual image data is displayed so that the virtual viewpoint passes through the second virtual viewpoint position.

Claims (28)

1. A surroundings monitoring apparatus comprising:

a processor configured to

acquire captured image data output from an imaging portion which is mounted at a vehicle to capture an image of surroundings of the vehicle;

convert the captured image data to virtual image data with a plurality of virtual viewpoints serving as imaging directions towards the vehicle; and

sequentially display the virtual image data at a display unit provided at a vehicle interior of the vehicle in a state where each of the virtual viewpoints moves from a first virtual viewpoint position at which an opposite side of the vehicle is viewed beyond a whole of the vehicle from one side of the vehicle, through a second virtual viewpoint position at which the vehicle is viewed from an overhead region of the vehicle, and to a third virtual viewpoint position at which the one side of the vehicle is viewed beyond the whole of the vehicle from the other side of the vehicle, wherein

the whole of the vehicle is displayed together with the virtual image data during a period when the virtual viewpoint moves from the first virtual viewpoint position, through the second virtual viewpoint position, and to the third virtual viewpoint position, and

the virtual image data is rotated with reference to a line of sight of the virtual viewpoint while the virtual image data is displayed so that the virtual viewpoint passes through the second virtual viewpoint position,

wherein the second virtual viewpoint position is positioned directly above the vehicle, and

wherein the control portion rotates the virtual image data is rotated by 180° at the second virtual viewpoint position which is positioned directly above the vehicle.

2. The surroundings monitoring apparatus according to claim 1 , wherein the third virtual viewpoint position is positioned at a rear side relative to an expected travelling direction of the vehicle in a case where the vehicle is started.

3. The surroundings monitoring apparatus according to claim 1 , wherein the image conversion portion converts the captured image data to the virtual image data by projecting the captured image data on a curved surface with reference to the position of the vehicle.

4. The surroundings monitoring apparatus according to claim 1 , wherein the captured image data is converted to the virtual image data by projecting the captured image data on a plane with reference to the position of the vehicle.

5. The surroundings monitoring apparatus according to claim 1 , wherein an image of an own vehicle is displayed by superimposing the image on the virtual image data.

6. The surroundings monitoring apparatus according to claim 1 , wherein

the virtual image data is displayed together with the vehicle so that the vehicle is between the virtual viewpoint and the virtual image data and positioned at or near center of a display area of the display unit while the virtual viewpoint moves from the first virtual viewpoint position, through the second virtual viewpoint position, and to the third virtual viewpoint position.

7. A surroundings monitoring method comprising:

acquiring captured image data output from an imaging portion which is mounted at a vehicle to capture an image of surroundings of the vehicle;

converting the captured image data to virtual image data with a plurality of virtual viewpoints serving as imaging directions towards the vehicle; and

sequentially displaying the virtual image data at a display unit provided at a vehicle interior of the vehicle in a state where each of the virtual viewpoints moves from a first virtual viewpoint position at which an opposite side of the vehicle is viewed beyond a whole of the vehicle from one side of the vehicle, through a second virtual viewpoint position at which the vehicle is viewed from an overhead region of the vehicle, and to a third virtual viewpoint position at which the one side of the vehicle is viewed beyond the whole of the vehicle from the other side of the vehicle, wherein

the whole of the vehicle is displayed together with the virtual image data during a period when the virtual viewpoint moves from the first virtual viewpoint position, through the second virtual viewpoint position, and to the third virtual viewpoint position, and

the virtual image data is rotated with reference to a line of sight of the virtual viewpoint while the virtual image data is displayed so that the virtual viewpoint passes through the second virtual viewpoint position,

wherein the second virtual viewpoint position is positioned directly above the vehicle, and

wherein the control portion rotates the virtual image data is rotated by 180° at the second virtual viewpoint position which is positioned directly above the vehicle.

8. The surroundings monitoring method according to claim 7 , wherein the third virtual viewpoint position is positioned at a rear side relative to an expected travelling direction of the vehicle in a case where the vehicle is started.

9. The surroundings monitoring method according to claim 7 , wherein the image conversion portion converts the captured image data to the virtual image data by projecting the captured image data on a curved surface with reference to the position of the vehicle.

10. The surroundings monitoring method according to claim 7 , wherein the captured image data is converted to the virtual image data by projecting the captured image data on a plane with reference to the position of the vehicle.

11. The surroundings monitoring method according to claim 7 , wherein an image of an own vehicle is displayed by superimposing the image on the virtual image data.

12. The surroundings monitoring method according to claim 7 , wherein the virtual image data is displayed together with the vehicle so that the vehicle is between the virtual viewpoint and the virtual image data and positioned at or near center of a display area of the display unit while the virtual viewpoint moves from the first virtual viewpoint position, through the second virtual viewpoint position, and to the third virtual viewpoint position.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2018
From: YAMAMOTO, KINJI; KUBOTA, NAOTAKA; WATANABE, KAZUYA; NAKASHO, TAKAYUKI
To: AISIN SEIKI KABUSHIKI KAISHA
Reel/Frame 045038/0558 →
Priority Claims (1)
JP 2015-192626 · Sep 30, 2015 · national
Continuity (1)
Related Publication 20180229657A1 · Aug 16, 2018