IP Library Granted Patent US 9,598,012
Granted Patent B2
US 9,598,012 · App. 14/205,296 · Granted Mar 21, 2017

Surroundings monitoring system for a vehicle

Inventors: Katsumi Nagata (Ann Arbor, MI); Charan Lota (Canton, MI)
Assignee: Toyota Motor Engineering & Manufacturing North America, Inc.
B60R1/00H04N7/181B60R2300/102B60R2300/105B60R2300/301B60R2300/605
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,598,012
App. No.
14/205,296
Granted
Mar 21, 2017
Kind
B2
Abstract

A surroundings monitoring system includes a first sensor subsystem operable to provide image data from around the vehicle; a second sensor subsystem operable to provide non-image data from around the vehicle; a control subsystem in communication with the first sensor subsystem and the second sensor subsystem, the control subsystem operable to generate manipulated image data symbology from the image data and arrange the manipulated image data symbology in response to the non-image data to generate a driver perspective view; and a display in communication with the control subsystem to display the driver perspective view. A method of monitoring surroundings for use in a vehicle includes obtaining image data from around the vehicle; obtaining non-image data from around the vehicle; manipulating the image data in response to the non-image data to generate a driver perspective view; and displaying the driver perspective view.

Claims (26)

1. A surroundings monitoring system for use in a vehicle, comprising:

a first sensor subsystem operable to provide image data from around the vehicle; a second sensor subsystem operable to provide non-image data from around the vehicle;

a control subsystem in communication with the first sensor subsystem and the second sensor subsystem, the control subsystem operable to:

when a view from the first sensor subsystem is obscured with respect to targets around the vehicle, generate representative symbology that schematically portrays the targets,

when a view from the first sensor subsystem is unobscured with respect to targets around the vehicle, generate, from images of the targets in the image data, manipulated image data symbology that portrays only the targets, from a driver perspective, and

based on ranging data for the targets in the non-image data, horizontally spatially arrange the generated representative and manipulated image data symbology around a central vehicle symbol in an overhead view around the vehicle that portrays, via the horizontal spatial arrangement of the generated representative and manipulated image data symbology around the central vehicle symbol, the relative positions of the targets around the vehicle in a horizontal plane; and

a display subsystem in communication with the control subsystem and located within the vehicle operable to display the overhead view around the vehicle.

2. The system as recited in claim 1 , wherein the image data includes video.

3. The system as recited in claim 1 , wherein the first sensor subsystem includes a multiple of first sensors that respectively provide image data from each of a front, passenger side, rear, and driver side of the vehicle.

4. The system as recited in claim 3 , wherein each of the multiple of first sensors includes at least one of a camera, a charge coupled device, a forward looking infrared, and a thermal system.

5. The system as recited in claim 1 , wherein the second sensor subsystem includes a multiple of second sensors that respectively provide non-image data from each of a front, passenger side, rear, and driver side of the vehicle.

6. The system as recited in claim 1 , wherein each of the multiple of second sensors includes at least one of RADAR, SONAR, laser, and LIDAR.

7. The system as recited in claim 1 , wherein the display subsystem is located within a human-machine interface within the vehicle.

8. The system as recited in claim 1 , wherein the display subsystem is located on a windshield within the vehicle.

9. The system as recited in claim 1 , wherein the control subsystem is operable to horizontally spatially arrange the generated representative and manipulated image data symbology to focus upon a target in response to the non-image data.

10. The system as recited in claim 1 , wherein the control subsystem is operable to extract the images of the targets from their surroundings in the image data to generate the manipulated image data symbology.

11. The system as recited in claim 1 , wherein the overhead view is a three-hundred and sixty degree overhead view around the vehicle.

12. A method of monitoring surroundings for use in a vehicle, comprising:

obtaining image data from around the vehicle from a first sensor subsystem;

obtaining non-image data from around the vehicle from a second sensor subsystem;

when a view from the first sensor subsystem is obscured with respect to targets around the vehicle, generate representative symbology that schematically portrays the targets, when a view from the first sensor subsystem is unobscured with respect to targets around the vehicle, generating, from images of the targets in the image data, manipulated image data symbology that portrays only the targets, from a driver perspective;

based on ranging data for the targets in the non-image data, horizontally spatially arranging the generated representative and manipulated image data symbology around a central vehicle symbol in an overhead view around the vehicle that portrays, via the horizontal spatial arrangement of the generated representative and manipulated image data symbology around the central vehicle symbol, the relative positions of the targets around the vehicle in a horizontal plane; and

displaying the overhead view around the vehicle.

13. The method as recited in claim 12 , further comprising:

extracting the images of the targets from their surroundings in the image data to generate the manipulated image data symbology.

14. The method as recited in claim 12 , wherein the overhead view is a three-hundred and sixty degree overhead view around the vehicle.

Assignments (2)
CHANGE OF ADDRESS Recorded Nov 30, 2018
From: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
Reel/Frame 047688/0784 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2014
From: NAGATA, KATSUMI; LOTA, CHARAN
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
Reel/Frame 032499/0224 →
Continuity (1)
Related Publication 20150258935A1 · Sep 17, 2015