IP Library Granted Patent US 10,366,541
Granted Patent B2
US 10,366,541 · App. 15/656,787 · Granted Jul 30, 2019

Vehicle backup safety mapping

Inventors: David M. Herman (Southfield, MI); David A. Herman (Southfield, MI)
Assignee: Ford Global Technologies, LLC
G06T19/006B60R1/00B60R1/12G06K9/00805G06K9/6267G06K9/78H04N5/23293H04N7/181B60K2350/106B60K2350/1088B60K2350/2013B60K2350/2017B60K2350/2065B60K2350/352B60R2001/1253B60R2300/105B60R2300/301B60R2300/308B60R2300/806B60R2300/8033B60R2300/8093
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,366,541
App. No.
15/656,787
Granted
Jul 30, 2019
Kind
B2
Abstract

Method and apparatus are disclosed for vehicle backup safety mapping. An example vehicle includes a display, a rear-view camera, and a processor. The processor generates a three-dimensional model of space behind the vehicle based on images from the rear-view camera The processor also generates an overlay based on the three-dimensional model. The overlay includes representation of objects not in the field of view of the rear-view camera. Additionally, the processor displays, on the display, the images from the rear-view camera and the overlay.

Claims (28)

1. A vehicle comprising:

a display;

vehicle position sensors;

a rear-view camera; and

a processor to:

generate a three-dimensional model of space behind the vehicle based on images from the rear-view camera;

track a location of the vehicle and the field of view of the rear-view camera in relation to the three-dimensional model of the space behind the vehicle based on measurements from the vehicle position sensors;

generate an overlay based on the three-dimensional model, the overlay including representation of objects not in a present field of view of the rear-view camera; and

display, on the display, the images from the rear-view camera and the overlay.

2. The vehicle of claim 1 , including a range detection sensor, and wherein the processor is to generate the three-dimensional model of the space behind the vehicle based on the images from the rear-view camera and measurements from the range detection sensor.

3. The vehicle of claim 2 , including side-view mirror cameras, and wherein the processor is to generate the three-dimensional model of the space behind the vehicle based on the images from the rear-view camera, the measurements from the range detection sensor, and images from the side-view mirror cameras.

4. The vehicle of claim 1 , wherein the overlay includes a cross-section of the model indicating edges of objects within the model.

5. The vehicle of claim 1 , wherein the processor is to classify objects detected by the rear-view camera.

6. The vehicle of claim 5 , wherein the overlay includes:

boxes around the objects extending into a portion of the overlay with representations of the objects not in the field of view of the rear-view camera; and

labels associated with the boxes identifying the corresponding objects.

7. The vehicle of claim 1 , wherein the processor is to provide an alert via an infotainment system when one of the objects is identified as a hazard.

8. The vehicle of claim 1 , wherein the processor is to provide an alert via an infotainment system when the vehicle comes within a threshold distance to an edge of one of the objects according to the model.

9. The vehicle of claim 1 , wherein the overlay includes a first indicia demarcating surfaces that are not in the field of view of the rear-view camera, and a second indicia demarcating surfaces that are in motion.

10. A method to assist a reverse moving vehicle, the method comprising:

generating, with a processor, a three-dimensional model of space behind the vehicle based on images from a rear-view camera;

generating an overlay based on the three-dimensional model, the overlay including a cross-section of the model representing edges of surfaces within the model;

displaying, on a center console display, the images from the rear-view camera and the overlay; and

providing an alert via an infotainment system when (i) one of the surfaces in the model is identified as belonging to a hazard or (ii) when the vehicle comes within a threshold distance to one of the surfaces according to the model.

11. The method of claim 10 , wherein generating the three-dimensional model of the space is also based on measurements from range detection sensors; and wherein the three-dimensional model of the space also includes areas to the side of the vehicle observable from the range detection sensors.

12. The method of claim 11 , wherein generating the three-dimensional model of the space is also based on the images from side-view mirror cameras, and wherein the three-dimensional model of the space also includes the areas to the side of the vehicle observable from the side-view mirror cameras.

13. The method of claim 10 , including tracking a location of the vehicle and a field of view of the rear-view camera in relation to the three-dimensional model of the space behind the vehicle based on measurements from vehicle position sensors.

14. The method of claim 10 , wherein the overlay includes a first indicia demarcating the surfaces that are not in a field of view of the rear-view camera, and a second indicia demarcating the surfaces that are in motion.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2017
From: HERMAN, DAVID M.; HERMAN, DAVID A.
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 043302/0211 →
Continuity (1)
Related Publication 20190026947A1 · Jan 24, 2019