IP Library Granted Patent US 10,810,448
Granted Patent B2
US 10,810,448 · App. 16/307,557 · Granted Oct 20, 2020

Image-capturing device

Inventors: Shinichi Nonaka (Hitachinaka, JP); Tatsuhiko Monji (Hitachinaka, JP)
Assignee: Hitachi Automotive Systems, Ltd.
G06K9/00805B60R21/00B60W40/10B60W50/029G01B11/00G01S13/931G06K9/00798G06K9/3241
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,810,448
App. No.
16/307,557
Granted
Oct 20, 2020
Kind
B2
Abstract

The present invention provides an image-capturing device capable of fulfilling a complementary role to a vehicle behavior sensor when a failure occurs in the vehicle behavior sensor. The invention is characterized by being provided with: an image acquisition unit for acquiring images of the surroundings of a vehicle; a vehicle behavior inference unit for inferring vehicle behavior information on the basis of the images acquired by the image acquisition unit; a vehicle behavior acquisition unit for acquiring vehicle behavior information which has been detected by a vehicle behavior sensor; and an abnormality detection unit for detecting an abnormality in the vehicle behavior sensor by comparing the behavior information acquired by the vehicle behavior acquisition unit and the behavior information inferred by the vehicle behavior inference unit.

Claims (50)

1. An image-capturing device comprising:

an image acquisition unit for acquiring images of surroundings of a vehicle;

a vehicle behavior inference unit for inferring behavior information of the vehicle on the basis of the images acquired by the image acquisition unit;

a vehicle behavior acquisition unit for acquiring behavior information of the vehicle which has been detected by a vehicle behavior sensor; and

an abnormality detection unit for detecting an abnormality in the vehicle behavior sensor by comparing the behavior information acquired by the vehicle behavior acquisition unit and the behavior information inferred by the vehicle behavior inference unit.

2. The image-capturing device according to claim 1 , further comprising:

a vehicle behavior information selection unit for selecting either one piece of the behavior information acquired by the vehicle behavior acquisition unit or the behavior information inferred by the vehicle behavior inference unit when an abnormality is detected by the abnormality detection unit.

3. The image-capturing device according to claim 2 , further comprising:

an external information extraction unit for extracting external information from the images acquired by the image acquisition unit; and

a control method determination unit for determining a control content of the vehicle on the basis of the behavior information selected by the vehicle behavior information selection unit and the external information extracted by the external information extraction unit.

4. The image-capturing device according to claim 3 ,

wherein the vehicle behavior sensor is one of a plurality of vehicle behavior sensors,

the vehicle behavior acquisition unit acquires behavior information of the vehicle detected by each of the plurality of vehicle behavior sensors,

when an abnormality is detected in one of the plurality of vehicle behavior sensors, the abnormality detection unit performs diagnosis on another vehicle behavior sensor by comparing the behavior information of the vehicle detected by the other vehicle behavior sensor other than the one of the plurality of vehicle behavior sensors acquired by the vehicle behavior acquisition unit and the behavior information inferred by the vehicle behavior inference unit, and

the control method determination unit determines the control content on the basis of the diagnosis result of the other vehicle behavior sensor by the abnormality detection unit.

5. The image-capturing device according to claim 4 ,

wherein the control method determination unit determines the control content on the basis of the behavior information of the vehicle detected by the other vehicle behavior sensor when the diagnosis result of the other vehicle behavior sensor by the abnormality detection unit is good.

6. The image-capturing device according to claim 4 ,

wherein the control method determination unit determines the control content on the basis of the behavior information inferred by the vehicle behavior inference unit when the diagnosis result of the other vehicle behavior sensor by the abnormality detection unit is not good.

7. The image-capturing device according to claim 3 ,

wherein the image acquisition unit comprises a plurality of image-capturing units, and

the external information extraction unit extracts external information from images acquired by the plurality of image-capturing units.

8. The image-capturing device according to claim 1 ,

wherein the image acquisition unit comprises a plurality of image-capturing units, and

the vehicle behavior inference unit infers behavior information of the vehicle on the basis of images acquired by the plurality of image-capturing units.

9. An image-capturing device comprising:

an image acquisition unit that is configured to acquire images of surroundings of a vehicle;

a vehicle behavior inference unit that is configured to infer behavior information of the vehicle on the basis of the images acquired by the image acquisition unit;

a vehicle behavior acquisition unit that is configured to acquire behavior information of the vehicle which has been detected by a vehicle behavior sensor; and

an abnormality detection unit that is configured to detect an abnormality in the vehicle behavior sensor by comparing the behavior information acquired by the vehicle behavior acquisition unit to the behavior information inferred by the vehicle behavior inference unit.

10. The image-capturing device according to claim 9 , further comprising:

a vehicle behavior information selection unit that is configured to select either one piece of the behavior information acquired by the vehicle behavior acquisition unit or the behavior information inferred by the vehicle behavior inference unit when an abnormality is detected by the abnormality detection unit.

11. The image-capturing device according to claim 10 , further comprising:

an external information extraction unit that is configured to extract external information from the images acquired by the image acquisition unit; and

a control method determination unit that is configured to determine a control content of the vehicle on the basis of the behavior information selected by the vehicle behavior information selection unit and the external information extracted by the external information extraction unit.

12. The image-capturing device according to claim 11 ,

wherein the vehicle behavior sensor is one of a plurality of vehicle behavior sensors,

the vehicle behavior acquisition unit is configured to acquire behavior information of the vehicle detected by each of the plurality of vehicle behavior sensors,

when an abnormality is detected in one of the plurality of vehicle behavior sensors, the abnormality detection unit is configured to diagnose on another vehicle behavior sensor by comparing the behavior information of the vehicle detected by the other vehicle behavior sensor other than the one of the plurality of vehicle behavior sensors acquired by the vehicle behavior acquisition unit and the behavior information inferred by the vehicle behavior inference unit, and

the control method determination unit is configured to determine the control content on the basis of the diagnosis result of the other vehicle behavior sensor by the abnormality detection unit.

13. The image-capturing device according to claim 12 ,

wherein the control method determination unit is configured to determine the control content on the basis of the behavior information of the vehicle detected by the other vehicle behavior sensor when the diagnosis result of the other vehicle behavior sensor by the abnormality detection unit is good.

14. The image-capturing device according to claim 12 ,

wherein the control method determination unit is configured to determine the control content on the basis of the behavior information inferred by the vehicle behavior inference unit when the diagnosis result of the other vehicle behavior sensor by the abnormality detection unit is not good.

15. The image-capturing device according to claim 1 ,

wherein the image acquisition unit comprises a plurality of image-capturing units, and

the external information extraction unit is configured to extract external information from images acquired by the plurality of image-capturing units.

16. The image-capturing device according to claim 9 ,

wherein the image acquisition unit comprises a plurality of image-capturing units, and

the vehicle behavior inference unit is configured to inter behavior information of the vehicle on the basis of images acquired by the plurality of image-capturing units.

Assignments (2)
CHANGE OF NAME Recorded Nov 30, 2021
From: HITACHI AUTOMOTIVE SYSTEMS, LTD.
To: HITACHI ASTEMO, LTD.
Reel/Frame 058481/0935 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2018
From: NONAKA, SHINICHI; MONJI, TATSUHIKO
To: HITACHI AUTOMOTIVE SYSTEMS, LTD.
Reel/Frame 047703/0299 →