IP Library Granted Patent US 11,042,757
Granted Patent B2
US 11,042,757 · App. 16/331,799 · Granted Jun 22, 2021

Image processing device and image capturing apparatus

Inventors: Keisuke Inata (Tokyo, JP); Satoshi Sano (Tokyo, JP); Shinichi Nonaka (Hitachinaka, JP)
Assignee: HITACHI AUTOMOTIVE SYSTEMS, LTD.
G06K9/00791G01C21/26G01C21/265G06T1/00G06T7/00G06T7/20G06T7/50G06T7/55G06T7/60G08G1/16H04N5/225H04N5/232H04N7/18H04N7/181G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,042,757
App. No.
16/331,799
Granted
Jun 22, 2021
Kind
B2
Abstract

An image processing device mounted to a vehicle includes a motion feature extracting unit is configured to create motion information indicative of a motion of an observation target from a captured image including the observation target around the vehicle, a distance feature extracting unit is configured to calculate a distance from the vehicle to the observation target based on the captured image, and a recognition unit is configured to execute a recognition process of the observation target based on process results of the motion feature extracting unit and the distance feature extracting unit. The motion feature extracting unit and the distance feature extracting unit have respective operation processing amounts changed based on a predetermined vehicle state.

Claims (36)

1. An image processing device mounted to a vehicle, comprising:

a memory;

an input/output device; and

a processor communicatively coupled to the memory and the input/output device, wherein the processor is configured to:

create motion information indicative of a motion of an observation target from a captured image including the observation target around the vehicle;

calculate a distance from the vehicle to the observation target based on the captured image; and

execute a recognition process of the observation target based on process results of the motion information created and the distance calculated,

wherein an operation processing amount of creating the motion information and an operation processing amount of calculating the distance is changed based on a predetermined vehicle state,

wherein the operation processing amount of creating the motion information and the operation processing amount of calculating the distance on a condition are inverse amounts.

2. The image processing device according to claim 1 ,

wherein the processor is further configured to determine proportions of the operation processing amount of creating the motion information and proportions of the operation processing amount of calculating the distance based on the predetermined vehicle state,

wherein according to the proportions of the operation processing amount of creating the motion information and proportions of the operation processing amount of calculating the distance determined by the processor, the operation processing amount of creating the motion information and the operation processing amount of calculating the distance are changed.

3. The image processing device according to claim 1 ,

wherein the image processing device is coupled to a plurality of cameras,

the processor is configured to create the motion information based on the captured image obtained with any of the plurality of cameras, and

the processor is configured to calculate the distance to the observation target based on the respective captured images obtained with any of two or more of the plurality of cameras.

4. The image processing device according to claim 1 ,

wherein the predetermined vehicle state includes a vehicle speed of the vehicle.

5. The image processing device according to claim 1 ,

wherein the predetermined vehicle state includes a running mode of the vehicle.

6. The image processing device according to claim 1 ,

wherein the predetermined vehicle state includes map information according to a position of the vehicle on a map.

7. The image processing device according to claim 1 ,

wherein the predetermined vehicle state includes a traffic situation of a road on which the vehicle is running.

8. The image processing device according to claim 2 ,

wherein the predetermined vehicle state includes a vehicle speed of the vehicle, and

the processor is configured, such that when the vehicle speed of the vehicle falls below a predetermined value, to set the operation processing amount of creating the motion information to be relatively higher than in the case where the vehicle speed of the vehicle is equal to or more than the predetermined value.

9. An image capturing apparatus comprising:

the image processing device including: a memory, an input/output device, and a processor communicatively coupled to the memory and the input/output device; and

one or two or more cameras coupled to the image processing device, the one or two or more cameras being configured to obtain a captured image,

wherein the processor is configured to:

create motion information indicative of a motion of an observation target from the captured image including the observation target around the vehicle,

calculate a distance from the vehicle to the observation target based on the captured image, and

execute a recognition process of the observation target based on process results of the motion information created and the distance calculated,

wherein an operation processing amount of creating the motion information and an operation processing amount of calculating the distance is changed based on a predetermined vehicle state,

wherein the operation processing amount of creating the motion information and the operation processing amount of calculating the distance on a condition are inverse amounts.

Assignments (2)
CHANGE OF NAME Recorded Nov 22, 2021
From: HITACHI AUTOMOTIVE SYSTEMS, LTD.
To: HITACHI ASTEMO, LTD.
Reel/Frame 058598/0321 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2020
From: INATA, KEISUKE; SANO, SATOSHI; NONAKA, SHINICHI
To: HITACHI AUTOMOTIVE SYSTEMS, LTD.
Reel/Frame 054729/0403 →
Priority Claims (1)
JP JP2016-189307 · Sep 28, 2016 · national
Continuity (1)
Related Publication 20190244037A1 · Aug 8, 2019