IP Library Granted Patent US 10,037,595
Granted Patent B2
US 10,037,595 · App. 15/170,361 · Granted Jul 31, 2018

Image processing device and image processing method

Inventors: Kouei Kiyo (Kobe, JP); Satoru Matsuyama (Kobe, JP); Shinichi Moriyama (Kobe, JP); Goro Asai (Toyota, JP); Masato Okuda (Okazaki, JP); Yohei Satomi (Okazaki, JP); Yuka Shidochi (Toyota, JP)
Assignees: FUJITSU TEN LIMITED; TOYOTA JIDOSHA KABUSHIKI KAISHA
G06T3/4038B60R1/00G06T3/0068H04N5/23293H04N5/247H04N7/181B60R2300/105B60R2300/303B60R2300/602
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,037,595
App. No.
15/170,361
Granted
Jul 31, 2018
Kind
B2
Abstract

An image processing device according to an embodiment includes a display control unit, a pattern specification unit, and a pattern collating unit. The display control unit generates a composite image that is a surrounding image of a vehicle viewed from a virtual viewpoint, based on images input from in-vehicle cameras, and displays thereof on a display unit. The pattern specification unit specifies an image pattern to be output as the input image among image patterns, for each in-vehicle camera. The pattern collating unit determines whether all image pattern responses from the in-vehicle cameras match with the image pattern. The display control unit displays a certain preparation image on the display unit when the display switching condition to the composite image is satisfied, and displays the composite image thereon instead of the preparation image, when the pattern collating unit determines that all the image pattern responses match with the image pattern.

Claims (28)

1. An image processing device,

the image processing device comprising a processor configured to:

specify as an image pattern for each of a plurality of in-vehicle cameras, an image area that is obtained by selecting a certain area from anions image areas of an image captured by the corresponding in-vehicle camera and is to be output as an input image of the corresponding in-vehicle camera;

in response to the image pattern being specified, receive the image areas respectively transmitted from the plurality of in-vehicle cameras along with respective image pattern responses;

generate a composite image that is a surrounding image of a vehicle viewed from a virtual viewpoint, based on the image areas received from the plurality of in-vehicle cameras;

determine whether all of the image pattern responses transmitted from the in-vehicle cameras match with the specified image pattern; and

display a certain preparation image when a display switching condition to the composite image is satisfied, and display the composite image instead of the preparation image, when it is determined that all of the image pattern responses match with the specified image pattern.

2. The image processing device according to claim 1 , wherein the processor is further configured to display the composite image without performing the determination, when the image pattern transmitted to each of the in-vehicle cameras after the display switching condition is satisfied, and the image pattern before the display switching condition is satisfied are identical.

3. The image processing device according to claim 2 , wherein when at least one of the image pattern responses does not match with the image pattern, the processor is further configured to generate an alternative composite image using a certain alternative image instead of the input image input from one of the in-vehicle cameras that output the image pattern response that does not match with the image pattern, and to display the alternative composite image.

4. The image processing device according to claim 2 , wherein the processor is further configured to display a monochromatic image as the preparation image.

5. The image processing device according to claim 4 , wherein the processor is further configured to display a black monochromatic image as the preparation image.

6. The image processing device according to claim 3 , wherein the processor is further configured to display a monochromatic image as the preparation image.

7. The image processing device according to claim 6 , wherein the processor is further configured to display a black monochromatic image as the preparation image.

8. The image processing device according to claim 2 , wherein the processor is further configured to display a layout image that indicates a display position of the composite image as the preparation image.

9. The image processing device according to claim 3 , wherein the processor is further configured to display a layout image that indicates a display position of the composite image as the preparation image.

10. The image processing device according to claim 1 , wherein when at least one of the image pattern responses does not match with the image pattern, the processor is further configured to generate an alternative composite image using a certain alternative image instead of the input image input from one of the in-vehicle cameras that output the image pattern response that does not match with the image pattern, and to display the alternative composite image.

11. The image processing device according to claim 10 , wherein the processor is further configured to display a monochromatic image as the preparation image.

12. The image processing device according to claim 11 , wherein the processor is further configured to display a black monochromatic image as the preparation image.

13. The image processing device according to claim 10 , wherein the processor is further configured to display a layout image that indicates a display position of the composite image as the preparation image.

14. The image processing device according to claim 1 , wherein the processor is further configured to display a monochromatic image as the preparation image.

15. The image processing device according to claim 14 , wherein the processor is further configured to display a black monochromatic image as the preparation image.

16. The image processing device according to claim 1 , wherein the processor is further configured to display a layout image that indicates a display position of the composite image as the preparation image.

17. An image processing method, comprising:

specifying, as an image pattern for each of a plurality of in-vehicle cameras, an image area that is obtained by selecting a certain area from among image areas of an image captured by the corresponding in-vehicle camera and is to be output as an input image of the corresponding in-vehicle camera;

in response to the image pattern being specified, receive the image areas respectively transmitted from the plurality of in-vehicle cameras along with respective image pattern responses;

generating a composite image that is a surrounding image of a vehicle viewed from a virtual viewpoint, based on the image areas received from the plurality of in-vehicle cameras;

determining whether all of the image pattern responses transmitted from the in-vehicle cameras match with the specified image pattern; and

displaying a certain preparation image on the display unit when a display switching condition to the composite image is satisfied, and displaying the composite image on the display unit instead of the preparation image, when it is determined that all of the image pattern responses match with the specified image pattern.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2022
From: DENSO TEN LIMITED
To: DENSO CORPORATION
Reel/Frame 060673/0937 →
CHANGE OF NAME Recorded Sep 27, 2021
From: FUJITSU TEN LIMITED
To: DENSO TEN LIMITED
Reel/Frame 057608/0417 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2016
From: KIYO, KOUEI; MATSUYAMA, SATORU; MORIYAMA, SHINICHI; ASAI, GORO; OKUDA, MASATO; SATOMI, YOHEI; SHIDOCHI, YUKA
To: FUJITSU TEN LIMITED; TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 038764/0581 →
Priority Claims (1)
JP 2015-117401 · Jun 10, 2015 · national
Continuity (1)
Related Publication 20160364842A1 · Dec 15, 2016