IP Library Granted Patent US 10,282,848
Granted Patent B2
US 10,282,848 · App. 15/604,215 · Granted May 7, 2019

Automatic detection and analysis of traffic signal type information using image data captured on a vehicle

Inventor: Han Woo Lee (Seongnam-si, KR)
Assignee: THINKWARE CORPORATION
G06T7/20G06K9/00818G06T7/70G06T2207/10016G06T2207/10024G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,282,848
App. No.
15/604,215
Granted
May 7, 2019
Kind
B2
Abstract

Provided herein is a control method of an electronic apparatus. The control method of an electronic apparatus includes: generating signal type information using an image data of a signal region portion of a signal lamp in a driving-related image data of a vehicle; and performing a driving-related guide of the vehicle using the generated signal type information.

Claims (44)

1. A control method of an electronic apparatus, the method comprising:

generating signal type information using image data of a signal region portion of a signal lamp in driving-related image data of a vehicle; and

performing a driving-related guide of the vehicle using the generated signal type information,

wherein the generating of the signal type information includes:

determining a region-of-interest including the signal lamp in the driving-related image data;

converting image data of the determined region-of-interest based on a preset pixel value;

generating region-of-interest image data in which the signal region portion of the signal lamp and a non-signal region portion are distinguished according to the converting;

calculating an area pixel value of a second region and an area pixel value of a first region from image data of the signal region portion;

comparing a difference between the area pixel value of the second region and the area pixel value of the first region with a preset area pixel value; and

generating the signal type information of the signal lamp according to a result of the comparison,

wherein the first region has a first area and the second region includes the first region and has a second area.

2. The control method of claim 1 , further comprising:

determining whether the vehicle is in a stopping state using the driving-related image data,

wherein the generating of the signal type information is performed when the vehicle is in the stopping state.

3. The control method of claim 2 , wherein the determining whether the vehicle is in the stopping state includes:

generating gray image data for the driving-related image data; and

determining whether the vehicle is in the stopping state by comparing each of a plurality of frames included in the generated gray image data.

4. The control method of claim 2 , wherein the signal type information is information for identifying each of a plurality of signals which is displayed in the signal lamp.

5. The control method of claim 4 , wherein the performing of the driving-related guide of the vehicle includes outputting a signal guide using the signal type information.

6. The control method of claim 4 , wherein the performing of the driving-related guide of the vehicle includes outputting a signal change guide using path information for road guide of the vehicle and the signal type information.

7. The control method of claim 6 , wherein the outputting is performed if the vehicle is in a stopping state during a preset time from timing when the signal of the signal lamp is changed.

8. The control method of claim 7 , wherein the outputting includes:

generating an indicator for performing the driving-related guide; and

outputting the generated indicator based on augmented reality.

9. An electronic apparatus, comprising:

a processor generating signal type information using image data of a signal region portion of a signal lamp in driving-related image data of a vehicle; and

a controller performing a driving-related guide of the vehicle using the generated signal type information,

wherein the processor is configured to:

determine a region-of-interest including the signal lamp in the driving-related image data,

convert image data of the determined region-of-interest based on a preset pixel value,

generate region-of-interest image data in which the signal region portion of the signal lamp and a non-signal region portion are distinguished according to the converting,

calculate an area pixel value of a second region and an area pixel value of a first region from image data of the signal region portion,

compare a difference between the area pixel value of the second region and the area pixel value of the first region with a preset area pixel value, and

generate the signal type information of the signal lamp according to a result of the comparison,

wherein the first region has a first area and the second region includes the first region and has a second area.

10. The electronic apparatus of claim 9 , wherein the processor is further configured to:

determine whether the vehicle is in a stopping state using the driving-related image data, and

wherein the controller controls the processor to generate the signal type information in response to the vehicle being in the stopping state.

11. The electronic apparatus of claim 10 , wherein the processor is further configured to generate gray image data for the driving-related image data and compare each of a plurality of frames included in the generated gray image data to determine whether the vehicle is in the stopping state.

12. The electronic apparatus of claim 10 , wherein the signal type information is information for identifying each of a plurality of signals which is displayed in the signal lamp.

13. The electronic apparatus of claim 12 , wherein the controller controls an output unit to output a signal guide using the signal type information.

14. The electronic apparatus of claim 12 , wherein the controller outputs a signal change guide using path information for road guide of the vehicle and the signal type information.

15. The electronic apparatus of claim 14 , wherein the controller controls the output unit to output the signal change guide if the vehicle is in a stopping state during a preset time from timing when the signal of the signal lamp is changed.

16. A non-transitory recording medium recorded with a program code for executing the control method of claim 1 on a computer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2021
From: THINKWARE CORPORATION
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 057102/0051 →
Priority Claims (1)
KR 10-2014-0073041 · Jun 16, 2014 · national
Continuity (2)
Continuation 14739572 · Jun 15, 2015
Related Publication 20170256064A1 · Sep 7, 2017