IP Library Granted Patent US 9,846,969
Granted Patent B2
US 9,846,969 · App. 14/955,762 · Granted Dec 19, 2017

Electronic apparatus, control method thereof, computer program, and computer-readable recording medium

Inventor: Ho Hyung Cho (Seongnam-si, KR)
Assignee: THINKWARE CORPORATION
G06T19/006B60R1/00G06K9/00805G06K9/00825B60R2300/306B60R2300/307B60R2300/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,846,969
App. No.
14/955,762
Granted
Dec 19, 2017
Kind
B2
Abstract

Disclosed herein is a control method of an electronic apparatus. The control method of an electronic apparatus includes: detecting a crosswalk from an image data photographed in a camera during a period in which a vehicle is operated; generating an object indicating the detected crosswalk; and outputting the generated object through augmented reality.

Claims (46)

1. A control method of an electronic apparatus, comprising:

detecting a crosswalk from an image data photographed in a camera during a period in which a vehicle is operated;

generating an object indicating the detected crosswalk;

outputting the generated object through augmented reality,

wherein the generated object is displayed in the augmented reality in a position near a front of the vehicle;

determining signal kind information using an image data of a signal region portion of a signal lamp in the image data;

generating a first object for allowing a driver to recognize that the crosswalk is positioned in front of the vehicle when the vehicle is maintained in a stopped state in a state in which the signal kind information is a stop signal; and

generating a second object for warning the driver that the crosswalk is positioned in front of the vehicle when the vehicle starts in the state in which the signal kind information is the stop signal.

2. The control method of an electronic apparatus of claim 1 , further comprising determining whether or not the vehicle is in a stopped state,

wherein in the generating, a first object for allowing a driver to recognize that the crosswalk is positioned in front of the vehicle is generated when it is determined that the vehicle is in the stopped state.

3. The control method of an electronic apparatus of claim 1 , wherein the first and second objects are distinguished from each other by different colors.

4. The control method of an electronic apparatus of claim 1 , wherein the first and second objects are implemented in a form including an alpha channel related to transparency of a color, and

the first and second objects include transparent regions depending on the alpha channel.

5. The control method of an electronic apparatus of claim 1 , further comprising:

determining whether or not a pedestrian is present on the crosswalk using the photographed image data; and

generating an object indicating whether or not the pedestrian is present.

6. The control method of an electronic apparatus of claim 5 , further comprising performing a control so as not to perform front vehicle start guidance in the case in which a front vehicle of the vehicle starts in a state in which the pedestrian is present on the crosswalk.

7. The control method of an electronic apparatus of claim 5 , further comprising performing a control to perform guidance for warning a driver that the pedestrian is present on the crosswalk in the case in which the vehicle starts in a state in which the pedestrian is present on the crosswalk.

8. The control method of an electronic apparatus of claim 1 , wherein display positions of the first and second objects are regions in which the crosswalk is positioned on the augmented reality.

9. The control method of an electronic apparatus of claim 1 , wherein the outputting includes:

performing calibration on the camera to calculate camera parameters;

generating a virtual 3D space for a photographed image of the camera on the basis of the camera parameters; and

positioning the generated object on the virtual 3D space.

10. An electronic apparatus comprising:

a display displaying a screen;

an generator generating an object indicating a crosswalk when the crosswalk is detected from an image data photographed in a camera during a period in which a vehicle is operated; and

a controller controlling the display to output the generated object through augmented reality,

wherein the generated object is displayed in the augmented reality in a position near a front of the vehicle such that a driver recognizes that the crosswalk is in front of the vehicle, and

wherein the controller determines signal kind information using an image data of a signal region portion of a signal lamp in the image data, and

wherein the controller controls the generator to generate a first object for allowing a driver to recognize that the crosswalk is positioned in front of the vehicle when the vehicle is maintained in a stopped state in a state in which the signal kind information is a stop signal, and to generate a second object for warning the driver that the crosswalk is positioned in front of the vehicle when the vehicle starts in the state in which the signal kind information is the stop signal.

11. The electronic apparatus of claim 10 , wherein the controller determines whether or not the vehicle is in a stopped state, and

controls the generator to generate a first object for allowing a driver to recognize that the crosswalk is positioned in front of the vehicle when it is determined that the vehicle is in the stopped state.

12. The electronic apparatus of claim 10 , wherein the first and second objects are implemented in a form including an alpha channel related to transparency of a color, and

the first and second objects include transparent regions depending on the alpha channel.

13. The electronic apparatus of claim 10 , wherein the controller determines whether or not a pedestrian is present on the crosswalk using the photographed image data, and controls the generator to generate an object indicating whether or not the pedestrian is present.

14. The electronic apparatus of claim 13 , wherein the controller performs a control so as not to perform front vehicle start guidance in the case in which a front vehicle of the vehicle starts in a state in which the pedestrian is present on the crosswalk.

15. The electronic apparatus of claim 13 , wherein the controller performs a control to perform guidance for warning a driver that the pedestrian is present on the crosswalk in the case in which the vehicle starts in a state in which the pedestrian is present on the crosswalk.

16. The electronic apparatus of claim 10 , wherein expression positions of the first and second objects are regions in which the crosswalk is positioned on the augmented reality.

17. The electronic apparatus of claim 10 , wherein the controller performs a control to perform calibration on the camera to calculate camera parameters, generate a virtual 3D space for a photographed image of the camera on the basis of the camera parameters, and position the generated object on the virtual 3D space.

18. A non-transitory computer readable storage medium containing instructions, that when executed by one or more processors, cause the one or more processors to perform a method, the method comprising:

detecting a crosswalk from an image data photographed in a camera during a period in which a vehicle is operated;

generating an object indicating the detected crosswalk; and

outputting the generated object through augmented reality,

wherein the generated object is displayed in the augmented reality in a position near a front of the vehicle such that a driver recognizes that the crosswalk is in front of the vehicle,

wherein the controller determines signal kind information using an image data of a signal region portion of a signal lamp in the image data, and

wherein the controller controls the generator to generate a first object for allowing a driver to recognize that the crosswalk is positioned in front of the vehicle when the vehicle is maintained in a stopped state in a state in which the signal kind information is a stop signal, and to generate a second object for warning the driver that the crosswalk is positioned in front of the vehicle when the vehicle starts in the state in which the signal kind information is the stop signal.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2021
From: THINKWARE CORPORATION
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 057102/0051 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2015
From: CHO, HO HYUNG
To: THINKWARE CORPORATION
Reel/Frame 037180/0504 →
Priority Claims (2)
KR 10-2014-0170051 · Dec 1, 2014 · national
KR 10-2015-0035744 · Mar 16, 2015 · national
Continuity (1)
Related Publication 20160155269A1 · Jun 2, 2016