IP Library Granted Patent US 10,127,726
Granted Patent B2
US 10,127,726 · App. 14/955,725 · Granted Nov 13, 2018

Electronic apparatus, control method thereof, computer program, and computer-readable recording medium

Inventor: Suk Pil Ko (Seongnam-si, KR)
Assignee: THINKWARE CORPORATION
G06T19/006B60R1/00G06T7/20G06T17/05B60R2300/207B60R2300/30B60R2300/302B60R2300/307B60R2300/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,127,726
App. No.
14/955,725
Granted
Nov 13, 2018
Kind
B2
Abstract

Disclosed herein is a control method of an electronic apparatus. The control method of an electronic apparatus includes: calculating an average speed of a vehicle when a specific event occurs; generating an object indicating a relationship between the calculated average speed and an event speed corresponding to the specific event; and outputting the generated object through augmented reality.

Claims (57)

1. A control method of an electronic apparatus, comprising:

determining whether a specific event occurs;

calculating an average speed of a vehicle if the specific event occurs;

when the average speed of the vehicle is slower than an event speed of the specific event, generating a first object and when the average speed of the vehicle is faster than the event speed of the specific event, generating a second object, wherein each of the first object and the second object indicates a relationship between the average speed and the event speed;

mapping the first object and the second object onto a road region of an augmented reality image; and

displaying at least one of the first object and the second object through the augmented reality image in accordance with a speed difference between the average speed of the vehicle and the event speed, wherein the first object and the second object have different size and location on the augmented reality image,

wherein a mapping position of the first object on the road region fluidly changes according to the speed difference between the average speed of the vehicle and the event speed,

wherein a mapping position of the second object on the road region does not fluidly change regardless of the speed difference between the average speed of the vehicle and the event speed, and the second object is displayed at a lower of the road region of the augmented reality image, and

wherein the mapping position of the first object is located higher than the mapping position of the second object on the road region.

2. The control method of an electronic apparatus of claim 1 , wherein the specific event includes at least one of a section speed regulation section entry event, a route guidance start event up to a destination, and a traffic information providing section entry event.

3. The control method of an electronic apparatus of claim 2 , wherein in the case of the section speed regulation section entry event, the generating includes:

comparing the average speed of the vehicle calculated on the basis of a section speed regulation section entry point in time and a limit average speed of a section speed regulation section with each other; and

generating the first object indicating a relationship between the average speed of the vehicle and the limit average speed depending on a comparison result.

4. The control method of an electronic apparatus of claim 2 , wherein in the case of the route guidance start event up to the destination, the generating includes:

calculating a route average speed on the basis of an arrival estimated time calculated by reflecting real time traffic information of a route guidance start point in time;

comparing the average speed of the vehicle and the route average speed; and

generating the first object indicating a relationship between the average speed of the vehicle and the route average speed depending on a comparison result.

5. The control method of an electronic apparatus of claim 2 , wherein in the case of the traffic information providing section entry event, the generating includes:

comparing an average speed of the vehicle calculated on the basis of a traffic information providing section entry point in time and a section average speed of the traffic information providing section with each other; and

generating the first object indicating a relationship between the average speed of the vehicle and the section average speed depending on a comparison result.

6. The control method of an electronic apparatus of claim 1 , wherein the augmented reality image is implemented to have a virtual three-dimensional (3D) space using a photographed image of a camera by

performing calibration on the camera to calculate camera parameters;

generating the virtual 3D space for the photographed image of the camera on the basis of the camera parameters; and

positioning the generated object on the virtual 3D space.

7. The control method of an electronic apparatus of claim 6 , wherein in the positioning, the first and second objects are controlled to be positioned and expressed at a lower end of a vanishing point of the photographed image of the camera.

8. The control method of an electronic apparatus of claim 7 , wherein a distance between the first object and the vanishing point is shorter than a distance between the second object and the vanishing point.

9. The control method of an electronic apparatus of claim 7 , wherein the first and second objects are distinguished from each other by different colors and each color of the first and second objects informs a driver whether a traffic law is violated or not based on the speed difference the average speed of the vehicle and the event speed.

10. The control method of the electronic apparatus of claim 1 , wherein the first object and the second object are displayed in parallel to the road region.

11. The control method of the electronic apparatus of claim 1 , wherein an arrow included in the second object is displayed in an opposite direction to a movement direction of the vehicle.

12. An electronic apparatus, including at least one processor, comprising:

a display displaying a screen;

an average speed calculator calculating an average speed of a vehicle when the specific event occurs;

a generator, when the average speed of the vehicle is slower than an event speed of the specific event, generating a first object and, when the average speed of the vehicle is faster than the event speed of the specific event, generating a second object, wherein each of the first object and the second object indicates a relationship between the calculated average speed and the event speed; and

a controller mapping the first object and the second object onto a road region of an augmented reality image; and

displaying at least one of the first object and the second object through an augmented reality image in accordance with a speed difference between the average speed of the vehicle and the event speed, wherein the first object and the second object have different size and location on the augmented reality image,

wherein a mapping position of the first object on the road region fluidly changes according to the speed difference between the average speed of the vehicle and the event speed,

wherein a mapping position of the second object on the road region does not fluidly change regardless of the speed difference between the average speed of the vehicle and the event speed, and the second object is displayed at a lower of the road region of the augmented reality image, and

wherein the mapping position of the first object is located higher than the mapping position of the second object on the road region.

13. The electronic apparatus of claim 12 , wherein the specific event includes at least one of a section speed regulation section entry event, a route guidance start event up to a destination, and a traffic information providing section entry event.

14. The electronic apparatus of claim 13 , wherein in the case of the section speed regulation section entry event, the controller compares an average speed of the vehicle calculated on the basis of a section speed regulation section entry point in time and a limit average speed of a section speed regulation section with each other, and

the generator generates the first object indicating a relationship between the average speed of the vehicle and the limit average speed depending on a comparison result.

15. The electronic apparatus of claim 13 , wherein in the case of the route guidance start event up to the destination, the controller calculates a route average speed on the basis of an arrival estimated time calculated by reflecting real time traffic information of a route guidance start point in time and compares the average speed of the vehicle and the route average speed, and

the generator generates the first object indicating a relationship between the average speed of the vehicle and the route average speed depending on a comparison result.

16. The electronic apparatus of claim 13 , wherein in the case of the traffic information providing section entry event, the controller compares an average speed of the vehicle calculated on the basis of a traffic information providing section entry point in time and a section average speed of the traffic information providing section with each other, and

the generator generates the first object indicating a relationship between the average speed of the vehicle and the section average speed depending on a comparison result.

17. The electronic apparatus of claim 12 , wherein the controller performs calibration on a camera to calculate camera parameters, generates a virtual 3D space for photographed image of the camera on the basis of the camera parameters, and positions the generated object on the virtual 3D space of the augmented reality image.

18. The electronic apparatus of claim 12 , wherein the first object and the second object are displayed in parallel to the road region.

19. A non-transitory computer readable storage medium containing instructions, that when executed by one or more processors, cause the one or more processors to perform a method, the method comprising:

determining whether a specific event occurs;

calculating an average speed of a vehicle if the specific event occurs;

when the average speed of the vehicle is slower than an event speed of the specific event, generating a first object and when the average speed of the vehicle is faster than the event speed of the specific event, generating a second object, wherein each of the first object and the second object indicates a relationship between the calculated average speed and the event speed;

mapping the first object and the second object onto a road region of an augmented reality image; and

displaying at least one of the first object and the second object through the augmented reality image in accordance with a speed difference between the average speed of the vehicle and the event speed, wherein the first object and the second object have different size and location on the augmented reality image,

wherein a mapping position of the first object on the road region fluidly changes according to the speed difference between the average speed of the vehicle and the event speed,

wherein a mapping position of the second object on the road region does not fluidly change regardless of the speed difference between the average speed of the vehicle and the event speed, and the second object is displayed at a lower of the road region of the augmented reality image, and

wherein the mapping position of the first object is located higher than the mapping position of the second object on the road region.

20. The non-transitory computer readable storage medium of claim 19 , wherein the first object and the second object are displayed in parallel to the road region.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2021
From: THINKWARE CORPORATION
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 057102/0051 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2015
From: KO, SUK PIL
To: THINKWARE CORPORATION
Reel/Frame 037180/0228 →
Priority Claims (2)
KR 10-2014-0170048 · Dec 1, 2014 · national
KR 10-2015-0036147 · Mar 16, 2015 · national
Continuity (1)
Related Publication 20160155268A1 · Jun 2, 2016