IP Library Granted Patent US 9,976,866
Granted Patent B2
US 9,976,866 · App. 15/588,221 · Granted May 22, 2018

Electronic apparatus, control method thereof, computer program, and computer-readable recording medium

Inventor: Suk Pil Ko (Seongnam-si, KR)
Assignee: THINKWARE CORPORATION
G01C21/3635G01C21/3602G01C21/3647G06T7/70G06T19/006G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,976,866
App. No.
15/588,221
Granted
May 22, 2018
Kind
B2
Abstract

Provided herein is a control method of an electronic apparatus. The control method of an electronic apparatus includes: determining a position of a vehicle that is being operated; determining a terrain height in a region positioned within a predetermined distance from the determined position of the vehicle; comparing a terrain height at the position of the vehicle and the terrain height in the region with each other to calculate a terrain height difference; and generating an information object including guidance information of the vehicle and displaying the generated information object through augmented reality by reflecting the terrain height difference.

Claims (43)

1. A control method of an electronic apparatus, wherein the apparatus includes a processor, the method comprising:

determining a current position of a moving body;

determining, by the processor, a terrain height in a region positioned within a predetermined distance from the current position of the moving body;

calculating, by the processor, a terrain height difference by comparing the terrain height at the current position of the moving body with the terrain height at the region;

generating, by the processor, an information object including guidance information of the moving body; and

displaying, by the processor, the generated information object through augmented reality by using the terrain height difference and an optical axis of a camera installed in the moving body,

wherein the displaying of the generated information object includes determining a mapping position of the information object on a virtual three-dimensional (3D) space for a photographed image of the camera using the terrain height difference.

2. The control method of the electronic apparatus of claim 1 , further comprising calculating a vertical rotation angle of the camera based on the optical axis of the camera,

wherein the displaying of the generated information object further includes correcting the determined mapping position of the information object using the calculated vertical rotation angle.

3. The control method of the electronic apparatus of claim 2 , wherein the displaying of the generated information object includes:

performing calibration on the camera to calculate camera parameters;

generating the virtual 3D space for the photographed image of the camera on a basis of the camera parameters; and

mapping the generated information object to the virtual 3D space on a basis of the mapping position of the information object depending on the correction.

4. The control method of the electronic apparatus of claim 3 , wherein the displaying of the generated information object includes:

converting the virtual 3D space to which the information object is mapped into a two-dimensional (2D) image on a basis of the camera parameters to generate an augmented reality screen; and

displaying the generated augmented reality screen.

5. The control method of the electronic apparatus of claim 1 , wherein in the determining of the terrain height, a terrain height of a route positioned within a predetermined distance from the current position of the moving body in an entire route up to a destination is determined in a case in which the electronic apparatus performs guidance of the route up to the destination.

6. The control method of the electronic apparatus of claim 1 , wherein the information object includes a route guidance object for guiding a route up to a destination, and

in the displaying of the generated information object, the route guidance object is positioned and displayed on a road region of the augmented reality screen.

7. An electronic apparatus comprising:

a display unit displaying a screen; and

a control device configured to:

determine a terrain height in a region positioned within a predetermined distance from a current position of a moving body that is being operated,

calculate a terrain height difference by comparing the terrain height at the current position of the moving body with the terrain height at the region, and

generate an information object including information of the moving body, and

control the display unit to display the generated information object through augmented reality by using the terrain height difference and an optical axis of a camera installed in the moving body,

wherein the control device determines a mapping position of the information object on a virtual three-dimensional (3D) space for a photographed image of the camera using the terrain height difference.

8. The electronic apparatus of claim 7 , wherein the control device is further configured to calculate a vertical rotation angle of the camera based on the optical axis of the camera, and correct the determined mapping position of the information object using the calculated vertical rotation angle.

9. The electronic apparatus of claim 8 , wherein the control device is further configured to:

perform calibration on the camera to calculate camera parameters;

generate the virtual 3D space for the photographed image of the camera on a basis of the camera parameters; and

map the generated information object to the virtual 3D space on a basis of the mapping position of the information object depending on the correction.

10. The electronic apparatus of claim 9 , wherein the control device converts the virtual 3D space to which the information object is mapped into a two-dimensional (2D) image on a basis of the camera parameters to generate an augmented reality screen, and controls the display unit to display the generated augmented reality screen.

11. The electronic apparatus of claim 7 , wherein the control device determines a terrain height of a route positioned within a predetermined distance from the current position of the moving body in an entire route up to a destination in a case in which the electronic apparatus performs guidance of the route up to the destination.

12. The electronic apparatus of claim 7 , wherein the information object includes a route guidance object for guiding a route up to a destination, and

the display unit positions and displays the route guidance object on a road region of an augmented reality screen.

13. A non-transitory computer readable storage medium containing instructions, that when executed by one or more processors, cause the one or more processor to perform a method, the method comprising:

determining a current position of a moving body;

determining a terrain height in a region positioned within a predetermined distance from the current position of the moving body;

calculating a terrain height difference by comparing the terrain height at the current position of the moving body with the terrain height at the region;

generating an information object including guidance information of the moving body; and

displaying the generated information object through augmented reality by using the terrain height difference and an optical axis of a camera installed in the moving body,

wherein the displaying of the generated information object includes determining a mapping position of the information object on a virtual three-dimensional (3D) space for a photographed image of the camera using the terrain height difference.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2021
From: THINKWARE CORPORATION
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 057102/0051 →
Priority Claims (2)
KR 10-2014-0170047 · Dec 1, 2014 · national
KR 10-2015-0035743 · Mar 16, 2015 · national
Continuity (2)
Continuation 14955793 · Dec 1, 2015
Related Publication 20170241795A1 · Aug 24, 2017