IP Library Granted Patent US 9,677,899
Granted Patent B2
US 9,677,899 · App. 14/955,793 · Granted Jun 13, 2017

Electronic apparatus, control method thereof, computer program, and computer-readable recording medium

Inventor: Suk Pil Ko (Seongnam-si, KR)
Assignee: THINKWARE CORPORATION
G01C21/3602G01C21/3647G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,677,899
App. No.
14/955,793
Granted
Jun 13, 2017
Kind
B2
Abstract

Disclosed herein is a control method of an electronic apparatus. The control method of an electronic apparatus includes: determining a position of a vehicle that is being operated; determining a terrain height in a region positioned within a predetermined distance from the determined position of the vehicle; comparing a terrain height at the position of the vehicle and the terrain height in the region with each other to calculate a terrain height difference; and generating an information object including guidance information of the vehicle and displaying the generated information object through augmented reality by reflecting the terrain height difference.

Claims (47)

1. A control method of an electronic apparatus, wherein the apparatus includes a processor, comprising:

determining a current position of a vehicle that is being operated;

determining, by the processor, a terrain height in a region positioned within a predetermined distance from the current position of the vehicle;

calculating, by the processor, a terrain height difference by comparing the terrain height at the current position of the vehicle with the terrain height at the region;

generating, by the processor, an information object including guidance information of the vehicle;

determining, by the processor, a mapping position of the information object on a virtual three-dimensional (3D) space for a photographed image of a camera using the terrain height difference and an optical axis of the camera; and

displaying, on a display device, the information object through augmented reality by mapping the information object to the virtual three-dimensional (3D) space based on the determined mapping position.

2. The control method of the electronic apparatus of claim 1 , further comprising:

calculating a vertical rotation angle of the optical axis of the camera installed in the vehicle at the current position; and

wherein the determining the mapping position of the information object comprises:

determining the mapping position of the information object on a virtual three-dimensional (3D) space for a photographed image of the camera using the terrain height difference; and

correcting the determined mapping position of the information object using the calculated vertical rotation angle.

3. The control method of the electronic apparatus of claim 2 , wherein the displaying of the information object includes:

performing calibration on the camera to calculate camera parameters;

generating the virtual 3D space for the photographed image of the camera based on the camera parameters; and

mapping the information object to the virtual 3D space based on the mapping position of the information object depending on the correction.

4. The control method of the electronic apparatus of claim 3 , wherein the displaying of the information object includes:

converting the virtual 3D space to which the information object is mapped into a two-dimensional (2D) image based on the camera parameters to generate an augmented reality screen; and

displaying the generated augmented reality screen.

5. The control method of the electronic apparatus of claim 1 , wherein in the determining of the terrain height, a terrain height of a route positioned within a predetermined distance from the current position of the vehicle in an entire route up to a destination is determined in a case in which the electronic apparatus performs guidance of a route up to the destination.

6. The control method of the electronic apparatus of claim 1 , wherein the information object includes a route guidance object for guiding a route up to a destination, and in the displaying of the information object, the route guidance object is positioned and displayed on a road region of the augmented reality screen.

7. An electronic apparatus comprising:

a display unit displaying a screen; and

a control device configured to

determine terrain height in a region positioned within a predetermined distance from a current position of a vehicle that is being operated and calculating a terrain height difference by comparing the terrain height at the current position of the vehicle with the terrain height at the region,

generate an information object including information of the vehicle,

determine a mapping position of the information object on a virtual three-dimensional (3D) space for a photographed image of a camera using the terrain height difference and an optical axis of the camera, and

control the display unit to display the information object through augmented reality by mapping the information object to the virtual three-dimensional (3D) space based on the determined mapping position.

8. The electronic apparatus of claim 7 , wherein the control device is further configured to:

calculate a vertical rotation angle of the optical axis of the camera installed in the vehicle at the current position,

determine the mapping position of the information object on the virtual three-dimensional (3D) space for a photographed image of the camera using the terrain height difference, and

correct the determined mapping position of the information object using the calculated vertical rotation angle.

9. The electronic apparatus of claim 8 , wherein the control device is further configured to:

perform calibration on the camera to calculate camera parameters,

generate the virtual 3D space for the photographed image of the camera based on the camera parameters, and

map the information object to the virtual 3D space based on the mapping position of the information object depending on the correction.

10. The electronic apparatus of claim 9 , wherein the control device converts the virtual 3D space to which the information object is mapped into a 2D image based on the camera parameters to generate an augmented reality screen, and controls the display unit to display the generated augmented reality screen.

11. The electronic apparatus of claim 7 , wherein the control device determines a terrain height of a route positioned within a predetermined distance from the current position of the vehicle in an entire route up to a destination in a case in which the electronic apparatus performs guidance of a route up to the destination.

12. The electronic apparatus of claim 7 , wherein the information object includes a route guidance object for guiding a route up to a destination, and

the display unit positions and displays the route guidance object on a road region of the augmented reality screen.

13. A non-transitory computer readable storage medium containing instructions, that when executed by one or more processors, cause the one or more processor to perform a method, the method comprising:

determining a current position of a vehicle that is being operated;

determining a terrain height in a region positioned within a predetermined distance from the current position of the operated vehicle;

calculating a terrain height difference by comparing the terrain height at the current position of the vehicle with the terrain height at the region;

generating an information object including guidance information of the operated vehicle;

determining a mapping position of the information object on a virtual three-dimensional (3D) space for a photographed image of a camera using the terrain height difference and the calculated vertical rotation angle and an optical axis of the camera; and

displaying the information object through augmented reality by mapping the information object to the virtual three-dimensional (3D) space based on the determined mapping position.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2021
From: THINKWARE CORPORATION
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 057102/0051 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2015
From: KO, SUK PIL
To: THINKWARE CORPORATION
Reel/Frame 037180/0663 →
Priority Claims (2)
KR 10-2014-0170047 · Dec 1, 2014 · national
KR 10-2015-0035743 · Mar 16, 2015 · national
Continuity (1)
Related Publication 20160153800A1 · Jun 2, 2016