IP Library Granted Patent US 8,879,784
Granted Patent B2
US 8,879,784 · App. 14/292,085 · Granted Nov 4, 2014

Terminal and method for providing augmented reality

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,879,784
App. No.
14/292,085
Granted
Nov 4, 2014
Kind
B2
Abstract

A method for providing augmented reality includes acquiring a real-world image including an object; transmitting terminal information, in which the terminal information includes a location information of a terminal and an original retrieval distance; receiving object information corresponding to the object, in which the object information is based on the transmitted terminal information; and overlapping the received object information over the corresponding object in the real-world image. A terminal to perform the methods described herein includes a location information providing unit, an information transmitting/receiving unit, an image processing unit, and a user view analyzing unit.

Claims (52)

1. A terminal to provide augmented reality, the terminal comprising:

a transceiver to transmit first terminal information and to receive first object information based on the first terminal information, the first terminal information corresponding to a physical location of the terminal and comprises first location information of the terminal located at the physical location; and

a processor to overlap the first object information on a first real-world image, to calculate a virtual movement location of the terminal based on a zooming level, and to calculate second terminal information corresponding to the virtual movement location, the first real-world image comprising a first object corresponding to the first object information, and the second terminal information comprising second location information of the terminal virtually located at the virtual movement location,

wherein the transceiver transmits the second terminal information and receives second object information based on the second terminal information,

the processor overlaps the second object information on a second real-world image, and the second real-world image comprises a second object corresponding to the second object information.

2. The terminal of claim 1 , wherein the first terminal information or the second terminal information further comprises at least one of an original retrieval distance, azimuth, and viewing angle information of the terminal.

3. The terminal of claim 1 , wherein the processor provides at least one of the first location information and the second location information having at least one of cellular network-based location information and global positioning system (GPS) information based location information.

4. The terminal of claim 1 , further comprising:

a camera having a zooming operation to obtain at least one of the first real-world image and the second real-world image, wherein, if the zooming level of the camera is changed,

the processor resets the first terminal information according to the virtual movement location corresponding to the changed zooming level, and a new retrieval distance is calculated based on the virtual movement location.

5. The terminal of claim 4 , wherein the new retrieval distance is calculated by subtracting a virtual movement distance from an original retrieval distance and the first terminal information is reset based on the virtual movement location and the new retrieval distance.

6. The terminal of claim 4 , wherein the processor extracts first feature information of the first object displayed on the first real-world image corresponding to the changed zooming level, transmits the first feature information along with the reset second terminal information corresponding to the virtual movement location, and receives the second object information based on the second terminal information and second feature information of the second object, and the processor matches the second object information to a location of the second object.

7. The terminal of claim 1 , wherein a virtual movement distance is calculated according to a reference value, and wherein the reference value is obtained by dividing an original retrieval distance by a total number of zooming levels.

8. The terminal of claim 1 , wherein the processor calculates a distance between a location of the terminal and the first or second object based on location information of the first or second object and sets the calculated distance as a reference distance, and

wherein the location of the terminal is an image capturing location or the virtual movement location, and the location information of the first or second object is comprised in the first or second object information, respectively.

9. The terminal of claim 1 , wherein a virtual movement distance is calculated according to a reference value, and wherein the reference value is obtained by dividing an original retrieval distance by a number of the zoom levels.

10. The terminal of claim 1 , wherein at least one of the first real-world image and the second real-world image is a real-time image.

11. The terminal of claim 8 , wherein the processor calculates the virtual movement location of the terminal based on the reference distance and the zooming level,

the transceiver transmits the virtual movement location of the terminal and feature information of the first object extracted from the first real-world image and receives the second object information based on the feature information of the first object, and the processor matches the second object information to a location of the second object.

12. A method for providing augmented reality, the method comprising:

acquiring a first real-world image comprising an object;

transmitting first terminal information,

wherein the first terminal information comprises a location information of a terminal and a first retrieval distance;

receiving object information corresponding to the object,

wherein the object information is based on the transmitted first terminal information;

overlapping the received object information over the corresponding object in the first real-world image;

changing a zooming level of the first real-world image for providing a second real-world image,

wherein the second real-world image comprises a second object, and

wherein the size of the first real-world image is changed according to the change in the zooming level;

calculating a virtual movement location of the terminal, a virtual movement distance between the second object and the terminal, and a second retrieval distance according to the changed zooming level; and

resetting the first terminal information according to the virtual movement location for providing second terminal information.

13. A method for providing augmented reality, the method comprising:

overlapping first object information over a first object included in a first real-world image;

changing a zooming level of the first real-world image for providing a second real-world image,

wherein the second real-world image comprises a second object;

calculating a virtual movement location of a terminal, a virtual movement distance between the second object and the terminal, and a retrieval distance according to the changed zooming level; and

setting terminal information according to the virtual movement location.

14. The method of claim 13 , further comprising:

transmitting the terminal information;

receiving second object information based on the terminal information; and

overlapping the second object information over the second object in the second real-world image.

15. The method of claim 13 , further comprising:

extracting feature information of the second object displayed on the second real-world image;

transmitting the terminal information and the feature information;

receiving second object information based on the terminal information and the feature information;

overlapping the second object information over the second object in the second real-world image; and

displaying the overlapped image such that the second object information is matched with a location of the second object.

16. The method of claim 13 , wherein at least one of the first real-world image and the second real-world image is a real-time image.

17. The method of claim 15 , further comprising:

overlapping information of the retrieval distance over the second real-world image; and

displaying the overlapped image such that the information of the retrieval distance is matched with a location of the second object.

18. The method of claim 13 , wherein the size of the first real-world image is changed according to the change in the zooming level.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2026
From: MEC RESOURCES LLC
To: SIPCO LLC
Reel/Frame 075695/0252 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 27, 2019
From: TRIPLE REALITY TECHNOLOGIES LLC
To: MEC RESOURCES LLC
Reel/Frame 050174/0980 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2017
From: PANTECH INC
To: TRIPLE REALITY TECHNOLOGIES, LLC
Reel/Frame 043081/0665 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVAL OF PATENTS 09897290, 10824929, 11249232, 11966263 PREVIOUSLY RECORDED AT REEL: 040654 FRAME: 0749. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Jan 18, 2017
From: PANTECH CO., LTD.
To: PANTECH INC.
Reel/Frame 041413/0799 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT APPLICATION NUMBER 10221139 PREVIOUSLY RECORDED ON REEL 040005 FRAME 0257. ASSIGNOR(S) HEREBY CONFIRMS THE PATENT APPLICATION NUMBER 10221139 SHOULD NOT HAVE BEEN INCLUED IN THIS RECORDAL. Recorded Nov 7, 2016
From: PANTECH CO., LTD.
To: PANTECH INC.
Reel/Frame 040654/0749 →
DE-MERGER Recorded Sep 13, 2016
From: PANTECH CO., LTD.
To: PANTECH INC.
Reel/Frame 040005/0257 →