IP Library Granted Patent US 11,562,545
Granted Patent B2
US 11,562,545 · App. 17/395,083 · Granted Jan 24, 2023

Method and device for providing augmented reality, and computer program

Inventors: Sang Jo Choi (Seoul, KR); Hee Cheol Park (Seoul, KR)
Assignee: LINE CORPORATION
G06T19/006G01P15/18G01S7/4802G01S17/08G01S17/42G01S17/86G06F3/011G06F3/0346G06T7/73G01S15/08G06T2219/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,562,545
App. No.
17/395,083
Granted
Jan 24, 2023
Kind
B2
Abstract

According to at least some example embodiments, a computer-readable medium stores computer-executable program instructions that, when executed by a processor, cause the processor to perform operations including, obtaining plane information of a plane by using first distances from a terminal to a plurality of points on the plane; obtaining a normal vector of the plane by using direction information of the terminal measured by a direction sensor and the plane information; determining, based on the normal vector, a parameter of an object to be displayed on the plane; and displaying, on a display of the terminal, the object according to the determined parameter.

Claims (39)

1. A non-transitory computer-readable medium storing computer-executable program instructions that, when executed by a processor of a terminal, cause the processor to perform operations including,

capturing an image by a camera of the terminal;

obtaining plane information of a plane in the captured image;

determining an attribute of the plane based on the plane information; and

based on the determined attribute of the plane, displaying, on a display of the terminal, an object on the plane; and

displaying at least a portion of the captured image in a pre-set internal region of the object.

2. The non-transitory computer-readable medium of claim 1 , wherein the attribute of the plane includes a type of the plane.

3. The non-transitory computer-readable medium of claim 1 , wherein the plane information is direction information of the plane based on a direction of the terminal.

4. The non-transitory computer-readable medium of claim 3 , wherein the obtaining the plane information includes measuring the direction of the terminal by a direction sensor.

5. The non-transitory computer-readable medium of claim 1 , wherein the displaying includes:

obtaining a parameter of the object; and

according to the parameter of the object, displaying the object on the plane.

6. The non-transitory computer-readable medium of claim 5 , wherein the parameter comprises at least one of a size of the object, direction of the object, color of the object, or an animation applied to the object.

7. The non-transitory computer-readable medium of claim 1 , wherein the displaying includes two-dimensionally rendering 3-dimensional (3D) information for displaying the object, according to a rendering direction, and two-dimensionally displaying the object.

8. The non-transitory computer-readable medium of claim 1 , wherein the displaying includes overlapping the object and a video captured by the camera and displaying the video overlapped by the object.

9. An augmented reality providing method comprising:

capturing an image by a camera of a terminal;

obtaining plane information of a plane in the captured image;

determining an attribute of the plane based on the plane information;

based on the determined attribute of the plane, displaying, on a display of the terminal, an object on the plane: and

displaying at least a portion of the captured image in a pre-set internal region of the object.

10. The augmented reality providing method of claim 9 , wherein the displaying includes:

obtaining a parameter of the object; and

according to the parameter of the object, displaying the object on the plane.

11. The augmented reality providing method of claim 9 , wherein the displaying includes two-dimensionally rendering 3-dimensional (3D) information for displaying the object, according to a rendering direction, and two-dimensionally displaying the object.

12. The augmented reality providing method of claim 9 , wherein the displaying includes overlapping the object and a video captured by the camera and displaying the video overlapped by the object.

13. An augmented reality providing apparatus comprising:

a camera configured to capture an image; and

processing circuitry configured to,

obtain plane information of a plane in the captured image;

determine an attribute of the plane based on the plane information;

based on the determined attribute of the plane, display, on a display unit, an object on the plane; and

display at least a portion of the captured image in a pre-set internal region of the object.

14. The augmented reality providing apparatus of claim 13 , wherein the attribute of the plane includes a type of the plane.

15. The augmented reality providing apparatus of claim 13 , wherein the plane information is direction information of the plane based on a direction of a terminal.

16. The augmented reality providing apparatus of claim 13 , wherein the processing circuitry is configured to obtain a parameter of the object; and

display the object on the plane according to the parameter of the object.

17. The augmented reality providing apparatus of claim 13 , wherein the processing circuitry is configured to render 3-dimensional (3D) information two-dimensionally for displaying the object, according to a rendering direction, and two-dimensionally displaying the object.

18. The augmented reality providing apparatus of claim 14 , wherein the processing circuitry is configured to overlap the object and a video captured by the camera and display the video overlapped by the object.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2024
From: Z INTERMEDIATE GLOBAL CORPORATION
To: LY CORPORATION
Reel/Frame 067096/0431 →
CHANGE OF NAME Recorded Apr 10, 2024
From: LINE CORPORATION
To: Z INTERMEDIATE GLOBAL CORPORATION
Reel/Frame 067069/0467 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CITY SHOULD BE SPELLED AS TOKYO PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0141. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 062401/0328 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF THE ASSIGNEES CITY IN THE ADDRESS SHOULD BE TOKYO, JAPAN PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0303. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 062401/0490 →
CHANGE OF NAME Recorded Dec 28, 2021
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 058597/0141 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 058597/0303 →
Continuity (3)
Continuation 16508830 · Jul 11, 2019
Continuation PCTKR2017002373 · Mar 6, 2017
Related Publication 20210366199A1 · Nov 25, 2021