IP Library Granted Patent US 11,268,822
Granted Patent B2
US 11,268,822 · App. 16/100,694 · Granted Mar 8, 2022

Method and system for navigation using video call

Inventors: Dongwon Lee (Seongnam-si, KR); Jungjun Park (Seongnam-si, KR); Jongjin Cho (Seongnam-si, KR); In Won Cho (Seongnam-si, KR)
Assignee: LINE CORPORATION
G01C21/362G01C21/3614G01C21/3647G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,268,822
App. No.
16/100,694
Granted
Mar 8, 2022
Kind
B2
Abstract

Disclosed is a computer-implemented navigation method including transmitting, to a counterpart terminal, current location-based video data that is input to a video call screen of a terminal during a video call; receiving instruction information for a navigation based on the video data from the counterpart terminal that displays the video data on a video call screen of the counterpart terminal; generating navigation information by mapping the instruction information to the video data of the terminal; and providing the navigation information based on location information of the terminal.

Claims (33)

1. A computer-implemented navigation method comprising:

transmitting, from a terminal, current location-based video data during a video call, the video data comprising an image of the video call and metadata acquired from a camera;

receiving, from a counterpart terminal, instruction information for navigation based on the video data, the instruction information including route instructions between two points;

generating navigation information to display a route based on the route instructions between the two points by mapping the instruction information to the video data; and

providing the navigation information based on location information of the terminal by overlaying a layer onto features of the image of the video call, the layer including the route.

2. The method of claim 1 , wherein the providing of the navigation information comprises providing augmented reality (AR)-based navigation information generated by mapping the instruction information to the video data of the terminal, based on the location information of the terminal.

3. The method of claim 1 , wherein the mapping of the instruction information to the video data is based on a location at which the instruction information is input.

4. The method of claim 1 , wherein the receiving of the instruction information comprises receiving, from the counterpart terminal, instruction information that is input through a user interface for inputting the instruction information in response to the user interface being provided to the counterpart terminal.

5. The method of claim 1 , wherein the receiving of the instruction information comprises receiving, from the counterpart terminal, instruction information associated with a specific event input to the video data.

6. The method of claim 1 , wherein the providing of the navigation information comprises providing guidance information associated with the navigation information based on the location information of the terminal.

7. The method of claim 1 , wherein the providing of the navigation information comprises consecutively updating the navigation information based on changed location information of the terminal in response to the location information of the terminal being changed.

8. The method of claim 1 , wherein the providing of the navigation information comprises playing content including a destination route of the terminal as the navigation information in response to the content being uploaded from the counterpart terminal.

9. The method of claim 1 , wherein the providing of the navigation information comprises generating information associated with a deviation of the terminal in response to detecting an occurrence of the deviation of the terminal based on the navigation information.

10. The method of claim 1 , wherein the providing of the navigation information comprises transmitting and receiving a message between the terminal and the counterpart terminal.

11. The method of claim 1 , wherein the providing of the navigation information comprises displaying a travel route through which the terminal is moving based on the location information of the terminal.

12. The method of claim 1 , wherein the transmitting of the current location-based video data comprises transmitting, to the counterpart terminal, the current location-based video data that is input to the video call screen of the terminal, according to a camera mode that operates during the video call.

13. A non-transitory computer-readable recording medium storing instructions that, when executed by a processor, cause the processor to perform a navigation method comprising:

transmitting, from a terminal, current location-based video data during a video call, the video data comprising an image of the video call and metadata acquired from a camera;

receiving instruction information, from a counterpart terminal, for navigation based on the video data, the instruction information including route instructions between two points;

generating navigation information to display a route based on the route instructions between the two points by mapping the instruction information to the video data; and

providing the navigation information based on location information of the terminal by overlaying a layer onto features of the image of the video call, the layer including the route.

14. A navigation server comprising:

a memory configured to store instructions; and

a processor, configured to execute the instructions to

determine current location information of a terminal during a video call from video data comprising an image of the video call and metadata acquired from a camera;

acquire additional information associated with instruction information for navigation that is input based on video data of the terminal from a counterpart terminal in response to the video data of the terminal being displayed on a video call screen of the counterpart terminal, the instruction information including route instructions between two points; and

provide the additional information associated with the instruction information to the terminal to be mapped to the image of the video call as a layer including the additional information as a route, based on the route instructions, between the two points.

15. The navigation server of claim 14 , wherein the processor is configured to generate augmented reality (AR)-based navigation information by mapping the additional information associated with the instruction information to the video data.

16. The navigation server of claim 14 , wherein the processor is configured to transfer map information including the current location information of the terminal to the video call screen of the counterpart terminal.

17. The navigation server of claim 14 , wherein the processor is configured to generate guidance information based on the current location information of the terminal and the instruction information.

18. The navigation server of claim 14 , wherein the processor is configured to set a deviation range for detecting a deviation of the terminal, to determine whether the terminal is deviated based on the deviation range, and to generate an alert message.

19. The navigation server of claim 14 , wherein the processor is configured to generate the layer that includes additional information associated with the instruction information and to transmit the layer to the terminal.

20. The navigation server of claim 16 , wherein the processor is configured to display, on the video call screen of the counterpart terminal, a travel route according to location information of the terminal based on navigation information that is displayed on the video call screen of the terminal.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2024
From: Z INTERMEDIATE GLOBAL CORPORATION
To: LY CORPORATION
Reel/Frame 067096/0431 →
CHANGE OF NAME Recorded Apr 10, 2024
From: LINE CORPORATION
To: Z INTERMEDIATE GLOBAL CORPORATION
Reel/Frame 067069/0467 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF THE ASSIGNEES CITY IN THE ADDRESS SHOULD BE TOKYO, JAPAN PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0303. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 062401/0490 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CITY SHOULD BE SPELLED AS TOKYO PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0141. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 062401/0328 →
CHANGE OF NAME Recorded Dec 28, 2021
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 058597/0141 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 058597/0303 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2018
From: LEE, DONGWON; PARK, JUNGJUN; CHO, JONGJIN; CHO, IN WON
To: LINE CORPORATION
Reel/Frame 046616/0966 →
Priority Claims (1)
KR 10-2017-0102953 · Aug 14, 2017 · national
Continuity (1)
Related Publication 20190049265A1 · Feb 14, 2019