IP Library › Granted Patent US 11,625,142
Granted Patent B2
US 11,625,142 · App. 17/643,107 · Granted Apr 11, 2023

User equipment and control method for the same

Inventors: Rowoon An (Seoul, KR); Jae Yul Woo (Seoul, KR); Seunghyun Woo (Seoul, KR); Soobin Kim (Seoul, KR)
Assignees: Hyundai Motor Company; Kia Corporation
G06F3/04817G06F3/0482G06F3/04886H04N5/23293H04N5/272
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,625,142
App. No.
17/643,107
Granted
Apr 11, 2023
Kind
B2
Abstract

An embodiment user equipment includes an image sensor, a user interface configured to display an image photographed by the image sensor and to receive a user input, a location detection sensor configured to detect a location of the user equipment, and a controller configured to identify a point of interest (POI) located in a shooting direction of the image sensor based on an output of the location detection sensor, control the user interface to display an augmented reality (AR) icon corresponding to the POI by superimposing the AR icon on the image photographed by the image sensor, and add information about the POI to a scrap list based on an input to the AR icon.

Claims (40)

1. A user equipment comprising:

an image sensor;

a user interface configured to display an image photographed by the image sensor and to receive a user input;

a location detection sensor configured to detect a location of the user equipment; and

a controller configured to:

identify a point of interest (POI) located in a shooting direction of the image sensor based on an output of the location detection sensor;

control the user interface to display an augmented reality (AR) icon corresponding to the identified POI by superimposing the AR icon on the image photographed by the image sensor; and

add information about the identified POI to a scrap list among a plurality of POIs based on an input to the AR icon, wherein the controller is configured to control the user interface to display the AR icon of the identified POI by superimposing the AR icon on the image photographed by the image sensor based on a selection of a scrap display filter, and only the AR icon of the identified POI corresponding to the selection of the scrap display filter and corresponding to the shooting direction of the image sensor based on the output of the location detection sensor is superimposed and displayed.

2. The user equipment of claim 1 , wherein the input to the AR icon comprises double tapping of the AR icon.

3. The user equipment of claim 1 , wherein the controller is configured to control the user interface to display a scrap button and add the information about the identified POI to the scrap list based on an input to the scrap button.

4. The user equipment of claim 1 , wherein the controller is configured to control the user interface to display information about each of the plurality of POIs included in the scrap list based on a selection of a scrap list display.

5. The user equipment of claim 4 , wherein the controller is configured to control the user interface to display information about at least one POI corresponding to a business type filter among the plurality of POIs included in the scrap list based on a selection of the business t e filter.

6. The user equipment of claim 4 , wherein the controller is configured to control the user interface to display the information about each of the plurality of POIs in an order of closest to the user equipment.

7. The user equipment of claim 4 , wherein, during addition of the information about the identified POI to the scrap list, the controller is configured to add a preference value for the identified POI to the information about the identified POI, and to control the user interface to display the information about each of the plurality of POIs in an order of highest preference value.

8. The user equipment of claim 1 , further comprising a communicator, wherein the controller is configured to control the communicator to transmit the information about the identified POI included in the scrap list to an external device.

9. The user equipment of claim 1 , further comprising a communicator, wherein the controller is configured to control the user interface to display a list of surrounding POIs located in a vicinity of the user equipment based on an input to a create post button, and based on a selection of a first POI from the list of surrounding POIs and a post about the first POI being input, to control the communicator to transmit to an external server post information including an AR image of the post and location information of the first POI.

10. The user equipment of claim 9 , wherein the controller is configured to control the user interface to display the AR image of the post by superimposing the AR image of the post about a location of the first POI on the image photographed by the image sensor.

11. The user equipment of claim 9 , wherein the controller is configured to control the user interface to display a list of posts about the first POI based on an input to the AR icon corresponding to the first POI.

12. The user equipment of claim 9 , wherein the controller is configured to control the communicator to transmit the post information to an external device.

13. A control method for a user equipment comprising an image sensor, a user interface, and a location detection sensor, the control method comprising:

identifying a point of interest (POI) located in a shooting direction of the image sensor based on an output of the location detection sensor;

controlling the user interface to display an augmented reality (AR) icon corresponding to the POI by superimposing the AR icon on an image photographed by the image sensor;

adding information about the identified POI to a scrap list among a plurality of POIs based on an input to the AR icon; and

controlling the user interface to display the AR icon of the identified POI by superimposing the AR icon on the image photographed by the image sensor based on a selection of a scrap display filter, wherein only the AR icon of the identified POI corresponding to the selection of the scrap display filter and corresponding to the shooting direction of the image sensor based on the output of the location detection sensor is superimposed and displayed.

14. The control method of claim 13 , wherein the input to the AR icon comprises double tapping of the AR icon.

15. The control method of claim 13 , further comprising:

controlling the user interface to display a scrap button; and

adding the information about the identified POI to the scrap list based on an input to the scrap button.

16. The control method of claim 13 , further comprising controlling the user interface to display information about each of the plurality of POIs included in the scrap list based on a selection of a scrap list display.

17. The control method of claim 16 , further comprising controlling the user interface to display information about at least one POI corresponding to a business type filter among the plurality of POIs included in the scrap list based on a selection of the business type filter.

18. The control method of claim 16 , further comprising controlling the user interface to display the information about each of the plurality of POIs in an order of closest to the user equipment.

19. A system comprising:

a user interface configured to display an image photographed by an image sensor and to receive a user input; and

a controller configured to:

receive the image photographed by the image sensor;

receive a location of user equipment from a location detection sensor;

identify a point of interest (POI) located in a shooting direction of the image sensor based on an output of the location detection sensor;

control the user interface to display an augmented reality (AR) icon corresponding to the identified POI by superimposing the AR icon on the image photographed by the image sensor; and

add information about the identified POI to a scrap list among a plurality of POIs based on an input to the AR icon, wherein the controller is configured to control the user interface to display the AR icon of the identified POI by superimposing the AR icon on the image photographed by the image sensor based on a selection of a scrap display filter, and only the AR icon of the identified POI corresponding to the selection of the scrap display filter and corresponding to the shooting direction of the image sensor based on the output of the location detection sensor is superimposed and displayed.

20. The system of claim 19 , wherein the controller is configured to control the user interface to display information about each of the plurality of POIs included in the scrap list based on a selection of a scrap list display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2021
From: AN, ROWOON; WOO, JAE YUL; WOO, SEUNGHYUN; KIM, SOOBIN
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 058326/0582 →
Priority Claims (1)
KR 10-2021-0017718 · Feb 8, 2021 · national
Continuity (1)
Related Publication 20220253203A1 · Aug 11, 2022
Cited By (4)
US 12,223,608 US 12,265,586 US 12,322,046 US 12,561,651