IP Library › Granted Patent US 11,170,222
Granted Patent B2
US 11,170,222 · App. 16/808,017 · Granted Nov 9, 2021

XR device and method for controlling the same

Inventors: Minwoo Kim (Seoul, KR); Hyunjoo Ryu (Seoul, KR); Minhyun Park (Seoul, KR); Seokyoung Oh (Seoul, KR)
Assignee: LG ELECTRONICS INC.
G06K9/00671G06F3/013G06F3/04817G06T7/74G06T11/60G06T15/205G06T19/006G06T2215/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,170,222
App. No.
16/808,017
Granted
Nov 9, 2021
Kind
B2
Abstract

The present disclosure relates to an extended reality (XR) device and a method for controlling the same. More particularly, the present disclosure is applicable to all of the technical fields of 5 th generation (5G) communication, robots, self-driving, and artificial intelligence (AI). The XR device comprises a display; a wireless communication module performing communication with an external server that provides Augmented Reality (AR) information; a first camera receiving an image that includes at least one object of a real world; and a processor acquiring AR information on the object from the external server through the wireless communication module and displaying the acquired AR information on the display, wherein the processor displays an icon instead of the AR information based on situational characteristics of the XR device, and acquires and displays the AR information, in response to an input for selecting the icon.

Claims (31)

1. An Extended Reality (XR) device comprising:

a display;

a wireless communication module configured to perform communication with an external server;

a first camera configured to receive an image that includes at least one object of a real world; and

a processor operably coupled with the display, the wireless communication module and the first camera, and configured to:

determine whether a Wi-Fi network is being used by the XR device,

in response to determining that the Wi-Fi network is being used by the XR device, acquire Augmented Reality (AR) information on the at least one object from the external server through the wireless communication module and display the AR information,

in response to determining that the Wi-Fi network is not being used by the XR device, display an icon instead of the AR information, and

in response to receiving an input for selecting the icon while the Wi-Fi network is not being used by the XR device, acquire and display the AR information.

2. The XR device of claim 1 , further comprising:

a memory configured to store two or more icons, and

wherein the icon instead of the AR information corresponds to the AR information among the icons stored in the memory.

3. The XR device of claim 1 , further comprising:

a second camera sensing a user's eyes direction,

wherein the processor is further configured to display the AR information or the icon based on the user's eyes direction sensed through the second camera when the user's eyes are gazed at the at least one object for a preset time or more.

4. The XR device of claim 3 , wherein the processor is further configured to determine that the icon is selected when the user's eyes are gazed at the icon for a preset time or more.

5. The XR device of claim 1 , wherein the processor is further configured to display the AR information or the icon in accordance with a size of the display.

6. The XR device of claim 1 , wherein the processor is further configured to display the AR information or the icon in accordance with a preset data download use allowable amount.

7. The XR device of claim 1 , wherein the processor is further configured to display a shape of the icon differently based on whether a user of the XR device is an adult.

8. The XR device of claim 1 , wherein the processor is further configured to display information indicating a data type of the AR information on the icon.

9. The XR device of claim 1 , wherein the processor is further configured to display a shape of the icon differently based on a distance between the XR device and the at least one object.

10. The XR device of claim 1 , wherein the processor is further configured to change a type of information displayed on the icon based on a communication speed provided by a communication network which is currently used.

11. The XR device of claim 1 , wherein the processor is further configured to display information indicating an event, which indicates that the AR information is updated, on the icon when the event is received from the external server.

12. The XR device of claim 1 , wherein the processor is further configured to display an amount of a content included in the AR information differently based on whether a position of the XR device is changed and a communication speed provided by a network which is currently connected.

13. The XR device of claim 1 , wherein the processor is further configured to display the AR information or the icon depending on a moving speed of the XR device.

14. A method for controlling an Extended Reality (XR) device, the method comprising:

receiving, via a camera, an image that includes at least one object of a real world;

determining whether a Wi-Fi network is being used by the XR device;

in response to determining that the Wi-Fi network is being used by the XR device, acquiring Augmented Reality (AR) information on the at least one object from an external server through a wireless communication module in the XR device and displaying the AR information;

in response to determining that the Wi-Fi network is not being used by the XR device, displaying an icon instead of the AR information; and

in response to receiving an input for selecting the icon while the Wi-Fi network is not being used by the XR device, acquiring and displaying the AR information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 4, 2020
From: KIM, MINWOO; RYU, HYUNJOO; PARK, MINHYUN; OH, SEOKYOUNG
To: LG ELECTRONICS INC.
Reel/Frame 052017/0116 →
Priority Claims (1)
KR 10-2019-0136774 · Oct 30, 2019 · national
Continuity (1)
Related Publication 20210133448A1 · May 6, 2021
Cited By (1)
US 12,738,053