IP Library › Granted Patent US 12,086,373
Granted Patent B2
US 12,086,373 · App. 17/507,214 · Granted Sep 10, 2024

Electronic device and method for controlling display of a plurality of objects on wearable display device

Inventors: Inyoung Choi (Gyeonggi-do, KR); Insik Myung (Gyeonggi-do, KR); Seungjoon Lee (Gyeonggi-do, KR); Shinjae Jung (Gyeonggi-do, KR); Hoon Han (Gyeonggi-do, KR)
Assignee: Samsung Electronics Co., Ltd
G06F3/04815G02B27/017G06F3/011G06F3/04817G06F3/0482G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,086,373
App. No.
17/507,214
Granted
Sep 10, 2024
Kind
B2
Abstract

Various embodiments of the disclosure disclose a method and apparatus, where an electronic device may include a communication module, a touch display, a memory, and a processor operatively connected to the communication module and the memory, wherein the processor may be configured to display a plurality of objects on the touch display, receive a touch input for the plurality of objects through the touch display while being connected to a wearable display device through the communication module, identify a direction corresponding to the touch input, identify a display angle and display distance of the wearable display device, determine an arrangement position of the plurality of objects included in the electronic device based on at least one of the identified direction, the display angle, or the display distance, and control displaying of the plurality of objects on the wearable display device based on the determination result. Various embodiments are possible.

Claims (44)

1. An electronic device comprising:

a communication module;

a touch display;

a memory; and

a processor operatively connected to the communication module and the memory,

wherein the processor is configured to:

obtain an image captured by a camera of a wearable display device from the wearable display device, while being connected to the wearable display device through the communication module,

recognize a target object by analyzing the obtained image,

detect a user interaction including touching the touch display and subsequently dragging downward and upward, the user interaction for displaying a plurality of objects associated with the target object on the wearable display device,

identify, in response to detecting the user interaction, the plurality of objects associated with the target object,

receive sensing information and location information from the wearable display device,

calculate, based on the obtained image, the sensing information, and the location information, a distance between the wearable display device and the target object, a direction from the target object to the wearable display device, and an angle between the wearable display device and the target object,

determine arrangement positions of the plurality of objects to be displayed on the wearable display device based on the calculated direction, the calculated angle, and the calculated distance, and

control displaying of the plurality of objects on the wearable display device based on the determined arrangement positions of the plurality of objects,

wherein when the target object is a desk, the processor is further configured to:

identify, among the plurality of objects, a first application icon of a first document application and a second application icon of a second document application, and

when a level of association between the desk and the first document application is higher than a level of association between the desk and the second document application, determine an arrangement position of the first application icon closer to the desk than an arrangement position of the second application icon.

2. The electronic device of claim 1 , wherein the processor is configured to control arranging the plurality of objects in a space displayed on the wearable display device.

3. The electronic device of claim 1 , wherein the processor is configured to determine the arrangement positions of the plurality of objects based on a speed of the user interaction.

4. The electronic device of claim 1 , wherein the processor is further configured to determine a number of the plurality of objects based on a time of the user interaction.

5. The electronic device of claim 1 , wherein the processor is configured to:

identify an attribute of an object included in the plurality of objects, and

determine the arrangement positions of the plurality of objects to be displayed on the wearable display device based further on the identified object attribute, and

wherein the identified object attribute includes at least one of time, history, a file, or an application.

6. The electronic device of claim 5 , wherein the determined arrangement positions of the plurality of objects includes positions in a direction within a display distance of the wearable display device according to time attributes of the plurality of objects.

7. The electronic device of claim 6 , wherein the display distance includes a first display distance that is fixed with respect to a position of the electronic device, a second display distance that is fixed with respect to a user wearing the wearable display device, and a third display distance that is fixed with respect to an absolute position.

8. The electronic device of claim 5 , wherein the determined arrangement positions of the plurality of objects includes:

different arrangement positions of the plurality of objects in a depth direction of a display distance of the wearable display device according to history attributes or file attributes of the plurality of objects, or

different arrangement positions of the plurality of objects in at least one of a horizontal direction, a vertical direction, or a depth direction on the display angle of the wearable display device according to application attributes of the plurality of objects.

9. The electronic device of claim 1 , wherein the processor is further configured to:

transmit arrangement information including the determined arrangement positions and object information corresponding to the plurality of objects to the wearable display device, and

control the wearable display device to display the plurality of objects based on the arrangement information.

10. An operation method of an electronic device, the method comprising:

obtaining an image captured by a camera of a wearable display device from the wearable display device, while being connected to the wearable display device through a communication module of the electronic device;

recognizing a target object by analyzing the obtained image;

detecting a user interaction including touching a touch display of the electronic device and subsequently dragging downward and upward, the user interaction for displaying a plurality of objects on the wearable display device;

identifying, in response to detecting the user interaction, the plurality of objects associated with the target object;

receiving sensing information and location information from the wearable display device;

calculating, based on the obtained image, the sensing information, and the location information, a distance between the wearable display device and the target object, a direction from the target to the wearable display device, and an angle between the wearable display device and the target object;

determining arrangement positions of the plurality of objects to be displayed on the wearable display device based on the calculated direction, the calculated angle, and the calculated distance; and

controlling displaying of the plurality of objects on the wearable display device based on the determined arrangement positions of the plurality of objects,

wherein when the target object is a desk, the processor is further configured to:

identifying, among the plurality of objects, a first application icon of a first document application and a second application icon of a second document application, and

when a level of association between the desk and the first document application is higher than a level of association between the desk and the second document application, determining an arrangement position of the first application icon closer to the desk than an arrangement position of the second application icon.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2021
From: CHOI, INYOUNG; MYUNG, INSIK; LEE, SEUNGJOON; JUNG, SHINJAE; HAN, HOON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 057943/0872 →
Priority Claims (1)
KR 10-2020-0137830 · Oct 22, 2020 · national
Continuity (2)
Continuation PCTKR2021012233 · Sep 8, 2021
Related Publication 20220129139A1 · Apr 28, 2022