IP Library Granted Patent US 11,960,091
Granted Patent B2
US 11,960,091 · App. 17/927,667 · Granted Apr 16, 2024

Method and device for controlling display of content

Inventors: Tommy Arngren (Södra Sunderbyn, SE); Andreas Kristensson (Södra Sandby, SE); Peter Ökvist (Luleå, SE); Jonas Pettersson (Luleå, SE)
Assignee: Telefonaktiebolaget LM Ericsson (publ)
G02B27/0172G06F3/012G06F3/013G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,960,091
App. No.
17/927,667
Granted
Apr 16, 2024
Kind
B2
Abstract

Embodiments of the present disclosure provide a method, a computer program product, and a wearable device for controlling display of content. The method is performed in a wearable device ( 10 ) comprising a head mounted display having a display region ( 12 ). The method comprises causing (S 12 ) to display a first visual content ( 32 ) on a first portion ( 14 ) of the display region, corresponding to an eye gaze direction ( 22 ) of the user ( 20 ). The method comprises determining (S 13 ) to transmit a second visual content ( 34 ) to one or more external display devices ( 40 a - 40 n ) based on presence of the one or more external display devices ( 40 a - 40 n ) in a field of view, FoV, of the wearable device ( 10 ). Further, the method comprises sending (S 14 ) a request to at least one of the one or more external display devices ( 40 a - 40 n ) to display the second visual content ( 34 ). The method further comprises causing (S 15 ) to display the second visual content ( 34 ), at least outside the first portion ( 14 ) of the display region ( 12 ). The resolution of the first visual content ( 32 ) is higher than the resolution of the second visual content ( 34 ).

Claims (67)

1. A method for controlling display of content, presented to a user, the method being performed in a wearable device, the wearable device comprising a head mounted display having a display region, wherein the method comprises:

causing to display a first visual content on a first portion of the display region, corresponding to an eye gaze direction of the user;

determining to transmit a second visual content to one or more external display devices based on presence of the one or more external display devices in the field of view (FoV) of the wearable device;

sending a request to at least one of the one or more external display devices to display the second visual content on the one or more external display devices, simultaneously with displaying the first visual content on the first portion of the display region, and

displaying the first visual content on the first portion of the display region simultaneously with displaying the second visual content outside the first portion on the one or more external display devices.

2. A computer program product comprising a non-transitory computer readable medium, having thereon a computer program comprising program instructions, the computer program being loadable into a processing circuitry and configured to cause execution of the method of claim 1 when the computer program is run by the processing circuitry.

3. A wearable device for controlling display of content, presented to a user, the wearable device comprising:

a head mounted display having a display region;

processing circuitry; and

a memory storing instructions that, when executed by the processing circuitry, causes the wearable device to:

display a first visual content on a first portion of the display region, corresponding to an eye gaze direction of the user;

determine to transmit a second visual content to one or more external display devices based on presence of the one or more external display devices in the field of view (FoV) of the wearable device and in front of the first portion of the display region;

send a request to at least one of the one or more external display devices to display the second visual content on the one or more external display devices, simultaneously with displaying the first visual content on the first portion of the display region, and

display the first visual content on the first portion of the display region simultaneously with displaying the second visual content outside the first portion on the one or more external display devices.

4. The wearable device of claim 3 , wherein the wearable device is further configured to determine the eye gaze direction, wherein the eye gaze direction is determined based on at least one of:

a tracked eye gaze direction of the user on the display region of the wearable device,

an identified type of content or an application being displayed on the first portion of the display region, and

detected occurrence of one or more events in a predetermined range of the wearable device.

5. The wearable device of claim 3 , wherein the wearable device is further configured to:

determine the first visual content to be displayed on the first portion of the display region;

determine whether the user is in motion using one or more motion determining sensors;

cause to display the first visual content on the first portion of the display region, in response to determining that the user is not in motion;

in response to determining that the user is in motion, align, by an aligner the first visual content on the first portion of the display region; and

cause to display the first visual content on the first portion of the display region based on a threshold value associated with the determined motion.

6. The wearable device of claim 3 , wherein the instructions to send the request comprise instructions that, when executed by the processing circuitry, cause the wearable device to:

select, by a selector, the at least one of the one or more external display devices based on a distance between the wearable device and the respective external display device;

determine the second visual content to be suitable for being displayed on the selected at least one external display device of the one or more external display devices; and

cause to display the second visual content on a portion of a display region associated with the selected at least one external display device of the one or more external display devices, wherein the portion of the display region associated with the one or more external display devices is defined based on a field of view (FoV) of the wearable device, wherein

a portion of the display region for displaying the second visual content is a complete FoV of the wearable device,

a portion of the display region for displaying the second visual content is a partial FoV of the wearable device, or

a portion of the display region for displaying the second visual content is larger than the FoV of the wearable device.

7. The wearable device of claim 3 , further comprising instructions that, when executed by the processing circuitry, cause the wearable device to:

determine a change in distance between the wearable device and the at least one of the one or more external display devices; and

cause to vary the resolution of the second visual content being displayed on the one or more external display devices based on the change in distance, wherein the resolution of the second visual content decreases with increase in distance between the wearable device and the at least one of the one or more external display devices.

8. The wearable device of claim 3 , further comprising instructions that, when executed by the processing circuitry, cause the wearable device to:

determine a head movement and/or a movement in the eye gaze direction from the first portion of the display region to a second portion of the display region;

cause seamless transition to display the first visual content, on the second portion of the display region based on the determined head movement and/or the movement in the eye gaze direction;

send a request to the one or more external display devices to display the second visual content based on the determined head movement and/or the movement in the eye gaze direction.

9. The wearable device of claim 8 , wherein the instructions to determine the head movement and/or the movement in the eye gaze direction comprise instructions that, when executed by the processing circuitry, cause the wearable device to:

identify a type of content and/or an application being displayed on the first portion of the display region; and

determine the head movement and/or the movement in the eye gaze direction based on the identified type of content and/or the application.

10. The wearable device of claim 8 , wherein the instructions to determine the head movement and/or the movement comprise instructions that, when executed by the processing circuitry, cause the wearable device to detect, by an event detector, occurrence of one or more events causing the head movement and/or the movement in the eye gaze direction in a predetermined range of the wearable device.

11. The wearable device of claim 10 , wherein the instructions to detect occurrence of the one or more events comprise instructions that, when executed by the processing circuitry, cause the wearable device to:

determine a head movement and/or the movement in the eye gaze direction using movement sensors equipped in the wearable device; and

detect, by the event detector, the occurrence of the one or more events by analysing the head movement(s) and/or the movement(s) in the eye gaze direction.

12. The wearable device of claim 10 , wherein the one or more events comprises at least one of: visual events in the first visual content and the second visual content, events occurring in real world including auditory events, perceptive events and events related to haptic feedback.

13. The wearable device of claim 8 , further comprising instructions that, when executed by the processing circuitry, cause the wearable device to:

predict the second portion of the display region based on the determined head movement and/or the movement in the eye gaze direction, while displaying the first visual content on the first portion of the display region;

cause seamless transition to display the first visual content, on the predicted second portion of the display region; and

send a request to the one or more external display devices to display the second visual content based on the determined head movement and/or the movement in the eye gaze direction.

14. The wearable device of claim 3 , wherein the instructions to determine to transmit comprise instructions that, when executed by the processing circuitry, cause the wearable device to:

determine that at least two users are viewing same visual content on respective wearable devices;

identify, by an overlap identifier, an overlap of the users respective eye gaze directions and/or an overlap between the user's respective FoV of the wearable devices; and

determine the one or more external display devices in a FoV of the respective wearable devices.

15. The wearable device of claim 14 , further comprising instructions, that when executed by the processing circuitry, cause the wearable device to:

cause to display the first visual content corresponding to the identified overlap between the users respective eye gaze directions on the at least one of the one or more external devices; and

cause to display the second visual content corresponding to the identified overlap between the user's respective FoV on the at least one of the one or more external display devices.

16. The wearable device of claim 14 , wherein the instructions to determine to transmit comprise instructions that, when executed by the processing circuitry, cause the wearable device to:

determine a movement pattern of the at least two users viewing the same visual content on respective wearable devices;

predict, by the overlap identifier, an overlap between the users respective eye gaze directions and/or predicting an overlap between the user's respective FoV based on the movement pattern; and

determine to transmit the second visual content to at least one of the one or more external display devices based on the prediction.

17. The wearable device of claim 14 , wherein the instructions to determine the movement pattern comprise instructions that, when executed by the processing circuitry, cause the wearable device to:

identify a change in users respective eye gaze directions and/or the user's respective FoV; and

determine the movement pattern based on the change in the users respective eye gaze directions and/or the user's respective FoV.

18. The wearable device of claim 14 , further comprising instructions that, when executed by the processing circuitry cause the wearable device to:

determine to transmit the second visual content corresponding to the identified overlap between the user's respective FoV to the at least one of the one or more external display devices based on the determined movement pattern.

19. The wearable device of claim 3 , wherein a resolution of the first visual content is higher than a resolution of the second visual content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2022
From: ARNGREN, TOMMY; KRISTENSSON, ANDREAS; ÖKVIST, PETER; PETTERSSON, JONAS
To: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
Reel/Frame 061960/0735 →
Continuity (1)
Related Publication 20230213764A1 · Jul 6, 2023
Cited By (1)
US 12,248,144