IP Library Granted Patent US 10,664,047
Granted Patent B2
US 10,664,047 · App. 15/982,064 · Granted May 26, 2020

Displaying visually aligned content of a mobile device

Inventors: Sarbajit K. Rakshit (Kolkata, IN); Martin G. Keen (Cary, NC); James E. Bostick (Cedar Park, TX); John M. Ganci, Jr. (Cary, NC)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06F3/012G06F1/1686G06F1/1694G06F2200/1614G06F2200/1637
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,664,047
App. No.
15/982,064
Granted
May 26, 2020
Kind
B2
Abstract

Systems and methods for the display of visually aligned content are disclosed. In embodiments, method comprises: determining a relative angular orientation of a display of a mobile device based on real-time sensor data from one or more sensors; determining a facial direction of a user relative to the mobile device using real-time image data from one or more cameras of the mobile device; determining that the facial direction of the user does not align with the relative angular orientation of the display; dynamically determining a configuration of an adjustable display area for displaying the content to the user based on the relative angular orientation of the display and the user's facial direction; and initiating the display of the content on the adjustable display area, wherein at least a portion of the adjustable display area comprises a virtual display created by one or more projectors of the mobile device.

Claims (62)

1. A computer-implemented method, comprising:

determining, by a mobile device, a relative angular orientation of a physical display of the mobile device based on real-time sensor data from one or more sensors of the mobile device;

determining, by the mobile device, a facial direction of a user relative to the mobile device using real-time image data from one or more cameras of the mobile device;

determining, by the mobile device, that an axis of the physical display is at an angle with respect to the facial direction of the user that is greater than a predetermined threshold angle;

dynamically determining, by the mobile device, a configuration of an adjustable display area for displaying the content to the user based on the relative angular orientation of the physical display and the user's facial direction; and

initiating, by the mobile device, the display of the content on the adjustable display area, wherein at least a portion of the adjustable display area comprises a virtual display created by one or more projectors of the mobile device, a first portion of the content is displayed on the physical display, and a second portion of the content is displayed by the one or more projectors.

2. The method of claim 1 , further comprising:

determining, by the mobile device, a content type of the content; and

determining, by the mobile device, a content layout mode of the content based on the content type,

wherein the content layout mode comprises a landscape layout mode or a portrait layout mode,

wherein the dynamically determining the configuration of the adjustable display area further comprises determining a size of the adjustable display area based on the content layout mode, and

wherein the initiating the display of the content comprises initiating the display of the content in the determined content layout mode.

3. The method of claim 1 , wherein the adjustable display area has a size that is greater than a size of the physical display of the mobile device.

4. The method of claim 1 , wherein the configuration of the adjustable display area comprises a size of the adjustable display area and a directional orientation of the adjustable display area, wherein the directional orientation is based on the relative angular orientation of the physical display and the user's facial direction.

5. The method of claim 1 , further comprising:

determining, by the mobile device, a content type for the content; and

determining, by the mobile device, a content layout mode for the content based on the content type, wherein the content layout mode comprises a landscape layout mode and a portrait layout mode, wherein the initiating the display of the content comprises initiating the display of the content in the determined content layout mode.

6. The method of claim 5 , further comprising receiving, by the mobile device, mapping data that maps a plurality of content types to respective layout modes, wherein the determining the content layout mode for the content based on the content type is performed utilizing the mapping data.

7. The method of claim 1 , further comprising:

detecting, by the mobile device, a user interaction with the adjustable display area; and

initiating, by the mobile device, a mobile device function based on the detection of the user interaction.

8. The method of claim 1 , further comprising:

detecting, by the mobile device, a content-free portion of the physical display; and

initiating, by the mobile device, display of supplemental content in the content-free portion of the physical display.

9. A computer program product for the display of visually aligned content, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a mobile device to cause the mobile device to:

determine a relative angular orientation of a physical display of the mobile device based on real-time sensor data from one or more sensors of the mobile device;

determine a facial direction of a user relative to the mobile device using real-time image data from one or more cameras of the mobile device;

determine that the facial direction of the user does not align with the relative angular orientation of the physical display;

dynamically determine a configuration of an adjustable display area for displaying the content to the user based on the relative angular orientation of the physical display and the user's facial direction; and

initiate the display of the content on the adjustable display area in a content layout mode, wherein a portion of the adjustable display area comprises a virtual display created by the projection of content by one or more projectors of the mobile device,

wherein the content is projected towards the user's facial direction, and

wherein the content layout mode is independent of an orientation of the physical display.

10. The computer program product of claim 9 , wherein the adjustable display area comprises the virtual display area and the physical display of the mobile device.

11. The computer program product of claim 9 , wherein the adjustable display area has a size that is greater than a size of the physical display of the mobile device.

12. The computer program product of claim 9 , wherein the configuration of the adjustable display area comprises a size of the adjustable display area and a directional orientation of the adjustable display area, wherein the directional orientation is based on the relative angular orientation of the physical display and the user's facial direction.

13. The computer program product of claim 9 , further comprising program instructions to cause the mobile device to:

determine a content type for the content; and

determine a content layout mode for the content based on the content type, wherein the content layout mode comprises a landscape layout mode and a portrait layout mode, wherein the initiating the display of the content comprises initiating the display of the content in the determined content layout mode.

14. The computer program product of claim 13 , further comprising program instructions to cause the mobile device to receive and store mapping data that maps a plurality of content types to respective layout modes, wherein the determining the content layout mode for the content based on the content type is performed utilizing the mapping data.

15. The computer program product of claim 9 , further comprising program instructions to cause the mobile device to:

detect a user interaction with the adjustable display area; and

initiate a mobile device function based on the detection of the user interaction.

16. The computer program product of claim 9 , further comprising program instructions to cause the mobile device to:

detect a content-free portion of the physical display; and

initiate display of supplemental content in the content-free portion of the physical display.

17. A mobile device for the display of visually aligned content, comprising:

one or more sensors;

one or more cameras;

one or more content projectors adapted to project content on a virtual display;

a physical display adapted to display content to a user;

a CPU, a computer readable memory and a computer readable storage medium associated with the mobile device;

program instructions to determine a relative angular orientation of the physical display based on real-time sensor data from the one or more sensors;

program instructions to determine a facial direction of a user relative to the physical display of the mobile device using real-time image data from the one or more cameras;

program instructions to determine that an axis of the physical display is at an angle with respect to the facial direction of the user that is greater than a predetermined threshold angle, indicating that the facial direction does not align with the relative angular orientation of the physical display;

program instructions to dynamically determine a configuration of an adjustable display area for displaying the content to the user based on the relative angular orientation of the physical display and the user's facial direction; and

program instructions to initiate the display of the content on the adjustable display area, wherein the adjustable display area comprises the virtual display and the physical display, a first portion of the content is displayed on the physical display, and a second portion of the content is displayed on the virtual display,

wherein the program instructions are stored on the computer readable storage medium for execution by the CPU via the computer readable memory.

18. The mobile device of claim 17 , wherein the adjustable display area has a size that is greater than a size of the physical display of the mobile device.

19. The mobile device of claim 17 , further comprising:

program instructions to determine a content type for the content; and

program instructions to determine a content layout mode for the content based on the content type, wherein the content layout mode comprises a landscape layout mode and a portrait layout mode, wherein the initiating the display of the content comprises initiating the display of the content in the determined content layout mode.

20. The mobile device of claim 17 , further comprising program instructions to receive and store mapping data that maps a plurality of content types to respective layout modes, wherein the determining the content layout mode for the content based on the content type is performed utilizing the mapping data, and the determination of the content layout mode is independent of an orientation of the physical display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2018
From: RAKSHIT, SARBAJIT K.; KEEN, MARTIN G.; BOSTICK, JAMES E.; GANCI, JOHN M., JR.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 045832/0467 →
Continuity (1)
Related Publication 20190354169A1 · Nov 21, 2019