IP Library Granted Patent US 9,558,714
Granted Patent B2
US 9,558,714 · App. 14/252,048 · Granted Jan 31, 2017

System and method for controlling a display of a mobile device

Inventors: Jerome Pasquero (Montreal, CA); Jason Tyler Griffin (Kitchener, CA)
Assignee: BlackBerry Limited
G09G5/10G06F3/013G06F3/017G06F3/0487G09G2320/0261G09G2330/022
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,558,714
App. No.
14/252,048
Granted
Jan 31, 2017
Kind
B2
Abstract

A method and system are provided for controlling the display of an mobile device by: capturing an image using a camera device of the mobile device, the camera device being directed in a same direction as a display of the mobile device, the image comprising one or more subjects (e.g. users or other humans seen in the image); determining a point of regard in the image for at least one of the one or more subjects, the point of regard being indicative of an area on the display at which a gaze of the corresponding subject is directed; determining, based on the point of regard, an instruction for controlling the display; and controlling the display according to the instruction, wherein controlling the display includes reducing visibility of at least one portion of what is displayed on the display.

Claims (35)

1. A method of controlling a display of a mobile device including a camera, comprising:

capturing a first image including a person, using the camera, the camera being directed in a same direction as the display;

determining in the first image, a first point of regard indicative of an area on the display at which a gaze of the person is directed;

capturing a second image including the person, using the camera, the capturing according to a frequency, the frequency determined according to a criterion associated with a location of the mobile device;

determining a second point of regard in the second image; and

modifying visibility of at least one portion of what is presented on the display of the mobile device when the second point of regard is directed to an area off the display.

2. The method of claim 1 , wherein the step of modifying visibility includes performing one or more of the following: turning off the at least one portion of the display, initiating a screensaver, dimming a backlight, adjusting a focus of content being presented on the display, and locking-out the mobile device.

3. The method of claim 1 , wherein the first point of regard and the second point of regard are determined using at least one of eye tracking and face tracking.

4. The method of claim 1 , wherein the frequency is proportional to sensitivity of the content.

5. The method of claim 1 , wherein the mode of the mobile device is a security mode.

6. The method of claim 1 , wherein the step of modifying visibility includes reducing visibility.

7. The method of claim 1 , wherein the first image and the second image are captured using a same camera.

8. The method of claim 1 , wherein the person is a user of the mobile device.

9. A mobile device comprising a processor, memory, a display, and a camera, the memory storing computer executable instructions for:

capturing a first image including a person, using the camera, the camera being directed in a same direction as the display;

determining in the first image, a first point of regard indicative of an area on the display at which a gaze of the person is directed;

capturing a second image including the person, using the camera, the capturing according to a frequency, the frequency determined according to a criterion associated with a location of the mobile device;

determining a second point of regard in the second image; and

reducing visibility of at least one portion of what is presented on the display when the second point of regard is directed to an area off the display.

10. The mobile device of claim 9 , including an accelerometer, and in which the change in orientation of the mobile device is detectable by the accelerometer.

11. The mobile device of claim 10 , wherein the camera does not capture a next second image when the accelerometer detects that the mobile device is being rotated quickly.

12. The mobile device of claim 9 , wherein the mode of the mobile device is a security mode.

13. The mobile device of claim 9 , wherein the first image and the second image are captured using a same camera.

14. The mobile device of claim 9 , wherein the person is a user of the mobile device.

15. A non-transitory computer readable storage medium for controlling a display of a mobile device including a camera, comprising computer executable instructions for:

capturing a first image including a person, using the camera, the camera being directed in a same direction as the display;

determining in the first image, a first point of regard indicative of an area on the display at which a gaze of the person is directed;

capturing a second image including the person, using the camera, the capturing according to a frequency, the frequency determined according to a criterion associated with a location of the mobile device;

determining a second point of regard in the second image; and

modifying visibility of at least one portion of what is presented on the display when the second point of regard is directed to an area off the display.

16. The non-transitory computer readable storage medium of claim 15 , wherein modifying visibility includes performing one or more of the following: turning off the at least one portion of the display, initiating a screensaver, dimming a backlight, adjusting a focus of content being presented on the display, and locking-out the mobile device.

17. The non-transitory computer readable storage medium of claim 15 , wherein the first point of regard and the second point of regard are determined using at least one of eye tracking and face tracking.

18. The non-transitory computer readable storage medium of claim 15 , wherein the frequency is proportional to sensitivity of the content.

19. The non-transitory computer readable storage medium of claim 15 , wherein the mode of the mobile device is a security mode.

20. The non-transitory computer readable storage medium of claim 15 , wherein the modifying visibility includes reducing visibility.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Jun 19, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064270/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064104/0103 →
CHANGE OF NAME Recorded Nov 4, 2014
From: RESEARCH IN MOTION LIMITED
To: BLACKBERRY LIMITED
Reel/Frame 034161/0020 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2014
From: PASQUERO, JEROME; GRIFFIN, JASON TYLER
To: RESEARCH IN MOTION LIMITED
Reel/Frame 032666/0912 →
Continuity (2)
Continuation 12938799 · Nov 3, 2010
Related Publication 20140218287A1 · Aug 7, 2014