IP Library Granted Patent US 9,508,119
Granted Patent B2
US 9,508,119 · App. 14/490,985 · Granted Nov 29, 2016

Application of filters requiring face detection in picture editor

Inventors: Hans Rikard Samvik (Lund, SE); Nils Johan Petter Montan (Malmo, SE)
Assignee: BlackBerry Limited
G06T3/20G06T7/0083G06T11/60G06T2207/20132G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,508,119
App. No.
14/490,985
Granted
Nov 29, 2016
Kind
B2
Abstract

An electronic device and method of operation, the electronic device including at least one processor communicatively coupled to a display and memory, the processor configured for filtering a facial image rendered on the display. In an illustrative embodiment, the at least one processor is configured to generate a boundary around the facial image, the boundary having 2-dimensional x and y coordinates relative to boundaries of the display; store the coordinates in memory; in response to at least one of a cropping and moving of the image, recalculate the coordinates to match a new transform setting; and apply an effect to the facial image based on the updated coordinates.

Claims (57)

1. A method of filtering a facial image, comprising:

rendering a first image on a display of an electronic device within a boundary of the display;

detecting the facial image within the first image;

rendering an image boundary around the facial image on the display;

calculating frame coordinates of the image relative to the boundary of the display;

storing the frame coordinates in a memory of the electronic device;

in response to transformation of the first image, the transformation comprising at least one of a cropping and moving of the first image, retrieving the frame coordinates from the memory and applying the transformation to the frame coordinates to obtain updated frame coordinates relative to the boundary of the display, wherein the updated frame coordinates match a transformed facial image within the transformed first image without detecting the facial image in the transformed first image;

determining if the updated frame coordinates of the image boundary are disposed within the boundary of the display;

in response to determining that the updated frame coordinates are disposed at least partially within the boundary of the display

applying a filter effect to the transformed facial image to provide a filtered facial

image in response to determining that the updated frame coordinates are disposed at least partially within the boundary of the display, and

rendering the filtered facial image on the display of the electronic device, wherein if the updated frame coordinates are disposed only partially within the boundary of the display only a portion of the filtered facial image is rendered on the display, wherein the portion of the filtered facial image is disposed within the boundary of the display; and

disabling the filter effect in response to determining that the updated frame coordinates are disposed outside of the boundary of the display.

2. The method of claim 1 , further comprising:

retrieving the updated frame coordinates from a memory of the electronic device;

applying the filter effect to the image within the frame; and

rendering a new facial image having the filter effect applied thereto.

3. The method of claim 1 , where moving the first image comprises one or more of rotating the first image and translating the first image.

4. The method of claim 1 , where the first image comprises a photograph that includes one or more facial images.

5. The method of claim 1 , where detecting the facial image within the first image comprises a processor of the electronic device executing a face-detection process, wherein the method further comprises rendering an updated image boundary on the display utilizing the updated frame coordinates.

6. The method of claim 1 , where the image boundary comprises a rectangle and where the frame coordinates comprise a height, a width and x and y coordinates relative to the boundary of the display.

7. The method of claim 1 , further comprising storing the updated frame coordinates in the memory of the electronic device.

8. The method of claim 1 , wherein

applying the filter effect comprises applying the filter effect to a portion of the transformed facial image disposed within the boundary of the display to provide a filtered partial image in response to determining that the updated frame coordinates are disposed at least partially within the boundary of the display, and wherein rendering the filtered facial image comprises rendering the filtered partial image on the display of the electronic device.

9. An electronic device, comprising at least one processor communicatively coupled to a display and memory, the processor configured for filtering a facial image rendered on the display by:

rendering a first image on the display of the electronic device within a boundary of the display;

detecting the facial image within the first image;

rendering an image boundary around the facial image on the display;

calculating frame coordinates of the image boundary relative to a boundary of the display;

storing the frame coordinates in memory;

in response to a transform of the first image, the transform comprising at least one of a cropping and moving of the first image, retrieving the frame coordinates from the memory and applying the transformation to the frame coordinates to obtain updated frame coordinates relative to the boundary of the display without detecting the facial image in the transformed first image, wherein the updated frame coordinates match a transformed facial image within the transformed first image;

determining if the updated frame coordinates of the image boundary are disposed within the boundary of the display;

in response to determining that the updated frame coordinates are disposed at least partially within the boundary of the display

applying a filter effect to the transformed facial image to provide a filtered facial image in response to determining that the updated frame coordinates are disposed at least partially within the boundary of the display, and

rendering the filtered facial image on the display of the electronic device, wherein if the updated frame coordinates are disposed only partially within the boundary of the display only a portion of the filtered facial image is rendered on the display, wherein the portion of the filtered facial image is disposed within the boundary of the display; and

disabling the filter effect in response to determining that the updated frame coordinates are disposed outside of the boundary of the display.

10. The electronic device of claim 9 , wherein the processor of the electronic device is further configured to render a new facial image having the filter effect applied thereto.

11. The electronic device of claim 9 , wherein

applying the filter effect comprises applying the filter effect to a portion of the transformed facial image disposed within the boundary of the display to provide a filtered partial image in response to determining that the updated frame coordinates are disposed at least partially within the boundary of the display, and wherein rendering the filtered facial image comprises rendering the filtered partial image on the display of the electronic device.

12. The electronic device of claim 9 , where the electronic device comprises a mobile communication device.

13. The electronic device of claim 9 , where the first image comprises a photograph that includes one or more facial images.

14. A non-transitory computer readable medium containing instructions that, when executed on a processor of an electronic device, perform a method of picture-editing comprising:

rendering a first image on a display of an electronic device within a boundary of the display;

detecting a facial image within the first image;

rendering an image boundary around the facial image on the display;

calculating frame coordinates of the image boundary relative to the boundary of the display;

storing the frame coordinates in a memory of the electronic device;

in response to transformation of the first image, retrieving the frame coordinates from the memory and applying the transformation to the frame coordinates to obtain updated frame coordinates relative to the boundary of the display, wherein the updated frame coordinate match a transformed facial image within the transformed first image without detecting the facial image in the transformed first image;

determining if the updated frame coordinates of the image boundary are disposed within the boundary of the display;

in response to determining that the updated frame coordinates are disposed at least partially within the boundary of the display

applying a filter effect to the transformed facial image to provide a filtered facial

image in response to determining that the updated frame coordinates are disposed at least partially within the boundary of the display, and

rendering the filtered facial image on the display of the electronic device, wherein if the updated frame coordinates are disposed only partially within the boundary of the display only a portion of the filtered facial image is rendered on the display, wherein the portion of the filtered facial image is disposed within the boundary of the display; and

disabling the filter effect in response to determining that the updated frame coordinates are disposed outside of the boundary of the display.

15. The non-transitory computer readable medium of claim 14 where, in the method performed upon execution of the instructions stored on the non-transitory computer readable medium, transformation of the first image comprises at least one of moving the first image with respect to the display and cropping the first image.

16. The non-transitory computer readable medium of claim 14 , wherein

applying the filter effect comprises applying the filter effect to a portion of the transformed facial image disposed within the boundary of the display to provide a filtered partial image in response to determining that the updated frame coordinates are disposed at least partially within the boundary of the display, and wherein rendering the filtered facial image comprises rendering the filtered partial image on the display of the electronic device.

Assignments (5)
NUNC PRO TUNC ASSIGNMENT Recorded Jun 19, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064271/0199 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064104/0103 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2017
From: BLACKBERRY SWEDEN AB
To: BLACKBERRY LIMITED
Reel/Frame 042237/0051 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2016
From: SAMVIK, HANS RIKARD; MONTAN, NILS JOHAN PETTER
To: BLACKBERRY SWEDEN AB
Reel/Frame 039876/0878 →
CHANGE OF NAME Recorded Nov 3, 2014
From: RESEARCH IN MOTION LIMITED
To: BLACKBERRY LIMITED
Reel/Frame 034131/0296 →
Continuity (2)
Continuation In Part 13548391 · Jul 13, 2012
Related Publication 20150002537A1 · Jan 1, 2015