IP Library › Granted Patent US 10,019,639
Granted Patent B2
US 10,019,639 · App. 15/132,572 · Granted Jul 10, 2018

Determining a boundary associated with image data

Inventors: Sean Vandeweerd (Etobicoke, CA); Sanjay Nathwani (Mississauga, CA); Kian Marandi (Toronto, CA)
Assignee: BlackBerry Limited
G06K9/3233G06K9/3216G06K19/06028G06T1/0021G06T1/0085H04N1/32277H04N1/32352H04N5/23293H04N5/23296
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,019,639
App. No.
15/132,572
Granted
Jul 10, 2018
Kind
B2
Abstract

A method and device for determining a boundary associated with image data captured by an electronic device is provided. The electronic device may include a camera. In one aspect, a method includes: capturing the image data using the camera; based on the captured image data, detecting a boundary marker displayed by a display device, the boundary marker is periodically displayed to be undetectable by a human eye that is viewing the display device; and modifying, based on the boundary marker, image data captured by the camera.

Claims (54)

1. A method of capturing an image displayed on an external display device and detected by an electronic device, the method comprising:

generating image data associated with the detected image using the electronic device;

detecting, by the electronic device, a first group of boundary markers displayed by the external display device, the first group of boundary markers being periodically displayed to be undetectable by a human eye that is viewing the external display device;

in response to detecting the first group of boundary markers, determining image regions associated with the generated image data including a first image region circumscribed by the first group of boundary markers and a second image region being distinct from the first image region; and

modifying, regional image data associated with at least one of the first image region or the second image region to contrast with regional image data of another determined image region.

2. The method of claim 1 , further comprising:

capturing a plurality of image frames, wherein the image frames are displayed by the external display device at a first frequency, wherein the first group of boundary markers is displayed by the display device at a second frequency, and wherein the first frequency is greater than the second frequency.

3. The method of claim 1 , wherein detecting the first group of boundary markers comprises:

identifying a first boundary marker in a first image frame; and

identifying a second boundary marker in a second image frame, and wherein modifying the regional image data comprises:

generating, based on a plurality of image frames, a watermarked image including the plurality of boundary markers.

4. The method of claim 1 , further comprising:

determining that each boundary marker of the first group of boundary markers is located along a peripheral edge of the detected image; and

in response to that determination, determining that an entirety of the detected image is within the first group of boundary markers.

5. The method of claim 1 , wherein the first group of boundary markers is a coded pattern including encoded information, the encoded information including at least one of external display device dimensions, boundary marker location on the external display device, and boundary location on the external display device, the method further comprising:

decoding the coded pattern; and

determining, based on the decoded pattern, a location of the first image region in the detected image.

6. The method of claim 1 ,

wherein regional image data associated with the second image region includes regional image data for a portion of the detected image located exterior to the first image region circumscribed by the first group of boundary markers.

7. The method of claim 1 , further comprising:

detecting, by the electronic device, a second group of boundary markers displayed by the external display device;

in response to detecting the second group of boundary markers, determining a third image region being circumscribed by the second group of boundary markers; and

modifying regional image data associated with the third image region to contrast with regional image data associated with the first image region and the second image region.

8. The method of claim 1 , wherein modifying regional image data includes decreasing view-ability of the regional image data associated with a respective determined image region.

9. The method of claim 8 , wherein decreasing the view-ability of the regional image data includes applying a blurring effect for providing a bokeh effect in the detected image.

10. The method of claim 1 , wherein modifying regional image data includes increasing view-ability of the regional image data associated with a respective determined image region.

11. An electronic device comprising:

a camera;

a memory device; and

a processor coupled to the camera and the memory device, the processor being configured to:

generate image data associated with a detected image using the camera;

detect a first group of boundary markers displayed by an external display device, the first group of boundary markers being periodically displayed to be undetectable by a human eye that is viewing the external display device;

in response to detecting the first group of boundary markers, determine image regions associated with the generated image data including a first image region circumscribed by the first group of boundary markers and a second image region being distinct from the first image region; and

modify regional image data associated with at least one of the first image region or the second image region to contrast with regional image data of another determined image region.

12. The electronic device of claim 11 , wherein the processor is further configured to:

capture a plurality of image frames, wherein the image frames are displayed by the external display device at a first frequency, wherein the first group of boundary markers is displayed by the display device at a second frequency, and wherein the first frequency is greater than the second frequency.

13. The electronic device of claim 11 , wherein detect the first group of boundary markers, the processor is configured to:

identify a first boundary marker in a first image frame; and

identify a second boundary marker in a second image frame,

and wherein modify the regional image data, the processor is configured to:

generate, based on a plurality of image frames, a watermarked image including the plurality of boundary markers.

14. The electronic device of claim 11 , wherein the processor is further configured to:

determine that each boundary marker of the first group of boundary markers is located along a peripheral edge of the detected image; and

in response to that determination, determine that an entirety of the detected image is within the first group of boundary markers.

15. The electronic device of claim 11 , wherein the first group of boundary markers is a coded pattern including encoded information, the encoded information including at least one of external display device dimensions, boundary marker location on the external display device, and boundary location on the external display device, the processor is further configured to:

decode the coded pattern; and

determine, based on the decoded pattern, a location of the first image region in the detected image.

16. The electronic device of claim 11 ,

wherein regional image data associated with the second image region includes regional image data for a portion of the detected image located exterior to the first image region circumscribed by the first group of boundary markers.

17. A non-transitory computer-readable storage medium comprising processor-executable instructions which, when executed by a processor of an electronic device, causes the electronic device to:

generate image data associated with a detected image using the electronic device;

detect a first group of boundary markers displayed by an external display device, the first group of boundary markers is-being periodically displayed to be undetectable by a human eye that is viewing the external display device;

in response to detecting the first group of boundary markers, determine image regions associated with the generated image data including a first image region circumscribed by the first group of boundary markers and a second image region being distinct from the first image region; and

modify regional image data associated with at least one of the first image region or the second image region to contrast with regional image data of another determined image region.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Jun 19, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064271/0199 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064104/0103 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2016
From: NATHWANI, SANJAY; MARANDI, KIAN
To: BLACKBERRY LIMITED
Reel/Frame 038600/0804 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2016
From: VANDEWEERD, SEAN
To: BLACKBERRY LIMITED
Reel/Frame 038600/0870 →
Continuity (1)
Related Publication 20170300769A1 · Oct 19, 2017
Cited By (1)
US 12,403,609