IP Library Granted Patent US 10,319,152
Granted Patent B2
US 10,319,152 · App. 15/409,713 · Granted Jun 11, 2019

Methods and devices for selecting objects in images

Inventor: Steven Henry Fyke (Waterloo, CA)
Assignee: BLACKBERRY LIMITED
G06T19/20G06K9/4604G06K9/6267G06T11/60H04N13/239H04N13/286G06T2200/24H04N2013/0092
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,319,152
App. No.
15/409,713
Granted
Jun 11, 2019
Kind
B2
Abstract

Methods and devices for selecting objects in images are described. In one example aspect, a method includes: receiving stereoscopic image data, the stereoscopic image data includes a first image obtained from a first camera and a second image obtained from a second camera; identifying an object in the first image by analyzing the first image and the second image; displaying the first image, the identified object in the first image being selectable.

Claims (46)

1. A method, implemented by a processor of an electronic device, for allowing selection of an object in an image, the method comprising:

receiving image data, the image data including a first image obtained from a first camera and a second image obtained from a second camera, the first camera and the second camera being oriented in a common direction;

identifying an object in the first image by analyzing the first image and the second image, wherein the analyzing includes identifying one or more boundary associated with the object in the first image based on discontinuities in visual characteristics; and

displaying an image based on one or both of the first image and the second image, the identified object in the first image being selectable.

2. The method of claim 1 , further comprising:

receiving a signal indicating a selection of the identified object; and

manipulating the first image based on the selection of the identified object.

3. The method of claim 2 , wherein manipulating includes cropping the identified object in the first image.

4. The method of claim 2 , wherein manipulating includes moving the identified object.

5. The method of claim 2 , wherein manipulating includes associating a caption with the identified object in the first image.

6. The method of claim 1 , further comprising:

receiving a signal indicating an instruction for copying the identified object; and

in response to the instruction, copying the identified object to an application.

7. The method of claim 1 , wherein identifying one or more boundary includes performing image segmentation.

8. The method of claim 7 , wherein performing image segmentation includes:

partitioning the image data into image segments;

assigning a visual characteristic label to each of the image segments;

grouping the image segments based on the visual characteristic labels to identify groups of image segments sharing visual characteristics; and

identifying the one or more boundary based on the identified sets of visual characteristics.

9. The method of claim 8 , wherein each of the image segments is a pixel.

10. The method of claim 1 , wherein visual characteristics include at least one of illumination, colour, intensity, and texture.

11. The method of claim 1 , the method further comprising:

determining depth information of image segments based on the first image and the second image; and

identifying the one or more boundary associated with the object in the first image based on discontinuities in the visual characteristics and based on the depth information corresponding to the discontinuities.

12. The method of claim 1 , wherein the image data is stereoscopic image data, the stereoscopic image data including the first image from the first camera and the second image from the second camera, wherein the first image and the second image are simultaneously obtained.

13. The method of claim 12 , wherein the stereoscopic image data is received in response to receiving an instruction to capture a non-stereoscopic image.

14. The method of claim 1 , further comprising:

discarding the second image from the electronic device after analyzing the first image and the second image.

15. An electronic device comprising:

a memory;

a display;

a first camera and a second camera, the first camera and the second camera being oriented in a common direction; and

a processor coupled to the memory, the display, the first camera, and the second camera, the processor being configured to:

receive image data, the image data including a first image obtained from a first camera and a second image obtained from the second camera;

identify an object in the first image by analyzing the first image and the second image, wherein the analyzing includes identifying one or more boundary associated with the object in the first image based on discontinuities in visual characteristics; and

display an image based on one or both of the first image and the second image, the identified object in the first image being selectable.

16. The electronic device of claim 15 wherein the processor is further configured to:

receive a signal indicating selection of the identified object; and

manipulate the first image based on the selection of the identified object.

17. The electronic device of claim 16 , wherein manipulate includes crop the identified object in the first image.

18. The electronic device of claim 16 , wherein manipulate includes move the identified object.

19. The electronic device of claim 16 , wherein manipulate includes associate a caption with the identified object in the first image.

20. A non-transitory, tangible computer readable storage medium encoded with computer executable instructions, wherein execution of the computer executable instructions is for:

receiving image data, the image data including a first image obtained from a first camera and a second image obtained from a second camera, the first camera and the second camera being oriented in a common direction;

identifying an object in the first image by analyzing the first image and the second image, wherein the analyzing includes identifying one or more boundary associated with the object in the first image based on discontinuities in one or more visual characteristics; and

displaying an image based on one or both of the first image and the second image, the identified object in the first image being selectable.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2017
From: FYKE, STEVEN HENRY
To: RESEARCH IN MOTION LIMITED
Reel/Frame 041023/0714 →
CHANGE OF NAME Recorded Jan 20, 2017
From: RESEARCH IN MOTION LIMITED
To: BLACKBERRY LIMITED
Reel/Frame 041459/0821 →
Continuity (2)
Continuation 13406595 · Feb 28, 2012
Related Publication 20170132848A1 · May 11, 2017