IP Library Granted Patent US 9,639,768
Granted Patent B2
US 9,639,768 · App. 14/564,546 · Granted May 2, 2017

Methods and systems to adaptively detect object borders from electronic device images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,639,768
App. No.
14/564,546
Granted
May 2, 2017
Kind
B2
Abstract

A method of automatically identifying a border in a captured image may include capturing an image of a target by an image sensor of an electronic device, and, by one or more processors, processing the image to automatically detect a border of the target in the image by applying an automatic border detection method to the image. The method may include presenting the image of the target to a user via a display of the electronic device so that the presented image comprises a visual depiction of the detected border, receiving an adjustment of the border from the user, determining whether to update the default parameters based on the received adjustment, in response to determining to update the default parameters, determining one or more updated parameters for the automatic border detection method that are based on, at least in part, the received adjustment, and saving the updated parameters.

Claims (85)

1. A method of automatically identifying a border in a captured image, the method comprising:

by an image sensor of a mobile electronic device, capturing an image of a target;

by one or more processors:

processing the image to automatically detect a border of the target in the image by applying an automatic border detection method to the image, wherein the automatic border detection method uses one or more default parameters,

presenting the image of the target to a user via a display of the mobile electronic device so that the presented image comprises a visual depiction of the detected border,

receiving, via a user interface, an adjustment of the border from the user,

determining whether to update the default parameters based on the received adjustment by:

determining a difference between one or more border coordinates associated with the received adjustment and one or more border coordinates associated with the default parameters, and

in response to the difference exceeding a threshold value:

determining one or more updated parameters that minimize the difference, and

replacing the default parameters with the updated parameters, and

saving the updated parameters.

2. The method of claim 1 , further comprising:

altering at least a portion of the image that is within the user-adjusted border; and

presenting the altered image to a user via the display of the mobile electronic device.

3. The method of claim 2 , wherein altering at least a portion of the image that is within the user-adjusted border comprises performing one or more of the following operations on the portion:

cropping; and

geometric correction.

4. The method of claim 1 , further comprising:

in response to the difference not exceeding a threshold value, not updating the default parameters.

5. The method of claim 1 , further comprising:

receiving a subsequent image of a subsequent target;

determining whether the subsequent image was received during a same session as the image; and

in response to determining that the subsequent image was received during the same session as the image:

processing the subsequent image to automatically determine a second border of the subsequent target in the image by applying the automatic border detection method to the image, wherein the automatic border detection method uses at least one or more of the updated parameters.

6. The method of claim 5 , further comprising:

presenting the subsequent image of the target to a user via the display of the mobile electronic device so that the presented subsequent image comprises a visual depiction of the second border,

receiving, via the user interface, an adjustment of the second border from the user,

altering at least a portion of the subsequent image that is within the second border, and

presenting the altered subsequent image to a user via the display of the mobile electronic device.

7. The method of claim 5 , wherein determining whether the subsequent image was received during a same session as the image comprises:

determining whether the subsequent image is captured within a time period from a time that the image is captured and at a same location as the image was captured; and

in response to determining that the subsequent image is received within the time period and at the same location, determining that the subsequent image is received in the same session.

8. The method of claim 1 , further comprising:

receiving a subsequent image of a subsequent target;

determining whether the subsequent image was received during a same session as the image; and

in response to determining that the subsequent image was not received during the same session as the image, processing the subsequent image to automatically determine a second border of the subsequent target in the subsequent image by applying the automatic border detection method to the subsequent image, wherein the automatic border detection method uses one or more of the default parameters.

9. The method of claim 8 , further comprising:

presenting the subsequent image of the target to a user via the display of the mobile electronic device so that the presented subsequent image comprises a visual depiction of the second border,

receiving, via the user interface, an adjustment of the second border from the user,

altering at least a portion of the subsequent image that is within the second border, and

presenting the altered subsequent image to a user via the display of the mobile electronic device.

10. A system of automatically identifying a border in a captured image, the system comprising:

a mobile electronic device comprising an image sensor; and

a computer-readable storage medium in communication with the mobile electronic device, wherein the computer-readable storage medium comprises one or more programming instructions that, when executed, cause the mobile electronic device to:

capture, by the image sensor, an image of a target,

process the image to automatically detect a border of the target in the image by applying an automatic border detection method to the image, wherein the automatic border detection method uses one or more default parameters,

present the image of the target to a user via a display of the mobile electronic device so that the presented image comprises a visual depiction of the detected border,

receive, via a user interface, an adjustment of the border from the user,

determine whether to update the default parameters based on the received adjustment by:

determining a difference between one or more border coordinates associated with the received adjustment and one or more border coordinates associated with the default parameters, and

in response to the difference exceeding a threshold value:

determining one or more updated parameters that minimize the difference, and

replacing the default parameters with the updated parameters, and

save the updated parameters.

11. The system of claim 10 , wherein the computer-readable storage medium further comprises one or more programming instructions that, when executed, cause the mobile electronic device to:

alter at least a portion of the image that is within the user-adjusted border; and

present the altered image to a user via the display of the mobile electronic device.

12. The system of claim 11 , wherein the one or more programming instructions that, when executed, cause the mobile electronic device to alter at least a portion of the image that is within an updated border comprise one or more programming instructions that, when executed, cause the mobile electronic device to perform one or more of the following operations on the portion:

cropping; and

geometric correction.

13. The system of claim 10 , wherein the computer-readable storage medium further comprises one or more programming instructions that, when executed, cause the mobile electronic device to:

in response to the difference not exceeding a threshold value, not update the default parameters.

14. The system of claim 10 , wherein the computer-readable storage medium further comprises one or more programming instructions that, when executed, cause the mobile electronic device to:

receive a subsequent image of a subsequent target;

determine whether the subsequent image was received during a same session as the image; and

in response to determining that the subsequent image was received during the same session as the image:

process the subsequent image to automatically determine a second border of the subsequent target in the image by applying the automatic border detection method to the image, wherein the automatic border detection method uses at least one or more of the updated parameters.

15. The system of claim 14 , wherein the computer-readable storage medium further comprises one or more programming instructions that, when executed, cause the mobile electronic device to:

present the subsequent image of the target to a user via the display of the mobile electronic device so that the presented subsequent image comprises a visual depiction of the second border,

receive, via the user interface, an adjustment of the second border from the user,

alter at least a portion of the subsequent image that is within the second border, and

present the altered subsequent image to a user via the display of the mobile electronic device.

16. The system of claim 14 , wherein the one or more programming instructions that, when executed, cause the mobile electronic device to determine whether the subsequent image was received during a same session as the image comprise one or more programming instructions that, when executed, cause the mobile electronic device to:

determine whether the subsequent image is captured within a time period from a time that the image is captured and at a same location as the image was captured; and

in response to determining that the subsequent image is received within the time period and at the same location, determine that the subsequent image is received in the same session.

17. The system of claim 10 , wherein the computer-readable storage medium further comprises one or more programming instructions that, when executed, cause the mobile electronic device to:

receive a subsequent image of a subsequent target;

determine whether the subsequent image was received during a same session as the image; and

in response to determining that the subsequent image was not received during the same session as the image, process the subsequent image to automatically determine a second border of the subsequent target in the subsequent image by applying the automatic border detection method to the subsequent image, wherein the automatic border detection method uses one or more of the default parameters.

18. The system of claim 17 , wherein the computer-readable storage medium further comprises one or more programming instructions that, when executed, cause the mobile electronic device to:

present the subsequent image of the target to a user via the display of the mobile electronic device so that the presented subsequent image comprises a visual depiction of the second border,

receive, via the user interface, an adjustment of the second border from the user,

alter at least a portion of the subsequent image that is within the second border, and

present the altered subsequent image to a user via the display of the mobile electronic device.

Assignments (10)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2025
From: XEROX CORPORATION
To: GENESEE VALLEY INNOVATIONS, LLC
Reel/Frame 073842/0479 →
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT RF 064760/0389 Recorded Feb 13, 2024
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: XEROX CORPORATION
Reel/Frame 068261/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
SECURITY INTEREST Recorded Jun 22, 2023
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 064760/0389 →
RELEASE OF SECURITY INTEREST IN PATENTS AT R/F 062740/0214 Recorded May 18, 2023
From: CITIBANK, N.A., AS AGENT
To: XEROX CORPORATION
Reel/Frame 063694/0122 →
SECURITY INTEREST Recorded Nov 10, 2022
From: XEROX CORPORATION
To: CITIBANK, N.A., AS AGENT
Reel/Frame 062740/0214 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2014
From: BALA, RAJA; FU, LINA
To: XEROX CORPORATION
Reel/Frame 034438/0368 →