Granted Patent B2

US 10,692,230 · App. 15/993,470 · Granted Jun 23, 2020

Inventors: Andrew T. Anderson (Duluth, GA); Ian McFarlane Denny (Perth, GB)

Assignee: NCR Corporation

G06T7/50G06K9/00442G06K2209/01G06T2207/30176

Abstract

Claims (55)

1. A self-service terminal, comprising:

a display positioned on a fascia of the self-service terminal;

a depth sensing camera, positioned on the fascia, to capture a video stream of a hand-held document and capture a depth map stream of the hand-held document; and

a processor, positioned in the self-service terminal, to perform data processing activities comprising:

determining, from the depth map stream received by the processor, that the hand-held document is positioned outside a specified range of distances away from the depth sensing camera;

presenting, on the display, instructions to reposition the hand-held document to be within the specified range of distances away from the depth sensing camera;

determining, from the depth map stream, that the hand-held document is positioned within the specified range of distances away from the depth sensing camera;

automatically capturing an image of the hand-held document from the video stream received by the processor

determining, from the depth map stream received by the processor, an outline of the hand-held document, wherein determining the outline of the hand-held document comprises determining a group of pixels corresponding to a flat surface, wherein determining the group of pixels corresponding to the flat surface comprises determining that a depth image of each pixel in the group of pixels differs from a depth of an adjacent pixel in the group of pixels by less than a specified depth threshold, wherein the specified depth threshold is less than an average thickness of a human finger, and wherein the determined outline of the hand-held document excludes a peripheral area of the hand-held document that is obscured by one or more fingers.

2. The self-service terminal of claim 1 , wherein the data processing activities further comprise:

determining a bounding rectangle corresponding to the determined outline of the hand-held document, the bounding rectangle including the peripheral area of the hand-held document that is obscured by the one or more fingers;

wherein the image of the hand-held document is rectangular and captures an area of the video stream defined by the bounding rectangle.

3. The self-service terminal of claim 1 , wherein the specified range of distances is defined to exclude a distance value that is either too small to fit the hand-held document within a field of view of the video stream, or too large to capture the hand-held document in the video stream with a resolution greater than a specified threshold resolution.

4. The self-service terminal of claim 3 , wherein determining that the distance value is too small to fit the hand-held document within a field of view of the video stream comprises:

determining that at least a portion of the hand-held document lies within a specified margin from a peripheral edge of the frame of the video stream.

5. The self-service terminal of claim 3 , wherein the hand-held document is a check, and wherein determining that the distance value is too large to capture the hand-held document in the video stream with a resolution greater than the specified threshold resolution comprises:

performing determining optical character recognition of a magnetic ink character recognition code line of the check; and

determining that the optical character recognition failed.

6. The self-service terminal of claim 1 , wherein the self-service terminal is an automated teller machine, the hand-held document is a hand-held check, and the image corresponds to a first side of the hand-held check.

7. The self-service terminal of claim 6 , wherein the data processing activities further comprise, after the image of the first side of the hand-held check is captured:

presenting, on the display, instructions to flip the hand-held check front-to-back so that a second side of the hand-held check faces the depth sensing camera.

8. The self-service terminal of claim 7 , wherein the data processing activities further comprise, after the instructions to flip the hand-held check are displayed:

determining, from the depth map stream, that the second side of the hand-held document is positioned outside the specified range of distances away from the depth sensing camera;

presenting, on the display, instructions to reposition the second side of the hand-held document to be within the specified range of distances away from the depth sensing camera;

determining, from the depth map stream, that the second side of the hand-held document is positioned within the specified range of distances away from the depth sensing camera; and

automatically capturing an image of the second side of the hand-held document from the video stream.

9. The self-service terminal of claim 1 , wherein the depth sensing camera is positioned below the display on the fascia.

10. The self-service terminal of claim 1 , wherein presenting the instructions to reposition the hand-held document comprises:

presenting, on the display, a left-right mirroring of the video stream, and

presenting, on the display, a colored box around the hand-held document, the colored box superimposed on the left-right mirroring of the video stream.

11. The self-service terminal of claim 10 , wherein:

the colored box is color-coded to indicate an acceptability of a distance from the hand-held document to the depth sensing camera, and

the colored box is further rendered as a dotted line, the dotted line having a mark-to-space ratio that corresponds to the acceptability of the distance from the hand-held document to the depth sensing camera.

12. A method, comprising, sequentially:

capturing, with a depth sensing camera positioned on a fascia of a self-service terminal, a video stream of a hand-held document;

capturing, with the depth sensing camera, a depth map stream of the hand-held document, the depth map stream being synchronized to the video stream;

determining, with a position-analysis circuit, from the depth map stream, that the hand-held document is positioned outside a specified range of distances away from the depth sensing camera;

presenting, on a display positioned on the fascia, instructions to reposition the hand-held document to be within the specified range of distances away from the depth sensing camera;

determining, with the position-analysis circuit, from the depth map stream, that the hand-held document is positioned within the specified range of distances away from the depth sensing camera;

automatically capturing, with an image-capturing circuit, an image of the hand-held document from the video stream

determining, with an outline-determining circuit, an outline of the hand-held document, wherein the determined outline of the hand-held document excludes a peripheral area of the hand-held document that is obscured by one or more fingers; and

determining, with a boundary-determining circuit, a bounding rectangle corresponding to the determined outline of the hand-held document, the bounding rectangle including the peripheral area of the hand-held document that is obscured by the one or more fingers;

wherein the image of the hand-held document is rectangular and captures an area of the video stream defined by the bounding rectangle.

13. A self-service terminal, comprising:

a display positioned on a fascia of the self-service terminal;

a depth sensing camera, positioned on the fascia below the display, to capture a video stream of a hand-held document and capture a depth map stream of the hand-held document;

a position-determining circuit to determine, from the depth map stream, that the hand-held document is at a first distance away from the depth sensing camera;

a position-comparing circuit to determine that the first distance is outside a specified range of distances away from the depth sensing camera;

a display, positioned on the fascia, to present instructions to reposition the hand-held document to be within the specified range of distances away from the depth sensing camera,

wherein the distance-determining circuit is further to determine, from the depth map stream, that the hand-held document is at a second distance away from the depth sensing camera,

wherein the distance-comparing circuit is further to determine that the second distance is within the specified range of distances away from the depth sensing camera;

an image-capturing circuit to, after the second distance is determined to be within the specified range of distances away from the depth sensing camera, automatically capture an image of the hand-held document from the video stream

an outline-determining circuit to determine an outline of the hand-held document, wherein the determined outline of the hand-held document excludes a peripheral area of the hand-held document that is obscured by one or more fingers; and

a boundary-determining circuit to determine a bounding rectangle corresponding to the determined outline of the hand-held document, the bounding rectangle including the peripheral area of the hand-held document that is obscured by the one or more fingers;

wherein the image of the hand-held document is rectangular and captures an area of the video stream defined by the bounding rectangle.

Assignments (10)