IP Library Granted Patent US 10,489,973
Granted Patent B2
US 10,489,973 · App. 15/228,227 · Granted Nov 26, 2019

3D face reconstruction from gate camera

Inventors: Steffen Reymann (Reigate, GB); Jon Packham (Ashford, GB)
Assignee: Cubic Corporation
G06T17/10G06K9/00228G06K9/00288G06K9/00771G06T7/55G06T19/20G07C9/00563G07C9/00571G07C9/02H04N7/183G06T2207/30201G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,489,973
App. No.
15/228,227
Granted
Nov 26, 2019
Kind
B2
Abstract

A method of creating a 3-dimensional facial reconstruction of a user of a transit system includes detecting a user within a range of an image capture device positioned at a transit access point. A plurality of images of a first portion of the user's face are captured using the image capture device while the user passes through the range of the image capture device. A plurality of positions of the user may be detected as the user passes through the range of the image capture device. The plurality of images are combined with the plurality of positions and a relative angle and position of the user's face are calculated based on the combination of the plurality of images and the plurality of positions. A 3-dimensional model of the first portion of the user's face is generated based on the calculated relative angle and position and the 3-dimensional model is stored.

Claims (72)

1. A method of creating a 3-dimensional facial reconstruction of a user of a transit system, the method comprising:

detecting a user within a range of an image capture device positioned at a transit access point;

capturing a plurality of images of a first portion of the user's face using the image capture device while the user passes through the range of the image capture device;

detecting a plurality of positions of the user as the user passes through the range of the image capture device by detecting breaks in a plurality of position-sensing cross beams that extend across the transit access point as the user passes through the plurality of position-sensing cross beams;

combining the plurality of images with the plurality of positions;

calculating a relative angle and position of the user's face based on the combination of the plurality of images and the plurality of positions;

generating a 3-dimensional model of the first portion of the user's face based on the calculated relative angle and position;

storing the 3-dimensional model;

generating a second 3-dimensional model based on a separate instance of the user passing through the transit access point or through a second transit access point; and

updating the stored 3-dimensional model by combining the stored 3-dimensional model with the second 3-dimensional model.

2. The method of creating a 3-dimensional facial reconstruction of a user of a transit system of claim 1 , wherein:

detecting the plurality of positions comprises receiving position information from the plurality of position-sensing cross beams; and

the plurality of position-sensing cross beams are generated by one or more of light-based position sensors or sound-based position sensors positioned proximate to the transit access point.

3. The method of creating a 3-dimensional facial reconstruction of a user of a transit system of claim 1 , wherein:

detecting the plurality of positions comprises receiving position information from a second image capture device.

4. The method of creating a 3-dimensional facial reconstruction of a user of a transit system of claim 1 , wherein:

each of the plurality of images and each of the plurality of positions comprises a timestamp; and

combining the plurality of images with the plurality of positions comprises matching the timestamp from each of the plurality of images with a corresponding timestamp from one of the plurality of positions.

5. The method of creating a 3-dimensional facial reconstruction of a user of a transit system of claim 1 , further comprising:

capturing a second plurality of images of a second portion of the user's face using a second image capture device; and

generating a 3-dimensional model of the second portion of the user's face using the second plurality of images.

6. The method of creating a 3-dimensional facial reconstruction of a user of a transit system of claim 1 , wherein:

detecting the user within the range of the image capture device comprises detecting a fare validation event at the transit access point and triggering the image capture device to capture the plurality of images.

7. A non-transitory computer-readable medium having instructions embedded thereon for creating a 3-dimensional facial reconstruction of a user of a transit system, the instructions comprising computer code for causing a computing device to:

detect a user within a range of an image capture device positioned at a transit access point;

capture a plurality of images of a first portion of the user's face using the image capture device while the user passes through the range of the image capture device;

detect a plurality of positions of the user as the user passes through the range of the image capture device by detecting breaks in a plurality of position-sensing cross beams that extend across the transit access point as the user passes through the plurality of position-sensing cross beams;

combine the plurality of images with the plurality of positions;

calculate a relative angle and position of the user's face based on the combination of the plurality of images and the plurality of positions;

generate a 3-dimensional model of the first portion of the user's face based on the calculated relative angle and position; and

store the 3-dimensional model.

8. The non-transitory computer-readable medium of claim 7 , wherein:

detecting the plurality of positions comprises receiving position information from the plurality of position-sensing cross beams; and

the plurality of position-sensing cross beams are generated by one or more of light-based position sensors or sound-based position sensors positioned proximate to the transit access point.

9. The non-transitory computer-readable medium of claim 7 , wherein:

detecting the plurality of positions comprises receiving position information from a second image capture device.

10. The non-transitory computer-readable medium of claim 7 , wherein:

each of the plurality of images and each of the plurality of positions comprises a timestamp; and

combining the plurality of images with the plurality of positions comprises matching the timestamp from each of the plurality of images with a corresponding timestamp from one of the plurality of positions.

11. The non-transitory computer-readable medium of claim 7 , further comprising instructions for causing the computing device to:

capture a second plurality of images of a second portion of the user's face using a second image capture device; and

generate a 3-dimensional model of the second portion of the user's face using the second plurality of images.

12. The non-transitory computer-readable medium of claim 7 , wherein:

detecting the user within the range of the image capture device comprises detecting a fare validation event at the transit access point and triggering the image capture device to capture the plurality of images.

13. A system for creating a 3-dimensional facial reconstruction of a user of a transit system, the system comprising:

an image capture device positioned to capture an image of a user's face as the user passes through a transit access point;

a user detection module configured to determine when a user is within a range of the image capture device;

a position module configured to determine a position of the user as the user passes through the transit access point, wherein the position module comprises a plurality of position-sensing cross beams that extend across the transit access point;

a facial model generation module configured to generate a 3-dimensional model using images from the image capture device;

a communications module;

a memory; and

a processor, the processor configured to:

detect, using the user detection module, the user within a range of the image capture device positioned at a transit access point;

capture a plurality of images of a first portion of the user's face using the image capture device while the user passes through the range of the image capture device;

detect, using the position module, a plurality of positions of the user as the user passes through the range of the image capture device by detecting breaks in the plurality of position-sensing cross beams as the user passes through the plurality of position-sensing cross beams;

combine the plurality of images with the plurality of positions;

calculate a relative angle and position of the user's face based on the combination of the plurality of images and the plurality of positions;

generate, using the facial model generation module, a 3-dimensional model of the first portion of the user's face based on the calculated relative angle and position; and

store the 3-dimensional model.

14. The system for creating a 3-dimensional facial reconstruction of a user of a transit system of claim 13 , wherein:

the plurality of position-sensing cross beams are generated by one or more of light-based position sensors or sound-based position sensors positioned proximate to the transit access point.

15. The system for creating a 3-dimensional facial reconstruction of a user of a transit system of claim 13 , wherein:

the position module comprises a second image capture device.

16. The system for creating a 3-dimensional facial reconstruction of a user of a transit system of claim 13 , wherein:

each of the plurality of images and each of the plurality of positions comprises a timestamp; and

combining the plurality of images with the plurality of positions comprises matching the timestamp from each of the plurality of images with a corresponding timestamp from one of the plurality of positions.

17. The system for creating a 3-dimensional facial reconstruction of a user of a transit system of claim 13 , further comprising:

a second image capture device, wherein the processor is further configured to:

capture a second plurality of images of a second portion of the user's face using the second image capture device; and

generate, using the facial model generation module, a 3-dimensional model of the second portion of the user's face using the second plurality of images.

18. The system for creating a 3-dimensional facial reconstruction of a user of a transit system of claim 13 , wherein:

detecting the user within the range of the image capture device comprises detecting a fare validation event at the transit access point and triggering the image capture device to capture the plurality of images.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Jul 30, 2025
From: ALTER DOMUS (US) LLC
To: CUBIC CORPORATION; CUBIC DIGITAL SOLUTIONS LLC; NUVOTRONICS, INC.
Reel/Frame 072281/0176 →
RELEASE OF SECURITY INTEREST AT REEL/FRAME 056393/0281 Recorded Jul 28, 2025
From: BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT
To: CUBIC CORPORATION; CUBIC DEFENSE APPLICATIONS, INC.; CUBIC DIGITAL SOLUTIONS LLC (FORMERLY PIXIA CORP.)
Reel/Frame 072282/0124 →
FIRST LIEN SECURITY AGREEMENT Recorded May 26, 2021
From: CUBIC CORPORATION; PIXIA CORP.; NUVOTRONICS, INC.
To: BARCLAYS BANK PLC
Reel/Frame 056393/0281 →
SECOND LIEN SECURITY AGREEMENT Recorded May 26, 2021
From: CUBIC CORPORATION; PIXIA CORP.; NUVOTRONICS, INC.
To: ALTER DOMUS (US) LLC
Reel/Frame 056393/0314 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2017
From: REYMANN, STEFFEN; PACKHAM, JON
To: CUBIC CORPORATION
Reel/Frame 042614/0426 →
Cited By (3)
US 12,283,149 US 12,293,622 US 12,307,850