IP Library › Granted Patent US 10,900,772

Granted Patent B2

US 10,900,772 · App. 16/818,156 · Granted Jan 26, 2021

Apparatus and methods for facial recognition and video analytics to identify individuals in contextual video streams

Inventors: Ruslan Sabitov (Jersey City, NJ); Alexander Betser (Brooklyn, NY); Adam Resnick (Boca Raton, FL); E. Michael Huestis (Holmes, NY); Brett Terry Joshpe (New York, NY)

Assignee: 15 Seconds of Fame, Inc.

G01B11/14 G01J3/26 G01J3/2823 G01J3/4535 G06K9/00677 G06K9/00771

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 10,900,772
App. No.: 16/818,156
Granted: Jan 26, 2021
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

An apparatus includes a memory, a communication interface in communication with the memory and configured to communicate via a network, and a processor in communication with the memory and the communication interface. The processor receives facial image data associated with a user of a client device, registers the facial image data, and stores the facial image data and contextual data associated with the user in a database. The processor also receives video stream data from at least one image capture device in communication with the network, analyzes the video stream data and contextual data associated with the video stream data to define analyzed video data and analyzed contextual data, respectively, and defines a confidence level based on comparing the data associated with the video stream data to the data stored in the database. The processor defines a user-specific contextual video stream when the confidence level satisfies a criterion.

Claims (65)

1. A method, comprising:

receiving data associated with a first user device;

identifying, based on the data, a location of the first user device;

receiving at least one image captured by a second user device different from the first user device;

identifying a location associated with the at least one image;

comparing the location of the first user device to the location associated with the at least one image to determine whether the first user device is within a predetermined distance of the location associated with the at least one image at a time;

when the first user device is within the predetermined distance of the location associated with the at least one image:

performing facial recognition on the at least one image to determine a probability that a user associated with the first user device is depicted within the at least one image; and

when the probability meets a criterion, automatically sending the at least one image to the first user device; and

when the first user device is not within the predetermined distance of the location associated with the at least one image:

not performing facial recognition on the at least one image to determine whether the user associated with the first user device is depicted within the at least one image.

2. The method of claim 1 , wherein the data associated with the first user device includes calendar data associated with the first user device.

3. The method of claim 1 , wherein the data associated with the first user device includes ticket sale data associated with a venue.

4. The method of claim 1 , wherein the identifying the location of the first user device includes identifying the location of the first user device by inferring a section within a venue based on the data.

5. The method of claim 1 , wherein the data associated with the first user device includes historical location data of the first user device.

6. The method of claim 1 , further comprising:

sending a signal to the first user device requesting the data, the receiving the data from the first user device includes receiving the data from the first user device in response to the signal.

7. The method of claim 1 , wherein the identifying the location associated with the at least one image includes identifying a venue associated with the at least one image,

the identifying the location of the first user device includes identifying the location of the first user device within the venue.

8. The method of claim 1 , wherein the data associated with the first user device includes at least one of near field communication (NFC) verification data, cellular network triangulation data, or Bluetooth verification data.

9. The method of claim 1 , wherein the data associated with the first user device includes social media posts.

10. The method of claim 1 , wherein the data associated with the first user device includes at least one of internet web browsing data or purchase data.

11. A non-transitory processor-readable medium storing code representing instructions to be executed by a processor, the instructions comprising code to cause the processor to:

receive, from an image capture device, data associated with at least one image;

identify a location associated with the at least one image based on at least a portion of the data associated with the at least one image;

identify a location of a user device;

compare the location of the user device to the location associated with the at least one image to determine whether the user device is within a predetermined distance of the location associated with the at least one image at a time;

when the user device is within the predetermined distance of the location associated with the at least one image:

perform facial recognition on the at least one image to determine a probability that a user associated with the user device is depicted within the at least one image;

define user-specific data including an instance of the at least one image and data representing at least an indication of a corresponding event occurring at the location associated with the at least one image; and

when the probability meets a criterion, automatically send the user-specific data to the user device; and

when the user device is not within the predetermined distance of the location associated with the at least one image:

not perform facial recognition on the at least one image to determine whether the user associated with the user device is depicted within the at least one image.

12. The non-transitory processor-readable medium of claim 11 , wherein the user device is a first user device, the non-transitory processor-readable medium and the processor being a non-transitory processor-readable medium and a processor, respectively, of a second user device different from the first user device, the image capture device being a camera of the second user device.

13. The non-transitory processor-readable medium of claim 11 , wherein the user device is a first user device, the non-transitory processor-readable medium and the processor being a non-transitory processor-readable medium and a processor, respectively, of a second user device different from the first user device.

14. The non-transitory processor-readable medium of claim 11 , wherein the instructions further comprise code to cause the processor to:

receive data associated with the user device, the code to cause the processor to identify the location of the user device includes code to cause the processor to identify the location of the user device based on at least a portion of the data associated with the user device.

15. The non-transitory processor-readable medium of claim 11 , wherein the instructions further comprise code to cause the processor to:

the portion of the data associated with the user device includes at least one of historical location data, calendar data, near field communication (NF1) verification data, cellular network triangulation data, Bluetooth verification data, internet web browsing data, purchase data, social media posts made by the user associated with the user device, or ticket sale data associated with a venue.

16. The non-transitory processor-readable medium of claim 11 , wherein the code to cause the processor to send the user-specific data includes code to cause the processor to automatically send the user-specific data to the user device when the probability meets the criterion.

17. The non-transitory processor-readable medium of claim 11 , wherein the code to cause the processor to identify the location associated with the at least one image includes code to cause the processor to identify a venue associated with the at least one image based on at least a portion of the data associated with the at least one image, and

the code to cause the processor to identify the location of the user device includes code to cause the processor to identify the location of the user device within the venue.

18. The non-transitory processor-readable medium of claim 11 , wherein the code to cause the processor to identify the location associated with the at least one image includes code to cause the processor to identify a venue associated with the at least one image based on at least a portion of the data associated with the at least one image, and

the code to cause the processor to identify the location of the user device includes code to cause the processor to identify the location of the user device by inferring a section within the venue based on at least a portion of the data associated with the at least one image.

19. A method, comprising:

receiving, at a processor of a first user device, data associated with at least one image captured by an image capture device of the first user device;

identifying, at the processor, a location associated with the at least one image based on at least a portion of the data associated with the at least one image;

identifying, at the processor, a location of a second user device;

comparing, at the processor, the location of the second user device to the location associated with the at least one image to determine whether the second user device is within a predetermined distance of the location associated with the at least one image at a time;

when the second user device is within the predetermined distance of the location associated with the at least one image:

performing, at the processor, facial recognition on the at least one image to determine a probability that a user associated with the second user device is depicted within the at least one image;

defining, at the processor, user-specific data including an instance of the at least one image and data representing at least an indication of a corresponding event occurring at the location associated with the at least one image; and

sending the user-specific data to the second user device when the probability meets a criterion; and

when the second user device is not within the predetermined distance of the location associated with the at least one image:

not performing facial recognition on the at least one image to determine whether the user associated with the second user device is depicted within the at least one image.

20. The method of claim 19 , wherein the identifying the location of the second user device includes identifying the location of the second user device by inferring a section within a venue based on at least a portion of the data associated with the at least one image.

21. The method of claim 19 , further comprising:

22. The method of claim 19 , further comprising:

receiving, at the processor, data associated with the second user device, the identifying the location of the second user device includes identifying the location of the second user device based on at least a portion of the data associated with the second user device, the portion of the data associated with the second user device includes at least one of historical location data, calendar data, near field communication (NFC) verification data, cellular network triangulation data, Bluetooth verification data, internet web browsing data, purchase data, social media posts made by the user associated with the second user device, or ticket sale data associated with a venue.

23. The method of claim 19 , further comprising:

sending, from the first user device, a signal to the second user device requesting data associated with the second user device.

24. The method of claim 19 , wherein the identifying the location associated with the at least one image includes identifying a venue associated with the at least one image based on at least a portion of the data associated with the at least one image,

the identifying the location of the second user device includes identifying the location of the second user device within the venue.

Assignments (1)

ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2020

From: SABITOV, RUSLAN; BETSER, ALEXANDER; RESNICK, ADAM; JOSHPE, BRETT TERRY; HUESTIS, E. MICHAEL

To: 15 SECONDS OF FAME, INC.

Reel/Frame 052154/0729 →

Continuity (4)

Continuation 16150717 · Oct 3, 2018

Continuation 15211261 · Jul 15, 2016

Provisional Application 62192854 · Jul 15, 2015

Related Publication 20200217645A1 · Jul 9, 2020

Cited By (1)

US 12,256,143