IP Library Granted Patent US 11,249,544
Granted Patent B2
US 11,249,544 · App. 16/590,264 · Granted Feb 15, 2022

Methods and systems for using artificial intelligence to evaluate, correct, and monitor user attentiveness

Inventors: Roberto Sicconi (Purdys, NY); Malgorzata Stys (Purdys, NY); Tim Chinenov (Glen Head, NY)
Assignee: TELELINGO
G06F3/011G06F3/017G06F9/542G06N20/00G06T7/11G06T7/136G06T7/174G06T7/248G08B3/1016G08B5/223G06T2207/20021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,249,544
App. No.
16/590,264
Granted
Feb 15, 2022
Kind
B2
Abstract

In an aspect, a system for using artificial intelligence to evaluate, correct, and monitor user attentiveness includes a forward-facing camera, the forward-facing camera configured to capture a video feed of a field of vision on a digital screen, at least a user alert mechanism configured to output a directional alert to a user, a processing unit in communication with the forward-facing camera and the at least a user alert mechanism, a screen location to spatial location map operating on the processing unit, and a motion detection analyzer operating on the processing unit, the motion detection analyzer designed and configured to detect, on the digital screen, a rapid parameter change, determine a screen location on the digital screen of the rapid parameter change, retrieve, from the screen location to spatial location map, a spatial location based on the screen location, and generate, using the spatial location, the directional alert.

Claims (59)

1. A system for using artificial intelligence to evaluate, correct, and monitor user attentiveness, the system comprising:

a forward-facing camera, the forward-facing camera configured to capture a video feed of a field of vision on a digital screen;

at least a user alert mechanism configured to output a directional alert to a user;

a processing unit in communication with the forward-facing camera and the at least a user alert mechanism;

a screen location to spatial location map operating on the processing unit; and

a motion detection analyzer operating on the processing unit, the motion detection analyzer designed and configured to:

detect, on the digital screen, a rapid parameter change;

determine a screen location on the digital screen of the rapid parameter change;

retrieve, from the screen location to spatial location map, a spatial location based on the screen location;

determine a degree of interest as a function of a user parameter; and

generate, using the spatial location and the degree of interest, the directional alert, wherein the directional alert comprises a communication of interest.

2. The system of claim 1 , wherein the motion detection analyzer is further configured to detect the rapid parameter change by:

comparing a first frame of the video feed to a second frame of the video feed; and

determining that a number of pixels exceeding a threshold amount has changed with respect to at least a parameter from the first frame to the second frame.

3. The system of claim 2 , wherein the at least a parameter includes a color value.

4. The system of claim 2 , wherein the at least a parameter includes an intensity value.

5. The system of claim 1 , wherein the motion detection analyzer is further configured to determine the screen location by:

dividing the digital screen into a plurality of sections; and

identifying at least a section of the plurality of sections containing the rapid parameter change.

6. The system of claim 1 , wherein the motion detection analyzer is further configured to generate the directional alert by:

determining a direction of user focus;

calculating a spatial difference between the direction of user focus and the spatial location; and

generating the directional alert as a function of the spatial difference.

7. The system of claim 1 , wherein the motion detection analyzer is further configured to generate the directional alert by:

determining a user attentiveness level; and

generating the directional alert as a function of the user attentiveness level.

8. The system of claim 1 , wherein outputting the directional alert further comprises outputting a verbal indicator of direction.

9. The system of claim 1 , wherein outputting the directional alert further comprises outputting a spatial directional indicator.

10. The system of claim 1 , wherein the motion detection analyzer is further configured to:

determine how quickly user responds to the directional alert; and

determine an attentiveness level of the user as a function of response.

11. A method of using artificial intelligence to evaluate, correct, and monitor user attentiveness, the method comprising:

capturing, by a motion detection analyzer operating on a processing unit, using a forward-facing camera, a video feed of a field of vision on a digital screen;

detecting, by the motion detection analyzer and on the digital screen, a rapid parameter change;

determining, by the motion detection analyzer, a screen location on the digital screen of the rapid parameter change;

retrieving, by the motion detection analyzer and from a screen location to spatial location map, a spatial location based on the screen location;

determining, by the motion detection analyzer, a degree of interest as a function of a user parameter; and

generating, by the motion detection analyzer and using the spatial location and the degree of interest, a directional alert; and

outputting, by the motion detection analyzer and using at least a user alert mechanism the directional alert, wherein the directional alert comprises a communication of interest.

12. The method of claim 11 , wherein detecting the rapid parameter change further comprises

comparing a first frame of the video feed to a second frame of the video feed; and

determining that a number of pixels exceeding a threshold amount has changed with respect to at least a parameter from the first frame to the second frame.

13. The method of claim 12 , wherein the at least a parameter includes a color value.

14. The method of claim 12 , wherein the at least a parameter includes an intensity value.

15. The method of claim 11 , wherein determining the screen location further comprises:

dividing the digital screen into a plurality of cells; and

identifying at least a cell containing the rapid parameter change.

16. The method of claim 11 , wherein generating the directional alert further comprises:

determining a direction of user focus;

calculating a spatial difference between the direction of user focus and the spatial location; and

generating the directional alert as a function of the spatial difference.

17. The method of claim 11 , wherein generating the directional alert further comprises:

determining a user attentiveness level; and

generating the directional alert as a function of the user attentiveness level.

18. The method of claim 11 , wherein outputting the directional alert further comprises outputting a verbal indicator of direction.

19. The method of claim 11 , wherein outputting the directional alert further comprises outputting a spatial directional indicator.

20. The method of claim 11 , further comprises:

determine how quickly user responds to the directional alert; and

determine an attentiveness level of the user as a function of response.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 5, 2020
From: STYS, MALGORZATA; CHINENOV, TIM; SICCONI, ROBERTO
To: TELELINGO DBA DREYEV
Reel/Frame 052567/0952 →
Continuity (3)
Continuation In Part 15820411 · Nov 21, 2017
Provisional Application 62424612 · Nov 21, 2016
Related Publication 20200057487A1 · Feb 20, 2020
Cited By (8)
US 12,351,193 US 12,375,474 US 12,539,876 US 12,539,878 US 12,542,213 US 12,654,744 US 12,705,994 US 12,718,939