IP Library Granted Patent US 12,023,136
Granted Patent B2
US 12,023,136 · App. 17/250,077 · Granted Jul 2, 2024

Method and system for abnormality detection

Inventors: Paul Svensen (Forde, AU); Chan Yeoh (Forde, AU); Philip Wilson (Thorneside, AU)
Assignee: Saltor Pty Ltd
A61B5/02055A61B5/0002A61B5/015A61B5/02416A61B5/1118A61B5/1171G06V40/174G06V40/20G06V40/28A61B2503/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,023,136
App. No.
17/250,077
Granted
Jul 2, 2024
Kind
B2
Abstract

A method, including: receiving observation data from one or more data-capturing devices, the observation data representing a presence of an individual; processing the observation data to generate identity data representing the identity of the individual, and to detect at least one physiological characteristic or behavioural characteristic of the individual; retrieving behavioural profile data of the individual based on the identity data; and comparing the detected characteristic to at least one expected characteristic represented by the behavioural profile data of the individual to identify an abnormality of the individual.

Claims (64)

1. An abnormality determination system for determining an abnormality of an individual within a learning environment, including:

a monitor, including one or more imaging devices, said imaging devices configured to generate imaging signals; and

at least one abnormality detection server device, including:

a communications interface to receive data;

at least one computer processor to execute program instructions; and

a memory, coupled to the at least one computer processor, storing program instructions for execution by the at least one computer processor to automatically:

receive imaging signals from the monitor;

process the imaging signals to generate imaging data;

process the imaging data to detect the individual, and to generate corresponding identity data representing the identity of the individual; and

identify an abnormality of the individual based on:

physical detection data representing the detection of a physical characteristic of the individual from the imaging data, and a corresponding physical profile of the individual; or

behavioural detection data representing the detection of a behavioural characteristic of the individual from the imaging data, and a corresponding behavioural profile of the individual; and

context data representing a context of the detected behavioural or physical characteristic within the learning environment, wherein the context includes one or more influencing factors that influence the physical characteristic or behavioural characteristic of the individual;

wherein identifying the abnormality of the individual includes:

adjusting the corresponding physical profile or behavioural profile of the individual based on the context data.

2. The abnormality determination system of claim 1 , wherein the imaging signals include: video signals and thermal imaging signals, the thermal imaging signals including a series of thermal images that are associated with corresponding images of the video signals, and

where the video signals and thermal imaging signals are generated by a first imaging device and a second imaging device respectively, said video signals and thermal imaging signals being processed by the abnormality detection server device to generate one or more video and thermal image frames including the individual.

3. The abnormality determination system of claim 1 , wherein the identifying of an abnormality of the individual based on behavioural detection data includes:

processing the behavioural detection data to determine that the behavioural characteristic is one of a behaviour type including: a gesture; and a facial expression;

comparing the behavioural detection data to one or more behavioural characteristic models of the determined behaviour type; and

selecting a particular behavioural characteristic based on a result of the comparison,

where the behavioural characteristics are specific to the learning environment and include:

for the gesture behaviour type: (i) Head-scratching; (ii) Hitting/striking; (iii) Nodding; (iv) Hand-raising; (v) Waving; and (vi) Thumbs up/down; and

for the facial expression behaviour type: (i) Smiling; (ii) Frowning; and (iii) Crying.

4. The abnormality determination system of claim 3 , wherein the behavioural characteristics include: for the gesture behaviour type: (vii) one or more user-defined gestures, said user-defined gestures being gestures that are customised and/or configured specifically for the abnormality determination system.

5. The abnormality determination system of claim 1 , wherein the abnormality detection server device is configured to selectively update the physical profile of the individual based on corresponding physical detection data or the behavioural profile of the individual based on corresponding behavioural detection data.

6. The abnormality determination system of claim 1 , wherein the abnormality detection server device is configured to:

transmit, to a management system device of the learning environment, an indication of the identity of the individual;

transmit, to the management system device, an indication of an abnormality identified for the individual; and

receive, from the management system device, context data representing a context for detected behavioural or physical characteristics of the individual.

7. The abnormality determination system of claim 1 , wherein the context data indicates one or more of:

the types of learning activities being undertaken by the individual; and

the highest degree of physical activity in which the individual has engaged n within a particular time period.

8. The abnormality determination system of claim 1 , wherein the identification of an abnormality of the individual includes comparing the physical detection data to a physical model of the corresponding physical profile of the individual, said physical model being determined based on the context of the detected physical characteristics within the learning environment.

9. The abnormality determination system of claim 8 , wherein the physical profile of the individual includes at least one of:

a heart rate profile; and

a temperature profile,

and wherein said heart rate and temperature profiles each having one or more physical models representing the respective nominal heart rate and temperature levels of the individual for a particular context.

10. The abnormality determination system of claim 9 , wherein the heart rate profile of the individual includes physical models each representing: i) a “resting state”, which represents the heart rate of the individual when they have not undertaken vigorous physical activity; and ii) a “high activity” state which represents the heart rate of the individual when they have engaged in physical activity within the particular time period.

11. The abnormality determination system of claim 8 , wherein the abnormality detection server device is configured to:

transmit, to a management system device of the learning environment, an indication of the identity of the individual;

transmit, to the management system device, an indication of an abnormality identified for the individual; and

receive, from the management system device, context data representing a context for detected behavioural or physical characteristics of the individual.

12. The abnormality determination system of claim 8 , wherein the imaging signals include: video signals and thermal imaging signals, the thermal imaging signals including a series of thermal images that are associated with corresponding images of the video signals, and

where the video signals and thermal imaging signals are generated by a first imaging device and a second imaging device respectively, said video signals and thermal imaging signals being processed by the abnormality detection server device to generate one or more video and thermal image frames including the individual.

13. The abnormality determination system of claim 1 , wherein the identification of an abnormality of the individual includes comparing the behavioural detection data to a behavioural model of the corresponding behavioural profile of the individual, said behavioural model being determined based on the context of the detected behavioural characteristics within the learning environment.

14. The abnormality determination system of claim 13 , wherein the behavioural model of the individual includes, at least, behavioural tendency data representing the tendency of the individual to exhibit one or more of the detected behavioural characteristics relative to the context.

15. The abnormality determination system of claim 14 , wherein the behavioural tendency data for a particular behavioural characteristic includes an indication of the frequency with which the individual nominally exhibits the particular behavioural characteristic within a time period.

16. The abnormality determination system of claim 13 , wherein the abnormality detection server device is configured to:

transmit, to a management system device of the learning environment, an indication of the identity of the individual;

transmit, to the management system device, an indication of an abnormality identified for the individual; and

receive, from the management system device, the context data representing a context for detected behavioural or physical characteristics of the individual.

17. The abnormality determination system of claim 13 , wherein the imaging signals include: video signals and thermal imaging signals, the thermal imaging signals including a series of thermal images that are associated with corresponding images of the video signals, and

where the video signals and thermal imaging signals are generated by a first imaging device and a second imaging device respectively, said video signals and thermal imaging signals being processed by the abnormality detection server device to generate one or more video and thermal image frames including the individual.

18. An abnormality determination method for determining an abnormality of an individual within a learning environment, including:

receiving imaging signals from a monitor including one or more imaging devices, said imaging devices configured to generate the imaging signals;

processing the imaging signals to generate imaging data;

processing the imaging data to detect the individual, and to generate corresponding identity data representing the identity of the individual; and

identifying an abnormality of the individual based on:

physical detection data representing the detection of a physical characteristic of the individual from the imaging data, and a corresponding physical profile of the individual and context data representing a context of the detected physical characteristics within the learning environment; or

behavioural detection data representing the detection of a behavioural characteristic of the individual from the imaging data, and a corresponding behavioural profile of the individual and context data representing a context of the detected behavioural characteristics within the learning environment; and

context data representing a context of the detected behaviour or physical characteristic within the learning environment, wherein the context includes one or more influencing factors that influence the physical characteristic or behavioural characteristic of the individual;

wherein identifying the abnormality of the individual includes:

adjusting the corresponding physical profile or behavioural profile of the individual based on the context data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2021
From: SVENSEN, PAUL; YEOH, CHEN; WILSON, PHILIP
To: SALTOR PTY LTD
Reel/Frame 054910/0844 →
Priority Claims (2)
AU 2017902032 · May 29, 2017 · national
AU 2017279806 · Dec 22, 2017 · national
Continuity (1)
Related Publication 20210307621A1 · Oct 7, 2021