IP Library Granted Patent US 12,002,224
Granted Patent B2
US 12,002,224 · App. 17/215,319 · Granted Jun 4, 2024

Apparatus and method for protecting against environmental hazards

Inventors: Veljko Krunic (Westminster, CO); Helen Stella (Westminster, CO)
Assignee: HS VK IDEA FACTORY LLC
G06T7/248G06T7/12G06V40/28G06T2207/30196G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,002,224
App. No.
17/215,319
Granted
Jun 4, 2024
Kind
B2
Abstract

The disclosures are directed to methods and apparatuses that allow for one or more of personal sanitizing/decontamination of a user, prevention of the touching of exposed parts of the user's body, tracking of surface sanitizing/decontamination status, tracking of the interpersonal distance, and sanitization of personal electronics (e.g., a mobile phone). In addition, data relating to a user's usage of the various components of the system may be tracked, and artificial intelligence (AI) techniques may be employed to mine for patterns of user behavior in the system.

Claims (83)

1. An apparatus comprising:

a memory storing instructions; and

a processor communicatively coupled to the memory and configured to execute the instructions to:

receive, from at least one camera, a first image of a scene;

determine, based on the first image, a first location of at least one marker within the scene;

based on the first location of the at least one marker within the scene, generate boundary data characterizing a boundary of an object within the scene;

receive, from the at least one camera, a second image of the scene;

determine, based on the second image, a second location of the at least one marker within the scene;

modify the boundary data based on the second location of the at least one marker; and

track a movement of the object based on the modified boundary data.

2. The apparatus of claim 1 , wherein the processor is configured to execute the instructions to determine that the tracked movement satisfies at least one predetermined movement based on movement data.

3. The apparatus of claim 2 , wherein the processor is configured to execute the instructions to:

provide for displaying a first indication that the object is not cleaned when the at least one predetermined movement has not been satisfied; and

provide for displaying a second indication that the object is cleaned when the at least one predetermined movement has been satisfied.

4. The apparatus of claim 1 , wherein generating the boundary data comprises applying an image segmentation algorithm to the first image.

5. The apparatus of claim 1 , wherein the processor is configured to execute the instructions to detect the at least one marker within the first image, wherein generating the boundary data is based on the at least one marker.

6. The apparatus of claim 1 , wherein generating the boundary data comprises:

determining an area of the first image that comprises the at least one marker; and

generating the boundary data based on combining the area with the boundary of the object.

7. The apparatus of claim 6 , wherein determining the area of the first image that comprises the at least one marker comprises:

generating at least one virtual marker at a location of the first image based on marker configuration data, the market configuration data characterizing the location of the first image in relation to the first location of the at least one marker; and

determining the area based on the location of the at least one virtual marker.

8. The apparatus of claim 1 wherein the processor is configured to execute the instructions to:

determine that the tracked movement fails to satisfy at least one predetermined movement based on movement data; and

provide for display an indication that the object has not been cleaned.

9. The apparatus of claim 1 wherein the processor is configured to execute the instructions to:

detect a surface in the first image;

determine at least a portion of the surface that coincides with the object; and

determine that the at least portion of the surface has been cleansed by the object.

10. The apparatus of claim 9 , wherein determining the at least portion of the surface that coincides with the object comprises determining that first pixels of the first image that correspond to the at least portion of the surface coincides with second pixels of the first image that correspond to the object.

11. A method by at least one processor comprising:

receiving, from at least one camera, a first image of a scene;

determining, based on the first image, a first location of at least one marker within the scene;

based on the first location of the at least one marker within the scene, generating boundary data characterizing a boundary of an object within the scene;

receiving, from the at least one camera, a second image of the scene;

determining, based on the second image, a second location of the at least one marker within the scene;

modifying the boundary data based on the second location of the at least one marker; and

tracking a movement of the object based on the modified boundary data.

12. The method of claim 11 comprising determining that the tracked movement satisfies at least one predetermined movement based on movement data.

13. The method of claim 12 comprising:

providing for display a first indication that the object is not cleaned when the at least one predetermined movement has not been satisfied; and

providing for display a second indication that the object is cleaned when the at least one predetermined movement has been satisfied.

14. The method of claim 11 , wherein generating the boundary data comprises applying an image segmentation algorithm to the first image.

15. The method of claim 11 comprising detecting the at least one marker within the first image, wherein generating the boundary data is based on the at least one marker.

16. A non-transitory, computer readable medium comprising instructions stored thereon, wherein the instructions, when executed by at least one processor, cause the at least one process to perform operations comprising:

receiving, from at least one camera, an image of a scene;

determining, based on the first image, a first location of at least one marker within the scene;

based on the first location of the at least one marker within the scene, generating boundary data characterizing a boundary of an object within the scene;

receiving, from the at least one camera, a second image of the scene;

determining, based on the second image, a second location of the at least one marker within the scene;

modifying the boundary data based on the second location of the at least one marker; and

tracking a movement of the object based on the modified boundary data.

17. The non-transitory, computer readable medium of claim 16 , wherein the performed operations comprise determining that the tracked movement satisfies at least one predetermined movement based on movement data.

18. The non-transitory, computer readable medium of claim 16 , wherein the performed operations comprise:

providing for display a first indication that the object is not cleaned when the at least one predetermined movement has not been satisfied; and

providing for display a second indication that the object is cleaned when the at least one predetermined movement has been satisfied.

19. The non-transitory, computer readable medium of claim 16 , wherein the performed operations comprise applying an image segmentation algorithm to the first image to generate the boundary data.

20. The non-transitory, computer readable medium of claim 16 , wherein the performed operations comprise detecting the at least one marker within the first image, wherein generating the boundary data is based on the at least one marker.

21. An apparatus comprising:

a memory storing instructions; and

a processor communicatively coupled to the memory and configured to execute the instructions to:

receive a first image and a second image from a camera directed to a sink;

apply a computer vision algorithm to the first image and, based on the application of the computer vision algorithm to the first image, determine a first location of a hand;

apply the computer vision algorithm to the second image and, based on the application of the computer vision algorithm to the second image determine a second location of the hand;

determine a hand movement is satisfied based on the first location of the hand, the second location of the hand, and hand movement data characterizing the hand movement;

generate hand status data characterizing whether the hand is sanitized based on the hand movement; and

store the hand status data in a data repository.

22. The apparatus of claim 21 , wherein determining the hand movement is satisfied comprises determining a first orientation of the hand based on the first image, a second orientation of the hand based on the second image, and comparing the first orientation of the hand to the second orientation of the hand.

23. An apparatus comprising:

a memory storing instructions; and

a processor communicatively coupled to the memory and configured to execute the instructions to:

receive a first image of a room;

apply a computer vision algorithm to the first image and, based on applying the computer vision algorithm to the first image, determine a first location of a first object in the room;

receive a second image of the room;

apply the computer vision algorithm to the second image and, based on applying the computer vision algorithm to the second image, determine a second location of a second object in the room;

determine a distance between the first location of the first object and the second location of the second object;

compare the distance to a predetermined threshold and, based on the comparison, determine the distance is below the predetermined threshold;

based on determining that the distance is below the predetermined threshold, determine the first object has contaminated the second object;

based on determining that the first object has contaminated the second object, generate contamination graph data characterizing that the first object has contaminated the second object; and

store the contamination graph data in a database.

24. The apparatus of claim 23 , wherein determining the first object has contaminated the second object comprises determining the first object has touched the second object.

25. The apparatus of claim 23 , wherein the predetermined threshold is an interpersonal distance.

26. The apparatus of claim 25 , wherein the predetermined threshold is an airflow distance between the first object and the second object.

Assignments (2)
CHANGE OF ADDRESS Recorded Apr 17, 2024
From: HS VK IDEA FACTORY LLC
To: HS VK IDEA FACTORY LLC
Reel/Frame 067136/0057 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2021
From: KRUNIC, VELJKO; STELLA, HELEN
To: HS VK IDEA FACTORY LLC
Reel/Frame 055751/0199 →
Continuity (5)
Provisional Application 63073231 · Sep 1, 2020
Provisional Application 63050518 · Jul 10, 2020
Provisional Application 63009661 · Apr 14, 2020
Provisional Application 63000732 · Mar 27, 2020
Related Publication 20210304420A1 · Sep 30, 2021