IP Library Granted Patent US 11,563,922
Granted Patent B2
US 11,563,922 · App. 17/320,151 · Granted Jan 24, 2023

Method for monitoring occupancy in a work area

Inventors: Dan Ryan (Mountain View, CA); Kelby Green (Mountain View, CA)
Assignee: VergeSense, Inc.
H04N7/188G05D23/1917G06K9/6218G06V10/143G06V20/52G06V20/53
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,563,922
App. No.
17/320,151
Granted
Jan 24, 2023
Kind
B2
Abstract

One variation of a method for monitoring occupancy in a work area includes, at a sensor block: transitioning from an inactive state into an active state when an output of a motion sensor indicates motion in a work area; during a scan cycle in the active state, recording an image through an optical sensor at a time, detecting a set of humans in the image, detecting a second set of human effects in the image, predicting a second set of humans occupying but absent the work area based on the second set of human effects, and estimating a total occupancy in the work area at the time based on the set of humans and the second set of humans; and transmitting the total occupancy to a remote computer system for update of a scheduler for the work area.

Claims (104)

1. A method for monitoring occupancy comprising:

accessing a set of definitions of an occupied state for a desk-type asset comprising:

a first definition of an occupied with human present state for the desk-type asset; and

a second definition of an occupied with human absent state for the desk-type asset;

accessing a third definition of a vacant state for the desk-type asset;

at a first time, recording a first image at a sensor block, the first image depicting:

a first desk comprising the desk-type asset; and

a second desk comprising the desk-type asset;

extracting a first set of features associated with the first desk from the first image, the first set of features representing a set of human effects, the set of human effects comprising personal objects carried by humans in a work environment and excluding fixed assets defined by an administrator;

detecting a first human effect in the set of human effects and absence of humans within a predefined area associated with the first desk from the first image based on the first set of features;

in response to detecting the first human effect in the set of human effects and absence of humans within the predefined area associated with the first desk from the first image, identifying the first desk in the occupied with human absent state according to the second definition of the occupied state;

extracting a second set of features associated with the second desk from the first image;

identifying the second desk in the vacant state based on the second set of features and the third definition of the vacant state; and

updating a scheduler to indicate the first desk in the occupied with human absent state and to indicate the second desk in the vacant state.

2. The method of claim 1 , wherein identifying the second desk in the vacant state based on the second set of features and the third definition of the vacant state comprises:

detecting absence of humans in the second set of features; and

in response to detecting absence of humans in the second set of features, identifying the second desk in the vacant state according to the third definition of the vacant state.

3. The method of claim 1 , further comprising:

at a second time, recording a second image at the sensor block, the second image depicting a third desk comprising the desk-type asset;

extracting a third set of features associated with the third desk from the second image;

detecting presence of a human within a predefined area associated with the third desk based on the third set of features;

in response to detecting presence of the human within the predefined area associated with the third desk, identifying the third desk in the occupied with human present state according to the second definition of the occupied state; and

updating the scheduler to indicate the third desk in the occupied with human present state.

4. The method of claim 3 , wherein extracting the third set of features, associated with the third desk, from the second image comprises extracting the third set of features of a human in the predefined area associated with the third desk.

5. The method of claim 1 , wherein detecting the first human effect in the set of human effects comprises detecting the first human effect within a threshold distance of a centroid of the first desk from the first image based on the first set of features.

6. A method for monitoring occupancy comprising:

accessing a first definition of an occupied with human absent state for a desk-type asset;

accessing a second definition of a vacant state for the desk-type asset;

accessing a third definition of an occupied with human present state for the desk-type asset;

at a first time:

recording a first image at a sensor block, the first image depicting a first desk comprising the desk-type asset;

extracting a first set of features associated with the first desk from the first image, the first set of features representing a set of human effects, the set of human effects comprising personal objects carried by humans in a work environment and excluding fixed assets defined by an administrator of the work environment; and

identifying the first desk in the occupied with human absent state based on the first set of features and the first definition of the occupied with human absent state; and

at a second time:

recording a second image at the sensor block, the second image depicting a second desk comprising the desk-type asset;

extracting a second set of features associated with the second desk from the second image; and

identifying the second desk in the occupied with human present state based on the second set of features and the third definition of the occupied with human present state; and

updating a desk manager to indicate the first desk in the occupied with human absent state and to indicate the second desk in the occupied with human present state.

7. The method of claim 6 :

wherein recording the first image at the sensor block comprises recording a first color image at the sensor block, the first color image depicting the first desk; and

wherein recording the second image at the sensor block comprises recording a second color image at the sensor block, the second color image depicting the second desk.

8. The method of claim 6 :

wherein recording the first image at the sensor block comprises recording a first depth image at the sensor block, the first depth image depicting the first desk; and

wherein recording the second image at the sensor block comprises recording a second depth image at the sensor block, the second depth image depicting the second desk.

9. A method for monitoring occupancy comprising:

accessing a first definition of an occupied with human absent state for a desk-type asset;

accessing a second definition of a vacant state for the desk-type asset;

accessing a third definition of an occupied with human present state for the desk-type asset;

at a first time:

recording a first image at a sensor block, the first image depicting a first desk comprising the desk-type asset;

extracting a first set of features associated with the first desk from the first image, the first set of features representing a first set of human effects, the set of human effects comprising personal objects carried by humans in a work environment and excluding fixed assets within the work environment; and

identifying the first desk in the occupied with human absent state based on the first set of features and the first definition of the occupied with human absent state;

at a second time:

recording a second image at the sensor block, the second image depicting a second desk comprising the desk-type asset;

extracting a second set of features associated with the second desk from the second image; and

identifying the second desk in the vacant state based on the second set of features and the second definition of the vacant state;

at a third time:

recording a third image at the sensor block, the third image depicting a third desk comprising the desk-type asset;

extracting a third set of features associated with the third desk from the third image; and

identifying the third desk in the occupied with human present state based on the third set of features and the third definition of the occupied with human present state; and

transmitting the occupied with human absent state of the first desk, the vacant state of the second desk, and the occupied with human present state of the third desk to a remote computer system.

10. The method of claim 9 , wherein extracting the third set of features associated with the third desk from the third image comprises extracting the third set of features of a human in a predefined area associated with the third desk.

11. The method of claim 9 , further comprising, at the remote computer system:

receiving the occupied with human absent state of the first desk, the vacant state of the second desk, and the occupied with human present state of the third desk from the sensor block; and

updating a scheduler to indicate the occupied with human absent state of the first desk, the vacant state of the second desk, and the occupied with human present state of the third desk.

12. The method of claim 9 :

wherein updating the scheduler to indicate the occupied with human absent state of the first desk comprises updating the scheduler to indicate a first location and the occupied with human absent state of the first desk;

wherein updating the scheduler to indicate the vacant state of the second desk comprises updating the scheduler to indicate a second location and the vacant state of the second desk; and

wherein updating the scheduler to indicate the occupied with human present state of the third desk comprises updating the scheduler to indicate a third location and the occupied with human present state of the third desk.

13. The method of claim 9 :

wherein recording the first image at the sensor block comprises recording a first depth image at the sensor block, the first depth image depicting the first desk;

wherein recording the second image at the sensor block comprises recording a second depth image at the sensor block, the second depth image depicting the second desk; and

wherein recording the third image at the sensor block comprises recording the third depth image at the sensor block, the third depth image depicting the third desk.

14. The method of claim 9 , wherein extracting the set of features associated with the first desk from the first image comprises:

extracting the first set of features from the first image, the first set of features representing a first set of human effects; and

associating the first set of features with the first desk based on proximity of the first set of features to the first desk in the first image.

15. The method of claim 14 , wherein associating the first set of features with the first desk based on proximity of the first set of features to the first desk in the first image comprises associating the first set of features with the first desk in response to detecting the first set of features within a first predefined region of the first image, the first predefined region associated with the first desk.

16. The method of claim 14 , wherein associating the first set of features with the first desk based on proximity of the first set of features to the first desk in the first image comprises associating the first set of features with the first desk in response to detecting the first set of features within a threshold distance of the first desk in the first image.

17. The method of claim 9 , wherein extracting the first set of features associated with the first desk from the first image, the first set of features representing the first set of human effects, the first set of features representing the first set of human effects is selected from a group consisting of:

personal items;

laptop computers;

tablet computers;

smartphones;

keyboards;

electronic mice;

charging cables;

data transfer cables;

beverage containers;

food containers;

utensils;

tissues;

napkins;

pairs of headphones;

articles of clothing;

wearable accessories;

keys;

keychains;

wallets;

pens;

pencils;

books;

booklets;

notebooks; and

pieces of loose paper.

Assignments (2)
SECURITY INTEREST Recorded Apr 2, 2026
From: VERGESENSE INC.
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 074264/0445 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2022
From: GREEN, KELBY; RYAN, DAN
To: VERGESENSE, INC.
Reel/Frame 061680/0290 →
Continuity (5)
Continuation 16828676 · Mar 24, 2020
Continuation In Part 16424252 · May 28, 2019
Continuation 15973445 · May 7, 2018
Provisional Application 62502132 · May 5, 2017
Related Publication 20210274134A1 · Sep 2, 2021