IP Library Granted Patent US 11,532,163
Granted Patent B2
US 11,532,163 · App. 17/138,784 · Granted Dec 20, 2022

Arrival detection for battery-powered optical sensors

Inventors: Kelby Green (Mountain View, CA); Dan Ryan (Mountain View, CA)
Assignee: VergeSense, Inc.
G06V20/52G06Q10/1093G06T7/70G06T7/97G06V10/147G06V40/10G06T2207/30196G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,532,163
App. No.
17/138,784
Granted
Dec 20, 2022
Kind
B2
Abstract

A method including, accessing an occupancy of the workspace. The method also includes, in response to the occupancy status indicating vacancy: at a first time, recording a first image and a second image of the workspace, the first image and the second image characterized by a first resolution; and executing an arrival detection model based on the first and second image. The method further includes, in response to detecting arrival at the workspace: at a third time, recording a third image of the workspace, the third image characterized by a second resolution greater than the first resolution; and executing an occupancy detection model based on the third image. The method additionally includes, in response to detecting occupancy of the workspace: updating the occupancy status to indicate occupancy; and transmitting the occupancy status to a remote scheduling system.

Claims (97)

1. A method for detecting occupancy of a workspace comprising:

accessing an occupancy status of the workspace;

in response to the occupancy status indicating vacancy of the workspace:

at a first time, recording a first image of the workspace at a sensor block; and

at a second time succeeding the first time by a first time interval, recording a second image of the workspace at the sensor block;

in response to detecting human arrival at the workspace based on the first image and the second image, at a third time, recording a third image of the workspace at the sensor block; and

in response to detecting occupancy of the workspace based on the third image:

updating the occupancy status to indicate occupancy of the workspace;

transmitting the occupancy status to a remote scheduling system;

at a fourth time succeeding the third time by a second time interval longer than the first time interval, recording a fourth image of the workspace at the sensor block; and

updating the occupancy status of the workspace based on the fourth image.

2. The method of claim 1 :

wherein recording the first image of the workspace at the sensor block comprises recording the first image of the workspace at the sensor block, the first image characterized by a first resolution;

wherein recording the second image of the workspace at the sensor block comprises recording the second image of the workspace at the sensor block, the second image characterized by the first resolution;

wherein recording the third image of the workspace at the sensor block comprises recording the third image of the workspace at the sensor block, the third image characterized by a second resolution greater than the first resolution; and

wherein recording the fourth image of the workspace at the sensor block comprises recording the fourth image of the workspace at the sensor block, the fourth image characterized by the second resolution.

3. The method of claim 1 :

wherein detecting human arrival at the workspace based on the first image and the second image comprises:

executing an arrival detection model based on the first image and the second image; and

detecting human arrival at the workspace based on the arrival detection model; and

wherein detecting occupancy of the workspace based on the third image comprises:

executing an occupancy detection model based on the third image; and

detecting occupancy of the workspace based on the occupancy detection model.

4. The method of claim 3 , wherein executing the occupancy detection model based on the third image comprises executing a computer vision classification algorithm to detect an occupancy status of the workspace, the occupancy status being one of:

occupied;

vacant; and

occupied with no human present.

5. The method of claim 3 , wherein executing the arrival detection model based on the first image and the second image comprises, in response to a set of pixel values in an image mask corresponding to the workspace in the second image exceeding a first set of pixel value thresholds, detecting human arrival at the workspace.

6. The method of claim 3 , wherein executing the arrival detection model based on the first image and the second image comprises:

detecting a presence of the first contiguous edge in the first image; and

in response to detecting an absence of the first contiguous edge in the second image, detecting human arrival at the workspace.

7. The method of claim 3 :

further comprising accessing a template image of the workspace; and

wherein executing the arrival detection model based on the first image and the second image comprises:

generating a first difference image between the template image and the first image;

detecting a human arrival in the workspace based on the first difference image;

generating a second difference image between the template image and the second image; and

confirming the human arrival in the workspace based on the second difference image.

8. The method of claim 3 :

wherein executing the arrival detection model based on the first image and the second image comprises executing the arrival detection model based on the first image and the second image, the arrival detection model characterized by a first energy consumption; and

wherein executing the occupancy detection model based on the third image comprises executing the occupancy detection model based on the third image, the occupancy detection model characterized by a second energy consumption greater than the first energy consumption.

9. The method of claim 1 :

wherein accessing the occupancy status of the workspace comprises accessing the occupancy status of the workspace at the sensor block;

wherein executing the arrival detection model based on the first image and the second image comprises executing the arrival detection model based on the first image and the second image at the sensor block;

further comprising, in response to detecting human arrival at the workspace via the arrival detection model, transmitting the third image from the sensor block to a gateway;

further comprising, in response to detecting occupancy of the workspace via the occupancy detection model, transmitting an indication of occupancy of the workspace from the gateway to the sensor block;

wherein updating the occupancy status to indicate occupancy of the workspace comprises updating the occupancy status to indicate occupancy of the workspace at the sensor block; and

wherein transmitting the occupancy status to the remote scheduling system comprises transmitting the occupancy status from the gateway to the remote scheduling system.

10. The method of claim 1 :

wherein recording the first image of the workspace at the sensor block comprises recording the first image of the workspace at the sensor block via a first optical sensor;

wherein recording the second image of the workspace at the sensor block comprises recording the second image of the workspace at the sensor block via the first optical sensor;

wherein recording the third image of the workspace at the sensor block comprises recording the third image of the workspace at the sensor block via a second optical sensor; and

wherein recording the fourth image of the workspace at the sensor block comprises recording the fourth image of the workspace at the sensor block via the second optical sensor.

11. The method of claim 1 :

further comprising accessing an image mask corresponding to the workspace, the image mask defining a subsection of the image occupied by the workspace;

wherein detecting human arrival at the workspace based on the first image and the second image comprises detecting human arrival at the workspace based on the first image within the image mask and the second image within the image mask; and

wherein detecting occupancy of the workspace based on the third image comprises detecting occupancy of the workspace based on the third image within the image mask.

12. The method of claim 11 :

further comprising calculating a set of most significant pixels within the image mask based on a set of previous images of the workspace; and

wherein detecting human arrival at the workspace based on the first image within the image mask and the second image within the image mask comprises detecting human arrival at the workspace based on the set of most significant pixels in the first image and the set of most significant pixels in the second image.

13. The method of claim 1 , further comprising, in response to detecting vacancy of the workspace based on the fourth image:

at a fifth time, recording a fifth image of the workspace at the sensor block; and

at a sixth time succeeding the fifth time by the first time interval, recording a sixth image of the workspace at the sensor block.

14. The method of claim 1 :

wherein accessing the occupancy status of the workspace comprises accessing the occupancy status of the workspace from a local memory of the sensor block;

wherein detecting human arrival at the workspace based on the first image and the second image comprises detecting human arrival at the workspace based on the first image and the second image at the sensor block;

wherein detecting occupancy of the workspace based on the third image comprises detecting occupancy of the workspace based on the third image at the sensor block;

wherein updating the occupancy status to indicate occupancy of the workspace comprises updating the occupancy status to indicate occupancy of the workspace in the local memory of the sensor block; and

wherein transmitting the occupancy status to the remote scheduling system comprises transmitting the occupancy status from the sensor block to the remote scheduling system.

15. The method of claim 1 , further comprising:

in response to detecting human arrival at the workspace based on the first image and the second image:

transmitting an indication of the human arrival at the workspace to the remote scheduling system; and

at the remote scheduling system, in response to receiving the indication of human arrival, representing the human arrival at the workspace with a first graphical representation in a user interface; and

at the remote scheduling system, in response to receiving the occupancy status indicating occupancy of the workspace, representing the occupancy of the workspace with a second graphical representation in the user interface.

16. A method comprising:

accessing a first occupancy status of a first workspace;

in response to the first occupancy status indicating vacancy of the first workspace and during a first time period, recording a first series of images of the first workspace at a sensor block and at a first imaging frequency;

in response to detecting human arrival at the first workspace based on the first series of images and during a second time period succeeding the first time period, recording a second series of images of the first workspace at the sensor block and at a second imaging frequency less than the first image frequency; and

in response to detecting occupancy of the first workspace based on the second series of images, updating the first occupancy status to indicate occupancy of the first workspace.

17. The method of claim 16 :

wherein, during the first time period, recording the first series of images of the first workspace at the sensor block and at the first imaging frequency comprises, during the first time period, recording the first series of images of the first workspace at the sensor block and at the first imaging frequency, the first imaging frequency based on the time of day of the first time period; and

wherein, during the second time period succeeding the first time period, recording the second series of images of the first workspace at the sensor block and at the second imaging frequency comprises, during the second time period succeeding the first time period, recording the second series of images of the first workspace at the sensor block and at the second imaging frequency, the first imaging frequency based on the time of day of the second time period.

18. The method of claim 16 :

wherein accessing the first occupancy status of the first workspace comprises accessing a set of occupancy statuses of a set of workspaces located in a work area, the set of workspaces comprising the first workspace;

further comprising calculating a total occupancy of the work area;

wherein recording the first series of images of the first workspace at the sensor block and at the first imaging frequency comprises recording the first series of images of the first workspace at the sensor block and at the first imaging frequency, the first frequency based on the total occupancy of the work area; and

wherein recording the second series of images of the first workspace at the sensor block and at the second imaging frequency comprises recording the second series of images of the first workspace at the sensor block and at the second imaging frequency, the second imaging frequency based on the total occupancy of the work area.

19. The method of claim 16 , further comprising:

accessing a second occupancy status of a second workspace in a work area encompassing the first workspace and the second workspace; and

in response to the second occupancy status indicating vacancy of the second workspace:

during the second time period succeeding the first time period, recording a third series of images of a second workspace at the sensor block and at the first imaging frequency; and

detecting human arrival at the second workspace based on the third series of images.

20. The method of claim 19 , further comprising:

in response to detecting human arrival at the second workspace via the arrival detection model, during a fourth time period succeeding the third time period, recording a fourth series of images of the second workspace at the sensor block and at the second imaging frequency; and

in response to detecting vacancy of the second workspace based on the fourth series of images:

maintaining the second occupancy status to indicate vacancy of the second workspace; and

recording a fifth series of images of the second workspace at the sensor block and at the first imaging frequency.

Assignments (2)
SECURITY INTEREST Recorded Apr 2, 2026
From: VERGESENSE INC.
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 074264/0445 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2022
From: GREEN, KELBY; RYAN, DAN
To: VERGESENSE, INC.
Reel/Frame 061762/0654 →
Continuity (3)
Continuation 16820603 · Mar 16, 2020
Provisional Application 62819288 · Mar 15, 2019
Related Publication 20210117692A1 · Apr 22, 2021