IP Library Granted Patent US 12687918
Granted Patent B2
US 12687918 · App. 18/630,196 · Granted Jul 21, 2026

Systems and methods for sensor-agnostic representation of human presence information

Inventors: Ugan Sivagnanenthirarajah (Seattle, WA); Michael Jeffrey Ajax (Redmond, WA); Sathyanarayanan Karivaradaswamy (Sammamish, WA); Robert Eugene Harris, Jr. (Woodinville, WA); Sarah Barnette (Seattle, WA); Sergii Viktorovych Liashenko (Edmonds, WA); Sanjeev Chandra Reddy (Redmond, WA); Sayak Chatterjee (Seattle, WA)
Assignee: Microsoft Technology Licensing, LLC
G06F3/012G06F21/84
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12687918
App. No.
18/630,196
Granted
Jul 21, 2026
Kind
B2
Abstract

Systems and methods for sensor-agnostic representation of human presence information are described. An operating system of a computing device with a display screen is configured to receive, from a sensor system, human presence information representing the position and posture of one or more persons detected by a sensor of the sensor system, where the human presence information is determined based on a coordinate system associated with the display screen. The human presence information has the same format regardless of the sensor technology. The human presence information includes an elevation angle, an azimuth angle, a face pitch, a face roll, and/or a face yaw of the person relative to the sensor and/or display screen. The operating system may use the human presence information to implement privacy-related features and/or may provide the human presence information to one or more applications via an API.

Claims (66)

1 . A computing device for detecting human presence, the computing device comprising:

at least one processor;

a display screen;

a sensor system comprising a sensor positioned adjacent the display screen; and

memory storing instructions that, when executed by the at least one processor, cause the computing device to perform operations comprising:

receiving, by an operating system of the computing device from a first application, a first request for human presence information;

in response to receiving the first request, obtaining, by the operating system, first human presence information, from the sensor system, indicating a position of one or more humans relative to the display screen, the first human presence information comprising:

a first elevation angle that represents an elevation of a head portion of a first person relative to a plane of a first coordinate system associated with the sensor, wherein;

the plane is orthogonal to a plane of the display screen; and

the elevation angle is an angle between a distance vector extending from an origin of the first coordinate system to the head portion of the first person and a projection of the distance vector onto the plane, and

a first azimuth angle that represents a viewing perspective of the head portion of the first person relative to the sensor, wherein the azimuth angle is an angle between an axis of the first coordinate system and the projection of the distance vector onto the plane; and

providing the first human presence information to the first application.

2 . The computing device of claim 1 , wherein the origin of the first coordinate system is at a location of the sensor.

3 . The computing device of claim 1 , wherein the first human presence information further comprises a face pitch, a face roll, and a face yaw associated with a face of the first person, the face pitch, the face roll, and the face yaw determined based in part on a second coordinate system having axes that are parallel to axes of the first coordinate system and a second origin associated with the face of the first person.

4 . The computing device of claim 1 , wherein the first human presence information further comprises:

a detected number of persons;

a second elevation angle associated with a second person; and

a second azimuth angle associated with the second person.

5 . The computing device of claim 1 , wherein the instructions further cause the computing device to perform operations comprising:

determining, based on the first human presence information, the first person is an onlooker; and

in response to the determination that the first person is an onlooker, causing a privacy function to be performed.

6 . The computing device of claim 5 , wherein the privacy function includes at least one of dimming the display screen, muting notifications, or issuing an alert.

7 . The computing device of claim 1 , wherein the first human presence information is provided to the first application via an application program interface (API) of the operating system.

8 . The computing device of claim 1 , wherein the instructions further cause the computing device to perform operations comprising:

receiving, by the operating system from a second application, a second request for human presence information; and

in response to receiving the second request:

obtaining, from the sensor system, second human presence information comprising:

a second elevation angle associated with a second person,

a second azimuth angle associated with the second person, and

providing the second human presence information to the second application via an application program interface (API) of the operating system.

9 . The computing device of claim 8 , wherein the second human presence information further comprises a face pitch, a face roll, and a face yaw associated with a face of the second person.

10 . The computing device of claim 1 , wherein the sensor is an ultrawideband sensor, an ultrasonic sensor, a LiDAR sensor, or a time-of-flight (ToF) sensor.

11 . The computing device of claim 1 , wherein the sensor is positioned with a bezel.

12 . A sensor system for detecting persons of a computing device, the sensor system comprising:

processing circuitry; and

a sensor positioned adjacent a display screen of the computing device;

wherein the sensor system is configured to:

capture, by the sensor, sensor signals;

detect one or more persons based on the captured sensor signals;

determine, via the processing circuitry, human presence information indicating a position of one or more humans relative to the display screen, wherein the human presence information includes first human presence information for a first person of the one or more persons, the first human presence information comprising:

a first elevation angle that represents an elevation of a head portion of the first person relative to a plane of a first coordinate system associated with the sensor, wherein the first elevation angle is an angle between a first distance vector extending from an origin of the first coordinate system to the head portion of the first person and a projection of the first distance vector onto the plane, and

a first azimuth angle that represents a viewing perspective of the head portion of the first person relative to the sensor, wherein the azimuth angle is an angle between an axis of the first coordinate system and the projection of the distance vector onto the plane; and

provide, to an operating system of the computing device, the human presence information.

13 . The sensor system of claim 12 , wherein an X-Y plane is orthogonal to a plane of a display screen.

14 . The sensor system of claim 12 , wherein the origin of the first coordinate system is centered relative to a horizontal width of a display screen.

15 . The sensor system of claim 12 , wherein the origin of the first coordinate system is at a location of the sensor.

16 . The sensor system of claim 12 , wherein the sensor system is further configured to:

determine, based on a second coordinate system having axes that are parallel to axes of the first coordinate system and a second origin associated with a face of the first person, a face pitch, a face roll, and a face yaw associated with the face of the first person, wherein the first human presence information includes the face pitch, face roll, and face yaw associated with the face of the first person.

17 . The sensor system of claim 12 , wherein the one or more persons includes a second person and the sensor system is further configured to:

determine a number of detected persons including the first person and the second person; and

determine a second elevation angle associated with the second person and a second azimuth angle associated with the second person, wherein providing the human presence information to the operating system includes providing:

an indication of the number of detected persons;

an array of elevation angles including the first elevation angle and the second elevation angle; and

an array of azimuth angles including the first azimuth angle and the second azimuth angle, wherein a number of elements in the array of elevation angles and a number of elements in the vector of azimuth angles correspond to the number of detected persons.

18 . A computer-implemented method for detecting human presence, the method comprising:

receiving, by an operating system of a computing device from an application, a request for human presence information for a plurality of persons detected by a sensor system positioned adjacent a display screen of the computing device;

in response to receiving the request, transmitting, by the operating system to the sensor system, a request for the human presence information;

receiving, from the sensor system, human presence information for a first detected person and a second detected person, wherein:

the human presence information indicates a position of the first detected person and a position of the second detected person relative to the display screen;

the human presence information for the first detected person includes a first elevation angle, a first azimuth angle, a first face pitch, a first face roll, and a first face yaw; and

the human presence information for the second detected person includes a second elevation angle, a second azimuth angle, a second face pitch, a second face roll, and a second face yaw; and

providing the human presence information to the application.

19 . The method of claim 18 , wherein:

the first elevation angle that represents an elevation of a head portion of a first person relative to a plane of a first coordinate system associated with a sensor of the sensor system, wherein the elevation angle is an angle between a distance vector extending from an origin of the coordinate system to the head portion of the first person and a projection of the distance vector onto the plane; and

the first azimuth angle that represents a viewing perspective of the head portion of the first person relative to the sensor, wherein the azimuth angle is an angle between an axis of the coordinate system and the projection of the distance vector onto the plane.

20 . The method of claim 19 , wherein the first face pitch, the first face roll, and the first face yaw are determined based on a second coordinate system having axes that are parallel to axes of the first coordinate system and a second origin associated with the face of the first person.