IP Library Granted Patent US 11,856,419
Granted Patent B2
US 11,856,419 · App. 17/404,159 · Granted Dec 26, 2023

Method and system for commissioning environmental sensors

Inventors: David E. Schwartz (Concord, MA); Paloma J. Fautley (Concord, MA); Eric D. Cocker (Redwood City, CA); Warren Jackson (San Francisco, CA)
Assignee: Xerox Corporation
H04W24/02G06K7/10722G06K7/1417G06T7/74G06V20/20G08B21/182H04W8/005H04W84/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,856,419
App. No.
17/404,159
Granted
Dec 26, 2023
Kind
B2
Abstract

Methods and systems to commission building environmental sensors are disclosed. The system include a device that will move about the environment of a building (inside and/or outside) and detect building environmental sensor devices that are installed in the environment. For each of the sensor devices, in response to detecting the sensor device, the system will retrieve an identifier for the sensor device, and it will determine whether the sensor device is registered with a control system. If the sensor device is registered with the control system, the system will not automatically implement a commissioning process with the sensor device. If the sensor device is not registered with the control system, the system will automatically implement the commissioning process with the sensor device.

Claims (214)

1. A system for commissioning building environmental sensors, the system comprising:

a portable electronic device comprising a processor, a receiver, and a non-transitory computer-readable medium containing programming instructions that are configured to cause the processor to, as the portable electronic device moves about an environment:

detect, via the receiver, each of a plurality of building environmental sensor devices that are installed in the environment;

for each of the sensor devices, in response to detecting the sensor device:

determine an identifier for the sensor device,

determine whether the sensor device is registered with a control system,

if the sensor device is registered with the control system, determine whether the sensor device requires re-commissioning,

in response to determining that the sensor device requires recommissioning, implement a commissioning process with the sensor device, and

if the sensor device is not registered with the control system, automatically implement the commissioning process with the sensor device.

2. The system of claim 1 , wherein the instructions to automatically implement the commissioning process comprise instructions to:

determine a location of the sensor device; and

send the location and the identifier to the control system.

3. The system of claim 1 , wherein the instructions to implement the commissioning process further comprise instructions to:

identify a token from the control system that the sensor device can use to communicate with the control system via a wireless network; and

transfer the token to the sensor device.

4. The system of claim 1 , wherein:

the receiver comprises a camera; and

the instructions to detect each of the building environmental sensor devices comprise instructions to:

analyze images captured by the camera to recognize codes in the images, wherein the codes comprise one or more of the following: two-dimensional bar codes, three-dimensional bar codes, or alphanumeric codes, and

upon detection of one of the codes, parse the detected code to extract the identifier for the sensor device from the detected code.

5. The system of claim 1 , wherein:

the receiver comprises a camera; and

the instructions to detect each of the building environmental sensor devices comprise instructions to analyze images captured by the camera to identify an object that is a sensor device in the images.

6. The system of claim 1 , wherein:

the receiver comprises a camera;

the system comprises a wearable augmented reality device comprising a see-through display; and

the instructions to detect the building environmental sensor devices comprise instructions to:

cause the camera to capture the images to correspond to a field of view of the see-through display in real time as the wearable augmented reality device is moved through the environment, and

determine whether any of the sensor devices appear in the field of view of the see-through display in real time.

7. The system of claim 1 , wherein:

the instructions to detect each of the building environmental sensor devices comprise instructions to:

analyze signals received via the receiver, wherein the signals comprise one or more of the following: radio frequency signals, near-field communication signals, or optical signals; and

upon detection of one of the signals, parse the detected signal to extract the identifier for the device from the detected signal.

8. The system of claim 2 , wherein the instructions to determine the location of the sensor device comprise instructions to perform one or more of the following:

receive images from a camera of the system, process the images to recognize a known landmark in the images, access a map of the environment, and determine the location to correspond to a place of the known landmark in the map;

receive images from the camera, output the images on a display of the portable electronic device or of a remote control system, and receive the location via a user interface of the portable electronic device or of the remote control system; or

receive signals from a plurality of beacons in the environment in which the system is moving, and use a triangulation process to process the signals and yield the location.

9. The system of claim 1 , wherein the instructions to implement the commissioning process further comprise instructions to:

detect, via an environmental sensor of the portable electronic device, a first value of an environmental parameter;

query the sensor device for a second value of the environmental parameter as detected by a component of sensing device;

compare the first value and the second value to determine whether the first and second values match; and

in response to determining that the first and second values do not match, determining that the sensor device requires calibration.

10. The system of claim 1 , wherein the system comprises a mobile robotic device.

11. The system of claim 2 , wherein the instructions to determine the location comprise instructions to implement a simultaneous localization and mapping algorithm as the portable electronic device moves about the environment.

12. The system of claim 1 , wherein the instructions to automatically implement the commissioning process with the sensor device further comprise instructions to:

determine one or more configuration parameters for the sensor device; and

transmit the one or more configuration parameters to the sensor device.

13. The system of claim 1 , further comprising instructions to, for each of the sensor devices, in response to detecting the sensor device:

query the sensor device for a battery level report;

analyze a signal received from the sensor device in response to the query; and

when the signal indicates that a battery level of the sensor device is below a threshold, generate an alert.

14. The system of claim 1 , wherein the instructions to determine whether the sensor device requires re-commissioning comprises determining one or more of the following:

determining whether the sensor device was last commissioned more than a threshold period of time ago;

determining whether the sensor device received a software or firmware update since the sensor device was last commissioned;

determining whether the sensor device received maintenance since the sensor device was last commissioned; or

determining whether the sensor device has been moved to a new location.

15. A method of commissioning building environmental sensors, the method comprising:

by an electronic device comprising a processor and a receiver, as the electronic device moves about an environment:

detecting, via the receiver, each of a plurality of building environmental sensor devices that are installed in the environment;

for each of the sensor devices, in response to detecting the sensor device:

retrieve an identifier for the sensor device,

determine whether the sensor device is registered with a control system,

if the sensor device is registered with the control system, determine whether the sensor device requires re-commissioning,

in response to the sensor device requiring recommissioning, implement a commissioning process with the sensor device, and

if the sensor device is not registered with the control system, automatically implementing the commissioning process with the sensor device.

16. The method of claim 15 , wherein automatically implementing the commissioning process comprises one or more of the following, for each sensor:

sending a location of the sensor device and the identifier to the control system;

transferring, to the sensor device, a token that the sensor device can use to communicate with the control system via a wireless network;

transferring one or more or configuration parameters to the sensor device;

determining whether the sensor device requires calibration by:

using an environmental sensor of the electronic device to detect a first value of an environmental parameter,

querying the sensor device for a second value of the environmental parameter as detected by a component of the sensor device,

comparing the first value and the second value to determine whether the first and second values match, and

when the first and second values do not match, determining that the sensor device requires calibration.

17. The method of claim 15 , wherein:

the receiver comprises a camera; and

detecting each of the building environmental sensor devices comprises:

analyzing images captured by the camera to recognize codes that correspond to sensors in the images, wherein the codes comprise one or more of the following: two-dimensional bar codes, three-dimensional bar codes, or alphanumeric codes, or

analyzing images captured by the camera to identify an object that is a sensor in the images.

18. The method of claim 15 , further comprising determining a location of the sensor device by performing one or more of the following:

receiving images from a camera of the electronic device, processing the images to recognize a known landmark in the images, accessing a map of the environment, and determining the location to correspond to a place of the known landmark in the map;

receiving images from the camera, outputting the images on a display of the electronic device or of a remote control system, and receiving the location via a user interface of the electronic device or of the remote control system;

receiving signals from a plurality of beacons in the environment in which the electronic device is moving, and using a triangulation process to process the signals and yield the location; or

implementing a simultaneous localization and mapping algorithm in an autonomous mobile robotic device that caries the camera as the autonomous mobile robotic device moves about the environment.

19. The method of claim 15 further comprising, by the electronic device:

querying the sensor device for a battery level report;

analyzing a signal received from the sensor device in response to the querying; and

when the signal indicates that a battery level of the sensor device is below a threshold, generating an alert.

20. The method of claim 15 , wherein:

determining whether the sensor device requires re-commissioning comprises:

determining whether the sensor device was last commissioned more than a threshold period of time ago,

determining whether the sensor device received a software or firmware update since the sensor device was last commissioned,

determining whether the sensor device received maintenance since the sensor device was last commissioned, or

determining whether the sensor device has been moved to a new location.

21. A system for commissioning building environmental sensors, the system comprising:

a portable electronic device comprising a processor, a camera, a wearable augmented-reality device comprising a see-through display and a non-transitory computer-readable medium containing programming instructions that are configured to cause the processor to, as the portable electronic device moves about an environment:

cause the camera to capture images corresponding to a field of view of the see-through display in real time as the wearable augmented-reality device is moved through the environment;

detect each of a plurality of building environmental sensor devices that are installed in the environment by determining whether any of the sensor devices appear in the field of view of the see-through display in real time;

for each detected sensor device:

determine an identifier for the sensor device,

determine whether the sensor device is registered with a control system,

if the sensor device is registered with the control system, do not automatically implement a commissioning process with the sensor device, and

if the sensor device is not registered with the control system, automatically implement the commissioning process with the sensor device.

22. The system of claim 21 , wherein the instructions to automatically implement the commissioning process comprise instructions to:

determine a location of the sensor device; and

send the location and the identifier to the control system.

23. The system of claim 21 , wherein the instructions to implement the commissioning process further comprise instructions to:

identify a token from the control system that the sensor device can use to communicate with the control system via a wireless network; and

transfer the token to the sensor device.

24. The system of claim 21 , wherein the instructions to determine the identifier for the sensor device comprise instructions to:

analyze images captured by the camera to recognize codes in the images, wherein the codes comprise one or more of the following: two-dimensional bar codes, three-dimensional bar codes, or alphanumeric codes, and

upon detection of one of the codes, parse the detected code to extract the identifier for the sensor device from the detected code.

25. The system of claim 22 , wherein the instructions to determine the location of the sensor device comprise instructions to perform one or more of the following:

process images from the camera to recognize a known landmark in the images, access a map of the environment, and determine the location to correspond to a place of the known landmark in the map;

receive images from the camera, output the images on a display of the portable electronic device or of a remote control system, and receive the location via a user interface of the portable electronic device or of the remote control system; or

receive signals from a plurality of beacons in the environment in which the system is moving, and use a triangulation process to process the signals and yield the location.

26. The system of claim 21 , wherein the instructions to implement the commissioning process further comprise instructions to:

detect, via an environmental sensor of the portable electronic device, a first value of an environmental parameter;

query the sensor device for a second value of the environmental parameter as detected by a component of sensing device;

compare the first value and the second value to determine whether the first and second values match; and

in response to determining that the first and second values do not match, determining that the sensor device requires calibration.

27. The system of claim 22 , wherein the instructions to determine the location comprise instructions to implement a simultaneous localization and mapping algorithm as the portable electronic device moves about the environment.

28. The system of claim 21 , wherein the instructions to automatically implement the commissioning process with the sensor device further comprise instructions to:

determine one or more configuration parameters for the sensor device; and

transmit the one or more configuration parameters to the sensor device.

29. The system of claim 21 , further comprising instructions to, for each of the sensor devices, in response to detecting the sensor device:

query the sensor device for a battery level report;

analyze a signal received from the sensor device in response to the query; and

when the signal indicates that a battery level of the sensor device is below a threshold, generate an alert.

30. A system for commissioning building environmental sensors, the system comprising:

a portable electronic device comprising a processor, a receiver, and a non-transitory computer-readable medium containing programming instructions that are configured to cause the processor to, as the portable electronic device moves about an environment:

detect, via the receiver, each of a plurality of building environmental sensor devices that are installed in the environment;

for each of the sensor devices, in response to detecting the sensor device:

determine an identifier for the sensor device,

determine whether the sensor device is registered with a control system,

if the sensor device is registered with the control system, do not automatically implement a commissioning process with the sensor device and

if the sensor device is not registered with the control system, automatically implement the commissioning process with the sensor device by:

determining a location of the sensor device by performing one or more of the following:

receiving images from a camera of the system, processing the images to recognize a known landmark in the images, accessing a map of the environment, and determining the location to correspond to a place of the known landmark in the map;

receiving images from the camera, outputting the images on a display of the portable electronic device or of a remote control system, and receiving the location via a user interface of the portable electronic device or of the remote control system; or

receiving signals from a plurality of beacons in the environment in which the system is moving, and use a triangulation process to process the signals and yield the location; and

send the location and the identifier to the control system.

31. The system of claim 30 , wherein the instructions to implement the commissioning process further comprise instructions to:

identify a token from the control system that the sensor device can use to communicate with the control system via a wireless network; and

transfer the token to the sensor device.

32. The system of claim 30 , wherein the instructions to detect each of the building environmental sensor devices comprise instructions to:

analyze images captured by the camera to recognize codes in the images, wherein the codes comprise one or more of the following: two-dimensional bar codes, three-dimensional bar codes, or alphanumeric codes, and

upon detection of one of the codes, parse the detected code to extract the identifier for the sensor device from the detected code.

33. The system of claim 30 , wherein:

the receiver comprises a camera; and

the instructions to detect each of the building environmental sensor devices comprise instructions to analyze images captured by the camera to identify an object that is a sensor device in the images.

34. The system of claim 30 , wherein:

the instructions to detect each of the building environmental sensor devices comprise instructions to:

analyze signals received via the receiver, wherein the signals comprise one or more of the following: radio frequency signals, near-field communication signals, or optical signals; and

upon detection of one of the signals, parse the detected signal to extract the identifier for the device from the detected signal.

35. The system of claim 30 , wherein the instructions to implement the commissioning process further comprise instructions to:

detect, via an environmental sensor of the portable electronic device, a first value of an environmental parameter;

query the sensor device for a second value of the environmental parameter as detected by a component of sensing device;

compare the first value and the second value to determine whether the first and second values match; and

in response to determining that the first and second values do not match, determining that the sensor device requires calibration.

36. The system of claim 30 , wherein the system comprises a mobile robotic device.

37. The system of claim 30 , wherein the instructions to determine the location comprise instructions to implement a simultaneous localization and mapping algorithm as the portable electronic device moves about the environment.

38. The system of claim 30 , wherein the instructions to automatically implement the commissioning process with the sensor device further comprise instructions to:

determine one or more configuration parameters for the sensor device; and

transmit the one or more configuration parameters to the sensor device.

39. The system of claim 30 , further comprising instructions to, for each of the sensor devices, in response to detecting the sensor device:

query the sensor device for a battery level report;

analyze a signal received from the sensor device in response to the query; and

when the signal indicates that a battery level of the sensor device is below a threshold, generate an alert.

40. The system of claim 30 , wherein the instructions further comprise instruction to, when the system determines that the sensor device is registered with the control system:

determine whether the sensor device requires re-commissioning by one or more of the following:

determining whether the sensor device was last commissioned more than a threshold period of time ago;

determining whether the sensor device received a software or firmware update since the sensor device was last commissioned;

determining whether the sensor device received maintenance since the sensor device was last commissioned; or

determining whether the sensor device has been moved to a new location; and

when the system determines that the sensor device requires re-commissioning, implementing the commissioning process with the sensor device.

41. A method of commissioning building environmental sensors, the method comprising:

by an electronic device comprising a processor and a receiver, as the electronic device moves about an environment:

detecting, via the receiver, each of a plurality of building environmental sensor devices that are installed in the environment;

determining a location of the sensor device by performing one or more of the following:

receiving images from a camera of the electronic device, processing the images to recognize a known landmark in the images, accessing a map of the environment, and determining the location to correspond to a place of the known landmark in the map;

receiving images from the camera, outputting the images on a display of the electronic device or of a remote control system, and receiving the location via a user interface of the electronic device or of the remote control system; or

receiving signals from a plurality of beacons in the environment in which the electronic device is moving, and using a triangulation process to process the signals and yield the location; and

for each of the sensor devices, in response to detecting the sensor device:

retrieve an identifier for the sensor device,

determine whether the sensor device is registered with a control system,

if the sensor device is registered with the control system, do not automatically implement a commissioning process with the sensor device, and

if the sensor device is not registered with the control system, automatically implement the commissioning process with the sensor device.

42. The method of claim 41 , wherein automatically implementing the commissioning process comprises one or more of the following, for each sensor:

sending the location of the sensor device and the identifier to the control system;

transferring, to the sensor device, a token that the sensor device can use to communicate with the control system via a wireless network;

transferring one or more or configuration parameters to the sensor device;

determining whether the sensor device requires calibration by:

using an environmental sensor of the electronic device to detect a first value of an environmental parameter,

querying the sensor device for a second value of the environmental parameter as detected by a component of the sensor device,

comparing the first value and the second value to determine whether the first and second values match, and

when the first and second values do not match, determining that the sensor device requires calibration.

43. The method of claim 41 , wherein:

the receiver comprises a camera; and

detecting each of the building environmental sensor devices comprises:

analyzing images captured by the camera to recognize codes that correspond to sensors in the images, wherein the codes comprise one or more of the following: two-dimensional bar codes, three-dimensional bar codes, or alphanumeric codes, or

analyzing images captured by the camera to identify an object that is a sensor in the images.

44. The method of claim 41 , wherein determining the location of the sensor device further comprises implementing a simultaneous localization and mapping algorithm in an autonomous mobile robotic device that caries the camera as the autonomous mobile robotic device moves about the environment.

45. The method of claim 41 , further comprising, by the electronic device:

querying the sensor device for a battery level report;

analyzing a signal received from the sensor device in response to the querying; and

when the signal indicates that a battery level of the sensor device is below a threshold, generating an alert.

46. The method of claim 41 , further comprising, by the electronic device upon determining that the sensor device is registered:

determining whether the sensor device requires re-commissioning by:

determining whether the sensor device was last commissioned more than a threshold period of time ago,

determining whether the sensor device received a software or firmware update since the sensor device was last commissioned,

determining whether the sensor device received maintenance since the sensor device was last commissioned, or

determining whether the sensor device has been moved to a new location; and

when the electronic device determines that the sensor device requires re-commissioning, implementing the commissioning process with the sensor device.

Assignments (7)
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVAL OF US PATENTS 9356603, 10026651, 10626048 AND INCLUSION OF US PATENT 7167871 PREVIOUSLY RECORDED ON REEL 064038 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 28, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064161/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064038/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2021
From: SCHWARTZ, DAVID ERIC; FAUTLEY, PALOMA JUANITA; COCKER, ERIC DAVID; JACKSON, WARREN
To: PALO ALTO RESEARCH CENTER INCORPORATED
Reel/Frame 057201/0645 →