IP Library Granted Patent US 12,216,464
Granted Patent B2
US 12,216,464 · App. 17/746,613 · Granted Feb 4, 2025

Augmented reality system for diagnosing system operation

Inventor: James Junior Nkhata (Leicestershire, GB)
Assignee: HONEYWELL INTERNATIONAL INC.
G05B23/0272G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,216,464
App. No.
17/746,613
Filed
May 17, 2022
Granted
Feb 4, 2025
Kind
B2
Examiner
DESTA, ELIAS
Art Unit
2857
USPC
702/185
Abstract

A camera of a mobile device may be used to capture an image of at least part of a component. The component is identified based at least in part on the captured image. Once the component has been identified, the mobile device communicates with a remote server to receive one or more real-time electrical parameter values that correspond to the component. A diagnostic image of the component is displayed on a display of the mobile device, the diagnostic image showing one or more wiring terminals of the component. One or more of the real-time electrical parameter values received from the remote server are superimposed on the diagnostic image, wherein each of the one or more real-time electrical parameter values that is superimposed is positioned adjacent to the corresponding one or more of the wiring terminals.

Claims (38)

1. A method of using a mobile device for diagnosing a system, the mobile device including a display and a camera, the system including a component having a plurality of wiring terminals for wiring the component to one or more other components of the system, the system configured to identify and report to a remote server one or more real-time electrical parameter values that each correspond to one or more of the wiring terminals of the component, the method comprising:

using the camera of the mobile device to capture an image of at least part of the component;

identifying the component based at least in part on the captured image;

once the component has been identified, the mobile device communicating with the remote server to receive one or more real-time electrical parameter values that correspond to the component;

displaying a diagnostic image of the component on the display of the mobile device, the diagnostic image showing one or more wiring terminals of the component; and

superimposing on the diagnostic image one or more of the real-time electrical parameter values received from the remote server, wherein each of the one or more real-time electrical parameter values that is superimposed is positioned adjacent to the corresponding one or more of the wiring terminals.

2. The method of claim 1 , wherein using the camera of the mobile device to capture the image of at least part of the component includes capturing an image of a unique identifier displayed on the component.

3. The method of claim 2 , wherein the unique identifier comprises a bar code, a QR code and/or an alphanumeric identifier code.

4. The method of claim 1 , wherein the diagnostic image comprises a video frame of a real-time video stream, and the method includes repeating the display and superimposing steps over a plurality of video frames.

5. The method of claim 1 , wherein the system comprises a security system, and the component comprises a security component of the security system.

6. The method of claim 1 , wherein at least one of the real-time electrical parameter values comprises a real-time resistance value.

7. The method of claim 1 , wherein at least one of the real-time electrical parameter values comprises a real-time voltage value.

8. The method of claim 1 , wherein at least one of the real-time electrical parameter values comprises a real-time current value.

9. The method of claim 1 , further comprising:

applying a filter to the real-time electrical parameter values using filter criteria; and

superimpose only the real-time electrical parameter values that meet the filter criteria.

10. The method of claim 9 , further comprising allowing a user to change the filter criteria.

11. The method of claim 1 , further comprising:

identifying an access level of a user;

identifying the real-time electrical parameter values that are available to the user based on the access level of the user; and

superimpose only the real-time electrical parameter values that are available to the user.

12. A method of using a mobile device for diagnosing a system, the mobile device including a display and a camera, the system including a component having a plurality of wiring terminals for wiring the component to one or more other components of the system, the method comprising:

identifying the component to the mobile device;

once the component has been identified to the mobile device, the mobile device requesting and receiving one or more electrical parameter values that each correspond to one or more of the wiring terminals of the component;

displaying a diagnostic image of the component on the display of the mobile device, the diagnostic image including one or more wiring terminals of the component; and

superimposing on the diagnostic image one or more of the electrical parameter values, wherein each of the one or more electrical parameter values is superimposed adjacent to the corresponding one or more of the wiring terminals.

13. The method of claim 12 , wherein at least one of the electrical parameter values comprises a real-time resistance value.

14. The method of claim 12 , wherein at least one of the electrical parameter values comprises a real-time voltage value.

15. The method of claim 12 , wherein at least one of the electrical parameter values comprises a real-time current value.

16. The method of claim 12 , wherein the mobile device requests and receives the one or more electrical parameter values that each correspond to one or more of the wiring terminals of the component from a remote server.

17. The method of claim 12 , wherein the mobile device requests and receives the one or more electrical parameter values that each correspond to one or more of the wiring terminals of the component from the component via a wired or wireless connection with the component.

18. The method of claim 12 , wherein the mobile device requests and receives the one or more electrical parameter values that each correspond to one or more of the wiring terminals of the component from another component of the system.

19. A method of using a mobile device for diagnosing a system, the mobile device including a display and a camera, the system including a component having a plurality of wiring terminals for wiring the component to one or more other components of the system, the method comprising:

identifying the component to the mobile device;

once the component has been identified to the mobile device, the mobile device requesting and receiving one or more real-time electrical parameter values that each correspond to one or more of the wiring terminals of the component; and

displaying an augmented reality video feed captured by the camera of the mobile device on the display of the mobile device, the augmented reality video feed showing one or more wiring terminals of the component with one or more of the real-time electrical parameter values superimposed adjacent to the corresponding one or more of the wiring terminals.

20. The method of claim 19 , further comprising:

superimposing a real-time status of one or more sub-components of the component in the augmented reality video feed, wherein the real-time status is superimposed adjacent to a corresponding sub-component in the augmented reality video feed.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2022
From: NKHATA, JAMES JUNIOR
To: HONEYWELL INTERNATIONAL INC.
Reel/Frame 059935/0768 →
Continuity (1)
Related Publication 20230376025A1 · Nov 23, 2023
References Cited (12)
US 7649450B2 · Campion, Jr. et al. · 2010 [cited by applicant]
US 8830267B2 · Brackney · 2014 [cited by applicant]
US 9846996B1 · Moore · 2017 [cited by examiner]
US 10297129B2 · Piccolo, III · 2019 [cited by applicant]
US 20130301875A1 · Schumacher · 2013 [cited by examiner]
US 20170310541A1 · Jin · 2017 [cited by applicant]
US 20200394900A1 · Lontka et al. · 2020 [cited by applicant]
US 20210248732A1 · Poluri et al. · 2021 [cited by applicant]
CA 2895373A1 · 2016 [cited by applicant]
KR 1409964B1 · 2014 [cited by applicant]
WO 2020168379A1 · 2020 [cited by applicant]
Executed European Search Report, European Patent Office, EP Application No. 23171598.8, Sep. 28, 2023 (9 pages). [cited by applicant]