IP Library › Granted Patent US 12,347,297
Granted Patent B2
US 12,347,297 · App. 18/051,341 · Granted Jul 1, 2025

Method and system for AR-based graded management education of laboratory safety risk

Inventors: Zheng Liu (Hangzhou, CN); Zhixiang Zhao (Hangzhou, CN)
Assignee: China Academy of Art
G08B21/0225G06V10/255G06V10/26G06V10/48G06V10/751G06V10/764G06V10/7715G06V10/806G06V20/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,347,297
App. No.
18/051,341
Granted
Jul 1, 2025
Kind
B2
Abstract

A method and system for AR-based graded management education of laboratory safety risk are provided, which includes following steps: collecting laboratory image data and sensor data and obtaining a risk grade matching rule of a laboratory; identifying image feature data of the image data and sensor feature data of the sensor data, converting matched image feature data into a laboratory equipment name and converting matched sensor feature data into an equipment model; inputting the equipment name and a corresponding equipment model and quantity into the risk grade matching rule of the laboratory, and outputting a risk grade of a current laboratory according to the risk grade matching rule of the laboratory; and fusing and matching a AR template image corresponding to the identified and output risk grade and real image information according to preset AR template images for various risk grades, so as to output alarm information.

Claims (65)

1. A method for AR-based graded management education of laboratory safety risk, comprising:

collecting a laboratory image data and a sensor data and obtaining a risk grade matching rule of a laboratory;

identifying an image feature data of the laboratory image data and a sensor feature data of the sensor data, converting the image feature data into a laboratory equipment name after matching and converting the sensor feature data into an equipment model after matching;

inputting the equipment name and a corresponding equipment model and quantity into the risk grade matching rule of the laboratory, and outputting a risk grade of a current laboratory according to the risk grade matching rule of the laboratory; and

according to a present plurality of AR template images for various risk grades, fusing and matching the AR template image corresponding to the identified image feature data and output risk grade to output an alarm information;

wherein identifying the image feature data comprises:

applying a gray threshold T to the laboratory image data using a gray threshold segmentation method, wherein f(x,y) represents a pixel value of a point (x,y) and pixel values of f(x,y) greater than the threshold T are segmented to obtain the segmented image g(x,y); and

by using a Hough transform, selecting any point (a,b) within a shape of the segmented image g(x,y) as a reference point, and

calculating a tangent direction ϕ and an offset vector r to a position of the reference point (a,b) and an included angle α between r and an x axis, from each point on an edge of a graph of an arbitrary shape,

wherein calculating the reference point (a,b) is as follows:

a=x+r (ϕ)cos(α(ϕ))

b=x+r (ϕ)sin(α(ϕ)).

2. The method for AR-based graded management education of laboratory safety risk according to claim 1 , wherein after the feature extraction is completed, a classifier is further configured to classify extracted features, a classification method comprises:

calculating a total number M of classes of current equipment samples, a current sample class extracted from the sample library being wi={1, 2, . . . , M}, a prior probability of the current sample being expressed as P(wi) and a class conditional probability density of the current sample being expressed as P(x|wi); calculating a posterior probability P(wi|x) of the current sample by using a Bayesian formula, a class corresponding to a maximum value of the posterior probability being a final classified class, j representing a subscript of a summation term, n being the total number of classes of the equipment, where the posterior probability P(wi|x) is calculated as follows:

P

⁡

(

w

i

❘

x

)

=

P

⁡

(

x

❘

w

i

)

⁢

P

⁡

(

w

i

)

∑

j

=

0

n

P

⁡

(

x

❘

w

j

)

⁢

P

⁡

(

w

j

)

.

3. The method for AR-based graded management education of laboratory safety risk according to claim 1 , wherein the risk grade matching rule of the laboratory comprises: establishing equipment classes and quantities for various risk grades, calculating equipment classes corresponding to all of the image feature data in a laboratory image identified by a classifier; and if an equipment class identified by the classifier completely cover an equipment class and quantity for a corresponding risk grade, determining that a current laboratory scene is a laboratory matched with covered risk grade rules, and outputting the AR template image corresponding to the risk grade of the laboratory so as to be fused with a real laboratory image.

4. The method for AR-based graded management education of laboratory safety risk according to claim 1 , wherein the risk grade matching rule of the laboratory comprises a decision rule for various priorities, and the decision rule for various priorities comprises: establishing a first priority risk grade rule and a second priority risk grade rule; and if an equipment class and quantity identified in the collected laboratory image data not only cover an equipment class and quantity corresponding to the first priority risk grade rule, but also cover an equipment class and quantity corresponding to the second priority risk grade rule, the first priority risk grade being higher than the second priority risk grade, directly calling an AR template image corresponding to the first priority risk grade to be fused with a real laboratory image.

5. The method for AR-based graded management education of laboratory safety risk according to claim 1 , wherein the risk grade matching rule of the laboratory comprises: collecting the sensor data, setting a risk grade range of sensor values, and if a collected current sensor value is at a corresponding risk grade, and an equipment class and quantity in the image obtained by a classifier match a same risk grade in the grade range where the sensor data is located, directly outputting a corresponding AR module image with a same risk grade to be fused with a real laboratory image.

6. The method for AR-based graded management education of laboratory safety risk according to claim 1 , wherein the risk grade matching rule of the laboratory comprises: collecting the sensor data, setting a risk grade range of sensor values, and if there is difference between a corresponding risk grade where the collected current sensor value is located and a risk grade determined by an equipment class and quantity in the image obtained by a classifier, selecting a risk grade with higher priority to output an AR module image corresponding to the risk grade to be fused with a real laboratory image.

7. A system for AR-based graded management education of laboratory safety risk, wherein the system implements the method for AR-based graded management education of laboratory safety risk according to claim 1 .

8. A non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores a computer program, and the computer program can be executed by a processor to implement the method for AR-based graded management education of laboratory safety risk according to claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2022
From: LIU, ZHENG; ZHAO, ZHIXIANG
To: CHINA ACADEMY OF ART
Reel/Frame 061660/0972 →
Priority Claims (1)
CN 202211193446.1 · Sep 28, 2022 · national
Continuity (1)
Related Publication 20240112558A1 · Apr 4, 2024
References Cited (12)
US 20070104358A1 · Komatsu · 2007 [cited by examiner]
US 20200065584A1 · Lyer · 2020 [cited by examiner]
US 20200117903A1 · Goel · 2020 [cited by examiner]
US 20210216773A1 · Bohannon · 2021 [cited by examiner]
Kim et al., Image-based construction hazard avoidance system using augmented reality in wearable device, 2017, Automation in Construction, 83 (2017): 390-403. (Year: 2017). [cited by examiner]
Song et al., Research on image segmentation algorithm based on threshold, 2021, 13th International Conference on Measuring Technology and Mechatronics Automation, pp. 1-4. (Year: 2021). [cited by examiner]
Wang et al., AR for enhanced visual inspection through knowledge-based deep learning, 2020, Structural Health Monitoring, 20(1): 426-442. (Year: 2020). [cited by examiner]
Selfozzakerini et al., Hough Transform Implementation for Event-Based Systems, 2018, Frontiers in Computational Neuroscience, 2018(12): pp. 1-18. (Year: 2018). [cited by examiner]
Wang et al., Improved Registration Algorithm Based on Double Threshold Feature Extraction and Distance Disparity Matrix, 2022, Sensors, 22(6525): 1-14. (Year: 2022). [cited by examiner]
Nadeem et al., AR-LabOr: Design and Assessment of an Augmented Reality Application for Lab Orientation, 2020, Education Sciences, 10 (316): 1-30. (Year: 2020). [cited by examiner]
Plunkett, Simple and Practical Method for Incorporating Augmented Reality into the Classroom and Laboratory, 2019, J. Chem Edu. (96): 2628-2631. (Year: 2019). [cited by examiner]
Schiano Lo Moriello, On the Suitability of Augmented Reality for Safe Experiments on Radioactive Materials in Physics Educational Applications, 2022, IEEE Digital Object Identifier, (10): 54185-54196. (Year: 2022). [cited by examiner]