IP Library Granted Patent US 11,151,799
Granted Patent B2
US 11,151,799 · App. 17/105,238 · Granted Oct 19, 2021

System and method for monitoring field based augmented reality using digital twin

Inventors: Tae Jin Ha (Gimpo-si, KR); Chul Hee Lee (Incheon, KR); Soo Hwan Kim (Seoul, KR); Sung Ha Lee (Incheon, KR); Hye Jeong Nam (Yongin-si, KR); Ho Young Kim (Seoul, KR)
Assignee: VIRNECT INC.
G06T19/006G06K9/00671G06T17/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,151,799
App. No.
17/105,238
Granted
Oct 19, 2021
Kind
B2
Abstract

Provided is a method for monitoring a field based on augmented reality using a digital twin performed in a processor of a computing device of a manager located remotely from a physical space of a field, including: outputting a field twin model of a three-dimensional virtual space matched to the physical space of the field; acquiring location information of a field user for the physical space based on positioning sensor data received from a field sensor system arranged in the field; and displaying a first virtual content representing a location of the field user on the field twin model by matching location information of the field user for the physical space to the three-dimensional virtual space.

Claims (27)

1. A method for monitoring a field based on augmented reality using a digital twin performed in a processor of a computing device of a manager located remotely from a physical space of a field, the method comprising:

outputting a field twin model of a three-dimensional virtual space matched to the physical space of the field;

acquiring location information of a field user for the physical space based on positioning sensor data received from a field sensor system arranged in the field;

displaying a first virtual content representing a location of the field user on the field twin model by matching location information of the field user for the physical space to the three-dimensional virtual space;

requesting augmented reality communication connection with a computing device of the field user through the first virtual content;

performing augmented reality communication with the computing device of the field user according to acceptance of the field user; and

providing an input/output interface for generating a particular virtual content matched to one location of the three-dimensional virtual space based on the field twin model and transmitting the generated particular virtual content as communication data.

2. The method of claim 1 ,

wherein the step of acquiring the location information of the field user for the physical space based on the positioning sensor data further comprises,

acquiring the positioning sensor data acquired by receiving an ultra wide band (UWB) radio signal generated from a tag of the field user by a plurality anchors;

tracking real-time actual coordinates of the physical space for the field user based on the acquired positioning sensor data;

calculating virtual coordinates of the three-dimensional virtual space matched to the actual coordinates; and

displaying the first virtual content representing identification information of the field user on the calculated virtual coordinates.

3. The method of claim 1 , further comprising:

receiving information about a real object arranged in the physical space of the field from the field sensor system arranged in the field; and

overlaying and displaying the received information about the real object on a virtual object matched to the real object of the field twin model.

4. The method of claim 1 , further comprising:

receiving work history information matched to a real object through the computing device of the field user;

storing the received work history information;

matching the received work history information to a virtual object corresponding to the real object; and

displaying a work history virtual content representing the work history information around the virtual object of the field twin model.

5. The method of claim 1 , further comprising:

detecting that the field user enters a real dangerous zone of the physical space corresponding to a predetermined dangerous zone of the field twin model; and

monitoring the field user in the real dangerous zone by the field twin model and a field image received through a camera system arranged in the field.

6. The method of claim 5 , further comprising:

transmitting, to a computing device of the field user, coordinates of the three-dimensional virtual space for the predetermined dangerous zone in the field twin model; and

overlaying and displaying a work history virtual content for highlighting a dangerous area on actual coordinates of the physical space matched to coordinate information of the three-dimensional virtual space in the computing device of the field user.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2023
From: VIRNECT INC.
To: VIRNECT CO., LTD.
Reel/Frame 064252/0252 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 25, 2020
From: HA, TAE JIN; LEE, CHUL HEE; KIM, SOO HWAN; LEE, SUNG HA; NAM, HYE JEONG; KIM, HO YOUNG
To: VIRNECT INC.
Reel/Frame 054473/0017 →
Priority Claims (1)
KR 10-2019-0179249 · Dec 31, 2019 · national
Continuity (1)
Related Publication 20210201584A1 · Jul 1, 2021
Cited By (1)
US 12,523,995