IP Library Granted Patent US 11,544,913
Granted Patent B2
US 11,544,913 · App. 17/564,107 · Granted Jan 3, 2023

Method and system for wearable device-based manual providing

Inventor: Tae Jin Ha (Gimpo-si, KR)
Assignee: VIRNECT INC.
G06T19/006G06F3/012G06F3/0483G06V20/64G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,544,913
App. No.
17/564,107
Granted
Jan 3, 2023
Kind
B2
Abstract

A method for providing a manual based on a wearable device according to an embodiment of the present disclosure, as a method for providing an augmented reality (AR)-based manual by a manual application executed by at least one processor of the wearable device, comprises obtaining at least one piece of AR manual content for a first work; and providing the AR manual content by executing the obtained AR manual content, wherein the providing AR manual content includes providing head position AR content that visualizes a head pose describing 3D position and 6 degrees of freedom information of the head of a user who has performed the first work and providing guidance image information that provides guidance on a first process within the first work.

Claims (34)

1. A method for providing an augmented reality (AR)-based manual by a manual application executed by at least one processor of a wearable device, the method comprising:

obtaining at least one piece of AR manual content for a first work; and

providing the AR manual content by executing the obtained AR manual content,

wherein the providing AR manual content includes

providing head position AR content that visualizes a head pose describing 3D position and 6 degrees of freedom information of the head of a user who has performed the first work and

providing guidance image information that provides guidance on a first process within the first work.

2. The method of claim 1 , wherein providing head position AR content includes displaying a first virtual object showing a movement path of the user's head according to the first work and a second virtual object showing a step point on the first virtual object,

wherein the second virtual object is a virtual object showing the head pose of the user at a step where at least one process is performed within the first work.

3. The method of claim 2 , wherein the user includes a producer who creates the AR manual content and a worker who performs work based on the AR manual content, and

the providing guidance image information includes providing the guidance image information when the head pose of the producer coincides with the head pose of the worker within a specific range.

4. The method of claim 2 , further including providing guidance content that guides the position of the step point virtual object of a second process, which is a second step process, when a first process, which is a first step process among a plurality of processes within the first work, is completed.

5. The method of claim 1 , wherein the providing AR manual content further includes providing work motion information corresponding to the first process,

wherein the work motion information is the information tracking the movement of a specific object for the first work, and

the providing work motion information corresponding to the first process includes providing a motion object which is an augmented virtual object that interacts with the movement of the specific object based on the work motion information.

6. The method of claim 5 , wherein, when the 3D coordinates of the motion object fall within an image screen of a worker, the providing work motion information further includes displaying the motion object at a position having coordinate values corresponding to 3D coordinates of the motion object on the image screen of the worker.

7. The method of claim 5 , wherein, when 3D coordinates of the motion object fall outside an image screen of a worker, the providing work motion information further includes displaying the motion object by moving the motion object to a predetermined area within the image screen of the worker.

8. The method of claim 1 , further including creating the AR manual content,

wherein the creating AR manual content includes

executing a process for creating the AR manual content,

obtaining manual basic information providing metadata for the AR manual content, and

generating manual creation parameter information providing basic information required for creating the AR manual content.

9. The method of claim 8 , wherein the generating manual creation parameter information includes at least one or more of generating the head pose, generating the guidance image information, and generating work motion information,

wherein the generating work motion information includes at least one of extracting a specific object within an image screen of a producer and generating the motion object by transforming the extracted object into a 3D object when 3D coordinates of the specific object fall within the image screen of the producer and

generating the motion object by obtaining sensing data for the specific object based on a depth sensor when the 3D coordinates of the specific object fall outside the image screen of the producer.

10. A system for providing a manual based on a wearable device, the system comprising:

a display displaying a virtual object within AR manual content;

at least one or more processors; and

at least one or more memories,

wherein the at least one application, as at least one application that is stored in the memory and provides an AR-based manual by being executed by the at least one or more processors,

obtains at least one piece of AR manual content for a first work;

executes the obtained AR manual content;

provides head position AR content that visualizes a head pose describing the 3D position and 6 degrees of freedom information of the head of a user when the first work is performed based on the executed AR manual content,

provides guidance image information that provides guidance on a first process within the first work based on the AR manual content; and

provides work motion information corresponding to the first process.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2023
From: VIRNECT INC.
To: VIRNECT CO., LTD.
Reel/Frame 064252/0252 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: HA, TAE JIN
To: VIRNECT INC.
Reel/Frame 058494/0523 →
Priority Claims (1)
KR 10-2020-0186435 · Dec 29, 2020 · national
Continuity (1)
Related Publication 20220207839A1 · Jun 30, 2022