IP Library Patent Application 18147991
Patent Application
App. No. 18/147,991

METHOD AND SYSTEM FOR CREATING AND STORING MAP TARGET

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/147,991
Abstract

A method of creating and storing a map target according to one embodiment of the present disclosure, which creates and stores the map target through a map target application executed by at least one processor of a mobile terminal, includes: creating a 3D map based on an image obtained by photographing a 3D space; determining an authoring space in which a virtual object authoring work is to be performed based on the created 3D map; setting reference coordinates based on a target object in the determined authoring space; providing a virtual object authoring interface for performing the virtual object authoring work based on the set reference coordinates; and mapping a virtual object authored through the provided virtual object authoring interface to the target object and storing the virtual object mapped to the target object.

Claims (49)

1 . A method of creating and storing a map target through a map target application executed by at least one processor of a mobile terminal, the method comprising:

creating a 3D map based on an image obtained by photographing a 3D space;

determining an authoring space in which a virtual object authoring work is to be performed based on the created 3D map;

setting reference coordinates based on a target object in the determined authoring space;

providing a virtual object authoring interface for performing the virtual object authoring work based on the set reference coordinates; and

mapping a virtual object authored through the provided virtual object authoring interface to the target object and storing the virtual object mapped to the target object,

wherein the setting of the reference coordinates based on the target object in the authoring space includes:

when the target object is a marker, reading a default coordinate system matching the marker and setting the read default coordinate system as the reference coordinates; and

when the target object is a pixel, detecting a normal vector corresponding to the pixel and determining a Z-axis of the reference coordinates based on the detected normal vector, and determining a X-axis and a Y-axis of the reference coordinates based on the determined Z-axis,

wherein the determining of the X-axis and the Y-axis of the reference coordinates based on the determined Z-axis includes determining the X-axis and Y-axis of the reference coordinates with default X-axis and Y-axis matching the Z-axis, or determining the X-axis and Y-axis of the reference coordinates with preset X-axis and Y-axis depending on a point of viewing the authoring space,

wherein the setting of the reference coordinates based on the target object in the authoring space further includes providing a modification interface for changing at least one of an origin and an axis of the reference coordinates set based on the target object according to a user's input, and

wherein the providing of the modification interface includes providing a modification interface for changing at least one of the X-axis and the Y-axis of the reference coordinates in a state in which the Z-axis of the reference coordinates is fixed.

2 . The method of claim 1 , further comprising:

acquiring a target shooting image obtained by photographing the 3D space;

detecting the target object in the acquired target shooting image; and

augmenting and displaying a virtual object mapped to the detected target object on the target shooting image.

3 . The method of claim 1 , wherein the 3D map includes at least one of a point cloud map image representing the 3D space based on a plurality of feature points detected from an image captured by photographing the 3D space, a frame image that is an image corresponding to the point cloud map image, and a point cloud frame image obtained by combining the point cloud map image and the frame image.

4 . The method of claim 3 , wherein the determining of the authoring space in which the virtual object authoring work is to be performed includes:

setting the authoring space based on a user's input based on at least one of the point cloud map image and the frame image; and

extracting an authoring space image representing the set authoring space.

5 . The method of claim 4 , wherein the authoring space image includes a plurality of feature points in the point cloud map image corresponding to the authoring space image and descriptor information for each of the feature points.

6 . The method of claim 5 , wherein the setting of the reference coordinates based on the target object in the authoring space includes:

detecting a marker in the authoring space image as the target object; and

setting a preset coordinate system for the detected marker as the reference coordinates.

7 . The method of claim 5 , wherein the setting of the reference coordinates based on the target object in the authoring space includes:

acquiring a user's input that selects at least one pixel in the authoring space image as the target object;

setting a center point of the at least one selected pixel as the origin of the reference coordinates; and

setting the Z-axis of the reference coordinates by detecting the normal vector for the at least one pixel based on the descriptor corresponding to the selected at least one pixel.

8 . The method of claim 1 , further comprising:

mapping and storing the virtual object authored through the provided virtual object authoring interface to 3D spatial coordinates of the 3D map;

acquiring a target shooting image obtained by photographing the 3D space;

detecting the 3D spatial coordinates in the acquired target shooting image; and

augmenting and displaying a virtual object mapped to the detected 3D spatial coordinates on the target shooting image.

9 . A system for creating and storing a map target, the system comprising:

at least one display for outputting a 3D map;

at least one memory;

at least one processor; and

at least one application stored in the memory and executed by the processor to create and store a map target,

wherein the at least one application is operated to:

create a 3D map based on an image of a 3D space;

determine an authoring space in which a virtual object authoring work is to be performed based on the created 3D map;

set reference coordinates based on a target object in the determined authoring space;

provide a virtual object authoring interface for performing the virtual object authoring work based on the set reference coordinates; and

map a virtual object authored through the provided virtual object authoring interface to the target object and store the virtual object mapped to the target object,

wherein when the target object is a marker, the at least one application reads a default coordinate system matching the marker and setting the read default coordinate system as the reference coordinates,

wherein when the target object is a pixel, the at least one application detects a normal vector corresponding to the pixel and determines a Z-axis of the reference coordinates based on the detected normal vector, and determines a X-axis and a Y-axis of the reference coordinates based on the determined Z-axis,

wherein the at least one application determines the X-axis and Y-axis of the reference coordinates with default X-axis and Y-axis matching the Z-axis, or determining the X-axis and Y-axis of the reference coordinates with preset X-axis and Y-axis depending on a point of viewing the authoring space,

wherein the at least one application provides a modification interface for changing at least one of an origin and an axis of the reference coordinates set based on the target object according to a user's input, and

wherein the at least one application provides a modification interface for changing at least one of the X-axis and the Y-axis of the reference coordinates in a state in which the Z-axis of the reference coordinates is fixed.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2023
From: VIRNECT INC.
To: VIRNECT CO., LTD.
Reel/Frame 064252/0252 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2022
From: KIM, KI YOUNG; PARK, NOH YOUNG
To: VIRNECT INC.
Reel/Frame 062235/0733 →