IP Library › Granted Patent US 12,225,175
Granted Patent B2
US 12,225,175 · App. 18/050,448 · Granted Feb 11, 2025

Method and apparatus for creating virtual world

Inventors: Soo Mi Choi (Seoul, KR); Jong Won Lee (Seoul, KR); Ho San Kang (Seoul, KR)
Assignee: INDUSTRY ACADEMY COOPERATION FOUNDATION OF SEJONG UNIVERSITY
H04N13/111G06T7/13G06T7/593G06V10/764G06V20/20H04N13/366
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,225,175
App. No.
18/050,448
Granted
Feb 11, 2025
Kind
B2
Abstract

An apparatus for creating a virtual world includes a processor and a memory connected to the processor, in which the memory stores program instructions executed by the processor so as to receive an image of a real space through a device having a stereo camera, collect mesh data for the real space and an object existing in the real space through the image, determine coordinates for first edges of the real space from the mesh data for the real space, select one of a plurality of second edges based on an area of a virtual space defined by each of the plurality of second edges facing a predetermined direction, when there are more first edges of the real space than edges of a polygon preset for the real space, and output a virtual space defined by some of the first edges and the selected one second edge and a virtual object corresponding to the real object recognized in the real space.

Claims (27)

1. An apparatus for creating a virtual world, comprising:

a processor; and

a memory connected to the processor,

wherein the memory stores program instructions executed by the processor to receive an image of a real space through a device having a stereo camera,

collect mesh data for the real space and an object existing in the real space through the image,

determine coordinates for first edges of the real space from the mesh data for the real space,

select one of a plurality of second edges based on an area of a virtual space defined by each of the plurality of second edges facing a predetermined direction, when there are more first edges of the real space than edges of a polygon preset for the real space, and

output a virtual space defined by some of the first edges and the selected one second edge and a virtual object corresponding to the object existing in the real space,

wherein the apparatus is a head-mounted display, and

the program instructions determine coordinates for the first edges by tracking a position of the head-mounted display in the real space through at least two tracking devices disposed in the real space,

wherein in the program instructions, 3D initial coordinates of the head-mounted display are set as an origin point at the center in the real space, and a y-coordinate in the 3D initial coordinates is preset by a user,

wherein a boundary of the real space is defined by x and z coordinates of at least some of the first edges of the real space based on the 3D initial coordinates,

wherein each edge of the preset polygon is disposed in one of quadrants divided into x-axis and y-axis, and the x-axis and z-axis, and

the program instructions calculate an area of a virtual space defined by each of the plurality of second edges positioned within a predetermined angular range on the same axis or the same quadrant, and select one second edge having the largest calculated area.

2. The apparatus for creating the virtual world of claim 1 , wherein the program instructions classify the object existing in the real space in detail through a deep learning model, and output a virtual object corresponding to the classified object in detail.

3. The apparatus for creating the virtual world of claim 1 , wherein the program instructions output an image corresponding to a virtual simulation preset in the virtual space.

4. A method for creating a virtual world in a computing device including a processor and a memory, comprising:

receiving an image of a real space through a device having a stereo camera;

collecting mesh data for the real space and an object existing in the real space through the image;

determining coordinates for first edges of the real space from the mesh data for the real space by tracking a position of the device having the stereo camera in the real space through at least two tracking devices disposed in the real space;

selecting one of a plurality of second edges based on an area of a virtual space defined by each of the plurality of second edges facing a predetermined direction, when there are more first edges of the real space than edges of a polygon preset for the real space; and

outputting a virtual space defined by some of the first edges and the selected one second edge and a virtual object corresponding to the object existing in the real space,

wherein 3D initial coordinates of the device having the stereo camera are set as an origin point at the center in the real space, and a y-coordinate in the 3D initial coordinates is preset by a user, and

the selecting step includes defining a boundary of the real space by x and z coordinates of at least some of the first edges of the real space based on the 3D initial coordinates,

wherein each edge of the preset polygon is disposed in one of quadrants divided into x-axis and y-axis, and the x-axis and z-axis,

the selecting step includes calculating an area of a virtual space defined by each of the plurality of second edges positioned within a predetermined angular range on the same axis or the same quadrant, and selecting one second edge having the largest calculated area.

5. A program stored in a non-transitory computer-readable recording medium for performing the method according to claim 4 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2022
From: CHOI, SOO MI; LEE, JONG WON; KANG, HO SAN
To: INDUSTRY ACADEMY COOPERATION FOUNDATION OF SEJONG UNIVERSITY
Reel/Frame 061572/0290 →
Priority Claims (1)
KR 10-2022-0111872 · Sep 5, 2022 · national
Continuity (1)
Related Publication 20240080427A1 · Mar 7, 2024
References Cited (18)
US 9401044B1 · Kaufman · 2016 [cited by examiner]
US 10725308B1 · Trail · 2020 [cited by examiner]
US 11024079B1 · Chuah · 2021 [cited by examiner]
US 11361513B2 · Lohr et al. · 2022 [cited by applicant]
US 11676351B1 · Yang · 2023 [cited by examiner]
US 20180075648A1 · Moghadam · 2018 [cited by examiner]
US 20180103284A1 · Kubo · 2018 [cited by examiner]
US 20180190022A1 · Zamir · 2018 [cited by examiner]
US 20200342673A1 · Lohr · 2020 [cited by examiner]
US 20210248826A1 · Shriram · 2021 [cited by examiner]
US 20210335034A1 · Bell · 2021 [cited by examiner]
US 20220406026A1 · Marotta · 2022 [cited by examiner]
US 20230377300A1 · Becker · 2023 [cited by examiner]
US 20230401805A1 · Lee · 2023 [cited by examiner]
US 20240080427A1 · Choi · 2024 [cited by examiner]
KR 1020170081964A · 2017 [cited by applicant]
KR 1020200027846A · 2020 [cited by applicant]
KR 1020210154814A · 2021 [cited by applicant]
Cited By (1)
US 12,726,606