IP Library › Granted Patent US 11,887,365
Granted Patent B2
US 11,887,365 · App. 17/138,058 · Granted Jan 30, 2024

Method for producing and replaying courses based on virtual reality and system thereof

Inventors: Yao-Han Yen (Taoyuan, TW); Wen-Hsin Lo (Taoyuan, TW)
Assignee: DELTA ELECTRONICS, INC.
G06V20/20A63F13/212A63F13/45G02B27/0172G06F18/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,887,365
App. No.
17/138,058
Granted
Jan 30, 2024
Kind
B2
Abstract

A method for producing and replaying courses based on virtual reality is provided. The method is used in an electronic device and the method includes steps of: receiving a 3D model; generating a model data package corresponding to the 3D model according to the 3D model, wherein the model data package at least includes several objects applied to the 3D model; recording, by several virtual cameras, actions of a user who manipulates the objects in virtual reality, and generating action videos corresponding to the objects; and generating a course data package, wherein the course data package includes the model data package and an animation package including action videos.

Claims (46)

1. A method for producing and replaying courses based on virtual reality, used in an electronic device, comprising steps of:

receiving, by a processor of the electronic device, a 3D model;

generating, by the processor, a model data package according to the 3D model, wherein the model data package at least comprises a plurality of objects applied to the 3D model;

capturing, by a plurality of virtual cameras, an image of actions performed by a user who manipulates the objects in virtual reality, and generating action videos corresponding to the objects;

generating, by the processor, a course data package, wherein the course data package comprises the model data package and an animation package comprising action videos;

loading, by the processor, the course data package; and

playing, by the processor, the animation package comprised in the course data package to replay the actions of the user manipulating the objects in virtual reality.

2. The method for producing and replaying courses based on virtual reality as claimed in claim 1 , wherein the objects are classified into pure collision objects, base objects, extraction objects, physical objects, penetrating objects, and physical objects with gravity ignored.

3. The method for producing and replaying courses based on virtual reality as claimed in claim 1 , wherein the virtual cameras record coordinate rotation information and displacement information of the objects through a time difference.

4. The method for producing and replaying courses based on virtual reality as claimed in claim 1 , wherein after recording the actions of the user who manipulates the objects in virtual reality, the method further comprises steps of:

determining whether the objects move;

marking the action videos with time stamps when an object moves; and

storing the action videos marked with time stamps.

5. The method for producing and replaying courses based on virtual reality as claimed in claim 1 , wherein the step of playing the animation package comprised in the course data package further comprises steps of:

putting the animation package comprising the action videos into an object pool;

determining whether an action frame of the action videos has the same first object as an action frame to be played; and

reserving the first object of the action frame in the object pool when the action frame and the action frame to be played have the same first object.

6. The method for producing and replaying courses based on virtual reality as claimed in claim 1 , further comprising a step of:

creating virtual reality with a Unity3D engine.

7. The method for producing and replaying courses based on virtual reality as claimed in claim 6 , wherein the course data package is an AssetBundle file.

8. The method for producing and replaying courses based on virtual reality as claimed in claim 1 , wherein the animation package comprises at least one audio file, a preloaded object-and-animation matching file, animation information corresponding to the objects, a screenshot of the animation package or combination thereof.

9. The method for producing and replaying courses based on virtual reality as claimed in claim 1 , wherein the electronic device is a head-mounted display (HMD) device.

10. A system for producing and replaying courses based on virtual reality, comprising:

one or more processors; and

one or more computer storage media for storing one or more computer-readable instructions, wherein the processor is configured to drive the computer storage media to execute the following tasks of:

receiving a 3D model;

generating a model data package according to the 3D model, wherein the model data package at least comprises a plurality of objects applied to the 3D model;

capturing, by a plurality of virtual cameras, an image of actions performed by a user who manipulates the objects in virtual reality, and generating action videos corresponding to the objects;

generating a course data package, wherein the course data package comprises the model data package and an animation package comprising action videos;

loading the course data package; and

playing the animation package comprised in the course data package to replay the actions of the user manipulating the objects in virtual reality.

11. The system for producing and replaying courses based on virtual reality as claimed in claim 10 , wherein the objects are classified into pure collision objects, base objects, extraction objects, physical objects, penetrating objects, and physical objects with gravity ignored.

12. The system for producing and replaying courses based on virtual reality as claimed in claim 10 , wherein the virtual cameras record coordinate rotation information and displacement information of the objects through a time difference.

13. The system for producing and replaying courses based on virtual reality as claimed in claim 10 , wherein after recording the actions of the user who manipulates the objects in virtual reality, the processor further executes the following tasks of:

determining whether the objects move;

marking the action videos with time stamps when an object moves; and

storing the action videos marked with time stamps.

14. The system for producing and replaying courses based on virtual reality as claimed in claim 10 , wherein the task of playing the animation package comprised in the course data package further comprises tasks of:

putting the animation package comprising the action videos into an object pool;

determining whether an action frame of the action videos has the same first object as an action frame to be played; and

reserving the first object of the action frame in the object pool when the action frame and the action frame to be played have the same first object.

15. The system for producing and replaying courses based on virtual reality as claimed in claim 10 , wherein the processor further executes the following task of:

creating virtual reality with a Unity3D engine.

16. The system for producing and replaying courses based on virtual reality as claimed in claim 15 , wherein the course data package is an AssetBundle file.

17. The system for producing and replaying courses based on virtual reality as claimed in claim 10 , wherein the animation package comprises at least one audio file, a preloaded object-and-animation matching file, animation information corresponding to the objects, a screenshot of the animation package or combination thereof.

18. The system for producing and replaying courses based on virtual reality as claimed in claim 10 , wherein the electronic device is a head-mounted display (HMD) device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2021
From: YEN, YAO-HAN; LO, WEN-HSIN
To: DELTA ELECTRONICS, INC.
Reel/Frame 054827/0600 →
Continuity (2)
Provisional Application 63040215 · Jun 17, 2020
Related Publication 20210394046A1 · Dec 23, 2021