IP Library › Granted Patent US 11,681,426
Granted Patent B2
US 11,681,426 · App. 17/508,506 · Granted Jun 20, 2023

Method and program for producing multi reactive video, and generate meta data to make multi reactive video, and analyze into interaction data to understand human act

Inventor: Chui Woo Lee (Seoul, KR)
Assignee: Momenti, Inc.
G06F3/04847G06F3/04883G06F16/743G06V20/46H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,681,426
App. No.
17/508,506
Granted
Jun 20, 2023
Kind
B2
Abstract

Disclosed is a multi-reactive video generating method and program that performs various condition playbacks depending on a user's manipulation, based on a video database (e.g., a basic video) in which a general video or a plurality of image frames are stored. According to an embodiment of the inventive concept, various actions (i.e., reactions) may be applied as the multi-reactive video generation file is played with a general video or a combination of a plurality of image frames.

Claims (53)

1. A multi-reactive video generating method, the method comprising:

obtaining, by a computer, a basic video, wherein the basic video is an original video including a movement of an object to be reactively implemented depending on manipulation of a user;

generating, by the computer, a compressed video based on the basic video, wherein the compressed video includes only a movement of an object to be reactively implemented depending on the manipulation of the user;

receiving, by the computer, a multi-reactive video generation condition, wherein the multi-reactive video generation condition is a plurality of manipulation inputs corresponding to reactions capable of being generated in the compressed video; and

generating a multi-reactive video by applying the generation condition to the compressed video,

wherein the generating of the compressed video includes:

when the basic video includes a first event section and a second event section, which have appearance changes different from each other before and after a specific reference time point, setting a first playback type, in which the first event section is played in a forward direction and then the second event section is continuously played, and a second playback type, in which the first event section is played in the forward direction and then is played in a reverse direction, and

wherein the receiving of the multi-reactive video generation condition includes:

connecting the first playback type to the second playback type by dividing a same user manipulation type into a first manipulation and a second manipulation based on specific reference manipulation intensity, a reference movement length, a reference manipulation speed, or a reference manipulation time length.

2. The method of claim 1 , wherein the generating of the compressed video includes:

deleting an image frame, which is not implemented reactively, from the basic video by dividing a video section or recognizing a similarity between image frames.

3. The method of claim 1 , wherein the generating of the compressed video includes:

when a first basic video and a second basic video, which include the same object as each other, include a movement for a path having the same object,

storing, by the computer, a redundant section video included in one of the first basic video and the second basic video by extracting a section video including a movement of a same path from the first basic video and the second basic video.

4. The method of claim 1 , wherein the generating of the compressed video includes:

when the basic video includes a first section video indicating a movement from a first location to a second location and a second section video indicating a movement from the second location to the first location,

storing, by the computer only the first section video in the compressed video; and

setting the first section video to be played in a reverse direction when a user manipulation of generating a movement of the object from the second location to the first location is entered.

5. The method of claim 1 , wherein the generating the multi-reactive video includes:

when a specific reactive generation condition is satisfied by a user manipulation, setting a specific section video within the compressed video to be output in a specific playback method.

6. The method of claim 1 , wherein the generating the multi-reactive video includes:

connecting a plurality of multi-reactive videos such that a change in a second multi-reactive video is output depending on a user manipulation entered into a first multi-reactive video,

wherein the first multi-reactive video and the second multi-reactive video are set to be simultaneously output on a screen.

7. A non-transitory computer-readable recording medium storing a multi-reactive video generating program, configured to be coupled to computer hardware, the program includes instructions to execute the method of claim 1 .

8. A multi-reactive video generating method, the method comprising:

obtaining, by a computer, a basic video, wherein the basic video is an original video including a movement of an object to be reactively implemented depending on manipulation of a user;

generating, by the computer, a compressed video based on the basic video, wherein the compressed video includes only a movement of an object to be reactively implemented depending on the manipulation of the user;

receiving, by the computer, a multi-reactive video generation condition, wherein the multi-reactive video generation condition is a plurality of manipulation inputs corresponding to reactions capable of being generated in the compressed video; and

generating a multi-reactive video by applying the generation condition to the compressed video,

wherein the generating of the compressed video includes:

when a background region in which a change does not occur is included in a plurality of image frames included in the entire basic video or a specific section video within the basic video, extracting, by the computer, the background region from the basic video or the section video; and

including the background region within only the basic video or an initial frame of the section video and then storing only one or more extraction regions in an image frame, and

wherein the extraction regions are regions in which a change in an object movement occurs in the basic video.

9. The method of claim 8 , wherein the generating of the compressed video includes:

sequentially accumulating, by the computer, an extraction region of each image frame, which is implemented reactively, at each location in a stack structure from an initial frame including both the background region and the extraction regions and generating a compressed video file, and

wherein the generating the multi-reactive video includes:

connecting and storing a user manipulation to each extraction region on the stack structure.

10. The method of claim 9 , wherein, when an extraction region stack is formed in a plurality of regions within an image frame, the multi-reactive video is output by simultaneously extracting a plurality of extraction regions according to a plurality of user manipulations thus input and combining the extracted plurality of extraction regions with the background region.

11. The method of claim 8 , wherein the generating of the compressed video includes:

deleting an image frame, which is not implemented reactively, from the basic video by dividing a video section or recognizing a similarity between image frames.

12. The method of claim 8 , wherein the generating of the compressed video includes:

when a first basic video and a second basic video, which include the same object as each other, include a movement for a path having the same object,

storing, by the computer, a redundant section video included in one of the first basic video and the second basic video by extracting a section video including a movement of a same path from the first basic video and the second basic video.

13. The method of claim 8 , wherein the generating of the compressed video includes:

when the basic video includes a first section video indicating a movement from a first location to a second location and a second section video indicating a movement from the second location to the first location,

storing, by the computer only the first section video in the compressed video; and

setting the first section video to be played in a reverse direction when a user manipulation of generating a movement of the object from the second location to the first location is entered.

14. The method of claim 8 , wherein the generating the multi-reactive video includes:

when a specific reactive generation condition is satisfied by a user manipulation, setting a specific section video within the compressed video to be output in a specific playback method.

15. The method of claim 8 , wherein the generating the multi-reactive video includes:

connecting a plurality of multi-reactive videos such that a change in a second multi-reactive video is output depending on a user manipulation entered into a first multi-reactive video,

wherein the first multi-reactive video and the second multi-reactive video are set to be simultaneously output on a screen.

16. A non-transitory computer-readable recording medium storing a multi- reactive video generating program, configured to be coupled to computer hardware, the program includes instructions to execute the method of claim 8 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2023
From: LEE, CHUL WOO
To: MOMENTI, INC.
Reel/Frame 063561/0107 →
Priority Claims (2)
KR 10-2019-0049071 · Apr 26, 2019 · national
KR 10-2020-0050470 · Apr 27, 2020 · national
Continuity (2)
Continuation PCTKR2020005493 · Apr 27, 2020
Related Publication 20220107724A1 · Apr 7, 2022
Cited By (1)
US 12,741,190