IP Library › Granted Patent US 12,086,335
Granted Patent B2
US 12,086,335 · App. 17/744,415 · Granted Sep 10, 2024

Device, method and program for generating multidimensional reaction-type image, and method and program for reproducing multidimensional reaction-type image

Inventor: Chul Woo Lee (Seoul, KR)
Assignee: Momenti, Inc.
G06F3/041G06F3/048G06T7/00H04N5/93H04N21/42204H04N5/76
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,086,335
App. No.
17/744,415
Granted
Sep 10, 2024
Kind
B2
Abstract

The present disclosure related to a method for playing a multidimensional reaction-type image. The method includes at least: receiving, by a computer, input manipulation to an object from a user; and extracting, by the computer, an image frame matched to a detailed cell corresponding to location information and depth information in a reaction-type image, depending on the location information and the depth information of the input manipulation received at each playback time point. The depth information is information about pressure strength of the input manipulation applied to the reaction-type image or time length to which the input manipulation is applied. The location information is information about a location of a two-dimensional space in which the input manipulation is applied to the reaction-type image.

Claims (54)

1. A method for generating a multidimensional reaction-type image of a computing device, the method comprising:

obtaining, by the computing device, a plurality of multi-dimensional image frames forming a base image, wherein the base image is an image from applying manipulation to an object through a manipulation object;

generating, by the computing device, a three-dimensional cell combination based on a configuration region within the base image and a specific frame density within the configuration region, wherein the three-dimensional cell combination includes a plurality of detailed cells to which different depth information and different location information are assigned; and

generating, by the computing device, a reaction-type image having a multi-dimensional by matching each image frame included in the base image to the corresponding detailed cell;

wherein the depth information includes information about at least one of a pressure strength and a time length of input manipulation applied to the reaction-type image,

wherein the location information includes information about a location of a two-dimensional space in which the input manipulation is applied to the reaction-type image,

wherein the configuration region includes a two-dimensional space area generated as the reaction-type image in the object,

wherein the frame density includes a number of a plurality of multi-dimensional image frames matched to a specific point in the base image, and

wherein the plurality of multi-dimensional image frames are repeatedly obtained while changing the location and the pressure strength at which a manipulation is applied to the object to a specific pattern.

2. The method of claim 1 , further comprising:

calculating a restoration variable of the object by recognizing a change in the base image after the pressure of a specific intensity is applied to the object.

3. The method of claim 1 , wherein the obtaining of the multi-dimensional image frames includes:

extracting a restoration image, which is restored after the input manipulation is applied in an entire image in which the input manipulation is applied to the object through the manipulation object; and

obtaining the plurality of image frames in the restoration image.

4. The method of claim 1 , further comprising:

assigning the configuration region to be generated as the reaction-type image.

5. The method of claim 4 , wherein the assigned configuration region includes at least one of a first region in which a shape change of the object occurs in the base image, a second region including the object that exists in common in the plurality of multi-dimensional image frames in the base image, and a third region including a movement path of the manipulation object.

6. The method of claim 1 , further comprising:

receiving input manipulation to the object from a user; and

extracting an image frame matched to a detailed cell corresponding to location information and depth information in the reaction-type image, based on the location information and the depth information of the input manipulation received at each playback time point,

wherein the detailed cell is matched to a specific image frame corresponding to the location information and the depth information of the input manipulation, and constitutes a three-dimensional cell combination in the reaction-type image.

7. The method of claim 6 , further comprising:

adjusting a speed of change of an image frame by extracting a restoration variable from the reaction-type image.

8. The method of claim 6 , further comprising:

adjusting a change of the image frame according to the input manipulation to the object by calculating time elapsing from a specific time point at which the reaction-type image is executed.

9. The method of claim 6 , further comprising:

when successive input manipulations are entered into an adjacent region, generating a final playback image frame by performing morphing based on a combination of a plurality of image frames having different depth information corresponding to a specific point on the screen, or a combination of an image frame provided at a previous time point and an image frame in a detailed cell corresponding to a current input manipulation.

10. A non-transitory computer readable recording medium storing a program that, when executed by a processor of a computing device, causes the processor to execute the method of claim 1 .

11. A computing device for providing a multidimensional reaction-type image, the computing device comprising:

a memory configured to store a plurality of processes for generating and playing the multidimensional reaction-type image; and

a processor configured to control an operation of the computing device based on the plurality of processes stored in the memory, and

wherein the processor is further configured to:

obtain a plurality of multi-dimensional image frames forming a base image, wherein the base image is an image from applying manipulation to an object through a manipulation object,

generate a three-dimensional cell combination based on a configuration region within the base image and a specific frame density within the configuration region, wherein the three-dimensional cell combination includes a plurality of detailed cells to which different depth information and different location information are assigned, and

generate a reaction-type image having a multi-dimensional by matching each image frame included in the base image to the corresponding detailed cell,

wherein the depth information includes information about at least one of a pressure strength and a time length of input manipulation applied to the reaction-type image,

wherein the location information includes information about a location of a two-dimensional space in which the input manipulation is applied to the reaction-type image,

wherein the configuration region includes a two-dimensional space area generated as the reaction-type image in the object,

wherein the frame density includes a number of a plurality of multi-dimensional image frames matched to a specific point in the base image, and

wherein the plurality of multi-dimensional image frames are repeatedly obtained while changing the location and the pressure strength at which a manipulation is applied to the object to a specific pattern.

12. The computing device of claim 11 , wherein the processor is further configured to calculate a restoration variable of the object by recognizing a change in the base image after the pressure of a specific intensity is applied to the object.

13. The computing device of claim 11 , wherein the processor is further configured to:

extract a restoration image, which is restored after the input manipulation is applied in an entire image in which the input manipulation is applied to the object through the manipulation object, and

obtain the plurality of image frames in the restoration image.

14. The computing device of claim 11 , wherein the processor is further configured to assign the configuration region to be generated as the reaction-type image.

15. The computing device of claim 14 , wherein the assigned configuration region includes at least one of a first region in which a shape change of the object occurs in the base image, a second region including the object that exists in common in the plurality of multi-dimensional image frames in the base image, and a third region including a movement path of the manipulation object.

16. The computing device of claim 11 , wherein the processor is further configured to:

receive input manipulation to the object from a user, and

extract an image frame matched to a detailed cell corresponding to location information and depth information in the reaction-type image, based on the location information and the depth information of the input manipulation received at each playback time point,

wherein the detailed cell is matched to a specific image frame corresponding to the location information and the depth information of the input manipulation, and constitutes a three-dimensional cell combination in the reaction-type image.

17. The computing device of claim 16 , wherein the processor is further configured to adjust a speed of change of an image frame by extracting a restoration variable from the reaction-type image.

18. The computing device of claim 16 , wherein the processor is further configured to adjust a change of the image frame according to the input manipulation to the object by calculating time elapsing from a specific time point at which the reaction-type image is executed.

19. The computing device of claim 16 , wherein the processor is further configured to:

when successive input manipulations are entered into an adjacent region, generate a final playback image frame by performing morphing based on a combination of a plurality of image frames having different depth information corresponding to a specific point on the screen, or a combination of an image frame provided at a previous time point and an image frame in a detailed cell corresponding to a current input manipulation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2023
From: LEE, CHUL WOO
To: MOMENTI, INC.
Reel/Frame 063561/0107 →
Priority Claims (2)
KR 10-2016-0115235 · Sep 7, 2016 · national
KR 10-2017-0114671 · Sep 7, 2017 · national
Continuity (3)
Continuation 16890419 · Jun 2, 2020
Division 16331475
Related Publication 20220269360A1 · Aug 25, 2022